Patent Application
20080262304
The present invention relates to in vivo imaging. More specifically the invention relates to an apparatus and method for concurrent receiving, recording, processing and presenting information gathered by an in-vivo sensing device.
In-vivo devices, such as, for example, capsules having image capturing capabilities, may transmit streams of images while progressing through body lumens. Such a stream of images may be recorded in a memory of a recording device and may be used by human operators as, for example, a source of information regarding the health condition of such body lumens.
There is provided, in accordance with some embodiments of the present invention an in-vivo sensing system which may include an in-vivo sensing device, such as, for example, a capsule having image capturing capabilities, and a receiver/recorder, to receive information, for example, a stream of images from the in-vivo sensing device and to store the stream of images in a memory for a later use.
In addition, the in-vivo sensing system may include a workstation and/or a portable device, capable of downloading the stream of images from the receiver/recorder and capable of processing and/or analyzing and/or displaying the stream of images, for example in real time. According to some embodiments of the present invention, the information may be downloaded, for example from the receiver/recorder to a portable memory in real time.
Moreover, according to some embodiments of the present invention, the receiver/recorder may be capable of recording the information from the sensing device, for example to a memory, while simultaneously accepting input from the sensing device. An associated workstation and/or portable device may be capable of controlling the receiver/recorder to download selected images in a selected order while the receiver/recorder is recording other images of the stream of images.
Embodiments of the invention are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like reference numerals indicate corresponding, analogous or similar elements, and in which:
It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity.
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the invention. However it will be understood by those of ordinary skill in the art that the embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, procedures, components and circuits have not been described in detail so as not to obscure the embodiments of the invention.
According to some embodiments of the present invention, an in-vivo sensing system may include an in-vivo sensing device, such as, for example, a capsule having image capturing capabilities, and a receiver/recorder, to receive a stream of images from the in-vivo sensing device and to store the stream of images in a memory for a later use. In vivo sensing systems other than capsules may be used.
Embodiments of the present invention may be used in conjunction with an in-vivo sensing system or device such as described in U.S. application Ser. No. 10/046,540, which is hereby incorporated by reference. The system according to other embodiments may be used in conjunction with an imaging device and/or receiving system similar to embodiments described in U.S. Pat. No. 5,604,531 to Iddan et al. and/or in International Application number WO 01/65995 entitled “A Device And System For In-Vivo Imaging”, published on 13 Sep., 2001, all of which are hereby incorporated by reference.
As illustrated in the following description, sensing device 4 may gather information, such as, for example, images, while inside a patient's body, and may be able to transmit at least that information to receiver/recorder 6 via wireless signals 10 from inside the patient's body. Receiver/recorder 6 may include a memory 12, and/or a buffer and may be able to record information received from sensing device 4 on memory 12. Optionally receiver/recorder 6 may include a display 18 which may include an LCD, TFT, CRT, OLED or other suitable panels. The display may be integrated into receiver/recorder 6 or may be operatively connected to receiver/recorder 6. Receiver/recorder 6 may be able to transfer the received and/or recorded information to display 18 via, for example, a wireless or hard-wired medium.
In some embodiments, receiver/recorder 6 may be or be included in a hand-held or portable device that may include or be connected to an antenna 8. Antenna 8 may be suitable for collecting or transmitting for example wireless signals 10 that may be transmitted from or to device 4 while device 4 is in a patient's body. In some embodiments, receiver/recorder 6 may include one or more processors 14 that may for example encode or de-code wireless signals 10 for display on a display 18, and an amplifier 17 that may be suitable for amplifying a signal 10 received from device 4. In some embodiments, receiver/recorder 6 may be or include for example a personal digital assistant or other hand-held or portable computing device.
In some embodiments, processor 14 may process and/or present information received from receiver/recorder 6 to a human operator while sensing device 4 is still inside the patient's body, and while receiver/recorder 6 is still recording information gathered by sensing device 4. Display 18 unit may include an LCD (Liquid Crystal Display), TFT (Thin Film Transistor), CRT (Cathode Ray Tube) and an OLED (Organic Light Emitting Device) or other suitable panels.
In some embodiments, receiver/recorder 6 may include a control panel such as for example a key pad 13 or keys that may be configured to issue control commands. Such control commands may be encoded or otherwise processed by for example processor 14 to issue commands by wireless signals 10 to device 4.
In some embodiments, such control commands may include for example commands to start or stop imaging, to start or stop collecting samples or other commands to alter a state of one or more functions of device 4.
In operation, receiver/recorder 6 may be held by for example a user or operator on or close to a patient's body and moved around for example an area of the body corresponding to the patient's gastro-intestinal tract. Antenna 8 may be part of or connected to receiver/recorder 6 and may collect an image or other transmitted data when receiver/recorder 6 is passed near or proximate to an area of patient's body where device 4 is located. The area of the patient's body where the image or other data is received may provide a user or operator with an indication of the approximate location of the device 4. The image or other data received by receiver/recorder 6 may provide a further indication of the location of device 4 within an in-vivo area. In some embodiments, based on the location data received by receiver/recorder 6 or the image displayed, a user or other operator may issue a signal 10 to device 4 to activate, deactivate or otherwise change a state of operation of device 4.
In some embodiments, receiver/recorder 6 may be used in addition to an array of antennas 21 that may be worn on a patient's body in for example a belt or garment 22 to record data transmitted from device 4 on a continuous or periodic basis. In some embodiments, receiver/recorder 6 may include a link 19 such as for example a USB, blue-tooth, radio frequency or infra-red link, that may connect to antennas 21 or to a device attached to antennas 21 as may be worn on a patient's body in garment 22. Receiver/recorder 6 may display some or all of the images or other data that may be transmitted by device 4 to antennas 21. In operation, a user may for example wear or carry receiver/recorder 6, such as for example a PDA, cellular phone, having a display or other computing device, and such user may periodically monitor data transmitted or collected by device 4. A user may transmit such data in, for example real time, to a remote operator such as for example a doctor.
In some embodiments, receiver/recorder 6 may include a memory 12 that may be fixed in or removable from receiver/recorder 6. A non-exhaustive list of examples of memory 12 includes any combination of the following: semiconductor devices such as registers, latches, electrically erasable programmable read only memory devices (EEPROM), not AND (NAND) flash memory devices, not OR (NOR) flash memory devices, non-volatile random access memory devices (NVRM), synchronous dynamic random access memory (SDRAM) devices, RAMBUS dynamic random access memory (RDRAM) devices, double data rate (DDR) memory devices, static random access memory (SRAM), universal serial bus (USB) removable memory, compact flash (CF) memory cards, personal computer memory card international association (PCMCIA) memory cards, security identity module (SIM) cards, MEMORY STICKE cards, and the like; optical devices, such as compact disk read-write memory (CD ROM), and the like; and magnetic devices, such as a hard disk, a floppy disk, a magnetic tape, and the like. In some embodiments memory 12 may hold approximately 10 Gigabytes of memory.
In some embodiments, receiver/recorder 6 may include or be connected to a transmitter such as for example a cellular transmission device 16, that may transmit signals received from device 4 to a remote operator or viewer, or that may receive signals from a remote viewer for further transmission to device 4 by way of for example antenna 8. In some embodiments, the receiver/recorder 6 may download information by way of link 19 and transmit such information to a remote user or store the information in recorder/receiver 6 or in a memory 12 linked to recorder/receiver 6.
As illustrated in the following description, sensing device 4 may be able to gather information e.g. raw data, such as a stream of images, while inside a patient's body. According to one embodiment of the present invention, the sensing device 4 may be able to transmit at least that information to a receiver/recorder 30, for example, via a wireless or hard-wired medium 10 while inside the patient's body. According to one embodiment of the present invention, receiver/recorder 30 may include, for example a memory 32, and/or a buffer and may be able to record information received from sensing device 4, for example on memory 32. According to one embodiment of the present invention, the receiver/recorder 6 may be able to transfer the received and/or recorded information to the portable device 40, such as a SONY VAIO™ lightweight belt-portable computer, a personal digital assistant, and/or to the work station 50 via, for example, a wireless or hard-wired medium 44 such as a USB cable, and may be able to do so while receiving/recording information from sensing device 4 and while the sensing device is inside a patient's body.
According to some embodiments of the present invention, the portable device 40 and/or the workstation 50 may be able to process and/or present information e.g. a stream of images, received from receiver/recorder 6, for example, to a human operator while sensing device 4 is still inside the patient's body, and while receiver/recorder 6 is still recording information gathered by sensing device 4. For example, according to one embodiment of the present invention the portable device 40 may include a display unit 46, and may be able to display the stream of images recorded for example in memory 32 on the display unit 46.
Furthermore, according to some embodiments of the present invention, the information may be transmitted from the receiver/recorder 30 and/or may be transferred, for example through the portable device 40 or the workstation 50, to a removable memory 60, such as a DiskonKey or other small and portable memory device. For example the information e.g. stream of images may be recorded by receiver/recorder 30
In some embodiments, as shown in
According to some embodiments of the present invention, the operating system may include an information display such as a “Toolbox” screen 90 for performing one or more procedures. For example screen 90 may include a check-in patient box 92, a transfer data to removable memory device box 94 a View Real Time box 96 and an Exit box 98. Other functionality may be included.
According to some embodiments of the present invention, sensing device 4 may include a container or housing 241. According to one embodiment of the present invention, within the housing 241, may be, for example, an imaging system 218, a control block 220, a transmitter 222, a receiver 224 and an antenna 226. According to one embodiment of the present invention, sensing device 4 may include a power source 228 to provide power to at least imaging system 218, control block 220, transmitter 222, and optional receiver 224.
According to one embodiment of the present invention, all of the components may be sealed within the sensing device 4 body (the body or shell may include more than one piece); for example, an imaging system, power source, and transmitting and control systems, may all be sealed within the sensing device 4 body.
According to some embodiments of the present invention, sensing device 4 typically may be or may include an autonomous swallowable capsule, but device 4 may have other shapes and need not be swallowable or autonomous. Embodiments of device 4 are typically autonomous, and are typically self-contained. For example, device 4 may be a capsule or other unit where all the components are substantially contained within a container or shell, and where device 4 does not require any wires or cables to, for example, receive power or transmit information.
According to some embodiments of the present invention, transmitter 222 may include control capability for, for example controlling the various operations of device 4, although control capability or one or more aspects of control may be included in a separate component.
According to some embodiments of the present invention, power source 228 may include batteries, such as, for example, silver oxide batteries, Lithium batteries, capacitors, or any other suitable power source. In another embodiment of the present invention, power source 228 may not be present and the device may be powered by an external power source, for example, by a magnetic field or electric field that transmits to the device.
Imaging system 218 may include an optical window 230, at least one illumination source 232, such as, for example, a light emitting diode (LED), an OLED (Organic LED) an imaging sensor 234, and an optical system 236.
Imaging sensor 234 may include a solid state imaging sensor, a complementary metal oxide semiconductor (CMOS) imaging sensor, a charge coupled device (CCD) imaging sensor, a linear imaging sensor, a line imaging sensor, a full frame imaging sensor, a “camera on chip” imaging sensor, or any other suitable imaging sensor.
According to some embodiments of the present invention, control block 220 may control, at least in part, the operation of sensing device 4. For example, control block 220 may synchronize time periods, in which illumination source 232 produce light rays, time periods, in which imaging sensor 234 captures images, and time periods, in which transmitter 22 transmits the images. In addition, control block 220 may produce timing signals and other signals necessary for the operation of transmitter 222, optional receiver 224 and imaging sensor 234. Moreover, control block 220 may perform operations that are complimentary to the operations performed by other components of sensing device 4, such as, for example, image data buffering.
According to some embodiments of the present invention, control block 220 may include any combination of logic components, such as, for example, combinatorial logic, state machines, controllers, processors, memory elements, and the like.
Control block 220, transmitter 222, receiver 224 and imaging sensor 234 may be implemented on any combination of semiconductor dies. For example, and although the invention is not limited in this respect, control block 220, transmitter 222 and receiver 224 may be parts of a first semiconductor die, and imaging sensor 234 may be a part of a second semiconductor die. More over, such a semiconductor die may be an application-specific integrated circuit (ASIC) or may be part of an application-specific standard product (ASSP). According to some embodiments dies may be stacked. According to some embodiments some or all of the components may be on the same die.
According to some embodiments of the present invention, illumination source 232 may produce light rays 238 that may penetrate through optical window 231 and may illuminate an inner portion 240 of a body lumen. A non-exhaustive list of examples of a body lumen may include the gastrointestinal (GI) tract, a blood vessel, a reproductive tract, or any other suitable body lumen.
Reflections 242 of light rays 238 from inner portion 240 of a body lumen may penetrate optical window 230 back into sensing device 4 and may be focused by optical system 236 onto imaging sensor 234. According to some embodiments of the present invention, imaging sensor 234 may receive the focused reflections 242, and in response to an image capturing command 244 from control block 220, imaging sensor 234 may capture an image of inner portion 240 of a body lumen. According to some embodiments of the present invention, control block 220 may receive the image of inner portion 240 from imaging sensor 234 over wires 246, and may control transmitter 222 to transmit the image of inner portion 240 through antenna 226 into wireless medium 210.
Sensing device 4 may passively or actively progress along an axis of a body lumen. In time intervals that may or may not be substantially equal and may or may not be related to that progress, control block 220 may initiate capturing of an image by imaging sensor 234, and may control transmitter 222 to transmit the captured image. Consequently, a stream of images of inner portions of the body lumen may be transmitted from sensing device 4 through wireless medium 210.
Device 4 may transmit captured images embedded in “wireless communication frames”. A payload portion of a wireless communication frame may include a captured image and may include additional data, such as, for example, telemetry information and/or cyclic redundancy code (CRC) and/or error correction code (ECC). In addition, a wireless communication frame may include an overhead portion that may contain, for example, framing bits, synchronization bits, preamble bits, and the like.
According to some embodiments of the present invention, the receiver/recorder 230 may include an antenna 248, a receiver, such as, for example, RF receiver 250, an optional transmitter (TX) 252, a digital modem 254, a memory controller 256, a processor (uP) 258, and a communication controller, such as, for example, a universal serial bus (USB) controller 260. According to other embodiments of the invention, transmitter 52 may be a unit separate from receiver/recorder 230.
According to some embodiments of the present invention, processor 258 may be able to control the operation of RF receiver 250, optional transmitter 252, digital modem 254, memory controller 256, and USB controller 260 through, for example, a bus 262. In addition, RF receiver 250, optional transmitter 252, digital modem 254, memory controller 256, processor 258 and USB controller 260 may be able to exchange data, such as, for example, images received from sensing device 4, or portions thereof, over bus 262. It may be appreciated, that other methods for control and data exchange are possible, and are under the scope of the invention.
According to some embodiments of the present invention, an antenna 248 may be mounted inside or outside receiver/recorder 230, and both RF receiver 250 and optional transmitter 252 may be coupled to antenna 248. According to some embodiments of the present invention, the transmitter 252 may be able to transmit wireless messages to sensing device 4 through antenna 248. According to some embodiments of the present invention, RF receiver 250 may be able to receive transmissions, such as, for example, a stream of wireless communication frames, from sensing device 4 through antenna 248, and may output signal 264, corresponding to the received wireless communication frames.
According to some embodiments of the present invention, the digital modem 254 may receive the sampled analog signal bits 264 of RF receiver 250, and may output digital bits 265 that are made from the analog signal 264, and may for example output a payload valid indication 266, that is received by processor 258. According to some embodiments of the present invention, payload valid indication 266 may be asserted by digital modem 254 to, for example, a high logic level, during payload portion (306 of
The memory controller 256 may include a write direct memory access (DMA) controller 268, a read DMA controller 270, a header storage 272, a write page pointers storage 274, a read page pointers storage 276 and a read/write burst size storage 277. In response to assertion of payload valid indication 266, processor 258 may store in write page pointers storage 274 pointers to pages in memory 212, and may optionally store a header in header storage 272. In addition, processor 258 may activate write DMA controller 268 to receive payload bits 265 of a wireless communication frame from digital modem 254, and to store the payload bits 265 in memory 212. According to some embodiments of the present invention, the receiver/recorder 230 may communicate with workstation 251 and/or a portable device via medium 214. For example, according to some embodiments of the present invention, receiver/recorder 230 may be able to transfer payloads recorded on memory 212 to workstation 251, and may be able to receive controls from workstation 251. Although the invention is not limited in this respect, medium 214 may be, for example, a USB cable and may be coupled to USB controller 260 of receiver/recorder 230 and to a USB controller 280 of device 251. Alternatively, medium 214 may be wireless, and receiver/recorder 230 and device 251 may communicate wirelessly.
According to some embodiments of the present invention, the receiver/recorder 230 may receive from device 251 via USB controller 260 or another suitable link a control to, for example, start sending a stream of payloads as received from sensing device 4 to device 251, starting at a particular payload of the stream. USB controller 60 may forward the control to processor 58 via bus 62.
According to some embodiments of the present invention, in response to the control received from device 251, processor 258 may program memory controller 256 and USB controller 260 so that read DMA controller 270 fetches payloads from memory 212 in the order requested by device 251, sends the fetched payloads to USB controller 260, and USB controller 260 sends the fetched payloads to device 251. For example, processor 258 may write to read page pointers storage 276 pointers to portions of is memory 212 from which read DMA controller 270 may start fetching payloads. In addition, processor 258 may write to read/write burst size storage 277 the number of portions of memory 212 that read DMA controller 270 may fetch in one burst.
The read DMA controller 270 may access memory 212 via memory bus 278 to fetch recorded payloads during times in which write DMA controller 268 does not access memory 212. For at least this purpose, write DMA controller 268 may, for example, output an indication 284 to read DMA controller 270. According to some embodiments of the present invention, the write DMA controller 268 may assert indication 284 to, for example, a high logic level, in response to the assertion of payload valid indication 266, and may de-assert indication 284 to, for example, a low logic level, after completing writing the header to memory 212. According to some embodiments of the present invention, the read DMA controller 270 may start fetching recorded payloads from memory 212 after indication 284 is de-asserted, and may fetch from memory 212 a number of portions equal to the number stored in read/write burst size storage 277.
For example, according to some embodiments of the present invention, the number stored in read/write burst size storage 277 may be related to the number of pointers stored in read page pointers storage 276 and/or to the time available for read DMA controller 270 to fetch recorded payloads from memory 212.
Read DMA controller 270 may send processor 258 an indication over, for example, bus 262, to notify processor 258 of the end of burst.
According to some embodiments moving backwards and forwards in the memory may be enabled. According to other embodiments data may be transmitted (e.g. fetched) directly from the digital modem 254 to the USB controller 260. Thus, writing to read DMA 270 may not be necessary. According to some embodiments read DMA 270 need not be included in the receiver/recorder 230.
Device 251 may include a processor 286, at least one human interface device (HID) 288 such as, for example, a mouse or a keyboard, a memory 290, and a display controller 292 coupled to display unit 216.
According to some embodiments of the present invention, the processor 258 may be able to control the operation of USB controller 280, HID 288, memory 290 and display controller 292 through a bus 294. In addition, USB controller 280, processor 286, HID 288, memory 290 and display controller 292 may be able to exchange data, such as, for example, payloads of wireless communication frames received from receiver/recorder 230, or portions thereof, over bus 294.
According to some embodiments of the present invention, the payloads of wireless communication frames received from receiver/recorder 230 may be transferred from USB controller 280 to memory 290 in a DMA process over bus 294, or by way of processor 286.
According to some embodiments of the present invention, the images may be extracted from payloads stored in memory 290 and may be transferred to display unit 216 by way of display controller 292 to be displayed, and/or may be analyzed by processor 286.
A non-exhaustive list of examples of processors 258 and 286 includes a central processing unit (CPU), a digital signal processor (DSP), a reduced instruction set computer (RISC), a complex instruction set computer (CISC) and the like. Moreover, processors 220, 258 and/or 286 may each be part of an application specific integrated circuit (ASIC) or may each be a part of an application specific standard product (ASSP).
A non-exhaustive list of examples of device 251 may include a original equipment manufacturer (OEM) dedicated workstation, a desktop personal computer, a server computer, a laptop computer, a personal digital assistant, a notebook computer, a hand-held computer, and the like.
Reference is made now in addition to
According to some embodiments of the present invention, an exemplary payload of a wireless communication frame transmitted by sensing device 4 may include a captured image of, for example, 256 pixels by 256 pixels and ECC. Sensing device 4 may transmit, for example, two wireless communication frames per second in substantially equal frame time intervals (300) of 500 milliseconds (mS). During a transmission portion (302) of a frame time interval, sensing device 4 may transmit a wireless communication frame, and during a pausing portion (304) of a frame time interval, sensing device 4 may not transmit. In addition, during a payload portion (306) of transmission portion (302), sensing device 4 may transmit the payload of a wireless communication frame, while during the rest of a transmission portion (302), sensing device 4 may transmit the overhead of a wireless communication frame. According to another embodiment a pausing portion (304) may not be needed. Fetching and transmission may be preformed, almost simultaneously during a transmission period (302), as described, for example, below.
According to some embodiments of the present invention, an optional receiver 224 may be able to receive wireless messages via wireless medium 210 through antenna 226, and control block 220 may be able to capture these messages. A non-exhaustive list of examples of such messages includes activating or de-activating image capturing by sensing device 4, controlling the time intervals for capturing images, activating or de-activating transmissions from sensing device 4, or any other suitable messages.
According to some embodiments of the present invention, a write DMA controller 268 may receive payload bits 265, may access memory 212 via a memory bus 278, and may store payload bits 265 in portions of memory 212 pointed to by the pointers stored in write page pointers storage 274. In response to the following de-assertion of payload valid indication 266, processor 258 may send a control to memory controller 256 to indicate the end of the payload bits 265. In response, write DMA controller 268 may append the header stored in header storage 272 to the last byte of the payload bits 265 or before the first byte in memory 212, and may terminate its operation. According to some embodiments of the present invention, as shown in
According to some embodiments of the present invention, the process of processor 258 activating write DMA controller 268 to independently store payload bits 26 in memory 212 may repeat itself for frames of a stream of wireless communication frames. Moreover, the order in which the payloads were received from sensing device 4 may be traceable in memory 212.
Reference is now made to
According to some embodiments of the present invention, for example, as shown in
According to one embodiment of the present invention, the receiver/recorder 6 may simultaneously record information received from the sensing device 4 on a memory, such as memory 12, process the information and display the information on a display, such as display 18 (as shown in
According to another embodiment of the present invention, the receiver/recorder 6 may simultaneously record the information received from the sensing device 4 on a memory, such as memory 32, download the information from the memory to a workstation 50 or to a portable device 40. The information may be simultaneously displayed, during the downloading/processing period 450 and the recording period 440 on a display, such as display 46.
According to some embodiments of the present invention, a control button may be included in the display, such as display 18, that may allow a user to for example, fast-forward, rewind, stop play or reach the beginning or end of, for example, a stream of images, in real time, while the sensing device is still in a patient's body, and during the recording period 440 and downloading/processing period 450.
In step 720 the approximate location of an in-vivo sensor may be determined for example based on the location of the receiver/recorder when a signal from the sensor is received by the receiver/recorder. For example, a user may pass the receiver/recorder over the abdomen of the patient, and stop when images appear on a display. Location determination need not be used in some embodiments.
In step 730, a receiver/recorder may display images or other information that was received from the in-vivo sensor.
In some embodiments, images may be recorded or transmitted from the receiver/recorder to a memory or to a remote user by way of, for example, cellular or other magnetic waves.
While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the spirit of the invention.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IL05/00696 | 6/30/2005 | WO | 00 | 1/25/2008 |
| Number | Date | Country | |
|---|---|---|---|
| 60583882 | Jun 2004 | US | |
| 60667074 | Apr 2005 | US |
