Image-guided therapy (IGT) is based on the registration of pre-operative (e.g., computed tomography, CT) or intra-operative (e.g., ultrasound, US) patient imagery to the actual operative field inside the patient for surgical intervention. Thus, IGT provides freehand navigation or guidance for mechatronic positioning of medical instruments. These methods commonly rely on the localization of surgical equipment with respect to the patient and the imagery. This localization in 3D space is referred to as tracking, and is a key enabling technology for computer assisted interventions.
Electromagnetic (EM) tracking localizes small sensors inside a magnetic field of known geometry, which is created by a field generator (FG). Different small sensors are commercially available, such as sensors for the Ascension dc tracking system, for the Polhemus ac tracking system, a Six DoF Sensor for the NDI Aurora ac tracking system, and a Passive EM transponder of the Calypso GPS for the Body system, referred to as a beacon. Several of these sensors are a few millimeters in length and connected by small gauge insulated wire to an electronic tracking base system.
In general, image guided therapy involves the spatial registration of a 3D medical image for the patient and the EM tracking system with the same spatial fiducials. The EM tracking sensor is then located relative to the 3D medical image, with accuracy of 1 to 5 millimeters.
Techniques are provided for adapting invasive medical tools to removably receive an EM sensor for positioning an operational portion of the tool relative to 3D medical imagery. As used herein, the term invasive medical tool refers to any tool used during superficial, subcutaneous and deep medical procedures including surgical biopsies, surgical resections, image guided biopsies and implant placement.
In a first set of embodiments, an invasive medical tool includes: an operative portion that is configured to perform some invasive medical action. The invasive medical tool also includes a stem having a distal end attached to a proximal end of the operative portion and a proximal end configured to be held outside a subject during the invasive medical action. The invasive medical tool further includes a recess along the stem. The recess is configured to removably engage an electromagnetic tracking system component comprising an electromagnetic sensor and an insulated electrical wire connected to the electromagnetic sensor. The invasive medical tool still further includes a viewport configured to reveal a portion of the recess where the electromagnetic sensor is to be disposed.
In a second set of embodiments, a system includes the invasive medical tool of the first set of embodiments and the electromagnetic tracking system comprising a magnetic field generator configured to be disposed outside a subject into which the tool is to be inserted and the electromagnetic sensor and the insulated electrical wire, wherein the sensor and a portion of the insulated electrical wire are removably disposed inside the recess.
In some embodiments of the second set, the system includes a brace configured to hold motionless two portions of the subject on opposite sides of a joint of the subject.
In a third set of embodiments, a method for guided surgical procedures includes producing three dimensional imagery of a subject relative to spatial fiducials and registering an electromagnetic (EM) tracking system relative to the spatial fiducials. The method further includes inserting a wired sensor and wire of the EM tracking system into a first recess with a first viewport of a first invasive medical tool until the wired sensor is disposed at a desired location and evident through the viewport. The method also includes using the first invasive medical tool in the subject while tracking the position of the wired sensor relative to the three-dimensional imagery of the subject based on the EM tracking system and the spatial fiducials.
In some embodiments of the third set, the method also includes selecting a different second invasive medical tool and removing the wired sensor and wire of the EM tracking system from the first recess of the first invasive medical tool. The method yet further includes inserting the wired sensor and wire of the EM tracking system into a second recess with a second viewport of the second invasive medical tool until the wired sensor is disposed at a desired location and evident through the second viewport. This embodiment even further includes using the second invasive medical tool in the subject while tracking the position of the wired sensor relative to the three-dimensional imagery of the subject based on the EM tracking system and the spatial fiducials.
In some embodiments of the third set, the method still further includes, before producing three-dimensional imagery of the subject, attaching a brace to the subject to immobilize a joint of the subject. The method also includes, before producing the imagery, attaching at least one spatial fiducial on each of at least two different sides of the joint.
In a fourth set of embodiments, an apparatus for guided surgical procedures includes a rigid invasive medical tool. A distal end of the tool is configured for insertion into a body of a subject and a proximal end is configured to be external to the body of the subject when the distal end is inserted. The apparatus also includes a frame configured to removably and rigidly attach to the proximal end of the tool. The apparatus also includes a plurality of electromagnetic tracking system components, each component comprising an electromagnetic sensor rigidly attached to the frame. The plurality of electromagnetic tracking system components is configured to measure position and orientation of the frame with 6 degrees of freedom.
In a fifth set of embodiments, a method for guided surgical procedures includes producing three-dimensional imagery of a subject relative to spatial fiducials; and, registering an electromagnetic (EM) tracking system relative to the spatial fiducials. The method further includes removably attaching a frame to a proximal portion of a rigid invasive medical tool. Multiple electromagnetic tracking system sensors are rigidly attached to the frame and configured to measure position and orientation of the frame with 6 degrees of freedom. The method still further includes computing, automatically on a processor, a location of an operative portion of the rigid tool based on the position and orientation of the frame and on the EM tracking system and the spatial fiducials. Even further, the method includes using the rigid invasive medical tool in the subject while tracking the position and orientation of the operative portion of the rigid tool relative to the three-dimensional imagery of the subject.
Still other aspects, features, and advantages are readily apparent from the following detailed description, simply by illustrating a number of particular embodiments and implementations, including the best mode contemplated for carrying out the invention. Other embodiments are also capable of other and different features and advantages, and its several details can be modified in various obvious respects, all without departing from the spirit and scope of the invention. Accordingly, the drawings and description are to be regarded as illustrative in nature, and not as restrictive.
Embodiments are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings in which like reference numerals refer to similar elements and in which:
A method, system and apparatus are described for image guided surgical procedures. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
Notwithstanding that the numerical ranges and parameters setting forth the broad scope are approximations, the numerical values set forth in specific non-limiting examples are reported as precisely as possible. Any numerical value, however, inherently contains certain errors necessarily resulting from the standard deviation found in their respective testing measurements at the time of this writing. Furthermore, unless otherwise clear from the context, a numerical value presented herein has an implied precision given by the least significant digit. Thus, a value 1.1 implies a value from 1.05 to 1.15. The term “about” is used to indicate a broader range centered on the given value, and unless otherwise clear from the context implies a broader range around the least significant digit, such as “about 1.1” implies a range from 1.0 to 1.2. If the least significant digit is unclear, then the term “about” implies a factor of two, e.g., “about X” implies a value in the range from 0.5 X to 2X, for example, about 100 implies a value in a range from 50 to 200. Moreover, all ranges disclosed herein are to be understood to encompass any and all sub-ranges subsumed therein. For example, a range of “less than 10” for a positive only parameter can include any and all sub-ranges between (and including) the minimum value of zero and the maximum value of 10, that is, any and all sub-ranges having a minimum value of equal to or greater than zero and a maximum value of equal to or less than 10, e.g., 1 to 4.
Some embodiments of the invention are described below in the context of certain invasive medical tools, such as needles, cannula, spatulas, whirlybirds, curettes, knives, clamps and forceps with attached tubes providing a subcutaneous recess for EM wired sensors. However, the invention is not limited to this context. In other embodiments, other invasive medical tools, including surgical tools, are used, such as flexible or rigid endoscopes, colposcopes, aspirators, biopsy needles, infusion needles, suction tips, catheters, stylets, introducers, robotically controlled arms and implements, and implants such as stents, electrodes, chemical, drug, or energy eluting compounds, among others, with built-in recesses, such as irrigation tubes, or tubes attached internally or externally to provide recesses for EM wired sensors. In some embodiments, the EM sensors are more complex combinations of wired or wireless sensors that provide up to 6 degrees of freedom (DoF) and are attached via a removable frame at the base (proximal portion) of the invasive medical tool, wherein the EM sensor remain outside the body of the subject where space is not so limited and size of the EM sensor combination is not so much an issue.
While EM tracking for image-guided therapy (IGT) has been suggested, the number of invasive medical tools outfitted with EM sensors is limited and the price per tool is high. It is noted here that novel modifications to many invasive medical tools render them suitable for removably inserting an EM sensor, so that the relatively highly priced EM sensors can be reused for multiple tools employed during a surgical procedure. A simple position sensor (3 degrees of freedom, DoF) is small enough to be placed on a subcutaneous portion of a tool, at or near the operative portion of the tool, so that a surgeon can determine where the business end of the tool is, relative to co-registered three dimensional medical imagery. If the sensor is connected by a simple conducting wire, the size and expense and power demands of a wireless connection is avoided in the subcutaneous portion of the tool. Thus, a tool is readily adapted for EM tracking without introducing bulky components that interfere with the surgeon's well practiced movements, and without permanently binding the EM tracking device that renders the tool expensive.
Therefore, in various embodiments, a recess is utilized or added to the tool. The recess is configured to removably engage an electromagnetic tracking system component comprising an electromagnetic sensor and an insulated electrical wire connected to the electromagnetic sensor. Because the sensor is removably engaged, it is possible for the sensor to be in any location along the recess. To ensure that the sensor is at the desired location, e.g., at a known distance from the operative portion of the tool, a viewport is included in some embodiments, to make evident what is in the recess at least at or near the desired location. Thus, in these embodiments, the viewport is configured to reveal a portion of the recess where the electromagnetic sensor is to be disposed.
The system 100 also includes a computational system 130, such as computer system 800 described below with reference to
During medical procedures, the system operates on a subject 190, such as a currently or formerly living animal, including a human. Although the subject 190 is depicted for purposes of illustrating the use of the system 100, the subject 190 is not part of the system 100. Spatial fiducials 112 are disposed on or near the subject 190. Thus, the system includes registration markers configured to be placed on or near the subject such that the position of the electromagnetic sensor can be determined relative to a three-dimensional scanned medical image of the subject.
For some medical procedures, such as procedures in the neck or shoulder or hip or wrist or ankle of a human patient, a target volume of the subject includes tissues on either or both sides of one or more joints, including vertebrae. In such circumstances, a brace 114 is included in the system 100 and configured to hold relatively motionless two portions of the subject on opposite sides of a joint of the subject; and, spatial fiducials 112 are disposed on both sides of the joint. The brace 114 is configured to be rigid enough for this purpose and can be adjustable to be reusable with several subjects, as described in more detail below with reference to
According to several embodiments, each of one or more commonly used invasive medical tools is configured to support removably positioning a wired EM sensor at or near an operative portion of the tool. Example invasive medical tools include a cannula, a needle, a catheter, a guided curette, a guided ring curette, a spatula, a whirly bird, a gimmick type curette, a 90 degree canal knife, a round knife, a guided giraffe forceps, a clamp, a laparoscope, and an endoscope, among others. A invasive medical tool includes an operative portion 152 configured to interact with a subcutaneous tissue or organ inside a body of the subject, and a stem 154 configured to extend from a stem distal end at a proximal side of the operative portion 152 of the tool to a stem proximal end configured to be manipulated outside the body of the subject. In some embodiments, one or more mechanical or electrical control wires 156 are disposed inside the stem, e.g., to cause the stem 154 to bend or to cause the operative portion 152 to activate, e.g., to grab or clamp some tissue or organ inside the subject or to rotate a lens or lamp of an endoscope or other optical component. Although depicted as straight in
The system 100 includes an invasive medical tool 150 with a recess 161 that extends along the stem 154. The recess 161 is configured to removably engage an electromagnetic tracking system component comprising the electromagnetic sensor 124 and an insulated electrical wire 122 connected to the electromagnetic sensor 124. In the illustrated embodiment, the recess is a lumen of a tube 162 that is attached along the stem. In other embodiments, the recess 161 is provided by an extant lumen in the stem, such as an irrigation tube. The recess extends from a proximal portion of the stem to at least a desired location for the EM sensor. To ensure a surgeon that the operative portion of the tool is as close as possible to a position identified relative to the 3D medical imagery, it is advantageous if the sensor is disposed as close as possible to the operative portion of the tool without interfering with the operation of the tool. Thus, in some embodiments, a distal end 165 of the recess is at the proximal side of the operative portion 152. In some embodiments, this is coincident with a distal end of the stem 154.
The invasive medical tool 150 includes a viewport 164 into the recess 161. The viewport 164 is configured to reveal a portion of the recess 161 where the electromagnetic sensor 124 is to be disposed. In some embodiments, the viewport 164 is a transparent part of the tube 162 or wall of another recess. In some embodiments, the viewport 164 is an opening through a wall of the tube 162 or other recess. In some embodiments, the recess has a diameter between about 0.1 and 0.6 millimeters that is sufficient to accommodate a modern miniature EM tracking sensor and its electrical connecting wire.
In the illustrated embodiment, in order to keep the sensor from shifting its position from the desired location in the viewport during use of the tool 150, the tool 150 includes a lock 166 to hold the wire 122, in place; and, thus keep the sensor 124 in the viewport 164. In some embodiments, the lock 166 is a Luer lock. In some embodiments, the lock also provides a seal at a proximal end of the tool, wherein the proximal end of the tool is configured to remain outside a body of subject into which the tool is inserted, and the seal is configured to pass the insulated electrical wire and to prevent at least one of any of fluid flow around the insulated electrical wire or pressure loss around the insulated electrical wire or movement of the insulated electrical wire.
In
Although processes, structures, equipment, and devices are depicted in
In step 201, a brace 114 is fixed to a subject to hold relatively stationary (motionless) target tissues on either side of a joint in a region of interest (also called target tissues, herein). In addition, multiple spatial fiducials 112 are placed on or near or inside the subject. The spatial fiducials are configured to be detected by the medical imaging system 110 and are accessible to the EM tracking system 120 so that the EM tracking system 120 can be co-registered spatially with the medical imaging system 110. When a joint in the subject is included in the region of interest, the spatial fiducials 112 are distributed to place at least one spatial fiducial 112 on each different side of the joint. In some embodiments, a joint is not included in the region of interest; and, step 201 omits fixing a brace 114 to the subject. Step 201 still includes placing multiple spatial fiducials 112 on or near or inside the subject; but, omits placing spatial fiducials 112 on different sides of the joint.
In step 203, the subject is placed in operational range of the medical imaging system 110; and, the system 110 is operated to produce a three dimensional (3D) medical image of the target tissues and the spatial fiducials 112. The 3D medical imagery is thus registered to the positions of the spatial fiducials 112.
In step 205, The EM tracking system field generator 123 is positioned to produce an EM tracking field in a tracking volume occupied by the target tissues and spatial fiducials 112. In some embodiments, one or more of the spatial fiducials 112 each includes a wired or wireless EM tracking sensor so that the positions of such spatial fiducials 112 are determined by the system 120. If any spatial fiducials 112 do not include a wired or wireless EM tracking sensor, then a wired or wireless EM tracking sensor, such as wired sensor 124, or other tracer provided with the system 120, is placed successively at each such accessible spatial fiducial 112 so that the EM tracking system 120 can determine the position of each such spatial fiducial 112.
In step 211, an invasive medical tool with a recess for engaging an EM tracking wired sensor and wire, and with a viewport into that recess, (e.g., invasive medical tool 150) is selected for use during a medical procedure on the subject 190. In step 213, the EM tracking wired sensor 124 is inserted into the recess until the sensor 124 is evident in the viewport (e.g., visible through the viewport opening or transparent window of tube 162). In some embodiments, step 213 includes locking the sensor 124 or sensor wire 122 in place inside the tool, e.g., inside tool 150 with lock 166. Any locking mechanism known in the art can be used in various embodiments as lock 166, such as using a Luer lock, twist lock, or pressure locking device.
In step 215, while the tool is manipulated inside the subject by a surgeon, a position of the sensor relative to the 3D medical imagery is presented on a display device in view of the surgeon. The surgeon can infer the position of the operative portion of the tool relative to the target tissue based on the position of the EM tracking wired sensor 124 relative to the 3D medical imagery; thus, providing a substantial assist in the way of image guided therapy.
In step 221, it is determined by the surgeon or therapist whether to change the tool. If so, then in step 223 the EM tracking wired sensor 124 is removed from the current tool, e.g., tool 150. In some embodiments, step 223 includes sterilizing the tool or the EM sensor 124 and wire or some combination. The process passes back to step 211 and following steps to select and use a different tool with recess and viewport, if such a different tool is available, e.g. a tool 150 with a different operative portion 152. This loop continues until it is determined in step 231 that the invasive medical procedure on the target tissue is complete. If not complete, the process continues with step 215 to continue to manipulate the tool and display the sensor position relative to the 3D imagery.
If the invasive medical procedure is complete, then the process continues with step 233, in which the EM tracking wired sensor 124 is removed from the current tool, e.g., a tool 150. In some embodiments, step 235 includes sterilizing the tool or the EM sensor 124 and wire or some combination. In step 235 the brace 114, if any, and spatial fiducials 112 are removed from the subject. The process then ends.
Thus, the system 100 and method 200 allow for the reuse of expensive EM tracking components for very precise image guided therapy using multiple inexpensive invasive medical tools that need provide only: a recess for accepting an EM tracking wired sensor with connected wire; and a viewport into the recess.
In this section, several different example embodiments are described for tool 150.
The vertically hatched dots represent spatial fiducials 512 (that serve as imaging markers) on the headpiece 510, the chest harness 530, and on the skin of the subject 590, that would be used to ensure that the ultimate correlation of the scan lined up with the subject positioning.
In the embodiments described in this section, instead of a recess and viewport, a subcutaneous rigid tool is outfitted with a removable frame on the proximal portion of the tool stem to which is attached an EM sensor combination that provides six (6) degrees of freedom (DoF). This configuration, while different and more complex than the system of
The system 600 also includes a computational system 630, such as computer system 800 described below with reference to
Although the subject 190 is depicted for purposes of illustrating the use of the system 600, the subject 190 is not part of the system 600.
The frame 610 is configured to removably and rigidly attach to a proximal portion of each of one or more invasive medical tools. As described above, an invasive medical tool includes an operative portion 152 configured to arrive at or interact with a subcutaneous tissue or organ inside a body of the subject, and a stem 154 configured to extend from a stem distal end at a proximal side of the operative portion 152 of the tool to a stem proximal portion configured to be manipulated outside the body of the subject. In some embodiments, one or more mechanical or electrical control wires 156 are disposed inside the stem, e.g., to cause the operative portion 152 to activate, e.g., to grab or clamp some tissue or organ inside the subject or to rotate a lens or lamp of an endoscope or other optical component. Although depicted as straight in
The frame includes a base to which the sensor suite is attached, such as the Six degree of freedom (6 DoF) Sensor for the NDI Aurora ac tracking system. The frame also includes one or more adjustable fasteners configured to removably attach the frame rigidly to the proximal portion of one or more invasive medical tools, as depicted in
In step 703, the subject is placed in operational range of the medical imaging system 110; and, the system 110 is operated to produce a three dimensional (3D) medical image of the target tissues and the spatial fiducials 612. The 3D medical imagery is thus registered to the positions of the spatial fiducials 612.
In step 705, The EM tracking system field generator 623 is positioned to produce an EM tracking field in a tracking volume occupied by the target tissues and spatial fiducials 112, as in step 205.
In step 711, one or more invasive medical tools (e.g., invasive medical tool 650) are selected for use during a medical procedure on the subject 690. In step 713, the frame 610 with the EM tracking sensor suite 612 is removably attached to a proximal portion of the stem of the selected one or more invasive medical tools. The distance and direction from the base of the frame where the sensor suite is attached to the operative portion of the tool is measured, e.g., with a manual device, such as a caliper or compass, or automatically using a tracer of the EM tracking system 120, and saved for use in a later step, e.g., on a computer-readable medium in computational system 630.
In step 715, while the one or more tools are manipulated inside the subject by a surgeon, a position of the operative portion 152 relative to the 3D medical imagery is presented on a display device in view of the surgeon. The module 140 determines the position of the operative portion of the tool relative to the 3D medical imagery based on the position and orientation of the sensor suite 612 and the known position of the fiducials and the distance and direction from the base of the frame where the sensor suite is attached to the operative portion of the tool. A position of the operative portion 152 of the tool 650 relative to the 3D medical imagery is presented on a display device in view of the surgeon; thus, providing a substantial assist in the way of image guided therapy.
In step 721, it is determined by the surgeon or therapist whether to change one or more tools. If so, then in step 723 the frame is detached from the current tool, e.g., tool 650. In some embodiments, step 723 includes cleaning or sterilizing the frame. The process passes back to step 711 and following steps to select and attach the frame to a different tool, if such a tool is amenable to the attachment mechanism of the frame, e.g. a tool 650 with a different operative portion 652. This loop continues until it is determined in step 731 that the invasive medical on the target tissue is complete. If not complete, the process continues with step 715 to continue to manipulate the tool and display the sensor position relative to the 3D imagery.
If the invasive medical procedure is complete, then the process continues with step 733, in which the frame is detached from the current tool, e.g., a tool 650. In some embodiments, step 733 includes cleaning or sterilizing the frame. In step 735 the brace 114, if any, and spatial fiducials 112 are removed from the subject. The process then ends.
Thus, the system 600 and method 700 allow for the reuse of expensive EM tracking components for very precise image guided therapy using multiple inexpensive invasive medical tools and a reusable frame rigidly attached to an EM tracking sensor suite that provides 6 DoF.
A sequence of binary digits constitutes digital data that is used to represent a number or code for a character. A bus 810 includes many parallel conductors of information so that information is transferred quickly among devices coupled to the bus 810. One or more processors 802 for processing information are coupled with the bus 810. A processor 802 performs a set of operations on information. The set of operations include bringing information in from the bus 810 and placing information on the bus 810. The set of operations also typically include comparing two or more units of information, shifting positions of units of information, and combining two or more units of information, such as by addition or multiplication. A sequence of operations to be executed by the processor 802 constitutes computer instructions.
Computer system 800 also includes a memory 804 coupled to bus 810. The memory 804, such as a random access memory (RAM) or other dynamic storage device, stores information including computer instructions. Dynamic memory allows information stored therein to be changed by the computer system 800. RAM allows a unit of information stored at a location called a memory address to be stored and retrieved independently of information at neighboring addresses. The memory 804 is also used by the processor 802 to store temporary values during execution of computer instructions. The computer system 800 also includes a read only memory (ROM) 806 or other static storage device coupled to the bus 810 for storing static information, including instructions, that is not changed by the computer system 800. Also coupled to bus 810 is a non-volatile (persistent) storage device 808, such as a magnetic disk or optical disk, for storing information, including instructions, that persists even when the computer system 800 is turned off or otherwise loses power.
Information, including instructions, is provided to the bus 810 for use by the processor from an external input device 812, such as a keyboard containing alphanumeric keys operated by a human user, or a sensor. A sensor detects conditions in its vicinity and transforms those detections into signals compatible with the signals used to represent information in computer system 800. Other external devices coupled to bus 810, used primarily for interacting with humans, include a display device 814, such as a cathode ray tube (CRT) or a liquid crystal display (LCD), for presenting images, and a pointing device 816, such as a mouse or a trackball or cursor direction keys, for controlling a position of a small cursor image presented on the display 814 and issuing commands associated with graphical elements presented on the display 814.
In the illustrated embodiment, special purpose hardware, such as an application specific integrated circuit (IC) 820, is coupled to bus 810. The special purpose hardware is configured to perform operations not performed by processor 802 quickly enough for special purposes. Examples of application specific ICs include graphics accelerator cards for generating images for display 814, cryptographic boards for encrypting and decrypting messages sent over a network, speech recognition, and interfaces to special external devices, such as robotic arms and medical scanning equipment that repeatedly perform some complex sequence of operations that are more efficiently implemented in hardware.
Computer system 800 also includes one or more instances of a communications interface 870 coupled to bus 810. Communication interface 870 provides a two-way communication coupling to a variety of external devices that operate with their own processors, such as printers, scanners and external disks. In general, the coupling is with a network link 878 that is connected to a local network 880 to which a variety of external devices with their own processors are connected. For example, communication interface 870 may be a parallel port or a serial port or a universal serial bus (USB) port on a personal computer. In some embodiments, communications interface 870 is an integrated services digital network (ISDN) card or a digital subscriber line (DSL) card or a telephone modem that provides an information communication connection to a corresponding type of telephone line. In some embodiments, a communication interface 870 is a cable modem that converts signals on bus 810 into signals for a communication connection over a coaxial cable or into optical signals for a communication connection over a fiber optic cable. As another example, communications interface 870 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN, such as Ethernet. Wireless links may also be implemented. Carrier waves, such as acoustic waves and electromagnetic waves, including radio, optical and infrared waves travel through space without wires or cables. Signals include man-made variations in amplitude, frequency, phase, polarization or other physical properties of carrier waves. For wireless links, the communications interface 870 sends and receives electrical, acoustic or electromagnetic signals, including infrared and optical signals, that carry information streams, such as digital data.
The term computer-readable medium is used herein to refer to any medium that participates in providing information to processor 802, including instructions for execution. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media and transmission media. Non-volatile media include, for example, optical or magnetic disks, such as storage device 808. Volatile media include, for example, dynamic memory 804. Transmission media include, for example, coaxial cables, copper wire, fiber optic cables, and waves that travel through space without wires or cables, such as acoustic waves and electromagnetic waves, including radio, optical and infrared waves. The term computer-readable storage medium is used herein to refer to any medium that participates in providing information to processor 802, except for transmission media.
Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, a magnetic tape, or any other magnetic medium, a compact disk ROM (CD-ROM), a digital video disk (DVD) or any other optical medium, punch cards, paper tape, or any other physical medium with patterns of holes, a RAM, a programmable ROM (PROM), an erasable PROM (EPROM), a FLASH-EPROM, or any other memory chip or cartridge, a carrier wave, or any other medium from which a computer can read. The term non-transitory computer-readable storage medium is used herein to refer to any medium that participates in providing information to processor 802, except for carrier waves and other signals.
Logic encoded in one or more tangible media includes one or both of processor instructions on a computer-readable storage media and special purpose hardware, such as ASIC 820.
Network link 878 typically provides information communication through one or more networks to other devices that use or process the information. For example, network link 878 may provide a connection through local network 880 to a host computer 882 or to equipment 884 operated by an Internet Service Provider (ISP). ISP equipment 884 in turn provides data communication services through the public, world-wide packet-switching communication network of networks now commonly referred to as the Internet 890. A computer called a server 892 connected to the Internet provides a service in response to information received over the Internet. For example, server 892 provides information representing video data for presentation at display 814.
The invention is related to the use of computer system 800 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 800 in response to processor 802 executing one or more sequences of one or more instructions contained in memory 804. Such instructions, also called software and program code, may be read into memory 804 from another computer-readable medium such as storage device 808. Execution of the sequences of instructions contained in memory 804 causes processor 802 to perform the method steps described herein. In alternative embodiments, hardware, such as application specific integrated circuit 820, may be used in place of or in combination with software to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
The signals transmitted over network link 878 and other networks through communications interface 870, carry information to and from computer system 800. Computer system 800 can send and receive information, including program code, through the networks 880, 890 among others, through network link 878 and communications interface 870. In an example using the Internet 890, a server 892 transmits program code for a particular application, requested by a message sent from computer 800, through Internet 890, ISP equipment 884, local network 880 and communications interface 870. The received code may be executed by processor 802 as it is received, or may be stored in storage device 808 or other non-volatile storage for later execution, or both. In this manner, computer system 800 may obtain application program code in the form of a signal on a carrier wave.
Various forms of computer readable media may be involved in carrying one or more sequence of instructions or data or both to processor 802 for execution. For example, instructions and data may initially be carried on a magnetic disk of a remote computer such as host 882. The remote computer loads the instructions and data into its dynamic memory and sends the instructions and data over a telephone line using a modem. A modem local to the computer system 800 receives the instructions and data on a telephone line and uses an infra-red transmitter to convert the instructions and data to a signal on an infra-red a carrier wave serving as the network link 878. An infrared detector serving as communications interface 870 receives the instructions and data carried in the infrared signal and places information representing the instructions and data onto bus 810. Bus 810 carries the information to memory 804 from which processor 802 retrieves and executes the instructions using some of the data sent with the instructions. The instructions and data received in memory 804 may optionally be stored on storage device 808, either before or after execution by the processor 802.
In one embodiment, the chip set 900 includes a communication mechanism such as a bus 901 for passing information among the components of the chip set 900. A processor 903 has connectivity to the bus 901 to execute instructions and process information stored in, for example, a memory 905. The processor 903 may include one or more processing cores with each core configured to perform independently. A multi-core processor enables multiprocessing within a single physical package. Examples of a multi-core processor include two, four, eight, or greater numbers of processing cores. Alternatively, or in addition, the processor 903 may include one or more microprocessors configured in tandem via the bus 901 to enable independent execution of instructions, pipelining, and multithreading. The processor 903 may also be accompanied with one or more specialized components to perform certain processing functions and tasks such as one or more digital signal processors (DSP) 907, or one or more application-specific integrated circuits (ASIC) 909. A DSP 907 typically is configured to process real-world signals (e.g., sound) in real time independently of the processor 903. Similarly, an ASIC 909 can be configured to performed specialized functions not easily performed by a general purposed processor. Other specialized components to aid in performing the inventive functions described herein include one or more field programmable gate arrays (FPGA) (not shown), one or more controllers (not shown), or one or more other special-purpose computer chips.
The processor 903 and accompanying components have connectivity to the memory 905 via the bus 901. The memory 905 includes both dynamic memory (e.g., RAM, magnetic disk, writable optical disk, etc.) and static memory (e.g., ROM, CD-ROM, etc.) for storing executable instructions that when executed perform one or more steps of a method described herein. The memory 905 also stores the data associated with or generated by the execution of one or more steps of the methods described herein.
In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. Throughout this specification and the claims, unless the context requires otherwise, the word “comprise” and its variations, such as “comprises” and “comprising,” will be understood to imply the inclusion of a stated item, element or step or group of items, elements or steps but not the exclusion of any other item, element or step or group of items, elements or steps. Furthermore, the indefinite article “a” or “an” is meant to indicate one or more of the item, element or step modified by the article.
The entire contents of each of the following references is hereby incorporated by reference as if fully set forth herein, except for terminology inconsistent with that used herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2019/055158 | 10/8/2019 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62742786 | Oct 2018 | US |