Patent Application
20200104974
The present invention relates to projection of medical information onto the human body in such a way that the projected information conforms to the shape of the area being projected upon.
In the medical field physicians rely on a whole host of medical information in order to make decisions. For example, surgeons can refer to different images (CT scans, X-rays, MRI's, IR maps etc.) and computer-generated operative plans to help guide decision making in the operating room. However, in its current state, medical information can only be displayed for physicians on either paper, computer screen or through a mixed reality head mounted device such as Holo-Lens. The very primitive paper or computer display which offer visualization of medical information, have a significant limitation in that the operator must mentally manipulate and estimate what he/she sees on the screen to the actual patient. Similarly, in sterile environment such as the operating theatre, paper and computer displays cannot reside in local operative field making the medical information less accessible.
On the other hand, mixed reality technology which uses a head mounted device, display the information to the physician virtually into the operative field solving the issue of accessibility. However, these are personalized systems where the experience is only for the wearer of the head mounted display and have inherent problems such as: alignment/registration issues, the need to wear the technology on the head which may cause user discomfort, limited interaction with the virtual image, and display of information only to the user with the wearable device. Given the issues at hand, a new system is needed to display medical information for medical professionals which does not rely on wearable devices and allows for accurate registration and conformation of medical information onto the patient anatomy.
The present invention features a system that allows for medical information be projected onto the human body while remaining accurate and precise without distortion due to non-flat shape of the underlying part of the human body, objects in the operative field, or movement. Furthermore, the user can interact with the projected information through hand gestures, laser pointers etc. to move and alter the information while maintaining contour conformation.
In some aspects, the present invention comprises of projection system which is used to project medical information onto the surface of the human body such that the medical information conforms and registers to the contour of the underlying shape of the region it is being projected upon. The projection system is in communication with one or more projectors and one or more sensors (e.g. visible camera, depth camera, IR camera, head/eye tracker) which capture the topography/area/volume of the region of interest and/or the view of the user, and alter the medical information such that the medical information remains accurate in dimensions (length, width, angles, positioning etc.) when projected into the area of interest. The medical information also adapts to the movements of the underlying surface while maintaining shape conformation. This projected information can be altered in real time (moved, repositioned, stretched, lengthened, shortened) by the user while maintaining shape conformation using modalities such as but not limited to hand gestures, markers or digital pens, tablets or other mobile devices. The projected information can change based on the view point of the user. Finally, the projected information can interact with a dye (surface agent) placed on the area being projected upon which marks (i.e. tattoos) the information onto the surface being projected upon.
Any feature or combination of features described herein are included within the scope of the present invention provided that the features included in any such combination are not mutually inconsistent as will be apparent from the context, this specification, and the knowledge of one of ordinary skill in the art. Additional advantages and aspects of the present invention are apparent in the following detailed description and claims.
The features and advantages of the present invention will become apparent from a consideration of the following detailed description presented in connection with the accompanying drawings in which:
Referring now to
In another aspect of the present invention, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection adapts to the movement of the surface it is being projected upon (breathing, facial expression) while maintaining conformation to the underlying shape.
In some embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection can be altered by the user (i.e. stretched, scaled, rotated, repositioned) while maintaining conformation to the underlying shape.
In other embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projection is correct from the single preferred user's (i.e. surgeon) point of view and projection change with the user's head position, in order to correctly visualize internal data (e.g. bones, blood vessels) on the surface.
In some other embodiments, medical information (i.e. CT scans, X-rays, blood flow map, thermal maps, surgical guides) is projected onto the anatomy (or anatomical models) such that the projected information can be adapted to best fit the shape of the area projected upon by integrating contour, shape and volume of the region being projected upon into mathematical consideration.
In additional embodiments of the present invention, projected medical information can be interacted with by the user using via multiple interaction modalities like laser pointers, hand gestures, markers or digital pens, scalpels, tablets or other mobile devices while maintaining conformation to the underlying shape.
In further embodiments of the present invention projected medical information can interact with a surface agent, such as a light activated dye or heat activated dye, placed on the area being projected upon which marks (i.e. Tattoos) the information onto the surface being projected upon.
The following is a non-limiting example of the present invention. It is to be understood that said example is not intended to limit the present invention in any way. Equivalents or substitutes are within the scope of the present invention.
A surgeon may acquire medical information such as blood flow and vascularity of a patient's breast tissue using and infrared camera or dye-based imaging system and project this medical information on the patient's breast tissue in such a way that the projection conforms to the contour of the breast such that the areas of poor blood flow are accurately demarcated using the projection system. The area of poor blood flow which is projected can be traced using a marker. The traced region can then be surgically removed by the surgeon.
A surgeon may acquire information on the location of major blood vessels in the abdomen using CT scans prior to performing surgery. Intraoperatively the physician can project the preoperative CT scan onto the abdomen in such a way that the projection conforms to the exact contour of the patient's abdomen as well as the view point of the surgeon. Using this technique, the physician can actually identify the location of the major blood vessels for surgical dissection.
Referring to
A surgeon preforming craniofacial surgery may project a virtual plan onto the surface of the skull guiding them where to make cuts into the mandible. The projected information registers and conforms to the contour of the mandible maintaining accuracy of the cutting locations that were planned before surgery.
Referring to
Although there has been shown and described the preferred embodiment of the present invention, it will be readily apparent to those skilled in the art that modifications may be made thereto which do not exceed the scope of the appended claims. Therefore, the scope of the invention is only to be limited by the following claims. In some embodiments, the figures presented in this patent application are drawn to scale, including the angles, ratios of dimensions, etc. In some embodiments, the figures are representative only and the claims are not limited by the dimensions of the figures. In some embodiments, descriptions of the inventions described herein using the phrase “comprising” includes embodiments that could be described as “consisting essentially of” or “consisting of”, and as such the written description requirement for claiming one or more embodiments of the present invention using the phrase “consisting essentially of” or “consisting of” is met.
This application is a non-provisional and claims benefit of U.S. Patent Application No. 62/737,680 filed Sep. 27, 2018, the specification(s) of which is/are incorporated herein in their entirety by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62737680 | Sep 2018 | US |
