Patent Application
20090306498
This invention relates generally to systems and methods for removing various biological tissue samples, including follicular units, from a body surface and, in particular, to methods and devices that utilize subsurface imaging to reduce potential damage to and maintain the integrity of the harvested hair follicles and/or tissue samples.
There are various known tools and instruments for removing biological tissue samples from the body. For example, biopsy needles and punches are used when a small tissue specimen is required for examination, for example, to identify certain medical conditions. Another example of the biological tissue which is often desired to be removed or harvested is a hair follicle.
Hair transplantation procedures are well-known, and typically involve harvesting donor hair grafts from the “donor areas,” for example, side and back fringe areas of the patient's scalp, or other body surfaces, and implanting them in a bald area (“recipient area”). Various techniques were developed over the years for harvesting donor hair grafts. Recently more physicians employ a technique called Follicular Unit Extraction (“FUE”) that allows harvest of individual follicular units without a need to cut a strip of tissue from the patient's scalp.
An FUE method for harvesting follicular units utilizes a hollow needle punch having a cutting edge and an interior lumen with a diameter of for example, 1 mm. Generally, based on visualization of each follicular unit through magnifying optics, the needle punch advances along an axis of a follicular unit to be extracted. Thereafter, the follicular units are easily removed, e.g., using forceps, for subsequent implantation into a recipient site with a specially devised insertion needle. While it is a laborious procedure, it has distinct advantages over another known “strip harvesting” technique, like avoiding scarring associated with cutting a strip of scalp, reducing patient's discomfort, and reducing recovery time.
One of the limitations, however, of the FUE-based devices and methods is caused by the fact that the hair follicles do not maintain the same direction of growth under the skin as they do above the skin. Quite often a hair follicle significantly changes its direction or angle underneath the skin, and advancing the punch based on the visible portion of the hair follicle above the skin may result in follicle transection, damaging it or rendering it unusable for transplantation,
In general, attempts have been made to look at subsurface skin images up to about 1 mm when examining an epidermis layer of skin (e.g., for treating skin cancer). There are several publications that describe systems that have been used to allow for detection depth of up to 1.5 mm with some limited resolution to investigate at least approximate architecture of the skin lesions. Similarly, some work has been described for subsurface imaging at depths substantially greater than 5-6 mm, or to enhance the visibility of high-contrast blood vessels. U.S. Pat. No. 7,239,909 describes an imaging system to enhance visibility of subcutaneous blood vessels based on reflected infrared light. While certain developments were made to visualize high-contrast blood vessels which are usually located at least 5 mm or more below the skin level, there are no known systems or devices that provide clear images of low-contrast tissue/structures, for example, a hair shaft below the skin, and/or in some instances at least a portion of a bulb of a hair follicle below the skin.
Despite certain advances in improving the tools and systems for harvesting of biological tissue, such as hair follicles, there remains a need for a more efficient harvesting tool or system that increases the yield of usable harvested specimens by visualizing the subcutaneous structure and orientation of such specimens.
According to one aspect of the present invention, a method for determining subsurface information about a biological unit, such as a follicular unit, is provided. In one example, the method comprises imaging a follicular unit above a body surface using light of a first wavelength to form a first resultant image (or, in other words, imaging and processing the information to identify the follicular unit above the body surface), imaging the follicular unit above and below the body surface using either light of a second wavelength or having a different (for example, transverse) direction to form a second resultant image (or, in other words, imaging and processing the information to identify the follicular unit above and below the body surface). The first resultant image is subtracted from and/or combined with (which includes any method of subtracting and/or combining, such as by adding, deletion, subtraction, division or multiplication, as well by smoothing or sharpening any one or all of the relevant images) the second resultant image to obtain information about the follicular unit below the body surface. The information includes subsurface location and orientation of the follicular unit. In some embodiments of the invention, the method also provides for identifying a distance between relative portions of hair shafts of adjacent hair follicles below the surface from the images of the follicular units below the body surface, and based on that identified distance determining whether the adjacent hair follicles belong to the same follicular unit. Additional embodiments of the methods and systems of the present invention, as described below, may also provide for identifying a number of bulbs of a particular follicular unit based on the subsurface image information and classifying such follicular unit accordingly. In some embodiments, based on the obtained subsurface direction and/or curvature of the follicular unit, the method comprises dissecting and/or harvesting follicular unit from a body surface by aligning a certain way a removal and/or dissection tool with the follicular unit. The above-described methods for determining subsurface information may be performed in other embodiments, including those described herein, and in reference to the biological units other than follicular units, such, for example, biopsy samples or moles.
According to another aspect of the present invention, a method is provided for aligning (including orienting relative to) a harvesting tool with a subsurface orientation of a follicular unit on a body surface. In one embodiment, the method comprises obtaining an “above the surface” image of a follicular unit of interest, determining a location and/or orientation of the follicular unit above the body surface, aligning a harvesting tool and a portion of the follicular unit above the surface, identifying an offset of the position and/or orientation of the follicular unit below the surface with respect to the harvesting tool based on subsurface imaging, and repositioning the harvesting tool to align it with a portion of the follicular unit below the surface based on the offset. The method may further comprise dissection or harvesting the follicular unit. In some embodiments, identifying the offset may be accomplished, for example, utilizing optical coherent tomography, or ultrasound transducers, or infrared light, or other illumination sources. In some embodiments, the method for aligning, determining an offset, and repositioning of the tool may be based on stored data (including one or more stored images) and in some embodiments, repositioning may be based on the real-time data. Again, this and other methods and systems described below in reference to follicular units as an example, are also applicable to biological units other than follicular units.
Another method of the present invention for removing follicular units from a body surface, comprises first processing one or more images of a follicular unit both above and below the body surface. The images are stored, and a follicular unit removal tool is controlled based on the stored images. The follicular unit removal tool may be reoriented based on one or more of the images of the follicular unit below the body surface to remove the biological unit without damage or transection thereof. An image acquisition device such as one that senses light in the visible, infrared or near-infrared spectrum may be used. In some embodiments, the images include images below the body surface in the range of up to 5 mm, and preferably more than about 2 mm in depth.
A further aspect of the present invention is a method for dissecting hair follicles from a body surface that uses optical coherence tomography to obtain one or more images of a hair follicle. The one or more images may be enhanced to enable visualization of at least a portion of a curvature of a hair shaft beneath a body surface. The one or more images may be also enhanced to enable visualization of at least a portion of a bulb of the hair follicle beneath a body surface. Position and/or orientation of, for example, a hair follicle dissection tool may be controlled relative to the hair follicle below the body surface based on the one or more enhanced images to dissect the hair follicle from a surrounding tissue. In some embodiments, the depth of insertion of the hair follicle dissection tool may be controlled based on the one or more enhanced images. The orientation of the dissection tool may be changed as many times as necessary to follow the curvature of the hair follicle below the surface to dissect the hair follicle to keep it substantially intact. The hair follicle dissection tool can be operated to both dissect and remove the hair follicle for transplantation.
The one or more enhanced images may include an image below the body surface in the range of more than about 2 mm in depth. In a further aspect of the invention, the enhancement may be such that the one or more enhanced images have a signal to noise ratio of greater than 85 dB, and the hair follicle to a depth of greater than 2 mm below the body surface can be visualized to a resolution of smaller than 100 micrometers. Such enhancement may be achieved by decomposing the data from at least one of the one or more images into sub spatial frequency bands, processing each sub spatial frequency band to provide modified sub spatial frequency band data, and reassembling the modified sub spatial frequency band data to form an enhanced image with the desired signal to noise ratio. In yet another embodiment, it may be determined whether there is another (one or more) hair follicle having at least a portion of its hair shaft below the surface located within a predetermined distance from at least a portion of the below-the-surface hair shaft of the first hair follicle, and having those hair follicles with the hair shaft portions within the predetermined distance dissected as one follicular unit from a surrounding tissue. In another embodiment, it may be determined whether there is another hair follicle having at least a portion of its bulb within a predetermined distance from the at least a portion of the bulb of the hair follicle, and those hair follicles with the bulb portions within the predetermined distance are dissected as a single follicular unit from a surrounding tissue.
According to a still further aspect of the invention a system for dissecting hair follicles from a body is provided. The system comprises a processor which is configured to receive information from an image acquisition device. In one embodiment of the invention, the image acquisition device having utilized optical coherent tomography. The image acquisition device enables visualization of a hair shaft, including at least a portion of the curvature of the hair shaft below the surface. In some embodiments, at least a portion of a bulb of the hair follicle beneath the body surface may be visualized as well. The processor also comprises one or more modules for executing operations, the one or more modules comprising instructions for: determining the orientation of the hair follicle at least below the body surface based on the information received; and instructing movement of a hair follicle dissection tool relative to the hair follicle below the body surface based on the determined orientation to dissect the hair follicle from a surrounding tissue.
One or more of the modules may further comprise instructions to enhance the information received from the image acquisition device such that hair follicle at a distance of greater than 2 mm below the body surface can be visualized. One or more of the same or different modules may further comprise instructions to instruct changes in orientation of the dissection tool as many times as necessary to follow the curvature of the hair follicle below the body surface to dissect the hair follicle to keep it substantially intact.
The present invention also provides a system for removing biological units from a body surface. The system includes a biological unit removal tool, and one or more sensors, for visualizing at least below the body surface and obtaining images of biological units below the body surface. One or more of these sensors may also visualize above the body surface. In the case of multiple sensors, one of the sensors may be a digital camera, an infrared sensor, an ultrasonic sensor, or an optical coherence tomography (OCT) sensor, for example. In the case of a single sensor, different illumination methods may be utilized to achieve the desired images.
Another system of the present invention for visualizing a biological unit, such as a follicular unit on a body surface to assist in harvesting of the follicular unit, comprises an image acquisition device including a sensor for obtaining images of the follicular unit above the skin surface and a sensor for obtaining images of the follicular unit below the skin surface. A processor is configured to receive information from the image acquisition device, determine the location and orientation of the follicular unit above and below the body surface based on the images obtained by the image acquisition device, and instruct movement of a tool, for example a tool for harvesting follicular units, to align the tool with a portion of the follicular unit below the skin surface.
According to yet a further aspect of the present invention, a processor for visualizing a follicular unit on a body surface is provided. The processor may be configured to receive images of a follicular unit above a skin surface and below a skin surface, and includes routines to determine the location and orientation of the follicular unit above and below the body surface based on the images. In some embodiments, the processor is also configured to instruct movement of a tool for harvesting follicular units to align the tool with a portion of the follicular unit below the skin surface. In some further embodiments, the processor is also configured to identify from the received images a number of bulbs that the follicular unit has, and based on the number of bulbs determine a specific type of the follicular unit.
According to another aspect of the present invention, a method for dissecting hair follicles from a body is provided using ultrahigh frequency ultrasound to penetrate a body surface containing a hair follicle to a depth sufficient to obtain one or more images that allow to visualize at least a portion of a hair shaft, including a curvature of the portion of the hair shaft below the surface, and/or in some embodiments at least a portion of a bulb of the hair follicle below the body surface. A hair follicle dissection tool is controlled to be orientated relative to the hair follicle below the body surface based on the one or more images to dissect the hair follicle from a surrounding tissue.
Systems and methods of the present invention may be implemented for use with manual, partially automated and fully automated, including robotic, systems and procedures for removal of biological units, including hair harvesting and/or transplantation. Other and further objects and advantages of the invention will become apparent from the following detailed description when read in view of the accompanying figures.
Features and advantages of the present invention will become appreciated as the same become better understood with reference to the specification, claims, and appended drawings wherein:
In the following Detailed Description, reference is made to the accompanying drawings that show by way of illustration some examples of the embodiments in which the invention may be practiced. In this regard, directional terminology, such as “top,” “bottom,” “front,” “back,” “distal,” “proximal,” etc., is used with reference to the orientation of the Figure(s) being described. Because components or embodiments of the present invention can be positioned in a number of different orientations, the directional terminology is used for purposes of illustration and is in no way limiting. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present invention. The following description, therefore, is not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
The adjective “automated” with reference to a system or process as a whole means that some part or all of a particular system or step in the process involves an autonomous mechanism or function; i.e., that mechanism or function does not require manual actuation. Ultimately, one or more steps in the procedure may be automated, or autonomous, with some parts requiring manual input. This definition encompasses an automated system that requires only an operator to depress an ON switch or schedule the operation, and also a system in which hand held tools are used but some mechanism of the system functions autonomously, i.e., without human input, to perform a function. Some of the automated systems described herein may also be robotically-assisted or computer/software/machine-instruction controlled. The devices and methods of the present invention are useful in manual procedures and systems, as well as in automated procedures and system. The tools of the present invention could be used with the robotically-assisted systems and procedures. The adverb “automatically” when referring to use of a particular component of a system or a particular step in a process means that such step is accomplished autonomously, i.e., without real-time manual assistance.
The term “tool,” or “biological unit removal tool,” or “dissection tool” as used herein refers to any number of tools or end effectors that are capable of removing or harvesting various biological tissues, for example, follicular units (“FUs”) from a body surface, and/or dissecting (or separating) them from a surrounding tissue. In general, however, the tools of the present invention may be useful for removing biological units other than FUs from a body surface. In this sense, a body surface (including any part of the body surface, such as a head, a trunk, limbs, etc.) can be attached to the body or may be a flap of skin or body tissue removed from the body. Such tools may have many different forms and configurations. In many embodiments, the tool comprises a hollow tubular shaft and thus may be labeled, for example, a cannula, a needle, or a punch. The distal end of removal tools (for example, punches, coring devices, cutting and/or trimming devices, needles), are typically sharpened, to cut and extract the tissue (e.g., hair follicle). Alternatively, the “tool” could be a laser, or ultrasonic energy device, or other energy device for removal of biological tissue, or ablation, or even complete destruction of such tissue. The terms “coupled,” or “mounted” or “attached” as used herein, may mean directly or indirectly coupled, attached, or mounted through one or more intervening components.
“Biological units” as referenced in the present application include discrete units used in cosmetic, diagnostic? and dermatological procedures, for example, various tissues, including that extracted for biopsies or grafting, fat units, skin units, moles, etc. Examples of the biological units particularly useful with the present invention are hair grafts, or follicles, or “follicular unit(s).” Furthermore, “biological unit” may alternatively be referred to as “biopsy sample,” “biopsy specimen,” “biological tissue sample,” or “biological tissue specimen.” In a particular embodiment, the biological units are located at least partly within 0-5 mm below the skin.
As mentioned above, the term biological units encompasses a number of things, though the present invention is particularly useful in hair harvesting, to provide devices and methods for harvesting hair follicles, and/or follicular units (FUs). As such, the term follicular units (or FUs) will be used herein simply as an example for purposes of describing some embodiments of the present invention with the understanding that it represents more broadly biological units.
In particular, “follicular units” (also referred to as FU or FUs) are naturally occurring aggregates of 1-3 (and much less commonly, 4-5) closely spaced hair follicles that are distributed randomly over the body surface, such as a scalp. Each hair follicle has a bulb (a subsurface bottom-most portion that contains follicular stem cells and melanocytes). When harvesting a hair follicle, or a follicular unit for subsequent implantation in another area, it is important that the hair follicle be kept substantially intact. In some instance, substantially intact may comprise that the bulb of the hair follicle not be damaged. In other instances it may be sufficient to retain a predetermined quantity of the follicular stem cells and/or melanocytes, for example keeping intact in approximate terms the upper two thirds or the lower two thirds of the hair follicle. Scientists believe that the bulge of the hair follicle, which is situated in the vicinity of the sebaceous lobules, hosts stem cells as well. They also believe that stein cells reside in the outer root sheath and the bulb of the hair follicle. Keeping some or all of these stem cells with the hair follicle to be transplanted improves the probability of subsequent hair survival and growth. So keeping intact, for example, the upper two thirds of a hair follicle, which may include the bulge and a significant portion of the hair shaft, or the lower two thirds, which may include the bulb and up to and including the bulge, would increase the chances of a successful transplantation. It will be appreciated that in terms of a biological unit, the term intact will have various meanings dependent upon application, but will basically require that the biological unit retain its integrity for its application or purpose, and dictated by the same.
The follicular units may be classified, or “typed,” based on the number of hair follicles in the unit and identified in shorthand as an “F1” for a single hair follicular unit, an “F2” for a two hair follicular unit and so on for follicular units with 3-5 hairs. It is desirable to identify follicular units based on the number of hairs in the follicular unit. For example, it is preferable to transplant certain classes of follicular units into specific regions of the scalp. For example, single hair follicular units (F1s) are commonly implanted along the hairline that frames the face. Follicular units with more than one hair (F2s, F3s, etc.) are commonly implanted in the mid-scalp and crown. While there are other ways to determine the type of follicular unit, determination of the type of the follicular units may be accomplished based on subsurface imaging. For example, in one instance, determination of the type of follicular unit may be accomplished based on a location of one or more hair follicle bulbs relative to each other. For example, by determining if at least a portion of the bulb of a first hair follicle is within a predetermined distance, typically less than about 1 mm, and in some instances even less than 0.8 mm, or less than 0.5 mm, from another portion of a bulb of a second hair follicle; one can decide if they belong to the same follicular unit (for example, F2), and also if the first and the second hair follicles should be dissected from the surrounding tissue as a single follicular unit, or as separate hair follicles. Alternatively, in some other instances the decision regarding dissecting and/or harvesting a plurality of follicles as one follicular unit may be based on subsurface imaging of at least portions of their relative hair shafts. For example, if at least a part of a hair shaft below the surface and up to a point where it exits the body surface of one hair follicle is in close proximity (for example, less than 1 mm, or less than 0.75 mm, or less than 0.5 mm) to a corresponding portion of a hair shaft below the surface and up to a point where it exits the body surface of another hair follicle, it may be determined that the first and second hair follicles should be dissected and/or harvested together as one follicular unit. In some cases, if the corresponding hair shafts run in close proximity along a portion within a depth up to about 4 mm below the body surface, it may be advantages to dissect and/or remove them as one unit.
The present invention encompasses utilizing various techniques for imaging low-contrast features and structures, in the region located up to 5-6 mm below the body surface, and especially including those located more than about 2 mm below the body surface (for example, between 2 and 3 mm), in order to determine the size, shape, position, and orientation of those low-contrast features and structures, such as subsurface follicular units, or more generally various biological units located at least partially within the same range below the body surface. The imaging requirement for hair follicles is, for example, that the hair shaft, including at least a portion of a curvature of the shaft beneath the body surface should be visible in the image; or, in another example, that the hair shaft and at least a portion of the bulb of the hair follicle beneath the body surface should be visible in the image. It should be appreciated that the depth at which the bulb of a hair follicle lies beneath the surface varies dependent upon what stage the hair follicle is in its life-cycle. This depth can vary from 1 mm to as much as 8 mm or more below the skin surface, typically being in the 1 to 5 mm range, and often in the 2 to 4 mm range. It is also known that the orientation or curvature of the hair shaft may change as it enters and traverses beneath the body surface. By visualizing of the hair shaft, including at least a portion of the hair shaft beneath the body surface, for example in the range of 1.5 to 2.5 mm, especially if there is a substantial curvature or change of its direction below the surface, a hair removal or harvesting tool can be guided at an optimal orientation to reduce the chances of transecting the hair shaft, thus enabling the harvested follicular unit to subsequently be transplanted to a desired location. Visualization of the hair shaft or its portion as described above, and in some instances also visualization of at least a portion of the bulb enables one to dissect or separate the hair follicle from the surrounding tissue and keep it substantially intact, without transection of the hair shaft and/or without transection of the bulb of the hair follicle, thus enabling the harvested follicular unit to subsequently be transplanted to a desired location. Without actual visualization beneath the body surface at the above-described depths, one has no option other than to guess the position, orientation and curvature of the hair shaft beneath the body surface, and to infer or guess the location and depth of the follicular bulb beneath the body surface. This ultimately leads to greater transection of hair shafts and/or bulbs.
By utilizing the methods and systems of the present invention, one is also able to select, based on the visualized hair shaft including at least a portion of a curvature of the hair shaft beneath the body surface, or based on the visualized hair shaft and at least a portion of bulb of the hair follicle, whether the hair follicle is desirable for dissection and removal for the purposes of transplantation or not. If disintegration of the hair follicle is observed, a choice may be made to select all alternative hair follicle for dissection and removal for the purpose of transplantation.
Various embodiments of the present invention employ subsurface imaging of the follicular units and other biological units/structures, including low-contrast and those located at Up to approximately 5-6 mm, including greater than 2 mm, below the body surface in harvesting systems, whether such systems are fully-automated (e.g., robotically controlled), semi-automated, or manually controlled. While the present invention is especially useful in robotically operated systems for dissecting and harvesting hair, it will also provide great benefit to a physician who removes follicular units using a manual FUE technique or with partially/fully automated hand-held tools, as it will guide the physician in adjusting an angle of insertion of the tool to avoid transecting or otherwise damaging the follicular unit or tissue to be harvested.
Various terms for imaging devices and systems are used herein. The terms image acquisition device and image sensor are synonymous, and the term camera is also considered to be an image sensor. Image sensors generate, receive and/or sense visible and non-visible images, such as within the visible spectrum, the infrared spectrum or ultrasonic waves. One example of the image acquisition device is one or more cameras, such as any commercially available cameras. Instead of a camera, it could be a video recording device (such as a camcorder) or any other image acquisition device. While stereo or multi-view imaging devices are very useful in the present invention, it is not necessary to employ such geometries or configurations. For example, the image acquisition device could be an analog TV camera that acquires an initial image which is then processed into a digital image (for example, via an analog-to-digital device like a commercial-off-the-shelf frame grabber) for further use in the present invention. The system of the present invention may include an illumination source, for example, an infra-red light emitting diode, a laser, or an ultrasound transducer. The system of the present invention typically incorporates an image processor. The image processor may comprise any device programmed and configured to perform the methods according to the present invention. One non-limiting example of a suitable image processor is any type of personal computer (“PC”). Alternatively, the image processor may comprise an Application Specific Integrated Circuit (ASIC) or Field Programmable Gate Array (FPGA). The image processor may be programmed with software configured to perform the methods of the present invention. The image processor may comprise one or more modules for executing operations and one or more modules may comprise instructions for performing various steps of the methods of the inventions described herein. For example, one module may contain instructions including determining location and/or orientation of the hair follicle below the body surface. The same or different module may contain instructions controlling movement of a tool (e.g. dissecting tool, or harvesting tool) relative to the location and/or orientation of the hair follicle below the body surface.
The operating tip of the tool 28 is shown positioned over a body surface 30, in this case a part of the patient scalp having hair follicles thereon. The tool 28 is any number of harvesting tools useful for removing follicular units from the body surface 30. A processor 32 acting, for example, through a robotic control 34 instructs the various movement devices of the robotic arm 22 and head assembly 24. The processor 32 may incorporate in some embodiments an image processor. As an example, the processor 32 may be any type of personal computer. Alternatively, the processor 32 may comprise ASIC or FPGA, or any other appropriate device. An operator monitors conditions and provides instructions through a monitor 35, keyboard 36, and mouse 38. A magnified image of the body surface 30 can be seen on the monitor 35.
Alternatively, an optional ultrasound sensor 29″ may be used, which is also shown attached to the system 20′. The ultrasound sensor 29″ may be used prior to the biological unit removal step to map the subsurface configurations of select biological units, which information can then be referenced and shown on the monitor 35. In this arrangement, the imaging sensor 29′ may be a standard visible light camera, or even stereo cameras.
The imaging sensor 29 (or 29′) mounts on the system 20 (or 20′) and is aimed toward the body surface 30. The imaging sensor 29 provides information about the hair follicles on the body surface 30, ultimately for controlling movement of the tool 28. For instance, as is known, the imaging sensor 29 can be stereo cameras that provide visible light images. An imaging subsystem in general associated with the system 20 may have one or more combined surface and subsurface imaging sensors, or it may include several independent imaging systems or sensors, including subsurface imaging that allows depiction of a part of the follicular unit underneath the skin or body surface. One example of the secondary sensor for subsurface imaging is an Optical Coherence Tomography (OCT) sensor, which may be incorporated into the system separate from the stereo cameras. Alternatively, infra-red sensors for providing subsurface images could be incorporated into the existing imaging camera or again could be added to the system as a separate device. In some applications, a separate imaging component for subsurface imaging is introduced, such as when using an ultrasound sensor. The ultrasound sensor generally has to touch the body surface for imaging, therefore, it could be incorporated into the system such that at least some part of it could extend and touch the relevant body surface. For example, an ultrasound sensor could be used in both automatically operated systems and in the manual procedures where physicians use hand-held devices. In the manual procedures, the ultrasound sensor may be incorporated into the hand-held device, or it could be a separate device that physician uses prior to harvesting to obtain subsurface images. In other embodiments an imaging sensor in the form of an ultrasound sensor may be attached to the robotic arm or the robotically-operated system of the present invention, for example, adjacent the harvesting tool 28. Measurements could be taken by the ultrasound device, for example, prior to harvesting off-line separately and then stored and used by the system.
Usually, the robotics system 20 is initiated and calibrated so that the camera frame of the imaging sensor(s) 29 is aligned or oriented with respect to the tool frame of the harvesting or dissecting tool 28 of the present example. The image data is acquired by the imaging sensor 29 and processed by the processor to identify objects of interest in the camera frame. By way of example,
With reference to
With reference to image processing of the follicular units, unless the camera axis happens to be exactly aligned with the longitudinal axis of the follicular unit 42 (in which case the follicular unit will appear as a circular point representing an end view of the hair shaft), the image of follicular unit will be in the form of an elongate line having an “apparent” length that will depend on the angle of the camera frame relative to the follicular unit. Also, when the camera axis is not exactly aligned with the longitudinal axis of the follicular unit, a shadow of the follicular unit can typically be identified, which by definition is “attached” to the follicular unit at the body surface. Because of physical attributes of a hair follicular unit, its base (i.e., the end emerging from the dermis) can be readily distinguished from its tip as part of the image segmentation process. For example, the base portion has a different profile and is generally thicker than the distal tip portion.
A more detailed description of examples of follicular harvesting tools and assemblies is provided below in conjunction with
The system may further incorporate a fluid (e.g., saline) delivery subsystem 60 as seen in
The outer tube 76 also reciprocates with a piston 90 within a gas cylinder 92. In particular, a leading end nut 94 holds the outer tube 76 fixed relative to the piston 90. In the illustrated embodiment, as seen in
Furthermore, the visible images from the stereo cameras may be combined with images from other sources. Such as infrared cameras. The monitor screen shot in
In an embodiment of
As will be appreciated by those skilled in the art, one can visualize below the skin surface by adjusting the lighting, filters on the cameras, and various image processing techniques. This is because the reflection and absorption of light by the skin surface will change based on the wavelength of light used. Further, the depth of penetration of the light itself into the skin also varies based on the wavelength. Understanding these basic properties of light, images of the subcutaneous portions of the follicular units (hair follicles) may be obtained using appropriate respective wavelengths of light, including both visible light spectrum and infrared, capturing the different wavelengths of light using different imaging filters, and subtracting and/or combining images during image processing. “Subtracting and/or combining” as used herein is by no means limited only to literal pixel subtraction and/or adding, but rather includes any method of combining data from, for example, image 1 and image 2 (by adding, deletion, subtraction, division or multiplication, including original pixel values or the logarithm of those pixel values, as well as by smoothing or sharpening any one or all of the relevant images) which makes details that are contained in either or both images more apparent. This approach enables one to visualize the hair shaft of the follicular unit, both outside the skin surface, as well as under the skin surface, including a curvature of the hair shaft beneath the skin, or all the way down to the bulb.
In general, different wavelengths of light penetrate to different depths and provide varying contrast in the skin. The present invention contemplates using different wavelengths of light to obtain different images of a biological unit embedded in skin, such as follicular units. By segmenting various images received at different depths, and combining and/or subtracting such images during image processing, the system is capable of isolating and visualizing the length, orientation and curvature of a follicular unit under the skin, including the information about location and a number of hair bulbs in a particular follicular unit.
The present invention contemplates imaging systems for determining information, such as shape, orientation, depth, direction of growth, etc., about a biological unit under the skin surface. Examples of the imaging contemplated with the present invention includes infrared or near infrared imaging, Optical Coherence Tomography (OCT), and High Frequency Ultrasound Imaging (HFUI). Particular examples of using these technologies are provided below.
Subsurface imaging can be used with visible imaging for an enhanced understanding of the position and orientation of multiple hair follicles in a short amount of time.
Then the follicular unit(s) of interest are imaged again, but this time using, for example, a light of a different wavelength, or it could be of the same wavelength but transverse (meaning that it is more or less parallel to the body surface that is imaged); alternatively, it could be both transverse and different wavelength, or it may differ in another property such as, for example, coherence. For convenience we will call this image as Image 2. Some examples of the Image 2 include using infrared or near infrared light. Again, these additional images are processed to determine and identify the characteristics of the follicular unit(s) above and below the skin surface, which can be termed RESULT 2. Subtracting and/or combining (as previously explained) RESULT 1 from RESULT 2 obtains, for example, the size, shape, position, direction and orientation of the subsurface portions 104 of the follicular unit (see
More generally, with reference to the example of
In general, the subsurface image of each follicular unit or hair follicle can be used to pre-position the harvesting or dissecting tool, or to adjust the position during the operation of harvesting or dissection. For instance, the harvesting needle may be positioned and aimed prior to a single movement using the super- and subsurface information. Alternatively, the system may instruct the harvesting tool to align first with the “above the surface” portion of the hair follicle, and then change orientation if necessary based on the subsurface follicle angle. The subsurface data may further indicate a curvature in the subsurface follicle necessitating several orientation changes. These changes may be accomplished in real-time, as the tool moves, depending on the speed of the processor, and may be incorporated into automated or even manual systems. One example of a method for dissecting follicular units from a body comprises obtaining one or more images of a follicular unit comprising information on the location and/or orientation of the follicular unit both above and below the body surface. The location and/or orientation of the follicular unit above the body surface is then determined, and a follicular unit dissection tool controlled to be positioned and orientated relative to the position and/or orientation of the follicular unit above the body surface. An offset of a location and/or orientation of the follicular unit (e.g., a single hair follicle) below the body surface is identified with respect to the follicular unit dissection tool. The follicular unit dissection tool is then repositioned based on the identified offset to dissect the follicular unit from a surrounding tissue. In some embodiments at least one of the one or more images of the follicular unit are stored, and the offset is identified from the one or more stored images, and the follicular unit dissection tool is repositioned based on the offset identified from the one or more stored images.
In the alternative embodiment of the present invention, OCT-based imaging technology may be used in the system and method of the present invention. This technology can be used either in combination with the aforementioned subtracting and/or combining technique, or on its own. OCT works on the basis that when light falls on a tissue surface, some of the light penetrates the tissue and reflects off of various depths of the tissue. Even though a majority of the light is reflected off of the surface of the tissue, most of the reflected light is scattered. OCT captures only the light that is non-scattered, e.g. temporally-coherent light, and eliminates all the scattered light which is not temporally coherent. Separating temporally coherent light from non-temporally-coherent light is done by an instrument called optical interferometer, which is a part of the OCT instrument.
Research indicates that OCT can penetrate to various limited depths into skin depending on the wavelength of transmitted light. For example, Podoleanu (Podoleanu A G. Optical Coherence Tomography. Br J Radiol 2005; 78 (935): 976-988) indicates that OCT can penetrate to a depth of about 1.5 mm into skin with 800 μm light, and up to about 2 mm into skin with 1300 mm light. Any description in the literature, however, is limited to the region from 0 to about 1.5-2.0 mm, and more specifically under 0.9 mm below the body surface, and mostly directed to analyzing precancerous and cancerous skin structures.
The light penetration into highly scattering tissue, and therefore visibility, can be improved by the application of clearing agents, such as biocompatible and osmotically active agents, for example, glycerol, glucose, propylene glycol, polypropylene glycol (PPG), polyethylene glycol (PEG), and dimethyl sulphoxide (DMSO). Use of the above agents may induce an optical clearing effect, reduce optical scattering, and increase detection depth. A mixture containing any of the above-mentioned clearing agents may be topically applied to improve visibility.
An example of the OCT system 120 according to the present invention is illustrated schematically in
The OCT system 120 of the example of
In order to practice hair follicle dissection and/or removal methods using the OCT-based system of the invention, it is not only the tissue penetration depth that has to be considered, but also the maximum depth at which the system 120 itself can obtain images, and the resolution to which the images can be evaluated to enable hair follicle dissection to occur. The spectrometer resolution was selected such that the measurement range was greater than the expected tissue penetration depth. For example, for a maximum penetration depth in tissue on the order of about 2 mm, an imaging measurement depth greater than 2 mm, and preferably greater than 4 mm, is desired. For the example of the above-described Fourier-domain OCT system, the measurement depth is determined by the ability of the system 120 to resolve high frequency fringes, and on the optical properties of the tissue involved. Using the above system a measurement range of up to about 6 mm, for example, 5.7 mm can be achieved, however one should understand that the attainable measurement range depends on the refractive index of the tissue involved.
The axial resolution of the system 120 is determined by the coherence length of the source 122, which is in turn determined by the bandwidth. However, the bandwidth is limited by the spectrometer 136 of the OCT system 120, giving an axial resolution, for example, of about 30 micrometers at around 1300 nm. The lateral resolution of the OCT system 120 is completely decoupled from the axial resolution, and is determined by the lens 138 used to focus the beam on the tissue, or sample 134. Although a high numerical aperture lens typically gives the best lateral resolution, for this particular application of hair follicle dissection, in order to attain a reduction of multiple scatterings over the significant depth required, a smaller numerical aperture lens 138 may be used. This is particularly so since in-focus images deep into the tissue (for example, greater than 2 mm) are desired. Lenses 138 with a field of view of 1 mm or greater in any one direction, with greater than 3 mm offering better results, are utilized. These values provide a lateral resolution on the order of 30-35 micrometers.
In order to obtain good signal characteristics and to maximize in-focus imaging depth, the OCT system needs to be effectively aligned. Imaging depth is maximized by placing the focus inside the tissue to utilize the full depth of field. In one particular example, it was determined a depth of field of about 2.6 mm placed filly beneath the body surface would allow for visualizing and harvesting hair follicles (including the hair shaft and at least a portion of a curvature of the hair shaft, or in some embodiments the hair shaft and at least least a portion of the bulb) utilizing the system described herein.
In one embodiment, the selected detector may be an InGaAs array (136) which has readout line speeds of up to 47,000 lines per second. However, detectors with, for example, 10,000 lines per second and/or other different performance parameters may be employed as well The system sensitivity is defined as the ratio of the signal power generated by a perfectly reflecting mirror compared to the noise of the system. Typical signal to noise ratios in the range of greater than 85 dB and preferably greater than 100 dB are desired.
The OCT system as described herein provides one or more images of the hair follicle, including subsurface images. It enables improved visualization of a hair shaft or its portion, and/or at least a portion of the bulb of the hair follicle beneath the body surface, thus enabling the orientation of a hair follicle dissection tool or harvesting tool relative to the hair follicle below the body surface based on the one more enhanced images to dissect the hair follicle from a surrounding tissue, preferably substantially intact. In an embodiment of the invention, the orientation of the hair follicle dissection tool can be changed as many times as necessary to follow the curvature of the hair follicle below the body surface to dissect the hair follicle and to keep it substantially intact.
According to another aspect of the present invention, the images achieved by utilization of the above-described OCT-based system and methodology may be further enhanced by removing noise and improving contrast resolution. As a result, further improvement of visibility of low-contrast features at significant depths (for example, greater than 2 mm) beneath the body surface. In particular, speckle noise is bothersome to human observers. Prior to the enhancing process a two or three dimensional image of a hair follicle can be attained for example, by using a series of C-Scans or B-Scans. The enhanced processing comprises decomposing data from at least one of the one or more images into a number of sub spatial frequency bands, processing each sub spatial frequency band to provide modified sub spatial frequency band data, and reassembling the modified sub spatial frequency band data to form an enhanced image with the desired signal to noise ratio. By utilization of the enhanced processing, images below the body surface in the range of interest may be visualized, with the resolution at the higher depth values being less than at the resolution at lower depth values in some instances. For the purposes of hair follicle dissection or removal for transplantation, echanced images below the body surface allow visualization of a substantial portion of the hair shaft, and/or in some embodiments at least a portion or the whole bulb of the hair follicle. For example, structures of interest located in some cases deeper than 2 mm can be visualized to a resolution of smaller than 100 micrometers, preferably smaller than 35 micrometers.
In some embodiments, pyramid decomposition imaging technique may be used to divide the different sub-bands to correspond to different spatial frequencies in the image. One form of pyramid decomposition uses “steerable filters” (Simoncelli 1995) which are known to preserve orientation information. In some embodiments, after Pyramid decomposition, the OCT images obtained utilizing the methods of the invention were found to contain horizontal noise texture due to speckle. Since the highest frequency sub-band may contain very little useful information, it may be completely suppressed in some embodiments, that is, the high frequency sub-band in the pyramid may be set to zero. The lowest frequency sub-band may contain much of the overall brightness variation (contrast) in the image. The original image contrast may be strong due to the large reflection from the skin. The lowest frequency sub-band may be reduced in amplitude to about 25% to 35% of its original value, around 30%, to minimize, but not eliminate the strong contrast. The remaining (mild-frequency) sub-bands are likely to contain both noise (including speckle) and useful image information. As mentioned earlier, in one example after Pyramid decomposition the OCT images were found to have noise due to speckle in one orientation, and the useful information was contained in another orientation. It was therefore desirable to suppress the noise in these bands while not eliminating signal information. This can be accomplished, for example, using a Gaussian coring technique, and making use of the results obtained by using a “steerable filters” (Simoncelli 1995) pyramid decomposition technique. In Gaussian coring, small amplitudes come through the function with less amplitude than in a linear coring function, in which small signals are suppressed while preserving larger signals. Large amplitudes come through the fiction with essentially the same amplitude of the linear coring function. For both orientations, low frequency signals at all amplitudes may be reduced. For the vertical orientation, very low amplitudes may be moderately suppressed. For horizontal orientations, small amplitudes may be suppressed completely, and moderate amplitudes may be suppressed moderately. In one embodiment, with sub-band data modified as described above, the final image was reassembled. Reassembling may be accomplished using any techniques known in the field.
In yet another embodiment of the present invention High Frequency Ultrasound, also known as HiFU or HFUS, is used. It works similar to standard ultrasound but using high frequency wavelengths, typically 20 MHz to 100 MHz. Ultrasound enables visualizing structures below the surface, as is frequently used in prenatal scanning. High frequency ultrasound resolves depths from a few millimeters to a centimeter. Again, the depth of interest with respect to hair follicles is approximately up to about 5-6 mm, in some cases from about 1 mm and up to 4-5 mm, and in some cases from more than 2 mm. Depending on the wavelength, the resolution and depth vary. As with any other ultrasound imaging, the sensor needs to be in contact with the surface of the skin. The ultrasound modality may be incorporated in either hand-held harvesting device or in robotic hair transplantation system as will be explained below.
First, follicles in a given area may be imaged with HiFU or HFUS using a series of B-scans, thus constructing a three-dimensional volume of a skin patch. The image processor processes the three-dimensional volumetric data to identify the direction of each follicle below the skin (i.e., portion 104 in
As an example, a robotic hair transplantation system using the subsurface imaging system of the present invention may comprise any or all of the following subsystems:
The processor or the image processor of the system may process the two or three-dimensional volumetric data to identify the follicle position and orientation below the skill surface. That information is then used to direct and control a follicular unit dissection and/or removal tool, such as that seen in
The flow chart of
As this embodiment is based on a real-time “on the go” imaging and alignment, additional images of the follicular unit(s) of interest using subsurface imaging, for example, OCT, may be obtained and processed to identify its characteristics under the skin surface. These images may be obtained before, after, or at the same time with aligning the harvesting or dissecting tool with the portion of the follicular unit above the surface. For example, in one implementation, an offset of the position and/or orientation of the follicular unit below the skin surface may be determined relative to the position of the harvesting or dissecting tool which was just aligned with the follicular unit above the surface. Based on the determined offset, the harvesting tool may be repositioned so that it is oriented relative to the follicular unit below the skin surface. The follicular unit now may be dissected and/or harvested based on the subsurface alignment so that the chance of damaging or transecting the follicular unit is substantially reduced. In some cases where the direction of the follicular unit below the surface changes several times, obtaining additional subsurface images of the follicular unit and repositioning of the harvesting tool may be repeated as necessary.
As mentioned above, the data on the subsurface characteristics of the follicles can be obtained immediately after the images are obtained, or first obtained and then stored. For instance, in the case of ultrasound (HFUS) and OCT as well, if it is more efficient, the images may be obtained and processed ahead of time and a series of offsets may be used. The offsets may be in the form of a lookup table, approximated by a formula, or an average in a given area of skin surface.
In general, one example of a system according to the inventions described herein comprises a processor which is configured to receive information from an image acquisition device, the image acquisition device enabling visualization of a hair shaft, including at least a portion of a curvature of the hair shaft beneath the body surface. The processor may also comprise one or more modules for executing operations comprising instructions for determining, for example, position or orientation of the hair follicle at least below the body surface based on the received information; and instructing movement of a hair follicle dissection tool relative to the hair follicle position or orientation below the body surface.
As will be appreciated by those skilled in the art, the methods of the present invention may be embodied, at least in part, in software and carried out in a computer system or other data processing system. Therefore, in some embodiments hardware may be used in combination with software instructions to implement the present invention.
The foregoing illustrated and described embodiments of the invention are susceptible to various modifications and alternative forms, and it should be understood that the invention generally, as well as the specific embodiments described herein, are not limited to the particular forms or embodiments disclosed, but on the contrary cover all modifications, equivalents and alternatives falling within the scope of the appended claims. For example, it will be appreciated by those skilled in the art that a particular feature or characteristic described in reference to one figure or embodiment may be combined as suitable with features or characteristics described in another figure or embodiment. Similarly, the invention is not limited to the use of a robotic system including a robotic arm, and that other automated and semi-automated systems may be utilized. Moreover, the system and method of the present invention can be a separate system used along with a separate automated transplantation system or even with a manual transplantation procedure.
While the invention has been described in its preferred embodiments, it is to be understood that the words which have been used are words of description and not of limitation. Therefore, changes may be made within the appended claims without departing from the true scope of the invention.
The present application claims priority to U.S. Provisional Patent Application Ser. No. 61/059,476, filed on Jun. 6, 2008, the disclosure of which is incorporated by reference herein in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61059476 | Jun 2008 | US |
