Apparatus and method for measuring photodamage to skin

Information

  • Patent Grant
  • 7558416
  • Patent Number
    7,558,416
  • Date Filed
    Friday, September 28, 2007
    17 years ago
  • Date Issued
    Tuesday, July 7, 2009
    15 years ago
Abstract
An apparatus and method for assessing photodamage has a digital imaging system for recording blue light imagining and in particular the green signal response intensity of the skin of a person, which is indicative of elastotic material and photodamage. Because the image data has a numerical intensity value, which may be expressed in RGB or L*a*b* colorspace, the image data taken from one image can be numerically compared to that of one or more other images and the image data is amenable to numerical and statistical analysis. Comparison to population profiles/image data permits an individual's image data to be characterized numerically, such as by a relative score or percentile rating. The image data can also be used to ascertain the degree of variation over a surface such as the face, with wider variation being indicative of greater photodamage.
Description
FIELD OF THE INVENTION

The present invention relates to apparatus and methods for determining skin conditions and more particularly to such apparatus and methods which use digital imaging of persons to ascertain photodamage to the subject's skin.


BACKGROUND OF THE INVENTION

In assessing a person's skin from cosmetic and health perspectives, the amount of photodamage due, e.g., to sun exposure is an important factor. High exposure levels have been correlated to increased risk of skin cancer due to U-V radiation—induced cell mutations. Sun exposure also has detrimental cosmetic effects on the skin, e.g., the skin loses elasticity and color homogeneity, as evidenced by “age spots” or solar lentigenes. It is known that photodamage is associated with/indicated by internal changes to the skin which underlie the observed external skin attributes. One of these internal changes occurs in the superficial (papillary) dermis. More particularly, as persons age and their cumulative exposure to the sun increases, elastotic material accumulates in the superficial dermis, in the form of abnormally clumped elastic fibers accompanied by deformed collagen fibers.


Visualization and physical examination of a person's skin by a dermatologist and/or histological examination of a skin sample can yield information on the degree of photodamage, however, such techniques require expensive professional services are inconvenient, sometimes unpleasant and frequently do not result in a comprehensive, quantified measure of photodamage of a large area of the skin, such as the face, relative to a norm.


Various imaging systems have been proposed that photographically capture images of a person's face for analysis of the health and aesthetic appearance of the skin. Different images, e.g., captured at different times or under different lighting conditions, e.g., using different illumination and filtration frequencies, can be compared to one another to gain insight into the condition of the skin, e.g., at different times, such as before and after treatment, in order to ascertain trends in the condition of the skin. This was typically done by human operators inspecting the photographs to ascertain changes between them, based on color, texture, etc.


While photographic skin imaging and analysis by human inspection is quite useful, it remains an objective in the art to conduct such analyses more insightfully without dependence upon professional evaluation and Judgment and in a more objective and reproducible manner.


SUMMARY OF THE INVENTION

The limitations of prior art methods and apparatus for ascertaining and assessing photodamage in persons are overcome by the present invention which includes an apparatus for detecting elastotic material in the skin by measuring the green response thereof to illumination with blue light. In an embodiment of the present invention, the intensity of the green signal response is recorded in a digital image as pixel intensity values. Given the accumulation of such data for numerous people, population norms and profiles can be assembled through quantitative analysis, to which individuals can be quantitatively compared. In accordance with an embodiment of the present invention, one useful method of quantitative analysis is to ascertain the distribution of green intensity response across the facial region, greater variations in intensity being indicative of greater photodamage.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a diagrammatic view of a digital imaging system in accordance with the present invention.



FIG. 2 is a graph of a* value vs. age for a first population of subjects whose digital images were captured.



FIG. 3 is a histogram of pixel intensity for a specific skin region for an individual and for a population.



FIG. 4 is a graph of fluorescence of elastotic material vs. age for a second population sample.



FIG. 5 is a graph of fluorescence of elastotic material vs. age for a third population sample.





DETAILED DESCRIPTION OF THE INVENTION


FIG. 1 diagrammatically illustrates a digital imaging apparatus 10 having a source of illuminating light 12 (e.g., a photo flash) and a digital camera 14. An image of the subject S is recorded by the camera 14 in the form of a matrix 16 of pixel values in RGB format (red, green, blue). The matrix 16 of values is typically produced by a Bayer-filtered close-coupled display CCD and the information is stored in a memory device, such as random access memory (RAM) or on a flash memory card. The RGB data can be separated into channels or planes, R, G and B, one plane for each color. Various frequencies of illuminating light LI disposed at varying positions relative to the subject S may be used to capture digital images of the subject S in order to capture different information about the skin of the subject. Filters 18, 20 may be employed on the light 12 and the camera 14, respectively, to control the light frequency/polarity of light LI which is projected on the subject S, as well as controlling the light LR (reflected or emitted from the subject S), which is admitted into the camera 14. Imaging of this type is described at length in co-pending U.S. patent application Ser. No. 10/008,753, entitled, “Method of Taking Images of the Skin Using Blue Light and the Use Thereof”, which was published as United States Application Publication No. US 2004/0146290 A1, U.S. patent application Ser. No. 10/978,284 entitled “Apparatus for and Method of Taking and Viewing Images of the Skin,” which was published as United States Patent Application Publication No. US 2005/0195316 A1 (“U.S. Publication No. 2005/0195316”), application Ser. No. 11/169,813 entitled “Skin Imaging System with Probe”, which was published as United States Application Publication No. US 2006/0092315 A1 (“U.S. Publication No. 2006/0092315”), all of which are incorporated by reference herein in their entirety. The foregoing applications disclose various correlations between skin condition and the images produced by various photographic parameters, i.e., specific combinations of illuminating light, filters 18, 20, etc. The skin response to different illuminating frequencies, angles, polarity etc. can reveal information about skin condition and this evidence of skin condition can be recorded and recalled in digital images for purposes of analysis.


Since the images recorded are in digital form, i.e., in numerical pixel intensity values, the images lend themselves to quantitative analysis. For example, instead of just noting that the cheek of a subject whose image is taken at time T1 is more or less green in color in an image of the person taken at time T2, as discerned by a skilled human observer, the values of the intensity of the green pixels in the specific area of the cheek at times T1 and T2 may be quantitatively compared. For example, the two values may be numerically analyzed to quantify the actual change in intensity for that pixel or pixels in that region. Digital image quantification can be used to discern average values for the skin in specified regions, e.g., by summing the values of pixels in the specific region and then dividing by the number of pixels. In this manner, a whole area of the face may be characterized quantitatively. Various other quantified analyses may be conducted, e.g., the imaged area of skin may be tested for standard deviation in pixel intensity or the RGB data may be converted to L*a*b* coordinate space and the a* values indicative of green coloration mathematically analyzed (e.g., the a* values of subsequent images can be directly compared—subtracted) to ascertain a change in greenness. The conversion of RGB image data to L*a*b* data is described at length in a co-pending application filed on Oct. 2, 2006 as U.S. Provisional Application No. 60/848,768 contemporaneously herewith entitled, “Apparatus and Method for Analyzing Skin Using L*a*b* Colorspace”, which is incorporated in its entirety herein by reference.


Given the capability of quantifying digital imaging results/data and the capacity for obtaining large samples of image data over time and across population groups, this data may be quantitatively analyzed to ascertain relationships and tendencies within these population groups, e.g., to establish normative skin conditions. The present invention is directed to ascertaining and apprising the level of photodamage in an individual or a population of individuals. Of course the same methods of data collection through digital imaging and numerical analysis of the data collected both from populations and from individuals may be utilized to draw conclusions pertaining to other parameters of skin condition.


As applied to the analysis of photodamage, the medical literature indicates a correlation between the number of hours of sun exposure to the level of photodamage. Related correlations exist pertaining to age and photodamage, (viz., the greater the person's age, the more photodamage is likely), the time that persons spend in particular latitudes (those with greater sun exposure having more photodamage), skin type by amount of melanin (greater pigmentation leading to less photodamage), etc. The present invention therefore recognizes that various photodamage—sensitive population groupings may be made for the purpose of assessing the likelihood of photodamage and that the level of photodamage may be assessed and quantified for samples of these populations to identify and quantify the predictive factors that a person may encounter or possess that effects photodamage. Accordingly, the present invention recognizes the utility of conducting large scale imaging studies involving diverse people and recording their various attributes and experiences to establish a database of digital image samples that may be subject to quantified analysis. This quantified analysis may then be used to quantify the various risk factors leading to photodamage, both in isolation and in combination.


As to predictive indicators of photodamage accessible through digital imaging, the present invention recognizes that the intensity of the green fluorescence response of the skin to illumination with blue light is an indicator for the presence of elastotic material. As noted above, photodamage is correlated with the presence of elastotic material. FIG. 2 is a graph of a* value by age for 7,825 subjects. The slope of the regression line RL is negative, indicating that, as subjects age, the a* value decreases, corresponding to an increase in “greenness” indicative of greater photodamage.


Given the foregoing correlation between green fluorescence signal intensity in response to blue light, and the capability to quantify same from the analysis of digital images, an individual seeking information concerning his/her level of photodamage can present themselves for one or more sessions of digital imaging under blue light, i.e., light having a wavelength from about 380 nm to about 430 nm. For example, the imaging may be conducted with one or more flashes 12 having interference filters 18. The camera 14 may also have a filter 20, e.g., a long pass filter to eliminate wavelengths below 400 nm, such as a GG-420 or GG-440 filter from Schott Glass Technologies and Wratten No. 8 from Eastman Kodak. After capturing the digital image in RGB format, the green signal data G is isolated and analyzed.


For all pixels of any image, there is an associated pixel intensity, which is determined by the photo-response of a photosensitive element, e.g., a voltage induced in a capacitor element in a CCD array. This image profile and the underlying intensity data may be used to quantitatively assess the level of photodamage present in the subject S whose image was captured in the image.


As with many other measurements, a measure of the extent or degree of photodamage has enhanced meaning when compared to some standard, such as the norm or mean for a relevant population. In comparison to this norm, an individual's state can be characterized as better or worse, ranked by percentile, or placed within a scale, e.g., a 1-to-10 ranking. This numerical characterization can then be associated with outcome likelihoods established by statistical studies of relevant populations. For example, if an individual is found to have photodamage that is 50% less than the norm of persons with similar age, pigmentation and geographic location, and statistical studies indicate that such person have a low chance of suffering from photodamage-related disease or conditions, such as melanoma, wrinkling or age spots when they are 60 years of age, then their low score would be an indicator that their risk for such conditions is low (—if they continue in their present course of behavior). Conversely, a person who proves to have a relatively high numerical photodamage score may be a greater risk and therefore behavior modification and/or treatment of the condition may be advisable.


In order to establish a standard of comparison, the individual may identify certain data about themselves, in particular regarding any data that has been shown by population studies to be predictive of photodamage, such as age, pigmentation (race) years of residency in specific geographic locations/latitudes, lifestyle and habituation as to outdoor activities, use of sunscreen, etc. Given this data, the relevant data can be extracted from the database of collected analyzed digital images and other sources of information concerning photodamage outcomes and levels associated with such factors. The individual's green intensity response data can then be compared to the accumulated population data to develop a score or percentile of photodamage relative to the overall population and/or relative to any particularly relevant population(s). In this manner, photodamage can be quantified by a number and the number can be representative of variations from the norm established by different populations of interest.


Besides, comparison to population groups, the subject person may present themselves for more than one imaging session spaced in time to discern or monitor changes in the level of their photodamage and the efficacy of skin treatments directed to reversing photodamage, e.g., the use of Trentinoin/Retin A.


In analyzing the skin of a person's face, it is beneficial to examine specific regions of the face for specific associated attributes, since the different regions of the face are specialized in form and function and interact with the environment differently. For example, the skin covering the upper surface of the nose is exposed to the most direct and intense rays of the sun, i.e., those emitted from late morning to early afternoon and therefore has a greater likelihood of photodamage. In contrast, the skin of the eyelids is shielded from the sun due to the bunching of the eyelid and retraction into the eye socket when the eye is open. Photodamage will therefore vary more strongly from skin region to region in a person who has been exposed to more radiation, i.e., the sun exposed areas will exhibit much higher photodamage than non-exposed areas, whereas in a person with limited sun exposure, the areas of the face with greater natural sun exposure will differ less from the areas of less natural sun exposure. Wide variations of green intensity signal across the face (or other body areas, e.g., dorsal vs. volar surfaces) is therefore an indicator of photodamage, because it indicates greater sun exposure.


In a similar manner, the response of skin to sun exposure can vary over a skin surface, such as the face or the back. Persons with little pigment in their skin and low capacity for melanin production tend to freckle, which indicates an uneven response of the skin to sun exposure and uneven photodamage over the surface. As a result, high variability of the green response signal to blue light is an indicator of photodamage (associated, e.g., with the freckled skin of a person with low pigment levels.



FIG. 3 shows an exemplary fictional histogram of pixel counts for different levels of green fluorescence response pixel intensity distributed over an area of the skin, such as the facial region. The solid lines indicate readings for an individual HI and the dotted lines indicate those values associated with a population HP. As can be appreciated from the graph, the median pixel intensity MP for the population is lower than the median intensity MI for the individual. This is one indication of greater photodamage. Furthermore, the individual's pixel intensity groups HI vary farther from the median for the individual MI than the intensity groups HP of the population vary from the population median MP. This is an indication that the standard deviation of pixel intensity of the individual is greater than the standard deviation of pixel intensity for the larger group (population). As noted above, this is also an indicator that the individual has a higher than normal amount of photodamage, in that he/she exhibits a wider variation in green signal intensity over the facial region. This would be analogous to freckling.



FIGS. 4 and 5 show fluorescence of elastotic material vs. age for two groups of persons, African Americans and Caucasians, respectively. In each of FIGS. 4 and 5, the sample size was 200 persons and testing was conducted in the summer (S) and in the winter (W). There is a seasonally varying level of photodamage present in both groups due to the increase in sun intensity and exposure in the summer and a corresponding decease in the winter. The following is a detailed description of the processing involved in computing the graphs.


For each subject, a region of interest on the face has to be defined to ensure that the images do not present signals from other fluorophores besides the elastotic material, such as horn and porphyrin. Also, one has to make sure that the assessment of fluorescence is based on analogous regions on the face, to guarantee that the quantification is consistent across various subjects. From visual inspection of the images, the subjects were evaluated to insure that each consistently presented measurements uncompromised by the presence of “horn” and “porphyrin”. The measurements were taken from the cheek, under the eye. For all subjects, the region of interest (ROI) was defined as a rectangular area on the left cheek, under the eye, with the top left corner of the ROI aligned horizontally with the center of the eye and aligned vertically with the center of the nose.


In order to quantify the elastotic material for each ROI, the green channel (RGB data) of the blue fluorescence (BF) image was selected since the elastin crosslinks fluoresce at the green region of the spectrum. Furthermore, the fluorescence signal as defined by the green channel of the BF images has to be corrected such that the measurement is not affected by the facial pigmentation. The green channel of the visible image, corresponding to the same ROI on the face, was used to normalize the signal. The corrected-for-pigment green channel of the BF image was averaged over the area of the ROI. The extracted number is referred to as the “background blue fluorescence index”, denominated by BBFI.


The BBFI for each of the subjects in the database was extracted and the average and the standard deviation of the BBFI were computed to analyze the dependency of the BBFI as a function of the age and the skin type. The results are summarized in the two graphs of FIGS. 4 and 5. FIG. 4 shows BBFI as a function of age, for African-American skin, for summer and winter and FIG. 5 shows BBFI as a function of age, for Caucasian skin, for summer and winter.


It should be understood that the embodiments described herein are merely exemplary, and that a person skilled in the art may make many variations and modifications without departing from the spirit and scope of the invention. All such variations and modifications are intended to be included within the scope of the invention.

Claims
  • 1. A method for detecting photodamage to skin, comprising the steps of: (A) providing an imaging apparatus having a digital camera, a source of light of 380 nm to 430 nm;(B) exposing skin to light in the approximate wavelength range of 380 nm to 430 nm;(C) capturing the green response of the skin to the light of step (B) in a digital image with the camera;(D) isolating the green response attributable to elastotic material beneath the outer surface of the skin recorded in the digital image by the steps of identifying a region of interest in the digital image corresponding to an area of skin having low horn and low porphyrin and isolating the green response of elastotic material from the green response of skin pigment and;(E) measuring the green response attributable to elastotic material beneath the outer surface of the skin recorded in the digital image.
  • 2. The method of claim 1, wherein said step of identifying includes identifying a plurality of regions of interest on the skin imaged; taking at least one image of a plurality of the regions of interest; and comparing the resultant green response recorded in the at least one image for the plurality of regions.
  • 3. The method of claim 2, wherein variations of green response from region to region are quantitatively interpreted as indicative of photodamage.
  • 4. The method of claim 3, wherein the variation of green response from region to region is quantified by calculating the standard deviation thereof.
  • 5. The method of claim 1, further including repeating steps (A) through (E) a plurality of times for skin of different persons who form a statistically significant group to establish a group model.
  • 6. The method of claim 5, further comprising the steps of identifying a group model which is predictive for an individual and comparing the green response of the individual to the predictive group model.
  • 7. The method of claim 6, wherein the relationship between the green response of the individual and the green response of the group model is expressed as a percentile rank.
  • 8. The method of claim 5, wherein the persons are selected for inclusion in a group based upon at least one of the following: race, skin pigmentation, geographic location of residence and extent of sun exposure.
  • 9. The method of claim 5, further including the step of performing said steps (A) through (E) in a plurality of different seasons which have significantly different levels of solar radiation.
  • 10. The method of claim 5, further including the steps of identifying a plurality of regions of interest on the skin, then for each person in the group, taking at least one image for each of the regions of interest and comparing the resultant green response stored in the images for the plurality of regions.
  • 11. The method of claim 1, further including the step of converting an imaging colorspace in which the green response is first recorded to L*a*b* colorspace, and using the a* axis in measuring the green response.
  • 12. The method of claim 1, further including the step of performing steps (A) through (E) a plurality of times yielding corresponding green responses, from which a trend in the person's photodamage may be discerned.
  • 13. The method of claim 12, wherein the trend may be used to assess the person's response to treatment of the photodamage.
  • 14. The method of claim 1, wherein the step of isolating the green response of elastotic material includes capturing images in white light and in blue light then normalizing image data from an image taken in white light and image data from an image taken in blue light, wherein the respective white and blue light images are of an area of skin having substantially the same pigment and elastotic material characteristics.
  • 15. The method of claim 1, wherein the region of interest corresponds to an area of skin on the cheek under the eye.
  • 16. A method for detecting photodamage to skin, comprising the steps of: (A) selecting a plurality of persons on the basis of skin similarity;(B) identifying a plurality of facial regions having different sun-exposure probability;(C) for each of said plurality of persons, exposing each of the plurality of skin regions to light in the approximate wavelength range of 380 nm to 430 nm and capturing a plurality of digital images with a digital camera, each digital image having green response data corresponding to the green response of the skin imaged;(D) converting the green response data to a* equivalents in L*a*b* colorspace, said green response data being at least partially attributable to the elastotic material beneath the surface of the skin, the presence of elastotic material being indicative of photodamage;(E) quantitatively analyzing the green response data primarily attributable to elastotic material differentiated from that attributable to skin pigment and porphyrins to ascertain at least one of the mean of the green response data for all images and the standard deviation between regions for the plurality of persons;(F) comparing at least one of the mean and the standard deviation of the green response data of an individual to the quantitatively analyzed green response data of Step (E) to show how the individual's photodamage compares to that of the plurality of other persons, thereby giving a relative measure of photodamage.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/848,767 filed Oct. 2, 2006, the disclosure of which is incorporated herein by reference in its entirety.

US Referenced Citations (55)
Number Name Date Kind
4170987 Anselmo et al. Oct 1979 A
4592726 Brilliant Jun 1986 A
4911544 Walsh Mar 1990 A
5016173 Kenet et al. May 1991 A
5241468 Kenet Aug 1993 A
5331551 Tsuruoka et al. Jul 1994 A
5363854 Martens et al. Nov 1994 A
5456260 Kollias et al. Oct 1995 A
5539540 Spaulding et al. Jul 1996 A
5556612 Anderson et al. Sep 1996 A
5640957 Kaminski Jun 1997 A
5742392 Anderson et al. Apr 1998 A
5785960 Rigg et al. Jul 1998 A
5836872 Kenet et al. Nov 1998 A
5945112 Flynn et al. Aug 1999 A
6018586 Kamei Jan 2000 A
6021344 Lui et al. Feb 2000 A
6032071 Binder Feb 2000 A
6081612 Gutkowicz-Krusin et al. Jun 2000 A
6148092 Qian Nov 2000 A
6208749 Gutkowicz-Krusin et al. Mar 2001 B1
6215893 Leshem et al. Apr 2001 B1
6293284 Rigg Sep 2001 B1
6317624 Kollias et al. Nov 2001 B1
6436127 Anderson et al. Aug 2002 B1
6507747 Gowda et al. Jan 2003 B1
6510366 Murray et al. Jan 2003 B1
6597392 Jenkins et al. Jul 2003 B1
6603552 Cline et al. Aug 2003 B1
6728560 Kollias et al. Apr 2004 B2
7004599 Mullani Feb 2006 B2
7015929 Satomi et al. Mar 2006 B2
20020059030 Otworth et al. May 2002 A1
20020065468 Utzinger et al. May 2002 A1
20020093698 Kagawa Jul 2002 A1
20030045916 Anderson et al. Mar 2003 A1
20030067545 Giron et al. Apr 2003 A1
20030086703 Kollias et al. May 2003 A1
20030086712 Merola et al. May 2003 A1
20030138249 Merola et al. Jul 2003 A1
20040006553 de Vries et al. Jan 2004 A1
20040077951 Lin et al. Apr 2004 A1
20040125996 Eddowes et al. Jul 2004 A1
20040146290 Kollias et al. Jul 2004 A1
20040174525 Mullani Sep 2004 A1
20040186363 Smit et al. Sep 2004 A1
20040263880 Ito et al. Dec 2004 A1
20050131304 Stamatas et al. Jun 2005 A1
20050146863 Mullani Jul 2005 A1
20050195316 Kollias et al. Sep 2005 A1
20050287040 Giebeler et al. Dec 2005 A1
20060092315 Payonk et al. May 2006 A1
20070002479 Menke et al. Jan 2007 A1
20070004972 Cole et al. Jan 2007 A1
20070005393 Cole et al. Jan 2007 A1
Foreign Referenced Citations (26)
Number Date Country
0737932 Oct 1996 EP
0682236 Nov 1996 EP
1089208 Apr 2001 EP
1118845 Jul 2001 EP
1194898 Mar 2003 EP
1297782 Apr 2003 EP
1376444 Jan 2004 EP
1433418 Jun 2004 EP
1434156 Jun 2004 EP
1541084 Jun 2005 EP
2293648 Apr 1996 GB
7075629 Mar 1995 JP
WO 9616698 Jun 1996 WO
WO 0104839 Jan 1997 WO
WO 9705473 Feb 1997 WO
WO 9917668 Apr 1997 WO
WO 9747235 Dec 1997 WO
WO 9824360 Jun 1998 WO
WO 9837811 Sep 1998 WO
WO 0076398 Dec 2000 WO
WO 0122869 Apr 2001 WO
WO 0135827 May 2001 WO
WO 0145557 Jun 2001 WO
WO 0172216 Oct 2001 WO
WO 02061405 Aug 2002 WO
WO 03040878 May 2003 WO
Related Publications (1)
Number Date Country
20080080755 A1 Apr 2008 US
Provisional Applications (1)
Number Date Country
60848767 Oct 2006 US