Many significant and commercially important uses of modern computer technology relate to images. These include image processing, image analysis and computer vision applications. A challenge in the utilization of computers to accurately and correctly perform operations relating to images is the development of algorithms that truly reflect and represent physical phenomena occurring in the visual world. For example, the ability of a computer to correctly and accurately distinguish between a shadow and a material object edge within an image has been a persistent challenge to scientists. Edge detection is a fundamental task in image processing because without accurate and correct detection of the edges of physical objects, no other processing of the image is possible. If a cast shadow is indistinguishable from the object casting the shadow, it would not be possible for the computer to recognize the object.
An early and conventional approach to object edge detection involves an analysis of brightness boundaries in an image. In the analysis it is assumed that a boundary caused by a material object will be sharp, while a boundary caused by a shadow will be soft or gradual due to the penumbra effect of shadows. While this approach can be implemented by algorithms that can be accurately executed by a computer, the results will often be incorrect. In the real world there are many instances wherein shadows form sharp boundaries, and conversely, material object edges form soft boundaries. Thus, when utilizing conventional techniques for shadow and edge recognition, there are significant possibilities for false positives and false negatives for shadow recognition. That is, for example, a material edge that imitates a shadow and is thus identified incorrectly by a computer as a shadow or a sharp shadow boundary that is incorrectly interpreted as an object boundary.
Once shadows and object edges are identified, a typical computerized operation is manipulation of the image to, for example, remove shadows from the image. Most scenes depicted in an image have a dominant illuminant, defined as a direct or incident illuminant. The incident illuminant causes shadows. The component of radiance onto a surface in the scene that is not from the incident illuminant, is referred to as an indirect or ambient illuminant. It is the ambient illuminant that is present within a shadow. While much of the energy of the ambient illuminant may come from the incident illuminant, it has generally interacted with the environment.
Typical solutions for manipulating images focus on the incident illuminant. Models have been developed for computerized image pixel manipulation based upon the assumption that the ambient illumination has the same spectral characteristics as the incident illumination or is non-existent. One such known solution is the dichromatic reflection model, which describes the variations in appearance caused by the combination of body and surface reflection on a material. Body reflection is what is normally considered the color of the material. The surface reflection is referred to as a highlight or specularity of the material reflecting the illuminant. The known dichromatic reflection model assumes a single incident illuminant and does not account for a non-zero ambient illuminant. Thus, results of image manipulation based upon the dichromatic reflection model are often not color correct.
Other useful solutions include color spaces such as hue and chromaticity, and other normalized color spaces that attempt to factor out the effect of changing the intensity of the incident illuminant on the intensity of the reflection from a surface. However, these color models have met with limited success in solving practical vision problems. Consequently, there is a growing realization that simple models of illumination do not correctly reflect the visual world, and thus, do not provide color correct manipulations. Recent research has focused upon empirical models of color change over a single material. This approach is not restricted by any prior assumptions about the behavior of illumination color or reflectance.
There is also significant amount of research attempting to determine the complete illumination environment. These methods are based upon multiple images of the same scene and/or knowledge of the scene geometry. In one research project, the existence and importance of complex indirect illumination is acknowledged. However, the method requires both a known geometry of a scene and two images. While these research efforts approach a solution that can extract and represent illumination environments of significant complexity, they cannot be used in environments such as, for example, consumer photography, or with existing photos or in any situation where either taking multiple images of a scene from different points of view or inserting objects into a scene are not readily possible or are unreasonable.
The present invention provides a bi-illuminant dichromatic reflection model (BIDR model) as a representation of an image to facilitate color correct image manipulation.
In a first exemplary embodiment of the present invention, an automated, computerized method for manipulating an image comprises the steps of manipulating the image to provide an intensity adjusted image, deriving a bi-illuminant dichromatic reflection model representation of the image and utilizing the bi-illuminant dichromatic reflection model representation to manipulate the intensity adjusted image to generate a color correct intensity adjusted image. In a preferred embodiment of the present invention, the step of manipulating the image to provide an intensity adjusted image is carried out by executing a gamma correction method.
In a second exemplary embodiment of the present invention, a computer system comprises a CPU and a memory storing an image file. According to a feature of the present invention, the CPU is arranged and configured to execute a routine to manipulate the image to provide an intensity adjusted image, derive a bi-illuminant dichromatic reflection model representation of the image, and utilize the bi-illuminant dichromatic reflection model representation to manipulate the intensity adjusted image to generate a color correct intensity adjusted image. In a preferred embodiment of the present invention, the CPU executes a routine to manipulate the image to provide an intensity adjusted image by executing a gamma correction method.
In accordance with yet further embodiments of the present invention, computer systems are provided, which include one or more computers configured (e.g., programmed) to perform the methods described above. In accordance with other embodiments of the present invention, computer readable media are provided which have stored thereon computer executable process steps operable to control a computer(s) to implement the embodiments described above. The automated, computerized methods can be performed by a digital computer, analog computer, optical sensor, state machine, sequencer or any device or apparatus that can be designed or programed to carry out the steps of the methods of the present invention.
a & b are graphs in RGB color space showing colors for a material, from a fully shaded color value to a fully lit color value, with error bounds forming a cylinder, as determined by execution of the bi-illuminant dichromatic reflection model according to a feature of the present invention.
a is a flow chart for a color correct brightness adjustment to an intensity adjusted image, according to a feature of the present invention.
b is a graph in RGB space showing an intensity adjusted pixel value for the intensity adjusted image of
c is a flow chart for estimating a gamma (γ) value for the pixel of
Referring now to the drawings, and initially to
Alternatively, the CPU can be implemented as a microprocessor embedded in a device such as, for example, the digital camera 14 or a robot. The CPU can also be equipped with a real time operating system for real time operations relating to images, for example, in connection with a robotic operation or an interactive operation with a user.
As shown in
In an image operation, the CPU 12 operates to analyze the RGB values of the pixels of a stored image file 18 to achieve various objectives, such as, for example, manipulation of the image to modify a shadow or to make a color correct brightness adjustment. A fundamental observation underlying a basic discovery of the present invention, is that an image comprises two components, material and illumination. All changes in an image are caused by one or the other of these components.
In a first exemplary embodiment of the present invention, shadowed and fully lit regions of an image are manually selected by a user. What is visible to the human eye upon display on the monitor 20 of a stored image file 18 by the CPU 12, is the pixel color values caused by the interaction between specular and body reflection properties of material objects in, for example, a scene photographed by the digital camera 14 and illumination flux present at the time the photograph was taken. As noted above, the illumination flux comprises an ambient illuminant and an incident illuminant. The incident illuminant is light that causes a shadow and is found outside a shadow perimeter. The ambient illuminant is light present on both the bright and dark sides of a shadow, but is more perceptible within the dark region.
In step 104, the CPU 12 operates on the user input selections to calculate a spectral ratio, S=Dark/(Bright−Dark), where Dark, for example, is a pixel in the fully shadowed material of the region selected by the user, and Bright is a pixel in the fully lit portion of that material selected by the user. A normalized version of the spectral ratio can be used in the methods according to the present invention. According to a feature of the present invention, the spectral ratio is used to manipulate pixel values for a color correct adjustment. Based upon the fundamental observation of the present invention that an image comprises two components, material and illumination, the computer system 10 can be operated to differentiate between material aspects and illumination flux through recognition of a spectral shift caused by the interplay between the incident or direct illuminant and the ambient illuminant. When one of material and illumination is known in an image, the other can be readily deduced. The spectrum for the incident illuminant and the ambient illuminant can be different from one another. A spectral shift caused by a shadow, i.e., a decrease of the intensity of the incident illuminant, will be substantially invariant over different materials present in a scene depicted in an image.
Pursuant to a feature of the present invention, this spectral shift information is detected by determination of an illuminant ratio, or a characteristic spectral ratio formed by the interplay of the incident illuminant and the ambient illuminant. A spectral ratio is a ratio based upon a difference in color or intensities between two areas of a scene depicted in an image, which may be caused by different materials, an illumination change or both.
An automated, computerized method for determining a characteristic spectral or illuminant ratio due to illumination flux, for an image, is disclosed in co-pending application Ser. No. 11/341,742, filed on Jan. 27, 2006, entitled: “Method and System For Identifying Illumination Flux In An Image,” which is hereby incorporated by reference. As disclosed in the co-pending application Ser. No. 11/341,742, to improve the accuracy and correctness of the characteristic ratio for an image, the spectral ratio information for illumination boundaries is determined on a local level, that is, an illuminant ratio is determined for each of several preselected local areas of a scene depicted in an image. An analysis of a boundary is then executed utilizing the spectral ratio for the specific location of the boundary within the image. The determination of locally relevant spectral ratios accommodates complexities that may be encountered in a real world image, for example, the interplay of several different sources of light in a room, inter-reflections, and so on.
In order to facilitate an accurate and correct manipulation of pixel values, to modify, for example, the pixel from a shaded color (Dark) to a correct fully lit color (Bright), the present invention recognizes the characteristic spectral ratio (illuminant ratio) as an analytical representation of image properties and characteristics pursuant to a bi-illuminant dichromatic reflection model. The bi-illuminant dichromatic reflection model (BIDR) combines terms relevant to the ambient illuminant with the dichromatic reflection model described above. The two illuminants of the BIDR model correspond to the incident illuminant and the ambient illuminant. The BIDR model can be stated as follow:
I(x,y,z,θ,φ,λ)=[mb(θi)cb(λ)+ms(θi,φi,θe,φe)cs(λ)]ld(λ)+Ma(λ)cb(λ)+Mas(θe,φe,λ)cs(λ),
where: I(x, y, z, θ, φ, λ) is the radiance of a surface point at (x, y, z) in the direction θ, φ, for the wavelength λ,
In the dichromatic reflection model, the radiance, I(x, y, z, θ, φ, λ), for a surface at a point viewed from the orientation by θ, φ is expressed as the sum of two bipartite terms multiplied by the illumination intensity and color ld(λ) to reflect the effect of the incident illuminant. The first reflectance term explains body reflection. mb(θi) is the amount of incident illuminant energy reflected by the body reflection, referred to as diffuse reflection, as a function of the geometric relationship of the light source and the surface, expressed by the incident angle θi. cb(λ) is the fraction of the incident illuminant energy reflected by the body reflection for each wavelength λ and describes what is considered the body color. The second reflection term explains surface reflection. ms(θi, φi, θe, φe) is the amount of the incident energy reflected by the surface reflection as a function of the geometry as expressed by the incident angles θi, φi and exit angles θe, φe. cs(λ) is the fraction of the incident energy reflected by the surface reflection for each wavelength λ. The power of the dichromatic reflection model is that the model predicts that the appearance, or color, of a uniform color dielectric surface under a single incident illuminant falls within a plane defined by the two color vectors cb and cs in RGB space, even with variation in the amount of incident illuminant and specularities on the surface.
According to a feature of the present invention, the BIDR model adds body and surface reflection terms for the ambient illuminant, which, as noted above may have a significantly different spectrum from the incident illuminant. Unlike the incident illuminant, the ambient illuminant is radiated from the whole hemisphere visible from the surface point.
Thus, Ma(λ) is the integral of the ambient body reflection:
∫mb(θi)la(θi,φi,λ)d θidφi.
Mas(θe, φe, λ): ∫ms(θi, φi, θe, φe)la(θi, φi, λ)d θi d φi. This function represents the integral of the ambient illuminant and geometric surface reflectance over the hemisphere, excluding the incident illuminant.
The above functions are an integration of all incoming illumination other than incident illuminant, as integrated over θi, φi≠θL, φL (incident illuminant). The BIDR model according to the present invention can accurately and correctly accommodate and predict tremendous complexity in the appearance of a surface, even a surface of uniform material. If, for example, the ambient environment is both bright and changes quickly across a surface, the ambient illuminant terms can cause deviations from the plane predicted by the dichromatic reflection model. Indeed, unlike the dichromatic reflection model, the BIDR model according to the present invention predicts a plane in the RGB space that does not necessarily pass through the zero point of the space, but in fact most often exhibits an offset from the zero point that comprises the color of the ambient illumination multiplied by the object color. The offset results in color correct changes when a pixel value is manipulated using the BIDR model of the present invention.
Given that the ambient illuminant is often an order of magnitude or more than the incident illuminant, the ambient specularity or body surface reflectance Mas(θe, φe, λ) term has a minimal effect on the appearance of a surface and can be discarded without significantly affecting the quality of the model. The BIDR model then reduces to three terms:
I(x,y,z,θ,φ,λ)=[mb(θi)cb(λ)+ms(θi,φi,θe,φe)cs(λ)]ld(λ)+Ma(λ)cb(λ).
Inasmuch as the appearance of cast shadows on a surface is also relevant to the uses of the BIDR model, a shadow term or factor sx, y, z ∈ [0,1] can be added to multiply the incident illuminant term:
I(x,y,z,θ,φ,λ)=[mb(θi)cb(λ)+ms(θi,φi,θe,φe)cs(λ)]ld(λ)sx,y,z+Ma(λ)cb(λ).
A fully lit pixel will have a shadow factor, s=1, and a fully shadowed pixel will have an s=0, with the only remaining term in the model at s=0 being the ambient body reflection. The model can be restated by substituting γb, the product of the shadow factor sx, y, z and the geometric factor mb(θi), for those non-spectral factors in the body reflection, and γs, the product of the shadow factor sx, y, z and the geometric factor ms(θi, φi, θe, φe), for those non-spectral factors in the surface reflection. The BIDR model is thus restated as: I(x, y, z, θ, φ, λ)=cb(λ)ld(λ)γb+cs(λ)ld(λ)γs+Ma(λ)cb(λ).
In the absence of specularities in a material, the second term of the BIDR model, cs(λ)ld (λ)γs, is zero, and the measured values of a surface will exist on a single theoretical line in, for example, RGB space. With no specularity term, the BIDR model is given by: I(x, y, z, θ, φ, λ)=cb (λ)ld(λ)γb+Ma(λ)cb(λ).
In practice, a camera or other sensor used to record an image typically has noise, and no material in an image is of a completely uniform color. Accordingly, the appearance values of the surface fall within a cylinder having a width determined by variation in material and imaging sensor noise characteristics. The cylinder representing body reflection, according to the incident and ambient illuminants considered in the BIDR model of the present invention, has a unique starting place for every intrinsic color in the scene. The starting point is determined by the product of the ambient illumination and the body color, and the slope of the cylinder in RGB space is determined by the product of the incident illumination and the body color.
a & b are graphs in RGB color space showing colors for a material, from a fully shaded color value to a fully lit color value, with error bounds forming a cylinder. In
b, illustrates a cone shaped BIDR cylinder in recognition that the same absolute distance at the fully shadowed end represents a greater actual color difference than the same absolute distance from the line at the fully lit end of the line. This is due to the fact that the magnitude of the color band intensities at the shadow end are a greater percentage of the actual distance from the line in the shadow end than at the lit end. For example, consider a color at the shadow end of the cylinder of (RGB)=(5, 6, 8) and a color at the lit end of (100, 120, 160). If the CPU 12 modifies the color value for each 10 units toward the color red from both color values, the result is a shadow color value of (15, 6, 8) and a lit color of (10, 120, 160). At the dark end, the color shifted from a distinctly blue color to a distinctly red color, while at the lit end the color remains blue. In order to compensate for the difference, an adjustment is made to the cylinder to be narrower at the shadow end and wider at the lit end such that a same magnitude of color change will have a correspondingly accurate absolute distance from the line.
When stating the spectral ratio, S=Dark/(Bright-Dark), in terms of the BIDR model, S=Ma(λ)cb(λ)/([cb(λ)ld(λ)γb+Ma(λ)cb(λ)]−Ma(λ)cb(λ)). This equation reduces to S=Ma(λ)/ld(λ)γb. Inasmuch as γb is scalar, the relative proportions of different color bands in the spectral ratio, for example, RGB values, are constant. Thus, for a given pair of direct and ambient illuminants in an image, the normalized spectral ratio is constant for all Bright and Dark pairs that correspond to the same material when Dark is assumed to have a γb=0, and the Bright is receiving some incident illuminant. The spectral ratio is therefore a representation of image properties and characteristics that, according to the BIDR model, can be utilized as a basis for manipulation of pixel values for a color correct adjustment, for example, as a prediction of color adjustments that fall within a color correct cylinder in RGB space, as illustrated in
In addition, the BIDR model can be used as a basis for representing pixel values. Rather than an RGB value, each pixel is represented by a BIDR cylinder in RGB space and a γ value, to indicate where in a specific BIDR cylinder, for example, the cylinder of
In step 106, the user selects an area from within the regions provided by the user in steps 100, 102, to be manipulated or corrected, and the degree of adjustment. The degree of adjustment is reflected in the value of γb, with, for example, γb=0.5 being selected if the user desired a half-shadow. In step 108, the CPU 12 uses the spectral ratio calculated in step 104 to adjust the intensity and color of the selected region to achieve the degree of adjustment selected by the user.
A method for generating an approximate gamma map for the pixels of the image can comprise a dynamic range compression algorithm as an input. Examples of such algorithms include a Retinex based algorithm, marketed by Hewlett-Packard or a gamma correction algorithm, an industry standard image compression algorithm. Note that a gamma correction process is distinct from a gamma map that indicates a gamma (γ corresponding to γb of the BIDR model representation). For a further discussion of gamma map generation, see the description of
In step 116, the CPU 12 operates to calculate a fully shadowed (Dark) version of each pixel in the selected area, Dark=P/(1+γ/S), where P is the color vector in RGB space of a pixel in the selected area of the subject image 18, gamma (γ) is the value of gamma for that pixel from the gamma map, and S is the spectral ratio calculated by the CPU 12 in step 104 of
In step 118, the CPU 12 calculates a color adjusted new value for each pixel in the selected area as a function of the new gamma map designated by the user: Pnew=Dark+γnew (Dark/S), where γnew is the new value for the pixel from the new gamma map designated by the user. In step 120, the CPU 12 outputs the image area with the modified incident illuminant (step 108 of
Referring once again to
a shows a flow chart for a color correct brightness adjustment to an intensity adjusted image, according to a feature of the present invention. The CPU 12 is given an original image area, an intensity adjusted image area, a gamma map and a spectral ratio S for the original image area (step 200). The intensity adjusted image area can be the output of a known dynamic range compression algorithm, such as, for example, the Retinex-based dynamic range compression algorithm marketed by Hewlett-Packard or a Foveon statistics-based dynamic range compression algorithm. These algorithms brighten darker areas of an image for a more pleasing appearance, by adjusting the intensity but not the color of pixels: f*(R, G, B)=>(fR, fG, fB). The routine of
To that end, reference is made to
c is a flow chart for estimating a gamma (γ) value for the pixel of
In step 404, for each pixel, the CPU 12 determines a Q, as the value of the minimum of R or the value of (1+∥S∥)/∥S∥. In step 406, for each pixel, the CPU 12 calculates a gamma value: γ=[(1+∥S∥)/Q]−∥S∥. After completing steps 402-406 for each pixel, the CPU outputs a gamma map of the image, with a gamma value for each pixel. The gamma value indicates the percent of incident or direct illuminant on the pixel.
In step 202, the CPU 12 calculates a fully shadowed version (Dark) for each pixel as performed by the CPU 12 in step 116 of
Thereafter, the CPU 12 calculates a fraction representing the difference between the goal intensity, that is, the intensity of the intensity adjusted image, and the intensity of the Pbright: fraction=(Pgoal intensity−Pbright intensity)/Vintensity. The adjustment required to the intensity of Pbright to reach the intensity of the intensity adjusted image is Adjustment=fraction*V. The final pixel value is then: Pfinal=Pbright+Adjustment.
After the CPU 12 completes step 204 for each pixel in the image area, the CPU 12 outputs a color correct intensity adjusted image (step 206).
In step 210, the CPU calculates a shadowed version (Dark) of each pixel in the image area, again as performed by the CPU 12 in step 116 of
In step 216, the CPU 12 uses the spectral ratio and gamma map to calculate a fully shadowed (Dark) version of each pixel in the image area, again using the algorithm: Dark=P/(1+γ/S). In steps 218, 220, the CPU 12 multiplies each Dark pixel by V to yield Darknew and thereby obtain a new apparent ambient illuminant (step 218), and also multiply S by V to obtain Snew (step 220).
In step 222, The CPU 12, using Snew and the gamma map, calculates a new color for each pixel: Pnew=Darknew+γ(Darknew/Snew). Upon completion of step 222 for all pixels, the CPU 12 outputs an image area with a modified apparent ambient illuminant (step 224).
In step 302, the CPU 12 calculates a Dark version of each pixel, as completed in the routines of the previous figures. In step 304, a new spectral ratio is determined by the CPU 12 using the vector V, Snew=S*1/V. The new spectral ratio permits a manipulation of pixel values to in effect, modify the apparent incident illumination. In step 306, the CPU 12 uses Snew and the gamma map to calculate a new color for each pixel: Pnew=Dark+γ(Dark/Snew). Upon completion of step 306 for all pixels, the CPU 12 outputs an image area with a modified apparent direct or incident illuminant.
Gamma correction is an industry standard method for brightening an image for display on a monitor or in print. According to the standard, an image is adjusted such that for each pixel in the image, the intensity is measured on a scale of 0 to 1, and the brightened intensity is equal to the original intensity raised to a power of (1.0/gamma), where gamma is a value greater than or equal to 1.0. The gamma used in the industry standard is not to be confused with gamma used above in this document to represent the fraction of incident light on a surface. To avoid confusion, the brightening factor used herein can be defined as lambda (λ). Gamma correction brightens all pixels some amount irrespective of illumination. Like other forms of dynamic range compression, gamma correction brightens shadows without making them more similar in color to the color correct unshaded counterparts. As will be described, the concepts of the BIDR model of the present invention can be applied to brighten shadows and adjust the color to provide a color correct, and thus, more visually pleasing image.
In step 606, the CPU 12 calculates the intensity of the DARK pixel (intensity(D)) of the BIDR cylinder as intensity(D)=intensity(B1)/R2. If intensity(D)>intensity(C), then the value C is updated to be C*intensity(D)/intensity(C). Next, in step 608, the CPU 12 calculates the intensity of the bright pixel P on the BIDR cylinder C as intensity(C)/R1 if intensity(B1)/intensity(C)>R1; otherwise, the intensity(P) is set to intensity(C). The intensity(P) will be less than the intensity(B1) because gamma correction brightens all pixels, even pixels in full incident illumination. The ratio R1 is a measurement of the excess brightening beyond full incident illumination.
Knowing the normalized spectral ratio Ŝ, the original color C, and the intensity(D), the CPU 12 calculates the dark color D in step 610. The dark color D is the color such that D=(kŜC)/(1+kŜ) for some scalar k. There is one value of k that satisfies the equation with the correct intensity for D. The value can be found by a direct algebraic solution or by successive approximation.
With the dark color D, the intensity(P), and the normalized spectral ratio Ŝ, the CPU 12 calculates the fully lit color P in step 612. The color P is the color with the proper intensity such that P=(D+DŜk)/(Ŝk) for some scalar k. The scalar k can be found as k=(DR/ŜR+DG/ŜG+DB/ŜB)/(3*intensity(P)−DR−DG−DB). In step 614, the CPU 12 brightens the color P to have the same intensity as B1, resulting in the color corrected brightened color B2. Following these steps for each pixel in the image produces a gamma corrected image with appropriately colored shadows (step 616).
In the preceding specification, the invention has been described with reference to specific exemplary embodiments and examples thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the claims that follow. The specification and drawings are accordingly to be regarded in an illustrative manner rather than a restrictive sense.
This application is a continuation-in-part of application Ser. No. 11/341,751, filed Jan. 27, 2006, entitled: “Bi-illuminant Dichromatic Reflection Model For Image Manipulation,” which is hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5253339 | Wells et al. | Oct 1993 | A |
5495536 | Osbourn | Feb 1996 | A |
5651042 | Dewaele | Jul 1997 | A |
5774112 | Kasson | Jun 1998 | A |
6061091 | Van de Poel et al. | May 2000 | A |
6272249 | Kobayashi et al. | Aug 2001 | B1 |
6428169 | Deter et al. | Aug 2002 | B1 |
6792160 | Shaw et al. | Sep 2004 | B2 |
7031525 | Beardsley | Apr 2006 | B2 |
7305127 | Wells | Dec 2007 | B2 |
20010007599 | Iguchi et al. | Jul 2001 | A1 |
20020080148 | Uchino | Jun 2002 | A1 |
20020176023 | Hofflinger et al. | Nov 2002 | A1 |
20030053689 | Watanabe et al. | Mar 2003 | A1 |
20050117045 | Abdellatif et al. | Jun 2005 | A1 |
20060018537 | Wu et al. | Jan 2006 | A1 |
20060018539 | Sato et al. | Jan 2006 | A1 |
Entry |
---|
Baba, et al. “Shadow removal from a real image based on shadow density” ACM SIGGRAPH 2004 Posters, Aug. 8-12, 2004, Los Angeles, California. |
Ebner, Marc and Christian Herrmann. “On Determining the Color of the Illuminant Using the Dichromatic Reflection Model”. Sep. 14, 2005. p. 1-8. Available at http://www.springerlink.com/content/6r7teb3tmfpg8wce/fulltext.pdf. |
Kobus Barnard and Graham Finlayson, Shadow Identification using Colour Ratios, Proceedings of the IS&T/SID Eighth Color Imaging Conference: Color Science, Systems and Applications, 2000, 97-101. |
Baba, et al:“Shadow removal from a real picture,” Proceedings of the SIGGRAPH 2003 conference on Sketches & Applications, ACM Press, 1-1, 2003, 1 page. |
Sato et al: Illumination distribution from brightness in shadows: adaptive distribution with unknown reflectance properties in shadow regions, IN ICCV(2) 875-882, 1999. |
K. Barnard, G.D. Finlayson and B. Funt, Color Constancy for Scenes with Varying Illumination, Computer Vision and Image Understanding, 65(2): 311-321, Feb. 1997. |
H.G. Barrow and J.M. Tenenbaum, Recovering Intrinsic Scene Characteristics from Imag, Computer Vision Systems, pp. 3-26, 1978. |
C.F. Borges, A Trichromatic Approximation Method for Surface Illumination, Journal of Optical Society of America A, 8(8): 1319-1323., Aug. 1991. |
M.S. Drew, G.D. Finlayson and S.D. Horley, Recovery of Chromaticity Image Free from Shadows via Illumination Invariance, Proceedings of IEEE Workshop on Color and Photometric Methods in Computer Vision, Nice, France 2003, pp. 32-39. |
C.D. Finlayson, M.S. Drew and L. Cheng, Intrinsic Images by Entropy Minimization, Proceedings of European Conference on Computer Vision, LNCS 3023, pp. 582-595, 2004. |
G.D. Finlayson, S.D. Horley and M.S. Drew, Removing Shadows from Images, 2002, pp. 2-14. |
G.D. Finlayson, S.D. Horley and M.S. Drew, On the Removal of Shadows from Images, 2006, pp. 1-11. |
G.D. Funklea and R. Bajcsy, Combining Color and Geometry for the Active, Visual Recognition of Shadows, University of Pennsylvania Department of Computer & Information Science Technical Report No. MS-CIS-94-62, 1994. |
R. Gershon, A.D. Jepson and J. K. Tsotsos, Ambient Illumination and the Determination of Material Changes, Journal of Optical Society of America A, 3(10):1700-1707, 1986. |
J.M. Geusebroek, R.v.d. Bommgard and A.W.M. Smeulders, Color Invariance, IEEE Trans. On Pattern Analysis and Machine Intelligence, 23(12):1338-1350, Dec. 2001. |
G.E. Healey, Using Color for Geometry-Insensitive Segmentation, Journal of Optical Society of America A, 6(6):920-937, Jun. 1989. |
B.K.P. Horn, Determining Lightness from an Image, Computer Graphics and Image Processing, 3(1)277-299, Dec. 1974. |
G.J. Klinker, S.A. Shafer and T. Kanade, A Physical Approach to Color Image Understanding, International Journal of Computer Vision, 4(1): 7-38, Jan. 1990. |
E.H. Land and J.J. McCann, Lightness and Retinex Theory, Journal of Optical Society of America A, 61:1-11, 1971. |
M.S. Langer, When Shadows Become Interreflections, International Journal of Computer Vision, 34(2/3), 193-204, 1999. |
J.A. Marchant and C.M. Onyango, Shadow-Invariant Classification for Scenes Illuminated by Daylight, Journal of Optical Society of America A, 17(11), Nov. 2000. |
S.K. Nayar, K. Ikeuchi and T. Kanade, Shape from Interreflections, IEEE International Conference onn cOmputr Vision (ICCV), pp. 2-11, Dec. 1990. |
I. Omer and M. Werman, Color Lines: Image Specific Color Representation, Proceeding of IEEE Conference on Computer Vision and Patter Recognition, pp. 946-953, Jun. 2004. |
S.A Shafer, Using Color to Separate Reflection Components, Computer Science Department University of Rochester, TR 136, Apr. 1984. |
S. Tominaga, Surface Identification Using Dichromatic Reflection Model, IEEE Transactions of Pattern Analysis and Machine Intelligence, 13(7), pp. 658-670, Jul. 1991. |
S. Tominaga and N. Tanaka, Estimating Reflection Parameters from a Single Color Image, IEEE Comput. Graph. Appl., 20(5):58-66, 2000. |
J.v.d. Weijer and C. Schmid, Coloring Local Feature Extraction, pp. 1-14, 2006. |
Marc Ebner et al.: “On determining the color of the illuminant using dichromatic reflection model,” Sep. 14, 2005. p. 1-8. Available at http://www.springerlink.com/content/6r7teb3unfpq8wce/fulltext.pdf. |
Baba et al.: “Shadow Removal from a Real Picture by Color Correction Based on Degree of Shadow,” proceeding of Visual Computing Graphics and CAD joint meeting 2003, Japan, The Institute of Imaging Electronics Engineers of Japan, Information Processing Society of Japan, Jun. 19, 2003, pp. 37 to 42; see enclosed translation (8 pages). |
Baba et al:“Shadow Removal from a Real Image Based on Color Clustering,” Journal of the Institute of Imaging Electronics Engineers of Japan, Japan, The Institute of Imaging Electronics Engineers of Japan, Aug. 25, 2004, vol. 33, No. 4-B, pp. 531-538; see English translation (8 pages). |
Lifeng Liu et al: “Color change method based on dichromatic reflection model” Signal Processing, 1996., 3rd International Conference on Beijing, China Oct. 14-18, 1996, New York, NY, USA,IEEE, US LNKD-DOI:10.1109/ICSIGP.1996.566520, vol. 2, Oct. 14, 1996, pp. 1246-1249. |
Magda S et al: “Beyond lambert: reconstructing surfaces with arbitrary BRDFs” Proceedings of the Eight IEEE International Conference on Computer Vision. (ICCV). Vancouver, British Columbia, Canada, Jul. 7-14, 2001; [International Conference on Computer Vision], Los Alamitos, CA : IEEE Comp. Soc, US LNKD- DOI:10.1109/ICCV.200, vol. 2, Jul. 7, 2001, pp. 391-398. |
Number | Date | Country | |
---|---|---|---|
20070176941 A1 | Aug 2007 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11341751 | Jan 2006 | US |
Child | 11403764 | US |