Electronic camera and method with fill flash function

Information

  • Patent Grant
  • 8553141
  • Patent Number
    8,553,141
  • Date Filed
    Friday, May 20, 2011
    13 years ago
  • Date Issued
    Tuesday, October 8, 2013
    10 years ago
  • CPC
  • US Classifications
    Field of Search
    • US
    • 348 216100
    • 348 229100
    • 348 260000
    • 348 261000
    • 348 262000
    • 348 264000
    • 348 216000
    • 348 362000
  • International Classifications
    • H04N5/222
    • H04N5/235
    • Disclaimer
      This patent is subject to a terminal disclaimer.
      Term Extension
      168
Abstract
A method and camera for electronic image capture provide an electronic image capture device, a scanning aperture shutter located to control light energy received by the image capture device, a flash unit oriented to illuminate an image scene, a photocell unit adapted for sensing visible spectrum energy and infrared spectrum energy received from the image scene, and an exposure control system responsive to the photocell unit and operatively connected to the scanning aperture shutter and the flash unit. The exposure control system is adapted to control an amount of fill flash energy received from the image scene in relation to visible ambient light energy received from the image scene during image capture by illuminating the flash unit once a predetermined amount of ambient visible spectrum energy is sensed by the photocell unit and by extinguishing the flash unit once a predetermined amount of infrared energy is sensed by the photocell unit.
Description
TECHNICAL FIELD

The present invention generally relates to electronic image capture and particularly to a fill flash function for such electronic image capture.


BACKGROUND

Electronic imaging devices, such as those used in digital cameras, typically perform image capture differently from film based cameras. Electronic image capture devices typically integrate separate output signals from each photosensitive semiconductor pixel of an array of pixels. An image capture is typically initiated by simultaneously zeroing all of the integration values of the pixels, and various approaches have been used for terminating the image capture process. Such integrated values then need to be read out from each of the array pixels. Problems occur in controlling the amount of time over which each of the pixels continues to integrate sensed light signals.


Controlling the integration of such imaging devices is further complicated by the attempt to control a fill flash function, wherein a flash unit is used for part of the illumination of a scene including a near field object of limited brightness and a far field background of greater brightness. Such image capture and pixel integration is still further complicated by the additional need to achieve the proper balance of illumination between natural and artificial, or flash, light sources.


SUMMARY

One embodiment of the present invention provides an electronic camera, including an electronic image capture device adapted for capturing an image scene, a scanning aperture shutter located to control light energy received by the electronic image capture device from the image scene, a photocell adapted for sensing light energy received from the image scene, and an exposure control system responsive to the photocell and operatively connected to the scanning aperture shutter, wherein the exposure control system is adapted to control the scanning aperture shutter and a flash unit in response to sensed light energy at the photocell to control an amount of fill flash energy in relation to ambient light energy received by the electronic image capture system during image capture.


The exposure control system may be adapted to illuminate the flash unit once a predetermined amount of ambient light energy is sensed by the photocell, and also to extinguish the flash unit once a predetermined amount of infrared spectrum energy is sensed by the photocell during flash unit illumination.


The photocell may include a visible spectrum photocell and an infrared spectrum photocell, and the exposure control system may adapted to use the visible spectrum photocell to sense ambient light energy received from the image scene prior to illumination by the flash unit and to use the infrared photocell for sensing infrared spectrum energy received from the image scene during illumination by the flash unit. Also, the scanning aperture shutter may include separate apertures for the image capture device, the visible spectrum photocell and the infrared spectrum photocell.


The exposure control system may be adapted to generate control signals for a detachable flash unit, or the flash unit may be constructed integrally with the camera.


Another embodiment of the present invention includes an electronic image capture device adapted for capturing an image scene, a scanning aperture shutter located to control light energy received by the image capture device, a flash unit oriented to illuminate the image scene, a photocell unit adapted for sensing visible spectrum energy and infrared spectrum energy received from the image scene, and an exposure control system responsive to the photocell unit and operatively connected to the scanning aperture shutter and the flash unit, wherein the exposure control system is adapted to control an amount of fill flash energy received from the image scene in relation to visible ambient light energy received from the image scene during image capture by illuminating the flash unit once a predetermined amount of ambient visible spectrum energy is sensed by the photocell unit and by extinguishing the flash unit once a predetermined amount of infrared energy is sensed by the photocell unit.


The visible spectrum and infrared spectrum photocells may be separate devices, and the shutter may include separate, proportionately operable, variable apertures for the image capture device and the photocell unit. Also, the flash unit may be a quenchable strobe light.


Yet another embodiment of the present invention provides a method for electronic image capture using a fill flash function, comprising the steps of using a scanning aperture shutter to control light energy received by an electronic image capture device, sensing visible ambient light energy and infrared energy received from an image scene, and controlling the scanning aperture shutter and a flash unit during image capture in response to the sensing to cause a predetermined ratio of fill flash light energy to ambient light energy to be received by the electronic image capture device including illuminating the flash unit once a predetermined amount of ambient light energy is sensed during image capture.


The step of sensing may use an infrared spectrum photocell for sensing infrared energy received from the image scene during illumination by the flash unit, and further may use a visible light spectrum photocell for sensing ambient light energy received from the image scene before illumination by the flash unit.


The step of controlling may include extinguishing the flash unit once a predetermined amount of infrared spectrum energy is sensed during flash unit illumination. Also, scanning aperture shutter may include separate, proportionately operable, variable apertures for image capture and the step of sensing.





BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustratively shown and described in reference to the accompanying drawings, in which:



FIG. 1 is a representational side view diagram of an electronic camera constructed in accordance with one embodiment of the present invention as it would be used for image capture;



FIG. 2 is a representational front view of a blade shutter suitable for use with the camera of FIG. 1;



FIG. 3 is a representational front view of another blade shutter suitable for use with the camera of FIG. 1; and



FIG. 4 is a graph of light energy captured by the camera of FIG. 1, verses time.





DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS


FIG. 1 shows an electronic camera 10 generally including an electronic image capture device 12, a scanning aperture shutter 14, imaging optics 16, a photocell 18 and an exposure control system 20. Attached to camera 10 is a removable flash unit 22. Camera 10 forms an electronic image capture system by using imaging optics 16, such as a lens, to focus an image scene of received light from a field of view 24, on image capture device 12. Scanning aperture shutter 14 is located between imaging optics 16 and image capture device 12 to control the amount of image light received by image capture device 12.


Photocell 18 is directed to sense light energy received from a substantially similar field of view 26, as determined by a separate optical element 28. Light energy received by photocell 18 passes through, and is likewise controlled by shutter 14. In this manner, the light energy sensed by photocell 18 is analogous to the light energy received by image capture device 12.


Exposure control system 20 is coupled to photocell 18 and is adapted to responsively control shutter 14 and image capture device 12 to control the amount of light energy received from flash unit 22 during image capture.


Image capture device 12 may be constructed in any suitable manner, such as in the form of a CCD, which is the best available embodiment at the time of this application. Also, although flash unit 22 is shown as a removable attachment to camera 10, it may also be constructed as an integral part of camera 10, as represented by phantom lines 23.


As is frequently the case, an image scene 30 may include a near-field object 32 set against a far-field background 34, wherein the natural illumination of far-field background 34 is greater than that of near-field object 32. In this case, a fill flash function is used to provide greater illumination to the near-field object 32 and thereby balance the lighting of the entire photo for better composition. Fill flash is even more frequently used to minimize shadow areas in near field objects. For these purposes, exposure control system 20 is adapted to control the amount of fill flash energy received from flash unit 22 in relation to ambient light energy received during an image capture.



FIG. 2 is a representational front view of one form of scanning aperture shutter 14, called a blade shutter, which may be used with the camera 10 (FIG. 1). Shutter 14 typically includes a pair of rigid shutter blades 40, 42, which are adapted for relative lateral movement in the direction of arrows 44 by means of an electromechanical actuator 45. Front blade shutter 40 includes apertures 46, 48, and rear blade shutter 42 includes apertures 47, 49, shown in phantom. Aperture pair 46, 47 are intended for image capture and are aligned with image capture device 12 (FIG. 1). Aperture pair 48, 49 are intended for exposing photocell 18 (FIG. 1) to incident image light energy and are therefore intended to be aligned with photocell 18.


The relative lateral movement of shutter blades 40, 42 causes aperture pairs 46, 47 and 48, 49 to progressively overlap and thereby increase the aperture size for incident light energy. The separate aperture pairs 46, 47 and 48, 49 are proportionately sized so that any relative positioning of shutter blades 40, 42 results in generally the same proportion of light energy emitted through aperture pairs 46, 47 and 48, 49. Thus, the amount of light energy sensed by photocell 18 generally represents the same proportion of the light energy emitted through aperture pair 46, 47, regardless of the position of shutter blades 40, 42. In this manner, shutter 14 includes separate, proportionately operable, variable apertures 46, 47 and 48, 49 for image capture device 12 and photocell 18. The art of constructing blade shutters is well developed and many variations from the art may be used with the present invention. Although lateral movement of shutter blades 40, 42 is described, alternative forms of movement, such as rotational, may be used. Likewise, relative shapes and sizes may be varied in accordance with known methods. Although FIG. 2, depicts a single photocell aperture, more than one may be used, and their orientation may vary.



FIG. 3 shows a front view of another pair of blade shutters 50, 52, which include an aperture pair 54, 55 for image capture and separate aperture pairs 56, 57 and 58, 59 to accommodate a visible spectrum photocell 60 and an infrared spectrum photocell 62, respectively. Aperture pair 56, 57 are associated with a monitoring aperture pair 64, which is shown as a single aperture, but is actually a separate aperture in each aperture blade 50, 52. Monitoring aperture pair 64 is designed to be open while aperture pair 54, 55 is closed to allow ambient light monitoring of an image scene prior to image capture. Both aperture pairs 56, 57 and 58, 59 are shaped to provide an analogous representation of the opening of image capture aperture pair 54, 55. The relative orientation of the aperture pairs varies between FIGS. 2 and 3 as the orientation of image capture device 12 and photocell 18 may vary in the embodiment of FIG. 1.


Thus any suitable arrangement of apertures may be used, depending upon the specific photocell arrangement employed. Photocell 18 may take any suitable form such as separate visible spectrum and infrared spectrum photocells, or a single unit adapted to separately sense visible and infrared spectrum energy.



FIG. 4 is a graph, over the exposure time of an image capture, of the amount of light energy admitted through image capture aperture pair 46, 47 (FIG. 2) to thereby form an image on image capture device 12 (FIG. 1). FIG. 4 represents the operation of camera 10 (FIG. 1) in the fill flash mode, wherein the total light energy used for image capture is a mixed proportion of ambient scene illumination and fill flash. As mentioned, photocell 18 senses an analogous amount of received light during image capture. Whereas the instantaneous value of curve 68 represents the light level being received, the area 70, 72 under the graph represents the amount of light energy received over time. In this manner, by monitoring and integrating the output of photocell 18, exposure control system 20 can determine, in real time, the amount of image capture light energy incident upon image capture device 12.


A well known fill flash function typically uses ambient scene illumination to provide approximately 75% of the image capture light energy and the fill flash function to provide the remaining 25% of image capture energy. This distribution may be varied by image scene. For controlling this distribution, exposure control system 20 monitors and integrates the output of photocell 18 until the integrated area 70 under curve 68 reaches approximately 70% of the necessary amount of image capture light energy. At this point 74, flash unit 22 is illuminated and the amount of incident light energy sensed by photocell 18 increases, very steeply. At some point 76, exposure control system 20 determines that 90 to 95% of the desired image capture light energy has been received and exposure control system 20 quenches flash 22 and closes shutter 14. In a this manner, flash unit 22 may have a variable light output, and exposure control system 20 may be adapted to limit such variable light output in response to light energy sensed by photocell 18.


The rising slope of the left side of curve 68 represents the increasing aperture size of a scanning aperture shutter. It can be appreciated, that in low-light image scenes, the scanning aperture shutter may open to its maximum aperture before approximately 70% of the image capture energy has been sensed or received. In this situation, exposure control system 20 may be programmed to illuminate flash unit 22 to allow the 25% flash contribution to be collected. Shutter 14 may subsequently be left open after flash unit 22 is quenched, so that ambient light is further admitted to reach the preferred distribution. Ambient light received during flash illumination may not be measurable because of visible spectrum flash illumination, but it may be factored into the measurement.


It is known in flash unit technology that the amount of infrared flash energy reflected by objects is more consistent between various objects than the amount of visible spectrum energy. For this reason, the present invention preferably uses an infrared photocell for measuring image scene energy during flash illumination, and those measurements are converted to appropriate visible spectrum values or otherwise factored into the overall light measurement in accordance with methods known in the art. The art of exposure control devices for cameras is well developed, and various physically different devices may be constructed in accordance with known methods to implement the functions of the exposure control system of the present invention.


The present invention is illustratively described above in reference to the disclosed embodiments. Various modifications and changes may be made to the disclosed embodiments by persons skilled in the art without departing from the scope of the present invention as defined in the appended claims.

Claims
  • 1. An electronic camera, comprising: an image capture aperture configured to admit light energy from an image scene;an electronic image capture device configured to capture light energy admitted through the image capture aperture;a photocell configured to sense a level of light energy admitted through the image capture aperture;a flash unit; anda flash control system configured to: measure a first amount of light energy, wherein the first amount of light energy is an amount of light energy admitted through the image capture aperture before the flash unit is illuminated,illuminate the flash unit,measure a second amount of light energy, wherein the second amount of light energy is an amount of light energy admitted through the image capture aperture after the flash unit is illuminated, andcontrol an amount of light to be emitted from the flash unit during image capture based on the first and second amounts of light energy.
  • 2. The electronic camera of claim 1, wherein the flash control system is further configured to integrate the level of light energy sensed by the photocell.
  • 3. The electronic camera of claim 2, wherein the first amount of light energy is an integrated level of light energy sensed before the flash unit is illuminated.
  • 4. The electronic camera of claim 2, wherein the second amount of light energy is an integrated level of light energy sensed after the flash unit is illuminated.
  • 5. The electronic camera of claim 1, wherein the photocell is configured to sense light energy from at least one of the group consisting of visible light energy, infrared light energy, and ambient light energy.
  • 6. The electronic camera of claim 1, wherein the electronic camera is configured to control the image capture aperture in response to a level of light energy sensed by the photocell.
  • 7. The electronic camera of claim 1, wherein the flash control system is configured to control an amount of light to be emitted from the flash unit such that a predetermined ratio of light energy from the flash unit to ambient light energy is received during image capture.
  • 8. A method for determining an amount of light to be emitted from a flash unit during image capture, comprising: measuring a first amount of light energy, wherein the first amount of light energy is an amount of light energy admitted through an image capture aperture before the flash unit is illuminated;illuminating the flash unit;measuring a second amount of light energy, wherein the second amount of light energy is an amount of light energy admitted through the image capture aperture after the flash unit is illuminated; andcontrolling an amount of light to be emitted from the flash unit during image capture of an electronic image capture device based on the first and second amounts of light energy.
  • 9. The method of claim 8, wherein measuring the first amount of light energy comprises integrating the amount of light energy admitted through the image capture aperture before the flash unit is illuminated, and wherein measuring the second amount of light energy comprises integrating the amount of light energy admitted through the image capture aperture after the flash unit is illuminated.
  • 10. The method of claim 9, wherein the first amount of light energy is the integrated amount of light energy admitted through the image capture aperture before the flash unit is illuminated.
  • 11. The method of claim 9, wherein the second amount of light energy is the integrated amount of light energy admitted through the image capture aperture after the flash unit is illuminated.
  • 12. The method of claim 8, wherein measuring the first amount of light energy comprises sensing light energy from at least one of the group consisting of visible light energy, infrared light energy, and ambient light energy.
  • 13. The method of claim 8, wherein measuring the second amount of light energy comprises sensing light energy from at least one of the group consisting of visible light energy, infrared light energy, and ambient light energy.
  • 14. The method of claim 8, further comprising controlling an amount of light to be emitted from the flash unit such that a predetermined ratio of light energy from the flash unit to ambient light energy is received during image capture.
  • 15. A system for determining an amount of light to be emitted from a flash unit during image capture, comprising: means for measuring a first amount of light energy, wherein the first amount of light energy is an amount of light energy admitted through an image capture aperture before the flash unit is illuminated;means for illuminating the flash unit;means for measuring a second amount of light energy, wherein the second amount of light energy is an amount of light energy admitted through the image capture aperture after the flash unit is illuminated; andmeans for controlling an amount of light to be emitted from the flash unit during image capture of an electronic image capture device based on the first and second amounts of light energy.
  • 16. The system of claim 15, further comprising means for integrating the amount of light energy admitted through the image capture aperture before the flash unit is illuminated.
  • 17. The system of claim 16, wherein the first amount of light energy is the integrated amount of light energy admitted through the image capture aperture before the flash unit is illuminated.
  • 18. The system of claim 15, further comprising means for integrating the amount of light energy admitted through the image capture aperture after the flash unit is illuminated.
  • 19. The system of claim 18, wherein the second amount of light energy is the integrated amount of light energy admitted through the image capture aperture after the flash unit is illuminated.
  • 20. The system of claim 15, further comprising means for sensing light energy from at least one of the group consisting of visible light energy, infrared light energy, and ambient light energy.
  • 21. The system of claim 15, further comprising means for controlling an amount of light to be emitted from the flash unit such that a predetermined ratio of light energy from the flash unit to ambient light energy is received during image capture.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 10/662,763, filed Sep. 15, 2003, which is hereby incorporated by reference in its entirety.

US Referenced Citations (77)
Number Name Date Kind
4023187 Shenk May 1977 A
4192587 LaRocque et al. Mar 1980 A
4196987 Erlichman Apr 1980 A
4262301 Erlichman Apr 1981 A
4285584 Canter Aug 1981 A
4325614 Grimes Apr 1982 A
4345828 Johnson Aug 1982 A
4354748 Grimes et al. Oct 1982 A
4395102 Pizzuti Jul 1983 A
4423936 Johnson Jan 1984 A
4549801 Winter Oct 1985 A
4772910 Fields Sep 1988 A
4801964 Desormeaux Jan 1989 A
4937676 Finelli et al. Jun 1990 A
4941011 Farrington Jul 1990 A
4998128 Coltman et al. Mar 1991 A
5032911 Takimoto Jul 1991 A
5049911 Shimizu Sep 1991 A
5050001 Hatanaka et al. Sep 1991 A
5128773 Sato Jul 1992 A
5309193 Takagi May 1994 A
5485201 Aoki et al. Jan 1996 A
5504554 Sakamoto Apr 1996 A
5673190 Kahleck et al. Sep 1997 A
5682562 Mizukoshi et al. Oct 1997 A
5715234 Stephenson et al. Feb 1998 A
5742373 Alvelda Apr 1998 A
5742905 Pepe et al. Apr 1998 A
5754305 DeClerck et al. May 1998 A
5794076 Farrington et al. Aug 1998 A
5802413 Stephenson Sep 1998 A
5815204 Abe et al. Sep 1998 A
5822637 Stephenson Oct 1998 A
5838369 Aoki et al. Nov 1998 A
5881326 Sakamoto Mar 1999 A
5894326 McIntyre et al. Apr 1999 A
5909245 Aoki et al. Jun 1999 A
5920298 McKnight Jul 1999 A
5943515 Omura Aug 1999 A
5946031 Douglas Aug 1999 A
5978022 Aoki et al. Nov 1999 A
5991290 Malik Nov 1999 A
6072281 Ogawa Jun 2000 A
6081076 Ogawa Jun 2000 A
6160960 Mikoshiba et al. Dec 2000 A
6167202 Fukui Dec 2000 A
6205294 Norris et al. Mar 2001 B1
6272292 Iwasaki et al. Aug 2001 B1
6275104 Holter Aug 2001 B1
6314476 Ohara Nov 2001 B1
6356356 Miller et al. Mar 2002 B1
6396565 Yamamoto et al. May 2002 B1
6445694 Swartz Sep 2002 B1
6473498 Foth Oct 2002 B1
6496651 Ishihara et al. Dec 2002 B2
6516147 Whiteside Feb 2003 B2
6594032 Hiroki et al. Jul 2003 B1
6597869 Uchida et al. Jul 2003 B2
6633635 Kung et al. Oct 2003 B2
6791605 Reele et al. Sep 2004 B1
6983070 Yamada Jan 2006 B2
6999114 Chapnik Feb 2006 B1
7206806 Pineau Apr 2007 B2
7233408 Henderson et al. Jun 2007 B2
7898678 Luciano et al. Mar 2011 B2
7978260 Staller Jul 2011 B2
20010031142 Whiteside Oct 2001 A1
20020051197 Minegishi May 2002 A1
20020060808 Henderson et al. May 2002 A1
20020064383 Kawasaki et al. May 2002 A1
20020081111 Ina et al. Jun 2002 A1
20020090145 Yamada Jul 2002 A1
20030115250 Bernier Jun 2003 A1
20040075762 Okubo Apr 2004 A1
20040145674 Hoppe et al. Jul 2004 A1
20050024499 Luciano et al. Feb 2005 A1
20050057682 Staller Mar 2005 A1
Foreign Referenced Citations (12)
Number Date Country
198 07 303 Jan 1999 DE
0 680 192 Feb 1995 EP
0 598 513 Jan 2001 EP
1 100 003 May 2001 EP
1 665 777 May 2007 EP
06-175202 Jun 1994 JP
08-037613 Feb 1996 JP
08-201871 Aug 1996 JP
09-090461 Apr 1997 JP
2001-326854 Nov 2001 JP
WO 0117226 Mar 2001 WO
WO 2005029848 Mar 2005 WO
Non-Patent Literature Citations (5)
Entry
U.S. Appl. No. 12/024,213, filed Feb. 1, 2008, Chapnik.
International Patent Application No. PCT/US2000/024011: International Search Report dated Dec. 7, 2000, 2 pages.
International Patent Application No. PCT/US2004/030002: International Preliminary Report on Patentability (IPER) dated Mar. 16, 2006.
Microdisplay Report: “What are Microdisplays?”, http://www.mdreport.com/whatis.html, 1999.
Wright et al., “Die-Sized Displays Enable Microdisplays New Applications”, http://www.ad-tec.com/semiconductor/archive/sep98/lores/feature3.html, Sep. 1998.
Related Publications (1)
Number Date Country
20110221954 A1 Sep 2011 US
Continuations (1)
Number Date Country
Parent 10662763 Sep 2003 US
Child 13112227 US