Patent Application
20080094478
This patent application claims priority from Japanese Patent Application No. 2006-284127 filed in Japan on Oct. 18, 2006, the contents of which are incorporated herein by reference.
1. Technical Field
The present invention relates to an image capture device, an image capture method, a display device, a display method, and a computer readable medium. More particularly, the present invention relates to a capture device and a capture method for capturing an image, a display device and a display method for displaying a captured image, and computer readable media storing thereon program instructions for image capture and display devices.
2. Related Art
A method for driving a liquid crystal display device is proposed as disclosed, for example, in Japanese Patent Application Publication Nos. 2003-195835, 2002-72998, 2002-98957, and 2004-294764. In the method, a brightness difference is provided between the center portion and the peripheral portion of the screen where a video is displayed.
However, according to the liquid crystal display device described in Patent Document 1, a subject of great interest for a user is difficult to be viewed by the user when it is located in the peripheral portion.
Therefore, it is an object of an aspect of the present invention to provide a image capture device, a image capture method, a display device, a display method, and a computer readable medium, which are capable of overcoming the above drawbacks accompanying the related art. The above and other objects can be achieved by combinations described in the independent claims. The dependent claims define further advantageous and exemplary combinations of the present invention.
According to the first aspect related to the innovations herein, one exemplary image capture device may include: a image capture unit that captures an image; a focus control unit that controls a to-be-focused position of the image capture unit; a display unit that displays the image; an area specifying unit that specifies a specific area within the image, the specific area including the to-be-focused position configured by the focus control unit; and a display control unit that controls the display unit to allow the specific area to be displayed relatively brighter than the other area within the image.
The focus control unit may include a subject distance calculation unit that calculates a plurality of distances from the image capture device to a subject corresponding respectively to a plurality of to-be-focused points on the image captured by the image capture unit; a to-be-focused position selection unit that selects one of the plurality of to-be-focused points according to the distances calculated by the subject distance calculation unit; and a to-be-focused position adjustment unit that adjusts the to-be-focused position of the image capture unit to be aligned to the one of the to-be-focused points. The area specifying unit may compare a reference distance corresponding to the one of the to-be-focused points selected by the to-be-focused point selection unit with a second distance corresponding to a second one of the to-be-focused points, and may further specify a predetermined area including the second to-be-focused point as a second specific area when the difference between the reference and the second distances exists within a predetermined range. The display control unit may allow the specific areas including the second specific area specified by the area specifying unit to be displayed relatively brighter than the area other than the specific areas within the image.
The area specifying unit may determine the specific areas in order for a sum of the specific areas to be a predetermined amount or less.
The image capture device may further include an object area extraction unit that extracts an object area including the to-be-focused position configured by the focus control unit from the image displayed by the display unit. The area specifying unit may specify the object area as a specific area.
According to the second aspect related to the innovations herein, one exemplary image capture method may include: controlling a to-be-focused position of an image capture unit that captures an image; displaying the image; specifying a specific area within the image, the specific area including the to-be-focused position configured in the controlling of the to-be-focused position; and controlling the displaying of the image to allow the specific area to be displayed relatively brighter than the other area within the image.
According to the third aspect related to the innovations herein, one exemplary computer readable medium storing thereon program instructions executable to implement an image capture device is provided. The image capture device may include: an image capture unit that captures an image; a focus control unit that controls a to-be-focused position of the image capture unit; a display unit that displays the image; an area specifying unit that specifies a specific area within the image, the specific area including the to-be-focused position configured by the focus control unit; and a display control unit that controls the display unit to allow the specific area to be displayed relatively brighter than the other area within the image.
According to the fourth aspect related to the innovations herein, one exemplary display device for displaying an image may include: a display unit that displays the image; an area specifying unit that specifies a specific area within the image, the specific area including a to-be-focused position of the image; and a display control unit that controls the display unit to allow the specific area to be displayed relatively brighter than the other area within the image.
According to the fifth aspect related to the innovations herein, one exemplary display method for displaying a captured image may include: specifying a specific area within the image, the specific area including a to-be-focused position of the image; and controlling the displaying of the image to allow the specific area to be displayed relatively brighter than the other area within the image.
According to the sixth aspect related to the innovations herein, one exemplary computer readable medium storing thereon program instructions executable to implement a display device for displaying a captured image is provided. The display device may include: an area specifying unit that specifies a specific area within the image, the specific area including a to-be-focused position of the image; a display unit that displays the image; and a display control unit that controls the display unit to allow the specific area to be displayed relatively brighter than the other area within the image.
According to an advantage of some aspects of the invention, the user may recognize a focused area at a glance.
The summary clause does not necessarily describe all necessary features of the embodiments of the present invention. The above and other features and advantages of the present invention will become more apparent from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:
Some aspects of the invention will now be described based on the embodiments, which do not intend to limit the scope of the present invention, but exemplify the invention. All of the features and the combinations thereof described in the embodiment are not necessarily essential to the invention. The same reference numerals may be used in different drawings to identify the same or similar elements.
The image capture unit 210 captures an image. The focus control unit 220 controls a to-be-focused position of the image capture unit 210. The area specifying unit 240 specifies a specific area within the image captured by the image capture unit 210. The specific area includes the to-be-focused position configured by the focus control unit 220 when the image capture unit 210 captures the image. The display unit 120 displays the image captured by the image capture unit 210. The display control unit 250 controls the display unit 120 to allow the specific area specified by the area specifying unit 240 to be displayed relatively brighter than the other area.
In particular, the subject distance calculation unit 222 calculates distances between the image capture device 100 and the subject corresponding respectively to a plurality of to-be-focused points on the image captured by the image capture unit 210. The to-be-focused point selection unit 224 selects one from the plurality of to-be-focused points according to the distances to the subject calculated by the subject distance calculation unit 222. The to-be-focused position adjustment unit 226 adjusts the to-be-focused position of the image capture unit 210 to be aligned to the to-be-focused point selected by the to-be-focused point selection unit 224. The area specifying unit 240 compares a reference distance corresponding to the to-be-focused point selected by the to-be-focused point selection unit 224 with a second distance corresponding to a second one of the to-be-focused points. When the difference between the reference and the second distances exists within a predetermined range, the area specifying unit 240 further specifies a predetermined area including the second to-be-focused point as a second specific area. Then, the display control unit 250 displays the specific areas including the second specific area specified by the area specifying unit 240 to be relatively brighter than the area other than the specific areas within the image. Thus, for example, not only a specific area including an in-focus point actually adjusted by the focus control unit 220 but also an area appearing sharp enough may be displayed relatively brighter than the other area according to the image capture device 100.
It should be noted that the area specifying unit 240 may determine the specific areas in order for a sum of the specific areas to be a predetermined amount or less. Also, the area specifying unit 240 may determine the specific areas such that the sum of the specific areas is substantially equal to a sum of other specific areas determined corresponding to other to-be-focused points.
The object area extraction unit 230 extracts an object area, which includes a to-be-focused position configured by the focus control unit 220 when the image capture unit 210 captures an image, from the captured image. The object area extraction unit 230 extracts an object area including a to-be-focused position from the image captured by the image capture unit 210, for example, by applying an edge extraction. Then, the area specifying unit 240 specifies the object area extracted by the object area extraction unit 230 as a specific area.
In particular, the object area extraction unit 230 extracts a person area, which includes the to-be-focused position configured by the focus control unit 220 when the image capture unit 210 captures an image, from the captured image. More particularly, the object area extraction unit 230 extracts the person area including the to-be-focused position by applying a template matching. The template matching is performed between a template configured to take on a shape of a predetermined person and a contour of the object extracted from the image by the edge extraction. Then, the area specifying unit 240 specifies the person area extracted by the object area extraction unit 230 as a specific area.
The object area extraction unit 230 extract a person's face area, which includes a to-be-focused position configured by the focus control unit 220 when the image capture unit 210 captures an image, from the captured image. In particular, the object area extraction unit 230 extracts the person's face area including the to-be-focused position by applying a template matching. The template matching uses a template representing a shape of a predetermined object included in a person's face. The object is exemplified by the eyes, the mouth, the nose, or the like. The template matching is performed between the template and the contour of the object extracted by an edge extraction from the image. The area specifying unit 240 specifies the person's face area extracted by the object area extraction unit 230 as a specific area. According to such controls, only a person area or only a person's face area, for example, may be displayed relatively brighter than the other area by the image capture device 100.
The battery unit 270 includes one or more batteries for supplying power to drive the image capture device 100. The area specifying unit 240 may specify the specific area to be smaller as the battery remaining amount of the battery unit 270 is less.
It should be noted that the display control unit 250 may control the display unit 120 to allow an area nearer to the specific area to be displayed brighter within the area other than the specific area. According to such controls, there may exist a gradation between the specific area and the other area in brightness. Thus, the user may recognize the specific area without sensing of unevenness between the specific area and the other area.
The display unit 120 includes a backlight unit that emits light, and a liquid crystal unit that displays an image by transmitting the light emitted from the backlight unit. Here, the display control unit 250 controls an emission intensity of the backlight unit to be relatively greater for displaying image contents on the specific area, which is displayed on the liquid crystal unit, specified by the area specifying unit 240 than for displaying image contents on the other area displayed on the liquid crystal unit.
In particular, the backlight unit includes a plurality of light-emitting elements that respectively emit light to a plurality of areas on the liquid crystal unit. The liquid crystal unit displays an image by transmitting the light emitted by the light-emitting elements. The display control unit 250 controls an emission intensity of some of the light-emitting elements, which emit light onto an area displayed on the liquid crystal unit corresponding to the specific area, to be relatively greater than that of the other light-emitting elements. The light-emitting elements may include organic electroluminescence elements. As such, it is possible to finely define the specific area.
The backlight unit may include a plurality of light-emitting diodes (LEDs) that respectively emit light to a plurality of areas on the liquid crystal unit. Here, the liquid crystal unit displays an image by transmitting the light emitted from the LEDs. The display control unit 250 controls an emission intensity of one or more of the LEDs to be relatively greater for displaying the specific area on the liquid crystal unit than for displaying the other LEDs.
The display unit 120 may include a plurality of light-emitting elements emitting light per pixel. Here, the display control unit 250 controls an emission intensity of some of the light-emitting elements, which are covered in the specific area specified by the area specifying unit 240, to be relatively greater than that for emitting light of pixels included in the other area. The light-emitting elements may include organic electroluminescence elements. It should be noted that details of the display unit 120 configuration will be described below referring to FIGS. 3 to 5.
The area specifying unit 240, the display unit 120, and the display control unit 250 of the components included in the image capture device 100 are possible to be provided as a display device for displaying a captured image. In this case, the area specifying unit 240 specifies a specific area on an image. The specific area includes a to-be-focused position configured when the image is captured. In particular, the area specifying unit 240 obtains the to-be-focused position associated with the image so as to specify a specific area including the to-be-focused position on the image. Then, the display unit 120 displays the image. Here, the display control unit 250 controls the display unit 120 to allow the specific area specified by the area specifying unit 240 to be displayed relatively brighter than the other area within the image. It is obvious that such a display device should be able to include the object area extraction unit 230 and the battery unit 270. Also, such a display device can be used for a small terminal having camera functionality, e.g., a portable camera or a camera built-in portable phone.
It should also be noted that the organic electroluminescence elements 410 are illustrated by way of an example. The light-emitting elements of the present invention are not limited to organic electroluminescence elements. As such, using organic electroluminescence element as light-emitting elements of the backlight unit 420 makes it possible to finely define the specific area and the brightness thereof. Due to this, visibility for the user to recognize the specific area may be improved significantly. Also, unwanted power consumption may be prevented because controlling the brightness per pixel allows for lighting a necessary area only.
It should be noted that the display control unit 250 provides the backlight unit 420 with instructions regarding a light-emitting area and a brightness value by means of an instruction value defined in 8-bit digital data. Moreover, patterns for driving the backlight unit 420 may be maintained as a lookup table in a circuit controlling the backlight unit 420 within the display control unit 250. Also, the display control unit 250 may appropriately switch among the driving patterns for the backlight unit 420 according to external factors, e.g., focus information including a position of a to-be-focused point, illuninance information therearound, image contents, and the like. For example, in the case that the area specifying unit 240 specifies the specific area the ratio of which to the other area is 1:2 and that the display control unit 250 configures brightness values of the specific area and the other area to be 120% and 50% respectively, the overall brightness value is estimated to be approximately 73%. Therefore, the image capture device 100 may achieve a power saving and may allow the specific area of great interest for the user to be displayed in brightness 20% more than usual or to be improved in visibility.
As such, using organic electroluminescence elements 510 as pixel elements of the display unit 120 makes it possible to finely define the specific area. Due to this, visibility for the user to recognize the specific area may be improved significantly. Also, a power saving may be achieved. It should be noted that the organic electroluminescence elements 510 are illustrated by way of an example. The light-emitting elements of the present invention are not limited to organic electroluminescence elements.
The area specifying unit 240 may specify the specific area such that the total amount of the specific area is substantially equal to that of a predetermined area corresponding to the number of to-be-focused points having to be included in the specific area. If there are many to-be-focused points having to be included in the specific area, a large part of the display unit 120 may be displayed brighter. In this case, advantages that the specific area is more effectively recognized than the other area may not be achieved. However, the area specifying unit 240 limiting the total amount of the specific area to the predetermined area corresponding to the number of to-be-focused points may cause the specific area to be more effectively recognized than the other area.
Besides, the area specifying unit 240 may control the specific area according to the battery remaining amount of the battery unit 270. For example, the area specifying unit 240 may determine the specific area to be smaller as the battery remaining amount of the battery unit 270 is less. This allows the area specifying unit 240 to reduce the battery power consumption rate when the battery remaining amount is less. Also, the display control unit 250 may control the display unit 120 such that the brightness of the specific area is maintained while that of the other area is reduced in the case that the battery remaining amount of the battery unit 270 is less.
As such, the display control unit 250 controlling the brightness of the display unit 120 to be less bright in a stepped manner as being away from the specific area allows the user to easily recognize the specific area. As described above referring to
The host controller 1582 is connected with the RAM 1520, the CPU 1505, and the graphics controller 1575 having access to the RAM 1520 with fast transfer rates. The CPU 1505 operates according to a program stored in the ROM 1510 and/or the RAM 1520 to control each unit. The graphics controller 1575 acquires image data generated on a frame buffer provided in the RAM 1520 by the CPU 1505 or the like and displays the same on the display device 1580. Alternatively, the graphics controller 1575 may include therein a frame buffer for storing image data generated by the CPU 1505 or the like.
The input/output controller 1584 is connected with the host controller 1582, the communication interface 1530, the hard disk drive 1540, and the CD-ROM drive 1560 that is a relatively fast input/output device. The hard disk drive 1540 stores a program and/or data used by the CPU 1505 in the computer 1500. The communication interface 1530 communicates with the image capture device 100 and provides the same with a program and/or data. The CD-ROM drive 1560 reads the program and/or data from the CD-ROM 1595 and provides the same to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.
The input/output controller 1584 is connected with the ROM 1510, and relatively slow input/output devices or the flexible disk drive 1550 and the input/output chip 1570. The ROM 1510 stores a boot program executed by the computer 1500 when starting up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from a flexible disk 1590 and provides the same to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input/output chip 1570 is connected with the flexible disk drive 1550 and other various input/output devices via a parallel port, a serial port a keyboard port, a mouse port, or the like.
A program provided to the communication interface 1530 via the RAM 1520 is stored in a storage medium, e.g., the flexible disk 1590, the CD-ROM 1595, an IC card or the like, and/or provided by the user. The program is read from the storage medium, provided to the communication interface 1530 via the RAM 1520, and transferred to the image capture device 100 via a network. The program transferred to the image capture device 100 is installed on the same and executed.
The program installed and executed on the image capture device 100 allows the same to function as the display unit 120, the image capture unit 210, the instruction input unit 200, the focus control unit 220, the object area extraction unit 230, the area specifying unit 240, the display control unit 250, and the battery unit 270, which are described above referring to FIGS. 1 to 9. Also, the program allows the focus control unit 220 to function as the subject distance calculation unit 222, the to-be-focused point selection unit 224, and the to-be-focused position adjustment unit 226, which are described above referring again to FIGS. 1 to 9.
The program described above may be stored in an external storage medium. Besides the flexible disk 1590 and the CD-ROM 1595, an optical storage medium such as a digital versatile disk (DVD), a phase change rewritable disk (PD) or the like, a magneto optical storage medium such as a mini disk (MD), a tape medium, a semiconductor memory such as an IC card, or the like may be used. Alternatively, a storage device such as a hard disk, a RAM or the like provided on a server system connected with a private communication network or the internet may be used as a storage medium such that a program may be provided to the computer 1500 via the network or the internet.
Also, the computer 1500 may communicate with the display device described referring to
Although some aspects of the present invention have been described by way of exemplary embodiments, it should be understood that those skilled in the art might make various modifications or substitutions without departing from the spirit and the scope of the present invention that is defined only by the appended claims. It is obvious from the appended claims that embodiments with such modifications or substitutions also belong to the technical scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-284127 | Oct 2006 | JP | national |
