Patent Application
20070139562
1. Field of the Invention
The present invention relates to a color image display apparatus and, in particular, to a color image display apparatus that can adjust display video colors in accordance with viewers.
2. Description of the Background Art
A color television, a color display apparatus, and other color image display apparatuses display a color image on the basis of a prescribed set value. In many cases, the color image display apparatus changes color display operation of a color image on the basis of a user's setting. The setting for changing the color display operation by the user can be troublesome and, the setting for displaying user's desiring color cannot be realized. Therefore, the convenience of the color image display apparatuses is not necessarily acceptable to viewers.
In order to offer the convenience to the viewer, for example, Japanese Patent Laying-Open Nos. 2003-078920, 2002-323382, and 2002-091415 disclose a display apparatus that can adjust a color temperature in accordance with a lighting environment. Further, Japanese Patent Laying-Open No. 09-247564 discloses a television receiver that improves the convenience not only in view of image display operation but also in. view of sound replay. Furthermore, Japanese Patent Laying-Open No.2005-236353 discloses a receiving apparatus that offers the convenience to the viewer in view of program recommendation.
With respect to television watching, a television set at a living room can be used not only by one specific person but also by another family member.
With the display apparatus disclosed in Japanese Patent Laying-Open No. 2003-078920, a specific viewer sets a color temperature and the display apparatus displays a video image on the basis of the set value of the color temperature. In this case, a favorite color of another viewer cannot be displayed. The other viewer cannot necessarily be satisfied with the convenience of the display apparatus.
The present invention is devised to solve the above problems. It is one object of the present invention to provide a color image display apparatus that can display color images in accordance with a plurality of viewers.
It is another object of the present invention to provide a color image display apparatus that can adjust and display a color image to a specific viewer.
In summary, in order to accomplish the objects, according to one aspect of the present invention, a color image display apparatus comprises: a tuner that obtains a video signal for displaying a color image; a display that displays the color image at a display area on the basis of the video signal; a camera that shoots an object and obtains image data corresponding to an image of the object; and a memory that stores a first characteristics amount obtained in advance for a first viewer of the color image display apparatus, and a set value input in advance so as to display a color image to the first viewer. The first amount of characteristics is associated with the set value. The color image display apparatus further comprises: a shooting control circuit that causes the camera to execute shooting operation on the basis of the video image displayed at the display area; a characteristic-amount calculating circuit that performs image analysis processing preset to image data of a second viewer, obtained on the basis of the shooting operation, and calculates the second viewer's characteristics amount, a determining circuit that determines whether or not the second viewer is the first viewer by comparing the first viewer's characteristics amount with the second viewer's characteristics amount; an extracting circuit that extracts partial image data corresponding to a partial area within a shootable range of the camera from the image data obtained by the camera; a calculating circuit that calculates the total of color components forming an image corresponding to the partial image on the basis of the partial image data; a color temperature determining circuit that determines a color temperature on the basis of the total of color elements; and an element changing circuit that changes color elements forming a video image displayed at the display area on the basis of the color temperature and the set value.
Further, according to another aspect of the present invention, a color image display apparatus comprises: an obtaining unit that obtains a video signal for displaying a color image; a display unit that displays the color image at a display area on the basis of the video image signal; an image pickup unit that shoots an object and obtains image data corresponding to an image of the object; a storage unit that stores specific data prepared in advance so as to specify a first viewer of the color image display apparatus and a set value input in advance so as to display a color image of the first viewer. The specific data is associated with the set value. The color image display apparatus further comprises: an image obtaining unit that obtains an image of a second viewer who views the video image on the basis of the video image displayed at the display area; a determining unit that determines whether or not the second viewer is the first viewer on the basis of the specific data and the second viewer's image; and a control unit that controls display of the video image at the display area by adjusting a display color of the video image displayed at the display area on the basis of the set value corresponding to the first viewer, when the determining unit determines that the second viewer is the first viewer.
Furthermore, according to another aspect of the present invention, a color image display apparatus comprises: an interface that obtains a video signal for displaying a color image; a display device that displays the color image in the display area on the basis of the video signal; a camera that shoots an object and obtains image data corresponding to an image of the object; a memory that stores specific data prepared in advance so as to specify a first viewer of the color image display apparatus, a set value input in advance so as to display a color image to the first viewer, and an instruction sequence. The specific data is associated with the set value. The color image display apparatus further comprises a processor that executes the instruction sequence. The instruction sequence comprises: an image obtaining step of obtaining an image of a second viewer who views the video image on the basis of display operation of the video image at the display area; a determining step that determines whether or not the second viewer is the first viewer on the basis of the specific data and the image of the second viewer; and a control step of controlling the display operation of the video image at the display area by adjusting a display color of the video image displayed at the display area on the basis of the set value associated with the first viewer, when it is determined that the second viewer is the first viewer.
The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
Hereinbelow, an embodiment of the present invention will be described with reference to the drawings. In the following description, the same reference numerals denote the same parts with the same functions. Therefore, a specific description thereof is not repeated.
First, with reference to
Camera 100 shoots an object and outputs an image signal. The image signal is input to image processing unit 110. Image processing unit 110 extracts a preset area and calculates a color temperature around the object on the basis of image data corresponding to the area. Further, image processing unit 110 calculates the color temperature displayed on video display unit 140 on the basis of the color temperature and preset information. Video source 120 is a television broadcasting signal or a video signal that is recorded in advance to a data recording medium. If the color image display apparatus is connected to a network, video source 120 may be a video signal input via the network.
Combining circuit 130 generates a video signal to display an image on video display unit 140 on the basis of the color temperature calculated by image processing unit 110 and video source 120. The generated signal is sent to video display unit 140. Video display unit 140 displays an image on the basis of the signal. The above-displayed video image reflects the color temperature around the object shot by camera 100.
The color image display apparatus can be realized by a color television having a camera, alternatively, a display apparatus that receives an input of the image signal and displays the image. Hereinbelow, a television 200 will be described as one example of the color image display apparatus.
Herein, with reference to
Hereinbelow, with reference to
Obtaining unit 410 obtains a video signal for displaying a color image from outside. Obtaining unit 410 is, e.g., a tuner for selecting a TV broadcasting signal, an input interface for receiving an input of a digital video signal, or the like. The tuner may be a digital tuner or an analog tuner. If the analog tuner is used, an analog signal is converted into a digital signal in television 200, and image adjusting processing is executed, which will be described later.
Display unit 412 displays a color image on the basis of the video signal obtained by obtaining unit 410. Display unit 412 is, e.g., a liquid crystal display, an organic electro luminescence (EL) display, a CRT (Cathode Ray Tube) display, or another display device.
Shooting control unit 414 outputs an instruction for shooting the viewer of television 200 on the basis of the display operation of the color image on display unit 412. The instruction is sent to image pickup unit 416. Image pickup unit 416 shoots the object existing within a shootable range that is set in advance on the basis of the instruction, and outputs corresponding image data. The image data is sent to characteristic-amount calculating unit 418. Characteristic-amount calculating unit 418 executes image processing that is prescribed on the basis of the image data, and calculates the characteristics amount of the object. Preferably, characteristic-amount calculating unit 418 executes filtering processing, edge emphasis processing, and other image adjusting processing of the image data.
Storage unit 420 stores data that is input in advance to television 200. Storage unit 420 stores the data that is registered in advance as the viewer of television 200 (data for identifying the viewer and data for controlling the display operation of display unit 412 that is input by the corresponding viewer).
With respect to the viewer whose characteristics amount is calculated by characteristic-amount calculating unit 418 and the viewer registered to storage unit 420, check unit 422 checks to see if the viewer shot by image pickup unit 416 is a viewer registered in advance to television 200. Check unit 422 searches for the characteristics amount calculated by characteristic-amount calculating unit 418 from the characteristics amount stored in storage unit 420, and determines whether or not there is a data index having the same characteristics amount, thereby checking to see if this viewer is registered.
Extracting unit 424 extracts partial image data corresponding to a partial area of the object image on the basis of the image data obtained by image pickup unit 416. The partial area indicates, e.g., an area preset as a target of image data processing within the shootable range of image pickup unit 416. Preferably, extracting unit 424 extracts, as the partial image data, the image corresponding to the top of the viewer that is shot with the shooting operation. In this case, the cloth of the viewer is not included in the image data. Thus, even if a color of the viewer's cloth is similar to a primary color, such as RGB (Red, Green, or Blue), the color adjustment is not influenced by the cloth color.
Calculating unit 426 calculates the total of color elements forming the color image at the partial area with the partial image data extracted by extracting unit 424.
Color temperature determining unit 428 determines the color temperature of the shot image on the basis of the total of color elements calculated by calculating unit 426. Further, color temperature determining unit 428 determines the color temperature displayed on display unit 412 on the basis of the set data stored in storage unit 420. The color temperature is determined by storing, as map data, a corresponding relationship between the total of color elements and the color temperature to storage unit 420 and by then referring to the map data. Preferably, when the total of color elements calculated by calculating unit 426 is below a preset upper limit, color temperature determining unit 428 determines the color temperature. Thus, when the total of color elements is over the upper limit, the color is not adjusted. Thus, it can be prevented that the adjusting processing of the color temperature is not converged.
Adjusting unit 430 adjusts values of the color elements of the image displayed on display unit 412 on the basis of the set data stored in storage unit 420. Incidentally, a broadcasting signal received by television 200 can include a signal for prohibiting the image adjusting processing. For example, for the purpose of copyright protection, control data for prohibiting the change in display color of the color image on the television 200 as a receiving device can be added to a video and audio signal itself (so-called content) and can be then sent. In this case, the television 200 detects the control data after receiving the broadcasting signal, adjusting unit 430 does not change the display color of the video image in response to the detection. Thus, the video image based on the broadcasting signal is reproduced without change.
Control unit 432 controls the video display operation at a display area on display unit 412 on the basis of the values of the color elements adjusted by adjusting unit 430. Specifically, control unit 432 outputs the adjusted values of the color components to display unit 412. Display unit 412 changes an output format of the video signal in accordance with the value.
Hereinbelow, with reference to
Television 200 mainly comprises an antenna 502, an external input unit 504, a light receiving unit 506, an operating unit 508, a CPU (Central Processing Unit) 510, a tuner 514, and a switching circuit 516. CPU 510 comprises a memory 512. The broadcasting signal received by antenna 502 is sent to tuner 514. Tuner 514 selects a channel whose selection is instructed on the basis of a control signal output from CPU 510.
External input unit 504 receives the input of the video and audio signal from its outside. For example, external input unit 504 receives an input of a video and audio signal sent from a VCR (Video Cassette Recorder), a DVD (Digital Versatile Disc) player, or another image reproducing device. The video and audio signal is sent from external input unit 504 to switching circuit 516. External input unit 504 may separately receive the video signal and the audio signal and, alternatively, may be obtained by combining cables for sending signals to one cable. Switching circuit 516 selectively outputs a signal output from tuner 514 or a signal output from external input unit 504 on the basis of a switching instruction output from CPU 510.
Television 200 further comprises camera 550, a memory 552, an analyzing device 560, and a communication I/F (Interface) 570. Camera 550 comprises, e.g., a CCD (Charge Coupled Device) solid-state image pickup device.
Memory 552 is, e.g., a flash memory. Camera 550 shoots the object (viewer) on the basis of a shooting instruction output from CPU 510, and sends image data of the object to memory 552. Memory 552 stores the image data in an area specified by a writing instruction output from CPU 510. Analyzing device 560 analyzes the image data obtained by shooting with camera 550 on the basis of the instruction from CPU 510. Analyzing processing will be described later.
Communication I/F 570 is connected to a network (not shown), and communicates data with another information communication device. Incidentally, television 200 may not have a communication I/F. A signal communicated via communication I/F 570 includes the control signal and the video and audio signal.
Referring again to
A signal output from switching circuit 516 is input to split circuit 522. Split circuit 522 executes processing for splitting the signal into a video signal and an audio signal on the basis of an instruction from CPU 510. The video signal output from split circuit 522 is input to OSD circuit 524. The audio signal output from split circuit 522 is sent to amplifiers 536a and 536b.
OSD circuit 524 generates a signal for displaying an image on display 530 on the basis of an instruction from CPU 510. The image contains, e.g., a channel number or another character information. Further, the character information contains the display operation of the volume level and the display- operation of television 200. The display operation indicating change operation includes up/down operation of volume and change in contrast. Specifically, OSD circuit 524 combines the video signal output from split circuit 522 and the image signal generated on the basis of the data pre-stored in memory 512, and outputs the signal generated by the combination to driver 528.
Driver 528 executes display processing of the image on display 530 on the basis of the signal output from OSD circuit 524. Amplifiers 536a and 536b amplify audio signals output from split circuit 522, and send the resultant signals to speakers 540a and 540b. Speakers 540a and 540b output sound on the basis of the signals.
Hereinbelow, with reference to
Information for identifying the viewer (viewer ID) is stored in area 610. A data file of face images obtained by shooting the viewers is stored in area 620. Attribute information (e.g., age) of the viewer is stored in area 630. A first characteristics amount (interval between the eyes) of the face image of the viewer is stored in area 640. Similarly, a second characteristics amount (interval between the eye and the mouth) is stored in area 650. Data for specifying a color temperature of the video image input every viewer is stored in area 660. Data stored in areas 610 to 660 is associated with each other. Thus, other associated data item can be derived by specifying the viewer ID stored in area 610.
Hereinbelow, with reference to
CPU 510 comprises a buffer area 710 that receives an input of a video signal from camera 550 and stores the signal, an entire-area reading unit 740 that reads the data in accordance with the entire area determined in accordance with a display area on display 530 to buffer area 710, and a partial-area reading unit 730 that reads data stored in a partial area 720 which is determined to buffer area 710 as a partial display area on display 530.
Entire-area reading unit 740 reads signals stored in buffer area 710 at predetermined processing speeds. When display 530 displays the image on the basis of this signal, the entire image of the object obtained by shooting with camera 550 is displayed on the entire display areas on display 530.
Partial-area reading unit 730 reads the signals stored in partial area 720. In this case, the reading speed is faster than a reading speed from the entire area of buffer area 710. That is, the area as a target of reading processing by partial-area reading unit 730 is smaller than the area as a target of reading processing by entire-area reading unit 740. Thus, the signals stored in partial area 720 are read faster than the signal corresponding to the entire area.
As a result, CPU 510 can execute signal reading processing faster than normal image processing on the basis of the video image shot by camera 550. Even if the object is still, the object is shot at the partial area determined in advance in camera 550 and information based on the signal sent from the object, e.g., infrared beams can thus be obtained.
Considering that the output from camera 550 is read from the upper left to the down right pixel by pixel, an area determining unit for specifying an area as a processing target may be provided. The total of color elements is calculated by extracting only the data in the partial area and sequentially adding the color elements. In this case, a buffer memory for image is not necessary and the circuit is therefore simplified.
In many cases, a camera module used for a mobile phone or the like includes an auto white balance (AWB) circuit. Data under intermediate processing in the auto white balance circuit, i.e., the total of color elements are read out, thereby obtaining the total of color elements.
Hereinbelow, with reference to
For example, when the color temperature near the viewer, calculated by the viewer shooting, is between 8500K and 9500K, the value of 9300K is set as the color temperature of the video image displayed on television 200.
When the calculated color temperature is between the set values, e.g. between 8500K and 9500K, hysteresis may be provided so as to prevent the sharp change of the set value due to the change in the calculated color temperature. Specifically, when the calculated color temperature is reduced from 8500K by several hundreds color temperatures (K), the used set value may be changed from 9300K to 8500K (hysteresis 810). On the other hand, when the calculated color temperature is increased from 8500K by several hundreds color temperatures (K), the used set value may be changed from 8500K to 9300K (hysteresis 820).
A relationship shown in
Further, in place of inputting the set value, a plurality of functions for determining the change in color may be prepared and names indicating the features of the display color may be added to the functions (e.g., “sharp video image” or “muted video image”, etc.), the name may be selected by the viewer, and the function corresponding to the selected name may be associated with the viewer, thereby storing the function and the name to memory 552.
Herein, with reference to
Shooting processing is normally executed while the object is in front of display 530 of television 200. Data generated by the shooting processing is stored in memory 552. The face of the object includes a skin color part and a non-skin-color part. For example, the hair, eyebrow, or eye is black or brawn, that is, different from the skin color (e.g., flesh-colored). With respect to the image of the object, the image data is subjected to binarizing processing or grayscale processing, thereby generating images with varied grayscales.
That is, as shown in
Hereinbelow, with reference to
In an example shown in
In this state, viewer 1001 performs initial registration to television 200. That is, viewer 1001 is shot by camera 550, and analyzing device 560 recognizes the face image of viewer 1001 and calculates the characteristics amount. As a consequence thereof, viewer 1001 is normally identified, the characteristics amount is then registered to television 200. Each time when viewer 1001 views television 200, camera 550 shoots viewer 1001. Therefore, the additionally-calculated characteristics amount can be compared with the already-stored characteristics amount.
It can be considered that viewer 1001 can view television 200 at the position near television 200, instead of the standard position. For example, viewer 1001 can view television 200 at position 1002 shown by a dotted line 1031. On the other hand, viewer 1001 can view television 200 at a position 1003 shown by a dotted line 1032, apart from television 200. In this case, the distance between viewer 1001 and camera 550 is reduced or is increased. According to this embodiment, a ratio of characteristics amounts is used for viewer identification. For example, a ratio of an interval between the eyes of the viewer to an interval between the eye and the mouth is used for the viewer identification. In this case, if the viewer is a single one, although the distances from camera 550 are different, the ratios are the same. Such erroneous identification that viewer 1001 is another viewer can be prevented. Therefore, the subsequent operation of television 200 can be controlled in accordance with viewer 1001.
Further, the viewer can view television 200 at the position displaced from central axis 1020. For example, a plurality of viewers can view a video image on television 200. Specifically, another viewer can view television 200 at positions shown by dotted lines 1021 and 1022. In this case, the ratios of the characteristics amount are not greatly different from the ratio of the pre-registered characteristics amounts. As a consequence, the amount of the difference is set in advance as an error, thereby accurately identifying the single viewer.
Incidentally, the position different from the standard position is not limited to that shown in
Hereinbelow, with reference to
In step S1110, CPU 510 detects an instruction for switching an operation mode of television 200 to a shooting mode of camera 550 on the basis of reception of a signal sent by a remote control terminal (not shown), input via light receiving unit 506. In step S820, CPU 510 detects an instruction for pressing a shooting button (not shown) of camera 550 on the basis of the shooting instruction signal from the remote control terminal, received by light receiving unit 506. CPU 510 outputs an instruction for shooting the object in the shooting mode preset to camera 550. The shooting mode includes a stop status, a shutter speed, and the like. Camera 550 executes the shooting processing of the object in response to the instruction. After the shooting processing, camera 550 outputs the image data. The output data is stored in an area reserved in memory 552.
In step S1130, CPU 510 stores data sent from camera 550 to memory 552 in the area that is reserved in advance in memory 552. Instep S1140, CPU 510 issues an instruction for executing analysis processing prescribed with the data stored in memory 552 to analyzing device 560. This instruction is realized by sending a command indicating this processing from CPU 510 to analyzing device 560.
In step S1150, analyzing device 560 reads the image data from memory 552 on the basis of the instruction, and stores the image data in a work area in a RAM (Random Access Memory) (not shown) that is provided for analyzing device 560. In step S1160, analyzing device 560 extracts the face image corresponding to the face of the viewer from the data. Processing for extraction is realized with well-known image processing.
In step S1170, analyzing device 560 executes processing for calculating the characteristics amount of the image area. The calculated characteristics amount corresponds to an item that is designated in advance by CPU 510. In step S1180, analyzing device 560 stores the calculated characteristics amount in the area that is reserved in advance in memory 552. As a consequence, the identifying processing of the viewer sitting at the standard position relative to television 200 ends, the data for specifying the viewer is stored in memory 552 (areas 620, 640, and 650 in
Hereinbelow, with reference to
In step S1210, CPU 510 detects the display operation of a color image on display 530. Instep S1220, CPU 510 sends the shooting instruction to camera 550. Camera 550 shoots the object existing within a predetermined shootable range on the basis of a preset shooting mode in response to the instruction. The data generated by the shooting operation is stored in memory 552. When the shooting operation by camera 550 ends, camera 550 sends a signal notifying the fact to CPU 510.
In step S1230, CPU 510 sends an instruction for analyzing the image data obtained in response to the reception of the instruction indicating the shooting end to analyzing device 560. Analyzing device 560 executes the prescribed image analysis processing with the data stored in memory 552 on the basis of the instruction. The result of analysis processing is stored in an area reserved in memory 552.
In step S1240, CPU 510 checks to see if the viewer obtained this time is the viewer that is registered in advance on the basis of the analysis result and the characteristics amount (the characteristics amount obtained upon registering the viewer) prestored in memory 552. Instep S1250, CPU 510 checks whether the viewer is a viewer that has already been registered on the basis of the result of check process in step S1240. If CPU 510 determines that the viewer has already been registered (YES in step S1250), the processing advances to step S1260. If CPU 510 determines that the viewer has not already been registered (NO in step S1250), the processing ends. In this case, television 200 continues the display operation of the color image on the basis of the prescribed set value.
In step S1260, CPU 510 reads the set value (color temperature) that is registered in advance from memory 552. Instep S1270, CPU 510 sends an instruction for changing the color to signal processing circuit 520 on the basis of the read set value. Signal processing circuit 520 changes the display color of the color image signal in accordance with the instruction. The changed signal is output from signal processing circuit 520, and display 530 displays the color image on the basis of the signal. The above-displayed color image is a video image that reflects the setting by the viewer.
As described above, television 200 according to this embodiment stores the characteristics amount in advance as data for specifying the viewer. A video display manner (grayscale of the display color) is associated with the characteristics amount as the set value indicating the preference of the viewer. Television 200 has the camera. Upon displaying the color image, television 200 shoots the viewer in the video image, obtains the image of the viewer, and calculates the characteristics amount of the viewer. When the viewer who views the color image is the viewer that is registered in advance in television 200 and the set value of the viewer exists, television 200 adjusts and displays the color image on the basis of the set value. Thus, the color image can be displayed in accordance with the viewer.
According to this embodiment, television 200 includes camera 550. Alternatively, a camera that can be externally connected to television 200 may be used. Further, analyzing device 560 that analyzes the image shot by camera 550 may be externally connected to television 200. In this case, the processing for identifying the viewer and the processing for outputting the identifying result are performed by an analyzing device that is externally connected the television. The television may adjust or may not adjust the display operation of the color image, depending on the identifying result depending on the viewers. As a consequence, the existing color television can perform display processing of colors depending on the viewers.
Although the present invention has been described and illustrated in detail, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, the spirit and scope of the present invention being limited only by the terms of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2005-368518 | Dec 2005 | JP | national |
