Patent Grant
9743034
The present invention relates to a video transmitting/receiving device and a video display device.
A background art of this technical field is, for example, EDTV-II (wide clear vision) (see, for example, Non-Patent Document 1). Non-Patent Document 1 describes that “EDTV2 supposedly incorporates the methods for returning the number of scanning lines lost due to an increase in an aspect ratio in a horizontal direction to original 483 in standards. One of the methods is “complement processing of vertical resolution”. It is only required that a broadcast station broadcasts this signal and a television which supports EDTV2 and has a built-in device which can receive this signal receives this signal.”
Non-Patent Document 1: IT frontier (Nikkei Business reduced edition DVD, 1995/04/10, pages 58 to 60)
As definition of video content becomes higher and three-dimensional video images configured by disparity images become popular, a data amount of the video content has been increasing. However, since a transmission band is limited, when a data amount of video images becomes larger, it is necessary to reduce the data amount in accordance with a transmission channel instead of transmitting the video content as is. However, there is a probability that the reduction of the data mount of the video content deteriorates image quality. For example, in a method for reducing the data amount per unit time by lowering a frame rate, a time interval between frames becomes longer, and thus the continuity in motion is lost, which causes the deterioration of image quality. Further, in a method for reducing the data amount per frame by lowering resolution, the deterioration of image quality is caused due to decrease in the resolution.
The EDTV-II standards define that a broadcast station multiplexes a complement signal on a video signal transmitted by an existing broadcast wave and transmits the video signal and a television which supports the complement signal performs complement processing. In this method, however, the broadcast station needs to generate the complement signal, and thus the complement processing does not always match the viewing environment of users.
The present invention provides a video transmitting/receiving device which solves the above problems, and outputs a video signal suitable to a video display device for viewing high-definition video images.
A summary of a typical aspect of the invention disclosed in this application will be briefly described as follows. For example, the summary of one aspect of the present invention is that a complement signal is generated in accordance with information of a device serving as an output destination, and the complement signal is output after being added to a video signal whose data amount has been reduced.
According to the present invention, it is possible to provide a video transmitting/receiving device which outputs a video signal suitable to a video display device.
Embodiments of the present invention will be described below with reference to the drawings.
[Configuration Example of Video Transmitting/Receiving Device]
The tuner unit 101 is connected with an antenna which receives a broadcast wave via a coaxial cable, and generates video content by demodulating the received broadcast wave. Note that the video content is configured by meta data including information related to a video signal or video encoded according to MPEG2, H.264 or H.265. The network interface unit 102 generates video content by analyzing video content distributed in a packet data format by using a network such as an IP (Internet Protocol). The optical drive unit 103 reads video content recorded in an optical medium such as a BD (Blu-ray (registered trademark) Disc).
The recording unit 104 reads video content recorded in an information recording medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The selecting unit 105 functions as a receiving unit which receives video content from each of the tuner unit 101, the network interface unit 102, the optical drive unit 103 and the recording unit 104, and selects video content to be output from video contents input in accordance with the setting instruction from a user via a remote controller or a button and outputs the selected video content.
Note that, when the video transmitting/receiving device includes a wireless communication unit which enables Wi-Fi connection, the setting instruction from a user can be received also via, for example, an application of a Wi-Fi connected smartphone through a wireless LAN router without the dedicated remote controller or the like, and the video content may be selected in accordance with the instruction.
The decoder unit 106 decodes the video content, and generates non-compressed video signal.
The converting unit 107 performs predetermined conversion processing on a video signal. The information adding unit 108 adds a complement signal to the video signal. The control unit 109 selects the video signal to be output in accordance with information of the video content and information of a video display device serving as a connection destination.
The input/output unit 110 receives an input of device information related to the connected video display device, and outputs the video signal selected by the control unit 109 to the video display device connected via an HDMI (registered trademark) cable or the like.
Next, an operation of the video transmitting/receiving device 100 according to the present embodiment will be described.
The selecting unit 105 selects the video content to be output to the decoder unit 106 from those of the tuner unit 101, the network interface unit 102, the optical drive unit 103 and the recording unit 104 based on an input from a user. For example, the user selects video content output from the tuner unit 101 when viewing a terrestrial digital broadcasting, the user selects video content output from the network interface unit 102 when viewing an IPTV, the user selects video content output from the optical drive unit 103 when viewing a movie recorded in an optical medium such as a BD, and the user selects video content output from the recording unit 104 when viewing a program recorded in advance in the recording unit 104.
The decoder unit 106 decodes the encoded video signal included in the video content selected by the selecting unit 105, and generates a non-compressed video signal.
The converting unit 107 performs conversion processing such as resolution reduction or tone reduction so that the non-compressed video signal generated by the decoder unit 106 falls within a transmission band. The method of conversion processing is selected by learning a method supported by the connected video display device based on device information obtained in advance. For example, a case where the user views high-resolution 3D video content including motions will be described. Input content has resolution of 3840×2160 (hereinafter, referred to as 4K2K), and left-eye and right-eye disparity images are displayed at a frame rate of 60 Hz. Further, the video display device has a function of displaying the resolution of 4K2K at 120 Hz.
Meanwhile, it is presupposed that a transmission channel which connects the video transmitting/receiving device and the video display device can transmit a video image of the resolution of 4K2K at a frame rate up to 60 Hz as a baseband video signal as standardized by HDMI2.0. In such a case, since the transmission channel becomes a bottle neck and input content cannot be viewed as is, it is necessary to transmit the input content after reducing the data amount to ½.
Examples of the method of reducing the data amount include a method of lowering a frame rate and a method of lowering resolution. However, when a frame rate of this input content is reduced to ½, a frame rate for one eye becomes 30 Hz, and motions sometimes become unsmooth and unnatural in the case of video images of speedy motions such as sports. Meanwhile, even when the resolution is reduced to ½, the resolution is not less than Full HD (1920×1080). Consequently, by appropriately performing scaling processing and displaying video images on a display side, it is possible to view video images of high resolution and smooth motions.
Hence, the resolution is reduced to ½ in a vertical direction, thereby obtaining the converted video signal having the transmittable data amount with the resolution of 3840×1080 at 120 Hz. Further, as described above, the conversion processing method supported by the video display device is obtained in advance before the conversion processing is performed. Information of the video display device is obtained by, for example, inter-device communication via an HDMI.
Note that it is also possible to record the device information of a video display device which has been connected once in a memory or the like so that detailed device information can be read instantly from the memory or the like when connection to the same video display device is made again.
The information adding unit 108 adds to the video signal a complement signal for generating a display video image by complementing the video signal converted by the converting unit 107 by using difference information. By learning information related to complement processing of the video display device serving as a connection destination via inter-device communication of HDMI in advance, and predicting a pixel value of a video signal generated by performing predetermined enlargement processing from a baseband video signal in order for the video display device to perform the complement processing, the complement signal is generated based on a difference value between the predicted pixel value and the pixel value of the non-compressed video signal which is not yet converted by the converting unit 107.
In the case of the output via the HDMI, the converted video data is transmitted as the baseband signal, and the complement signal is added to an info frame. When a data size to be added is large, compression processing supported by the video display device is performed to reduce the data amount before adding.
When the video display device performs the complement processing, it is possible to restore input video content of the video transmitting/receiving device 100 by performing predetermined enlargement processing on the baseband video signal and then performing the complement processing to add and return the complement signal.
The control unit 109 selects an output signal in accordance with a selection flow illustrated in
In S1001, inter-device communication with the connected video display device is performed to obtain information of the device serving as a connection destination including information related to a complementing function, and the flow moves to S1002. In S1002, whether or not a non-compressed video signal generated by the decoder unit 106 is supported by the video display device is determined from a viewpoint of resolution, a frame rate and a zoom display by a zoom function, based on the obtained device information. When it is determined in S1002 that the non-compressed video signal is supported, the flow moves to S1004, and when the non-compressed video signal is not supported, the flow moves to S1003.
In S1003, the user is notified that the video display device cannot display the input video image. In S1004, when the non-compressed video signal generated by the decoder unit 106 is transmitted as is, it is determined whether or not the non-compressed video signal exceeds the transmission band after the input/output unit 110. When it is determined in S1004 that the non-compressed video signal exceeds the transmission band, the flow moves to S1005, and when the non-compressed video signal does not exceed the transmission band, the flow moves to S1008.
In S1005, it is determined whether or not the connected video display device supports the complementing function of performing the complement processing using the complement signal added by the information adding unit 108. When it is determined in S1005 that the connected video display device supports the complementing function and the complementing function is in an ON state, the flow moves to S1006, and when the connected video display device does not support the complementing function or the complementing function is in an OFF state, the flow moves to S1007.
In S1006, the converted video signal to which the complement signal generated by the information adding unit 108 has been added is selected as a video signal output from the input/output unit 110. In S1007, the converted video signal generated by the converting unit 107 is selected as the video signal output from the input/output unit 110. In S1008, the non-compressed video signal generated by the decoder unit 106 is selected as the video signal output from the input/output unit 110.
The input/output unit 110 outputs the video signal selected by the control unit 109 to the video display device serving as a connection destination in accordance with general standards such as the HDMI.
When the connected video display device does not support the complementing function, the connected video display device optionally scales and displays the video signal transmitted in the baseband. When the connected video display device supports the complementing function, the connected video display device performs the complement processing based on the video signal transmitted in the baseband and the complement signal and displays the video signal.
Further, a case where the resolution of the video display device is lower than resolution of an input video image will be described with reference to
It is presupposed that an input video image is a 3D video image of 4K2K illustrated in
In such a case, the video signal obtained by reducing the input video image in
By employing the above configuration, the video display device which supports the complement processing can display high-definition video images of smooth motions while maintaining the frame rate without increasing the transmission band. Further, even the existing video display device which cannot perform the complement processing can also display the video images.
[Configuration Example of Video Display Device]
Next, a video display device 700 which supports the complementing function will be described.
The input unit 701 receives an input signal transmitted from a device connected via an HDMI cable or the like, and demultiplexes the input signal to a baseband non-compressed video signal and meta data and then outputs them. The converting unit 702 performs conversion processing described later on the non-compressed video signal. The decoding unit 703 extracts the complement signal from the meta data. Further, when the complement signal is compressed, the decoding unit 703 performs the decompression processing.
The complementing unit 704 performs complement processing on the video signal output from the converting unit 702 based on the complement signal output from the decoding unit 703, thereby generating a high-definition video signal. The control unit 705 switches an operation of each unit in accordance with information of the input signal and a function of the display unit 706. The display unit 706 is a display device such as a liquid crystal panel and a plasma panel, and displays video signals.
Next, an operation of the video display device 700 according to the present embodiment will be described.
The input unit 701 demultiplexes a signal transmitted from the connected video transmitting/receiving device 100 (
For example, when the resolution is 3840×1080 and an aspect ratio is 16:9 as described above, the converting unit 107 performs enlargement processing so that the resolution is doubled in the vertical direction, and converts the non-compressed video signal into a 4K2K video image. The enlargement processing may be realized by simply doubling each line or inserting an average value of two consecutive lines as a complement line.
Naturally, the number of pixels of video images is doubled in these methods, but this does not mean that an input video image of the video transmitting/receiving device 100 (
The decoding unit 703 restores the complement signal added to the input video signal by the video transmitting/receiving device 100 (
The complementing unit 704 performs complement processing on the video signal generated by the converting unit 702 based on the complement signal generated by the decoding unit 703, thereby generating a display image. In performing the complement processing, the method of the enlargement processing performed by the converting unit 702 is notified via inter-device communication before the video transmitting/receiving device 100 generates the complement signal, so that the video transmitting/receiving device 100 can predict a pixel value after enlargement.
Hence, by retaining a difference value for each pixel between the video signal generated by the converting unit 702 and the input video signal of the video transmitting/receiving device 100 as a complement signal and performing the complement processing so as to add and return the complement signal to the video signal after the enlargement processing by the converting unit 702, the video display device 700 can restore the high-definition input video image received by the video transmitting/receiving device 100.
The control unit 705 controls each unit other than the control unit 705 and the display unit 706 to perform the series of complement processing described above. Further, in the case of the setting which does not use the complementing function, the control unit 705 switches an operation of each unit so as to display the non-compressed video signal output from the input unit 701 as is.
The setting which does not use the complementing function is, for example, a low power consumption mode or a game mode. In the case of the low power consumption mode, it is possible to suppress power consumption of the video display device 700 by stopping power supply to relevant circuits without performing the complement processing. In the case of the game mode, since it is possible to reduce a display delay of the video image by displaying the video image by the through output without performing the complement processing, responsiveness in the use of a game machine by a user can be improved.
Further, when the video transmitting/receiving device 100 makes an inquiry as to whether or not the complementing function is supported via inter-device communication, the control unit 705 transmits information related to the complementing function such as an output resolution or a complementing method. The display unit 706 displays the video signal output from the complementing unit 704.
According to the above configuration, the user can view restored high-definition video images obtained by performing the complement processing on video images generated by the video transmitting/receiving device 100.
[Converting Unit and Information Adding Unit (Resolution)]
Next, the converting unit 107 and the information adding unit 108 in the case where resolution is converted so as to fall within a transmission band will be described.
The operations thereof will be described with reference to
Numbers of each element name in
Po00=(Pi00+Pi10)/2 (Equation 1)
Similarly, a conversion equation for generating the pixel Po10 of the reduced image S is expressed by (equation 2).
Po10=(Pi20+Pi30)/2 (Equation 2)
As expressed by above (equation 1) and (equation 2), the reduction processing is performed by using an average value of an even-number line and an odd-number line of each two lines for the pixel after the reduction. Further, similar conversion is performed also in a horizontal direction. By performing the reduction processing for an entire screen like this on all frames, a reduced video signal is generated. By performing the above reduction processing, it is possible to generate a reduced video signal while suppressing an unnatural jaggy.
The difference generating unit 202 generates the complement signal H illustrated in
H00=(Pi00−Pi10)/2 (Equation 3)
Also for other coordinates, a complement signal is generated according to the similar generation equation based on pixels having the same vertical positions of an even-number line and an odd-number line of each two lines. The compressing unit 203 performs compression processing to reduce the data amount of the complement signal generated by the difference generating unit 202, thereby generating a compressed complement signal.
As expressed by (equation 3), difference information is a difference value of pixels which are at a spatially close distance. In the case of general video images, neighboring pixels have a correlation, and therefore difference values tend to incline to values with small absolute values. Hence, the high compression efficiency can be realized by using a compression algorithm utilizing a statistical inclination of code appearance frequencies such as a Huffman code.
In order to add the compressed complement signal generated by the compressing unit 203 to the reduced video signal generated by the reducing unit 201, the adding unit 204 adds the compressed complement signal to meta data of the reduced video signal.
By performing the above reduction processing and difference generation processing, the information adding unit 108 (
Next, complement processing in the case where the video display device 700 (
The input unit 701 generates the reduced image S and the compressed complement signal as non-compressed video signals from the input signal. The converting unit 702 doubles the reduced image S for each line as illustrated by the converted image T in
The decoding unit 703 performs decoding processing on the compressed complement signal, thereby generating the complement signal H in
Pcmn=Pomn+Hmn(where m is an even number and n is an arbitrary integer) (Equation 4)
Pcmn=Pomn−Hmn(where m is an odd number and n is an arbitrary integer) (Equation 5)
The (Equation 4) is a complement equation for generating pixels of even-number lines configuring the display image D.
Similarly, the (equation 5) is a complement equation for generating pixels of odd-number lines configuring the display image D.
By performing the processing like this, it is possible to restore the pixels of the input image I in
A method of reducing resolution in the vertical direction has been described in the present embodiment, but a method of reducing resolution in a horizontal direction also provides the same effect.
Further, the resolution reducing method has also been described by using an example of the ½ reduction. Alternatively, when the reduction processing is performed at an arbitrary magnification, the same effect can be provided by, for example, generating a reduced image by linear interpolation in which pixels are generated based on a ratio of gravity center position, using a difference value from a pixel of the reduced image located at a position closest to the gravity center of display pixels as a complement signal, and performing the complement processing based on the gravity center position. Further, the generation of complement signal may be limited to a part of a screen instead of the entire screen.
The converting unit 107 performs horizontal ½ reduction processing on the area B of this input image, thereby generating the area C of the transmission image. The converting unit 107 does not perform the conversion processing on the area A of the input image, and uses it as the area A of the transmission image as is. By performing the above processing, the transmission image of 16:9 whose left and right parts are only reduced is generated. A video signal configured by the transmission image like this is used as a baseband video signal of an output signal.
The difference generating unit 202 generates a complement signal from the area B. Processing subsequent to the compressing unit 203 is operated as described above, and a compressed complement signal is added to the video signal. The video display device can display a video image of 21:9 by performing the complement processing on the area C.
When a video signal is transmitted, an operating frequency of a transmission channel changes in accordance with the number of pixels. Hence, when an aspect ratio of a video image changes from a video image generally transmitted in the transmission channel, a cable used for the transmission channel needs to be changed to a cable which supports the operating frequency. Consequently, by employing the above configuration, it is possible to transmit the video images of different aspect ratios without changing the transmission channel.
Further, a complement signal does not necessarily need to be generated by the video transmitting/receiving device 100. For example, the same effect can be provided by adding a complement signal as meta data of video content at a broadcast station in advance.
[Converting Unit and Information Adding Unit (Tone)]
In the second embodiment, a converting unit 107-2 and an information adding unit 108-2 in the case where the number of quantization bits of a signal is reduced so that the data amount of a video signal falls within a transmission band will be described as a modified example of the video transmitting/receiving device 100 described in the first embodiment.
The converting unit 107-2 is configured to include an LSB (Least Significant Bit) removing unit 301 which removes lower bits of a signal for each pixel. The information adding unit 108-2 is configured by using an MSB (Most Significant Bit) removing unit 302 which removes upper bits of a signal for each pixel, a compressing unit 303 which performs compression processing to generate a compressed signal whose data amount is reduced, and an adding unit 304 which adds the compressed signal to a video signal as appropriate.
The LSB removing unit 301 removes lower bit information for each pixel with respect to a non-compressed video signal output from the decoder unit 106 (
For example, when an input video image is configured by 12-bit data per pixel and the data amount of the video signal is approximately 1.5 times the transmission band, the data amount of the video signal becomes ⅔ times by removing four lower bits to generate a video signal configured by eight upper bits, and falls within the transmission band.
The MSB removing unit 302 generates a complement signal by removing information other than a portion removed by the LSB removing unit 301. In the preceding example, the LSB removing unit 301 removes the four lower bits, and therefore the eight upper bits and four lower bits are the complement signal. The processing of the LSB removing unit 301 and the processing of the MSB removing unit 302 are separately performed for clarification of description, but are desirably performed concurrently. Namely, it is possible to realize the same processing by separating the signal line of each bit for transmitting the input image into those for the eight upper bits and the four lower bits and changing the connection destinations.
The compressing unit 303 and the adding unit 304 perform the same processing as those of the compressing unit 203 and the adding unit 204 described with reference to
By employing the above configuration, it is possible to view video images whose discontinuity in tone is hard to be distinguished without increasing the transmission band.
[Converting Unit and Information Adding Unit (Color)]
In the third embodiment, a converting unit 107-3 and an information adding unit 108-3 in the case where color information of pixels is reduced so that the data amount of a video signal falls within a transmission band will be described as another modified example of the video transmitting/receiving device 100 described in the first embodiment.
The converting unit 107-3 is configured to include a color reducing unit 401 which reduces color information for each pixel. The information adding unit 108-3 is configured by using a difference color generating unit 402 which generates difference color information for each pixel, a compressing unit 403 which performs compression processing to generate a compressed signal whose data amount is reduced, and an adding unit 404 which adds the compressed signal to a video signal as appropriate.
The color reducing unit 401 reduces color information for each pixel with respect to a non-compressed video signal output from the decoder unit 106 (
Comn=(Cimn+Cim(n+1))/2 (Equation 6)
A suffix m represents a vertical coordinate expressed by an arbitrary integer, a suffix n represents a horizontal coordinate expressed by a multiple of two, Ci represents a color difference signal of an input video image, and Co represents a color difference signal after conversion.
The difference color generating unit 402 generates difference color information for complementing a video signal converted by the color reducing unit in the video display device based on the non-compressed video signal output from the decoder unit 106. The difference color information is generated based on a difference value between color difference signals of two horizontal pixels in the case where the color reducing unit 401 converts a non-compressed video signal from the 4:4:4 format into the 4:2:2 format. A generation equation of the difference information is expressed by (equation 7).
Hmn=(Cimn−Cim(n+1))/2 (Equation 7)
A suffix m represents a vertical coordinate expressed by an arbitrary integer, a suffix n represents a horizontal coordinate expressed by a multiple of two, Ci represents a color difference signal of an input video image, and H represents a complement signal.
The compressing unit 403 and the adding unit 404 perform the same processing as those of the compressing unit 203 and the adding unit 204 described with reference to
When the video display device performs the complement processing, the complement signal is added in the case where a horizontal position is an even number, and the complement signal is subtracted in the case where the horizontal position is an odd number. A complement equation in the case where the horizontal position is an even number is expressed by (equation 8), and a complement equation in the case where the horizontal position is an odd number is expressed by (equation 9).
Ccmn=Comn+Hmn (Equation 8)
Ccm(n+1)=Comn−Hmn (Equation 9)
A suffix m represents a vertical coordinate expressed by an arbitrary integer, a suffix n represents a horizontal coordinate expressed by a multiple of two, Co represents a color difference signal of an input video image, H represents a complement signal, and Cc represents a color difference signal of a display video image.
By employing the above configuration, it is possible to view video images of high color resolution without increasing a transmission band.
Note that the present invention is not limited to the embodiments described above and includes various modified examples. For examples, the embodiments above have been described in detail so as to make the present invention easily understood, and the present invention is not always limited to the embodiment having all of the described constituent elements. Also, a part of the configuration of one embodiment may be replaced with the configuration of another embodiment, and the configuration of one embodiment may be added to the configuration of another embodiment.
For example, the video transmitting/receiving device and the video display device may be integrated in each embodiment or there may be a modified example where part of components such as an optical drive unit and a recording unit are provided outside the video transmitting/receiving device. Further, another configuration may be added to a part of the configuration of each embodiment, and a part of the configuration of each embodiment may be eliminated or replaced with another configuration.
Furthermore, part or all of the above components may be configured by hardware or may be configured to be realized by executing a program by a processor. Still further, control lines and information lines are illustrated for the sake of description and do not necessarily indicate all control lines and information lines in products. Actually, it is presumable that almost all components are connected with each other.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2014/068917 | 7/16/2014 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2016/009507 | 1/21/2016 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20090109332 | Lin | Apr 2009 | A1 |
| Number | Date | Country |
|---|---|---|
| 09-027948 | Jan 1997 | JP |
| 2011-119828 | Jun 2011 | JP |
| 2014-082673 | May 2014 | JP |
| Entry |
|---|
| IT Frontier (Nikkei Business Reduced-size edition DVD, Apr. 10, 1995, pp. 58 to 60. |
| IT frontier (Nikkei Business reduced edition DVD, Apr. 10, 1995, pp. 58 to 60. |
| International Search Report of PCT/JP2014/068917 dated Oct. 21, 2014. |
| Number | Date | Country | |
|---|---|---|---|
| 20170171507 A1 | Jun 2017 | US |
