The present invention relates to a three-dimensional video image transmission system, and a video image display device and a video image output device composing the system, particularly to those transmitting three-dimensional video images through an interface compliant with the HDMI standard.
Conventionally, various types of methods have been devised for stereovision of TV images. These methods, using binocular parallax. alternately present right- and left-eye images specially or temporally on a single display, to provide three-dimensional images when viewed by a viewer wearing special glasses or with the naked eye.
Recently, devices have been widely used with HDMI (High Definition Multimedia Interface) terminals compliant with the HDMI standard. For example, connecting a TV to a DVD recorder with an HDMI connecting cable allows sending and receiving high-quality video and audio data as well as some types of control information between the devices.
In the meantime, video image formats for TV include SD (standard definition) and HD (high definition), where a large number of HD formats different in the number of scan lines and frame rate have already been prevailing in the world.
Meanwhile, video devices such as a TV and DVD recorder are usually different in functionality and capability depending on such as manufacturers, release time, and price ranges, where video image formats able to send and receive are often different among devices.
Hence, video and audio data in formats incompliant with each other cannot be communicated successfully. Such a problem can be solved by using some types of control information supported by HDMI.
For example, to reproduce audio and video data recorded in a DVD recorder and to output the data on a TV through an HDMI connecting cable, the following method is used. That is, EDID (extended display identification data) information (e.g. display capability of the TV) stored in a ROM is acquired from the TV preliminarily; the format is converted into that displayable on the TV; and the data is output on the TV (refer to patent literature 1 for example).
However, with conventional methods including that in patent literature 1, transmission of three-dimensional video images is not considered, thus leaving disadvantages in connecting between devices for transmitting three-dimensional video images.
[Patent literature 1] Japanese Patent Unexamined Publication No. 2007-180746
A three-dimensional video image transmission system of the present invention includes at least one video image display device for displaying three-dimensional video images and at least one video image output device for outputting three-dimensional video images. The system transmits three-dimensional video images output from the video image output device to the video image display device through an interface compliant with an HDMI standard. A three-dimensional video image is formed of left- and right-eye video images. The first interlaced scan data of left- and right-eye video images is transmitted during the first field and its subsequent second field. The second interlaced scan data, complementary to the first one, is transmitted during the third and fourth fields subsequent to the second one.
By adding a V synchronizing signal once for every four fields when transmitting three-dimensional video images from the video image output device to the video image display device through HDMI, such a configuration allows the display device to easily identify the four fields from the V synchronizing signal.
The video image display device of the present invention receives three-dimensional video images output from the video image output device through an interface compliant with the HDMI standard and displays the images, in the three-dimensional video image transmission system. The display device includes an HDMI receiving unit for receiving three-dimensional video image data transmitted from the video image output device in a given transmission format; a format converting unit for converting the transmission format into a display format; a display unit for displaying three-dimensional video images converted to the display format; and a storage unit for storing information on capability of displaying three-dimensional video images.
Such a configuration allows the video image display device to receive three-dimensional video image data output from the video image output device and to display the data.
The video image output device of the present invention transmits three-dimensional video images to the video image display device through an interface compliant with the HDMI standard, in the three-dimensional video image transmission system. The output device includes a video image acquiring unit for acquiring three-dimensional video images in a given video image format; a format converting unit for converting the given video image format into a transmission format; and an HDMI transmitting unit for transmitting three-dimensional video image data converted to the transmission format.
Such a configuration allows the video image output device to acquire information on the display capability of the display device through HDMI, which enables transmitting three-dimensional video image data adapted to the display device.
Hereinafter, a detailed description is made of some embodiments of the present invention with reference to the related drawings.
Recording and reproducing device 100, which is a DVD recorder for example, includes optical disc 101, recording and reproducing unit 102, codec 103, format converting unit 104, and HDMI transmitting unit 110. Compressed 3D video image data, compressed using such as MPEG2 and recorded on optical disc 101, is reproduced by recording and reproducing unit 102 (as a video image acquiring unit), and decompressed to baseband 3D video image data by codec 103. Format converting unit 104 converts video image data from the recording format of optical disc 101 into the transmission format of HDMI. HDMI transmitting unit 110 sends out 3D video image data to display device 200 through HDMI cable 205. Recording and reproducing device 100 preliminarily acquires information on a transmission format receivable by display device 200 from display device 200 through HDMI, and format converting unit 104 performs format conversion on the basis of this information.
Here, non-compressed (baseband) 3D video images recorded on optical disc 101 eliminate codec 103.
Display device 200 includes HDMI receiving unit 210, format converting unit 204, display control unit 201, and display panel 202. HDMI receiving unit 210 receives 3D video image data transmitted through HDMI cable 205. Format converting unit 204 converts 3D video image data received from a transmission format into a display format. Display control unit 201 drive-controls display panel 202 (i.e. a display unit) using 3D video image data converted into the display format. Display panel 202 (e.g. a plasma display panel (PDP) or liquid crystal display (LCD)) displays 3D video images.
Here, 3D video image data is composed of two different video image data: left-eye video image data (hereinafter, may be abbreviated simply as L) and right-eye video image data (hereinafter, may be abbreviated simply as R). These two different video image data are separately transmitted and are combined together by format converting unit 204 to be displayed as 3D video images. The transmission format and display format are described in detail later.
In the above description, the number of recording and reproducing devices and display devices composing 3D video image transmission system 1 is one each; however, the number is not limited to this embodiment, but any number of devices may be used.
In the above description, audio data is not mentioned; however, audio data may be transmitted as required.
HDMI transmitting unit 110 includes TMDS encoder 111 and packet processing unit 112. HDMI receiving unit 210 includes TMDS decoder 211, packet processing unit 212, and EDID_ROM 213.
Video image data, H/V synchronizing signal, and a pixel clock are input into TMDS encoder 111: converted from 8-bit data into 10-bit data as well as into serial data by TMDS encoder 111; and sent out through the three TMDS data channels (data #0, data #1, data #2). The pixel clock is transmitted through the TMDS clock channel. The three data channels transmit data at a maximum transmission speed of 165 M pixels/second, which enables transmitting even video image data of 1080 P by HDMI.
Audio data and control data are formed into packets by packet processing unit 112; converted into a specific 10-bit pattern by TMDS encoder 111: and transmitted during a video image blanking period of two data channels. A 2-bit horizontal/vertical synchronizing signal (H/V synchronization) is converted into a specific 10-bit pattern and is superimposed during a blanking period of one data channel; and transmitted. Here, the control data includes auxiliary video image data called AVI (Auxiliary Video Information) infoFrame, which allows transmitting format information of video image data from recording and reproducing device 100 to display device 200. AVI infoFrame is described in detail later.
Information for representing the capability of display device (sink) 200 is stored as EDID information in EDID_ROM 213 as a storage unit. Recording and reproducing device (source) 100 can determine such as the formats of video image data and audio data to be output, for example, by reading the EDID information using the DDC.
CEC enables operating plural devices with one remote control unit, for example, by interactively transmitting control signals between devices Connected with HDMI.
Next, a description is made of an example of parameters representing the capability (display and receiving capability) of display device 200 according to the embodiment using
In
The parameter “3D format” indicates a transmission format of 3D video image data receivable by display device 200, and there are four transmission formats: dot interleaved, line interleaved, side by side, and over under.
The image size (unit: pixel) includes the horizontal image size (image width) and vertical image size (image height), where the horizontal image size is changeable from 0 to 8,192 pixels, and the vertical image size is changeable from 0 to 4,096 pixels.
The screen size (unit: cm) has the horizontal screen size (display width) and vertical screen size (display height), where the horizontal screen size is changeable from 0 to 9,999 cm, and the vertical screen size is changeable from 0 to 4,999 cm.
The parameter “parallax compensation capable” indicates the capability of parallax compensation (1: compensation capable, 0: compensation incapable). This is because visual conditions such as viewing distance differ between viewing an original and viewing a 3D video image on display device 200, which requires parallax compensation. Parallax compensation is performed by shifting either one of the left-eye video image (also referred to as L video image, hereinafter) or the right-eye video image (also referred to as R video image, hereinafter) with respect to the other by a given number of pixels to display the images on the screen of display device 200. The number of pixels to be shifted at this moment is determined by the above image size, screen size, and viewing distance (the distance between the display device and the viewer).
The parameter “assumed viewing distance” (unit: cm) is viewing distance as a precondition for parallax compensation. The information (image size, screen size, assumed viewing distance) is required when parallax compensation is performed by recording and reproducing device 100, and the resulting video image data is transmitted to display device 200.
The last “extra delay for 3D process” (unit: frame) is a delay time generated at display device 200 for a 3D display process. The delay time is used to preliminarily execute a delay process at recording and reproducing device 100 for synchronizing (lip sync) video images with audio.
Next, a detailed description is made of each parameter of the transmission format (3D format) of 3D video images shown in
Usually, the transmission format of 3D video image data transmitted by recording and reproducing device 100 is determined on the basis of information preliminarily acquired from display device 200. If display device 200 can receive plural transmission formats, recording and reproducing device 100 can select one of them. In this case, recording and reproducing device 100 is to transmit information on the transmission format selected to display device 200 by using AVI infoFrame.
In
The glasses-worn method includes three parameters: “layout”, “image size”, and “parallax compensation”. The parameter “layout” includes four 3D video image transmission formats described in
The parameter “L/R mapping” represents an arrangement for transmitting L and R video images. In the dot interleaved method (
The parameter “L/R identification” represents a transmission order of L and R video images. In the dot interleaved method, the parameter indicates that the first pixel is an L video image (0) or R video image (1). In the line interleaved method, the parameter indicates that the first line is an L video image (0) or R video image (1). In the side by side method, the parameter indicates whether an L video image is placed on the (0: left side) or (1: right side); in the over under method, (0: upper) or (1: lower).
In the meantime, the over under method includes two different transmission methods as shown in
In
Meanwhile, to transmit 3D video image data in the same transmission band as that for regular 2D video image data, respective L and R video image data need to be contracted to a half for transmission, thus halving the resolution. Meanwhile, to transmit 3D video image data using twice the width of the transmission band for 2D video image data, L and R video image data can be transmitted in their original size, thus maintaining the original resolution. The parameter “image size” represents the resolution of 3D video images thus determined by a transmission line (band). The value (0: not squeezed) indicates that the screen size is not contracted and the resolution is not decreased. The value (1: horizontal half size) indicates that an image is contracted horizontally to half (a half horizontal resolution). The parameter relates to a case when transmitted by the dot interleaved method and side by side method.
Meanwhile, the value (2: vertical half size) indicates that a video image is contracted vertically to a half (the vertical resolution is halved). The parameter relates to a case when transmitted by the line interleaved method and over under method.
The parameter “parallax compensation” relates to parallax compensation. This is different from “parallax compensation” described in
Here, a description is made of the meaning of side priority. If parallax is not compensated at recording and reproducing device 100, parallax needs to be compensated at display device 200 in some cases. As shown in
If “parallax compensation” is (1: parallax compensated), “assumed width of display” (unit: cm), which is the screen size of display device 200 assumed when compensated by recording and reproducing device 100, can be sent, where “assumed width of display” is changeable within the range 0 to 9,999 cm.
Next, a description is made of a method of transmitting a parameter related to 3D video images described in
In this embodiment, information of group A in
Next, a description is made of AVI infoFrame superimposed during a blanking period of video images to be transmitted.
First, to declare that the infoFrame is a vendor's own infoFrame, Packet Type=0×81 is described in byte #HBO of the packet header, and Version 0×01 is described in byte #HB1. Further, the payload length (Nv) of vendor infoFrame is described in the five bits (bit #4 through bit #0) of byte #HB2.
The vendor ID registered to IEEE is described in the three bytes (byte #PB0 through byte #PB2) of the packet contents. Data (3D_7 through 3D_0) is described in byte #PB3 (data area), and byte #PB4 through byte #PB(Nv-4) are reserved (0). That is, each parameter of the transmission format of 3D video images in
In the above description, the size of the data area is 1 byte (byte #PB3), which is because all the parameters of the transmission format shown in
Part of the transmission format shown in
In
CEC provides a vendor's own message for a vendor command, with which a vendor can exchange vendor's own commands and arguments between devices. A description is made of how to transmit a parameter of group B in
Next, a description is made of the second exemplary embodiment of the present invention using
Tuner 300 as a video image receiving device includes receiving unit 305, format converting unit 304, and HDMI transmitting unit 310. and is connected to antenna 301, coaxial cable 302, and Internet 303. 3D video images broadcast from a broadcasting station (not shown) are received by receiving unit 305 (i.e. a video image acquiring unit) through antenna 301 in a predetermined receiving format. The 3D video images received are converted into a transmission format, receivable by display device 200, preliminarily acquired by format converting unit 304 and are output to display device 200 through HDMI transmitting unit 310.
3D video images broadcast from a cable broadcasting station (not shown) are input to receiving unit 305 through coaxial cable 302; 3D video images transmitted from a program distributing server (not shown) compliant with an IP (Internet Protocol) network are input to receiving unit 305 through Internet 303. Format converting unit 304 performs conversion compliant with the receiving format of 3D video images received from antenna 301, coaxial cable 302, or Internet 303. The subsequent operations are the same as those of the first embodiment, and thus their description is omitted.
Thus, according to 3D video image transmission system 2 of this embodiment, 3D video images in various types of formats sent from the outside of such as home can be displayed by being transmitted to display device 200 by tuner 300 having an HDMI terminal.
As described hereinbefore, the present invention allows a 3D video image transmission system composed of a video image output device and a display device connected to each other through HDMI to transmit parameters for transmitting and displaying 3D video images between the video image output device and the display device. Herewith, even if plural display devices with different display capabilities are connected to a 3D video image transmission system, 3D video image data can be transmitted without problems.
In the above embodiment, the description is made assuming that recording and reproducing device 100 is a DVD recorder, but not limited to, where other devices such as a BD recorder and a HDD (hard disk drive) recorder may be used.
In the above embodiment, the description is made of a case where a video image output device and a display device are connected with an HDMI cable compliant with the HDMI standard; however, devices may be connected wirelessly. When the wireless communication method is compliant with the HDMI protocol, the present invention is applicable, where 3D video image data to be transmitted is not limited to baseband video image data, but may be compressed video image data.
In the above embodiment, the description is made assuming that the HDMI standard is used; however, other transmission methods may be used as long as parameters representing the display capability of a display device described in the embodiment can be exchanged between devices.
The present invention is widely applicable to a system sending and receiving three-dimensional video image data between devices connected through HDMI.
100 Recording and reproducing device (video image output device)
101 Optical disc
102 Recording and reproducing unit
103 Codec
104, 204, 304 Format converting unit
110, 310 HDMI transmitting unit
111 TMDS encoder
112, 212 Packet processing unit
200 Display device (video image display device)
201 Display control unit
202 Display panel
210 HDMI receiving unit
211 TMDS decoder
213 EDID ROM
300 Tuner
301 Antenna
302 Coaxial cable
303 Internet
305 Receiving unit (video image acquiring unit)
Number | Date | Country | Kind |
---|---|---|---|
2008-224402 | Sep 2008 | JP | national |
2008-312867 | Dec 2008 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2009/004282 | 9/1/2009 | WO | 00 | 2/15/2011 |