1. Field of the Invention
The present invention relates to a technique for transmitting video data to multiple video output devices via multiple communication paths between multiple wireless transmitters and multiple wireless receivers.
2. Description of the Related Art
There is a system which projects split video using multiple projectors, combines the projected images and displays large-screen video, and a system which superimposes and displays a plurality of images from projectors the luminance of which is inadequate. There is also a system which displays 3D video by superimposing left and right images. Thus, there are various multiprojection systems for displaying a large picture as multiple images.
The video in such a large-picture multiprojection system is required to have a high image quality, and the amount of video data involved is enormous. In addition, the enlargement in screen size is accompanied by a longer distance between the projector and the video source and by more complicated wiring. As a consequence, the desire to adopt a wireless scheme for such a system has become very great.
Wireless communication systems involve larger capacity, as in MIMO techniques and milliwave transmission. However, in order to transmit large pictures and high-quality video that has not been compressed to a plurality of projectors, communication on multiple channels using multiple wireless communication devices is required.
For example, the specification of Japanese Patent Laid-Open No. 06-268985 discloses a technique for transmitting multiple items of video data using multiple channels. This technique varies the transmission rate per image channel in accordance with amount of information generated per image channel within the total transmission rate of the multiple transmission channels. Further, data on an image channel allocated in excess of the transmission rate of a single channel is transmitted utilizing a transmission channel that corresponds to an adjacent image channel.
In a multiprojection system for sending and receiving multiple items of video data by multiple wireless transmitters, there are instances where the required transmission rate cannot be maintained when the propagation environment changes owing to obstacles that block the electromagnetic waves of wireless communication, electric-wave interference ascribable to other communication devices, and the like. If the transmission rate of one communication path declines, the video transmitted via this communication path is disturbed. In the case of large-screen video, the seam or boundary between disturbed video and undisturbed video becomes conspicuous and the overall video quality deteriorates.
Further, in the case of 3D video or a case where video is superimposed in order to improve luminance, if high-quality video and low-quality video are superimposed, there are instances where image disturbance caused by the low-quality video becomes prominent and a decline in overall video image quality becomes conspicuous.
The present invention provides an apparatus and method adapted so that even if the transmission rate of any communication path of multiple communication paths declines, the video images combined and displayed are uniformalized in image quality.
According to one aspect of the present invention, there is provided a distribution apparatus in a video display system for combining and displaying at least two video images transmitted via multiple communication paths, comprising: a first deciding device configured to decide qualities of each of the video images combined and displayed based upon transmission rates of the multiple communication paths; a second deciding device configured to decide distribution ratios of multiple video images, which are transmitted via the multiple communication paths, in accordance with the transmission rates of the multiple communication paths and qualities of each of the video images decided by the first deciding device; and a distributing device configured to distribute multiple video images to the multiple communication paths in accordance with the distribution ratios decided by the second deciding device.
Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).
Embodiments of the present invention will be described below with reference to the drawings. Described in the embodiments are a distribution apparatus and video distribution method in a video display system for combining and displaying at least two video images transmitted via multiple communication paths.
It should be noted that although a case where a first communication path and a second communication path are the multiple communication paths will be described, the present invention is not limited to such case. Further, although a case where a first video image and a second video image are distributed is described, the present invention is not limited to such case.
This embodiment will be described taking as an example a system in which a projector 141 projects the right-half side of video of a large screen, a projector 142 projects the left-half side of video of the large screen and these left and right video images are joined together to thereby project large-screen video. However, the present invention is applicable even in a system that superimposes the video images from the projectors 141 and 142 to thereby improve the luminance of the projected video and in a system in which the projectors 141 and 142 project left and right video images of 3D video and superimpose these video images to display video rendered in 3D.
A data distributor (TxDiv) 101 shown in
Assume that best-quality video can be obtained from the projectors 141 and 142 if the video is transmitted via communication paths having a transmission rate of 2 Gbps. Accordingly, if communication is being achieved at a transmission rate of 2 Gbps on each of the communication paths between the transmitter 111 and receiver 121 and between the transmitter 112 and receiver 122, as shown in
The receiver 121 is connected by wire to both of the data combiners 131 and 132. However, in accordance with the contents of the header received, the receiver 121 sends video data only to the data combiner 131 and all of the video data is sent from the data combiner 131 to the projector 141. The receiver 122 also is connected by wire to both of the data combiners 131 and 132. However, in accordance with the contents of the header received, the receiver 122 sends video data only to the data combiner 132 and all of the video data is sent from the data combiner 132 to the projector 142.
In
Of the 2-Gbps transmission rate on the communication path between the transmitter 111 and receiver 121, the data distributor 101 allocates 1.5 Gbps to the video data destined for the projector 141 and allocates 0.5 Gbps to the video data destined for the projector 142. The data distributor 101 distributes to the transmitter 111 the video data transmitted at these transmission rates. Further, the data distributor 101 allocates the total of the 1-Gbps transmission rate on the communication path between the transmitter 112 and receiver 122 to the video data of projector 142 and distributes to the transmitter 112 the video data transmitted at 1 Gbps. Of the 1.5-Gbps video data transmitted to the projector 142, it will suffice if the data distributor 101 distributes a packet of 0.5 Gbps to the transmitter 111 and distributes a packet of 1.0 Gbps to the transmitter 112.
The header of the video data applied to the transmitter 111 has contents indicating that the destination of the 1.5-Gbps video data is the projector 141 and that the destination of the 0.5-Gbps video data is the projector 142. On the other hand, the header of the video data applied to the transmitter 112 has contents indicating that the destination of all of this video data is the projector 142.
In accordance with the contents of the header received, the receiver 121 sends the data combiner 131 the video data destined for the projector 141 that has been transmitted at the 1.5-Gbps transmission rate. Furthermore, the receiver 121 sends the data combiner 132 the video data destined for the projector 142 that has been transmitted at the 0.5-Gbps transmission rate. As a result, the data combiner 131 transmits to the projector 141 the video data that has been transmitted at the 1.5-Gbps transmission rate. In accordance with the contents of the header received, the receiver 122 transmits the video data destined for the projector 142, which data has been transmitted at the 1-Gbps transmission rate, only to the data combiner 132. This video data is combined with the 0.5-Gbps video data, which has been transmitted from the receiver 121, by the data combiner 132 and the resultant 1.5-Gbps video data is transmitted to the projector 142.
Thus, as described above, the quality of the video data transmitted to multiple projectors is evened out, thereby uniformalizing the left-and-right video outputs and making it possible to render inconspicuous the boundary between the video images.
Reference will now be had to
Next, the data distributor calculates the sum total of the transmission rates of all of the communication paths and decides video quality based upon the amount of data capable of being transmitted at the sum-total transmission rate (step 203). Further, the data distributor adjusts the quality of the video transmitted to each projector so as to uniformalize the image qualities of the video transmitted to each of the projectors, thereby deciding the amount of video data transmitted to each projector. Then, in conformity with the transmission rate on each communication path, the data distributor decides the data distribution of the multiple items of video data transmitted from each of the transmitters (step 204). Next, the data distributor inserts a header into the video data sent to each transmitter (step 205). It should be noted that the header contains information such as video-data destination, amount, order and transmission rate decided in accordance with the data distribution.
Next, the data distributor sends the data, into which the header has been inserted, to all of the transmitters with the exception of transmitters for which communication paths have not been acquired (step 206). The data distributor thenceforth returns to processing for ascertaining the transmission rates of the communication paths and ascertains the transmission rate of each communication path from the acknowledgement (Ack) response to the video data transmitted by each transmitter.
Further, in the initial state, the maximum transmission rate has been set in each transmitter (step 211). Upon receiving the test-signal transmission instruction from the data distributor, the transmitter transmits the test signal to the receiver (step 212). After transmitting the test signal, the transmitter waits for receipt of acknowledgement (Ack) from the receiver (step 213) and determines whether the transmission rate is the minimum rate if acknowledgement (Ack) cannot be received (step 214). If the result of the determination is that the transmission rate is not the minimum rate, then the transmitter lowers the transmission rate (step 21a) and returns to processing for transmitting the test signal to the receiver. Even if the transmission rate is the minimum rate, this transmission route is severed in a case where the acknowledgement (Ack) cannot be received (step 21b). In a case where the acknowledgement (Ack) can be received, on the other hand, the transmitter preserves the transmission rate prevailing at this time and conveys the transmission rate to the data distributor.
At the time of the data transfer that follows, the transmitter transmits the data at the transmission rate for which test-signal acknowledgement could be received (step 217). The transmitter then waits for receipt of acknowledgement (step 218) and, when acknowledgement cannot be received, the transmitter determines whether the transmission rate is the minimum transmission rate in a manner similar to transmission of the test signal (step 219). If the result of the determination is that the transmission rate is not the minimum rate, then the transmitter lowers the transmission rate (step 21a). Even if the transmission rate is the minimum rate, this transmission route is severed in a case where acknowledgement cannot be received (step 21b).
Further, each receiver receives the test signal or data from the transmitter (steps 221, 223) and transmits acknowledgement if the test signal or data could be received (steps 222, 224).
Next, reference will be had to
Thus, the data distributor 101 adjusts the bit width of resolution or gradation in accordance with the sum total of the transmission rates of all communication paths. Furthermore, the data distributor 101 adjusts the video quality and amount of data of the video data to each projector transmitted via each communication path and substantially equalizes the video qualities that are output from each of the projectors. The data distributor 101 subdivides the video data into the respective wireless packet sizes and sends the packets to the transmitters 111 and 112. When the video data is subdivided into packet sizes, the data distributor 101 decides the transmission rate on each communication path, the ratios of the video data transmitted on the respective communication paths and the packet size of each item of video data in such a manner that the video of the multiple projectors 141 and 142 will be uniformalized in image quality.
Examples of the packet structures of the transmitters 111 and 112 shown in
It should be noted that
A modification of the first embodiment will be described with reference to
When, in
Described above in the first embodiment are a case where the number of projectors and the number of wireless communication paths agree and a case where the number of projectors is greater than the number of wireless communication paths. However, this does not impose any limitation and it is permissible for the number of wireless communication paths to be greater than the number of projectors.
Thus, in accordance with this embodiment, the qualities of video that is output from each of the video output devices can be substantially equalized and uniformalized even if the transmission rates on some communication paths decline. Further, since video quality is decided based upon the transmission rates of all multiple communication paths and video transmitted on each communication path is decided, communication paths can be utilized efficiently and the quality of output video can be improved. For example, in a case where video images output from each of the video output devices are joined together to provide a large-screen image, the conspicuousness of the boundary due to the qualities of each of the images can be reduced. Further, a decline in overall video quality can be suppressed in a case where the video images output from each of the video output devices are superimposed to improve luminance and provide 3D video.
Next, reference will be had to
In the second embodiment, the transmitter 111 and receiver 121 have been inserted for the purpose of substituting a data transmission line between the data distributor 101 and the projector 141. Further, the transmitter 112 and receiver 122 also have been inserted for the purpose of substituting a data transmission line between the data distributor 101 and the projector 142.
In this arrangement, the data distributor 101 distributes video data so that the projectors 141, 142 will have the same image quality. Further, as shown in
In order to investigate the initial states of the communication paths, the data distributor issues a test-signal transmission instruction that causes all of the connected transmitters to transmit test signals to all of the receivers (step 201). Next, in the second embodiment, the data distributor confirms that there are no severed routes in order to make all communication paths conform to the communication path of the minimum transmission rate (step 802). In a case where a severed communication path exists, the data distributor causes the transmission of the test signal to the transmitter of this path until the communication path is established. When there is no longer a severed route, the transmission rate of each communication path is ascertained from acknowledgement (Ack) received by all of the transmitters (step 202). It should be noted that, in the example described in
Next, when the respective transmission rates are ascertained from the acknowledgement (Ack) of all transmitters, the data distributor decides the video qualities of the projectors in conformity with the minimum transmission rate (step 803). The data distributor then inserts a header in front of the data sent to each transmitter (step 804). The header contains information such as the transmission rate decided. Next, the data distributor sends the video data, into which the header has been inserted, to each transmitter (step 206). The data distributor thenceforth returns to processing for determining whether there is no severed route and ascertains the transmission rate of each communication path from the acknowledgement (Ack) response to the video data transmitted by each transmitter.
Thus, the qualities of the video output from multiple video output devices can be uniformalized to conform with the transmission rates in a system in which multiple items of video data are transmitted by multiple wireless communication devices and the multiple items of video data are combined using multiple video output devices to display a single video image.
Further, although various methods of changing video throughput are conceivable, such as changing the size of the smallest pixel of video or changing the resolution of gradations of color, the manner in which video throughput is changed is outside the scope of application of the present invention.
Aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU or MPU) that reads out and executes a program recorded on a memory device to perform the functions of the above-described embodiment(s), and by a method, the steps of which are performed by a computer of a system or apparatus by, for example, reading out and executing a program recorded on a memory device to perform the functions of the above-described embodiment(s). For this purpose, the program is provided to the computer for example via a network or from a recording medium of various types serving as the memory device (e.g., computer-readable medium).
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2011-085651, filed Apr. 7, 2011, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2011-085651 | Apr 2011 | JP | national |