The present invention is related to an image playback device and a display device for playing back content data so that a viewer views stereoscopic images.
Technologies for providing a viewer with stereoscopic images have been proposed due to development of video image technologies in recent years. Content data for presenting a viewer with stereoscopic images generally include a left image which is viewed by the left eye and a right image which is viewed by the right eye. For example, the left image represents an image displayed in a vision field expanding from a view point at the left eye of the viewer and the right image represents an image displayed in a view field expanding from a view point at the right eye of the viewer.
If content data are played back, these images are alternately displayed on a display. Meanwhile, the viewer wears a dedicated eyeglass device to view the stereoscopic images on the display. While the left image is displayed on the display, the eyeglass device shuts off light transmission to the right eye whereas the eyeglass device permits light transmission to the left eye. While the right image is displayed on the display, the eyeglass device shuts off light transmission to the left eye whereas the eyeglass device permits light transmission to the right eye. The viewer processes a difference (parallax) between the displayed images onto the retinas of the right and left eyes in the brain to perceive objects popping up or deeps in. If the parallax amount is small, the image is perceived as being situated close to the display surface. If the parallax amount is large, the image is perceived as being situated at a distant position from the display surface. Therefore, the viewer may stereoscopically view the objects in the displayed images on the display.
Like the playback of content data for presenting normal two-dimensional images, there are needs for fast playback of the content data for presenting stereoscopic images as well. In the fast playback which is carried out to figure out a playback point for viewing in the normal playback, video images of the content data are played back without audio at a faster speed than the standard playback speed, which depends on a recording medium to store the content data. In such a fast playback mode, if stereoscopic images are instantly displayed, changes in the parallax amount become extremely rapid, so that it becomes less likely that the viewer stereoscopically perceives objects in the content data. In particular, if the content data is a movie, it becomes less likely that the viewer perceives motion of the objects in the content.
Patent Document 1 proposes technologies to display a video as two-dimensional images in the fast playback mode, in order to resolve such problems. According to the disclosed technologies in Patent Document 1, content data are played back as two-dimensional video images during the fast playback mode for facilitating to comprehend the movement of objects in the content data.
It may be other needs than the aforementioned playback of the content data at the standard or fast playback speed for the image playback devices such as DVD players and Blu-ray players to playback the content data under a quick view playback mode. In the quick view mode, which is suitable for the viewer to enjoy the actual content rather than for finding a point for viewing in the normal playback, the content data are generally played back at a faster speed than the standard playback speed but at a slower speed than the fast playback speed with audio associated with the images. The viewer may comprehend the details of the content in a shorter time under the quick view playback mode than the standard playback speed mode and listen to the audio included in the content data, which are not played back under the fast playback mode. For example, existing image playback devices have playback modes at 1.3 times and 1.5 times as high as the standard playback speed of the content data, as the quick view playback mode.
In the disclosed technologies in Patent Document 1, if a viewer wants to play back the content data under the quick view playback mode, the video images are two-dimensionally displayed, which results in insufficient presentation of the contents included in the content data to the viewer. Alternatively, if the content data are played back as stereoscopic video images without any modification, temporal variations in the parallax amount between left and right image frames which are displayed on the display become too large. Therefore it becomes likely that the large temporal variations cause strain on the viewer's eyes.
It is an object of the present invention to provide an image playback device and a display device which allow a viewer to comprehend details of contents in a relatively short period of time with little strain on the viewer's eyes while the viewer views stereoscopic objects in the content data.
An image playback device according to one aspect of the present invention comprises: a playback portion which plays back content data to make a video stereoscopically viewed by means of video data including a first image for a first view point and a second image for a second view point; a setting portion configured to set a playback speed for playing back the content data; and an adjuster configured to adjust parallax information about parallax between the first and second images in response to the playback speed set by the setting portion.
A display apparatus according to another aspect of the present invention comprises: a playback portion which plays back content data to make a video stereoscopically viewed by means of video data including a first image for a first view point and a second image for a second view point; a display portion configured to display the video data; a setting portion configured to set a playback speed for playing back the content data; and an adjuster configured to adjust parallax information about parallax between the first and second images in response to the playback speed set by the setting portion.
A video system according to the first embodiment is described with reference to the accompanying drawings.
The video system 1 has a television device 2 exemplified as the display device, and an eyeglass device 3 for assisting in viewing video images displayed by the television device 2. The television device 2 comprises a display device 21 which displays video images, an image playback device 23 which outputs a stereoscopic video signal to the display device 21, and a remote controller 25 which is used for operating the image playback device 23 and/or the display device 21. The remote controller 25 includes several buttons 251 which are used for inputting desired instructions to the image playback device 23 and/or the display device 21, and a transmitter 252 which transmits instructions that are input by the viewer as control signals to the image playback device 23 and/or the display device 21. For example, the control signal may be sent as an infrared signal or an RF signal, or may be sent by other methodologies to transmit an instruction desired by the viewer to the image playback device 23 and/or the display device 21. In the present embodiment, the viewer may operate the remote controller 25 to control a playback speed of the image playback device 23.
The image playback device 23 comprises a storage portion 231 which stores a storage medium such as a DVD disk or Blu-ray disk (not shown in
The display device 21 comprises a display panel 211 which is used as the display portion for displaying a stereoscopic video signal as the stereoscopic video image, a speaker 212 which is used as an audio output portion to output an audio signal as sound, and a transmitter 213 which outputs a synchronization signal to synchronize operations of the eyeglass device 3 with the video frames displayed on the display panel 211. For example, the display panel 211 alternately displays the right and left image frames. The speaker 212 outputs sound corresponding to the video displayed on the display panel 211. For example, the transmitter 213 outputs a synchronization signal in synchronism with the switching operation between the left and right image frames. A device which employs a plasma display panel, a liquid crystal panel or a CRT, a device using organic electroluminescence or another device which allows a viewer to view video images in response to the stereoscopic video signal may be used as the display panel 211. The synchronization signal may be sent as an infrared beam or an RF signal or by any other methodologies to transmit the synchronization signal to the eyeglass device 3.
The eyeglass device 3 looks like eyeglasses for correcting eyesight. The eyeglass device 3 comprises an optical filter portion 33 including a left filter 31 which is situated in front of the viewer's left eye and a right filter 32 which is situated in front of the viewer's right eye if the viewer wears the eyeglass device 3, and a receiver 34 which is situated between the left and right filters 31, 32. The left and right filters 31, 32 may optically adjust light amounts transmitted to the left and right eyes. For example, the left and right filters 31, 32 may shut off optical paths of the light transmission to the left and right eyes, respectively, or may deflect the light transmitted to the left or right eye, in order to adjust the light amount. Liquid crystal elements may be used for such a kind of the left and right filters 31, 32.
The receiver 34 receives the synchronization signal transmitted by the display device 21. The eyeglass device 3 controls the optical filter portion 33 in response to the synchronization signal. As a result of the control in response to the synchronization signal, the light from the image frame is transmitted to the viewer's left eye via the left filter 31 during the display of the left image frame on the display panel 211 whereas the light amount reaching the viewer's right eye is decreased by the right filter 32. The light from the image frame is transmitted to the viewer's right eye via the right filter 32 during the display of the right image frame on the display panel 211 whereas the left filter 31 decreases the light amount reaching the viewer's left eye. Thus, the viewer views the left and right image frames with the left and right eyes, respectively, so that objects in the left and right images of the video data are stereoscopically (three-dimensionally) perceived by the viewer. The object is stereoscopically perceived or viewed by the viewer to be popping up toward the viewer from the display panel or to be deepened into the display panel.
The upper drawings in the sections (a) to (c) of
In the left and right images shown in the sections (a) to (c) of
As shown in the section (a) of
If the object OL in the left image is positioned in the right region of the display panel 211 whereas the object OR in the right image is positioned in the left region of the display panel 211 as shown in the section (b) of
If the object OL in the left image is positioned in the left region of the display panel 211 whereas the object OR in the right image is positioned in the right region of the display panel 211 and if the parallax between the positions of these objects OL, OR is “X2” (where X2 is a negative value) as shown in the section (c) of
As shown in the sections (a) to (c) of
In the present embodiment, the differences X1, X2 between the positions of the objects OL, OR (i.e., the parallax amount) are exemplified as the parallax information about parallax. Alternatively, the parallax information may be other parameters to increase or decrease the distance from the display panel 211 or the display surface, which displays the objects OL, OR, to the object F as perceived by the viewer. The term “increase the parallax amount” used in the present embodiment means increasing the difference in the positions of the objects OL, OR to cause a longer distance from the display surface to the object F (the pop-up or deep-in volume Y1, Y2). Alternatively, a parameter (parallax information) other than the parallax amount may be adjusted in order to increase the distance from the display surface to the object F (the pop-up or deep-in volume Y1, Y2). The term “decrease the parallax amount” which is used in the present embodiment means decreasing the difference in the positions of the objects OL, OR to cause a shorter distance from the display surface to the object F (the pop-up or deep-in volume Y1, Y2). Alternatively, a parameter (parallax information) other than the parallax amount may be adjusted in order to decrease the distance from the display surface to the object F (the pop-up or deep-in volume Y1, Y2). For example, it may be exemplified as adjustment of parameters other than the parallax amount to apply a shadow to an object by processing the video signal, change brightness of the object itself or change colors of the object. Such various methodologies may contribute to the adjustment of the distance perspective of the viewer.
It is empirically known that an increase in the distance from the display panel 211 to the object F increases strain on the viewer's eyes. It is empirically known that an increase in positional change speed of the object F increases the strain on the viewer's eyes if the left and right image frames are displayed on the display panel 211 so as to change a position of the object F from the position of the object F shown in the section (b) of
In the present embodiment, for example, the display device 21 displays the left and right image frames at a frame rate of 120 Hz (a total of 120 frames (which include the left and right image frames) per second are displayed). The standard playback speed is set to a playback speed at which the frames of the image signal on the recording medium may be output and displayed without skipping or holding. In the present embodiment, the standard playback speed is exemplified as the first speed. The playback of content data at the standard playback speed by the image playback device 23 is exemplified as the first mode.
In the present embodiment, the quick view playback speed is set to a playback speed, which is 1.3 times as high as the standard playback speed. Alternatively, the quick view playback speed may be set to another playback speed which is faster than the standard playback speed so as to allow the viewer to comprehend the details of the content data. In the present embodiment, one playback frame is skipped out of 1.3 frames in the quick view playback mode. If the frames in the medium are played back at a speed which is 1.3 times as high as the standard speed (120 frames per second), 156 playback frames per second are played back. In the quick view playback mode, one frame is skipped out of 1.3 frames, so that the display time of each playback frame is substantially as long as that of the standard playback. Thus, the output to the display device 21 becomes 120 frames per second. In the present embodiment, the quick view playback speed is exemplified as the second speed. The playback of the content data at the quick view playback speed by the image playback device 23 is exemplified as the second mode.
In the present embodiment, the fast playback speed is defined as a playback speed which is 2 times as high as the standard playback speed. Alternatively, the fast playback speed may be set as another playback speed which is faster than the quick view playback speed. In the present embodiment, in the fast playback mode, one playback frame is skipped out of 2 frames. Thus, the output to the display device 21 becomes 120 frames per second. The playback of the content data at the fast playback speed by the image playback device 23 is exemplified as the third mode.
In the present embodiment, an increase from the standard playback speed to the quick view playback speed or the fast playback speed is achieved by skipping the playback frames. Alternatively, the increase from the standard playback speed to the quick view playback speed or the fast playback speed may be achieved by shortening the display time of every playback frame.
As described with reference to
The storage portion 231 of the image playback device 23 stores the storage medium 233 in which content data such as video images and music videos are contained (e.g., a Blu-ray disk or a DVD disk). The image playback device 23 includes a medium controller 234 configured to control the recording medium 233. The medium controller 234 controls the drive device (not shown), which drives the storage medium 233, or the playback protocol such as the playback address setup procedures.
The receiver 232 receives the control signal from the remote controller 25 as described with reference to
The image playback device 23 includes the playback portion 236 which plays back the content data contained in the storage medium 233, an image signal processor 237 which processes the image signals generated in response to the video data included in the content data; an adjuster 238 which adjusts the parallax amount between the left and right images (e.g., the parallax amount X1, X2 described with reference to
The controller 235 may control the medium controller 234 and the playback portion 236 to switch the playback speed of the content data contained in the storage medium 233 to the standard playback speed, the quick view playback speed, which is faster than the standard playback speed, and the fast playback speed, which is faster than the quick view playback speed, in response to operations of the remote controller 25. In the present embodiment, the controller 235 is exemplified as the setting portion which sets the playback speed to play back the content data. The controller 235 selectively sets a playback mode at standard playback speed, the quick view playback speed or the fast playback speed, in response to operations of the remote controller 25 by the viewer.
In the present embodiment, the adjuster 238 adjusts the parallax amount between the left and right images in response to the playback speed controlled by the controller 235 (the standard playback speed, the quick view playback speed or the fast playback speed). Alternatively, the adjuster 238 may adjust another parameter (parallax information) for adjusting the pop-up or deep-in volume of the object F which is perceived by the viewer, in response to the playback speed (standard playback speed, quick view playback speed, fast playback speed).
The image playback device 23 may include an image generator 241 configured to generate a menu image so that the viewer may list the content data contained in the storage medium 233. The image generator 241 receives the control signal from the controller 235 via the bus 240. The image generator 241 then generates the menu image in response to the control signal.
The playback portion 236 reads out image data, which are subjected to the playback, from the video data of the content data, which are contained in the storage medium 233. The playback portion 236 then outputs image data 361 corresponding to the left image and image data 362 corresponding to the right image from the read image data to the image signal processor 237. The playback portion 236 also reads out audio data, which are subjected to the playback, from the content data contained in the storage medium 233. The playback portion 236 then outputs the audio data to the audio signal processor 239. The playback portion 236 also reads out auxiliary data about the image data, which are subjected to the playback, from the content data contained in the storage medium 233. The playback portion 236 then outputs the auxiliary data to the controller 235 via the bus 240.
Optionally, the image signal processor 237 may execute expansion processes on compressive-encoding such as MPEG-2 or H.264, which is carried out during recording, and display quality adjustment processes to the image data 361, 362 corresponding to the left and right images output from the generator 236. The image data 371, 372 corresponding to the left and right images after these processes are output to the adjuster 238.
The menu image generated by the image generator 241 may be output to the image signal processor 237. The image signal processor 237 may directly output the menu image to the adjuster 238. Alternatively, the image signal processor 237 may superimpose a menu image on image data 371, 372 corresponding to the left and right images to output the data to the adjuster 238.
The adjuster 238 adjusts the parallax amount between the image data 371, 372 corresponding to the left and right images, which are output from the image signal processor 237 under the control of the controller 235. The image data 381, 382 corresponding to the left and right images after the adjustment of the parallax amount between them are output to the display panel 211 of the display device 21.
Optionally, the audio signal processor 239 performs audio signal processes such as equalizer processes on the audio data output from the processor 236. The audio signal processor 239 then outputs the audio signal 390 after the audio signal processes to the speaker 212 of the display device 21.
The display device 21 has a synchronization signal generator 215 used for synchronization control between the television device 2 and the eyeglass device 3. The synchronization signal generator 215 generates a synchronization signal for the eyeglass device 3 in response to the image signal output from the image playback device 23 to the display device 21, and then outputs the synchronization signal to the transmitter 213. The transmitter 213 outputs the synchronization signal, which is generated by the synchronization signal generator 215, to the receiver 34 of the eyeglass device 3.
The controller 235 of the image playback device 23 may output a mode control signal 242 to the synchronization signal generator 215. The mode control signal 242 may be omitted as appropriate, depending on the eyeglasses control method during a fast playback mode which is described hereinafter. For example, the mode control signal 242 may be output in response to machine control on the basis of HDMI CEC standards.
The eyeglass device 3 has the receiver 34, an internal signal generator 38, an optical filter controller 39 and the optical filter portion 33. The receiver 34 receives the synchronization signal sent from the transmitter 213 of the display device 21, converts the signal to an electrical timing-control signal, and outputs the converted signal to the internal signal generator 38.
The internal signal generator 38 generates an internal signal to control internal parts of the eyeglass device 3, respectively, in response to the timing control signal. The optical filter controller 39 controls operations of the left and right filters 31, 32 of the optical filter portion 33, in response to the internal signal which is generated by the internal signal generator 38. Accordingly, the left filter 31 permits light transmission to the viewer's left eye whereas the right filter 32 decreases a light amount transmitted to the viewer's right eye while the display panel 211 displays a video signal of the image data 381 corresponding to the left image. On the other hand, the right filter 32 permits light transmission to the viewer's right eye whereas the left filter 31 decreases a light amount transmitted to the viewer's right eye while the display panel 211 displays a video signal of the image data 382 corresponding to the right image. Consequently, the viewer may stereoscopically view the displayed objects OR, OL in the image data 381, 382 (as an object F), as described with reference to
Operations of the image playback device 23 during quick view playback are further described with reference to
If the viewer operates the remote controller 25 to instruct playback of the content data at the quick view playback speed, the controller 235 controls the playback portion 236, the image signal processor 237, the adjuster 238, the medium controller 234, the image generator 241 and the audio signal processor 239 via the bus 240 to play back the content data (image data and audio data) from the storage medium 233 at the quick view playback speed (e.g., a playback speed which is 1.3 times as high as the standard playback speed). The image signal playback portion 237 reduces images in the video data to output image data 371, 372 to the adjuster 238. Accordingly, temporal changes in the parallax amount become greater. The adjuster 238 executes processes for adjusting the parallax amount, so as to reduce the temporal changes in the parallax amount.
The sections (a) to (c) of
The parallax amount between the left and right images of the content data contained in the storage medium 233 is shown by the reference symbol “X3” in the section (a) of
If the image playback device 23 is designed to have a few playback speeds as the quick view playback speed, preferably, the trim regions TL, TR become larger as the playback speed increases. Thus, the parallax amount is adjusted to be smaller at a relatively fast quick view playback speed whereas the parallax amount is adjusted to be greater at a relatively slow playback speed. The widths of the trim regions TL, TR may be calculated and defined by means of a prescribed calculation formula which uses the playback speed as a parameter. Alternatively, a look-up table may be prepared for indicating the widths of the trim regions TL, TR corresponding to the quick view playback speeds, respectively. The adjuster 238 may select the trim regions TL, TR corresponding to a particular quick view playback speed, which is defined by viewer's operations of the remote controller 25, from the trim regions TL, TR prepared in the look-up table.
Preferably, the trim region TL corresponding to the left image has the same width as the trim region TR corresponding to the left image, which results in few differences between the positions of the object as stereoscopically perceived by a viewer during the playback at the standard playback speed and the quick view playback speed. The image shift process described with reference to
The parallax amount between the left and right images of the content data contained in the storage medium 233 is shown by the reference symbol “X3” in the section (a) of
If the image playback device 23 is designed to have a few playback speeds as the quick view playback speed, preferably, the image contraction rate by the adjuster 238 becomes greater as the playback speed becomes faster. Accordingly, the parallax amount is adjusted to be smaller at a relatively fast quick view playback speed. The parallax amount is adjusted to be greater at a relatively slow playback speed. The image contraction rate by the adjuster 238 may be calculated and defined by means of a prescribed calculation formula which uses the playback speed as a parameter. Alternatively, a look-up table may be prepared for indicating image contraction rates corresponding to the quick view playback speeds, respectively. The adjuster 238 may select the image contraction rate corresponding to a particular quick view playback speed, which is defined by viewer's operations of the remote controller 25, from the image contraction rates prepared in the look-up table.
In the processes shown in the sections (a) to (c) of
The movement of the object in the image is further described with reference to the sections (a) to (c) of
The changing portion may calculate a reference convergence angle θr between the left and right eyes L, R which view the object F on the display panel 211, in response to the positional difference X1 or X2 between the objects OL, OR in the left and right images included in the content data. The changing portion may calculate the convergence angle θ1 or θ2 between the left and right eyes L, R under X1 or X2 of the positional difference between the objects OL, OR, in response to the values X1 or X2 of the positional difference between the objects OL, OR. The changing portion may move the objects OL, OR by the methodologies described with reference to the sections (a) to (d) of
The adjuster 238 may select particular objects from several objects displayed in the first and second images to process the selected image as described with reference to the sections (a) to (d) of
The object identification portion may select an object to move on the basis of a threshold value which is defined for the distance from the display panel 211 to the object perceived by the viewer.
The object identification portion selects the objects F3, F4 which are closer to the viewer than the line representing the threshold value T1 and the objects F5, F6, which are more distant from the viewer than the line representing the threshold value T2, to move them. The changing portion changes the display positions of the selected objects F3, F4, F5, F6 by means of the methodologies described with reference to the sections (a) to (c) of
The object identification portion may select and move objects in response to the object display positions on the display panel 211. The object identification portion may identify the display region of the objects on the display panel 211 as three regions which are horizontally divided (left region, central region and right region) as shown in
In
The object identification portion selects and moves the objects F2, F3 displayed in the central region. The changing portion changes the display positions of the selected objects F2, F3 by means of the methodologies described with reference to the sections (a) to (c) of
The object identification portion may select and move objects in response to the object display size on the display panel 211.
The changing portion changes the display positions of the selected objects F1, F2 by means of the methodologies described with reference to the sections (a) to (c) of
The priority sequence used by the object identification portion described with reference to
If the viewer operates the remote controller 25 to instruct the quick view playback, the playback portion 236 plays back all of the audio data in the content data contained in the storage medium 233 to output the audio data to the audio signal processor 239 like the playback at the standard playback speed. As a comparison between the audio data shown in
As shown in
As shown in
As shown in
Operation of the image playback device 23 during the fast playback mode is described with reference to
If the viewer operates the remote controller 25 to instruct the playback of the content data at the fast playback speed, the controller 235 controls the playback portion 236, the image signal processor 237, the adjuster 238, the medium controller 234, the image generator 241 and the audio signal processor 239 via the bus 240 to play back the content data (image data and audio data) from the storage medium 233 at the fast playback speed (e.g., a playback speed 2 times as high as the standard playback speed). The image signal playback portion 237 reduces the images in the video data to output the image data 371, 372 to the adjuster 238. Accordingly, the temporal changes in the parallax amount become greater.
The adjuster 238 outputs one of the left and right images data 381, 382 to the display device 21 during the playback of the content data at the fast playback speed. Accordingly, the display device 21 displays one of the left and right image data 381, 382. Alternatively, the image signal processor 237 may output one of the left and right image data 371, 372 to the adjuster 238. Consequently, the adjuster 238 outputs one of the left and right image data 381, 382 to the display device 21, so that the display device 21 displays one of the left and right image data 381, 382. Further alternatively, the adjuster 238 may adjust the left and right images so that the parallax amount between the left and right images becomes “0” by means of the methodologies described with reference to
If the content data are played back at the fast playback speed, the audio signal processor 239 executes processes for stopping the output of the audio signal to the display device 21. Alternatively, if the content data are played back at the fast playback speed, the playback portion 236 does not play back the audio data. Accordingly, the viewer views the video, which is two-dimensionally displayed on the display panel 211, without hearing sound.
As described above, the adjuster 238 outputs one of the left and right image signals to set the parallax amount to “0” during the fast playback mode. Thus, if the display device 21 and the eyeglass device 3 carry out the same operations as those during the normal playback mode and the quick view playback mode, the viewer may view a two-dimensional image. In this case, the mode control signal 242 described with reference to
The synchronization signal generator 215 receives information about operation of the image playback device 23 under the fast playback mode by means of the mode control signal 242 to generate a synchronization signal, of which waveform is different from the waveform used for the quick view playback mode. The synchronization signal generator 215 generates the synchronization signal which causes the eyeglass device 3 to open and close the left and right filters 3132 at the same timing during the fast playback mode. The transmitter 213 sends the synchronization signal to the receiver 34 of the eyeglass device 3.
The internal signal generator 38 of the eyeglass device 3 generates an internal signal for controlling the optical filter controller 39 to make the same image viewed by the left and right eyes, in response to the waveform of the synchronization signal. The optical filter controller 39 executes control for opening and closing the left and right filters 31, 32 at the same timing, in response to the internal signal. For example, if both filters open at the timing synchronized with the left image, the viewer views the left image with both the right and left eyes. Thus, the viewer views the video two-dimensionally displayed on the display panel 211.
If the viewer operates the remote controller 25 to send a control signal to the image playback device 23, the controller 235 determines whether the fast playback mode is instructed in response to the control signal or not. If the controller 235 determines that the fast playback mode is instructed, step S110 is executed. Unless the controller 235 determines that the fast playback mode is instructed, step S120 is executed.
If the controller 235 determines that the fast playback mode is instructed, the controller 235 controls the playback portion 236, the image signal processor 237, the adjuster 238, the medium controller 234 and the image generator 241 via the bus 240 to play back the content data contained in the storage medium 233 at the fast playback speed.
As described above, if the content data are played back at the fast playback speed, the image signal processor 237 reduces the left and right image data 371, 372, respectively, under the control of the controller 235, and then outputs the data to the adjuster 238. The adjuster 238 outputs one of the left and right image data 381, 382 to the display device 21 under the control of the controller 235. Alternatively, the image signal processor 237 may output one of the left and right image data 371, 372 to the adjuster 238 under the control of the controller 235. The adjuster 238 may output one of the left and right image data 371, 372, which are output from the image signal processor 237, to the display device 21 under the control of the controller 235. Accordingly, the adjuster 238 outputs one of the left and right image data 371, 372 to the display device 21. The image data output from the adjuster 238 to the display device 21 may be determined in advance or through operations performed by the viewer using the remote controller 25.
The controller 235 also controls the playback portion 236 to stop the playback portion 236 from executing the playback of the audio data. Alternatively, the controller 235 may cause the playback portion 236 to play back the audio data while the controller 235 prevents the audio signal processor 239 from outputting the audio data. Accordingly, the viewer views the video two-dimensionally displayed on the display panel 211 without hearing sound.
In step 100, unless it is determined that the control signal indicates the fast playback mode, step 120 is executed. At step 120, the controller 235 determines whether or not the control signal indicates the playback of the content data at the quick view playback speed. If the controller 235 determines that the playback at the quick view playback speed is instructed, the step 130 is executed. Unless the controller 235 determines that the playback at the quick view playback speed is instructed, step 140 is executed.
If the controller 235 determines that the playback at the quick view playback speed is instructed, the controller 235 controls the playback portion 236, the image signal processor 237, the adjuster 238, the medium controller 234 and the image generator 241 via the bus 240 to play back the content data (video data and/or audio data) contained in the storage medium 233 at the quick view playback speed.
As described above, if the content data are played back at the quick view playback speed, the image signal processor 237 decreases the left and right image data 371, 372, respectively, under the control of the controller 235, and then outputs the data to the adjuster 238. The adjuster 238 then detects the parallax amount between the left and right image data 371, 372 under the control of the controller 235 to reduce the parallax amount. The decrease in the parallax amount is achieved by means of the methodologies described with reference to
In step S120, unless the controller 235 determines that the control signal instructs the quick view playback, step S140 is executed. At step S140, the controller 235 controls the playback portion 236, the image signal processor 237, the adjuster 238, the medium controller 234 and the image generator 241 via the bus 240 to play back the content data (video data and/or audio data) contained in the storage medium 233 at the standard playback speed.
(Mode Change from Fast Playback Mode to Standard Playback Mode)
If the viewer operates the remote controller 25 to change the mode from the fast playback mode to the standard playback mode, the image signal processor 237 outputs frames of the image signals in the recording medium to the adjuster 238 without skipping under the control of the controller 235. The adjuster 238 outputs the left and right image data 381, 382 to the display device 21 under the control of the controller 235.
(Mode Change from Fast Playback Mode to Quick View Playback Mode)
If the viewer operates the remote controller 25 to change the mode from the fast playback mode to the quick view playback mode, the image signal processor 237 decreases the left and right image data 371, 372, respectively, and then outputs the data to the adjuster 238 under the control of the controller 235. The adjuster 238 then detects the parallax amount between the left and right image data 371, 372 under the control of the controller 235 to reduce the parallax amount. The decrease in the parallax amount is achieved by means of the methodologies described with reference to
(Mode Change from Quick View Playback Mode to Standard Playback Mode)
If the viewer operates the remote controller 25 to change the mode from the quick view playback mode to the fast playback mode, the image signal processor 237 outputs the frames of the image signals in the recording medium to the adjuster 238 without skipping under the control of the controller 235. The adjuster 238 outputs the left and right image data 381, 382 to the display device 21 under the control of the controller 235. In this case, the adjuster 238 does not adjust the parallax amount of the left and right image data 371, 372 which are input from the image signal processor 237. Therefore, there is a parallax amount between the left and right image data 381, 382, which are output from the adjuster 238 in response to the content data in the storage medium 233. Accordingly, in the standard playback mode, the viewer may view an object having large pop-up and/or deep-in volumes in comparison to the quick view playback mode.
Like the playback portion 236 described in the context of the first embodiment, the playback portion 236A reads out the image data, which are played back, from video data of the content data contained in the storage medium 233. The playback portion 236A then outputs the read image data 360 to the image signal processor 237A. The image data 360 include parallax amount data “X” to generate the left and right image data 381, 382, in addition to the image data displayed on the display panel 211.
Like the image signal processor 237 described in the context of the first embodiment, the image signal processor 237A applies expansion processes for compressive encoding such as MPEG-2 and H.264 during recording and adjustment processes for the image display to the image data 360. The image data 370 after these processes are output to the adjuster 238A.
The adjuster 238A generates left and right image data 381, 382 in response to the image data 370 which are output from the image signal processor 237A. In the standard playback mode, the adjuster 238A generates the image data 381, 382, in which the display position of the object O in the image data 370 is shifted by a parallax amount “X”, in response to the parallax amount data included in the image data 370. The object is horizontally shifted but the shift direction is different between the left and right image data 381, 382.
The adjuster 238A generates the image data 381, 382, in which the display position of the object O in the image data 370 is horizontally shifted by a smaller parallax amount “Xa” than the parallax amount “X” defined by the parallax amount data of the image data 370. A reduction rate of the shift amount “Xa” of the display position of the object O in the quick view playback mode with respect to the shift amount “X” of the display position of the object O in the standard playback mode is appropriately determined in response to the play back speed difference between the standard playback mode and the quick view playback mode. In the present embodiment, the parallax amount data included in the image data 370 are exemplified as the parallax information. The methodologies described with reference to
The adjuster 238A may reduce the image data 381, 382 so that the reduced parallax amount “Xa” is obtained in the quick view playback mode. Alternatively, if parallax amount data are assigned to the objects included in the image data 370, respectively, the adjuster 238A may individually shift the objects. Further alternatively, the adjuster 238A may select the objects to be moved in response to the parallax amount data allocated to each object.
In the second embodiment, the object O in the image data 370 is horizontally shifted in the image data 381, 382 in response to the parallax amount data of the image data 370. Alternatively, the parallax amount data included in the image data 370 may express a shift amount associated with one of the image data 381, 382. For example, if the parallax amount data in the image data 370 expresses a shift amount for the object OL in the left image data 381, the adjuster 238A shifts the object OL in response to the parallax amount data to generate the left image data 381. The adjuster 238A may depict the object OR at a position substantially equal to the object O represented in the image data 370 to generate the right image data 382.
In the aforementioned embodiment, a speed of two or more times as high as the standard playback mode is exemplified as the fast playback mode. In the fast playback mode, the display panel 211 shows two-dimensional images. Alternatively, in a low rate fast playback at a playback speed of 2 times or 4 times as high as the standard playback speed, the viewer may view video images with a decreased parallax amount, which results from the methodologies described with reference to
In the first embodiment, the playback portion 236 reads in all of the images from the storage medium 233 during the fast playback. Alternatively, the playback portion 236 may selectively read in one of the left and right image data from the storage medium 233 during the fast playback.
In the aforementioned embodiment, an eyeglass device with a shutter system is employed as the eyeglass device 3 which assists in viewing the stereoscopic video images. Alternatively, an eyeglass device based on a deflection system may be used as the eyeglass device 3 which assists in viewing the stereoscopic video images.
The aforementioned image playback device 23 may comprise: a CPU (Central Processing Unit), a system LSI (Large Scale Integration), a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive) and a network interface. The image playback device 23 may comprise a driver configured to read out and write information from and to a portable recording medium such as a DVD-RAM, Blu-ray disk or SD (Secure Digital) memory card.
The configurations, arrangements or shapes and alike depicted in the drawings and the descriptions with reference to the drawings are intended to explain the principles of the aforementioned embodiments, and do not in any way limit the principles of the aforementioned embodiments. The content data shown in the aforementioned embodiments include video data for video images and/or audio data, etc. which are contained in a storage medium such as a Blu ray disk or a DVD disk. Alternatively, the content data may be video data and/or audio data which are provided via the Internet, broadcast radio waves or by other means. The image playback device shown in the aforementioned embodiment is a Blu-ray player or a DVD player for playing back a storage medium such as a Blu-ray disk or a DVD disk. Alternatively, the image playback device may be a personal computer which plays back the provided content data with or without storing the content data, or any other device having an image playback function. In the aforementioned embodiment, the television device exemplified as the display device includes the display device for displaying content data as video images and the image playback device are provided as separate units. Alternatively, the television device may include a display device and an image playback device which are integrated together. Apart from a television device which has functions for tuning broadcast waves, the display device may be a computer having a monitor, or any other device configured to display images.
In the aforementioned embodiment, the standard playback speed which depends on the storage medium storing the content data is exemplified as the first speed. Alternatively, the best playback speed at which the content data is preferably presented may be exemplified as the first speed. Further alternatively, a relatively low playback speed of the playback speeds which are provided by the image playback device may be used as the first speed. In the above embodiment, the quick view playback speed, which is a playback speed faster than the first speed and allows the viewer to understand the contents of the audio data, is exemplified as the second speed. Alternatively, a playback speed which allows the viewer to stereoscopically perceive objects represented by the video data included in the content data may be exemplified as the second speed. In the above embodiment, the quick view playback speed is 1.3 to 1.5 times as high as the standard playback speed. Alternatively, the quick view playback speed may be set to be faster than the standard playback speed but less than 2 times as high as the standard playback speed. In the aforementioned embodiment, a fast playback speed which is faster than a playback speed that allows the viewer to understand the contents of the audio data is described as the third speed. Alternatively, any playback speed which is faster than the second speed may be used as the third speed. In the above embodiment, the fast playback speed is 2 times as high as the standard playback speed. Alternatively, the fast playback speed may be greater than 2 times as high as the standard playback speed or less than 2 times as high as the standard playback speed. Further alternatively, the playback speed may be continuously increased and decreased. In this case, any speed in a variation range of the continuously changeable playback speed is exemplified as the first speed, any speed faster than the first speed is exemplified as the second speed, and any speed faster than the second speed is exemplified as the third speed.
The image playback device 23 according to the present embodiment has a television device 2 with the display device 21. Alternatively, the image playback device 23 may be incorporated into any image processing device such as a digital video camera, a digital recorder, a digital television, a game machine, an IP telephone or a portable telephone.
The controller 235 and/or other constituent elements of the image playback device 23 according to the present embodiment may be realized as programs which are installed on a HDD or ROM or alike (hereinafter, such a program is called an image playback program) to control the image playback device 23. The functions of the image playback device 23 may be realized by executing the image playback program, respectively.
The image playback program may be recorded on a recording medium which is read by a hardware system such as a computer system or an embedded system. The image playback program may be read out to another hardware system via a recording medium to execute and achieve the functions of the image playback device 23, respectively, by means of another hardware system. An optical recording medium (e.g., CD-ROM), a magnetic recording medium (e.g., a hard disk), a magneto-optical recording medium (e.g., a MO or alike) or a semiconductor memory (e.g., a memory card) are exemplified as a recording medium read by a computer system.
The image playback program may be stored in a hardware system which is connected to a network such as the Internet or a local area network. The program may be downloaded and executed in another hardware system via a network. Therefore, the functions of the image playback device 23 are achieved by means of another hardware system, respectively. A terrestrial broadcast network, a satellite broadcast network, PLC (Power Line Communication), a mobile telephone network, a wired communication network (for example, IEEE 802.3) and a wireless communication network (for example, IEEE802.11) are exemplified as the network.
The functions of the image playback device 23 may be achieved, respectively, by means of an image playback circuit which is installed in the image playback device 23 according to the present embodiment.
The image playback circuit may be formed in a programmable logic device such as a full-custom LSI, a semi-custom LSI such as an ASIC (Application Specific Integrated Circuit), a programmable logic device such as a FPGA (Field Programmable Gate Array) or CP LD (Complex Programmable Logic Device) or a dynamic reconfigurable device of which the circuit configuration is dynamically rewritten.
Design data for defining functions of the image playback device 23 in the image playback circuit, respectively, may be a program which is written in a hardware description language (hereinafter, called HDL program). Alternatively, the design data may be a gate-level net list which obtains an HDL program by logical synthesis. The design data may be macro cell information formed by adding layout information, process conditions and alike to a gate-level net list. The design data may be mask data which define dimensions, timings and alike. The exemplary hardware description language may be VHDL (Very High-speed integrated circuit Hardware Description Language), Verilog-HDL and SystemC.
The design data may be recorded on a recording medium which is read by a hardware system such as a computer system or an embedded system. The design data may be read out to another hardware system via a recording medium for the execution. The design data read into the other hardware system via the recording media may be downloaded to a programmable logic device via a download cable.
The design data may be stored in a hardware system which is connected to a network such as the Internet or a local area network. The design data may be downloaded and executed in another hardware system via a network. The design data acquired in another hardware system via such a network may be downloaded to a programmable logic device via a download cable.
Alternatively, the design data may be recorded on a serial ROM, so as to be transferable to an FPGA if current is passed. The design data recorded on the serial ROM may be directly downloaded onto a FPGA if current is passed.
The design data may be generated by a microprocessor and downloaded to a FPGA if current is passed.
The aforementioned embodiments mainly have the following configurations.
The image playback device according to one aspect of the aforementioned embodiments comprises: a playback portion which plays back content data to make a video stereoscopically viewed by means of video data including a first image for a first view point and a second image for a second view point; a setting portion configured to set a playback speed for playing back the content data; and an adjuster configured to adjust parallax information about parallax between the first and second images in response to the playback speed set by the setting portion.
According to the above configuration, the content data played back by the playback portion make the video stereoscopically viewed by means of the video data including the first and second images for the first and second view points, respectively. The setting portion sets the playback speed for playing back the content data. The adjuster adjusts the parallax information about the parallax between the first and second images in response to the playback speed set by the setting portion. Since the parallax information is adjusted in response to the playback speed, it becomes less likely that the viewer's eyes increasingly fatigue even if the content data are played back at a high playback speed so that the viewer may comprehend the details of the content in a relatively short time.
In the aforementioned configuration, preferably, the adjuster changes at least one perception volume of a pop-up volume and a deep-in volume of an object in the video data, which are perceived by a viewer viewing the content data, in response to the playback speed.
According to the aforementioned configuration, the adjuster changes the at least one perception volume of the pop-up or deep-in volume of an object in the video data, which are perceived by a viewer viewing the content data, in response to the playback speed. Consequently, even if the content data are played back at a high playback speed so that the viewer may comprehend the content details in a relatively short time, it becomes less likely that the viewer's eyes increasingly fatigue.
In the above configuration, preferably, the setting portion selectively sets a first mode for playing back the content data at a first speed, and a second mode for playing back the content data at a second speed which is faster than the first speed, and the adjuster adjusts the parallax information so that a change amount of the perception volume in the second mode is less than a change amount of the perception volume in the first mode.
According to the above configuration, the setting portion selectively sets the first mode for playing back the content data at the first speed and the second mode for playing back the content data at the second speed, which is faster than the first speed. The adjuster adjusts the parallax information so that the change amount in the perception volume in the second mode becomes smaller than the change amount in the perception volume in the first mode. In the second mode, the change amount of the perception volume becomes smaller to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the aforementioned configuration, preferably, the adjuster shifts at least one of the first and second images.
According to the above configuration, the adjuster, which adjusts the parallax information, shifts at least one of the first and second images. In the second mode, the viewer views the content data, in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the aforementioned configuration, preferably, the adjuster lessens the first and second images.
According to the aforementioned configuration, the adjuster, which adjusts the parallax information, lessens the first and second images. In the second mode, the viewer views the content data, in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the aforementioned configuration, preferably, the adjuster changes at least one of display positions of the object in the first and second images.
According to the aforementioned configuration, the adjuster, which adjusts the parallax information, changes at least one of the positions of the object in the first and second images. In the second mode, the viewer views the content data, in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the aforementioned configuration, preferably, the object includes a plurality of objects, and the adjuster selects an object to change the display position of the object based on the pop-up volume from a display surface to display the content data, the deep-in volume from the display surface, a display position of the object on the display surface and a display size of the object.
According to the above configuration, if the first and second images render several objects, the adjuster selects one object to change the display position of the object. The object is selected on the basis of at least one of the pop-up volume of the object from a display surface to display the content data, the deep-in volume of the object from the display surface, the display position of the object on the display surface and the display size of the object, which results in efficient and effective moderation of strain on the viewer's eyes.
In the aforementioned configuration, preferably, the adjuster includes: a segmentation portion configured to divide the first and second images into image segments, respectively; an image segment identification portion configured to identify image segments, which contribute to display of the object, among the image segments; and a changing portion configured to change a display position of image data included in the image segments which contribute to the display of the object.
According to the above configuration, the segmentation portion of the adjuster divides the first and second images, respectively, into several image segments. The image segment identification portion identifies the image segments which contribute to the display of the object. The changing portion changes the display position of the image data included in the image segments which contribute to the display of the object. In the second mode, the viewer views the content data in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the aforementioned configuration, preferably, the adjuster adjusts the parallax information so as to reduce an absolute value of a difference between a reference convergence angle of the first and second view points with respect to a display surface, on which the content data are displayed, and a convergence angle of the first and second view points with respect to the object included in the first and second images.
According to the aforementioned configuration, the adjuster adjusts the parallax information so as to reduce the absolute value of the difference between the reference convergence angle of the first and second view points with respect to the display surface on which the content data are displayed, and the convergence angle of the first and second view points with respect to the object included in the first and second images. In the second mode, the viewer views the content data in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the above configuration, preferably, the parallax information includes information about a difference between display positions of an object in the first and second images, and the adjuster adjusts the parallax information so as to reduce the difference in the display positions of the object between the first and second images.
According to the above configuration, the parallax information has the information about the difference between the display positions of the object in the first and second images. The adjuster adjusts the parallax information so as to reduce the difference in the display position of the object between the first and second images. In the second mode, the viewer views the content data in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
In the above configuration, preferably, the setting portion sets a third mode for playing back the content data at a third speed which is faster than the second speed, and the adjuster outputs one of the first and second images in the third mode.
According to the aforementioned configuration, in the third mode, the adjuster outputs one of the first and second images to play back the content data as a two-dimensional video.
In the aforementioned configuration, preferably, the image playback device further comprises an audio signal processor; and the content data include audio data; the playback portion plays back the audio data if the setting portion sets the playback speed of the content data to the first or second mode; the audio signal processor adjusts the audio data in response to the second speed, if the setting portion sets the playback speed of the content data to the second mode; and the playback portion does not play back the audio data, if the setting portion sets the playback speed of the content data to the third mode.
According to the aforementioned configuration, the playback portion plays back the audio data if the setting portion sets the playback speed of the content data to the first or second mode. If the controller sets the playback speed of the content data to the second mode, the audio signal processor adjusts the audio data in response to the second speed. If the controller sets the playback speed of the content data to the third mode, the playback portion does not play back the audio data. Thus, the viewer may hear the audio data and view content data in the first or second mode. In the third mode, the viewer views two-dimensional images without hearing sound.
The display apparatus according to another aspect of the aforementioned embodiments comprises: a playback portion which plays back content data to make a video stereoscopically viewed by means of video data including a first image for a first view point and a second image for a second view point; a display portion configured to display the video data; a setting portion configured to set a playback speed for playing back the content data; and an adjuster configured to adjust parallax information about parallax between the first and second images in response to the playback speed set by the setting portion.
According to the above configuration, the display portion configured to display content data, which are played back by the playback portion, may make the video stereoscopically viewed by means of the video data including the first and second images for the first and second view points, respectively. The setting portion sets the playback speed for playing back the content data. The adjuster adjusts the parallax information about the parallax between the first and second images in response to the playback speed set by the setting portion. Since the parallax information is adjusted in response to the playback speed, it becomes less likely that the viewer's eyes increasingly fatigue even if the content data are played back at a high playback speed so that the viewer may comprehend the details of the content in a relatively short time.
In the aforementioned configuration, preferably, the setting portion selectively sets a first mode for playing back the content data at a first speed, a second mode for playing back the content data at a second speed, which is faster than the first speed, and a third mode for playing back the content data at a third speed, which is faster than the second speed, and the adjuster causes the display portion to display only one of the first and second images in the third mode.
According to the aforementioned configuration, if content data are played back at the third speed, the viewer may two-dimensionally view the content data.
An image playback program for playing back content data to make a video stereoscopically viewed by means of video data including a first image for a first view point and a second image for a second view point, according to yet another aspect of the present invention causes an image playback device which plays back the content data to perform: a function of selecting a first mode for playing back the content data at a first speed, or a second mode for playing back the content data at a second speed, which is faster than the first speed; and a function of making an change amount of at least one perception volume of a pop-up volume or a deep-in volume of an object in the video, which is viewed by the viewer viewing the content data in the second mode, smaller than a change amount in the first mode.
According to the above configuration, the content data played back by the image playback program makes the video stereoscopically viewed by means of video data including the first and second images for the first and second view points. The image playback program may select the first and second modes for playing back the content data at the first speed or the second speed, which is faster than the first speed. In the second mode, the viewer views content data, in which the change amount in the perception volume is reduced in comparison to the change amount of the perception volume in the first mode to moderate strain on the viewer's eyes. The viewer viewing the first and second images of the content data in the second mode may stereoscopically perceive the video to comprehend the content details in a short time.
The principles according to the aforementioned embodiments may be used in an image playback device which plays back stereoscopic images and audio recorded on a recording medium. The aforementioned principles may be suitably used for a video player which plays back stereoscopic images from a recording medium such as a semiconductor memory or optical disk. The video player according to the aforementioned principles may cause few temporal changes in the parallax amount to suppress eye strain under quick view playback (for example, 1.3 times as high as a normal speed) or semi-fast playback.
Number | Date | Country | Kind |
---|---|---|---|
2009-298202 | Dec 2009 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2010/007088 | 12/6/2010 | WO | 00 | 1/26/2012 |