The present invention generally relates to subtitles and, more particularly, to a method, apparatus and system for implementing subtitles for 3D content.
For two-dimensional content, subtitles are usually placed in the same location, for example, at the bottom of a frame or sequence of frames. In contrast, for three-dimensional content, it makes sense to place the subtitles in a particular area of a frame or sequence of frames depending on the elements in the frame(s).
Another factor to consider for three-dimensional content is the disparity involved with displaying three-dimensional content. More specifically, while in two-dimensional content both eyes receive the same frame, for three-dimensional content each eye receives a different frame. As such, the subtitles for three-dimensional content can be rendered in different positions on the horizontal axis. The difference of horizontal positions is called disparity.
As such, because there are many more variables that have to be controlled and taken into account, providing subtitles for three-dimensional content is much more complicated than for two-dimensional content.
Embodiments of the present invention address the deficiencies of the prior art by providing a method, apparatus and system for providing subtitles for stereoscopic content. In various embodiments of the present invention, a system of the present invention enables an operator to locate the subtitles for a stereoscopic image and to choose the disparity of stereo subtitles to ensure proper display.
In one embodiment of the present invention, the functionality of the concepts of the present invention is based on a player capable of displaying stereo content by reading two streams (one for the left view, one for the right view) and mixing the streams in real time using a mode supported on a 3D display (i.e. line interleaved, checkerboard pattern) based on received file information.
More specifically, in one embodiment of the present invention, a method for the positioning of subtitles in three-dimensional content includes receiving at least one left-eye view frame of three-dimensional content in which a subtitle is to be inserted, receiving at least one corresponding right-eye view frame of the three-dimensional content in which a subtitle is to be inserted, receiving file information identifying a subtitle to be inserted into the frames and at least a respective position in the frames for inserting the subtitle and providing a means for inserting the subtitle in the frames by rendering the values in the received file information and for real-time manipulation of the position of the subtitle in the frames by altering values in the received file information. The method can further include mixing the subtitled at least one left-eye view frame with the subtitled at least one right-eye view frame.
In an alternate embodiment of the present invention, a subtitling device for positioning of subtitles in three-dimensional content includes a memory for storing program routines and data files and a processor for executing program routines. In such an embodiment of the present invention, the processor, when executing the program routines, is configured to perform the steps of inserting a subtitle in at least one left-eye view frame and at least one corresponding right-eye view frame of the three-dimensional content by rendering values in a file containing information identifying a subtitle to be inserted into the frames and at least a respective position in the frames for inserting the subtitle, and performing real-time manipulation of the position of the subtitle in the frames by altering values in the file.
In an alternate embodiment of the present invention, a system for positioning of subtitles in three-dimensional content includes a source of at least one left-eye view frame of the three-dimensional content in which a subtitle is to be inserted, a source of at least one right-eye view frame of the three-dimensional content in which a subtitle is to be inserted, and a subtitling device for receiving at least one left-eye view frame of the three-dimensional content in which a subtitle is to be inserted, receiving at least one right-eye view frame of the three-dimensional content in which a subtitle is to be inserted, receiving file information identifying a subtitle to be inserted into the frames and at least a respective position in the frames for inserting the subtitle, and inserting the subtitle in the frames by rendering the values in the received file information and for real-time manipulation of the position of the subtitle in the frames by altering values of the received file information.
The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which:
a depicts a representative diagram of a subtitle inserted in left and right views of a stereoscopic image in accordance with an embodiment of the present invention;
b depicts a more detailed diagram of the subtitle inserted in the left and right views of the stereoscopic image of
It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention. To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures.
The present invention advantageously provides a method, apparatus and system for providing subtitles for stereoscopic content. Although the present invention will be described primarily within the context of providing subtitles for three-dimensional content using an information file, the specific embodiments of the present invention should not be treated as limiting the scope of the invention. It will be appreciated by those skilled in the art and informed by the teachings of the present invention that the concepts of the present invention can be applied to substantially any stereoscopic image content and receiving information regarding the subtitle in other forms in addition to a file structure.
The functions of the various elements shown in the figures can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage. Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure).
Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative system components and/or circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
As previously mentioned, adding subtitles to stereoscopic content, such as three-dimensional (3D) content is much more complicated than adding subtitles to two-dimensional content. For example, for 3D content, it makes sense to place the subtitles in a particular area of a frame or sequence of frames depending on the elements/objects in the frame(s) such that the subtitles are not blocked. In addition, for 3D content, the disparity involved with displaying the 3D content has to be taken into account. As such, the subtitles for three-dimensional content can be rendered in different positions on the horizontal axis.
In the system 100 of
As depicted in the system 100 of
Subtitle image file (e.g., a TIFF file).
Timestamps (initial and final).
Position (X, Y).
Disparity (Z).
That is, in one embodiment of the present invention, the stereo subtitle device receives stereoscopic images and information regarding a subtitle and a location and position in the received stereoscopic images in which a subtitle(s) is to be inserted. The received information further includes disparity information for the stereoscopic images. In one embodiment of the present invention, the received information takes the form of a control file and is communicated along with the stereoscopic images. In alternate embodiments of the present invention, the control information is communicated inside the stereoscopic images as metadata. In alternate embodiments of the present invention, such control information can be stored in a local or remote storage medium or device such that when the stereo subtitle device of the present invention receives stereoscopic images, the stored information can be compared to information identifying the received images to determine if any of the stored control information files are data that is meant to be applied to received stereoscopic content.
In accordance with the concepts of embodiments of the present invention, the stereo subtitle device of the present invention utilizes received control file information to locate subtitles in received stereoscopic images. In one embodiment of the present invention, the control file information can be utilized to initially locate subtitles in stereoscopic images in which no previous subtitles have been inserted or, in yet alternate embodiments of the present invention, the received control file information can be utilized to adjust a position of subtitles already existing in received stereoscopic images. For example, in the system 100 of
Again, although the subtitle device 115 of
The concepts of the present invention enable an operator/user to manipulate the position and disparity of the subtitles in real time by manipulating the values in the information/control file. Such an application in accordance with the concepts of the present invention achieves better results in the placement and look of subtitles for stereoscopic content and results in a faster process compared with former techniques of subtitling 3D content, because an operator/user can immediately see how changes in the values of the information file affect the final result of the subtitles in the stereoscopic image.
For example,
The GUI of
More specifically, in one embodiment of the present invention, a safe subtitle area can be configured on the frames of stereoscopic content. When such an area is designated by, for example, using the GUI of
As depicted in
In addition, when a frame size of content is larger than the rendering window (e.g., 2048×1200 and 1920×1080), only the content under a viewport is rendered. In one embodiment of the present invention, the user can change the viewport in real time. In one exemplary embodiment of the present invention, the motion granularity on the vertical axis is 2 pixels to avoid changing the views (i.e. when using line-interleaved mode, a change on the views will carry to invert the disparity on the screen).
In accordance with various embodiments of the present invention, a stereo subtitle device 115 of the present invention, via for example the GUI of
In one embodiment of the present invention, the information determined and received by the stereo subtitle device 115 is communicated to the mixer 125 and/or the renderer 130 for processing the stereoscopic images and subtitles for display.
Although in the system 100 of
a depicts a representative diagram of a subtitle inserted in left and right views of a stereoscopic image in accordance with an embodiment of the present invention. More specifically, as depicted in
b depicts a more detailed diagram of the subtitle inserted in the left and right views of the stereoscopic image of
At step 504, file information identifying a subtitle to be inserted into the frames and at least a respective position in the frames for inserting the subtitle is received. The method 500 then proceeds to step 506.
At step 506, a means is provided for inserting the subtitle in the frames by rendering the values in the received file information and for real-time manipulation of the position of the subtitle in the frames by altering values in the received file information. The method 500 can then be exited.
In accordance with the concepts of the present invention, a user can optionally set an offset to be applied to the control file information, using, for example, the GUI of
Having described various embodiments for a method, apparatus and system for providing subtitles for stereoscopic content (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention. While the forgoing is directed to various embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof.
This application claims the benefit of U.S. Provisional Application No. 61/307,779, filed Feb. 24, 2010.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2010/003150 | 12/13/2010 | WO | 00 | 5/2/2013 |
Number | Date | Country | |
---|---|---|---|
61307779 | Feb 2010 | US |