This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2007-086124, filed Mar. 29, 2007, the entire contents of which are incorporated herein by reference.
1. Field
One embodiment of the invention relates to a sub picture reproducing device, a sub picture reproducing method and a sub picture reproducing program to reproduce a sub picture to be used for a display of a subtitle, menu, etc., for example, in a digital versatile disk (DVD) format.
2. Description of the Related Art
As is known well, as regards the foregoing DVD format, a sub picture has been used to display subtitles to be superimposed on a main picture, a menu to selectively set reproduction content, etc. Especially, preparing sub pictures corresponding to subtitles in a plurality of languages by displaying the subtitles with the sub pictures enables displaying the sub pictures through the selection on the menu.
In this case, under the present circumstances, the sub pictures corresponding to the subtitles in a plurality of languages are each recorded on an optical disk as an independent plurality of sub picture streams. In reproduction, a user may reproduce the sub picture stream corresponding to the selected language by selecting the desired language on the menu.
Meanwhile, in the present situation, as regards a variety of television programs and video commercial message (CM), etc., subtitles are useful to enable the enjoyment of the program itself and to improve the understanding of a viewer. Further, subtitles are generally used with a certain type of content, especially that of a high entertainment value.
Jpn. Pat. Appln. KOKAI Publication No. 10-210504 discloses a configuration which enables a user to freely change the color tone of a sub picture set as a default by making it possible to selectively use a color pallet which has been set on the basis of a color code setting command, and a color pallet which has been freely changed and set by the user.
A general architecture that implements the various feature of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments of the invention and not to limit the scope of the invention.
Various embodiments according to the invention will be described hereinafter with reference to the accompanying drawings. In general, according to one embodiment of the invention, a sub picture reproducing device comprises an input unit configured such that a sub picture stream provided with display control information including sub picture pixel data to be displayed and color codes to specify display colors of the pixel data, a setting unit configured to set propriety of displays of the sub video pixel data for each of the color codes by operations to the sub picture stream input to the input unit, and a processing unit configured to apply prescribed decode processing to the sub picture stream input to the input unit and to control display inhibition to sub picture pixel data corresponding to color codes to which display inhibition is set by the setting unit.
Any one of the stream read from the optical disk 12 by the drive unit 13 and the stream read from the disk 14a by the HDD unit 14 is selected by a selector 15 to be supplied to a stream separation unit 16. The separation unit 16 separates an input stream into an audio stream, a main picture stream and a sub picture stream to output them together with system time clock (STC) information.
Of these streams, the audio stream is supplied to an audio decoder unit 17, applied with decode processing to be converted into audio data, and then, supplied to an output control unit 18. The main picture stream is supplied to a main picture decoder 19 to be applied with decode processing, converted into main picture data, and then, supplied to a mixing unit 20.
The mixing unit 20 multiplexes the input main picture data and sub picture data and outputs the multiplexed video data to the control unit 18. The control unit 18 synchronizes the input audio data and video data, outputs the audio data to a loud-speaker 23 from an audio output terminal 22, and outputs the video data to a monitor 25 from a video output terminal 24 to display video.
A control unit 26 integrally controls the whole operation of the device 11, including the aforementioned reproducing operation. The control unit 26 has a central processing unit (CPU) etc. built-in, which receives operation information from an operation unit 27 or operation information transmitted from a remote controller 28 and received by a light receiving unit 29, and controls each unit so as to reflect the operation content.
In this case, the control unit 26 utilizes a memory unit 30. The memory unit 30 includes mainly a read only memory (ROM) with a control program to be executed by the CPU built in the control unit 26 stored thereon, a random access memory (RAM) to provide an operation area for the CPU, and a non-volatile memory to store various items of setting information and control information.
The control unit 26 is connected to a sub picture control unit 31. The control unit 31 (see below for further details) is used for setting the propriety of displays for each color to be displayed of various sub pictures to be displayed in the same sub picture stream (e.g., subtitles etc.), namely for each specified color code. In other words, the control unit 31 controls to display a menu for setting the proprieties of displays of the sub pictures for each color code by a user, and actually displays or does not display the sub pictures on the basis of the content set by the menu.
Here,
The sub picture PXD is made by applying compression processing, for example, to bit map data of one horizontal line of a two-dimensional display screen in accordance with a run-length compression rule depicted in
Further, the display control sequence SP_DCSQ includes information SP_DCSQ_STM showing a start time of the SP_DCSQ (sub picture_display control sequence_start time), information SP_NXT_DCSQ_SA showing a head address of the next display control sequence SP_DCSQ (sub picture_next_display control sequence_start address), and one or more display control command SP_DCCMDs (sub picture_display control_commands).
The SP_DCCMD includes a display start timing forced setting command FSTA_DSP for forcibly setting display start timing of the sub picture PXD, a display start timing setting command STA_DSP for setting the display start timing of the PXD, a display stop timing setting STP_DSP for setting the display stop timing of the sub picture PXD, a color code setting command SET_COLOR for setting a color code of the sub picture PXD, a contrast setting command SET_CONTR for setting a contrast to the main picture of the sub picture PXD, a display area setting command SET_DAREA for setting a display area of the sub picture PXD, a PXD head address setting command SET_DSPXA for setting the head address of the sub picture PXD in the case of standard definition (SD), a color code/contrast change command CHG_COLCON for setting changes in the color code and the contrast of the sub picture PXD, a PXD head address setting command SET_DSPXA2 for setting the head address of the sub picture PXD in the case of HD, and a display control end command CMD_END for showing the end of the display control command SP_DCCMD.
That is to say, as shown in
Here, for example, it is assumed that three kinds of sub pictures; a first sub picture, of which the identification information ID is SP_0001 and the kind is original, a second sub picture, of which the identification information ID is SP_0002 and the kind is story A, a third sub picture, of which the identification information ID is SP_0003 and the kind is a story B, are recorded in the same sub picture stream as shown in
In the embodiment, the sub picture control unit 31 may set color codes and the propriety of their displays for each of the three kinds of sub pictures by associating the color codes with the propriety of the displays. That is, the first sub picture, of which the color code is specified by “0001b”, is set so that the display of the first sub picture is permitted (ON), the second sub picture, of which the color code is specified by “0010b”, is set so that the display of the second sub picture is inhibited (OFF), and the third sub picture, of which the color code is specified by “0011b”, is set so that the display of the third sub picture is inhibited (OFF).
In the case in which a specified color code is set so that the display of the corresponding-sub picture is inhibited, the decoder unit 21 replaces the contrast of the sub picture PXD corresponding to the specified color code by a value which makes the display of the sub picture invisible on the main picture, for example, “1111b”. For instance, in the case in which the color code “0010b” is set so that the display of the corresponding-sub picture is inhibited and a pattern pixel color code in the color code setting command SET_COLOR shown in
After decoding the sub picture stream with such replacement applied thereto, by being superposed on the main picture data, only the display of the sub picture in the color of which the color code is specified as “0010b” among the identical sub picture streams is not permitted, the sub picture reproducing device may control the propriety of displays of the sub pictures in pixel units, may enhance the degree of freedom of expression of sub pictures, and may contribute to the expansion of video expression.
If the color code/contrast changing command CHG_COLCON exists, it is determined whether the color code, which is set so that the display of the sub picture corresponding to the color code is inhibited, exists in the pixel control information PX_CTLI in the pixel control data PXCD, and if the color code exists, the decoder unit 21 replaces the contrast of the corresponding-pixel in the pixel control information PX_CTLI by the value “1111b” corresponding to the color code of which the corresponding-sub picture is set not to be displayed.
After this, in Step S3, the decoder unit 21 analyzes the display control sequence SP_DCSQ in turn from the input sub picture stream SPU on the basis of the information SP_DCSQT_SA showing the record start position of the display control sequence table SP_DCSQT existing in the previously analyzed sub picture unit header SPUH.
Next, in Step S4, if the color code/contrast changing command CHG_COLCON exists in the previously analyzed display control sequence SP_DCSQ, the decoder unit 21 analyzes the pixel control data PXCD. The decoder unit 21, in Step S5, executes run-length decode processing on the sub picture pixel data PXD in the input sub picture stream SPU.
After this, in Step S6, the decoder unit 21 obtains the color code, in the color code setting command SET_COLOR or in the pixel control information PX_CTLI of the color code/contrast changing command CHG_COLCON setting command SET_COLOR, which is specified on the basis of the color code to be applied to the sub picture PXD that has been applied with the run-length decode processing thereto previously, namely, two-bit pixel data indicating the kind of the sub picture PXD (refer to
If the inhibition of the display of the sub picture is set for the obtained color code, the decoder unit 21, in Step S7, replaces the contrast of the sub picture PXD corresponding to the color code, namely, the contrast in the color code setting command SET_COLOR or in the pixel control information PX_CTLI of the color code/contrast changing command CHG_COLCON, for example, by “1111b” as a value which makes the display of the sub picture invisible on the main picture.
After this, the decoder unit 21, in Step S8, applies the color code and the contrast described in the color code setting command SET_COLOR, in the contrast setting command SET_CONTR, or in the pixel control information PX_CTLI of the color code/contrast changing command CHG_COLCON to the sub picture PXD of which the contrast has not been replaced by “1111b” in Step S7.
If the permission of the display of the sub picture for the color code obtained in Step S6 has been set, the decoder unit 21 directly shifts to processing in Step S8 without having to pass though the processing in Step S7. In this case, the color code and the contrast, which is described in the color code setting command SET_COLOR, in the contrast setting command SET_CONTR, or in the pixel control information PX_CTLI of the color code/contrast changing command CHG_COLCON specified on the basis of the two-bit pixel data indicating the kind (refer to
Then, the decoder unit 21 determines whether or not the processing of one line has ended in Step S9. If it is determined that the processing has not ended (NO, in Step S9), the decoder unit 21 returns to the processing in Step S5 to execute the run-length processing for the sub picture PXD. If it is determined that the processing of one line has ended (YES, in Step S9), the decoder unit 21 determines whether or not the processing of one frame has ended in Step S10. If it is determined that the processing has not ended (NO, in Step 10), it is determined that a plurality of items pf pixel control data PXCD of the color code/contrast changing command CHG_COLCON exist, and the decoder 21 returns to the processing in Step 4 to analyze the next pixel control data PXCD. The processing of one line is performed for the fields of TOP/BOTTOM.
If it is determined that the processing of one frame has ended (YES, in Step S10), after outputting the decoded sub picture data of one frame to the mixing unit 20 in Step S11, the decoder unit 21 determines whether or not the display control sequence SP_DCSQ has completed in Step S12. If it is determined that the sequence SP_DCSQ has not completed (NO, in Step S12), the decoder unit 21 returns to the processing in Step S3 to analyze the next display control sequence SP_DCSQ.
If it is determined that the sequence SP_DCSQ has completed (YES, in Step S12), the decoder unit 21 determines whether or not the sub picture stream SPU has ended in Step S13. If it is determined that the stream SPU has not ended (NO, in Step S13), the decoder unit 21 returns to the processing in Step S2 to analyze the sub picture unit header SPUH of the next sub picture stream SPU, and if it is determined that the stream SPU has ended (YES, in Step S13), the decoder unit 21 terminates the processing (Step S14).
According to the given embodiment, since the disk reproducing device may set the propriety of displays by color codes for various kinds of sub picture pixel data PXD included in one sub picture stream SPU, the device may enhance the degree of freedom of the display form of the sub pictures in addition to enhancing the means to select and reproduce a desired sub picture stream among a plurality of sub picture streams pre-recorded on the optical disk 12, and may also contribute the expansion of video expression.
The following will describe an example of a concrete method of operation using the propriety of setting the propriety of displays by color code for various sub pictures included in one sub video stream SPU. As shown in
In this case, different color codes are set, respectively, for the four kinds of subtitles, namely for each sub picture pixel data PXD corresponding to the Japanese subtitles HJ for HANAKO HA, the English subtitles HE for HANAKO HA, the Japanese subtitles TJ for TARO TA and the English subtitles TE for TARO TA. For instance, it is assumed that the Japanese subtitles HJ for HANAKO HA are colored in red, the English subtitles HE for HANAKO HA are colored in pink, the Japanese subtitles TJ for TARO TA are colored in blue, and the English subtitles TE for TARO TA are colored in green.
In such a state, if the device displays a menu as shown in
In contrast, as shown in
Therefore, since the reproducing device makes it possible not to display solely the sub picture corresponding to the color code specified not to be displayed of the identical sub picture streams, the device may control the propriety of displays of sub pictures by pixel, may enhance the degree of freedom in the expression of sub pictures, and may contribute to the expansion of video expression.
In the aforementioned embodiment, since two-bit is set as the pixel data indicating the kinds of the sub picture PXD (refer to
Preparing subtitles for each of the background pixel, the pattern pixel, the emphasis pixels 1 and 2, and switching them by the color code setting command SET_COLOR and rewriting them by the setting of the color code/contrast changing command CHG_COLCON in the same kinds of pixel are possible approaches. It is acceptable to enable setting the propriety of displays of the sub pictures not only by the color code but also by the combination of color code and contrast.
As for a means for bringing the sub picture of the specified color code into a display inhibition state, other than the method for switching the contrast as mentioned above, a method, for example, which outputs a control signal to enable display-controlling by pixel from the sub picture decoder unit 21 to the mixing unit 20 to utilize the control signal, is also possible.
While certain embodiments of the inventions have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2007-086124 | Mar 2007 | JP | national |
2007-086127 | Mar 2007 | JP | national |