Patent Grant
11503246
The present invention relates to a video output controlling apparatus and a video output controlling method.
Standards for a communication interface such as DisplayPort or high-definition multimedia interface (HDMI) (registered trademark) are available.
Further, as an encryption technology of a content used in HDMI and so forth, high-bandwidth digital content protection (HDCP) is known.
The inventors are considering such a video outputting apparatus 10 as depicted in
Here, a sub system 16 that operates in cooperation with the processor 12 outputs a control signal to the conversion unit 18. Then, the conversion unit 18 performs control regarding whether or not the video of the second format is to be encrypted in accordance with the control signal. In this manner, a video encrypted by HDCP or a video not encrypted is outputted to the display apparatus 30.
In the video outputting apparatus 10 depicted
The present invention has been made in view of such an actual situation as described above, and one of objects of the present invention resides in provision of a video output controlling apparatus and a video output controlling method that can reduce the possibility that a video for which encryption is required may be outputted in a non-encrypted state.
In order to solve the subject described above, a video output controlling apparatus according to the present invention includes a first acceptance unit configured to accept a video and an encryption necessity signal indicative of whether or not encryption of the video is required via a first route, a second acceptance unit configured to accept a control signal via a second route different from the first route, a video conversion unit configured to convert, in accordance with the control signal, the video into one of a video that is different in a format from that of the video and is in an encrypted state and a video that is different in a format from that of the video and is not in an encrypted state, and an output controlling unit configured to perform control regarding whether or not the video is to be outputted based on the encryption necessity signal and whether or not the video after conversion by the video conversion unit is in an encrypted state.
In one aspect of the present invention, the first acceptance unit accepts the encryption necessity signal associated with a frame image included in the video, and the output controlling unit performs control regarding whether or not the frame image is to be outputted based on the encryption necessity signal and whether or not the frame image included in the video after the conversion by the video conversion unit and associated with the encryption necessity signal is in an encrypted state.
In the present aspect, when the first acceptance unit accepts a plurality of the encryption necessity signals associated with one frame image, in a case where one of the plurality of encryption necessity signals indicates that it is required that a frame image associated therewith is encrypted and the video after the conversion by the video conversion unit is not in an encrypted state, the output controlling unit may perform control such that the frame image is not outputted.
Further, in one aspect of the present invention, the first acceptance unit accepts the video and the encryption necessity signal indicative of whether or not encryption of the video is required from a processor, and the output controlling unit notifies, in a case where the first acceptance unit further accepts the encryption necessity signal indicating that encryption is required and besides the video conversion unit converts the video accepted by the first acceptance unit into a video that is different in a format from that of the video and is not in an encrypted state, the processer of the fact.
Meanwhile, a video output controlling method according to present inventions includes a step of accepting a video and an encryption necessity signal indicative of whether or not encryption of the video is required via a first route, a step of accepting a control signal via a second route different from the first route, a step of converting the video into one of a video that is different in a format from that of the video and is in an encrypted state and a video that is different in a format from that of the video and is not in an encrypted state, and a step of performing control regarding whether or not the video is to be outputted based on the encryption necessity signal and whether or not the video after conversion by the step of converting is in an encrypted state.
In the following, an embodiment of the present invention is described with reference to the drawings.
As depicted in
The video outputting apparatus 10 according to the present embodiment includes a processor 12, a storage unit 14, a sub system 16, a conversion unit 18, and an output port 20.
The processor 12 is, for example, a program control device such as a central processing unit (CPU) that operates in accordance with a program installed in the video outputting apparatus 10. The processor 12 according to the present embodiment includes also a graphics processing unit (GPU) that draws an image in a frame buffer on the basis of a graphics command and data supplied from the CPU. The processor 12 may otherwise be a secure processor.
The storage unit 14 includes storage elements such as, for example, a read-only memory (ROM) and a random access memory (RAM), a hard disk drive and so forth. In the storage unit 14, a program to be executed by the processor 12 and so forth are stored. Further, in the storage unit 14 according to the present embodiment, a region of a first frame buffer 14a and a region of a second frame buffer 14b in both of which an image is drawn by the GPU are secured.
The sub system 16 is a computer that cooperates, for example, with the processor 12 to control encryption of a video. The sub system 16 may be configured including a processor and a memory. Further, the sub system 16 may be configured including an electronic circuit.
The conversion unit 18 in the present embodiment is, for example, a computer that converts data of a video of a first format accepted from the processor 12 into data of a video of a second format. The conversion unit 18 converts data of a video of the format of, for example, DisplayPort into data of a video of the format of HDMI. The conversion unit 18 may be configured including a processor and a memory. Further, the conversion unit 18 may be configured including an electronic circuit.
The output port 20 is a port from which a video is outputted to the display apparatus 30 and is, for example, an HDMI port or the like.
The display apparatus 30 in the present embodiment is, for example, a display such as, for example, a liquid crystal display or an organic electroluminescence (EL) display and displays a video represented by data accepted from the output port 20.
The frame buffer according to the present embodiment is of the double buffer type and performs, when drawing of a frame buffer is being performed in the first frame buffer 14a, outputting of a frame image stored in the second frame buffer 14b. On the other hand, when drawing of a frame image is being performed in the second frame buffer 14b, outputting of frame image data stored in the first frame buffer 14a is performed. Then, for example, a flip process is executed at a predetermined timing such that a frame buffer to be used for writing of a frame image by the GPU and a frame buffer to be used for outputting of a stored frame image are switched.
Then, the processor 12 according to the present embodiment outputs, for example, a video of the DisplayPort format to the conversion unit 18. The conversion unit 18 converts the video accepted from the processor 12 into a video of the HDMI format. At this time, the conversion unit 18 converts the video into one of a video that has undergone encryption by HDCP and a video that has not undergone such encryption in accordance with a control signal accepted from the sub system 16.
Further, the processor 12 according to the present embodiment outputs also an encryption necessity signal that is a signal indicative of whether or not encryption of a video is required to the conversion unit 18.
Then, in the case where the conversion unit 18 accepts an encryption necessity signal indicating that encryption of a video is required and besides executes conversion into a video that has not undergone encryption, the conversion unit 18 suppresses outputting of the video. In this case, a video of a specific color (for example, a video of a black color) or a specific image may be outputted instead.
For example, modification of the video outputting apparatus 10 is sometimes performed such that an illegal control signal can be inputted to the conversion unit 18. In this case, there is the possibility that, although a video requires encryption, the video may be outputted in a non-encrypted state.
In the present embodiment, it is indicated by the encryption necessity signal that encryption of a video is required as described above, and in the case where a video for which encryption is required is not in an encrypted state, outputting of the video is suppressed. Here, for example, outputting itself of the video (outputting of the video signal) may be stopped compulsorily. As an alternative, for example, a substitute video (for example, a video of a black color, a video of white noise or the like) may be outputted. In this manner, according to the present embodiment, the possibility that a video for which encryption is required may be outputted in a non-encrypted state can be reduced. Further, according to the present embodiment, it can be sometimes prevented that a video for which encryption is required is outputted in a non-encrypted state.
Here, the encryption necessity signal may be incorporated as a packet equivalent to a vertical blanking signal or a horizontal blanking signal. In particular, for example, the encryption necessity signal may be incorporated as a DP Secondary Packet having a specific value set to the header thereof. In this case, for example, that encryption is required may be indicated by that the value of a specific field included in the payload of the DP Secondary Packet is 1. Further, for example, that encryption is not required may be indicated by that the value of the specific field included in the payload of the DP Secondary Packet is 0.
Further, in
Further, in this case, for example, as one packet from among a plurality of packets equivalent to a vertical blanking signal, an encryption necessity signal indicative of whether or not encryption of a frame image to be outputted following the vertical blanking signal is required may be outputted. For example, as one packet from among a plurality of packets equivalent to the vertical blanking signal A, an encryption necessity signal indicative of whether or not encryption of the frame image A is required may be outputted. Similarly, as one packet from among a plurality of packets equivalent to the vertical blanking signal B, an encryption necessity signal indicative of whether or not encryption of the frame image B is required may be outputted.
Further, for example, as one packet from among a plurality of packets equivalent to a horizontal blanking signal, an encryption necessity signal indicative of whether or not encryption of a frame image next to a frame image outputted alternately with the horizontal blanking signal is required may be outputted. For example, as one packet from among a plurality of packets equivalent to the horizontal blanking signal A, an encryption necessity signal indicative of whether or not encryption of the frame image B is required may be outputted.
Further, the encryption necessity signal may be incorporated, for example, as the header of a frame image. For example, as the header of the frame image A, an encryption necessity signal indicative of whether or not encryption of the frame image A is required may be outputted. Further, for example, as the header of the frame image B, an encryption necessity signal indicative of whether or not encryption of the frame image B is required may be outputted.
Further, as the header of a frame image, an encryption necessity signal indicative of whether or not encryption of a frame image next to the frame image is required may be incorporated. For example, as the header of the frame image A, an encryption necessity signal indicative of whether or not encryption of the frame image B is required may be outputted.
As described above, for each of a plurality of frame images, an encryption necessity signal that indicates whether or not encryption of the frame image is required and is associated with the frame image may be outputted. Then, in the case where an encryption necessity signal indicating that encryption of a frame image is required is accepted and besides conversion into a frame image that is not in an encrypted state is executed, outputting of the frame image may be suppressed.
Further, there is the possibility that such modification that not only a regular encryption necessity signal but also an illegal encryption necessity signal are outputted to the conversion unit 18 may be performed. Therefore, for example, when a plurality of encryption necessity signals each associated with one frame image are outputted, it may be confirmed whether or not it is indicated that encryption is required for one of the encryption necessity signals. Then, in the case where it is confirmed that one of the encryption necessity signals indicates that encryption is required and the frame image after conversion is not in an encrypted state, outputting of the frame image may be suppressed.
For example, to the conversion unit 18, not only a regular encryption necessity signal indicating that encryption is required but also an encryption necessity signal indicating that encryption is not required are illegally inputted as a vertical blanking signal immediately before a frame image is outputted. Also in this case, if the foregoing is applied, then in the case where a frame image for which encryption is required is not in an encrypted state, outputting of the frame image is suppressed on the basis of the regular encryption necessity signal associated with the frame image. In this manner, if the foregoing is applied, then the possibility that a frame image for which encryption is required may be outputted in a non-encrypted state can be reduced. Further, if the foregoing is applied, then also it can sometimes be prevented that a frame image for which encryption is required is outputted in a non-encrypted state.
Further, the processor 12 may output a frame image or a blanking signal to the conversion unit 18 after it scrambles the same. In this case, the conversion unit 18 first descrambles a frame image or a blanking signal accepted from the processor 12 and then executes succeeding processes.
In the following, functions of the conversion unit 18 according to the present embodiment and processes executed by the conversion unit 18 according to the present embodiment are further described.
As depicted in
The functions mentioned may be incorporated by executing a program including instructions installed in the video outputting apparatus 10 that is a computer and corresponding to the functions by the processor 12 or by a processor provided in the conversion unit 18. This program may be supplied to the video outputting apparatus 10 through a computer-readable information storage medium such as, for example, an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory or through the Internet or the like.
The first acceptance unit 40 in the present embodiment accepts an encryption necessity signal indicative of a video and whether or not encryption of the video is required, for example, via a first route. For example, the first acceptance unit 40 accepts a video and an encryption necessity signal of the DisplayPort format from the processor 12.
The descramble unit 42 in the present embodiment descrambles, for example, a signal accepted by the first acceptance unit 40.
The second acceptance unit 44 in the present embodiment accepts a control signal, for example, via a second route different from the first route. For example, the second acceptance unit 44 accepts a control signal from the sub system 16.
The video conversion unit 46 in the present embodiment converts a video accepted by the first acceptance unit 40 into one of a video that is different in the format from that of the video and is in an encrypted state and a video that is different in the format from that of the video and is not in a non-encrypted state, for example, in accordance with a control signal accepted by the second acceptance unit 44. The video conversion unit 46 may convert a video of the DisplayPort format into a video of the HDMI format.
The output controlling unit 48 in the present embodiment performs, on the basis of an encryption necessity signal accepted by the first acceptance unit 40 and whether or not a video after conversion by the video conversion unit 46 is in an encrypted state, control regarding whether or not the video is to be outputted. Here, for example, the output controlling unit 48 may hold a packet equivalent to the encryption necessity signal accepted by the first acceptance unit 40. Then, the output controlling unit 48 may perform, on the basis of the packet held therein and whether or not the video after conversion by the video conversion unit 46 is in an encrypted from, control regarding whether or not the video is to be outputted.
The outputting unit 50 in the present embodiment outputs, for example, a video controlled so as to be outputted to the display apparatus 30 via the output port 20. Here, in the case where the video is controlled so as not to be outputted by the output controlling unit 48, the outputting unit 50 may compulsorily stop outputting itself of the video (outputting of the video signal). Further, in the case where the video is controlled so as not to be outputted by the output controlling unit 48, the outputting unit 50 may output a substitute video (for example, a video of a black color, a video of white noise or the like).
Here, the first acceptance unit 40 may accept an encryption necessity signal associated with a frame image included in the video as described hereinabove. In this case, the output controlling unit 48 may perform, on the basis of the encryption necessity signal and whether or not a frame image included in the video after conversion by the video conversion unit 46 and associated with the encryption necessity signal is in an encrypted state, control regarding whether or not the frame image is to be outputted.
Further, the first acceptance unit 40 may accept a plurality of encryption necessity signals associated with one frame image as described hereinabove. Here, in the case where one of the plurality of encryption necessity signals indicates that it is required that the associated frame image is encrypted and the video after conversion by the video conversion unit 46 is not in an encrypted state, the output controlling unit 48 may control the frame so as not to be outputted.
The series of processes of acceptance of a video by the first acceptance unit 40, descramble by the descramble unit 42, conversion of the video by the video conversion unit 46, output control of the video by the output controlling unit 48, and outputting of the video by the outputting unit 50 may be executed in a unit of a pixel included in a frame image. As an alternative, the series of processes described above may be executed in a unit of several pixels. As another alternative, the series of processes described above may be executed in a unit of a frame image.
In the following, an example of a flow of processing executed by the output controlling unit 48 according to the present embodiment for performing control regarding whether or not a video is to be outputted is described with reference to a flow chart exemplified in
In the present processing example, the following processes are executed, for example, in a unit of a pixel included in a frame image converted by the video conversion unit 46.
Further, in the present processing example, it is assumed that the output controlling unit 48 holds a packet of an encryption necessity signal included in a vertical blanking signal immediately before the first acceptance unit 40 accepts a frame image including the pixel.
Here, as a vertical blanking signal immediately before a frame image including the pixel is accepted, a plurality of packets of different encryption necessity signals are sometimes accepted. In this case, in the case where one of the encryption necessity signals indicates that encryption is required, the output controlling unit 48 holds the packet of the encryption necessity signal that indicates that encryption is required. Further, in the case where all encryption necessity signals indicate that encryption is not required, the output controlling unit 48 holds a packet of an encryption necessity signal that indicates that encryption is not required.
First, the output controlling unit 48 confirms whether or not the pixel after conversion by the video conversion unit 46 is in an encrypted state (S101). In the following description, the pixel is referred to as target pixel.
In the case where it is confirmed that the pixel is not in an encrypted state (S101: N), the output controlling unit 48 confirms whether or not the first acceptance unit 40 accepts an encryption necessity signal indicating that encryption is not required and associated with the frame image including the target pixel (S102). Here, the output controlling unit 48 may execute the confirmation on the basis of the packets held therein.
It is assumed here that it is confirmed that an encryption necessity signal that indicates that encryption is not required and is associated with the frame image described above is not accepted (S102: N). For example, a case in which an encryption necessity signal indicating that encryption is required and associated with the frame image described above is accepted as an immediately preceding vertical blanking signal is included in this case. Also a case in which an encryption necessity signal associated with the frame image described above is not accepted as an immediately preceding vertical blanking signal is included in this case. In this case, the output controlling unit 48 performs control such that outputting of the target pixel is suppressed (S103). In this manner, in the case where an encryption necessity signal is not accepted, similar operation to that in the case where an encryption necessity signal indicating the encryption is required may be performed. This makes it possible to reduce the possibility that, also in the case where the outputting function of the processor 12 for outputting an encryption necessity signal does not operate correctly, a video for which encryption is required may be outputted in a non-encrypted state to the display apparatus 30. Further, in this case, outputting itself of the target pixel (outputting of a signal representative of the target pixel) may be stopped compulsorily as described hereinabove. Alternatively, a substitute video (for example, a video of a black color, a video of white noise or the like) may be outputted. Then, the processing returns to S101, and the processes at the steps beginning with S101 are executed for a subsequently converted pixel.
In the case where it is confirmed by the process indicated at S101 that the target pixel is in an encrypted state (S101: Y), the output controlling unit 48 performs control such that the target pixel is outputted (S104). Also in the case where it is confirmed by the process indicated at S102 that an encryption necessity signal indicating that encryption is not required and associated with the frame image described above, the output controlling unit 48 performs control such that the target pixel is outputted (S104). Then, the processing returns to the process indicated by S101, and the processes beginning with S101 are executed for a pixel converted next.
It is to be noted that, although, in the processing example described above, the processes at S101 to S104 are executed in a unit of a pixel, the processes at S101 to S104 may be executed otherwise in a unit of several pixels or in a unit of a frame image.
Further, for example, in the case where it is confirmed that the target pixel is in an encrypted state, the output controlling unit 48 may confirm whether or not the first acceptance unit 40 accepts an encryption necessity signal indicating that encryption is required and associated with the frame image including the target pixel. Then, in the case where it is confirmed that an encryption necessity signal indicating that encryption is required and associated with the frame image described above is not accepted, the output controlling unit 48 may perform control such that outputting of the target pixel is suppressed.
Further, for example, in the case where the first acceptance unit 40 does not accept an encryption necessity signal, even if the second acceptance unit 44 accepts a control signal instructive of encryption, the output controlling unit 48 may perform control such that a video is not outputted.
It is to be noted that the present invention is not limited to the embodiment described above.
For example, it is assumed that the first acceptance unit 40 accepts an encryption necessity signal indicating that encryption is required and besides the video conversion unit 46 converts the video accepted by the first acceptance unit 40 into a video that is of a format different from that of the video and is not in an encrypted state. In this case, the output controlling unit 48 may notify the processor 12 of this.
Further, for example, it is assumed that the first acceptance unit 40 does not accept an encryption necessity signal and besides the video conversion unit 46 converts a video accepted by the first acceptance unit 40 into a video that is of a format different from that of the video and is not in an encrypted state. In this case, the output controlling unit 48 may notify the processor 12 of this.
For example, in the case where the process indicated at S103 described above is executed, the output controlling unit 48 may execute the notification described above to the processor 12 together.
For example, this makes it possible to prompt the processor 12 to execute a process that becomes countermeasures against inappropriate control such as stopping of operation, re-activation, or notification of occurrence of inappropriate control of the video outputting apparatus 10.
Further, the scene to which the present invention can be applied is not restricted. For example, the present invention can be applied to a scene in which a video generated by the processor 12 and representative of a play situation of a game is converted by the conversion unit 18 and outputted from the video outputting apparatus 10 to the display apparatus 30. Further, the present invention can be applied to a scene in which a video of a content such as a movie stored in the storage unit 14 is converted by the conversion unit 18 and outputted from the video outputting apparatus 10 to the display apparatus 30.
Further, the particular character sequences and numerical values given hereinabove and the particular character sequences and numerical values in the drawings are exemplary, and such character sequences and numerical values are not restrictive.
| Number | Date | Country | Kind |
|---|---|---|---|
| JP2017-155909 | Aug 2017 | JP | national |
| JP2017-186090 | Sep 2017 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/029391 | 8/6/2018 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2019/031445 | 2/14/2019 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 9445112 | Culebro | Sep 2016 | B2 |
| 20060071920 | Ishimatsu et al. | Apr 2006 | A1 |
| 20060227967 | Nishikawa | Oct 2006 | A1 |
| 20110122142 | Wyatt et al. | May 2011 | A1 |
| 20160188909 | Zatko | Jun 2016 | A1 |
| Number | Date | Country |
|---|---|---|
| 2006-108961 | Apr 2006 | JP |
| 2014-002581 | Jan 2014 | JP |
| Entry |
|---|
| International Preliminary Report on Patentability dated Feb. 20, 2020, from International Application No. PCT/JP2018/029391, 11 sheets. |
| International Search Report and Written Opinion dated Oct. 30, 2018, from International Application No. PCT/JP2018/029391, 6 sheets. |
| Decision to Grant a Patent dated Oct. 20, 2020, from Japanese Patent Application No. 2019-535644, 3 sheets. |
| Number | Date | Country | |
|---|---|---|---|
| 20200213556 A1 | Jul 2020 | US |
