Patent Application
20180013811
The invention generally relates to a system, a device, and a display method, in particular, to a display system, a source device, a sink device and an image displaying method.
Development of Over-The-Top (OTT) service is accelerating with advances in technologies. In recent years, electronic products applying Over-The-Top service become more and more diversified. Especially, the design of the display system, the source device and the sink device for providing the video service is more and more important. The sink device may be a television, a television box, a computer, a PAD, a smart phone, etc. However, the display quality of the current display system may be determined by the picture quality processing IC, panel and backlight of the sink device. The video data from the video input of the display system is standard signal, and the display system cannot optimize the sink device or video data to provide the good display quality. That is to say, the image quality for viewers depends on the capabilities of the device. Once the sink device does not support the video data, the sink device cannot display images according to the video data from the video input of the display system.
Hence, how to design a display system that could provide a good image display quality for users and a satisfactory user experience based on the different video data from the video source is one of the most important topics in the pertinent field.
Accordingly, the invention is directed to a display system, a source device, a sink device, and an image display device, capable of providing a good image display quality for user and a satisfactory user experience.
The invention provides a display system. The display system is adapted to provide a client oriented service. The display system includes a source device and a sink device. The source device encodes a video input to output a video output. The video input includes video data. The video output includes metadata and a video stream, and the video stream is encoded from the video data. The sink device communicates with the source device. The sink device receives and decodes the video output to obtain the video data, and displays images according to the video data and the metadata. The source device generates the metadata from the video input according to hardware parameters of the sink device.
In an exemplary embodiment of the invention, the source device adjusts the video data according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the source device performs a picture quality processing operation on the video input to generate the metadata from the video input according to a setting of a sink-like device. The setting of the sink-like device includes the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the setting of the sink-like device is preset in a data processing unit or obtained from the sink device.
In an exemplary embodiment of the invention, the source device adjusts the setting of the sink-like device according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the metadata includes a plurality of instructions to be applied to the video data. The source device generates the metadata by creating the instructions according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the source device is adapted to provide the client oriented service for the sink device. The source device includes a data process unit, a data encoding unit, and a data merge unit. The data processing unit generates the metadata from the video input according to hardware parameters of the sink device. The data encoding unit is coupled to the data processing unit. The data encoding unit encodes the video data to generate the video stream. The data merge unit is coupled to the data encoding unit, and merges the video stream and the metadata to output a video output.
In an exemplary embodiment of the invention, the sink device outputs the hardware parameters to the source device based on a request of the source device.
In an exemplary embodiment of the invention, the metadata includes a plurality of instructions. The sink device applies the instructions to the video data, so as to perform the picture quality processing operation on the video data.
In an exemplary embodiment of the invention, the sink device is adapted to communicate with the source device. The sink device includes a data splitter unit, a data decoding unit, a data processing unit, and a display unit. The data splitter unit receives the video output outputted from the source device, and splits the video output to obtain the metadata and the video stream. The data decoding unit is coupled to the data splitter unit, and decodes the video stream to obtain the video data. The data processing unit is coupled to the data decoding unit, and performs a picture quality processing operation on the video data according to the metadata. The display unit is coupled to the data processing unit, and displays images according to the video data and the metadata.
The invention provides a source device. The source device is adapted to provide a client oriented service for a sink device. The source device includes a data processing unit, a data encoding unit, and a data merge unit. The data processing unit generates metadata from a video input according to hardware parameters of the sink device. The video input includes video data. The data encoding unit is coupled to the data processing unit, and encodes the video data to generate a video stream. The data merge unit is coupled to the data encoding unit, and merges the video stream and the metadata to output a video output.
In an exemplary embodiment of the invention, the data processing unit adjusts the video data according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the data processing unit performs a picture quality processing operation on the video input to generate the metadata from the video input according to a setting of a sink-like device. The setting of the sink-like device includes the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the setting of the sink-like device is preset in the data processing unit or obtained from the sink device.
In an exemplary embodiment of the invention, the data processing unit adjusts the setting of the sink-like device according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the metadata includes a plurality of instructions to be applied to the video data. The data processing unit generates the metadata by creating the instructions according to the hardware parameters of the sink device.
The invention provides a sink device. The sink device is adapted to communicate with a source device. The sink device includes a data splitter unit, a data decoding unit, a data processing unit and a display unit. The data splitter unit receives a video output outputted from the source device, and splits the video output to obtain metadata and a video stream. The data decoding unit is coupled to the data splitter unit, and decodes the video stream to obtain video data. The data processing unit is coupled to the data decoding unit, and performs a picture quality processing operation on the video data according to the metadata. The metadata is generated according to hardware parameters of the sink device. The display unit is coupled to the data processing unit, and displays images according to the video data and the metadata.
In an exemplary embodiment of the invention, the data processing unit outputs the hardware parameters of the sink device to the source device based on a request of the source device, and the source device generates the metadata according to the hardware parameters of the sink device.
In an exemplary embodiment of the invention, the metadata includes a plurality of instructions. The data processing unit applies the instructions to the video data, so as to perform the picture quality processing operation on the video data.
The invention provides an image displaying method. The image displaying method is adapted to a display system including a source device and a sink device. The image displaying method includes the following steps: generating metadata from a video input according to hardware parameters of the sink device via the source device, where the video input includes video data; encoding the video data to generate a video stream by the source device, and merging the video stream and the metadata to output a video output to the sink device by the source device; and receiving and decoding the video output by the sink device, and displaying images according to the video data and the metadata by the sink device.
In an embodiment of the invention, the image displaying method further includes the following step: adjusting the video data according to the hardware parameters of the sink device by the source device.
According to the above descriptions, in the exemplary embodiments of the invention, the source device outputs the video output including the metadata and the video stream to the sink device according to hardware parameters of the sink device, where the video stream is encoded from the video data. The sink device decodes the video output to obtain the video data and the metadata, and displays images according the video data and the metadata. Therefore, the sink device adjusts the picture quality of the video data according to the metadata to provide a satisfactory image quality for users.
In order to make the aforementioned and other features and advantages of the invention comprehensible, several exemplary embodiments accompanied with figures are described in detail below.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Reference will now be made in detail to the present preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
Embodiments are provided below to describe the present disclosure in detail, though the present disclosure is not limited to the provided embodiments, and the provided embodiments can be suitably combined. The term “coupling/coupled” used in this specification (including claims) of the present application may refer to any direct or indirect connection means. For example, “a first device is coupled to a second device” should be interpreted as “the first device is directly connected to the second device” or “the first device is indirectly connected to the second device through other devices or connection means.” In addition, the term “signal” can refer to a current, a voltage, a charge, a temperature, data, electromagnetic wave or any one or multiple signals.
To be specific, in the present embodiment, the display system 100 may be a display ecosystem system, and configured to perform an optimization for display quality according to different video sources. That is to say, the display system 100 may be designed for provide a client oriented service. In the present embodiment, the source device 110 may generate metadata for the image optimization according to the device capabilities of the sink device 120, so that at least one of the source device 110 and the sink device 120 may adjust the video data to provide a good display quality according to the device capabilities of the sink device 120. In the present embodiment, the sink device 120 may adjust the video data or the device capabilities itself based on the metadata. In the present embodiment, the video data may be encoded by Advanced Video Coding (AVC), High Efficiency Video Coding (HEVC) or other video coding methods, which the invention is not limited thereto.
More specifically, when a user operates the sink device 120 to view an image, the source device 110 may output a signal to the sink device 120 to check the device capabilities of the sink device 120. Then, the sink device 120 may feedback an acknowledgement signal (ACK) to provide hardware parameters of the sink device 120 to the source device 110. Therefore, the source device 110 may send a video output including a video stream and metadata to the sink device 120 according to the hardware parameters of the sink device 120. The video stream is encoded from the video data. In the present embodiment, the sink device 120 may decode the video output to obtain the video data and the metadata, and perform a picture quality processing operation on the video data according to the metadata. That is to say, the source device 110 may generate a video output adapted for the sink device 120, such that the sink device 120 provides a good display quality according to the hardware condition itself.
In the present embodiment, the data processing unit 311 may include a metadata generating module 311_1. The metadata generating module 311_1 may be configured to perform a picture quality processing operation on the video input to generate the metadata MD1 from the video input according to a setting of a sink-like device. The setting of the sink-like device includes the hardware parameters of the sink device. That is to say, the data processing unit 311 generates the metadata MD1 by creating the instructions according to the hardware parameters of the sink device.
In the present embodiment, the setting of the sink-like device may be preset in the data processing unit 311 or obtained from the sink device. Moreover, the data processing unit 311 may also adjust the setting of the sink-like device according to the hardware parameters of the sink device. It should be noticed that, the hardware parameters for display quality optimization may include a plurality of instruction to be applied to the video data, and the plurality of instructions may include per scene contrast distribution, per scene content color gamut, motion vectors, scene changes, depth maps, noise levels, film cadences, logos (for OLED burn in protection), or luminance profiles (for local dimming and boosting), and so on, which are not limited in the invention.
For example, owing to the sink device cannot utilize the video data VD1 of the video input to display the image, or the setting of the sink-like device is not preset in the data processing unit 311, the source device 310 may determine the metadata MD1 according to the device capabilities of the sink device, and encode the video output according to the video data VD1 and the metadata MD1 to output to the sink device. Therefore, in the present embodiment, the sink device receiving the video output may adjust the video data VD1 or the hardware parameters itself according to the metadata MD1, so that the sink device is able to display image according to the video data.
Besides, in the present embodiment, the processing unit 311 includes, for example, a Central Processing Unit (CPU), a Microprocessor, a Digital Signal Processor (DSP), a Programmable Controller, a Programmable Logic Device (PLD), or other similar devices, a combination of the foregoing devices, which are not particularly limited in the present invention. In the present embodiment, the data encoding unit 312 may include any encoder circuit or combiner circuit in the related art or be implemented by using any encoder circuit or combiner circuit in the related art, and the data merge unit 313 may include any adder circuit or mixer circuit in the related art or be implemented by using any adder circuit or mixer circuit in the related art, which are not particularly limited in the invention. Alternatively, in one embodiment, at least one of the data encoding unit 312 and the data merge unit 313 in
In the present embodiment, the data processing unit 411 includes a metadata generating module 411_1 and a video transform module 411_2. The video transform module 411_2 is configured to perform an image optimization operation on the video data VD2 to generate video data VD2′ adapted for the sink device. The metadata generating module 411_1 is configured to generate the metadata MD2 according to the video data VD2′ from the video input according to a setting of a sink-like device. The setting of a sink-like device includes the hardware parameters of the sink device. That is to say, the data processing unit 411 may pre-adjust the video input VI2 according the device capabilities of the sink device, and generate the metadata MD2 by creating the instructions according to the hardware parameters of the sink device.
For example, the source device 410 may pre-storage the information of the display format. When the source device 410 receives the video input having the video data VD2, the source device 410 may pre-adjust the video data VD2 to obtain the video data VD2′ adapted for the sink device according to the setting of the sink-like device, and encode the video data VD2′ to obtain the video stream VS2. Then, the source device 410 determines the metadata MD2 according to the device capabilities of the sink device, and encodes the video output according to the video stream VS2 and the metadata MD2 to output to the sink device. Therefore, the sink device receiving the video output may adjust the video data VD2′ again or adjust the hardware parameters itself according to the metadata MD2.
Besides, in the present embodiment, the data processing unit 411, the data encoding unit 412 and the data merge unit 413 described in the present embodiment of the invention is sufficiently taught, suggested, and embodied in the embodiments illustrated in
In the present embodiment, the data processing unit 523 may further include a video transform module 523_1. Owing to the metadata MD3 may include a plurality of instructions, and the data processing unit 523 applies the instructions to the video data VD3, the video transform module 523_1 may perform a picture quality processing operation on the video data VD3 to generate the video data VD3′ according to the metadata MD3 according to the hardware parameters of the sink device 520.
In addition, in one embodiment, the data processing unit 523 may output the hardware parameters of the sink device 520 to the source device based on a request of the source device, so that the source device may generate the metadata according to the hardware parameters of the sink device.
Besides, in the present embodiment, the data processing unit 523 includes, for example, a Central Processing Unit (CPU), a Microprocessor, a Digital Signal Processor (DSP), a Programmable Controller, a Programmable Logic Device (PLD), or other similar devices, a combination of the said devices, which are not particularly limited by the present invention. In the present embodiment, the data splitter unit 521 may include any splitter circuit or separator circuit in the related art or be implemented by using any splitter circuit or separator circuit in the related art, and the data decoding unit 522 may include any decoder circuit in the related art or be implemented by using any decoder circuit in the related art, which are not particularly limited by the invention. Alternatively, in one embodiment, at least one of the data splitter unit 521 and the data decoding unit 522 in
Furthermore, in the present embodiment, the display unit 524 may be a Liquid Crystal Display (LCD) device, a Plasma Display Panel (PDP) device, an Organic Light Emitting Display (OLED) device, a Field Emission. Display (FED) device, an Electro-Phoretic Display (EPD) device or a Light Emitting Diode (LED) display and the like, which are also not limited in the invention.
In summary, in the exemplary embodiment of the invention, the display system may adjust the video data according to the device capabilities of the sink device to provide a good display quality for user. The display system may utilize the source device or the sink device to perform a picture quality processing operation according to the device capabilities of the sink device, so as to adjust the video data from the video input of video system. Accordingly, the display system of the exemplary embodiments of the invention may provide a good image display quality for a specific sink device or a non-specific sink device, and reduce the processing time of the video data.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.
