Patent Application
20120044254
The present invention relates to display of a video image thumbnail list, and relates to a display apparatus, a display method and a program for executing the same for displaying a thumbnail list without applying a load to a device or without putting a stress on a user in displaying a plurality of video images.
In reproduction devices (players) and recording and reproduction devices (recorders) of video images, or PCs or the like having a function of recording/reproduction of a video image obtained via broadcast or a network, thumbnail display is frequently used as means to effectively present/manage a number of video images recorded in a recording medium such as a DVD (Digital Versatile Disc), a BD (Blu-ray Disc), an SD memory card, or an HDD (Hard-Disk Drive).
The thumbnail refers to a small image (usually a reduced image of an original image), representing a video image that is displayed instead of the video image, and the thumbnail display refers to a list display form consisting of thumbnails of a plurality of video images (representative reduced images). The thumbnail is usually a still image, however, a so-called moving image thumbnail in which a thumbnail is displayed not by a still image but by a moving image has also been spread gradually in accordance with improvement of a processing capacity of devices. In a case where the processing capacity of a display device is sufficient, in principle, it is possible to display all the thumbnails by moving images.
Patent Literature 1 describes that a user's interest degree is estimated by a difference in displayed states of a plurality of video images displayed on a screen, and that priority of display quality of the video images is determined according to the interest degree. It is also described that by changing display specification of the video image based on the priority, a transfer amount of the video image data or a data amount related to display processing is reduced.
In
The video image display control portion 205 stores display state data of each displayed video image in the display state management table 206. The interest degree measuring portion 207 estimates a user's interest degree of each video image based on the display state data. The video image display control portion 205 changes a display specification of each video image so as to display a video image in which a high degree of interest is taken with high display quality and to display a video image in which a low degree of interest is taken with reduced display quality, to be transferred from the transmission/reception portion 201 to the video image input portion 301 via the network 300. The video image input portion 301 controls the input video image data to be compressed based on the changed display specification, and the video image data is transmitted to the display device 200 via the network 300.
That is, the configuration of the Patent Literature 1 is characterized in that, the display specification of each video image is changed from the displayed state of the video images on the screen, and the video image data is compressed by the video image input portion 301, so that the transfer amount of the video image data or the data amount related to the display processing is reduced.
Patent Literature 2 describes that in a video on-demand apparatus, when a telephone function is executed while executing a video on-demand function, reproduction of a programs is temporarily stopped so as to prevent the program from being unable to be viewed due to the telephone function. It is also described that after finishing the telephone function, the temporary stop of the program is released so as to restart the reproduction from the stopped position.
With the technology of Patent Literature 2, when viewing a video image, viewing may be interrupted by an incoming call, an incoming mail, and the like, and as a method for dealing these interruptions, interruption or finishing of viewing of the video image may be performed. However, there is a need for talking with a friend on a phone while looking at thumbnail display, and reproduction is required without interrupting or finishing reproduction of the video image even though an incoming call is received.
Further, with the technology of Patent Literature 1, in a system which a display apparatus is connected to a communication network and data is transmitted via the Net, it is conceivable that while viewing video image data, reception of a video image stream or the like occurs so that the number of video images to be displayed on the display apparatus increases. In such a case, the device is applied with a load for processing these additional video images, thus having a possibility to influence the display of the video image in currently being viewed, however, in Patent Literature 1, such a situation is not assumed.
Moreover, in Patent Literature 1, although the display specification of the video image is determined on a side of the display apparatus, it is configured that the specification is transferred to a video image input portion via the Net, and after compressing the video image data, it is transmitted again to the display device via the Net, therefore, it is desired that processing is finished only on the side of the display apparatus.
Meanwhile, the present invention is devised in view of the above-described problem, and provides a display apparatus, a display method and a program for executing the same capable of continuing reproduction without interrupting or finishing moving image display of a plurality of thumbnails in currently being viewed, even when external data different from video image data in being viewed is input.
The present invention provides a display apparatus for controlling display quality of a plurality of video image data to be displayed, including: data detecting means for detecting an input of data different from video image data being displayed; load estimating means for estimating a load applied to a processing capacity of the display apparatus by the different data; and video image display control means for changing, in a case where the load exceeds the processing capacity of the display apparatus, quality of a plurality of video images to be displayed on the display apparatus so that display processing is able to be continued.
Here, the different data is characterized by being external data which is data other than the video image. This display apparatus further includes processing delay means for delaying, when reception of the external data is detected by the data detecting means, processing of the external data by a predetermined time.
Furthermore, the different data is characterized by being different video image data which is displayed additionally to the video image data being displayed. This display apparatus further includes processing delay means for delaying processing of the external data by a predetermined time when reception of the different video image data is detected by the data detecting means.
Further, the present invention provides a display apparatus for controlling display quality of a plurality of video image data to be displayed, including: video image detecting means for detecting video image data which is displayed additionally to display video image data; external data detecting means for detecting an input of external data which is data different from the video image data; load estimating means for estimating a load applied to display of a plurality of video images displayed on the display apparatus by the additional video image data and/or the external data; and video image display control means for changing, in a case where the load exceeds the processing capacity of the display apparatus, quality of a video image to be displayed on the display apparatus so that display processing is able to be continued.
This display apparatus further includes: display delay means for delaying, when an input of the additional video image is detected by the video image detecting means, display of the additional video image by a predetermined time; and processing delay means for delaying, when reception of the external data is detected by the external data detecting means, processing of the external data by a predetermined time.
Furthermore, the display apparatus of the present invention is characterized in that the video image display control means changes the display quality by switching into real-time reproduction, slow reproduction, or skip reproduction according to a load level estimated by the load estimating means.
Furthermore, the display apparatus of the present invention is characterized in that the video image display control means changes the display quality by simplifying decoding processing within an allowable range of image quality deterioration according to a load level estimated by the load estimating means.
Furthermore, in the display apparatus of the present invention, the video image display control means may switch the display quality of all the video images simultaneously, may change the display quality for a video image other than a video image to which a user pays attention, or may change the display quality only for a video image which is newly added.
Furthermore, the display apparatus of the present invention is characterized in that the video image display control means has a function to give a notice to a user about a change in the display quality of a video image during delay.
The present invention provides a display method for controlling display quality of a plurality of video image data to be displayed on a display apparatus, including: a data detecting step of detecting an input of data different from video image data being displayed;
a load estimating step of estimating a load applied to a processing capacity of the display apparatus by the different data; and
a video image display control step of changing, in a case where the load exceeds the processing capacity of the display apparatus, quality of a plurality of video images to be displayed on the display apparatus so that display processing is able to be continued.
Here, the different data is characterized by being external data which is data other than the video image. This display method further includes a processing delay step of delaying, when reception of the external data is detected by the data detecting step, processing of the external data by a predetermined time.
Furthermore, the different data is characterized by being different video image data which is displayed additionally to the video image data being displayed. This display method further includes a processing delay step of delaying, when reception of the different video image data is detected at the data detecting step, processing of the different video image data by a predetermined time.
Further, the present invention provides a display method for controlling display quality of a plurality of video image data to be displayed, including: a video image detecting step of detecting video image data which is displayed additionally to display video image data; an external data detecting step of detecting an input of external data which is data different from the video image data; a load estimating step of estimating a load applied to display of a plurality of video images displayed on the display apparatus by the additional video image data and/or the external data; and a video image display control step of changing, in a case where the load exceeds the processing capacity of the display apparatus, quality of a video image to be displayed on the display apparatus so that display processing is able to be continued.
This display method further includes: a display delay step of delaying, when an input of the additional video image is detected by the video image detecting step, display of the additional video image by a predetermined time; and a processing delay step of delaying, when reception of the external data is detected by the external data detecting step, processing of the external data by a predetermined time.
Furthermore, the display method of the present invention is characterized in that at the video image display control step, the display quality is changed by switching into real-time reproduction, slow reproduction, or skip reproduction according to a load level estimated by the load estimating means.
Furthermore, the display method of the present invention is characterized in that at the video image display control step, the display quality is changed by simplifying decoding processing within an allowable range of image quality deterioration according to a load level estimated by the load estimating means.
Furthermore, in the display method of the present invention, at the video image display control step, the display quality of all the video images may be switched simultaneously, the display quality for a video image other than a video image to which a user pays attention may be changed, or the display quality only for a video image which is newly added may be changed.
Furthermore, the display method of the present invention is characterized in that at the video image display control step, a function to give a notice to a user about a change in the display quality of a video image during delay is provided.
Further, the present invention provides a program for causing a computer to execute the display method.
According to the present invention, even when external data such as an incoming call or the like is received, or even when an additional video image is input, reproduction is able to be continued without interrupting or finishing reproduction of a plurality of video images in currently being viewed and a user is able to operate the a device without any stress.
Additionally, display quality of a plurality of video images of a display apparatus according to a reception state of the external data or the additional video image is changed, thereby making it possible to effectively display a plurality of video images corresponding to a processing capacity of a device.
Moreover, processing of the actual external data and the additional video image is delayed by a predetermined time, and meanwhile (before an increase of a CPU load), the display quality of the video image of the display apparatus is changed, thereby enabling display of a plurality of video images corresponding to the processing capacity of the device.
Further, the reproduction of the plurality of video images is switched into real-time (actual time) reproduction, slow reproduction, or skip reproduction according to a level of a load applied to the display of the plurality of video images by the video image or the external data, thereby enabling display of the plurality of video images corresponding to the processing capacity of the device.
Hereinafter, description will be given for embodiments of the present invention with reference to accompanying drawings.
As an embodiment, here, a display apparatus 1 configured to be applied to a communication device such as a mobile phone with a display apparatus is taken as an example, and description thereof is given. The configuration of the present application is shown in
The display apparatus 1 according to the present embodiment is characterized by having the display quality control portion (display quality control means) 2 so that, in so-called moving image thumbnail display in which thumbnails displayed as a list are displayed by moving images, for example, when external data such as a telephone or a mail different from display video image data is input, a plurality of video images being displayed on a screen are allowed to be continued to be displayed without interrupting or finishing. Detailed description will be given below for a function of the display quality control portion 2.
(Function of Display Quality Control Portion)
The external data detecting portion (external data detecting means) 6 detects an input of external data such as an incoming call or mail from a network 10 via a communication function to the display apparatus 1. For example, when an incoming call is detected, an incoming detected signal is transmitted to the load estimating portion 7.
The load estimating portion 7 estimates, when receiving the external data incoming detected signal, a level of a load applied to display of a plurality of video images by the processing related to the external data. The load at this time is a total load to a CPU (not shown) of the display apparatus 1 that is estimated from a processing amount required for display of a plurality of video images, a processing amount of the external data, and a battery remaining amount of the display apparatus 1.
The video image display control portion (video image display control means) 8 determines display quality of all the video images displayed on the display apparatus 1 according to the load level estimated by the load estimating portion (load estimating means) 7, and controls reproduction of each thumbnail video image displayed on a screen at the video image display portion 4 (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of the video image is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. In the present embodiment, it is characterized in that the display quality of a video image is determined to be any of real-time (actual time) reproduction, slow reproduction, or skip reproduction according to a load level estimated by the load estimating portion 7, and for each of which, reproduction processing and arrangement required are controlled. The detail thereof will be described below.
The video image display control portion (video image display control means) 8 may also perform change of the display quality only for a video image other than a video image to which a user pays attention. The video image to which a user pays attention is, for example, a video image on the display apparatus 1 on which a cursor or the like is placed, a video image which is displayed in the center of a screen of the display apparatus 1, or a video image which is selected by a user operation.
The video image display portion (video image display means) 4 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail a video image of the video image accumulating portion 5, or a video image in an external memory, although not shown, connected to the display apparatus 1, or a video image distributed via the network 10 with video image quality and an arrangement which have been determined by the video image display control portion 8.
The external data output portion (external data output means) 3 executes processing of external data which has been detected by the external data detecting portion 6, for example, processing such as ringing of an incoming call.
In the present embodiment, although description is given for the display control function of the thumbnail video image, in an actual display apparatus, other than the thumbnail video image, for example, reproduction of one video image, or displaying a three-dimensional video image or a still image such as a picture or the like may also occur, therefore, it is needless to say that the function of the present embodiment is also applicable during such video image display (reproduction). In this respect, same applies to other embodiments.
(Processing Flow of Display Quality Control Portion)
Next, a processing flow in the display apparatus 1 will be described.
Assume that a user is browsing a plurality of video images (thumbnails) as a display example shown in
(Video Image Display Control)
Next, description will be given for a method of video image display control.
The video image display control portion (video image display control means) 8 determines the display quality of the video image according to the load level estimated by the load estimating portion (load estimating means) 7, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. Here, description will be given for a method in which the display quality of a video image is determined to be any of real-time (actual time) reproduction, slow reproduction, or skip reproduction according to the load level estimated by the load estimating portion 7, and for each of which, reproduction processing and arrangement required are controlled.
Assume that a user is browsing a plurality of video images (thumbnails) as a display example shown in
Then, the load estimating portion 7 estimates a level of a load applied to the CPU of the display apparatus 1 from a processing amount required for display of a plurality of video images currently being displayed, a processing amount required for executing the external data, and a battery remaining amount of the display apparatus.
The video image display control portion (video image display control means) 8 includes a display quality management table 15 as shown in
Here, “small load” is a case where an impact on video reproduction is judged to be small since the load level is small, accordingly, the quality of the video image which has been browsed by the user so far is not changed, and is continued to be real-time (actual time) reproduction. “Moderate load” is a case where an impact on video reproduction is judged to be moderate, and accordingly, the quality of the video image which has been browsed by the user so far is controlled to be slow reproduction, for example, ½ speed reproduction. “Large load” is a case where an impact on video reproduction is judged to be large, and in this case, the quality of the video image which has been browsed by the user so far is controlled to perform skip reproduction, for example, to reproduce only I picture.
Note that, in the present embodiment, it is configured to change the video image quality in this order of real-time reproduction→slow reproduction→skip reproduction as the load level increases, and this is based on that as a result of a subjective assessment experiment by viewers for reproduction of a plurality of video images, user's tolerance is resulted in this order. Note that, both the type and the change order of the video image quality are not limited thereto.
In the present embodiment, description has been given for the display control function when external data different from the video image data in being viewed is input, however, it is needless to say that finishing of input of the external data (hang up the phone, for example) is also detected by the external data detecting portion 6 shown in
In this manner, in the first embodiment, when external data is received, a processing load applied to the display apparatus is estimated and display quality of a video image is changed so as to enable reduction in the processing load on the display apparatus as well as reproduction of the video image to be continued without interrupting or finishing.
The configuration of the display apparatus of the second embodiment is shown in
The display apparatus 21 in the second embodiment is comprised of the processing delay portion 29, in addition to the configuration of the first embodiment. Thereby, actual external data processing (such as ring a bell of a telephone) is delayed by a predetermined time, and meanwhile (before an increase of a CPU load), the display quality of the video image displayed on the display apparatus 21 is changed, and display of a plurality of video images corresponding to the processing capacity of the device is thereby able to be performed.
Description will be given in detail below for the function of the display quality control portion 22 in the second embodiment.
(Function of Display Quality Control Portion)
The external data detecting portion (external data detecting means) 26 detects an input of external data such as an incoming call or mail via a communication function to the display apparatus 21. For example, when an incoming call is detected, an incoming detected signal is transmitted to the processing delay portion 29 and the load estimating portion 27.
The processing delay portion (processing delay means) 29 delays, when receiving the external data incoming detected signal, by a predetermined time the processing of external data which has been detected, for example, incoming call processing (such as ringing of an incoming call). The delay time may be set in advance, or may be delayed until a video image is displayed on the video image display portion 24 shown below.
The load estimating portion (load estimating means) 27 estimates, when receiving the external data incoming detected signal, a level of a load applied to display of a plurality of video images by the processing related to the external data. The load at this time is a total load to a CPU of the display apparatus 21 that is estimated from a processing amount required for display of a plurality of video images, a processing amount of the external data, and a battery remaining amount of the display apparatus 21.
The video image display control portion (video image display control means) 28 determines display quality of the video image according to the load level estimated by the load estimating portion (load estimating means) 27, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion 24 (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of the video image is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. In the present embodiment, it is characterized in that the display quality of a video image is determined to be any of real-time (actual time) reproduction, slow reproduction, or skip reproduction according to a load level estimated by the load estimating portion 27, and for each of which, reproduction processing and arrangement required are controlled. The detail thereof is the same as the first embodiment.
The video image display control portion (video image display control means) 28 may also have a display timing control function so that all the plurality of video images are switched into the display quality simultaneously after delaying the processing.
The video image display control portion (video image display control means) 28 may also perform a change of the display quality only for a video image other than a video image to which a user pays attention. The video image to which a user pays attention is, for example, a video image on the display apparatus on which a cursor or the like is placed, a video image which is displayed in the center of a screen of the display apparatus, or a video image which is selected by a user operation.
Further, the video image display control portion (video image display control means) 28 may have a function to give a notice to a user about a change in the display quality of a video image during delay of the processing. For example, before changing the display quality, a text (character) may be displayed around the video image with the display quality to be changed, or video image effect may be displayed such as illuminating a frame of the video image with the display quality to be changed, so as to give a notice to a user.
The video image display portion (video image display means) 24 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail a video image of the video image accumulating portion 25, or a video image in an external memory, although not shown, connected to the display apparatus 21, or a video image distributed via the network 30 with video image quality and an arrangement which have been determined in the video image display control portion 28.
The external data output portion (external data output means) 23 executes processing of external data which has been delayed by the processing delay portion 29, for example, processing such as ringing of an incoming call.
(Processing Flow of Display Quality Control)
Next, description will be given for a processing flow in the display apparatus 21 in the second embodiment.
Assume that a user is browsing a plurality of video images (thumbnails) as a display example shown in
The video image display control portion 28 determines display quality of the video image according to the load level estimated by the load estimating portion 27 and controls a video image displayed on the video image display portion 24 (S14). The video image display portion 24 displays a plurality of video images with video image quality controlled by the video image display control portion 28 (S15). After the elapse of a predetermined time, the external data output portion 23 executes processing of external data such as incoming call processing (such as ringing of an incoming call) (S16), and the processing is finished.
Note that, in the present processing flow, the processing delay at S12 is set to a predetermined time, and the processing execution at S16 is after the elapse of a predetermined time. However, a time of the processing delay at S12 may not be set, and although not shown in
In this way, in the second embodiment, the processing delay portion 29 of the external data is provided and whereby, the incoming call processing or the like (such as ringing of an incoming call) is delayed by a predetermined time, and meanwhile (before an increase of a CPU load), the display quality of the video image of the display apparatus is changed, thereby enabling display of a plurality of video images corresponding to the processing capacity of the device.
Hereinafter, as an embodiment, description will be given as an example for a display apparatus 31 configured to be applied to a communication device such as a mobile phone with a display apparatus. The configuration of the present application is shown in
The display apparatus 31 includes a display quality control portion 32, a video image display portion 34, as well as a video image accumulating portion 35. The display quality control portion 32 includes a video image detecting portion 36, a load estimating portion 37 and a video image display control portion 38.
In the third embodiment, as shown in
(Function of Display Quality Control Portion)
The video image detecting portion (video image detecting means) 36 detects an input of video image data from the video image accumulating portion 35 or from the video server 41 via a network 40, and transmits a detected signal to the load estimating portion 37.
The load estimating portion (load estimating means) 37 estimates, when receiving the video image incoming detected signal, a level of a load applied to display of a video image currently being displayed by the processing related to the display of the additional video image. The load at this time is a total load to a CPU of the display apparatus 31 that is estimated from a processing amount required for display of the current video image, a processing amount required for display of the additional video image and a battery remaining amount of the display apparatus 31. For example, in a case where, when three video images are displayed, different three video images are received, a load level of the CPU of the display apparatus 31 is estimated from the processing amount required for the reproduction processing for a total of six video images, the battery remaining amount of the display apparatus 31 and the like. Note that, the processing amount required for the display of the plurality of the video images depends on the number of pieces of video images displayed on the screen, a size of each video image, the number of frame rates, the resolution and the like.
The video image display control portion (video image display control means) 38 determines display quality of all the video images (the video image currently being displayed and the video image to be added) according to the load level estimated by the load estimating portion (load estimating means) 37, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of all the video images is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. In the third embodiment, as with the first embodiment, the display quality management table 15 as shown in
Here, “small load” is a case where an impact on video reproduction is judged to be small since the load level is small like a low quality video image of One Seg or the like, accordingly, the quality of the video image which has been browsed by the user so far is not changed, and is continued to be real-time (actual time) reproduction. “Moderate load” is a case where an impact on video reproduction is judged to be moderate, accordingly, the quality of the video image which has been browsed by the user so far is controlled to be slow reproduction, for example, ½ speed reproduction, so that the load is reduced to ½. “Large load” is a case where an impact on video reproduction is judged to be large like a high pixel/high frame rate video image, and in this case, the quality of the video image which has been browsed by the user so far is controlled to perform skip reproduction, for example, to reproduce only I picture, so that the load is reduced to one several tenth.
The video image display control portion (video image display control means) 38 may also have a function to perform change of the display quality only for a video image other than a video image to which a user pays attention. The video image to which a user pays attention is, for example, a video image on the display apparatus 31 on which a cursor or the like is placed, a video image which is displayed in the center of a screen of the display apparatus, or a video image which is selected by a user operation.
Further, the video image display control portion (video image display control means) 38 may have a function to perform change of the display quality only for an additional video image. For example, as shown in
The video image display portion (video image display means) 34 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail all the video images (the video images currently being displayed and the additional video images) with video image quality and an arrangement which have been determined in the video image display control portion 38.
(Processing Flow of Display Quality Control Portion)
Description will be given in the flowchart of
Assume that a user is browsing the three video images like the display example shown in
The video image display control portion 38 determines display quality and arrangement of the video image according to the load level estimated by the load estimating portion 37, and controls the video image displayed on the video image display portion 34 (S23). Here, when the load level is determined to, for example, “moderate”, the display quality comes to be “slow reproduction”, and the arrangement is, for example, the arrangement as shown in the display example of
In the present flow, all the video images 45 and 46 in the display example of
Note that, in the present embodiment, although description has been given for the display control function when a different video image from a video image currently being viewed is input, it is needless to say that a decrease in the number of video images (for example, a decrease from the six video images as the display example of
With this processing, in a case where an increase of a load related to the processing capacity of the device is expected due to an increase of the video image to be displayed, the display quality of a video image which is currently displayed and a video image to be added is changed, and display is thus able to be continued without interrupting or finishing the plurality of video images.
A configuration of a display apparatus in the fourth embodiment is shown in
The fourth embodiment is comprised of, as shown in
Hereinafter, on the basis of
(Function of Display Quality Control Portion)
The video image detecting portion (video image detecting means) 56 detects an input of video image data from a video image accumulating portion or from a video server via a network, and transmits a detected signal to the load estimating portion 57 and the display delay portion 59. The display delay portion (display delay means) 59 delays, when receiving the video image incoming detected signal, the processing of the detected video image, namely display (reproduction) of the video image by a predetermined time.
The load estimating portion (load estimating means) 57 estimates, when receiving the video image incoming detected signal, a level of a load applied to display of a plurality of video images currently being displayed by the processing related to the video image. The load at this time is a total load to a CPU of the display apparatus 51 that is estimated from a processing amount required for display of the current video image, a processing amount related to display of the additional video image and a processing amount related to video image data, and a battery remaining amount of the display apparatus 51. For example, in a case where, when three video images are displayed, different three video images are received, a load level of a CPU is estimated from the processing amount required for the reproduction processing for a total of six video images, the battery remaining amount of the display apparatus 51 and the like. Note that, the processing amount required for the display of the plurality of the video images depends on the number of pieces of video images displayed on the screen, a size of each video image, the number of frame rates, the resolution and the like.
The video image display control portion (video image display control means) 58 determines display quality of all the video images (the video image currently being displayed and the video image to be added) according to the load level estimated by the load estimating portion (load estimating means) 57, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion 54 (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of all the video images is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. As with the first embodiment, the display quality management table as shown in
The video image display control portion (video image display control means) 58 may have a display timing control function so that all the plurality of video images are switched into the display quality simultaneously after delaying the display.
The video image display control portion (video image display control means) 58 may also perform change of the display quality only for a video image other than a video image to which a user pays attention. The video image to which a user pays attention is, for example, a video image on the display apparatus 51 on which a cursor or the like is placed, a video image which is displayed in the center of a screen of the display apparatus 51, or a video image which is selected by a user operation.
The video image display control portion (video image display control means) 58 may also have a function to perform change of the display quality only for an additional video image.
Additionally, the video image display control portion (video image display control means) 58 may have a function to give a notice to a user about a change in the display quality of a video image during delay of the display.
The video image display portion (video image display means) 54 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail, after a predetermined (delay) time, the video image distributed via the Net and the video currently being displayed, with video image quality and an arrangement which have been determined in the video image display control portion 58.
(Processing Flow of Display Quality Control)
Description will be given in the flowchart of
Assume that a user is browsing the three video images like the display example shown in
The video image display control portion 58 determines display quality and arrangement of the video image according to the load level estimated by the load estimating portion 57, and controls the video image displayed on the video image display portion 34 (S34). Here, when the load level is determined to, for example, “moderate”, the display quality comes to be “slow reproduction”, and the arrangement is, for example, the arrangement as shown in the display example of
Note that, in the present processing flow, the display delay at S32 is set to a predetermined time, and display execution at S35 is performed after the elapse of a predetermined time. However, without setting the time of the processing delay at S32, although not shown in
In this manner, in the fourth embodiment, the display delay portion 59 for an additional video image is provided and display of the video image distributed from the Net or a video image selected from the video image accumulating portion 55 is thereby delayed by a predetermined time, and meanwhile (before a CPU load increases), the display quality of the video image is changed, and display of a plurality of video images corresponding to the processing capacity of the device is thereby able to be performed, so that display of a video image is able to be continued without interrupting or finishing.
Hereinafter, description will be given for an embodiment of the present invention with using the drawings. As an embodiment, as with the first and the second embodiments, on the basis of a display apparatus 71 (
The display apparatus 71 includes a display quality control portion 72, an external data output portion 73, a video image display portion 74, as well as a video image accumulating portion 75. The display quality control portion 72 includes an external data detecting portion 76, a video image detecting portion 86, a load estimating portion 77 and a video image display control portion 78.
In the fifth embodiment, the first embodiment and the third embodiment coexist, and which makes it possible to process both the external data such as an incoming call or mail, and a video image of the video image accumulating portion 75 which is incorporated in the display apparatus 71 and a video image distributed via the Net.
Thereby, when a plurality of video images are displayed on one screen, in addition to the external data such as an incoming call, even when video image data is received from the video image accumulating portion 75 or a video server 81 via a network 80, the display of the video image is able to be continued without interrupting or finishing reproduction thereof.
The load estimating portion 77 in the display quality control portion 72 estimates the load related to both the processing of the external data described in the first embodiment and the video image described in the second embodiment, and the video image display control portion 78 controls, when the external data such as the incoming call is input and/or video image data is added to a video image currently being displayed from the video image accumulating portion 75 and/or the video server 81, so that the display quality of the video image displayed on the screen is changed so as not to exceed the processing capacity of the display apparatus 71, and enables the plurality of video images to be continued to be displayed without interrupting or finishing reproduction thereof.
(Function of Display Quality Control Portion)
The external data detecting portion (external data detecting means) 76 detects an input of external data such as an incoming call or mail via a communication function to the display apparatus 71, and transmits a detected signal to the load estimating portion 77. The video image detecting portion (video image detecting means) 86 detects distribution of a plurality of video images via the Net from the video image accumulating portion 75 and the video server 81, and transmits a detected signal to the load estimating portion 77. The load estimating portion (load estimating means) 77 estimates, when receiving the incoming detected signal of the external data and/or the video image data, a level of a load applied to display of a plurality of video images currently being displayed by the processing related to the external data and/or the video image data. The load at this time is a total load to a CPU of the display apparatus 71 that is estimated from a processing amount required for display of the current video image, a processing amount related to the external data and/or the video image data, and a battery remaining amount of the display apparatus 71.
The video image display control portion (video image display control means) 78 determines display quality of all the video images (the video image currently being displayed and the video image to be added) according to the load level estimated by the load estimating portion (load estimating means) 77, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion 74 (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of all the video images is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. In the fifth embodiment, as with the first embodiment, the display quality management table 15 as shown in
The video image display control portion (video image display control means) 78 may also have a function to perform change of the display quality only for a video image other than a video image to which a user pays attention. Further, the video image display control portion (video image display control means) 78 may have a function to perform change of the display quality only for an additional video image.
The video image display portion (video image display means) 74 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail the video images currently being displayed and the additional video image, with video image quality and an arrangement which have been determined in the video image display control portion.
The external data output portion (external data output means) 73 executes processing of external data (for example, ringing or the like in the case of the incoming call processing).
(Processing Flow of Display Quality Control)
Description will be given in the flowchart of
Assume that a user is browsing the three video images like the display example shown in
The load estimating portion 77 estimates a level of a load applied to display of the video image in the display apparatus 71 by reproduction of the total of the six video images including the three current video images and the three added video images and processing of the external data (S42). The video image display control portion 78 determines display quality and arrangement of the video image according to the load level estimated by the load estimating portion 77, and controls the video image displayed on the video image display portion 74 (S43). Here, when the load level is determined to, for example, “large”, the display quality comes to be “skip reproduction”, and the arrangement is, for example, the arrangement as shown in the display example of
With this processing, in a case where an increase of a load related to the processing capacity of the device is predicted due to an increase of the video image to be displayed and having a phone call, the display quality of the video image currently being displayed and the video image to be added is changed so as not to exceed the processing capacity of the display apparatus 71, and enables the plurality of video images to be continued to be displayed without interrupting or finishing reproduction thereof.
A configuration of a display apparatus 91 in the sixth embodiment is shown in
In the sixth embodiment, as shown in
Hereinafter, on the basis of
(Function of Display Quality Control Portion)
The external data detecting portion (external data detecting means) 96 detects an input of external data such as an incoming call or mail to the display apparatus 91 via a communication function. For example, when detecting an incoming call, an incoming detected signal is transmitted to the processing delay portion 99 and the load estimating portion 97. The video image detecting portion (video image detecting means) 106 detects distribution of video image data from the video image accumulating portion 95 or from a video server 101 via the Net, and transmits a detected signal to the display delay portion 109 and the load estimating portion 97.
The processing delay portion (processing delay means) 99 delays, when receiving the external data incoming detected signal, the processing of the external data (such as ringing in the case of an incoming call) by a predetermined time. The display delay portion (display delay means) 109 delays, when receiving the video image reception signal, the processing of the video image by a predetermined time. The processing of the video image is, for example, reproduction processing of a distributed video image.
The load estimating portion (load estimating means) 97 estimates, when receiving the external data and/or the video image incoming detected signal, a level of a load applied to display of a plurality of video images currently being displayed by the processing related to the external data and/or the video image data. The load at this time is a total load to a CPU of the display apparatus 91 that is estimated from a processing amount required for display of the current video image, a processing amount related to the external data and/or the video image data, and a battery remaining amount of the display apparatus 91.
The video image display control portion (video image display control means) 98 determines display quality of all the video images (the video image currently being displayed and the video image to be added) according to the load level estimated by the load estimating portion (load estimating means) 97, and controls reproduction of each thumbnail video image displayed on the screen at the video image display portion 94 (in the case of encoded data, decoding processing is included) and arrangement of the thumbnails on the screen. For example, when the load level is increased, a frame rate or resolution of all the video images is reduced, a compression rate is increased, or decoding processing is simplified. As a method for simplifying the decoding processing, simplification of motion compensation, omission of a deblocking filter, frame skip, and the like are included. The detail thereof is the same as the above-described embodiments.
The video image display control portion (video image display control means) 98 may also have a display timing control function so that all the plurality of video images are switched into the display quality simultaneously after the elapse (delay) of a predetermined time.
The video image display control portion (video image display control means) 98 may also perform change of the display quality only for a video image other than a video image to which a user pays attention.
The video image display control portion (video image display control means) 98 may also have a function to execute change of the display quality only for an additional video image.
Additionally, the video image display control portion (video image display control means) 98 may have a function to give a notice to a user about a change in the display quality of a video image during delay of the display.
The video image display portion (video image display means) 94 is comprised of, for example, a liquid crystal panel, and displays as a thumbnail all the video images with video image quality and an arrangement which have been determined in the video image display control portion.
The external data output portion (external data output means) 93 executes processing of external data (for example, processing such as ringing in the case of the incoming call processing) which has been delayed in the processing delay portion 99.
(Processing Flow of Display Quality Control)
Description will be given in the flowchart of
Assume that a user is browsing the three video images like the display example shown in
The display delay portion 109 delays, when receiving the video image incoming detected signal, display of the video image by a predetermined time (S52). The processing delay portion 99 delays, when receiving the external data incoming detected signal, the processing of the data (such as ringing) by a predetermined time (S53). The load estimating portion 97 estimates, when receiving the external data and/or the video image incoming detected signal, a level of a load applied to display of the video image in the display apparatus 91 by processing of reproduction of the total of the six video images including the three current video images and the three added video images and the processing of the external data (S54). Note that, in the processing flow, the processing is performed in the order of the display delay, the processing delay, and the estimation of the load level, however, the processing order may be interchanged, or two or three processing may be performed simultaneously.
The video image display control portion 98 determines display quality and arrangement of the video image according to the load level estimated by the load estimating portion 97, and controls the video image displayed on the video image display portion 94 (S55). Here, when the load level is determined to, for example, “large”, the display quality comes to be “skip reproduction”, and the arrangement is, for example, the arrangement as shown in the display example of
In this manner, in the sixth embodiment, the display delay portion and the processing delay portion are provided, and the quality and arrangement of the plurality of video images are controlled before an increase of a CPU load due to an increase of the video image to be displayed and having a phone call and the like, so as to make it possible to continue display of the video image without interrupting or finishing.
Furthermore, the function of the display quality control portion according to above-described each embodiment is able to be realized by a computer. In such a case, a program in which such a functional processing content is described is provided. By executing the program in the computer, the above-described processing is then realized on the computer. The program in which the processing content is described is able to be recorded in a computer-readable recording medium.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2009-109096 | Apr 2009 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2010/057354 | 4/26/2010 | WO | 00 | 10/27/2011 |
