Patent Application
20110081101
1. Technical Field
The disclosed embodiments relate to methods for displaying multimedia data, and more particularly to devices for displaying multimedia data which can play music and display pictures by emotional type modes.
2. Description of the Related Art
With the development of artificial intelligence, applications in consumer electronic products are being demanded. However, media players for playing music and displaying pictures do not provide sufficient artificial intelligence-like functions, such that emotional type mode functions may not sufficiently match user requirements. Thus, manual operation may be required for setting an emotional type mode, such as setting a display effect and a display speed for a picture to be played, to match with a type of music.
Thus, it is desired to provide a method and device for displaying multimedia data, which can play music and display pictures simultaneously according to an emotional type mode without manual operation.
An exemplary embodiment of method for displaying multimedia data is provided, comprising the steps of: providing an audio bitstream and at least one picture; analyzing the audio bitstream to obtain at least one feature value thereof; determining a playback model from a plurality of playback models to play the audio bitstream therewith according to the at least one feature value of the audio bitstream; playing the audio bitstream; and displaying the at least one picture according to the determined playback model while the audio bitstream is being played.
Another exemplary embodiment of method for displaying multimedia data is provided, comprising the steps of: providing a plurality of pictures and a plurality of different types of music; analyzing at least one of the pictures to obtain at least one feature value thereof; determining a playback model among a plurality of play models to display at least one of the pictures according to the at least one feature value of at least one of the pictures; selecting one type of music among the different types of music according to the determined playback model; playing the selected type of music; and displaying the at least one of the pictures according the determined playback model while the selected type of music is being played.
An exemplary embodiment of a device for displaying multimedia data according to a plurality of playback models is provided. The device comprises a first memory, a second memory, a processing module, a determination module, a music playing module, and a display module. The first memory stores a plurality of audio bitstreams. The second memory stores a group of pictures. The processing module receives and analyzes one of the audio bitstreams in a music priority mode or at least one picture of the group of pictures in a picture priority mode to generate at least one feature value. The determination module receives the at least one feature value and determines one of the playback models to play the analyzed audio bitstream in the music priority therewith or display the analyzed picture in the picture priority mode therewith according to the at least one feature value. The determination module further generates a first indication signal and a second indication signal according to the determined playback model. The music playing module plays one of the audio bitstreams in the music priority mode according to the first indication signal or plays one type of audio bitstreams in the picture priority mode according to the first indication signal. The display module displays the group of pictures in the music priority mode according to the second indication signal and displays the at least one picture of the group of pictures in the picture priority mode according to the second indication signal.
A detailed description is given in the following embodiments with reference to the accompanying drawings.
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
Devices for displaying multimedia data according to a plurality of playback models are provided. In an exemplary embodiment of a device for displaying multimedia data in
The music playing module 14 comprises a playback controller 140 and an audio output element 141 controlled by the playback controller 140, such as speaker, line-out jacks and headphones. The display module 15 comprises a display controller 150 and a display element 151 controlled by the display controller 150, such as panels and Liquid crystal display (LCD).
In the following, the operation of the device 1 in the music priority mode and the picture priority mode is described according to
Assume that the at least one feature value is the frequency variation value, and two reference values FH and FL are defined in advance, wherein the reference value FH is larger than the reference value FL. One model audio bitstream is played to the listeners. The listeners then determine their emotional feelings to the type of model audio bitstream (step S32), such as rock-and-roll music, romantic music, or general music. The played model audio bitstream is analyzed to obtain its frequency variation value (step S33), and the obtained frequency variation value is compared with the reference values FH and FL (step S34). A sufficient amount of model audio bitstreams are played to the listeners, and the operations of the steps S32, S33, and S35 are performed. By performing a statistics operation and a classification operation to the emotional feeling responses of the listeners and the comparison results of the model audio bitstreams, three playback models for the music priority mode may be built as follows.
The first playback model is: an audio bitstream with a frequency variation value FV larger than the reference value FH is classified as a first type of music, such as rock-and-roll music, and desired pictures are displayed with a predetermined display effect and/or a predetermined display effect corresponding to the first playback model while the audio bitstream is being played, wherein the predetermined display effect in the first playback model is a quick transition effect and the predetermined display effect is a fast display speed, as shown in Table 1.
The second playback model is: an audio bitstream with a frequency variation value FV less than the reference value FL is classified as a second type of music, such as romantic music, and desired pictures are displayed with a predetermined display effect and/or a predetermined display effect corresponding to the second playback model while the audio bitstream is being played, wherein the predetermined display effect in the second playback model is a progressive transition effect and the predetermined display effect is a slow display speed, as shown in Table 1.
The third playback model is: an audio bitstream with a frequency variation value FV larger than the reference value FL and less than the reference value FH is classified as a third type of music such as general music, and desired pictures are displayed with a predetermined display effect and/or a predetermined display effect corresponding to the third playback model while the audio bitstream is being played, wherein the predetermined display effect in the third playback model is a general transition effect between the quick and progressive transition effects and the predetermined display effect is an average display speed between the fast and slow display speed, as shown in Table 1.
In some embodiments, the display effect can be a wipe transition effect, a diagonal wipe transition effect, an extend transition effect, a compress transition effect, a window transition effect, or a fade-in transition effect according to determination of the playback models. Table 1 is only an example for illustrative purposes only, and is not meant to be a limitation of the present invention.
Referring to
For example, when the frequency variation value of the analyzed audio bitstream is larger than the reference value FH, the determination module 13 determines that the first playback module will be used. The display panel 151 displays at least one picture with the quick transition effect and the fast display speed while the audio bitstream is being played.
According to the embodiment of
Moreover, assuming an audio bitstream stored in the memory 10 can be divided into several successive audio clips according to types of music of each audio clips, these audio clips are alternately provided to the processing module 12 to obtain feature values thereof. The determination module 13 then determines the playback models for each audio clip. Accordingly, the display effect and display speed for the pictures vary with the type of music of each audio clips.
Assume that the at least one feature value is the shutter speed value, and two reference values SH and SL are defined, wherein the reference value SH is larger than the reference value SL. One model picture is displayed to the viewers. The viewers make emotional feeling responses to the content of the model picture (step S52), such as a dynamic picture, a static picture, or a general picture. The displayed model picture is analyzed to obtain its shutter speed value (step S53), and the shutter speed value is compared with the reference values SH and SL (step S54). A sufficient amount of model pictures are displayed to the viewers, and the operations of the steps S52, S53, and S54 are performed. By performing a statistics operation and a classification operation to the emotional feeling responses and the comparison results of the model pictures, three playback models for the picture priority mode may be built as follows.
The first playback model is: a picture among a group of pictures with shutter speed value SV larger than the reference value SH is classified as a first type of pictures, such as dynamic pictures, and the group of pictures is displayed with a predetermined display effect and/or a predetermined display effect corresponding to the first playback model, wherein the predetermined display effect in the first playback model is a quick transition effect and the predetermined display effect is a fast display speed, and a first type of music corresponding to the first playback model, such as rock-and-roll music, is selected and played while the group of pictures is being displayed, as shown in Table 2.
The second playback model is: a picture among a group of pictures with shutter speed value SV less than the reference value SL is classified as a second type of pictures such as static pictures, and the group of pictures is displayed with a predetermined display effect and/or a predetermined display effect corresponding to the second playback model, wherein the predetermined display effect in the second playback model is a progressive transition effect and the predetermined display effect is a slow display speed, and a second type of music corresponding to the second playback model, such as romantic music, is selected and played while the group of pictures is being displayed, as shown in Table 2.
The third playback model is: a picture among of a group of pictures with shutter speed value SV larger than the reference value SL and less than the reference value SH is classified as a third type of pictures, such as general pictures, and the group of pictures is displayed with a predetermined display effect and/or a predetermined display effect corresponding to the third playback model, wherein the predetermined display effect in the third playback model is a general transition effect between the quick and progressive transition effects and the predetermined display effect is an average display speed between the fast and slow display speed, and a third type of music corresponding to the third playback model, such as general music, is selected and played while the group of pictures is being displayed, as shown in Table 2. It is noted that Table 2 is only an example for illustrative purposes only, and is not meant to be a limitation of the present invention. Moreover, a plurality of pictures of the group of pictures may be utilized for determining the playback model for the picture priority mode.
Referring to
For example, when the shutter speed value of the analyzed picture is larger than the reference value SH, the determination module 13 determines that the first playback module is used. The playback controller 140 selects the rock-and-roll type of music to be played by the audio output element 141. The display element 151 displays the group of pictures with the quick transition effect and the fast display speed while the rock-and-roll type of music is being played.
According to the embodiment of
Moreover, assuming that several pictures among one group of picture stored in the memory 11 are processed by the processing module 12 to obtain respective feature values for determination of the playback model. The processing module 12 performs a statistics operation to the feature values to obtain a final feature value, and the determination module 13 determines the playback model to be used according to the final feature value and the reference values.
In the music and picture priority modes, after the determination module 13 determines the playback model to be used to play music and display pictures simultaneously, the display module 15 can modify color temperatures, color hues, contrasts, brightness values, and/or saturation degrees of the pictures according to the determined playback model, so that the contents of the modified pictures further match the played type of music. In some embodiments, after the playback model is determined in the picture priority mode, the music playing module 14 can also modify the bass, treble, or balance of music to be played, so that the type of the modified music further matches the contents of the pictures to be displayed.
While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
