Patent Grant
11115515
This is a National Phase Application filed under 35 U.S.C. 371 as a national stage of PCT/CN2017/105869, filed on Oct. 12, 2017, an application claiming the priority of Chinese Patent Application No 201710612875.0, filed on Jul. 25, 2017, the contents of which are incorporated herein in their entirety by reference.
The present disclosure relates to the field of communication technologies, and particularly relates to a method for playing sound and a multi-screen terminal.
The smart terminals have increasingly higher requirements for sound effects, and the auditory experience of a user is required to be improved as much as possible either in a voice call scenario or a multimedia playing scenario. The existing smart terminals typically use more excellent electroacoustic convertors, integrate a more complicated audio post-processing algorithm in a multimedia playing scenario, and use an audio optimization algorithm in a voice call scenario. The audio post-processing algorithm and the audio optimization algorithm can provide functions such as noise suppression, sound effect enhancement, echo cancellation, voice enhancement and the like, and thus optimize the audio effect of the smart terminal, and improve the auditory experience of the user.
With the rapid development of smart terminals, more and more smart terminals have multiple display screens. When a smart terminal with multiple display screens is used for application display, each of the display screens may display different parts of the same content, or may display different contents. For example, with the existing dual-screen mobile terminal (such as a dual-screen mobile phone), a user can independently operate two display screens. That is, the two screens may be used for watching television, listening to music, surfing the internet and the like, respectively and dependently, so that one smart terminal has multiple functions at the same time. However, when the two display screens are playing sound data simultaneously, loudspeakers on the two display screens have a problem of sound field cancellation, resulting in poor user experience.
In order to solve the above technical problem, the present disclosure provides a method for playing sound and a multi-screen terminal, which can solve the problem of sound field cancellation of multiple loudspeakers of a multi-screen terminal.
To achieve the objects of the present disclosure, the technical solutions in the embodiments of the present disclosure are implemented as follows:
In an embodiment of the present disclosure, there is provided a method for playing sound, including:
detecting, by a multi-screen terminal, a current opening/closing angle or angles between the respective display screens; and
selecting, by the multi-screen terminal according to the detected current opening/closing angle or angles between the respective display screens, a group of prestored audio drive parameters, and outputting the group of audio drive parameters to a power amplification module of the multi-screen terminal; or,
determining whether the detected current opening/closing angle or angles between the respective display screens and the current audio drive parameters are prestored opening/closing angle or angles and audio drive parameters corresponding to an optimal sound field playing effect, respectively, and if not, giving a prompt as to whether the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted.
Optionally, the step of selecting, by the multi-screen terminal according to the detected current opening/closing angle or angles between the respective display screens, a group of prestored audio drive parameters, and outputting the group of audio drive parameters to the power amplification module of the multi-screen terminal specifically includes:
selecting, by the multi-screen terminal, prestored audio drive parameters corresponding to the detected current opening/closing angle or angles between the respective display screens, and outputting the selected audio drive parameters to the power amplification module; or,
calculating, by the multi-screen terminal, similarity between the detected current opening/closing angle or angles between the respective display screens and prestored opening/closing angles between the respective display screens, and selecting the audio drive parameters corresponding to a prestored opening/closing angle or angles with the maximum similarity with the current opening/closing angle or angles, and outputting the audio drive parameters to the power amplification module.
Optionally, assuming that the prestored opening/closing angles between the respective display screens are arrays A1 to An, where n is the number of sets of correspondence relationships among the prestored opening/closing angles between the respective display screens and the sound field playing effects, and the detected current opening/closing angle or angles between the respective display screens form an array B, the step of calculating, by the multi-screen terminal, similarity between the detected current opening/closing angle or angles between the respective display screens and prestored opening/closing angles between the respective display screens specifically includes:
calculating differences between corresponding array elements in the array B and in each of the arrays A1-An and variance and/or weighted average of each group of differences; wherein
the smaller the calculated variance and/or weighted average of the differences between the array elements in the array B and the array elements in an array Ai, the greater the similarity between the array B and the array Ai, where i is a natural number between 0 and n-1.
Optionally, the method further includes:
adjusting by the multi-screen terminal, in case where the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted, the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect; or, giving, on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect.
Optionally, the audio drive parameters include a filter parameter, a gain parameter and a phase parameter.
In an embodiment the present disclosure, there is further provided a method for playing sound, including:
detecting, by a multi-screen terminal, a current opening/closing angle or angles between the respective display screens; and
selecting, according to the detected current opening/closing angle or angles between the respective display screens and a current sound field type, a group of prestored audio drive parameters, and outputting the group of audio drive parameters to a power amplification module of the multi-screen terminal; or,
determining whether the detected current opening/closing angle or angles between the respective display screens, the current audio drive parameters, and the current sound field type are prestored opening/closing angle or angles, audio drive parameters and sound field type corresponding to an optimal sound field playing effect, respectively, and if not, giving a prompt as to whether the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type need to be adjusted.
In an embodiment the present disclosure, there is further provided a multi-screen terminal, including a detecting module, a processing module, a power amplification module and a storage module, wherein:
the detecting module is configured to detect a current opening/closing angle or angles between the respective display screens, and output the detected current opening/closing angle or angles between the respective display screens to the processing module;
the processing module is configured to select, according to the detected current opening/closing angle or angles between the respective display screens, a group of audio drive parameters prestored in the storage module, and output the group of audio drive parameters to the power amplification module; or, determine whether the detected current opening/closing angle or angles between the respective display screens and the current audio drive parameters are opening/closing angle or angles and audio drive parameters prestored in the storage module corresponding to an optimal sound field playing effect, respectively, and if not, give a prompt as to whether the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted;
the power amplification module is configured to output an audio according to the audio drive parameters; and
the storage module is configured to prestore at least one set of correspondence relationships among the opening/closing angles between the respective display screens, the sound field playing effects and the audio drive parameters.
Optionally, the multi-screen terminal further includes an adjusting module, wherein:
the processing module is further configured to send a notification to the adjusting module in case where the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted; and
the adjusting module is configured to adjust, after receiving the notification from the processing module, the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect; or give, on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect.
Optionally, the processing module selecting, according to the detected current opening/closing angle or angles between the respective display screens, a group of audio drive parameters prestored in the storage module, and outputting the group of audio drive parameters to the power amplification module includes:
selecting audio drive parameters prestored in the storage module corresponding to the detected current opening/closing angle or angles between the respective display screens, and outputting the selected audio drive parameters to the power amplification module; or,
calculating similarity between the detected current opening/closing angle or angles between the respective display screens and the opening/closing angles between the respective display screens prestored in the storage module, and selecting the audio drive parameters corresponding to a prestored opening/closing angle or angles with the maximum similarity with the current opening/closing angle or angles, and outputting the audio drive parameters to the power amplification module.
Optionally, assuming that the prestored opening/closing angles between the respective display screens are arrays A1 to An, where n is the number of sets of correspondence relationships among the prestored opening/closing angles between the respective display screens and the sound field playing effects, the detected current opening/closing angle or angles between the respective display screens form an array B, and the processing module calculating similarity between the detected current opening/closing angle or angles between the respective display screens and the opening/closing angles between the respective display screens prestored in the storage module includes:
calculating differences between corresponding array elements in the array B and in each of the arrays A1-An and variance and/or weighted average of each group of differences; wherein
the smaller the variance and/or weighted average calculated from the array B and an array Ai, the greater the similarity of the array B and the array Ai, where i is a natural number between 1 and n.
Optionally, the audio drive parameters include a filter parameter, a gain parameter and a phase parameter.
Optionally, the detecting module includes a mechanical goniometer, a magnetic goniometer or a laser goniometer.
Optionally, the processing module is specifically configured to select, according to the detected current opening/closing angle or angles between the respective display screens and a current sound field type, a group of audio drive parameters prestored in the storage module, and output the group of audio drive parameters to the power amplification module; or, determine whether the current opening/closing angle or angles between the respective display screens, the current audio drive parameters, and the current sound field type are an opening/closing angle or angles, audio drive parameters and sound field type prestored in the storage module corresponding to an optimal sound field playing effect, respectively, and if not, give a prompt as to whether the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type need to be adjusted.
The technical solution of the present disclosure has the following beneficial effects:
According to the method for playing sound and the multi-screen terminal of the present disclosure, by means of prestoring correspondence relationships among the opening/closing angles, the audio drive parameters and the sound field playing effects, the problem of sound field cancellation of multiple loudspeakers of a multi-screen terminal is solved, the audio effect of the multi-screen terminal is optimized, and the auditory experience of a user is thus improved.
The drawings described herein are intended to provide a further understanding of the present disclosure, and are intended to be a part of the present disclosure. The exemplary embodiments of the present disclosure and the description thereof are for explaining the present disclosure and do not constitute an undue limitation of the present disclosure. In the drawings:
For clarity and better understanding of objects, technical solutions and advantages of the present disclosure, embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the embodiments of the present disclosure and features therein may be combined with each other in any manner as long as they are not contradictory.
As shown in
At step 101, a multi-screen terminal detects a current opening/closing angle or angles between the respective display screens.
Optionally, the multi-screen terminal detects the current opening/closing angle or angles between the respective (adjacent) display screens (of the multi-screen terminal) through an angle detecting device.
It should be noted that the angle detecting device of the present disclosure may adopt an existing angle measuring instrument such as a mechanical goniometer, a magnetic goniometer or a laser goniometer. When a mechanical goniometer is used for detection, a mechanical angle detecting element is provided on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, its mechanical structure rotates accordingly, and the mechanical angle detecting element transmits different signals to mark different rotation angles. When a magnetic goniometer is used for detection, a magnetic detecting element (such as a Hall device) is arranged on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, the magnetic detecting element detects a different change in field intensity, and thus measures and calculates different rotation angles. When a laser goniometer is used for detection, a laser ranging element is provided on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, its mechanical structure rotates accordingly, and the distance between the opening-closing parts of the multi-screen terminal also changes accordingly. Then, the laser ranging element measures the distance and in turn calculates the different rotation angles.
At step 102, the multi-screen terminal selects, according to the detected current opening/closing angle or angles between the respective display screens, a group of prestored audio drive parameters, and outputs the group of audio drive parameters to a power amplification module of the multi-screen terminal; or, the multi-screen terminal determines whether the detected current opening/closing angle or angles between the respective display screens and the current audio drive parameters are prestored opening/closing angle or angles and audio drive parameters (together) corresponding to an optimal sound field playing effect, respectively, and if not, gives a prompt as to whether the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted (to be the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect).
Specifically, the audio drive parameters include, but are not limited to, a filter parameter, a gain parameter and a phase parameter. The filter parameter is used for frequency-selection of different frequencies of sound signals for further processing (e.g., amplification, attenuation, rejection, etc.). The gain parameter is used for amplification or attenuation of the frequency-selected sound signals, and generally speaking, different gain parameters are adopted for sound signals of different frequency points. The phase parameter is used for phase shift processing of the sound signals to produce a stereo reverberation effect of the whole sound field so that the sound field could show more space sense and image sense.
It should be noted that the sound field in the present disclosure refers to a space occupied by an elastic medium in which sound waves are present. The medium may be a gas, a liquid or a solid, and the medium involved in environmental acoustics is mainly atmosphere. The sound field may be further classified into free field and reverberant field, diffuse sound field, and so on.
The prestored correspondence relationships among the opening/closing angles, the audio drive parameters, and the sound field playing effects may be set before the multi-screen terminal leaves the factory. For example, by debugging and recording different sound field playing effects corresponding to different opening/closing angles and different audio drive parameters, several different opening/closing angles and audio drive parameters capable of obtaining the optimal sound field playing effect at each of the several opening/closing angles are selected as the prestored correspondence relationships among the opening/closing angles, the sound field playing effects, and the audio drive parameters.
Optionally, the step of selecting, by the multi-screen terminal according to the detected current opening/closing angle or angles between the respective display screens, a group of prestored audio drive parameters, and outputting the group of audio drive parameters to the power amplification module of the multi-screen terminal specifically includes:
selecting, by the multi-screen terminal, prestored audio drive parameters corresponding to the detected current opening/closing angle or angles between the respective display screens, and outputting the selected audio drive parameters to the power amplification module of the multi-screen terminal; or,
calculating, by the multi-screen terminal, similarity between the detected current opening/closing angle or angles between the respective display screens and prestored opening/closing angles (prestored sets of opening/closing angle or angles) between the respective display screens, and selecting the audio drive parameters corresponding to a prestored opening/closing angle or angles with the maximum similarity with the current opening/closing angle or angles, and outputting the selected audio drive parameters to the power amplification module of the multi-screen terminal.
Optionally, assuming that the prestored opening/closing angles between the respective display screens are arrays A1 to An, where n is the number of sets of correspondence relationships among the prestored opening/closing angles between the respective display screens and the sound field playing effects, and the detected current opening/closing angle or angles between the respective display screens form an array B, the step of calculating, by the multi-screen terminal, similarity between the detected current opening/closing angle or angles between the respective display screens and the prestored opening/closing angles between the respective display screens specifically includes:
calculating differences between corresponding array elements in the array B and in each of the arrays A1-An and calculating variance and/or weighted average of each group of differences; wherein
the smaller the calculated variance and/or weighted average of the differences between the array elements in the array B and the array elements in an array Ai, the greater the similarity between the array B and the array Ai, where i is a natural number between 1 and n.
It should be noted that when calculating the variance and/or weighted average of each group of differences, weights of the respective elements in each array of elements are set in advance in the multi-screen terminal according to actual conditions, and when the weights of the respective elements are the same, the weighted average is the average; the smaller the obtained variance and/or weighted average, the greater the similarity.
In an embodiment of the present disclosure, assuming that the multi-screen terminal is a three-screen terminal, and the array Ai includes two array elements (ai0, ai1), where ai0 is an included angle between a first screen and a second screen, and ai1 is an included angle between the second screen and a third screen, where i is a natural number between 1 and n. Assuming that five sets of correspondence relationships between the opening/closing angles between the respective display screens and sound field playing effects are prestored, in which an array A1 of the opening/closing angles between the respective display screens is [90°, 90°], A2 is [30°, 90°], A3 is [90°, 30°], A4 is [60°, 30°], and A5 is [45°, 45°]. Assuming that the detected current opening/closing angles between the respective display screens (i.e., between the first and second screen, and between the second and third screen) form an array B, which is [85°, 95°], then:
firstly, the differences between corresponding array elements in the array B and the arrays A1 to A5 are respectively calculated, i.e., [−5°, 5°], [55°, 5°], [−5°, 60°], [25°, 45°] and [40°, 50°];
next, the average and variance of each group of differences are calculated, i.e., the first group of differences has an average ((−5)+5)/2=0, and a variance ((−5−0)2+(5−0)2)/2=25; the second group of differences has an average (55+5)/2=30, and a variance ((55−30)2+(5−30)2)/2=625; the third group of differences has an average ((−5)+60)/2=27.5, and a variance ((−5−27.5)2+(60−27.5))/2=1056.25; the fourth group of differences has an average (25+45)/2=35, and a variance ((25−35)2+(45−35)2)/2=100; the fifth group of differences has an average (40+50)/2=45, and a variance ((40−45)2+(50−45)2)/2=25. It can be seen from the calculation results that the first group of differences has the minimum average, and the first and fifth groups of differences have the minimum variance. Therefore, the current opening/closing angles between the respective display screens are considered to be most similar to the first group of prestored opening/closing angles between the respective display screens, and thus the audio drive parameters corresponding to the first group of opening/closing angles are output to the power amplification module of the multi-screen terminal.
In an embodiment of the present disclosure, if the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted, the multi-screen terminal adjusts the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect; or, gives (shows) on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect.
Optionally, the present disclosure provides a method for playing sound, including the following steps:
detecting, by a multi-screen terminal, a current opening/closing angle or angles between the respective display screens; and
selecting, according to the detected current opening/closing angle or angles between the respective display screens and a current sound field type, a group of prestored audio drive parameters, and outputting the group of audio drive parameters to a power amplification module of the multi-screen terminal; or,
determining whether the detected current opening/closing angle or angles between the respective display screens, the current audio drive parameters, and the current sound field type are prestored opening/closing angle or angles, audio drive parameters and sound field type corresponding to an optimal sound field playing effect, respectively, and if not, giving a prompt as to whether the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type need to be adjusted.
Optionally, if the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type need to be adjusted, the multi-screen terminal adjusts the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type to the prestored opening/closing angle or angles, audio drive parameters and/or sound field type corresponding to the optimal sound field playing effect, or gives on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type to the prestored opening/closing angle or angles, audio drive parameters and/or sound field type corresponding to the optimal sound field playing effect.
For example, the sound field type may include various types such as soft, clear, heavy bass, and rock style. At this time, among the prestored correspondence relationships among the opening/closing angles, the sound field types, and the sound field playing effects, the same opening/closing angle(s) corresponds to multiple sets of audio drive parameters for obtaining a better sound field playing effect for different sound field types.
As shown in
the detecting module 201 is configured to detect opening/closing angle or angles between the respective display screens, and output the detected current opening/closing angle or angles between the respective display screens to the processing module 202;
the processing module 202 is configured to select, according to the detected current opening/closing angle or angles between the respective display screens, a group of audio drive parameters prestored in the storage module 203, and output the group of audio drive parameters to the power amplification module 204; or, determine whether the current opening/closing angle or angles between the respective display screens and the current audio drive parameters are opening/closing angle or angles and audio drive parameters prestored in the storage module 203 corresponding to an optimal sound field playing effect, respectively, and if not, give a prompt as to whether the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted;
the storage module 203 is configured to prestore at least one set of correspondence relationships among the opening/closing angles between the respective display screens, the sound field playing effects and the audio drive parameters; and
the power amplification module 204 is configured to output an audio according to the audio drive parameters.
It should be noted that the detecting module 201 of the present disclosure may adopt an existing angle measuring instrument such as a mechanical goniometer, a magnetic goniometer or a laser goniometer. When a mechanical goniometer is used for detection, a mechanical angle detecting element is provided on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, its mechanical structure rotates accordingly, and the mechanical angle detecting element transmits different signals to mark different rotation angles. When a magnetic goniometer is used for detection, a magnetic detecting element (such as a Hall device) is arranged on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, the magnetic detecting element detects a different change in field intensity, and thus measures and calculates different rotation angles. When a laser goniometer is used for detection, a laser ranging element is provided on a rotation shaft of the multi-screen terminal. Each time the multi-screen terminal rotates for an angle, its mechanical structure rotates accordingly, and the distance between the opening-closing parts of the multi-screen terminal also changes along. Then, the laser ranging element measures and calculates the distance and thus different rotation angles.
Specifically, as shown in
the processing module 202 is further configured to send a notification to the adjusting module 205 in case where the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters need to be adjusted; and
the adjusting module 205 is configured to adjust, after receiving the notification from the processing module 202, the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect; or give, on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens and/or the current audio drive parameters to the prestored opening/closing angle or angles and/or audio drive parameters corresponding to the optimal sound field playing effect.
Optionally, the audio drive parameters include, but are not limited to, a filter parameter, a gain parameter and a phase parameter. The filter parameter is used for frequency-selection of different frequencies of sound signals for further processing (e.g., amplification, attenuation, rejection, etc.). The gain parameter is used for amplification or attenuation of the frequency-selected sound signal, and generally speaking, different gain parameters are adopted for sound signals of different frequency points. The phase parameter is used for phase shift processing of the sound signals to produce a stereo reverberation effect of the whole sound field so that the sound field could show more space sense and image sense.
It should be noted that the prestored correspondence relationships among the opening/closing angles, the sound field playing effects, and the audio drive parameters may be set before the multi-screen terminal leaves the factory. For example, by debugging and recording different sound field playing effects corresponding to different opening/closing angles and different audio drive parameters, several different opening/closing angles and audio drive parameters capable of obtaining the optimal sound field playing effect at each of the several opening/closing angles are selected as the prestored correspondence relationships among the opening/closing angles, the sound field playing effects, and the audio drive parameters.
Optionally, the processing module 202 selecting, according to the detected current opening/closing angle or angles between the respective display screens, a group of audio drive parameters prestored in the storage module 203, and outputting the group of audio drive parameters to the power amplification module 204 includes:
selecting audio drive parameters prestored in the storage module 203 corresponding to the detected current opening/closing angle or angles between the respective display screens, and outputting the selected audio drive parameters to the power amplification module 204; or,
calculating similarity between the detected current opening/closing angle or angles between the respective display screens and the opening/closing angles between the respective display screens prestored in the storage module 203, and selecting the audio drive parameters corresponding to a prestored opening/closing angle or angles with the maximum similarity with the current opening/closing angle or angles, and outputting the audio drive parameters to the power amplification module 204.
Optionally, assuming that the prestored opening/closing angles between the respective display screens are arrays Al to An, where n is the number of sets of correspondence relationships among the prestored opening/closing angles between the respective display screens and the sound field playing effects, and the detected current opening/closing angle or angles between the respective display screens form an array B, the processing module 202 calculating similarity between the detected current opening/closing angle or angles between the respective display screens and the opening/closing angles between the respective display screens prestored in the storage module 203 includes:
calculating differences between corresponding array elements in the array B and in each of the arrays A1-An and calculating variance and/or weighted average of each group of differences; wherein
the smaller the calculated variance and/or weighted average of the differences between the array elements in the array B and the array elements in an array Ai, the greater the similarity between the array B and the array Ai, where i is a natural number between 1 and n.
It should be noted that when calculating the variance and/or weighted average of each group of differences, weights of the respective elements in each array of elements are set in advance in the multi-screen terminal according to actual conditions, and when the weights of the respective elements are the same, the weighted average is the average; the smaller the obtained variance and/or weighted average, the greater the similarity.
In an embodiment of the present disclosure, assuming that the multi-screen terminal is a three-screen terminal, and the array Ai includes two array elements (ai0,ai1), where ai0 is an included angle between a first screen and a second screen, and ai1 is an included angle between the second screen and a third screen, where i is a natural number between 1 and n. Assuming that five sets of correspondence relationships between the opening/closing angles between the respective display screens and sound field playing effects are prestored, in which an array A1 of the opening/closing angles between the respective display screens is [90°, 90°], A2 is [30°, 90°], A3 is [90°, 30°], A4 is [60°, 30°], and A5 is [45°, 45°]. Assuming that the detected current opening/closing angles between the respective display screens form an array B, which is [85°, 95°], then:
firstly, the differences between corresponding array elements in the array B and the arrays A1 to A5 are respectively calculated, i.e., [−5°, 5°], [55°, 5°], [−5°, 60°], [25°, 45°] and [40°, 50°];
next, the average and variance of each group of differences are calculated, i.e., the first group of differences has an average ((−5)+5)/2=0, and a variance ((−5−0)2+(5−0)2)/2=25; the second group of differences has an average (55+5)/2=30, and a variance ((55−30)2+(5−30)2)/2=625; the third group of differences has an average ((−5)+60)/2=27.5, and a variance ((−5−27.5)2+(60−27.5))/2=1056.25; the fourth group of differences has an average (25+45)/2=35, and a variance ((25−35)2+(45−35)2)/2=100; the fifth group of differences has an average (40+50)/2=45, and a variance ((40−45)2+(50−45)2)/2=25. It can be seen from the calculation results that the first group of differences has the minimum average, and the first and fifth groups of differences have the minimum variance. Therefore, the current opening/closing angles between the respective display screens are considered to be most similar to the first group of prestored opening/closing angles between the respective display screens, and thus the audio drive parameters corresponding to the first group of opening/closing angles are output to the power amplification module 204 of the multi-screen terminal.
Optionally, the processing module 202 is specifically configured to select, according to the detected current opening/closing angle or angles between the respective display screens and a current sound field type, a group of audio drive parameters prestored in the storage module 203, and output the group of audio drive parameters to the power amplification module 204; or, determine whether the current opening/closing angle or angles between the respective display screens, the current audio drive parameters, and the current sound field type are opening/closing angle or angles, audio drive parameters and sound field type prestored in the storage module 203 corresponding to an optimal sound field playing effect, respectively, and if not, give a prompt as to whether the current opening/closing angle or angles between the respective display screens need to be adjusted, the current audio drive parameters and/or the current sound field type.
Optionally, the adjusting module 205 is specifically configured to adjust, after receiving the notification from the processing module 202, the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type to the prestored opening/closing angle or angles, audio drive parameters and/or sound field type corresponding to the optimal sound field playing effect, or give, on a currently used display screen through a user interface, a prompt as to how to adjust the current opening/closing angle or angles between the respective display screens, the current audio drive parameters and/or the current sound field type to the prestored opening/closing angle or angles, audio drive parameters and/or sound field type corresponding to the optimal sound field playing effect.
For example, the sound field type may include various types such as soft, clear, heavy bass, and rock style. At this time, among the prestored correspondence relationships among the opening/closing angles, the sound field types, and the sound field playing effects, the same opening/closing angle(s) corresponds to multiple sets of audio drive parameters for obtaining a better sound field playing effect for different sound field types.
The following preferred embodiment describes how the method for playing sound and the multi-screen terminal of the present disclosure are applied. It should be noted that the preferred embodiment below is only for better describing the present disclosure and should not be construed as limit to the present disclosure.
As shown in
During debugging of the dual-screen mobile terminal, different sound field schemes are debugged according to commonly used different opening/closing angles, and four kinds of audio drive parameters suitable for four common opening/closing angles, 0°, 30°, 150°, 180° (the corresponding opening/closing angle in
For example, for the opening/closing angle of 30° as shown in
(1) Filter parameter and gain parameter: when the opening/closing angle is 30°, the four loudspeakers have an obvious opposite-direction effect, and if the prior art is used, every two opposite loudspeakers may have some cancellation to a certain extent, resulting in a poor sound effect. During the current debugging, a higher gain is made for different frequencies to control the sound field cancellation of opposite loudspeakers and a balancing effect is finally achieved.
(2) Phase parameter: when the opening/closing angle is 30°, the four loudspeakers have an obvious opposite-direction effect, and if the prior art is used, every two opposite loudspeakers may have some cancellation to a certain extent, resulting in a poor sound effect. During the current debugging, pre-broadcast signals of the opposite loudspeakers are shifted in phase with a large amplitude, thus the phases are staggered, and the cancellation is controlled, thereby achieving an effect of surrounding stereo reverberation.
The correspondence relationships between the four common opening/closing angles and audio drive parameters are prestored in the dual-screen mobile terminal.
In use, the terminal detects the opening/closing angle between the respective display screens through an angle detecting device. The angle detecting device may be an angle sensor, a hall sensor, or the like in the prior art, which is not limited herein.
Then, according to the opening/closing angle between the respective display screens, audio drive parameters corresponding to the opening/closing angle between the respective display screens having minimum differences with the prestored opening/closing angle between the respective display screens in the terminal are searched. Corresponding audio drive parameters are extracted and output to a power amplification module of the terminal so that the terminal is turned over between 0° and 180°, and an optimal sound field playing effect is obtained at different opening and closing angles.
Optionally, several optimal sound field schemes and corresponding opening/closing angles are prestored in the dual-screen mobile terminal, and when the current opening/closing angle of the dual-screen mobile terminal are not the opening/closing angle corresponding to the optimal sound field schemes, a prompt as to whether the opening/closing angle between the respective display screens to obtain a better sound field playing effect is given on the currently used display screen. If the user selects to adjust, the opening/closing angle between the display screens are automatically adjusted to the opening/closing angle for obtaining the optimal sound field playing effect, or the user is guided to adjust the opening/closing angle between the display screens to the opening/closing angle for obtaining the optimal sound field playing effect on the currently used display screen.
If the user selects to manually adjust the opening/closing angle between the display screens, on the currently used display screen, the user is graphically guided (including a turnover direction and a turnover target point) to turn over the terminal. The opening/closing angle between the respective display screens is detected in real time and displayed on the currently used display screen, and finally the user is guided to manually turn over the terminal to the optimal sound field angle. For example, if the current opening/closing angle is 120°, and the target is 30°, the user is graphically guided to turn over the terminal in a direction toward the 30° position, and the current opening/closing angle is displayed in real time until the user turns over the terminal to 30°, and then the user is indicated that the turnover is completed.
If the user selects to automatically adjust the opening/closing angle between the respective display screens, a difference between the current opening/closing angle and the target opening/closing angle is calculated, and a motor is controlled to automatically adjust the opening/closing angle between the respective display screens to finally reach an angle corresponding to the optimal sound field. For example, if the current opening/closing angle is 90°, and the target is 30°, the motor automatically adjusts the opening/closing angle between the respective display screens to 30°.
According to the method for playing sound and the multi-screen terminal of the present disclosure, by means of prestoring correspondence relationships among the opening/closing angles, the audio drive parameters and the sound field playing effects, the problem of sound field cancellation of multiple loudspeakers of a multi-screen terminal is solved, the audio effect of the multi-screen terminal is optimized, and the auditory experience of a user is thus improved.
The technical solutions of the present application are not limited to wired devices or wireless terminals, but may be an industrial control display terminal, a portable product or other vehicle-mounted visual devices, and are reliable and low in cost.
One of ordinary skill in the art will appreciate that all or part of the steps described above may be implemented by a program stored in a non-transitory computer readable medium for instructing the associated hardware, such as a read-only memory, a magnetic or optical disk, and the like. Optionally, all or part of the steps in the above embodiments may also be implemented by one or more integrated circuits. Accordingly, respective modules/units in the above embodiments may be implemented in the form of hardware, or in the form of a software function module. The present disclosure is not limited to any particular combination form of hardware and software.
The descriptions above are only preferred embodiments of the present disclosure, which are not used to restrict the present disclosure. For those skilled in the art, the present disclosure may have various changes and variations. Any amendments, equivalent substitutions, improvements, etc. within the principle of the present disclosure are all included in the scope of the protection defined by the appended claims of the present disclosure.
According to the method for playing sound and the multi-screen terminal of the present disclosure, by means of prestoring correspondence relationships among the opening/closing angles, the audio drive parameters and the sound field playing effects, the problem of sound field cancellation of multiple loudspeakers of a multi-screen terminal is solved, the audio effect of the multi-screen terminal is optimized, and the auditory experience of a user is thus improved.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201710612875.0 | Jul 2017 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2017/105869 | 10/12/2017 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2019/019420 | 1/31/2019 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6445574 | Saw et al. | Sep 2002 | B1 |
| 8384615 | Tan et al. | Feb 2013 | B2 |
| 10050456 | Flynn | Aug 2018 | B2 |
| 10198450 | Reeves | Feb 2019 | B2 |
| 20090324002 | Richardson | Dec 2009 | A1 |
| 20110242361 | Kuwahara | Oct 2011 | A1 |
| 20120280924 | Kummer et al. | Nov 2012 | A1 |
| 20140101576 | Kwak | Apr 2014 | A1 |
| 20140157125 | Seo | Jun 2014 | A1 |
| 20170295269 | Hosoi | Oct 2017 | A1 |
| 20170332171 | Kim | Nov 2017 | A1 |
| 20180356904 | Disano | Dec 2018 | A1 |
| 20190278323 | Aurongzeb | Sep 2019 | A1 |
| 20190394563 | Kim | Dec 2019 | A1 |
| 20200164270 | Lin | May 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 102035910 | Apr 2011 | CN |
| 102236690 | Nov 2011 | CN |
| 102340585 | Feb 2012 | CN |
| 102497480 | Jun 2012 | CN |
| 102857628 | Jan 2013 | CN |
| 103051794 | Apr 2013 | CN |
| 103620967 | Mar 2014 | CN |
| 104360797 | Feb 2015 | CN |
| 106131322 | Nov 2016 | CN |
| 106293596 | Jan 2017 | CN |
| 106507251 | Mar 2017 | CN |
| 106791031 | May 2017 | CN |
| 108933978 | Dec 2018 | CN |
| 206251225 | Dec 2018 | CN |
| 2738640 | Jun 2014 | EP |
| H11275686 | Oct 1999 | JP |
| 2001310280 | Nov 2001 | JP |
| 2006157857 | Jun 2006 | JP |
| 2006174133 | Jun 2006 | JP |
| 2007158638 | Jun 2007 | JP |
| 201468288 | Apr 2014 | JP |
| 2014110049 | Jun 2014 | JP |
| 1020150087530 | Jul 2015 | KR |
| 200847731 | Dec 2008 | TW |
| WO-2010028397 | Mar 2010 | WO |
| Entry |
|---|
| European Patent Office. Search Opinion for EP application No. 17919373.5, dated Mar. 9, 2021, pp. 1-5. |
| European Patent Office. Supplementary European Search Report for EP application No. 17919373, dated Mar. 9, 2021, pp. 1-2. |
| Japanese Patent Office. Notice of Reasons for Refusal and translation for JP application No. 2020-503859, dated Mar. 23, 2021, pp. 1-4. |
| Japanese Patent Office. Search Report and translation for JP 2020-503859, dated Feb. 26, 2021, pp. 1-39. |
| WIPO, International Search Report dated Mar. 26, 2018. |
| CN Extended Search Report and Office Action dated Sep. 18, 2020, CN Application No. 2017106128750 (dated Jul. 25, 2017). |
| Number | Date | Country | |
|---|---|---|---|
| 20200153952 A1 | May 2020 | US |
