Patent Application
20220329957
The present application claims priority to Taiwan patent application Serial No. 110113007 filed on Apr. 10, 2021, the entire content of which is incorporated by reference to this application.
The present invention pertains to an audio signal processing technology, more specifically to an audio signal processing method and an audio signal processing apparatus for simulating a dual channel audio signal into a multi-channel audio signal.
With the development of the multimedia industry, people are used to watching movies and TV shows, or playing games all the time. In order to have better immersive sound experience, people often wear headphones for watching movies and TV shows, or playing games. However, the traditional headphones can only provide a dual channel listening experience, so that the sound heard by the user will not be immersive enough, e.g. the surrounding sound, while watching movies or TV shows. When playing games, the user wearing the traditional headphones can barely distinguish sounds from multiple directions. In addition, the hearing characteristic of each user may be different, which means each user may have different hearing responses at different frequencies. Therefore, to bring a better listening experience to the user, a new headphone is required to process the sound originally having dual channels into multiple channels, and to compensate the sound at different frequencies according to the hearing characteristic of the user.
The present invention provides an audio signal processing method, capable of converting a dual channel audio signal into a multi-channel signal, and compensating audio signals of different frequencies in response to different users.
The present invention further provides an audio signal processing apparatus that can perform the above-mentioned audio signal processing method.
The present invention provides an audio signal processing method, comprising: separating a left channel audio signal to a center-left channel audio signal and a center-right channel audio signal; separating a right channel audio signal to a side-left channel audio signal and a side-right channel audio signal; processing the center-left channel audio signal and the center-right channel audio signal by a center head related transfer function to simulate the center-left channel audio signal and the center-right channel audio signal at a first audio source position and a second audio source position related to a user respectively; processing the side-left channel audio signal and the side-right channel audio signal by a side head related transfer function to simulate the side-left channel audio signal and the side-right channel audio signal at a third audio source position and a fourth audio source position related to the user respectively; and compensating the center-left channel audio signal and the center-right channel audio signal processed by the center head related transfer function, and the side-left channel audio signal and the side-right channel audio signal processed by the side head related transfer function by a frequency compensation process according to a hearing characteristics of the user to synthesize a dual channel audio signal.
The present invention provides an audio signal processing apparatus, comprising a channel separation unit, an audio computing unit and an audio synthesizing unit. The channel separation unit receives a left channel audio signal and a right channel audio signal, separates the left channel audio signal to a center-left channel audio signal and a center-right channel audio signal, and separates the right channel audio signal to a side-left channel audio signal and a side-right channel audio signal. The audio computing unit receives and processes the center-left channel audio signal and the center-right channel audio signal by a center head related transfer function to simulate the center-left channel audio signal and the center-right channel audio signal at a first audio source position and a second audio source position related to a user respectively, and receives and processes the side-left channel audio signal and the side-right channel audio signal by a side head related transfer function to simulate the side-left channel audio signal and the side-right channel audio signal at a third audio source position and a fourth audio source position related to the user respectively. The audio synthesizing unit compensates the center-left channel audio signal and the center-right channel audio signal processed by the center head related transfer function, and the side-left channel audio signal and the side-right channel audio signal processed by the side head related transfer function by a frequency compensation process according to a hearing characteristics of the user to synthesize a dual channel audio signal.
In some embodiments, the audio signal processing method further comprises playing multiple audio signals with different frequencies to the user, generating a plurality of frequency response values corresponding to the audio signals with the different frequencies to obtain the hearing characteristic of the user, comparing the frequency response values with at least a predetermined value to generate at least a frequency response difference and compensating the audio signals with the different frequencies according to the frequency response difference.
In some embodiments, the audio signal processing apparatus further comprises an audio playing unit and a comparing unit. The audio playing unit playing multiple audio signals with different frequencies to the user, wherein the audio computing unit generates a plurality of frequency response values corresponding to the audio signals with the different frequencies to obtain the hearing characteristic of the user. The comparing unit comparing the frequency response values with at least a predetermined value to generate at least a frequency response difference, wherein the audio computing unit compensates the audio signals with the different frequencies according to the frequency response difference.
To sum up, the audio processing method and the audio processing apparatus provided by the present invention can process the left and right channel audio into four different source azimuth audios, and can process the audios of different frequencies according to the user's hearing performance. Compensation, so that the dual channel audio can also have a surround sound listening experience.
The features, objections, and functions of the present invention are further disclosed below. However, it is only a few of the possible embodiments of the present invention, and the scope of the present invention is not limited thereto; that is, the equivalent changes and modifications done in accordance with the claims of the present invention will remain the subject of the present invention. Without departing from the spirit and scope of the invention, it should be considered as further enablement of the invention.
Specifically, the center-left channel audio signal Cent_L and the center-right channel audio signal Cent_R are equivalent to the front left audio source and the front right audio source to the user, and the side-left channel audio signal Side_L and the side-right channel audio signal Side_R are equivalent to the side left audio source and the side right audio source to the user. In particular, the above-mentioned left channel audio source and right channel audio source are the sound heard by a left ear and a right ear of the user, respectively. The audio computing unit 204 receives the above-mentioned center-left channel audio signal Cent_L, center-right channel audio signal Cent_R, side-left channel audio signal Side_L and side-right channel audio signal Side_R, and process them by a center head related transfer function (HRTF) and a side head related transfer function, respectively. The head related transfer function is a sound localization algorithm. The process of its localization and calculation is known to person having ordinary skill in the art, so it will not be repeated here. Through the operation of the head related transfer function, the center-left channel audio signal Cent_L, center-right channel audio signal Cent_R, side-left channel audio signal Side_L and side-right channel audio signal Side_R are virtualized to audio source positions 301-304 relative to the user 300, as shown in
Further, the audio processing apparatus 200 is, for example, a dual channel headphones, and the stereo separation unit 201, the equalizer 202, the channel separation unit 203, the audio computing unit 204 and the audio synthesis unit 205 are separate or integrated components, circuits or chips inside the headphones. The audio processing apparatus 200 further comprises an audio playing unit and a comparing unit (not shown in figures). The audio playing unit plays multiple audio signals with different frequencies to the user, and the user will give feedback according to the audio signals with different frequencies after listening, so that frequency response values that can represent the user's listening personality are generated. The comparing unit then compares these frequency response values with a present value to generate at least one frequency response difference value. The meaning of the frequency response difference value is that the user may have a weak ability to recognize sounds with certain frequencies, so the audio computing unit 204 can compensate the corresponding audio signal according to the frequency response difference values. Therefore, the user can not only have the experience of surround sound when listening, but also obtain the hearing compensation for the frequency audio with poor recognition ability, which further optimizes the listening experience. In particular, there are various methods for compensation. In this embodiment, for example, the compensation is a preset value. However, the present invention is not limited thereto, and person having ordinary skill in the art can also compensate other values depending on the design or the hearing characteristics of the user.
More specifically, the audio computing unit 204 filters the center-left channel audio signal Cent_L, the center-right channel audio signal Cent_R, the side-left channel audio signal Side_L and the side-right channel audio signal Side_R. In this embodiment, for example, the high-pass filtering is used to filter out wavebands that are relatively insensitive to human hearing sensitivity, and retain wavebands that are more sensitive to human hearing sensitively. However, the present invention is not limited thereto, and person having ordinary skill in the art can also filter different wavebands depending on the design or the characteristics of the user. The audio computing unit 204 performs a convolution calculation on the filtered audio signal and the preset head related transfer function. The convolution calculation is known to person having ordinary skill in the art, so it is not repeated here. After the convolution calculation, the audio signal can be virtualized to various orientations relative to the user, so as to create a surround sound listening experience. In particular, the audio computing unit 204 can also multiply the audio signal after the convolution operation by a preset parameter, and the preset parameter can be any value, which can optimize the intensity of the audio signal according to requirements.
In addition, the synthesizing unit 205 can also receive the center-left channel audio signal Cent_L, the center-right channel audio signal Cent_R that have not been processed by the head related transfer function, and synthesize the audio signal that has not been processed by the head related transfer function and the audio signal that has not been processed by the head related transfer function. That is, the bands that are less sensitive to human hearing are synthesized with the bands that are more sensitive to human hearing. Therefore, the synthesized audio signal can cover wider range of bands to increase the richness of the final output audio signal.
To sum up, the audio processing method and the audio processing apparatus provided by the present invention can process the left and right channel audio into four different source azimuth audios, and can process the audios of different frequencies according to the user's hearing performance. Compensation, so that the dual channel audio can also have a surround sound listening experience.
| Number | Date | Country | Kind |
|---|---|---|---|
| 110113007 | Apr 2021 | TW | national |
