The present invention relates to an audio device, to a missing band estimation device, to a signal processing method, to a signal processing program, and to a recording medium upon which the signal processing program is recorded, and to a frequency band estimation device.
In recent years, audio devices that replay sound contents recorded in digital format have become widespread. In many cases, in order to reduce the file size, the data for the sound contents is subjected to digital compression processing according to a method such as MP3 (MPEG (Moving Picture Expert Group) Audio Layer-3) or the like. The compressed audio signal that is obtained by decompressing compressed audio data that has been generated by performing the digital compression processing becomes an audio signal in which the high frequency band is more limited than the band that is limited by the sampling frequency (FS) that was employed when obtaining the original audio data before compression processing. And, if compression processing according to the same method is performed upon the high frequency band that is thus limited by the compression processing according to the bit rate of the decompressed signal, then, the lower the bit rate becomes (in other words, the higher the compression ratio becomes), the wider that high frequency band becomes.
Due to this, a technique has been proposed (refer to Patent Document #1, hereinafter termed the “prior art”) for interpolating the high frequency band that lacks the signal component originating due to compression processing, according to the bit rate, in other words according to the compression ratio. In the prior art technique, a discriminating means reads in information including bit rate and so on that is separate from the compressed audio signal obtained by decompressing the compressed audio data. Subsequently, on the basis of the information including bit rate and so on that has been read in, the discriminating means sets a cutoff frequency of a high pass filter that passes a harmonic signal generated by a harmonic generation means. And, the signal component of the high frequency band is interpolated by the signal that has passed through the high pass filter whose cutoff frequency has been set in this manner being combined with the compressed audio signal.
Patent Document #1: Japanese Laid-Open Patent Publication 2004-317622
With the technique of the prior art example described above, since the discriminating means appropriately sets the cutoff frequency of the high pass filter that performs high pass filtering processing upon the harmonic signal generated by the harmonic generation means, accordingly information about bit rate and so on separated from the compressed audio data is read in. In other words, with the technique of the prior art example, the discriminating means is adapted to be able to access a storage device in which the compressed audio data and information such as the bit rate and so on are stored.
However, in recent years, it is often the case that such compressed audio data and information about bit rate and so on are downloaded as sound contents from a server upon a network by a compact portable terminal device. Due to this, in some cases, the compressed audio signal that is generated by the compact portable terminal device is sent to some other audio device, and is outputted as audio sound after having been converted into a high quality audio signal in which high frequency band interpolation has been performed by that audio device.
In such a case, if the technique of the prior art example is applied, it becomes necessary to transmit the information such as the bit rate and so on from the portable terminal device to the other audio device via a path that is different from the path of the compressed audio signal. Accordingly additional functionality in the portable terminal device is required, so that it is difficult to say that it is possible to output high quality audio sound in which interpolation of the high frequency band has been performed with a simple configuration.
Due to this, there has been a demand for a technique that can output audio sound of high quality by performing high frequency band interpolation with a simple configuration. Responding to this requirement is cited as one problem that the present invention can solve.
When considered from a first standpoint, the present invention is an audio device comprising: a harmonic generation unit that generates harmonics of an audio signal that is inputted; a variable high pass filter unit having variable cutoff frequency, that extracts a high frequency component of said harmonics generated by said harmonic generation unit; a first high pass filter unit having a first cutoff frequency, that extracts a high frequency component of said inputted audio signal; a second high pass filter unit having a second cutoff frequency that is higher than said first cutoff frequency, that extracts a high frequency component of said inputted audio signal; and a control unit that controls the cutoff frequency of said variable high pass filter unit on the basis of level of an output signal extracted with said first high pass filter unit and level of an output signal extracted with said second high pass filter unit.
And, when considered from a second standpoint, the present invention is a missing band estimation device comprising: a first high pass filter unit having a first cutoff frequency, that extracts a high frequency component of an audio signal that is inputted; a second high pass filter unit having a second cutoff frequency that is higher than said first cutoff frequency, that extracts a high frequency component of said audio inputted signal; and an estimation unit that estimates a high frequency band for which signal components in said inputted audio signal is missing, on the basis of level of an output signal extracted with said first high pass filter unit and level of an output signal extracted with said second high pass filter unit.
And, when considered from a third standpoint, the present invention is a signal processing method employed in an audio device comprising: a harmonic generation unit that generates harmonics of an audio signal that is inputted; a variable high pass filter unit having variable cutoff frequency, that extracts a high frequency component of said harmonics generated by said harmonic generation unit; a first high pass filter unit having a first cutoff frequency and that extracts a high frequency component of said inputted audio signal; and a second high pass filter unit having a second cutoff frequency that is higher than said first cutoff frequency and that extracts a high frequency component of said inputted audio signal, the signal processing method comprising the steps of: acquiring level of an output signal extracted with said first high pass filter unit and level of an output signal extracted with said second high pass filter unit; and controlling the cutoff frequency of said variable high pass filter unit on the basis of the results of acquisition by said acquiring step.
And, when considered from a fourth standpoint, the present invention is a signal processing program, wherein it causes a computer in an audio device to execute a signal processing method according to the present invention.
And, when considered from a fifth standpoint, the present invention is a recording medium, wherein a signal processing program according to the present invention is recorded thereon in a form that can be read by a computer in an audio device.
And, when considered from a sixth standpoint, the present invention is a frequency band estimation device comprising: a first high pass filter unit having a first cutoff frequency, that extracts a high frequency component of said inputted audio signal; a second high pass filter unit having a second cutoff frequency that is higher than said first cutoff frequency, that extracts a high frequency component of said inputted audio signal; and an estimation unit that estimates a high frequency band of said inputted audio signal, on the basis of level of an output signal extracted with said first high pass filter unit and level of an output signal extracted with said second high pass filter unit.
In the following, an embodiment of the present invention will be explained with reference to
[Configuration]
The schematic configuration of an audio device 100 according to the embodiment of the present invention is shown in
Here, the compressed audio decompression device 200 decompresses compressed audio data that has been generated in conformity with a predetermined standard, such as the MP3 standard or the like, and generates a compressed audio signal CAD (i.e. an audio signal). The compressed audio signal CAD that has been generated in this manner is sent to the audio device 100.
Note that, in the embodiment, the compressed audio signal CAD is a compressed audio signal corresponding to any of the three bit rates “BR1”, “BR2 (>BR1)”, and “BR3 (>BR2)”.
Moreover, the audio sound output device 300 comprises a speaker SP. The audio sound output device 300 receives a signal HID after high frequency interpolation sent from the audio device 100. And, the audio sound output device 300 outputs sound from the speaker SP corresponding to the signal HID after high frequency interpolation.
<Configuration of the Audio Device 100>
The audio device 100 comprises a harmonic generation unit (HMG) 110 and a missing band estimation device (MBE) 120. Moreover, the audio device 100 comprises a variable high pass filter (HPF) unit 130 and a combination unit 140.
The harmonic generation unit 110 receives the compressed audio signal CAD sent from the compressed audio decompression device 200. Subsequently, the harmonic generation unit 110 generates the first through the N-th order harmonic components of predetermined frequency bands (0 through FH) of the compressed audio signal CAD. And, among these harmonics that have been generated, the components that are less than or equal to the highest frequency FMAX (=FS/2) of the audio band before compression determined by the sampling frequency FS are sent to the variable HPF unit 130 as a signal HMD.
The missing band estimation device 210 receives the compressed audio signal CAD sent from the compressed audio decompression device 200. Subsequently, on the basis of the compressed audio signal CAD, the missing band estimation device 200 estimates a high frequency band (hereinafter sometimes termed the “missing band”) for which a signal component is missing in the compressed audio signal CAD. And, the missing band estimation device 120 sends a cutoff frequency designator HPC that designates the lowest frequency of that estimated missing band to the variable HPF unit 130.
Here, estimating the missing band in the compressed audio signal CAD is the same thing as estimating the frequency band of the compressed audio signal CAD. Due to this, the missing band estimation device 120 also has a function of serving as a frequency band estimation device that estimates the frequency band of the compressed audio signal CAD.
Note that the details of the configuration of the missing band estimation device 120 will be described hereinafter.
The variable HPF unit 130 receives the signal HMD sent from the harmonic generation unit 110. Moreover, the variable HPF unit 130 receives the cutoff frequency designator HPC sent from the missing band estimation device 120. And, the variable HPF unit 130 performs high pass filtering processing upon the signal HMD while taking the frequency designated by the cutoff frequency designator HPC as cutoff frequency. The result of the high pass filtering processing is sent to the combination unit 140 as a signal HBD.
The combination unit 140 receives the compressed audio signal CAD sent from the compressed audio decompression device 200. Moreover, the combination unit 140 also receives the signal HBD sent from the variable HPF unit 130. And, the combination unit 140 performs combination upon the compressed audio signal CAD and the signal HBD, thereby generating a signal HID after high frequency interpolation. The signal HID that has been generated after high frequency interpolation in this manner is sent to the audio sound output device 300.
Note that the details of the configuration of the combination unit 140 will be described hereinafter.
Now, the relationship between the bit rate and the compressed audio band will be explained. The average spectrum of the audio sound before compression, which corresponds to digital musical sound that has been generated by sampling at the sampling frequency FS, is schematically shown in
The signal bands of the compressed audio signals obtained by decompressing compressed audio data having the bit rates BR1 through BR3 described above and obtained by compressing the audio data before compression are shown in
Moreover, the signal band of the audio sound that has been compressed at the bit rate BR2 (>BR1) is shown in
Yet further, the signal band of the audio sound that has been compressed at the bit rate BR3 (>BR2) is shown in
(The Configuration of the Missing Band Estimation Device 120)
Next, the configuration of the missing band estimation device 120 will be explained.
As shown in
The HPF unit 1211 performs high pass filtering processing with a cutoff frequency FC1. The HPF unit 1211 receives the compressed audio signal CAD sent from the compressed audio decompression device 200. And, the HPF unit 1211 performs high pass filtering processing upon the compressed audio signal CAD with the cutoff frequency FC1. The result of the high pass filtering processing is sent to the subtraction unit 122 as a signal HPD1.
The HPF unit 1212 performs high pass filtering processing with a cutoff frequency FC2 (>FC1). The HPF unit 1212 receives the compressed audio signal CAD sent from the compressed audio decompression device 200. And, the HPF unit 1212 performs high pass filtering processing upon the compressed audio signal CAD with the cutoff frequency FC2. The result of the high pass filtering processing is sent to the subtraction unit 122 and to the level detection unit 1232 as a signal HPD2.
The subtraction unit 122 receives the signal HPD1 sent from the HPF unit 1211. Furthermore, the subtraction unit 122 receives the signal HPD2 sent from the HPF unit 1212. And, the subtraction unit 122 subtracts the signal HPD2 from the signal HPD1. The result calculated in this manner is sent to the level detection unit 1231 as a signal SBD.
The level detection unit 1231 receives the signal SBD sent from the subtraction unit 122. And, the level detection unit 1231 detects the power level of the signal SBD. The result of detection by the level detection unit 1231 is sent to the estimation unit 124 as a detection level DL1.
The level detection unit 1232 receives the signal HPD2 sent from the HPF unit 1212. And, the level detection unit 1232 detects the power level of the signal HPD2. The result of detection by the level detection unit 1232 is sent to the estimation unit 124 as a detection level DL2.
The estimation unit 124 receives the detection level DL1 sent from the level detection unit 1231. Moreover, the estimation unit 124 receives the detection level DL2 sent from the level detection unit 1232. And, the estimation unit 124 estimates the missing band in the compressed audio signal CAD on the basis of the ratio R (=DL1/DL2) between the detection level DL1 and the detection level DL2.
Subsequently, the estimation unit 124 generates a cutoff frequency designator HPC that designates the lower limit frequency of the estimated missing band. The cutoff frequency designator HPC that has been designated in this manner is sent to the variable HPF unit 130.
Note that examples of the filtering characteristics of the HPF unit 1211 and of the HPF unit 1212 are shown in
Here, for each of the bit rates BR1, BR2, and BR3, the filtering characteristic of the HPF unit 1212 is set so that, when the ratio R is calculated, overflow of the division resource of the estimation unit 124 does not occur.
Moreover, the signal components corresponding to the subjects of detection by the HPF unit 1211 and the HPF unit 1212 are schematically shown in
Here, for the case of the bit rate BR1, the signal components corresponding to the subjects of detection by the HPF unit 1211 and by the HPF unit 1212 are schematically shown in
As will be understood by comparison between
(The Configuration of the Combination Unit 140)
Next, the configuration of the combination unit 140 will be explained.
As shown in
The delay unit 141 receives the compressed audio signal CAD sent from the compressed audio decompression device 200 (=D0(T), where T is time). And, the delay unit 141 generates a signal DLD (=D(T)) by delaying the compressed audio signal CAD by just a time interval TDL that corresponds to the phase delay in the harmonic generation unit 110 and the variable HPF unit 130. Here, the relationship between the signal D(T) and the compressed audio signal D0(T) is given by the following Equation (1):
D(T)=D0(T−TDL) (1)
The result is that the synchronization between the signal DLD and the signal HBD outputted from the variable HPF unit 130 becomes as planned. The DLD signal that has been generated in this manner is sent to the multiplication unit 1421.
The multiplication unit 1421 receives the signal DLD sent from the delay unit 141. And, the multiplication unit 1421 multiplies the signal DLD by K1, thus generating a signal MLD. The signal MLD that has been generated in this manner is sent to the addition unit 143.
The multiplication unit 1422 receives the signal HBD sent from the variable HPF unit 130. And, the multiplication unit 1422 multiplies the signal HBD by K2, thus generating a signal MHD. The signal MHD that has been generated in this manner is sent to the addition unit 143.
Note that the ratio between the value K1 and the value K2 is determined in advance on the basis of experiment, simulation, experience and so on, from the standpoint of appropriate high frequency interpolation.
The addition unit 143 receives the signal MLD sent from the multiplication unit 1421. Moreover, the addition unit 143 receives the signal MHD sent from the multiplication unit 1422. And, the addition unit 143 generates a signal HID after high frequency interpolation by adding together the signal MLD and the signal MHD. The signal HID after high frequency interpolation that has been generated in this manner is sent to the audio sound output device 300.
Spectrums of signals MHD that have been generated in this manner are shown in
As shown in
[Operation]
Next, the operation of the audio device 100 having the configuration as described above will be explained, with attention principally being focused upon the processing for generation of the signal HBD on the basis of the compressed audio signal CAD (refer to
When the compressed audio decompression device 200 starts supply of the compressed audio signal CAD, in the audio device 100, the harmonic generation unit 110 and the missing band estimation device 120 receive the compressed audio signal CAD. Moreover, in the audio device 100, the combination unit 140 receives the compressed audio signal CAD (refer to
Upon receipt of the compressed audio signal CAD, the harmonic generation unit 110 generates harmonics of components of a predetermined frequency band of the compressed audio signal CAD. And, among the harmonics that are generated, the harmonic generation unit 110 sends the components at less than the highest frequency FMAX of the band of the audio sound before compression determined by the sampling frequency FS to the variable HPF unit 130 (refer to
On the other hand, upon receipt of the compressed audio signal, the estimation device 120, in parallel with the high frequency generation by the harmonic generation unit 110, also, on the basis of the compressed audio signal CAD, estimates the missing band in the compressed audio signal CAD. During the estimation of the missing band, in the missing band estimation device 120, the HPF unit 1211 that has received the compressed audio signal CAD performs high pass filtering processing at the cutoff frequency FC1 upon the compressed audio signal CAD. And, the HPF unit 1211 sends the result of the high pass filtering processing to the subtraction unit 122 as the signal HPD1 (refer to
Furthermore, upon receipt of the compressed audio signal CAD, in parallel with the high pass filtering processing performed by the HPF unit 1211, the HPF unit 1212 performs high pass filtering processing with the cutoff frequency FC2 upon the compressed audio signal CAD. And, the HPF unit 1212 sends the result of the high pass filtering processing to the subtraction unit 122 and to the level detection unit 1232 as the signal HPD2 (refer to
Upon receipt of the signal HPD1 sent from the HPF unit 1211 and of the signal HPD2 sent from the HPF unit 1212, the subtraction unit 122 calculates the difference between the signal HPD1 and the signal HPD2. And, the subtraction unit 122 sends the differential that it has calculated to the level detection unit 1231 as a signal SBD (refer to
Upon receipt of the signal SBD sent from the subtraction unit 122, the level detection unit 1231 detects the power level of the signal SBD. And, the level detection unit 1231 sends the result of the detection to the estimation unit 124 as a detection level DL1 (refer to
Upon receipt of the signal HPD2 sent from the HPF unit 1212, the level detection unit 1232 detects the power level of the signal HPD2. And, the level detection unit 1232 sends the result of the detection to the estimation unit 124 as a detection level DL2 (refer to
Upon receipt of the detection level DL1 sent from the level detection unit 1231 and of the detection level DL2 sent from the level detection unit 1232, the estimation unit 124 generates a cutoff frequency designator HPC on the basis of the detection level DL1 and the detection level DL2. And, when generating the cutoff frequency designator HPC, the estimation unit 124 first calculates the ratio R (=DL1/DL2) between the detection level DL1 and the detection level DL2.
Subsequently, the estimation unit 124 estimates the missing band of the compressed audio signal on the basis of the ratio R that has been calculated.
Next, the estimation unit 124 generates the cutoff frequency designator HPC that specifies the lower limit frequency of the missing band that has been estimated. And, the estimation unit 124 sends the cutoff frequency designator HPC that it has generated to the variable HPF unit 130 (refer to
Upon receipt of the cutoff frequency designator HPC sent from the missing band estimation device 120 (more exactly, from the estimation unit 124), the variable HPF unit 130 performs high pass filtering processing with the frequency designated by the cutoff frequency designator HPC as the cutoff frequency upon the signal HMD sent from the harmonic generation unit 110, and thereby generates a signal HBD. And, the variable HPF unit 130 sends the signal HBD that it has generated to the combination unit 140 (refer to
Upon receipt of the signal HBD from the variable HPF unit 130, the combination unit 140 performs combination of the signal HBD and the compressed audio signal CAD sent from the compressed audio decompression device 200. During the combination, in the combination unit 140, the delay unit 141 delays the compressed audio signal CAD by just a time interval TDL that corresponds to the phase delay in the harmonic generation unit 110 and the variable HPF unit 130, and generates a signal DLD synchronized with the signal HBD. And, the delay unit 141 sends the signal DLD that it has generated to the multiplication unit 1421 (refer to
Upon receipt of the signal DLD sent from the delay unit 141, the multiplication unit 1421 generates a signal MLD by multiplying the signal DLD by K1. And, the multiplication unit 1421 sends the signal MLD that it has generated to the addition unit 143 (refer to
On the other hand, the multiplication unit 1422 generates a signal MHD by multiplying the signal HBD by K2. And, the multiplication unit 1422 sends the signal MHD that it has generated to the addition unit 143 (refer to
Upon receipt of the signal MLD sent from the multiplication unit 1421 and of the signal MHD sent from the multiplication unit 1422, the addition unit 143 adds together the signal MLD and the signal MHD, and generates a signal HID upon which high frequency interpolation has been performed. And, the addition unit 143 sends the signal HID after performance of high frequency interpolation that it has generated to the audio sound output device 300 (refer to
In other words, while synchronizing the signal HBD and the compressed audio signal CAD, the combination unit 140 combines the signal HBD and the compressed audio signal CAD by performing weighted addition at a mixing ratio at which high frequency interpolation can be appropriately performed. The signal HID after high frequency interpolation that has been generated as the result of the combination is then sent to the audio sound output device 300.
Upon receipt of the signal HID after high frequency interpolation that has been sent from the audio device 100 (more exactly, from the combination unit 140), the audio sound output device 300 outputs sound according to the signal HID after high frequency interpolation from the speaker SP. As a result, audio sound of high quality upon which high frequency interpolation corresponding to the bit rate of the compressed audio signal CAD has been appropriately performed is outputted from the audio sound output device 300.
As has been explained above, in the embodiment, during the high frequency interpolation, first, the harmonic generation unit 110 generates harmonics of the compressed audio signal CAD. In parallel with the generation of harmonics, the missing band estimation device 120 estimates the missing band in the compressed audio signal CAD.
During the missing band estimation, in the missing band estimation device 120, along with the high pass filter unit 1211 that has the cutoff frequency FC1 extracting a high frequency component of the compressed audio signal CAD, also the high pass filter unit 1212 that has the cutoff frequency FC2 (which >FC1) extracts a high frequency component of the compressed audio signal CAD. Subsequently, in the missing band estimation device 120, the estimation unit 124 calculates the ratio R between the level of the difference signal SBD obtained by subtracting the signal HPD2 outputted from the high pass filter unit 1212 (i.e. the second high pass filter unit) from the signal HPD1 outputted from the high pass filter unit 1211 (i.e. the first high pass filter unit), and the level of the signal HPD2. Note that, if the bit rate of the compressed audio signal CAD is different, then the filtering characteristics of the high pass filter units 1211 and 1212 are set so that the ratio R is different.
Next, on the basis of the ratio R that has been calculated, the estimation unit 124 estimates the missing band of the compressed audio signal CAD. And, the estimation unit 124 controls the high pass filtering processing by the variable HPF unit 130 by sending the cutoff frequency designator HPC that specifies the lower limit frequency of the estimated missing band to the variable HPF unit 130.
Based upon the control, the variable HPF unit 130 performs high pass filtering processing with the frequency specified by the cutoff frequency designator HPC as cutoff frequency upon the signal HMD sent from the harmonic generation unit 110, and thereby generates the signal HBD. And, the compressed audio signal CAD and the signal HBD are combined by the combination unit 140.
Thus according to the embodiment, with a simple configuration, it is possible to output audio sound of high quality upon which high frequency band interpolation has been appropriately performed.
The present invention is not to be considered as being limited to the embodiment described above; modifications of various types can be implemented thereto.
For example, in the embodiment, it was arranged to estimate the missing band of the compressed audio signal that is inputted on the basis of the ratio between the level of the difference signal obtained by subtracting the signal outputted from the second high pass filter unit from the signal outputted from the first high pass filter unit, and the level of the signal outputted from the second high pass filter unit. By contrast, it would be possible to arrange to estimate the frequency band of the compressed audio signal that is inputted on the basis of the ratio between the level of the signal outputted from the first high pass filter unit and the level of the signal outputted from the second high pass filter unit. And, it would be possible for the cutoff frequency designator that specifies the upper limit frequency for the estimated frequency band to be performed for the variable HPF unit.
Moreover, it would be possible to arrange to employ a high pass filter unit having filtering characteristics that are different from the characteristics of the high pass filter unit shown by way of example in the embodiment, provided that, when the bit rate of the compressed audio signal is different, the ratio between the level of the signal outputted from the first high pass filter unit and the level of the signal outputted from the second high pass filter unit is different.
Furthermore while, in the embodiment, it was arranged to apply the present invention to high frequency interpolation of a compressed audio signal, it would be possible to arrange to apply the present invention to high frequency interpolation of an audio signal that is a different type of signal from a compressed audio signal.
Note that it would be possible to arrange to perform all or a part of the processing of the embodiment by configuring the audio device of the embodiment as a computer that is provided with a DSP (Digital Signal Processor) or the like as a calculation means, and by executing a program that has been prepared in advance with that computer. It would be possible for the program to be acquired in the format of being recorded upon a transportable recording medium such as a CD-ROM, a DVD, or the like; or it would be possible to arrange for the program to be acquired by the method of transmission via a network such as the internet or the like.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2014/058859 | 3/27/2014 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2015/145660 | 10/1/2015 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20100145685 | Nilsson | Jun 2010 | A1 |
20100223052 | Nilsson | Sep 2010 | A1 |
20120275607 | Kjoerling et al. | Nov 2012 | A1 |
20130163784 | Tracey | Jun 2013 | A1 |
20150030181 | Kimura | Jan 2015 | A1 |
20150051905 | Gao | Feb 2015 | A1 |
Number | Date | Country |
---|---|---|
2004-317622 | Nov 2004 | JP |
2007-192964 | Aug 2007 | JP |
2011-203480 | Oct 2011 | JP |
2013-511752 | Apr 2013 | JP |
Entry |
---|
International Search Report, PCT/JP2014/058859, dated May 27, 2014. |
Number | Date | Country | |
---|---|---|---|
20170103772 A1 | Apr 2017 | US |