Patent Application
20180211643
This application claims priority from Korean Patent Application No. 10-2017-0012941, filed on Jan. 26, 2017 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
Apparatuses and methods consistent exemplary embodiments relate to an electronic apparatus and a control method thereof, and more particularly to an electronic apparatus capable of detecting a music scale of an audio signal and a control method thereof.
The related scale obtain methods include the Fourier transform-based (FFT-based) method of converting into the frequency domain, or the method of obtaining a self-correlation by giving input data a delay as much as the target pitch, for example.
In the FFT-based method, scales of wide octave bands may be obtained by a single computation, but a wide window may be required to obtain a sufficient resolution, and accordingly, a delay may be caused.
Meanwhile, the self-correlation method has a shortcoming because it may require the number of computations in proportion to the number of scales to be obtained, and it may be also difficult to obtain a sufficient resolution as the frequency increases, due to insufficient delay difference among scales. That is, there is a problem that accuracy of scale detection is deteriorated in a high frequency range.
Exemplary embodiments address at least the above problems and/or disadvantages and other disadvantages not described above. Also, the exemplary embodiments are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.
One or more exemplary embodiments an electronic apparatus capable of scale detection in a plurality of octaves by using the same digital filter and a control method thereof.
According to an aspect of an exemplary embodiment, there is provided an electronic apparatus including: an input interface configured to receive an audio signal, a processor configured to process the received audio signal, and an output interface configured to output the processed audio signal, in which the processor may apply a filter bank to an audio signal based on a sampling frequency of an received audio signal to obtain a scale of a first octave, and down-sample the audio signal and apply the filter bank to the down-sampled signal to obtain a scale of a second octave lower than the first octave.
The audio signal may be a compressed time-domain signal, the processor may decode the audio signal to acquire a pulse amplitude modulation (PAM) signal and information about a sampling frequency of the PAM signal, and convert the PAM signal into a frequency-domain signal and apply the filter bank to the frequency-domain signal based on the sampling frequency.
Further, the filter bank may include a plurality of digital filters for filtering a frequency band corresponding to each of the plurality of target scales.
The filter band may include a plurality of digital band pass filters having center frequencies that are set based on a sampling frequency of the audio signal and a plurality of frequencies corresponding to each of a plurality of scales of the first octave.
The plurality of digital band pass filters may have the plurality of frequencies as the center frequencies in a normalized frequency domain, and each of the center frequencies of the plurality of digital band pass filters may be reduced to half of the center frequencies when the sampling frequency is reduced to half of the sampling frequency.
The processor may be further configured to: obtain the scale of the second octave by applying the filter bank to the audio signal that is down-sampled by half; and obtain a scale of a third octave that is lower than the second octave by applying the filter bank to the audio signal that is down-sampled by one fourth. The second octave may be an octave lower than the first octave by one octave, and the third octave may be an octave lower than the second octave by one octave.
The first octave may be a highest octave of a plurality of target octaves, and the audio signal may be a signal sampled at two times the highest frequency of the first octave or higher.
The electronic apparatus may further include a display including a plurality of light emitting elements, and the processor may control an illuminating state of the plurality of light emitting elements based on a scale obtained from the processed audio signal.
The processor may control at least one of the illumination time of the light emitting elements, and a number and intensity of illuminations of the light emitting elements corresponding to the scales based on the octave of the scales obtained from the processed audio signal.
According to an aspect of another exemplary embodiment, there is provided a method of controlling an electronic apparatus, including: obtaining a scale of a first octave by applying a filter bank to an audio signal based on a sampling frequency of an audio signal; and down-sampling the audio signal, and obtaining a scale of a second octave that is lower than the first octave by applying the filter bank to the down-sampled signal.
The audio signal may be a compressed time-domain signal, and the method may further include decoding the audio signal to obtain a pulse amplitude modulation (PAM) signal and information about a sampling frequency of the PAM signal. The obtaining the scale of the first octave may include converting the PAM signal into a frequency-domain signal and apply the filter bank to the frequency-domain signal.
The obtaining the scale of the first octave may include filtering a frequency band corresponding to each of a plurality of target scales by using a plurality of digital filters included in the filter bank.
The plurality of digital filters may be band pass filters having center frequencies that are set based on the sampling frequency and a plurality of frequencies corresponding to each scale of the first octave.
The plurality of digital filters may be band pass filters having the plurality of frequencies as the center frequencies in a normalized frequency domain, and each of the center frequencies may be reduced to half of the center frequencies when the sampling frequency is reduced to half of the sampling frequency.
The obtaining the scale of the second octave may include obtaining the scale of the second octave by applying the filter bank to the audio signal by half, and the method may further include obtaining a scale of a third octave that is lower than the second octave by applying the filter bank to the audio signal that is down-sampled by one fourth.
The second octave may be an octave lower than the first octave by one octave, and the third octave may be an octave lower than the second octave by one octave.
The first octave may be a highest octave of a plurality of target octaves, and the audio signal may be a signal sampled at two times the highest frequency of the first octave or higher.
The electronic apparatus may include a plurality of light emitting elements, and the method may further include controlling an illuminating state of the plurality of light emitting elements based on at least one of the first octave and the second octave. The controlling may include controlling at least one of an illumination time of the light emitting elements, and a number and an intensity of illuminations of the light emitting elements corresponding to the scale of the at least one of the first octave and the second octave.
According to an aspect of another exemplary embodiment, there is provided a non-transitory computer readable storage medium storing a program that is executable by a computer to perform a method for controlling an electronic apparatus, wherein the method may include: obtaining a scale of a first octave by applying a filter bank to an audio signal based on a sampling frequency of an received audio signal; down-sampling the audio signal, and obtaining a scale of a second octave that is lower than the first octave by applying the filter bank to the down-sampled signal.
According to an aspect of another exemplary embodiment, there is provided an electronic apparatus, comprising: an input interface configured to receive an audio signal; a processor including: at least one down-sampler configured to down-sample the audio signal; a filter bank configured to apply a first set of digital band pass filters to the audio signal received by the input interface to obtain scales of a first octave, and configured to apply a second set of digital band pass filters to the down-sampled audio signal to obtain scales of a second octave, wherein center frequencies of the first set of digital band pass filters may be different from center frequencies of the second set of digital band pass filters, and the scales of the first octave may have higher frequencies than the scales of the second octave.
The at least one down-sampler may down-sample the audio signal a number of times, and the number of times may be set based on an frequency interval between the first octave and a target octave that is to be obtained from the down-sampled audio signal.
The at least one down-sampler may be further configure to down-sample a frequency of the audio signal by half.
According to various exemplary, it may be possible to reduce the number of computations and obtain a scale in a wider frequency band than the FFT-based method used in conventional scale detection.
The above and/or other aspects will be more apparent by describing certain exemplary embodiments, with reference to the accompanying drawings, in which:
Example embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the present disclosure is not limited to the example embodiments. Instead, the example embodiments may be variously modified. While describing example embodiments, if the specific description regarding a known technology obscures the gist of the disclosure, the specific description is omitted.
In example embodiments, relational terms such as first and second, and the like, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.
The terms used herein are solely intended to explain a specific example embodiment, and not to limit the scope of the present disclosure. It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. The terms “include,” “comprise,” “is configured to,” etc., of the description are used to indicate that there are features, numbers, steps, operations, elements, parts or combination thereof, and they should not exclude the possibilities of combination or addition of one or more features, numbers, steps, operations, elements, parts or a combination thereof. The expression, “at least one of a and b,” should be understood as including only a, only b, or both a and b.
In the example embodiments disclosed herein, a term “module” or “unit” refers to an element that performs at least one function or operation. The “module” or “unit” may be realized as hardware, software, or combinations thereof. In addition, a plurality of “modules” or a plurality of “units” may be integrated into at least one module and may be realized as at least one processor except for “modules” or “units” that should be realized in a specific hardware.
The electronic apparatus 100 may output au audio signal and provide a lighting effect according to the outputted audio signal. For example, the electronic apparatus 100 may be implemented as a speaker device, and/or a display device such as a TV including a plurality of light emitting elements, but may not be limited thereto.
Accordingly, the electronic apparatus 100 may be implemented as a variety of devices, such as a wireless speaker, a sound bar, a smart phone, a tablet, a PC, a large format display (LFD), a digital signage, a digital information display (DID), a video wall, a projector display, and so on.
As illustrated, the electronic apparatus 100 includes a plurality of light emitting elements 10, and may illuminate at least one of the plurality of light emitting elements according to an outputted audio signal to provide a lighting effect. The ‘lighting effect’ as used herein refers to provision of a feedback by illuminating a light emitting element corresponding to a frequency level (e.g., scale) of a currently-outputted audio signal. For example, the electronic apparatus 100 may map a plurality of light emitting elements to respective scales, octaves, scales of the octaves, and so on, and when the corresponding scale (or corresponding octave) is included in the outputted audio signals, may illuminate the corresponding light emitting element.
However, the electronic apparatus 100 is not limited to the example described above. For example, the electronic apparatus 100 may not be provided with a light emitting element, and the electronic apparatus 100 may perform communication with an external device having a plurality of light emitting elements. In this case, the electronic apparatus 100 may be configured to analyze the scale of the outputted audio signal, and control the illuminating state of the light emitting elements provided in the external device according to the obtained scale information, or transmit the obtained scale information to the external device.
Meanwhile, the electronic apparatus 100 according to an exemplary embodiment may obtain or detect scales of each of a plurality of octaves by using a digital filter, which will be described below with reference to various embodiments of the present disclosure and the drawings.
According to
The input unit 110 receives an audio signal as an input. For example, the input unit 110 may receive an audio signal from an external device, an external server, and so on, via a communication method that uses an access point (AP)-based Wi-Fi, Bluetooth, Zigbee, wired/wireless local area network (LAN), a wide area network (WAN), Ethernet, IEEE 1394, high-definition multimedia interface (HDMI), universal serial bus (USB), and so on. Also, the input unit 110 may be a microphone that receives a voice or audio signal.
In this example, the audio signal may be a digital audio signal. A digital audio signal is a data signal of an analog signal, and this data should use a certain ‘transmission format’ according to the communication protocol.
For example, the digital audio signal may be in a signal form in which an analog audio signal is modulated according to a pulse code modulation (PCM) method. PCM is a method of converting an analog signal having temporal continuity into a temporally discrete signal. Specifically, PCM refers to a method of sampling an analog signal to generate a pulse amplitude modulation (PAM) signal, quantizing the sampled value (amplitude) of the PAM signal, that is, discrete signal, and encoding the signal into a binary or M-ary bit string (digital signal). That is, the transmitting side samples the analog audio signal to convert it into a PAM signal, and quantizes each sampled pulse of the PAM signal to encode it, and transmits the PCM signal. Accordingly, the electronic apparatus 100 decodes the received audio signal (i.e., the PCM signal) to convert it into a PAM signal and interpolates it with a filter to obtain the original input signal.
Meanwhile, as described above, the input digital audio signal may be a signal sampled at a predetermined sampling frequency. The ‘sampling frequency’ (hertz (Hz)) refers to the number of representative values of the signals sampled in one second from the original analog signal. That is, if the frequency of the sampling is 10 times per second, the sampling frequency is expressed as 10 Hz, and if the frequency of sampling is 100 times per second, the sampling frequency is expressed as 100 Hz.
For example, the digital audio signal may be a signal sampled at a frequency that is two times the highest frequency included in the analog audio signal or higher, according to the sampling theory (or the Nyquist theory). That is, as shown in
For example, when it is assumed that the human's maximum audio frequency response is 20 kHz, the signal may be a signal that is sampled at frequency two times 20 kHz or higher. For example, the signal may be a signal sampled at 44.1 kHz, 48 kHz, and so on. In this example, 44.1 kHz is two times the 20 kHz including 10% error, and it is the standard sample rate of compact disc (CD) digital audio. 48 kHz is adopted in a digital versatile disc (DVD) format to maximize sound quality from that of 44.1 kHz, and when a signal is sampled at 48 kHz, this means that 48,000 samples are extracted in 1 second from analog audio signal. Of course, exemplary embodiments are not limited to the examples given above, and accordingly, various sampling frequencies such as 32 kHz, 38 kHz, 44.1 kHz, 88.2 kHz, 96 kHz, 192 kHz and so on may be used depending on the applications. Hereinafter, for convenience of explanation, it is assumed that the digital audio signal is a signal sampled at 48 kHz.
The output unit 140 may output an audio signal.
Specifically, the output unit 140 may convert the digital signal processed at the processor 130 into an analog signal, and amplify and output the same. For example, the output unit 140 may include at least one speaker unit, a digital/analog (D/A) converter, an audio amplifier, etc., capable of outputting at least one channel. For example, the output unit 150 may include a left (L) channel speaker, a center (C) channel speaker, and a right R channel speaker that may reproduce the L channel, the C channel, and the R channel, respectively. However, the present exemplary embodiment is not limited thereto, and the output unit 140 may be implemented in various forms. As another example, the output unit 140 may also be implemented in a sound bar form that reproduces the L channel, the R channel, and the C channel.
The filter bank may filter a frequency band that corresponds to each of at least one target scale. In this example, the filter bank may be implemented as a digital signal processor (DSP) or a multiplier large-scale integration (LSI) chip. However, in some cases, the filter bank may be implemented as a central processing unit (CPU). The filter bank may be implemented as a processor 130 described below, although it is depicted as a separate component for convenience of explanation.
In particular, the filter bank includes a plurality of digital filters corresponding to the number of target scales in one octave. In this example, each of the plurality of digital filters may be implemented as a band pass filter that filters only a specific frequency.
Specifically, the plurality of digital filters may be implemented as a band pass filter. The center frequency, the low cut-off frequency, and the high cut-off frequency of the band pass filter may be set based on pitch information that corresponds to a predetermined sampling frequency and each of scales of a predetermined octave. The ‘pitch’ may represent a musical tone that is determined by the frequency of the waves that produce the sound. Sounds may be higher or lower in pitch according to the frequency of vibration of the sound waves.. The pitch information may contain information of the frequency of each scale. In particular, the center frequency of the plurality of digital filters may be the pitch information (that is, the frequency value) of each scale, and the bandwidth of the band pass filter may be set within a predetermined threshold range based on the center frequency. In addition, the predetermined sampling frequency may be a sampling frequency of the received audio signal, which may be 48 kHz for example, and the predetermined octave may be the highest octave of the target octaves.
In particular, the plurality of digital filters may be implemented as a band pass filter having a center frequency respectively corresponding to a plurality of pitches in the normalized frequency domain. In this case, each of the digital filters may have a form in which each of the center frequencies is linearly scaled down to 1/2 when the sampling frequency is reduced to 1/2.
According to an exemplary embodiment, each of the plurality of digital filters may filter a plurality of scales (e.g., twelve scales) within one octave, respectively.
The term ‘scale’ may refer to a staircase of sounds in which sounds are arranged in order of height, or a graduated series of musical tones ascending or descending in order of pitch. The term ‘octave’ may refer to an interval between one pitch and another pitch that has a frequency that is two times as high as the other pitch, or an interval between two frequencies having a ratio of 2 to 1. The scale may be repeated for every octave. For example, one octave can be divided into twelve scales (or chromatic scale). However, the present exemplary embodiment is not limited thereto, and the number of scales in one octave may vary based on the form into which the octave is divided. However, for convenience of explanation, it is assumed that twelve scales are provided in one octave.
As shown in
That is, when the octave consists of twelve scales and has the frequency characteristics as shown in
It may be possible to obtain the same scale from different octave regions using one digital filter based on the frequency characteristics of the octave as described above and the relationship between the sampling frequency of the audio signal and the cutoff frequency of the digital filter. For example, the same scale may be obtained from different octave regions using a digital filter defined in the normalized frequency domain, i.e., in −π to π (or 0 to 2π) region. That is, each of the plurality of digital filters may be implemented to be linearly scaled according to the sampling frequency of the input signal to obtain each scale from different octaves.
For example, when a digital filter having a cutoff frequency of π/2 radians (1/4 (=0.25) of the sampling frequency) in the normalized frequency domain is applied to an input signal sampled at 48 kHz, the digital filter will operate as a filter having a center frequency at 12 kHz.
In addition, when the same digital filter is applied to a signal down-sampled by 1/2, i.e., to a signal sampled at 24 kHz, the digital filter having a cutoff frequency of π/2 radian will have a center frequency at 6 kHz.
Accordingly, for the sampling frequencies of 12 kHz and 6 kHz, the center frequency of the digital filter becomes 3 kHz and 1.5 kHz, and so on, such that the same filtering can be performed with one single filter by repeating the above for each of the frequencies corresponding to (1/2)̂n frequency.
The processor 130 controls the overall operation of electronic apparatus 100. The processor 130 may include one or more of a central processing unit (CPU), a micro controller unit (MCU) controller, an application processor (AP), or a communication processor (CP), or an ARM processor, or may be defined in that term. In addition, the processor 130 may be implemented as a digital signal processor (DSP), or implemented as a SoC in which a content processing algorithm is embedded, or implemented as a field programmable gate array (FPGA).
According to an exemplary embodiment, when the processor 130 is implemented as a DSP, the processor 130 may be implemented so as to also perform the functions of the filter bank. According to another exemplary embodiment, the processor 130 may be implemented as a CPU, and the filter bank may be implemented as a DSP. According to yet another exemplary embodiment, it may be possible that both the filter bank and the processor 130 may be implemented as a CPU.
The processor 130 may process the received audio signal to convert it into a form suitable for applying the filter bank. In this example, the received audio signal may be a time-domain signal, or more specifically, it may be a signal sampled in the time domain.
The processor 130 may convert the time-domain signal into a frequency-domain signal and apply a filter bank to the frequency-domain signal. For example, the processor 130 may decode a received audio signal (i.e., a PCM signal) to acquire a PAM signal and convert it into a frequency-domain signal.
Meanwhile, the received audio signal may be a signal that is compressed according to the audio compression standard, and the compressed signal may include additional information on the audio signal, such as the information on the sampling frequency (sampling rate) in particular. For example, when the received audio signal is compressed according to MPEG 2 or MPEG 4 standard, the signal may be in the form of an MPEG 2 or MPEG 4 transport stream, and the corresponding information may be included in the header of the transport packet constituting the transport stream. However, various other compression standards may be applied for the compression and transmission of an audio signal.
In particular, the processor 130 may decode the compressed signal to acquire both the PCM signal and the information on the sampling frequency at the same time.
The processor 130 may apply the filter bank to the frequency-domain signal to obtain the scale of the first octave.
In addition, the processor 130 may down-sample the audio signal and apply the filter bank to the down-sampled signal, respectively, to obtain the second octave scale lower than the first octave. Specifically, the processor 130 may down-sample the PAM signal and then convert it into a frequency-domain signal and apply the filter bank.
Specifically, the processor 130 may apply a plurality of digital filters to an received audio signal sampled at a predetermined frequency to obtain a scale of the first octave, and apply a plurality of digital filters to the received audio signal that is 1/2 down-sampled, respectively, to obtain the scale of the second octave that is lower than the first octave by one octave.
In this example, by the ‘1/2 down-sampling’, it means that only the samples of two intervals are remained in the received audio signal sampled at the predetermined frequency. In particular, after applying an anti-aliasing low-pass filter (LPF) to the received audio signal, only samples at two intervals are left in the sampled signal. The anti-aliasing LPF may be applied to attenuate frequencies higher than the Nyquist frequency to prevent aliasing components from being collected. In addition, the processor 130 may apply a plurality of digital filters to the 1/4 down-sampled signal of the received audio signal, respectively, to obtain a scale of a third octave that is lower than the second octave by one octave. In this example, by the ‘1/4 down-sampling’, it means that only the samples at four intervals are left in the received audio signal sampled at the predetermined frequency. Alternatively, it means that only the samples at two intervals are left in the 1/2 down-sampled signal. In this case, it is of course possible that the anti-aliasing LPF can be applied.
For example, it is assumed that the received audio signal is sampled at 48 kHz, and the highest octave is the seventh octave, i.e., at 2093 to 3951 Hz, based on the table shown in
In this case, by the sampling theory, since the maximum frequency of the sampled data, i.e., the received audio signal, is 24 kHz, the center frequency of the digital filter corresponding to each of the scales may be: 2093.005 Hz, 2217.461 Hz , 2349.318 Hz, 2489.016 Hz, 2637.020 Hz, 2793.826 Hz, 2959.955 Hz, 3135.963 Hz, 3322.438 Hz, 3520.000 Hz, 3729.310 Hz, 3951.066 Hz, based on the table shown in
A plurality of digital filters 501 to 512 as shown in
The position of the center frequency of the digital filter may be determined to be: 2093.005/24000 (C (Do)), 2217.461/24000 (C#), 2349.318/24000 (D (Re)), 2489.016/24000 (D#), 2637.020/24000 (E (Mi)), 2793.826/24000 F (Fa)), 2959.955/24000 (F#), 3135.963/24000 (G (Sol)), 3322.438/24000 (G#), 3520.000/24000 (A (Ra)), 3729.310/24000 (A#), 3951.066/24000 (B (Si)).
That is, the center frequency of the digital filter corresponding to each of the scales has a magnitude of, such as, approximately 0.0872083, 0.09239420, 0.09788825, 0.103709, 0.10987583, 0.1164094, 0.1233331, 0.1306651, 0.138434917, 0.1466666, 0.15538792, 0.16462775 of the maximum frequency. The center frequency of the digital filter thus calculated may be a normalized frequency of each of the plurality of digital filters. That is, in the normalized digital domain, it has the cutoff frequencies at positions of 0.0872083, 0.09239420, 0/09788825, 0.103709, 0.10987583, 0.1164094, 0.1233331, 0.1306651, 0.138434917, 0.1466666, 0.15538792, 0.16462775 of the sampling frequency.
Accordingly, the plurality of normalized digital filters 521 to 532 applied to the audio signal sampled at 48 kHz may be in the form as shown in
In the same manner, a plurality of normalized digital filters applied to an audio signal sampled at 32 kHz and 44.1 kHz may be in the form as shown in
The processor 130 then down-samples the audio signal sampled at 48 kHz to 1/2 and applies each of the plurality of digital filters to the down-sampled signal to obtain the twelve scales of the next highest octave, i.e., the scales at 1046 to 1975 Hz (i.e., sixth octave), respectively. That is, when the sampling frequency is halved (1/2), the center frequency of the digital filter is also halved (1/2). This is because, in an audio signal sampled at 48 kHz, it is possible to obtain a signal up to 24 kHz according to the sampling theory, and when the sampling frequency is halved (1/2), that is, in an audio signal sampled at 24 kHz, it is possible to obtain a signal up to 24 kHz according to the sampling theory. Accordingly, when a digital filter for filtering a relative position is applied to a signal sampled at different frequencies from each other, the frequency to be filtered is linearly scaled according to the sampling frequency.
For example, in the embodiment described above, since the normalized center frequencies of each of the plurality of digital filters are 0.0872083, 0.09239420, 0.09788825, 0.103709, 0.10987583, 0.1164094, 0.1233331, 0.1306651, 0.138434917, 0.1466666, 0.15538792, 0.16462775, respectively, when a plurality of digital filters are respectively applied to an audio signal down-sampled at 24 kHz, it is possible to obtain up to 12 kHz, and accordingly, the scale C (Do) may be obtained by 0.0872083*12000=1046.5, and the scale “C#” may be obtained by 0.09239420*12000=1108.73.
The processor 130 then down-samples the audio signal down-sampled at 24 kHz by 1/2 and applies each of the plurality of digital filters to the down-sampled signal to obtain the twelve scales of the next highest octave, i.e., the scales at 523 to 987 Hz (i.e., fifth octave), respectively. That is, when a plurality of digital filters are respectively applied to an audio signal down-sampled at 12 kHz, the scale “C (Do)” may be obtained by 0.0872083*6000=523.25 and the scale “C#” may be obtained by 0.09239420*6000=554.365.
In this way, the processor 130 may repeatedly down-sample the audio signal by 1/2 to obtain the scales corresponding to each of the octaves.
Specifically, the processor 130 may obtain the scales based on the magnitude of the pitch component in the filtered signal and the magnitude of the received audio signal, with a digital filter for obtaining specific scales.
Specifically, when a specific scale, that is, a specific frequency is included in the audio signal, the signal filtered by the corresponding filter should include a pitch component of a predetermined magnitude or greater. In this example, the predetermined magnitude may be determined by the magnitude (or amplitude) of the audio signal, the cutoff frequency of the band pass filter, the bandwidth, and so on. For example, if the frequency band to pass is so narrow that only the frequency of the corresponding scale is passed, the corresponding scale itself may be obtained by the pitch component itself.
For example, as shown in
When a filter for filtering a specific scale is applied in such a frequency domain, if a signal corresponding to the corresponding scale is included in the audio signal, a pitch component of a predetermined magnitude K or greater is obtained, as shown in
Based on this, the processor 130 is able to obtain if the audio signal includes a specific scale.
The output unit 120 functions to output an audio signal.
Specifically, the output unit 120 may convert the digital signal processed at the processor 130 into an analog signal, and amplify and output the same. For example, the output unit 120 may include at least one speaker unit, a D/A converter, an audio amplifier, etc., capable of outputting at least one channel. For example, the output unit 120 may include an L channel speaker and an R channel speaker that can reproduce the L channel and the R channel, respectively. However, the present disclosure is not limited to the examples provided above, and accordingly, the output unit 120 may be implemented in various forms. As another example, the output unit 120 may also be implemented in a sound bar form that reproduces the L channel, the R channel, and the center channel.
Meanwhile, since the number of computations to be performed in the digital domain is reduced by the number of samples according to the down-sampling of the audio signal as described above, the number of computations of the processor can be reduced. That is, when the down-sampling by 1/2 is performed, the time-complexity is reduced to 1/2.
Meanwhile, in the embodiment described above, the audio signal sampled at 48 kHz is sequentially down-sampled by 1/2 each time, but this is merely an example. According to another embodiment, it is of course possible that twelve scales of seventh octave may be obtained based on the received audio signal sampled at 48 kHz, and the received audio signal sampled at 48 kHz may be down-sampled to 1/2 to obtain twelve scales of sixth octave, and the received audio signal sampled at 48 kHz may be down-sampled to 1/4 to obtain twelve scales of fifth octave.
Meanwhile, according to another embodiment of the present disclosure, when the processor 130 obtains only the scales irrespective of the octaves, the processor 130 may obtain the scale values by merging the information of the same scales in each of the octave bands. For example, in order to obtain only the presence or absence of a C# scale regardless of the octave, it is also possible to obtain whether the scale is included or not based on a representative value of the magnitude of the C#, such as an average value, a maximum value, etc.
According to
The processor 130 may include a CPU 131, a ROM (ROM or nonvolatile memory) storing a control program for controlling the electronic apparatus 100, and a RAM (RAM, or volatile memory) used as a storage area for storing data inputted from outside the electronic apparatus 100 and corresponding to various operations performed in the electronic apparatus 100.
The processor 130 may execute an Operating System (OS), a program, and various applications stored in the storage 150 when a predetermined event occurs. The processor 130 may include a single core, a dual core, a triple core, a quad core, and a multi-core.
The CPU 131 accesses the storage 150 to perform booting using the O/S stored in the storage 150. Then, various operations are performed using various programs, contents, data, and so on stored in the storage 150.
In addition, the processor 130 may include a digital signal processor (DSP), and the DSP may add various functions such as a digital filter, an effect, and an acoustic feel, etc., and an over-sampling technique for preventing deterioration of sound quality during conversion between analog and digital signals can also be applied.
The storage 150 may store various data, programs, or applications for driving/controlling the electronic apparatus 100. The storage 140 may store a control program for controlling the electronic apparatus 100 and the processor 130, applications, databases, or related data originally provided by a manufacturer or downloaded externally.
The storage 150 may be implemented as an internal memory such as a ROM or a RAM included in the processor 130 or may also be implemented as a separate memory from the processor 130. In this case, the storage 150 may be implemented in the form of a memory embedded in the electronic apparatus 100, or a removable memory in the electronic apparatus 100 depending on the purpose of storing data. For example, in the case of data for driving the electronic apparatus 100, the data may be stored in a memory embedded in the electronic apparatus 100, and in the case of data for the extended function of the electronic apparatus 100, such data may be stored in a removable memory in the electronic apparatus 100. Meanwhile, the memory embedded in the electronic apparatus 100 may be implemented in the form of a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD), and the removable memory in the content output apparatus 200 may be implemented in the form such as a memory card (for example, a micro SD card, a USB memory and so on), an external memory (for example, a USB memory) connectable to a USB port, and so on.
The display 160 includes a plurality of light emitting elements and may provide light feedback according to the audio signal being outputted.
In this example, a plurality of light emitting elements may be provided in the outer housing of the electronic apparatus 100. For example, when the electronic apparatus 100 is implemented as a cylindrical speaker device, the plurality of light emitting elements may be arranged at predetermined intervals along the edge of the top circle of the electronic apparatus 100. Alternatively, a plurality of light emitting elements may be arranged at predetermined intervals along the edge of the side surface of the electronic apparatus 100. As another example, when the electronic apparatus 100 is implemented as a TV, a plurality of light emitting elements may be arranged at predetermined intervals along the bezel area of the TV. In this example, the plurality of light emitting elements may be implemented as LEDs, although the present disclosure is not limited thereto.
In some cases, a transparent sheet may be disposed on the plurality of LEDs so that the light of the plurality of LEDs is continuously displayed without a border. The plurality of LEDs may be implemented to have the same color or different colors. In addition, the plurality of LEDs may have different colors from each other depending on positions they are arranged. Further, in some cases, pairs of LEDs of different colors from each other may be arranged adjacent to each other.
Meanwhile, the processor 130 may match each of the scales to a plurality of LEDs such that, when a specific scale is obtained from the outputted audio signal, the processor 130 may illuminate the LED corresponding to the corresponding scale. For example, the first light emitting element may be matched to the C scale, and the second light emitting element may be matched to the D scale such that corresponding light emitting elements may be illuminated each time the scale is obtained.
In addition, the processor 130 may control the illuminating states of the plurality of LEDs by matching the same scales of different octaves with at least one of different frequency of illumination, and different time of illumination. For example, when the C scale of sixth octave is obtained, the first light emitting element may be briefly illuminated once, and when the C scale of seventh octave is obtained, the first light emitting element may be illuminated two times successively. As another example, when the C scale of sixth octave is obtained, the first light emitting element may be illuminated for two seconds, and when the C scale of seventh octave is obtained, the first light emitting element may be illuminated for four seconds.
According to another embodiment, the processor 130 may control an illuminating state of an external device by matching different octaves to a plurality of light emitting elements provided in at least one external device. For example, the first to seventh external devices matching the first to seventh octaves respectively may be controlled accordingly.
As shown in
The processor 130 may obtain information on the sampling frequency in the process of decoding the inputted compression audio signal, and may apply a specific filter bank 830 based on the corresponding sampling frequency.
The processor 130 may apply the filter bank 830 to the frequency-domain signal to filter the scale of the highest octave of the target octaves.
In this case, the filter bank 830 may include, for example, a plurality of digital filters 830-1 to 830-12 for respectively obtaining twelve scales as shown in
The pitch analyzer 840 may analyze the pitch of the filtered signal passed through the filter bank 830 to obtain pitch information 850 that includes the scales in the first octave. Specifically, the scale included in the audio signal may be obtained by analyzing the magnitude of the received audio signal and the magnitude of the filtered signal.
In addition, the half down sampler 821 may down-sample the input signal 810 by 1/2 sampling frequency and provide the down-sampled input signal 810 to the filter bank 830. The filter bank 830 may filter each of the scales of the second octave that is one octave lower than the first octave.
The pitch analyzer 840 may analyze the pitch of the filtered signal to obtain pitch information 850 that includes the scales in the second octave.
Also, the audio signal down-sampled by 1/2 is down-sampled by the half down sampler 822 by 1/2 and provided to the filter bank 830, and the filter bank 830 may filter each of the scales of the third octave of the third octave that is one octave lower than the second octave.
The analyzer 840 may analyze the pitch of the filtered signal passed through the filter bank 830 to obtain pitch information 850 that includes the scales in the third octave.
By repeating this process, the scales of the entire octaves may be obtained with the same filter bank 830.
Meanwhile, in the process described above, the filter bank 830 may be implemented as the filter bank 140 of
In
Meanwhile, to help understand of the present disclosure,
Meanwhile, according to
In this case, each LED is matched with at least one scale of at least one octave, and when the corresponding scale is obtained from the outputted audio signal, the corresponding light emitting element may be illuminated.
For example, if the first LED 1, the second LED 2, the third LED 3 and the fourth LED 4 are matched to the C, C#, D, D# scales of a particular octave, respectively, when a corresponding scale is sequentially obtained from an outputted audio signal, the first LED 1, the second LED 2, the third LED 3 and the fourth LED 4 may sequentially be illuminated for a predetermined time as shown in the drawing.
It is assumed that the first LED 1, the second LED 2, the third LED 3 and the fourth LED 4 are matched to the C, C#, D, D# scales of the first to fourth octaves, respectively. In this case, when the first to fourth octaves are matched with different illumination times, such as first to fourth times for example, the first LED 1, the second LED 2, the third LEDs 3 and the fourth LED 4 may sequentially be illuminated for the first to fourth times, respectively.
According to the control method of the electronic apparatus shown in
The audio signal is then down-sampled, in operation S1020.
Thereafter, a filter bank is respectively applied to the down-sampled signal to obtain a scale of a second octave that is lower than the first octave, in operation S1030. In this example, the second octave may be an octave lower than the first octave by one octave, and the third octave may be an octave lower than the second octave by one octave.
Meanwhile, the received audio signal may be a compressed time-domain signal, and the control method may further include decoding the audio signal to acquire the PAM signal and information about the sampling frequency of the PAM signal.
In addition, in operation S1010 of obtaining the scale of the first octave, the PAM signal may be converted into a frequency-domain signal and the filter bank may be applied.
In this example, the filter bank may include a plurality of digital filters for filtering a frequency band corresponding to each of the plurality of target scales.
In addition, the plurality of digital filters may be band pass filters having a center frequency determined based on a sampling frequency of the received audio signal and a plurality of frequencies corresponding to each of the scales of the first octave.
In addition, the plurality of digital filters may be band pass filters each having the plurality of frequencies mentioned above as the center frequencies in the normalized frequency domain, and may be implemented such that when the sampling frequency is reduced to 1/2, each of the center frequencies is reduced to 1/2.
In addition, in operation S1020 of obtaining the scale of the second octave, the filter bank may be applied to a signal resulting from down-sampling the audio signal by 1/2, to obtain the scale of the second octave.
In addition, the control method may further include obtaining a scale of a third octave lower than a second octave, by applying a filter bank to a signal resulting from down-sampling the audio signal by 1/4.
In addition, the electronic apparatus may include a plurality of light emitting elements. In this case, the control method may further include controlling the illuminating states of the plurality of light emitting elements based on the scales obtained from the outputted audio signal.
In this case, it may be possible to control at least one of the illumination time of the light emitting elements, and the number and intensity of illuminations of the light emitting elements corresponding to the scales based on the octave of the scales obtained from the outputted audio signal.
According to various exemplary embodiments, it may be possible to reduce the number of computations and obtain a scale in a wider frequency band than the FFT-based method used in conventional scale detection.
In addition, a desired result can be obtained only by obtaining the scales irrespective of octaves.
In addition, since the same digital filter is used, it is efficient in terms of memory. For example, when obtaining the scale of the sixth octave, without down-sampling, memory for six times greater computations and six times greater filters than for obtaining one octave are required. However, with the down-sampling, only the two times greater computations and amount of memory will suffice.
In addition, in a CPU (or DSP) with limited performance such as a Consumer Electronics (CE) device, it is enabled to obtain signal components at finer intervals such as twelve scales in a wide octave band at a sufficient resolution.
While not restricted thereto, an exemplary embodiment can be embodied as computer-readable code on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, an exemplary embodiment may be written as a computer program transmitted over a computer-readable transmission medium, such as a carrier wave, and received and implemented in general-use or special-purpose digital computers that execute the programs. Moreover, it is understood that in exemplary embodiments, one or more units of the above-described apparatuses and devices can include circuitry, a processor, a microprocessor, etc., and may execute a computer program stored in a computer-readable medium.
Further, at least some configurations of the methods according to various exemplary embodiments above may be implemented in the form of an application that can be installed on an existing electronic apparatus.
In addition, at least some configurations of the methods according to various exemplary embodiments above may be implemented with simple software or hardware upgrades for existing electronic apparatus.
In addition, at least some configurations of the methods according to various exemplary embodiments of the present disclosure described above may be performed through an embedded server provided in the electronic apparatus or an external server of the electronic apparatus.
The foregoing exemplary embodiments are merely exemplary and are not to be construed as limiting. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2017-0012941 | Jan 2017 | KR | national |
