This application claims the priority benefit of Taiwan application serial no. 104118328, filed on Jun. 5, 2015. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
Field of the Invention
The invention relates to a signal processing apparatus; more particularly, the invention relates to a video signal processing apparatus and a voice signal processing method.
Description of Related Art
In general, hearing-impaired people can clearly hear low frequency signals but have trouble receiving high frequency voice signals (e.g., a consonant signal). According to the related art, such an issue is generally resolved by lowering a frequency of the high frequency signal and stacking signal frames. However, in the conventional process of stacking the signal frames, whether the phases of the signal frames are matched with each other is usually not taken into consideration. Therefore, in the overlapped signal frames, parts of the signals may be added up while other parts of the signals may be offset, which may further cause signal distortion.
The invention is directed to a voice signal processing apparatus and a voice signal processing method. Thereby, while signal frames are overlapped, the issue of signal distortion caused by phase mismatch can be effectively resolved.
In an embodiment of the invention, a voice signal processing apparatus includes a processing unit which is configured to lower a frequency of a sampling voice signal to generate a frequency-lowered signal including a sequence of original frequency-lowered signal frames and generate corresponding renovating frequency-lowered signal frames according to the original frequency-lowered signal frames. Here, each of the original frequency-lowered signal frames includes p sampling points. The processing unit further determines a last sampling point of an mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to a phase reference sampling point number according to the phase reference sampling point number of the mth original frequency-lowered signal frame corresponding to a middle sampling point of an mth renovating frequency-lowered signal frame of the renovating frequency-lowered signal frames. The processing unit also applies P consecutive sampling points starting from the last sampling point phase-matched with the sampling point corresponding to the phase reference sampling point number as the sampling points of an (m+1)th renovating frequency-lowered signal frame, and adjacent renovating frequency-lowered signal frames of the renovating frequency-lowered signal frames are mixed and stacked to generate an overlapping voice signal. Here, p is a positive integer, and m is a positive integer greater than 1.
According to an embodiment of the invention, each of two adjacent renovating frequency-lowered signal frames includes a 50% overlapping section.
According to an embodiment of the invention, the processing unit further adds up a first count value and a second count value according to sampling values of the sampling points of the mth original frequency-lowered signal frame. Here, when the frequency-lowered signal in a positive half cycle is changed to a negative half cycle, the processing unit returns the first count value to 0, and when the frequency-lowered signal in the negative half cycle is changed to the positive half cycle, the processing unit returns the second count value to 0. The processing unit applies the first count value or the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number as a reference value, and the processing unit determines the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number according to the reference value.
According to an embodiment of the invention, the processing unit further determines whether the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number. If the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the processing unit applies the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number as the reference value and applies a last-sampled sampling point of the sampling points of the mth original frequency-lowered signal frame where the first count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number; if the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is greater than the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the processing unit applies the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number as the reference value and applies the last-sampled sampling point of the sampling points of the mth original frequency-lowered signal frame where the second count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number.
According to an embodiment of the invention, the processing unit further multiplies the frequency-lowered signal by a Hamming window.
In an embodiment of the invention, a voice signal processing method includes following steps. A frequency of a sampling voice signal is lowered to generate a frequency-lowered signal including a sequence of original frequency-lowered signal frames. Here, each of the original frequency-lowered signal frames includes p sampling points, and p is a positive integer. A last sampling point of an mth original frequency-lowered signal frame is determined according to a phase reference sampling point number of the mth original frequency-lowered signal frame. Here, the phase reference sampling point number corresponds to a middle sampling point of an mth renovating frequency-lowered signal frame, the last sampling point is phase-matched with a sampling point corresponding to the phase reference sampling point number in the mth original frequency-lowered signal frame, and m is a positive integer greater than 1. P consecutive sampling points starting from the last sampling point phase-matched with the sampling point corresponding to the phase reference sampling point number are applied as the sampling points of an (m+1)th renovating frequency-lowered signal frame of the renovating frequency-lowered signal frames. Adjacent renovating frequency-lowered signal frames are mixed and stacked to generate an overlapping voice signal.
According to an embodiment of the invention, each of two adjacent renovating frequency-lowered signal frames includes a 50% overlapping section.
According to an embodiment of the invention, the step of determining the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number according to the phase reference sampling point number corresponding to the middle sampling point of the mth renovating frequency-lowered signal frame includes following steps. A first count value and a second count value are added up according to sampling values of the sampling points of the mth original frequency-lowered signal frame. When the frequency-lowered signal in a positive half cycle is changed to a negative half cycle, the first count value is returned to 0, and when the frequency-lowered signal in the negative half cycle is changed to the positive half cycle, the second count value is returned to 0. The first count value or the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number is applied as a reference value. The last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number is determined according to the reference value.
According to an embodiment of the invention, the step of applying the first count value or the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number as the reference value includes following steps. It is determined whether the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number. If the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the first count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number is applied as a reference value. If the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is greater than the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number is applied as a reference value.
According to an embodiment of the invention, if the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the voice signal processing method further includes applying a last-sampled sampling point of the sampling points of the mth original frequency-lowered signal frame where the first count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number.
According to an embodiment of the invention, if the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is greater than the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the voice signal processing method further includes applying a last-sampled sampling point of the sampling points of the mth original frequency-lowered signal frame where the second count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number.
According to an embodiment of the invention, the voice signal processing method includes multiplying the frequency-lowered signal by a Hamming window.
In view of the above, the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number is determined according to the phase reference sampling point number of the mth original frequency-lowered signal frame corresponding to the middle sampling point of the mth renovating frequency-lowered signal frame. The P consecutive sampling points starting from the last sampling point phase-matched with the sampling point corresponding to the phase reference sampling point number is applied as the sampling points of the (m+1)th renovating frequency-lowered signal frame, such that the issue of signal distortion caused by the overlapped signal frames with phase mismatch can be effectively resolved.
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanying figures are described in detail below.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
The processing unit 102 is able to obtain renovating frequency-lowered signal frames (e.g., renovating frequency-lowered signal frames WL1′-WL4′ shown in
Each of the original frequency-lowered signal frames includes p sampling points, and p is a positive integer. The processing unit 102 applies the sampling point number of an mth original frequency-lowered signal frame corresponding to a middle sampling point of the mth renovating frequency-lowered signal frame as a phase reference sampling point number, determines the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to a phase reference sampling point number according to the phase reference sampling point number, and applies p consecutive sampling points starting from the last sampling point as the sampling points of the (m+1)th renovating frequency-lowered signal frame, such that the middle sampling point of the mth renovating frequency-lowered signal frame is phase-matched with the initial sampling point of the (m+1)th renovating frequency-lowered signal frame. Here, m is a positive integer greater than 1. Accordingly, when a 50% signal frame overlapping action is performed on the (m+1)th renovating frequency-lowered signal frame and the mth renovating frequency-lowered signal frame (i.e., each of the (m+1)th renovating frequency-lowered signal frame and the mth renovating frequency-lowered signal frame includes a 50% overlapping section), the phase mismatch problem may be significantly lessened, and the issue of signal distortion can be resolved to a great extent.
Specifically, the processing unit 102 may add up a first count value and a second count value according to sampling values of the sampling points of the mth original frequency-lowered signal frame. When the frequency-lowered signal SL in a positive half cycle is changed to a negative half cycle, the first count value is returned to 0, and when the frequency-lowered signal SL in the negative half cycle is changed to the positive half cycle, the second count value is returned to 0. The method to add up the first and second count values can be represented by the following formulas (1) to (4).
Here, m is a positive integer greater than 1, n=0, 1, 2, . . . , or 2N−2, N is a positive integer greater than 1, sm(n) is the sampling value of the sampling point numbered as n in the mth original frequency-lowered signal frame, PNm(n) serves to convert the sampling value sm(n) into values represented by “1” or “0”, wherein PNm(−1)=PNm(0). Cotm+(n) is the first count value corresponding to the sampling point numbered as n in the mth original frequency-lowered signal frame, Cotm−(n) is the second count value corresponding to the sampling point numbered as n in the mth original frequency-lowered signal frame, wherein Cotm+(−1)=0, and Cotm−(−1)=0. It can be derived from (1) and (2) that Cotm+(n) is an accumulated count value corresponding to the frequency-lowered signal in a positive half cycle, whereas Cotm−(n) is an accumulated count value corresponding to the frequency-lowered signal in a negative half cycle. As shown in formulas (1) to (4), in the present embodiment, the sampling value sm(n) greater than or equal to 0 and the sampling value sm(n) less than 0 are set to be 1 and 0, respectively; while the first count value Cotm+(n) is being counted, the first count value corresponding to PNmD(n) equal to 1 is returned to 0, and while the second count value Cotm−(n) is being counted, the second count value corresponding to PNmD(n) equal to −1 is returned to 0.
The processing unit 102 applies the first count value or the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number obtained from the mth renovating frequency-lowered signal frame as a reference value, and the processing unit 102 determines the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number according to the reference value. For instance, the processing unit 102 determines whether the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, which may be represented by the following formula (5):
Cotm+(nCot
Here, nCot
If the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is less than or equal to the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, the processing unit 102 applies the first count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number as a reference value and applies the last-sampled sampling point of the mth original frequency-lowered signal frame where the first count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame, which can be represented by the following formulas (6) and (7):
It can be derived from the formulas (6) and (7) that if the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point with the serial number n is equal to the first count value of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number, nCot
By contrast, if the first count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number is greater than the second count value of the mth original frequency-lowered signal frame corresponding to the sampling point corresponding to the phase reference sampling point number, i.e., the formula (5) is not satisfied, the processing unit 102 applies the second count value corresponding to the sampling point of the mth original frequency-lowered signal frame corresponding to the phase reference sampling point number as the reference value and applies the last-sampled sampling point of the mth original frequency-lowered signal frame where the second count value is equal to the reference value as the last sampling point of the mth original frequency-lowered signal frame, which can be represented by the following formulas (8) and (9):
It can be derived from the formulas (8) and (9) that if the second count value nCot
For instance, it is assumed that each of the original frequency-lowered signal frames WL1-WL4 shown in
To obtain the initial sampling point of the renovating frequency-lowered signal frame WL3′, the processing unit 102 can count the serial number of the corresponding sampling point of the original frequency-lowered signal frame WL2 while the first count value Cot2+(n) is equal to 18. Since the first count value of the original frequency-lowered signal frame WL2 corresponding to the sampling point numbered as 88 is less than the corresponding second count value Cot2−(88), the first count value Cot2+(88) is applied as the reference value. As shown by the schematic diagram illustrating the original frequency-lowered signal frame WL2 in
It should be mentioned that the original frequency-lowered signal frame WL1 is the first original frequency-lowered signal frame, and thus the sampling points of the renovating frequency-lowered signal frame WL1′ are included in the original frequency-lowered signal frame WL1, and the phase reference sampling point number of the original frequency-lowered signal frame WL1 corresponding to the middle sampling point of the renovating frequency-lowered signal frame WL1′ is 100. In the present embodiment, the serial number of the last sampling point of the original frequency-lowered signal frame WL1 phase-matched with the middle sampling point of the original frequency-lowered signal frame WL1 is 188, which should however not be construed as a limitation to the invention. The method for obtaining the last sampling point (with the serial number 188) is similar to that applied in the foregoing embodiments, and people having ordinary skill in the art should be able to derive the way to implement the invention from the teachings provided in the foregoing embodiment. Hence, no further description is provided hereinafter.
After adjusting the sampling points of each of the original frequency-lowered signal frames and obtaining the corresponding renovating frequency-lowered signal frames, the processing unit 102 may perform a 50%-mixing and stacking action on the adjacent renovating frequency-lowered signal frames to generate an overlapping voice signal. Since the middle sampling point of each renovating frequency-lowered signal frame is phase-matched with the initial sampling point of the next renovating frequency-lowered signal frame, the issue of signal distortion caused by phase mismatch while the signal frames are overlapped can be resolved to a great extent. Besides, in some embodiments, after the renovating frequency-lowered signal frames corresponding to the original frequency-lowered signal frames are obtained, the frequency-lowered signal may be multiplied by a Hamming window to enhance continuity between the right-end and the left-end of the renovating frequency-lowered signal. As shown in
To sum up, the last sampling point of the mth original frequency-lowered signal frame phase-matched with the sampling point corresponding to the phase reference sampling point number is determined according to the phase reference sampling point number of the mth original frequency-lowered signal frame corresponding to the middle sampling point of the mth renovating frequency-lowered signal frame. The P consecutive sampling points starting from the last sampling point phase-matched with the sampling point corresponding to the phase reference sampling point number is applied as the sampling points of the (m+1)th renovating frequency-lowered signal frame, such that the issue of signal distortion caused by overlapped signal frames with phase mismatch can be effectively resolved.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
104118328 A | Jun 2015 | TW | national |
Number | Name | Date | Kind |
---|---|---|---|
9165561 | Wu | Oct 2015 | B2 |
20150049879 | Young | Feb 2015 | A1 |
20160210987 | Sugiyama | Jul 2016 | A1 |
20160217805 | Tu | Jul 2016 | A1 |
20160343388 | Tu | Nov 2016 | A1 |
Number | Date | Country | |
---|---|---|---|
20160360324 A1 | Dec 2016 | US |