I. Field of the Invention
The present invention pertains generally to the field of wireless communications, and more specifically to providing an efficient method and apparatus for reducing voice latency associated with a voice-over-data wireless communication system.
II. Background
The field of wireless communications has many applications including cordless telephones, paging, wireless local loops, and satellite communication systems. A particularly important application is cellular telephone systems for mobile subscribers. (As used herein, the term “cellular” systems encompasses both cellular and PCS frequencies.) Various over-the-air interfaces have been developed for such cellular telephone systems including frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (CDMA). In connection therewith, various domestic and international standards have been established including Advanced Mobile Phone Service (AMPS), Global System for Mobile (GSM), and Interim Standard 95 (IS-95). In particular, IS-95 and its derivatives, such as IS-95A, IS-95B (often referred to collectively as IS-95), ANSI J-STD-008, IS-99, IS-657, IS-707, and others, are promulgated by the Telecommunication Industry Association (TIA) and other well known standards bodies.
Cellular telephone systems configured in accordance with the use of the IS-95 standard employ CDMA signal processing techniques to provide highly efficient and robust cellular telephone service. An exemplary cellular telephone system configured substantially in accordance with the use of the IS-95 standard is described in U.S. Pat. No. 5,103,459 entitled “System and Method for Generating Signal Waveforms in a CDMA Cellular Telephone System”, which is assigned to the assignee of the present invention and incorporated herein by reference. The aforesaid patent illustrates transmit, or forward-link, signal processing in a CDMA base station. Exemplary receive, or reverse-link, signal processing in a CDMA base station is described in U.S. application Ser. No. 08/987,172, filed Dec. 9, 1997, entitled MULTICHANNEL DEMODULATOR, which is assigned to the assignee of the present invention and incorporated herein by reference. In CDMA systems, over-the-air power control is a vital issue. An exemplary method of power control in a CDMA system is described in U.S. Pat. No. 5,056,109 entitled “Method and Apparatus for Controlling Transmission Power in A CDMA Cellular Mobile Telephone System” which is assigned to the assignee of the present invention and incorporated herein by reference.
A primary benefit of using a CDMA over-the-air interface is that communications are conducted simultaneously over the same RF band. For example, each mobile subscriber unit (typically a cellular telephone) in a given cellular telephone system can communicate with the same base station by transmitting a reverse-link signal over the same 1.25 MHz of RF spectrum. Similarly, each base station in such a system can communicate with mobile units by transmitting a forward-link signal over another 1.25 MHz of RF spectrum.
Transmitting signals over the same RF spectrum provides various benefits including an increase in the frequency reuse of a cellular telephone system and the ability to conduct soft handoff between two or more base stations. Increased frequency reuse allows a greater number of calls to be conducted over a given amount of spectrum. Soft handoff is a robust method of transitioning a mobile unit between the coverage area of two or more base stations that involves simultaneously interfacing with two or more base stations. (In contrast, hard handoff involves terminating the interface with a first base station before establishing the interface with a second base station.) An exemplary method of performing soft handoff is described in U.S. Pat. No. 5,267,261 entitled “Mobile Station Assisted Soft Handoff in a CDMA Cellular Communications System” which is assigned to the assignee of the present invention and incorporated herein by reference.
Under Interim Standards IS-99 and IS-657 (referred to hereinafter collectively as IS-707), an IS-95-compliant communications system can provide both voice and data communications services. Data communications services allow digital data to be exchanged between a transmitter and one or more receivers over a wireless interface. Examples of the type of digital data typically transmitted using the IS-707 standard include computer files and electronic mail.
In accordance with both the IS-95 and IS-707 standards, the data exchanged between a transmitter and a receiver is processed in discreet packets, otherwise known as data packets or data frames, or simply frames. To increase the likelihood that a frame will be successfully transmitted during a data transmission, IS-707 employs a radio link protocol (RLP) to track the frames transmitted successfully and to perform frame retransmission when a frame is not transmitted successfully. Re-transmission is performed up to three times in IS-707, and it is the responsibility of higher layer protocols to take additional steps to ensure that frames are successfully received.
Recently, a need has arisen for transmitting audio information, such as voice, using the data protocols of IS-707. For example, in a wireless communications system employing cryptographic techniques, audio information may be more easily manipulated and distributed among data networks using a data protocol. In such applications, it is desirable to maintain the use of existing data protocols so that no changes to existing infrastructure are necessary. However, problems occur when transmitting voice using a data protocol, due to the nature of voice characteristics.
One of the primary problems of transmitting audio information using a data protocol is the delays associated with frame re-transmissions using an over-the-air data protocol such as RLP. Delays of more than a few hundred milliseconds in speech can result in unacceptable voice quality. When transmitting data, such as computer files, time delays are easily tolerated due to the non real-time nature of data. As a consequence, the protocols of IS-707 can afford to use the frame re-transmission scheme as described above, which may result in transmission delays, or a latency period, of more than a few seconds. Such a latency period is unacceptable for transmitting voice information.
What is needed is a method and apparatus for minimizing the problems caused by the time delays associated with frame retransmission requests from a receiver. Furthermore, the method and apparatus should be backwards-compatible with existing infrastructure to avoid expensive upgrades to those systems.
The present invention is a method and apparatus for reducing voice latency, otherwise known as communication channel latency, associated with a voice-over-data wireless communication system. Generally, this is achieved by dropping data frames at a transmitter, a receiver, or both, without degrading perceptible voice quality.
In a first embodiment of the present invention, in a voice-over-data communication system, data frames are dropped in a transmitter at a fixed, predetermined rate prior to storage in a queue. Audio information, such as voice, is transformed into data frames by a voice-encoder, or vocoder, at a fixed rate, in the exemplary embodiment every 20 milliseconds. The data frames are stored in a queue for use by further processing elements. A processor located within the transmitter prevents data frames from being stored in the queue at a fixed, predetermined rate. This is known as frame dropping. As a result of fewer data frames being stored in the queue, fewer data frames representing the audio information are transmitted to the receiver, thereby alleviating the problem of communication channel latency between transmitter and receiver due to poor communication channel quality.
At the receiver, data frames are received, demodulated, and placed into a queue for use by a voice decoder. Data frames are withdrawn from the queue by the voice decoder at the same fixed rate as they were generated at the transmitter, i.e., every 20 milliseconds in the exemplary embodiment. Occasionally, the size of the queue will vary dramatically due to poor communication channel quality. Under such circumstances, frame retransmissions from the transmitter to the receiver occur, causing an overall increase in the number of data frames ultimately used by the voice decoder. The increased size of the queue causes subsequent frames added to the queue to be delayed from reaching the voice decoder, resulting in increased communication channel latency. The present invention reduces this latency by transmitting fewer data frames to represent the audio information. Thus, during periods of poor communication channel quality, the size of the receive queue is held to a reasonable size, preventing an unreasonable amount of communication channel latency.
In a second embodiment of the present invention, data frames are dropped at a transmitter at either one of two rates, depending on the communication channel latency which relates to the quality of the communication channel. A first rate is used if the communication channel latency is within reasonable limits, i.e., little or no perceptible voice latency. A second, higher rate is used when it is determined that the communication channel latency is sufficiently noticeable. In this embodiment, as in the first embodiment, audio information is transformed into data frames by a voice-encoder, or vocoder, at a fixed rate, in the exemplary embodiment every 20 milliseconds. Under normal channel conditions, where the communication channel latency is within an acceptable range, data frames are dropped at a first, fixed rate. Data frames are dropped at a second, higher rate if a processor determines that the communication channel latency has increased significantly. This embodiment reduces the communication channel latency quickly during bursty channel error conditions where latency can increase rapidly.
In a third embodiment of the present invention, communication channel latency is reduced by dropping data frames at the transmitter at a variable rate, depending on the communication channel latency. In this embodiment, a processor located within the transmitter determines the communication channel latency using one of several possible techniques. If the processor determines that the communication channel latency has changed, frames are dropped at a rate proportional to the level of communication channel latency. As latency increases, the frame dropping rate increases. As latency decreases, the frame dropping rate decreases. As in the first two embodiments, communication channel latency increases when the communication channel quality decreases. This is due primarily to increased frame re-transmissions which occur as the communication channel quality decreases.
In a fourth embodiment, data frames are dropped in accordance with the rate at which the data frames were encoded by a voice-encoder. In this embodiment, a variable-rate vocoder is used to encode audio information into data frames at varying data rates, in the exemplary embodiment, four rates: full rate, half rate, quarter rate, and eighth rate. A processor located within the transmitter determines the communication channel latency using one of several possible techniques. If the processor determines that the communication channel latency has increased beyond a predetermined threshold, eighth-rate frames are dropped as they are produced by the vocoder. If the processor determines that the communication channel latency has increased beyond a second predetermined threshold, both eighth rate and quarter-rate frames are dropped at they are produced by the vocoder. Similarly, half rate and full rate frames are dropped as the communication channel latency continues to increase.
In a fifth embodiment of the present invention, data frames are dropped at the receiver either alone, or in combination with frame dropping at a transmitter. The fifth embodiment can be implemented using any of the above embodiments. For example, data frames can be dropped using a single, fixed rate, two fixed rates, or a variable rate, and can further incorporate the fourth embodiment, where frames are dropped in accordance with their rate at which the data frames have been encoded by the vocoder residing at the transmitter.
In a sixth embodiment, frame dropping is performed at the receiver. Receiver frame dropping is usually performed based on a queue length compared to a queue threshold. In the sixth embodiment, the queue threshold is dynamically adjusted to maintain a constant level of voice quality.
The embodiments described herein are described with respect to a wireless communication system operating in accordance with the use of CDMA signal processing techniques of the IS-95, IS-707, and IS-99 Interim Standards. While the present invention is especially suited for use within such a communications system, it should be understood that the present invention may be employed in various other types of communications systems that transmit information in discreet packets, otherwise known as data packets, data frames, or simply frames, including both wireless and wireline communication systems, and satellite-based communication systems. Additionally, throughout the description, various well-known systems are set forth in block form. This is done for the purpose of clarity.
Various wireless communication systems in use today employ fixed base stations that communicate with mobile units using an over-the-air interface. Such wireless communication systems include AMPS (analog), IS-54 (North American TDMA), GSM (Global System for Mobile communications TDMA), and IS-95 (CDMA). In a preferred embodiment, the present invention is implemented in a CDMA system.
A prior art wireless communication system is shown in
Transmissions from transmitter 102 are received by receiver 112, where they are downconverted and demodulated into data frames representing the original data frames generated by voice encoder 108. The data frames are then provided to receiver buffer 114, where they are stored until used by voice decoder 116, for reconstructing the original electrical signal. Once the data frames have been converted into the original electrical signal, the audio information is reproduced using transducer 118, typically an audio speaker.
The purpose of receive buffer 114 is to ensure that at least one data frame is available for use by voice decoder 116 at all times. Data frames are stored on a first in/first out basis. In theory, as one data frame is used by voice decoder 116, a new data frame is provided by receiver 112 and stored in receive buffer 114, thereby keeping the number of frames stored in receive buffer 114 constant. Voice decoder 116 requires a constant, uninterrupted stream of data frames in order to reproduce the audio information correctly. Without receive buffer 114, any interruption in data transmission would result a discontinuation of data frames to voice decoder 116, thereby distorting the reconstructed audio information. By maintaining a constant number of data frames in receive buffer 114, a continuous flow of data frames can still be provided to voice decoder 116, even if a brief transmission interruption occurs.
One potential problem with the use of receiver buffer 114 is that it may cause a delay, or latency, during the transmission of audio information between transmitter 102 and receiver 104, for example, in a telephonic conversation.
The above scenario assumes that the number of data frames stored in receive buffer 114 remain constant over time. However, in practice, the number of data frames stored within receive buffer 114 at any given time varies, depending on a number of factors. One factor which is particularly influential on the size of receive buffer 114 is the communication channel quality between transmitter 102 and receiver 104. If the communication channel is degraded for some reason, the rate at which data frames are added to receive buffer 114 will be initially slower and then ultimately greater than the rate at which data frames are removed from receive buffer 114 by voice decoder 116. This causes an increase the size of receive buffer 114 so that new data frames are added in later slot positions, for example, in slot position 9. New data frames added at slot position 9 will be delayed 8 frames times 20 milliseconds per frame, or 160 milliseconds, before being used by voice decoder 116. Thus, the communication channel latency increases to 160 milliseconds, which results in noticeable delays in communication between transmitter 102 and receiver 104.
Latency of over a few hundred milliseconds is generally not tolerable during voice communications. Therefore, a solution is needed to reduce the latency associated with degraded channel conditions.
The present invention overcomes the latency problem generally by dropping data frames at transmitter 102, at receiver 104, or at both locations.
MSC 16 is configured to interface with a conventional public switch telephone network (PSTN) 18 or directly to a computer network, such as Internet 20. MSC 16 is also configured to interface with BSC 14. BSC 14 is coupled to each base station 12 via backhaul lines. The backhaul lines may be configured in accordance with any of several known interfaces including E1/T1, ATM, or IP. It is to be understood that there can be more than one BSC 14 in the system. Each base station 12 advantageously includes at least one sector (not shown), each sector comprising an antenna pointed in a particular direction radially away from base station 12. Alternatively, each sector may comprise two antennas for diversity reception. Each base station 12 may advantageously be designed to support a plurality of frequency assignments (each frequency assignment comprising 1.25 MHz of spectrum). The intersection of a sector and a frequency assignment may be referred to as a CDMA channel. Base station 12 may also be known as base station transceiver subsystem (BTS) 12. Alternatively, “base station” may be used in the industry to refer collectively to BSC 14 and one or more BTSs 12, which BTSs 12 may also be denoted “cell sites” 12. (Alternatively, individual sectors of a given BTS 12 may be referred to as cell sites.) Mobile subscriber units 10 are typically wireless telephones 10, and the wireless communication system is advantageously a CDMA system configured for use in accordance with the IS-95 standard.
During typical operation of the cellular telephone system, base stations 12 receive sets of reverse-link signals from sets of mobile units 10. The mobile units 10 transmit and receive voice and/or data communications. Each reverse-link signal received by a given base station 12 is processed within that base station 12. The resulting data is forwarded to BSC 14. BSC 14 provides call resource allocation and mobility management functionality including the orchestration of soft handoffs between base stations 12. BSC 14 also routes the received data to MSC 16, which provides additional routing services for interface with PSTN 18. Similarly, PSTN 18 and internet 20 interface with MSC 16, and MSC 16 interfaces with BSC 14, which in turn controls the base stations 12 to transmit sets of forward-link signals to sets of mobile units 10.
In accordance with the teachings of IS-95, the wireless communication system of
The protocols contained within IS-707 to transmit data are different than the protocols used to transmit audio information, as specified in IS-95, due to the properties associated with each data type. For example, the permissible error rate while transmitting audio information can be relatively high, due to the limitations of the human ear. A typical permissible frame error rate in an IS-95 compliant CDMA communication system is one percent, meaning that one percent of transmitted frames can be received in error without a perceptible loss in audio quality.
In a data communication system, the error rate must be much lower than in a voice communication system, because a single data bit received in error can have a significant effect on the information being transmitted. A typical error rate in such a data communication system, specified as a Bit Error Rate (BER) is on the order of 10−9, or one bit received in error for every billion bits received.
In an IS-707 compliant data communication system, information is transmitted in 20 millisecond data packets in accordance with a Radio Link Protocol, defined by IS-707. The data packets are sometimes referred to as RLP frames. If an RLP frame is received in error by receiver 104, i.e., the received RLP frame contains errors or was never received by receiver 104, a re-transmission request is sent by receiver 104 requesting that the bad frame be re-transmitted. In a CDMA compliant system, the re-transmission request is known as a negative-acknowledgement message, or NAK. The NAK informs transmitter 102 which frame or frames to re-transmit corresponding to the bad frame(s). When the transmitter receives the NAK, a duplicate copy of the data frame is retrieved from a memory buffer and is then re-transmitted to the receiver. This process may be repeated several times if necessary.
The re-transmission scheme just described introduces a time delay, or latency, in correctly receiving a frame which has initially been received in error. Usually, this time delay does not have an adverse effect when transmitting data. However, when transmitting audio information using the protocols of a data communication system, the latency associated with re-transmission requests may become unacceptable, as it introduces a noticeable loss of audio quality to the receiver.
Referring back to
The digitized voice signal is then provided to voice encoder 406, which is typically used in conjunction with a voice decoder (not shown). The combined device is typically referred to as a vocoder. Voice encoder 406 is a well-known device for compressing the digitized voice signal to minimize the bandwidth required for transmission. Voice encoder 406 generates consecutive data frames, otherwise referred to as vocoder frames, generally at regular time intervals, such as every 20 milliseconds in the exemplary embodiment, although other time intervals could be used in the alternative. The length of each data frame generated by voice encoder 406 is therefore 20 milliseconds.
One way that many vocoders maximize signal compression is by detecting periods of silence in a voice signal. For example, pauses in human speech between sentences, words, and even syllables present an opportunity for many vocoders to compress the bandwidth of the voice signal by producing a data frame having little or no information contained therein. Such a data frame is typically known as a low rate frame.
Vocoders may be further enhanced by offering variable data rates within the data frames that they produce. An example of such a variable rate vocoder is found in U.S. Pat. No. 5,414,796 (the '796 patent) entitled “VARIABLE RATE VOCODER”, assigned to the assignee of the present invention and incorporated by reference herein. When little or no information is available for transmission, variable rate vocoders produce data frames at reduced data rates, thus increasing the transmission capacity of the wireless communication system. In the variable rate vocoder described by the '796 patent, data frames comprise data at either full, one half, one quarter, or one eighth the data rate of the highest data rate used in the communication system.
Data frames generated by voice encoder 406, again, referred to as vocoder frames, are stored in a queue 408, or sequential memory, to be later digitally modulated and then upconverted for wireless transmission. In the present invention, vocoder frames are encoded into data packets, in conformity with one or more well-known wireless data protocols. In a voice-over-data communication system, vocoder frames are converted to data frames for easy transmission among computer networks such as the Internet and to allow voice information to be easily manipulated for such applications as voice encryption using, for example, public-key encryption techniques.
In prior art transmitters, each vocoder frame generated by voice encoder 406 is stored sequentially in queue 408. However, in the present invention, not all vocoder frames are stored. Processor 410 selectively eliminates, or “drops,” some vocoder frames in order to reduce the total number of frames transmitted to a receiver. The methods in which processor 410 drops frames is discussed later herein.
Frames stored in queue 408 are provided to TCP processor 412, where they are transformed into data packets suitable for the particular type of data protocol used in a computer network such as the Internet. For example, in the exemplary embodiment, the frames from queue 408 are formatted into TCP/IP frames. TCP/IP is a pair of well-known data protocols used to transmit data over large public computer networks, such as the Internet. Other well-known data protocols may be used in the alternative. TCP processor 412 may be a hardware device, either discreet or integrated, or it may comprise a microprocessor running a software program specifically designed to transform vocoder frames into data packets suitable for the particular data protocol at hand.
As shown in
TCP frames are characterized by having a duration measured by the number of bits contained within each frame. As shown in
It should be understood that TCP frames are not generated by TCP processor 412 at regular intervals, due to the nature of the variable rate vocoder frames. For example, if no information is available for transmission, for instance no voice information is provided to microphone 402, a long series of low-rate vocoder frames will be produced by voice encoder 406. Therefore, many frames of low-rate vocoder frames will be needed to fill the 536 bits needed for a TCP frame, and, thus, a TCP frame will be produced more slowly. Conversely, if high voice activity is present at microphone 402, a series of high-rate vocoder frames will be produced by voice encoder 406. Therefore, relatively few vocoder frames will be needed to fill the 536 bits necessary for a TCP frame, thus, a TCP frame will be generated more quickly.
The data frames generated by TCP processor 412, referred to as TCP frames in this example, are provided to RLP processor 414. RLP processor 414 receives the TCP frames from TCP processor 412 and re-formats them in accordance with a predetermined over-the-air data transmission protocol. For example, in a CDMA communication system based upon Interim Standard IS-95, data packets are transmitted using the well-known Radio Link Protocol (RLP) as described in Interim Standard IS-707. RLP specifies data to be transmitted in 20 millisecond frames, herein referred to as RLP frames. In accordance with IS-707, RLP frames comprise an RLP frame sequence field, an RLP frame type field, a data length field, a data field for storing information from TCP frames provided by TCP processor 412, and a field for placing a variable number of padding bits.
RLP processor 414 receives TCP frames from TCP processor 412 and typically stores the TCP frames in a buffer (not shown). RLP frames are then generated from the TCP frames using techniques well-known in the art. As RLP frames are produced by RLP processor 414, they are placed into transmit buffer 416. Transmit buffer 416 is a storage device for storing RLP frames prior to transmission, generally on a first-in, first-out basis. Transmit buffer 416 provides a steady source of RLP frames to be transmitted, even though a constant rate of RLP frames is generally not supplied by RLP processor 414. Transmit buffer 416 is a memory device capable of storing multiple data packets, typically 100 data packets or more. Such memory devices are commonly found in the art.
Data frames are removed from transmit buffer 416 at predetermined time intervals equal to 20 milliseconds in the exemplary embodiment. The data frames are then provided to modulator 418, which modulates the data frames in accordance with the chosen modulation technique of the communication system, for example, AMPS, TDMA, CDMA, or others. In the exemplary embodiment, modulator 418 operates in accordance with the teachings of IS-95. After the data frames have been modulated, they are provided to RF transmitter 420 where they are upconverted and transmitted, using techniques well-known in the art.
In a first embodiment of the present invention, data frames are dropped by processor 410 at a predetermined, fixed rate. In the exemplary embodiment, the rate is 1 frame dropped per hundred frames generated by voice encoder 406, or a rate of 1%. Processor 410 counts the number of frames generated by voice encoder 406. As each frame is generated, it is stored in queue 408. When the 100th frame is generated, processor 410 drops the frame by failing to store it in queue 408. The next frame generated by voice encoder 406, the 101st frame, is stored in queue 408 adjacent to the 99th frame. Alternatively, other predetermined, fixed rates could be used, however, tests have shown that dropping more than 10 percent of frames leads to poor voice quality at a receiver.
In the first embodiment, frames are dropped on a continuous basis, without regard to how much or how little communication channel latency exists between the transmitter and a receiver. However, in a modification to the first embodiment, processor 410 monitors the communication channel latency and implements the fixed rate frame dropping technique only if the communication channel latency exceeds a predetermined threshold. The communication channel latency is generally determined by monitoring the communication channel quality. The communication channel quality is determined by methods well known in the art, and described below. If the communication channel latency drops below the predetermined threshold, processor 410 discontinues the frame dropping process.
In a second embodiment of the present invention, frames are dropped at either one of two fixed rates, depending on the communication channel latency. A first rate is used to drop frames when the communication channel latency is less than a predetermined threshold. A second fixed rate is used to drop frames when the communication channel latency exceeds the predetermined threshold. Again, the communication channel latency is generally derived from the communication channel quality, which in turn depends on the channel error rate. Further details of determining the communication channel latency is described below.
Often, the communication channel quality, thus the communication channel latency, is expressed in terms of a channel error rate, or the number of frames received in error by the receiver divided by the total number of frames transmitted over a given time period. A typical predetermined threshold in the second embodiment, then, could be equal to 7%, meaning that if more than 7 percent of the transmitted frames are received in error, generally due to a degraded channel condition, frames are dropped at the second rate. The second rate is generally greater than the first rate. If the channel quality is good, the error rate will generally be less than the predetermined rate, therefore frames are dropped using the first rate, typically equal to between one and four percent.
Referring back to
As frames are transmitted by transmitter 400, processor 410 determines the quality of the communication channel by determining the length of queue 408. If the channel quality increases, i.e., the length of queue 408 decreases below a predetermined threshold, frames are dropped at a first rate. If the channel quality decreases, i.e., the length of queue 408 increases above the predetermined threshold, frames are dropped at a second, higher rate.
The reason why frames are dropped at a higher rate when the channel quality is poor is that more frame re-transmissions occur during poor channel conditions, causing a backup of frames waiting to be transmitted at queue 408. At the receiver, during poor channel conditions, a receiver buffer first underflows due to the lack of error-free frames received, then overflows when the channel conditions improve. When the receive buffer underflows, silence frames, otherwise known as erasure frames, are provided to a voice decoder in order to minimize the disruption in voice quality to a user. If the receive buffer overflows, or becomes relatively large, latency is increased. Therefore, when the communication channel quality becomes degraded, it is desirable to drop frames at an increased rate at transmitter 400, so that neither queue 408 nor the receiver buffer grow too large, increasing latency to intolerable levels.
In a third embodiment of the present invention, latency is reduced by dropping data frames at a variable rate, depending on the communication channel latency. In this embodiment, processor 410 determines the quality of the communication channel using one of several possible techniques. The rate at which frames are dropped is inversely proportional to the communication channel quality. If the channel quality is determined by the channel error rate, the rate at which frames are dropped is directly proportional to the channel error rate.
As in other embodiments, processor 410 determines the communication channel quality, generally by measuring the length of queue 408 or by measuring the channel error rate, as discussed above. As the communication channel quality increases, that is, the channel error rate decreases, the rate at which frames are dropped decreases at a predetermined rate. As the communication channel quality decreases, that is, the channel error rate increases, the rate at which frames are dropped increases at a predetermined rate. For example, with every 1 percent point change in the channel error rate, the frame dropping rate might change by 1 percentage point.
As in the first two embodiments, when the quality of the communication channel decreases, more frame re-transmissions are necessary, resulting in either queue 408 or the receiver buffer increasing in size, causing an unacceptable amount of latency.
In a fourth embodiment of the present invention, data frames are dropped in accordance with the rate at which the data frames were encoded by voice encoder 406. In this embodiment, voice encoder 406 comprises a variable-rate vocoder, as described above. Voice encoder 406 encodes audio information into data frames at varying data rates, in the exemplary embodiment, four rates: full rate, half rate, quarter rate, and eighth rate. Processor 410 located within the transmitter determines the communication channel latency generally by determining the communication channel quality using one of several possible techniques. If processor 410 determines that the communication channel has become degraded beyond a predetermined threshold, a percentage of data frames having the lowest encoded rate generated by voice encoder 406 are dropped. In the exemplary embodiment, a percentage eighth-rate frames are dropped if the communication channel becomes degraded by more than a predetermined threshold. If processor 410 determines that the communication channel has become further degraded beyond a second predetermined threshold, a percentage of data frames having the second lowest encoding rate generated by voice encoder 406 are dropped in addition to the frames having the lowest encoding rate. In the exemplary embodiment, a percentage of both quarter-rate frames and eighth-rate frames are dropped if the communication channel becomes degraded by more than the second predetermined threshold as they are generated by voice encoder 406. Similarly, a percentage of half rate and full rate frames are dropped if the communication channel degrades further. In a related embodiment, if the communication channel becomes degraded beyond the second predetermined threshold, only a percentage of data frames having an encoding rate of the second lowest encoding rate are dropped, while data frames having an encoding rate equal to the lowest encoding rate are not dropped.
The percentage of frames dropped in any of the above scenarios is generally a predetermined, fixed number, and may be either the same as, or different, for each frame encoding rate. For example, if lowest rate frames are dropped, the predetermined percentage may be 60%. If the second-lowest and lowest frames are both dropped, the predetermined percentage may be equal to 60%, or it may be equal to a smaller percentage, for example 30%.
In a fifth embodiment of the present invention, data frames are dropped at a receiver, rather than at transmitter 400.
Communication signals are received by RF receiver 602 using techniques well known in the art. The communication signals are downconverted then provided to demodulator 604, where the communication signals are converted into data frames. In the exemplary embodiment, the data frames comprise RLP frames, each frame 20 milliseconds in duration.
The RLP frames are then stored in receive buffer 606 for use by RLP processor 608. RLP processor 608 uses received RLP frames stored in receive buffer 606 to re-construct data frames, in this example, TCP frames. The TCP frames generated by RLP processor 608 are provided to TCP processor 610. TCP processor 610 accepts TCP frames from RLP processor 608 and transforms the TCP frames into vocoder frames, using techniques well known in the art. Vocoder frames generated by TCP processor 610 are stored in queue 612 until they can be used by voice decoder 614. Voice decoder 614 uses vocoder frames stored in queue 612 to generate a digitized replica of the original signal transmitted from transmitter 400. Voice decoder 614 generally requires a constant stream of vocoder frames from queue 612 in order to faithfully reproduce the original audio information. The digitized signal from voice decoder 614 is provided to digital-to-analog converter D/A 616. D/A 616 converts the digitized signal from voice decoder 614 into an analog signal. The analog signal is then sent to audio output 618 where the audio information is converted into an acoustic signal suitable for a listener to hear.
The coordination of the above process is handled by processor 620. Processor 620 can be implemented in one of many ways which are well known in the art, including a discreet processor or a processor integrated into a custom ASIC. Alternatively, each of the above block elements could have an individual processor to achieve the particular function of each block, wherein processor 620 would be generally used to coordinate the activities between the blocks.
As mentioned previously, voice decoder 614 generally requires a constant stream of vocoder frames in order to reconstruct the original audio information without distortion. To achieve a constant stream of vocoder frames, queue 612 is used. Vocoder frames generated by TCP processor 610 are generally not produced at a constant rate, due to the quality of the communication channel and the fact that a variable-rate vocoder is often used in transmitter 400, generating vocoder frames at varying encoding rates. Queue 612 allows for changes in the vocoder frame generation rate by TCP processor 610 while ensuring a constant stream of vocoder frames to voice decoder 614.
The object of queue 612 is to maintain enough vocoder frames to supply voice decoder 614 with vocoder frames during periods of low frame generation by TCP processor 610, but not too many frames due to the increased latency produced in such a situation. For example, if the size of queue 612 is 50 frames, meaning that the current number of vocoder frames stored in queue 612 is 50, voice latency will be equal to 50 times 20 milliseconds (the length of each frame in the exemplary embodiment), or 1 second, which is unacceptable for most audio communications.
In the fifth embodiment of the present invention, frames are removed from queue 612, or dropped, by processor 620 in order to reduce the number of vocoder frames stored in queue 612. By dropping vocoder frames in queue 612, the problem of latency is reduced. However, frames must be dropped such that a minimum amount of distortion is introducing into the audio information.
Processor 620 may drop frames in accordance with any of the above discussed methods of dropping frames at transmitter 400. For example, frames may be dropped at a single, fixed rate, at two or more fixed rates, or at a variable rate. In addition, if a variable-rate voice encoder 406 is used at transmitter 400, frames may be dropped on the basis of the rate at which the frames were encoded by voice encoder 406. Dropping frames generally comprises dropping further incoming frames to queue 612, rather than dropping frames already stored in queue 612.
Generally, the decision of when to drop frames is based on the communication channel latency as determined by the communication channel quality, which in turn can be derived from the size of queue 612. As the size of queue 612 increases beyond a predetermined threshold, latency increases to an undesired level. Therefore, as the size of queue 612 exceeds a predetermined threshold, processor 620 begins to drop frames from queue 612 at the single fixed rate. As the size of queue 612 decreases past the predetermined threshold, frame dropping is halted by processor 620. For example, if the size of queue 612 decreases to 2 frames, latency is no longer a problem, and processor 620 halts the process of frame dropping.
If two or more fixed rate schemes are used to drop frames, two or more predetermined thresholds are used to determine when to use each fixed dropping rate. For example, if the size of queue 612 increases greater than a first predetermined threshold, processor 620 begins dropping frames at a first predetermined rate, such as 1 percent. If the size of queue 612 continues to grow, processor 620 begins dropping frames at a second predetermined rate if the size of queue 612 increases past a second predetermined size. As the size of queue 612 decreases below the second threshold, processor 620 halts dropping frames at the second predetermined rate and begins dropping frames more slowly at the first predetermined rate. As the size of queue 612 decreases further, past the second predetermined threshold, or size, processor 620 halts frame dropping altogether so that the size of queue 612 can increase to an appropriate level.
If a variable frame dropping scheme is used, processor 620 determines the size of queue 612 on a continuous or near-continuous basis, and adjusts the rate of frame dropping accordingly. As the size of queue 612 increases, the rate at which frames are dropping increases as well. As the size of queue 612 decreases, the rate at which frames are dropped decreases. Again, if the size of queue 612 falls below a predetermined threshold, processor 620 halts the frame dropping process completely.
In another embodiment, frames may be dropped in accordance with the size of queue 612 and the rate at which frames have been encoded by voice encoder 406, if voice encoder 406 is a variable-rate vocoder. If the size of queue 612 exceeds a first predetermined threshold, or size, vocoder frames having an encoding rate at a lowest encoded rate are dropped. If the size of queue 612 exceeds a second predetermined threshold, vocoder frames having an encoding rate at a second-lowest encoding rate and the lowest encoding rate are dropped. Conceivably, frames encoded at a third-lowest encoding rate plus second lowest and lowest encoding rate frames could be dropped if the size of queue 612 surpassed a third predetermined threshold. Again, as the size of queue 612 decreases through the predetermined thresholds, processor 620 drops frames in accordance with the encoded rate as each threshold is passed.
As explained above, frame dropping can occur at receiver 600 or at transmitter 400. However, in another embodiment, frame dropping can occur at both transmitter 400 and at receiver 600. Any combination of the above embodiments can be used in such case.
In a sixth embodiment of the present invention, frame dropping is performed at the receiver, generally based on the length of queue 612 compared to a variable queue threshold. If the length of queue 612 is less than the variable queue threshold, frames are dropped at a first rate, in the exemplary embodiment, zero. In other words, when the length of queue 612 is less than the variable queue threshold, no frame dropping occurs. Frame dropping occurs at a second rate, generally higher than the first rate, if the length of queue 612 is greater than the variable queue threshold. In other related embodiments, the first rate could be equal to a non-zero value. In the sixth embodiment, the variable queue threshold is dynamically adjusted to maintain a constant level of vocoder frame integrity or voice quality.
In the exemplary embodiment, vocoder frame integrity is determined using two counters within receiver 600, although other well-known alternative techniques could be used instead. A first counter 622 increments for every vocoder frame duration, in the exemplary embodiment, every 20 milliseconds. A second counter 624 increments every time a vocoder frame is delivered from queue 612 to voice decoder 614 for decoding. Voice frame integrity is calculated by dividing count of counter 624 by the count of counter 622 at periodic intervals. The voice frame integrity is then compared to a predetermined value, for example 90%, representing an acceptable voice quality level. In the exemplary embodiment, the voice frame integrity is calculated every 25 frame intervals, or 500 milliseconds. If the voice frame integrity is less than the predetermined value, the variable queue threshold is increased by a predetermined number of frames, for example, by 1 frame. Counters 622 and 624 are then reset. The effect of increasing the variable queue threshold is that less frames are dropped, resulting in more frames being used by voice decoder 614, and thus, an increase in the voice frame integrity. Conversely, if the voice frame integrity exceeds the predetermined value, the variable queue threshold is reduced by a predetermined number of frames, for example, by 1 frame. Counters 622 and 624 are then reset. The effect of decreasing the variable queue threshold is that more frames are dropped, resulting in fewer frames being used by voice decoder 614, and thus, a decrease in the voice frame integrity.
In transmitter 400, data frames are generated from audio information in step 700. The data frames in the present invention are digitized representations of audio information, typically human speech, arranged in discreet packets or frames. Typically, the data frames are generated by voice encoder 406, or the voice encoding component of a well-known vocoder. Such data frames are typically referred to as vocoder frames. It should be understood that the use of voice encoder 406 is not mandatory for the present invention to operate. The present invention is applicable to vocoder frames or any kind of data frames generated in response to an audio signal.
In receiver 600 at step 700, data frames are generated by TCP processor 610 after being transmitted by transmitter 400 and received, downconverted, and recovered from the data encoding process used by TCP processor 410 and RLP processor 412 at transmitter 400. The data frames generated by TCP processor are replicas of the data frames generated at transmitter 400, in the exemplary embodiment, vocoder frames generated by voice encoder 406.
At step 702, data frames are dropped at a fixed, predetermined rate, in the exemplary embodiment, a rate between 1 and 10 percent. Frames are dropped regardless of the communication system latency. In transmitter 400, data frames are dropped as they are generated by voice encoder 406, prior to storage in queue 408. In receiver 600, frames are dropped as they are generated by TCP processor 610, prior to storage in queue 612.
At step 704, data frames that have not been dropped are stored in queue 408 at transmitter 400, or in queue 612 at receiver 600.
In step 800, data frames are generated at the transmitter or the receiver, as described above. In step 802, communication system latency is determined by processor 410 in transmitter 400, or by processor 620 in receiver 600. In transmitter 400, the latency of the communication system can be determined by a number of methods well known in the art. In the exemplary embodiment, the latency is determined by measuring the quality of the communication channel between transmitter 400 and receiver 600. This, in turn, is measured by counting the number of NAKs received by transmitter 400 over a given period of time. A high rate of received NAKs indicate a poor channel condition and increased latency while a low rate of received NAKs indicate a good channel condition and less latency.
Latency at receiver 600 is measured by determining the size of queue 612 at any given time. As the size of queue 612 increases, latency is increased. As the size of queue 612 decreases, latency is reduced. Similarly, the size of queue 408 can be used to determine the latency between transmitter 400 and receiver 600.
In step 804, the communication system latency is evaluated in comparison to a first predetermined threshold. In transmitter 400, if the communication channel quality is less than a first predetermined threshold, step 806 is performed in which data frames from voice encoder 406 are dropped at a first predetermined rate. In the exemplary embodiment, the first predetermined threshold is a number of NAKs received over a predetermined period of time, or the size of queue 408. Data frames generated by voice encoder 406 are then dropped at the first predetermined rate, in the exemplary embodiment, between 1 and 10 percent.
In receiver 600, the communication system latency is determined with respect to the size of queue 612. The first predetermined threshold is given in terms of the size of queue 612. If the size of queue 612 exceeds the first predetermined threshold, for example 10 frames, then step 806 is performed in which data frames from voice encoder 406 are dropped at the first predetermined rate.
Referring back to step 804, if the communication system latency is not greater than a first predetermined threshold, step 808 is performed in which frames are dropped at a second predetermined rate. The second predetermined rate is greater than the first predetermined rate. The second predetermined rate is used to quickly reduce the communication system latency.
In transmitter 400, as frames are generated by voice encoder 406, they are dropped at either the first or the second predetermined rate, and stored in queue 408, as shown in step 810. In receiver 600, as frames are generated by TCP processor 610, they are dropped at either the first or the second predetermined rate, and stored in queue 612, also shown in step 810. The process of evaluating the communication channel latency and adjusting the frame dropping rate continues on an ongoing basis, repeating the steps of 802 through 808.
In step 900, data frames are generated at the transmitter or the receiver, as described above. In step 902, the communication system latency is determined by processor 410 in transmitter 400, or by processor 620 in receiver 600 on a continuous or near continuous basis. In step 904, the rate at which frames are dropped is adjusted in accordance with the latency determination of step 902. As the communication system latency increases, the rate at which frames are dropped increases, and vice-versa. The rate adjustment may be determined by using a series of latency thresholds such that as each threshold is crossed, the frame dropping rate is increased or decreased, as the case may be, by a predetermined amount. The process of evaluating the communication system latency and adjusting the frame dropping rate is repeated.
In transmitter 400, as frames are generated by voice encoder 406, they are dropped at either the first or the second predetermined rate, and stored in queue 408, as shown in step 906. In receiver 600, as frames are generated by TCP processor 610, they are dropped at either the first or the second predetermined rate, and stored in queue 612, also shown in step 906.
As described in the fourth embodiment, frames may be dropped on the basis of the rate at which they were encoded by voice encoder 406, if a variable rate vocoder is used in transmitter 400. In such case, rather than drop frames at a first or second predetermined rate, or at a variable rate, frames are dropped on the basis of their encoded rate and the level of communication system latency. For example, in
In
After a predetermined time period, generally expressed as a number of vocoder frames, for example 25 frames, step 1002 is performed in which a voice frame integrity is calculated by dividing count of counter 624 by the count of counter 622. In step 1004, the voice frame integrity is compared to a predetermined value representing a minimum desired voice quality. If the voice frame integrity is less than the predetermined value, processing continues to step 1006. If the voice frame integrity is greater then or equal to the predetermined value, processing continues to step 1008.
In step 1006, a variable queue threshold is increased. In step 1008, the variable queue threshold is decreased. The variable queue threshold represents a decision point at which frames are dropped at either one of two rates, as explained below. In step 1010, counters 622 and 624 are cleared.
In step 1012, the current length of queue 612 is compared to the variable queue threshold. If the current length of queue 612, as measured by the number of frames stored in queue 612, is less than the variable queue threshold, step 1014 is performed, in which frames are dropped at a first rate, in the exemplary embodiment, zero. In other words, if the length of queue 612 is less than the variable queue length, no frame dropping occurs.
If the current length of queue 612 is greater than or equal to the variable queue threshold, step 1016 is performed, in which frames are dropped at a second rate, generally a rate greater than the first rate. The process then repeats at step 1000.
The previous description of the preferred embodiments is provided to enable any person skilled in the art to make or use the present invention. The various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without the use of the inventive faculty. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
This application is a continuation of U.S. application Ser. No. 09/406,945 filed Sep. 28, 1999 now U.S. Pat. No. 6,785,262 entitled METHOD AND APPARATUS FOR VOICE LATENCY REDUCTION IN A VOICE-OVER-DATA WIRELESS COMMUNICATION SYSTEM.
Number | Name | Date | Kind |
---|---|---|---|
5812200 | Normile | Sep 1998 | A |
5828653 | Goss | Oct 1998 | A |
6169738 | Sriram et al. | Jan 2001 | B1 |
6219339 | Doshi et al. | Apr 2001 | B1 |
6229789 | Simpson et al. | May 2001 | B1 |
6243359 | Roy et al. | Jun 2001 | B1 |
6247058 | Miller et al. | Jun 2001 | B1 |
6282196 | Lyons et al. | Aug 2001 | B1 |
6680906 | Nguyen | Jan 2004 | B1 |
Number | Date | Country | |
---|---|---|---|
20040240436 A1 | Dec 2004 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09406945 | Sep 1999 | US |
Child | 10888630 | US |