This invention relates to a method and system for testing the quality of a voice-over-internet-protocol (VoIP) network and more particularly, to a method and system for end-to-end network testing of voice and path quality in a VoIP network.
While the invention is particularly directed to the art of VoIP telephony, and will be thus described with specific reference thereto, it will F be appreciated that the invention may have usefulness in other fields and applications. For example, the invention may be used in cellular and traditional phone systems.
By way of background, a VoIP network converts analog audio data to digital data that can be transmitted over the internet. Many phone companies use VoIP to streamline networks by routing thousands of phone calls through a circuit switch and into an IP gateway. Among other functions, the gateway compresses the data and transmits the data through the network. Once the call is received by a destination gateway, the call is decompressed, reassembled and routed to a local circuit switch.
VoIP technology is gaining popularity as a way to transfer voice data. Because of numerous economic and infrastructure benefits, VoIP is a viable alternative to traditional phone service in some circumstances. However, in order to become major competitor, VoIP technology must match the level of quality of traditional phone service, which it has yet to do.
VoIP technology, in many respects, is more sensitive than other forms of audio/voice transmission. Many factors, including excessive bandwidth usage and out of order packets, contribute to poor voice transmission. Notably, these factors typically only have a very minor effect on data transmission quality. Although the average customer may not notice the reduction in quality for strict data transmission, the average customer would likely (and indeed does) notice the drop in voice quality when these difficulties are encountered. However, when a relatively small amount of packets are lost or out of order, it can cause many noticeable problems such as jitter and latency which, in turn, can cause echo problems and/or dropouts. These problems render VoIP technology less desirable to the average user than traditional phone service.
VoIP technology service providers are equipped to correct many of these problems. However, in order to do so, the service provider must be aware of the problems and be able to track the source of the problems. This makes it desirable to have a method to test the voice quality of the system so problems can be corrected quickly and effectively.
Furthermore, it is desirable in the industry to quantitatively measure the quality of VoIP service in order to prioritize problems and intercept major problem areas quickly. It is also desirable to measure the quality of the VoIP service through an automated process. In this manner, testing can be done more frequently and without the intervention of a technician. It is also desirable to conduct frequent testing that will not adversely impact the average end user.
The present invention contemplates a new and improved testing method and system that resolves the above-referenced difficulties and others.
A method and system for measurement of voice quality using coded signals is provided.
In one aspect of the presently described embodiments, a method for end-to-end network testing in a voice over internet protocol network comprises generating a signature signal at a first compatible device, transmitting said signature signal to a second compatible device, receiving said signature signal at said second compatible device and comparing said received signature signal to a recognized signal at said second compatible device.
In another aspect of the presently described embodiments, the signature signal as an inaudible tone.
In another aspect of the presently described embodiments, the method is implemented in predetermined intervals.
In another aspect of the presently described embodiments, the method further comprises deriving a quantitative value based upon said comparison.
In another aspect of the presently described embodiments, the method further comprises deriving an estimated mean opinion score.
In another aspect of the presently described embodiments, the method further comprises storing said received signature signal enabling a prior path trace record to be used to debug errors.
In another aspect of the presently described embodiments, the method further comprises employing a switch as said first or second compatible device.
In another aspect of the presently described embodiments, the method further comprises implementing switch to switch communication.
In another aspect of the presently described embodiments, the method further comprises employing a gateway as said first or second compatible device.
In another aspect of the presently described embodiments, the method further comprises employing an end device as said first or second compatible device.
In another aspect of the presently described embodiments, the testing is conducted over a communication path that is between said compatible devices.
In another aspect of the presently described embodiments, a VoIP test enabling system comprises a transmission module operative to generate a signature signal and send said signature signal through a voice over internet protocol network, a testing module operative to receive said transmitted signature signal and compare said signature signal with a stored recognized signal and a plurality of compatible devices, wherein at least one compatible device comprises said transmission module and at least another compatible device comprises said testing module.
In another aspect of the presently described embodiments, the testing module comprises testing logic capable of detecting problems in the network.
In another aspect of the presently described embodiments, the testing module comprises memory.
In another aspect of the presently described embodiments, the transmission module comprises generator logic.
In another aspect of the presently described embodiments, an end-to-end network testing method in a voice over internet protocol network comprises generating a signature signal at a switch, transmitting said signature signal to a compatible device, wherein said compatible device is adapted to capture said signature signal and comparing said signature signal to a recognized signal at said compatible device.
In another aspect of the presently described embodiments, the method further comprises storing said received signature signal enabling a prior path trace record to be used to debug errors.
In another aspect of the presently described embodiments, the method further comprises employing a gateway as said compatible device.
In another aspect of the presently described embodiments, the method further comprises employing a second switch as said compatible device.
In another aspect of the presently described embodiments, the method further comprises employing an end device as said compatible device.
Further scope of the applicability of the present invention will become apparent from the detailed description provided below. It should be understood, however, that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.
The present invention exists in the construction, arrangement, and combination of the various parts of the device, and steps of the method, whereby the objects contemplated are attained as hereinafter more fully set forth, specifically pointed out in the claims, and illustrated in the accompanying drawings in which:
Referring now to the drawings wherein the showings are for purposes of illustrating the preferred embodiments of the invention only and not for purposes of limiting same,
The communications network infrastructure 1 includes two compatible devices 3, 5 and a network 7. The two compatible devices 3, 5 are connected through the network 7 (e.g., the Internet). It should be understood that the compatible devices could also be connected to a plurality of different devices throughout the network. It should also be understood that the compatible device can be a variety of communication devices or network elements including gateways, switches, telephones, laptops, etc.
As described in detail below, the invention includes a method for end-to-end testing in a VoIP network. It comprises generating a signature signal at a first compatible device 3 and transmitting that signal from the first compatible device 3 to the second compatible device 5. The signal is received at the second compatible device 5 and compared to a recognized signal at the second compatible device 5. The results of this comparison are then used by the system to determine if there is a voice quality issue to address.
Referring now to
In this example system of
In operation, the network 10 provides voice and path quality testing. In one form, a signature signal is generated at the first switch 17. The signature signal is transmitted from the first switch 17 to the second end device 15. The signal is received at the second end device 15 and compared to a recognized signal at the second end device 15. As will be detailed below, in one form, the recognized signal is stored in a suitable location at the second end device 15. The results of this comparison are then used by the system to determine if there is a voice quality issue to address. Of course, the recognized signal could be stored at a variety of other locations, including databases that can be accessed by the second end device 15. As described, this technique requires no dedicated test equipment and should provide an advantage to the user and manufacturers of VoIP equipment.
Referring to
This testing method 100 can be accomplished at various times. For example, in one embodiment, this testing method is performed continuously. In another embodiment, it is performed only after disconnects. In another embodiment, the method is performed at every tenth call. In another embodiment, the method is performed every other day or at some other specific predetermined interval. In yet another embodiment, this testing method is performed every time the user calls the voice mail system. In yet another embodiment, the method is performed as soon as a call begins. In yet another embodiment, the method is performed while the phone ringing. In yet another embodiment, this testing method is performed only on demand. The system is flexible enough to allow for the method to be performed at any time. But regardless of when it is performed, if it is conducted over time, it can provide a more accurate depiction of the Quality of Service (QoS).
The method 100 includes generating a signature signal at a first compatible device (at 110). When generating a signature signal, the signature signal can take the form of any measurable noise. In one embodiment, the signature signal is inaudible to the human ear. In another embodiment, the signature signal is 3 to 4 seconds long. The longer the signal and more varied in frequency (e.g. tone, pitch), the more accurate the test, however, the signature signal is not required to be any particular length or frequency.
The signature signal is then transmitted to a second compatible device (at 120). Of course, the QoS is evaluated between the compatible device that sends the signature signal and the compatible device that receives the signature signal. In this regard, the signature signal is then transmitted from the switch 17 to the second compatible device, e.g. the end device 15, as shown in
The signature signal is received at said second compatible device (at 130) and compared to a recognized signal at second compatible device (at 140). In this regard, the signature signal is received by the end device 15. The end device 15 can then compare the received signature signal with a recognized signal. In at least one form, the recognized signal is a signal stored in the end device 15 that is equivalent to the signature signal. Therefore, if the signature signal is sent without incident, e.g. no packets were lost in the transmission, the received signal and the recognized signal would be identical.
After the end device makes a comparison (at 140), the end device 15 can derive a quantitative value (at 150) based upon the comparison. This comparison is discussed in further detail below.
The method further includes storing the received signal for debugging purposes (at 160). Along these lines, the end device 15 can store the received signal in its memory 440 (
As noted, the compatible devices described herein may take a variety of forms and may perform functions other than end-to-end testing. Indeed, an advantage of the system according to the presently described embodiments is that dedicated test equipment is not required. The compatible device may be a variety of devices including but not limited to gateways, switches and end devices.
Referring now to
In this embodiment, the compatible device 530 contains a testing module 500 and a transmission module 520 which will enable the device 530 to be either the first or second compatible device 3, 5.
The transmission module 520 contains generator logic 460 and transport logic 480. The generator logic 460 is capable of generating the signature signal 110. As noted above, the signature signal can be one of a variety of different sounds. The transport logic 480 is capable of sending the generated signature signal across the network 12 to a second compatible device 530.
The testing module 500 contains capture logic 400, testing logic 420 and memory 440. The capture logic 400 is operative to receive the generated signal and capture it. Once the sent signal is captured, it can be tested and stored in memory for later use. The capture logic 400, used in conjunction with the memory, can allow for a technician to hear the received signal as some later date. The memory 440 is operative to store the received signal for debugging purposes and it can further be used to store the recognized signal.
The testing module 500 further comprises testing logic 420, that may take a variety of forms. Referring to
When debugging the system, a map can be developed to chart each variable to the source of the problem, greatly assisting a technician in debugging the system's errors. For example, using a map, one skilled in the art will be able to conclude that when a signature signal is 2 milliseconds too short, packets are being dropped or they are out of order. The map could also tell a technician that when the signature signal is shifted higher or lower in frequency there are problems with the level of bandwidth usage.
The above description merely provides a disclosure of particular embodiments of the invention and is not intended for the purposes of limiting the same thereto. As such, the invention is not limited to only the above-described embodiments. Rather, it is recognized that one skilled in the art could conceive alternative embodiments that fall within the scope of the invention.