This disclosure relates in general to wireless communication systems and methods, and more specifically to a new and useful system and method for displaying a digital signal.
Operators of communication devices can be distracted from their communications if they are constantly monitoring for signal strength. As an example, when an operator controls a robot with a remote controller, the operator may need to monitor signal strength, but this can divert the operator's attention and affect the operator's focus on the precise operation and control of the robot.
Embodiments disclosed herein adjust the data rate or the quality of data being sent over a wireless channel in response to a detection of reduced signal strength over the channel, and can also improve latency. A system according to one embodiment includes a first communication device and a second communication device configured to communicate with one another over a wireless channel, and a signal strength detection module configured to detect a signal strength of a signal transmitted over the wireless channel, wherein the second communication device is configured to send digital data of a first quality to the first communication device if the signal strength is above a threshold and to send digital data of a second quality to the first communication device if the signal strength is below the threshold, the second quality being lower than the first quality. A system according to another embodiment includes a first communication device and a second communication device configured to communicate with one another over a wireless channel, and a signal strength detection module configured to detect a signal strength of a signal transmitted over the wireless channel, wherein the second communication device is configured to insert noise into digital data to be transmitted to the first communication device, and the amount of noise inserted into the digital data is based in part on the signal strength.
A system according to another embodiment includes a first communication device and a second communication device configured to communicate with one another over a wireless channel, wherein at least one of the communication devices is configured to detect a latency of a signal transmitted over the wireless channel, and the second communication device is configured to send digital data of a first quality to the first communication device if the latency is above a threshold and to send digital data of a second quality to the first communication device if the latency is below the threshold, the first quality being lower than the second quality.
A method of adjusting a quality of digital data transmitted over a wireless channel according to a signal strength of a signal transmitted over the wireless channel includes the steps of capturing digital data with a recording device and transmitting digital data representative of the captured digital data over a wireless channel for reproduction by an output device, the transmitted digital data being of a first quality if the signal strength is above a threshold and of a second quality if the signal strength is below the threshold.
A method of altering digital video data captured at a source and transmitting the altered digital video data to a destination over a wireless channel according to a signal strength of a signal transmitted over the wireless channel includes the steps of inserting noise into the digital video data captured at the source according to the signal strength, wherein an increased amount of noise is inserted if the signal strength decreases and a decreased amount of noise is inserted if the signal strength increases, and transmitting the digital video data having the noise inserted therein to the destination.
Numerous technical advantages are provided according to various embodiments of the present disclosure. Particular embodiments of the disclosure may exhibit none, some, or all of the advantages depending on the implementation.
Other technical advantages of the present disclosure will be readily apparent to one skilled in the art from the following figures, descriptions, and claims. Moreover, while specific advantages are enumerated, various embodiments may include all, some, or none of the enumerated advantages.
So that the manner in which the above recited features of the present disclosure can be understood in detail, a more particular description of the present disclosure, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of the present disclosure and are therefore not to be considered limiting of its scope, for the present disclosure may admit to other equally effective embodiments.
In the following description, numerous specific details are set forth to provide a more thorough understanding of embodiments of the disclosure. However, it will be apparent to one of skill in the art that embodiments may be practiced without one or more of these specific details. In other instances, well-known features have not been described in order to avoid obscuring embodiments of the present disclosure.
A receiver that receives an analog signal will notice an increase in noise as signal strength decreases. A decrease in signal strength could be caused by an increase in the distance between a transmitter and the receiver or by interference on a communication channel established between the transmitter and the receiver. The analog signal will degrade as the noise slowly overcomes the signal. A user monitoring the signal (e.g., watching video transmitted wirelessly) will be able to do so until it becomes so faint that it is completely washed out by the noise. For digital signals, digital signal processing (DSP) technology may apply filters, transforms, error correction, compression, and other techniques to improve signal-to-noise ratio and maintain a steady data rate as the noise level changes. However, this can cause a sudden drop-off (or cut-off) of the data rate to zero when the digital signal is overcome by noise. A user monitoring a digital video transmission will see a high quality image, and then when the signal is overcome with noise, the image will disappear completely and suddenly. To overcome this, certain embodiments disclosed herein intentionally reduce the data rate of the digital transmission as noise increases or signal strength decreases so that the received signal appears to slowly degrade, much like an analog signal, which also can preserve latency of the signal. For applications requiring low latency, the data rate can be reduced in order to preserve a certain latency, such that a signal is transmitted at a lower quality but with less latency, or as little latency as possible. This reduced data rate can also allow for bandwidth to be preserved for transmitting other information. In some embodiments, other characteristics of the transmission may be adjusted to further signal the user, such as color resolution. In other embodiments, noise artifacts can be introduced in inverse proportion to the signal strength to provide the user an indication of signal strength. In other embodiments, noise artifacts can be introduced in proportion to latency to provide the user an indication of latency.
In certain applications, the “digital drop-off” can lead to unfortunate results. As one example, a law enforcement officer outside a building may be using a robot containing a video camera and a robot controller to inspect the interior of the building. As the robot navigates various hallways and rooms in the building, the number of walls and other obstructions between the controller and the robot might increase, which in turn can increase the noise in the video signal. With an analog video signal, the officer can see the video quality gradually decreasing as noise increases. The officer may want to take appropriate actions to prevent the loss of the signal entirely; e.g., by reversing the path of the robot and returning it closer to the officer. With a digital video signal, the officer may not notice any degradation in video signal quality until the digital drop-off occurs. When this occurs, the lack of a video signal from the robot can make it difficult or impossible for the officer to direct the robot to a location where communication can be re-established. A lower latency signal would also enable officers to, react or respond better or faster to situations they may encounter. Other applications requiring low latency can be any application where remote operation requires human control, such as robots in space, surgical robots, remote controlled robots like the RoboteX avatar system, or any other suitable application. Embodiments of the present disclosure intentionally decrease the data rate and thus the potential reproduction quality of the video signal as noise increases so that the user of the system, through the degradation of the video quality, is warned of the potential drop-off of the signal. Adjusting the data rate can also reserve bandwidth for other wireless communications besides the video signal, such as control signals. Certain embodiments may decrease the data rate or other determinants of quality to lower the latency of a signal. As latency improves, the data rate of the signal may be increased so that a higher quality signal is transmitted.
In
In some embodiments, a lower bit rate may show up as pixelation in a digital video frame. The viewer can use the level of pixelation to approximate signal strength and make appropriate decisions. In other embodiments, color depth and/or color palette (referred to herein as “color resolution”) can be adjusted to communicate to the viewer that the signal strength is decreasing. The viewer of the video signal will notice the color adjustments and that will serve as a warning that the signal strength is decreasing, and that the signal may be in danger of being lost completely.
Controller 20 also includes a number of internal components (not shown) for providing functionality in system 10, such as one or more computer processing chips configured to perform functions associated with system 10, one or more memory modules for storing data, a GPS or other location detecting module, and hardware for accessing cellular networks for sending and/or receiving voice or data. Controller 20 further includes any number of audio or video components for sending, receiving, displaying, outputting, or processing audio or video data, and hardware and/or software operable to communicate over a wireless channel. Controller 20 may also include hardware, software, or a combination of hardware and software to measure the latency of a signal sent over the wireless channel. In one embodiment, signal strength is measured (using any known hardware or techniques) and used to derive a latency measurement. In another embodiment, robotic system 30 sends beacon messages to controller 20, which controller 20 bounces back. The time between the transmission and receipt of these messages can be used to calculate latency.
In one example, the robot persistently sends beacon messages to the controller. The controller bounces the messages back, and the time between these events (T) is measured. This value is then used to calculate an average latency (L) as follows:
L′=(w*T)+((1−w)*L).
In the formula, L′ is the updated latency and L is the previous latency. The initial value of L for the first iteration is 0. Also, w represents a weighting factor. In one implementation, the value of w that is used is different depending on whether T is greater than L or not. When T>L, weighting factor w1 is used. When T<=L, weighting factor w2 is used. In this embodiment, w1>w2. The weighting factor is used so that the average latency is pulled up quicker than it is pulled down. The purpose of this is to dampen oscillations that can occur with the dynamic quality adjustment (since adjusting the quality of the video can affect the latency measurement).
In this example embodiment, robotic device 30 collects video via camera 32 or camera 38 and transmits it wirelessly to controller 20, where a user can view the video on display 24. Audio and other data can also be collected and transmitted wirelessly. Controller 20 monitors the strength of the signal received from robotic system 30 using the signal strength detector. In some embodiments, controller 20 may monitor the latency of the signal instead of, or in addition to, monitoring signal strength. Upon receipt of the signal and determining its signal strength (and/or measuring the latency of the signal), controller 20 communicates the signal strength to robotic device 30, and robotic device 30 in response thereto adjusts the data rate of the video signal being transmitted wirelessly to controller 20 as described above in conjunction with
It should be recognized that a reduced resolution image can provide other advantages for a user of the system. A reduced resolution image can be used by an operator of a robot to navigate around obstacles or make decisions in a stressful or dangerous situation, where a low resolution image is better than no image at all. The reduced resolution image can also preserve bandwidth to be allocated for other communications, such as navigation instructions from the controller to the robot. The reduced resolution image can be accompanied by a lower latency to allow for greater functionality of the system.
As seen in
In another example embodiment, a portion of the data can be transmitted at a high quality and a portion can be transmitted at a lower quality. This embodiment could be useful in a variety of situations. For example, the transmission range for video data may have increased and that would necessitate a lower data rate for the video being transmitted. However, one portion of the video image being transmitted may be more important than the rest of the image. The more important portions can be transmitted with a higher data rate or data quality, and the other portions could be transmitted with a lower data rate or data quality. As one example, a police officer may be using a remote video system for surveillance inside a building. The officer may be viewing a criminal suspect and would like to receive a higher quality transmission of the suspect's face, and be willing to accept a lower quality transmission of the other parts of the image, such as the background of the image. This system could initiate appropriate video capture and processing to transmit a portion of the video showing the suspect's face at a high resolution and the rest of the video at a lower resolution.
Method 100 begins with Step 110. In Step 110, signal strength is measured or monitored at a display device using any appropriate signal strength detector. In the embodiment illustrated herein, the display device is part of a wireless controller configured to control a mobile device that captures video and transmits the captured video back to the wireless controller for display using the display device. In other embodiments, the display device may be a part of a mobile or desktop computing device configured to control the mobile device. The signal strength that is measured may include transmission power or bandwidth latency.
In Step 120, the measured signal strength is communicated to a recording device, which may include a video camera. One example is the RoboteX Avatar® II robot, which is able to capture video with a front-mounted drive camera or a 360-degree camera. In Step 130, video data is captured with the recording device at the native resolution of the recording device. The captured video data is stored in any appropriate location, e.g., locally in a storage unit of the recording device.
In Step 140, a transmission quality of video data at the recording device is adjusted based on the signal strength communicated by the wireless controller. If the signal strength is below a threshold, the captured video data is transformed into a lower quality video. For example, the frame rate or resolution of the video data can be reduced. If the signal strength is above the threshold, the captured video data is not transformed. If the signal strength is measured relative to latency (for example, if the latency is increasing as a transmitter moves further from the receiver), the transmitter can lower the data rate (i.e., lower frames and/or resolution of a video signal) to attempt to reduce the frequency of dropped packets and therefore reduce the perceived latency.
In Step 150, the captured video data is transmitted to the wireless controller for display by the display device. In Step 160, the wireless controller receives the transmitted video data and displays it using the display device. The display device can process the video data in any manner before displaying the video.
Method 200 begins with Step 210. In Step 210, signal strength is measured or monitored at a display device using any appropriate signal strength detector. In the embodiment illustrated herein, the display device is part of a wireless controller configured to control a mobile device that captures video and transmits the captured video back to the wireless controller for display using the display device. In other embodiments, the. display device may be a part of a mobile or desktop computing device configured to control the mobile device. The signal strength that is measured may include transmission power, bandwidth, or latency. The RoboteX Avatar® II robot can measure the latency between the robot and the controller.
In Step 220, the measured signal strength is communicated to a recording device, which may include a video camera. One example is the RoboteX Avatar® II robot, which is able to capture video with a front-mounted drive camera or a 360-degree camera. In Step 230, video data is captured with the recording device at the native resolution of the recording device. The captured video data is stored in any appropriate location, e.g., locally in a storage unit of the recording device.
In Step 240, noise is inserted into the video data by the recording device based on the signal strength received from the display device. For example, white snow noise artifacts can be inserted into the image as the signal strength weakens. This would alert the viewer, user, or operator that the strength of the signal containing the video is weakening. An increased amount of noise can be inserted as the signal strength further decreases. Conversely, noise artifacts can be removed as the signal strength increases. Latency (as possibly measured in Step 210) could be minimized, but as a RoboteX Avatar® II robot operates progressively further from the RoboteX Avatar® II controller, the latency will increase. To effectively minimize the effects of an increased latency with a weaker signal strength (another possible side effect of the robot operating further from the controller), the transmitter can lower the frame rate, data rate, number of colors, or use another chosen technique for lowering a signal data rate to allow for smaller packets to be transmitted at a higher rate, reducing the likelihood of lost packets and/or an increase in latency.
In Step 250, the video data having inserted noise is transmitted to the display device. In Step 260, the wireless controller receives the transmitted video data and displays it using the display device. The display device can process the video data in any manner before displaying the video.
Alternatively, noise artifacts can be inserted at the side of the display device. In such an embodiment, the recording device sends the captured video data to the display device, and appropriate hardware and/or software at the side of the display device can insert the noise artifacts prior to displaying the video on the display device.
In certain other embodiments, signal strength or latency can be detected at the recording device and video quality can be adjusted or noise artifacts inserted, as described above, based on this signal strength or latency.
Although the present disclosure has been described with several embodiments, a myriad of changes, variations, alterations, transformations, and modifications may be suggested to one skilled in the art, and it is intended that the present disclosure encompass such changes, variations, alterations, transformations, and modifications as fall within the scope of the appended claims.
This application claims the benefit of U.S. provisional patent application entitled “Method of Displaying a Digital Signal,” filed on Oct. 24, 2011, having application Ser. No. 61/550,745, which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61550745 | Oct 2011 | US |