The present disclosure relates to the field of data communication and, more particularly, to an unmanned aerial vehicle system and a corresponding communication method.
Currently, unmanned aerial vehicles (UAVs) with cameras are widely used. For example, a UAV with one or more cameras may track and capture a desired object and transmit the captured images and/or videos to a user in real-time through wireless communication.
In addition, with the popularity and development of the Internet self-media and the like, after using UAVs for aerial photography, people often want to download media data to their mobile phones right away and upload them to the Internet through editing.
With the improvement of the image quality of the cameras carried by the UAVs, the size of the videos and images taken by the cameras becomes larger and larger. This puts high demands on the instant transmission of image data and video data of the UAVs.
In accordance with the present disclosure, there is provided an unmanned aerial vehicle. The unmanned aerial vehicle includes a camera, a first communication system, a second communication system, and a controller. The camera is configured to capture an image or video. The first communication system is configured to communicate according to a proprietary protocol, and the second communication system is configured to communicate according to a standard communication protocol. The controller is configured to control operations of the first communication system and the second communication system, to allow the first communication system and the second communication system to simultaneously transmit the image or video captured by the camera.
Also in accordance with the disclosure, an unmanned aerial vehicle system is provided. The unmanned vehicle system includes an unmanned aerial vehicle and a remote control. The unmanned aerial vehicle includes a camera, a first communication system, a second communication system, and a controller. The camera is configured to capture an image or video. The first communication system is configured to communicate according to a proprietary protocol, and the second communication system is configured to communicate according to a standard communication protocol. The controller is configured to control operations of the first communication system and the second communication system, to allow the first communication system and the second communication system to simultaneously transmit the image or video captured by the camera. The remote control is configured to receive the image or video, captured by the camera, from the unmanned aerial vehicle by communicating with the first communication system and/or the second communication system of the unmanned aerial vehicle.
Also in accordance with the disclosure, a method implemented by an unmanned aerial vehicle is provided. The unmanned aerial vehicle includes a camera, a first communication system, a second communication system, and a controller. The method includes that: the camera captures an image or video; the first communication system communicates according to a proprietary protocol; the second communication system communicates according to a standard communication protocol; and the controller controls operations of the first communication system and the second communication system, to allow the first communication system and the second communication system to simultaneously transmit the image or video captured by the camera.
The disclosure is described in detail hereinafter with reference to the drawings and specific embodiments. It should be noted that the present disclosure should not be limited to the specific embodiments described therein. In addition, for the sake of simplicity, detailed descriptions of well-known technologies not directly related to the present disclosure are omitted to prevent confusion in the understanding of the present disclosure.
The principles of the present disclosure may be applied to UAVs having two or more communication systems, wherein at least one communication system may communicate according to a proprietary protocol and at least another communication system may communicate according to a standard communication protocol. In the following embodiments, the principles of the present disclosure will be described in detail with a UAV having two communication systems: one is a communication system that communicates according to a proprietary image transmission protocol, and the other is a communication system that communicates according to a WiFi communication protocol. However, those skilled in the art may understand that the principles of the present disclosure may also be applied to UAVs/UAV systems having two or more communication systems adopting other types of proprietary protocols and standard communication protocols.
The first communication system 110 is configured to communicate according to a proprietary protocol. For example, the first communication system 110 may communicate with a remote control or user device according to a proprietary image transmission protocol to transmit information such as image/video data and/or signaling. In the disclosed embodiments, the proprietary image transmission protocol may be an Ocusync communication protocol.
The second communication system 120 is configured to communicate according to a standard communication protocol. For example, the second communication system 120 may communicate with a remote control or user device according to a WiFi communication protocol to transmit information such as image/video data and/or signaling.
The camera 140 is configured to capture an image or a video. For example, the camera 140 may include one or more cameras, which may be visible light cameras and/or infrared cameras, and so on.
The controller 130 is configured to control operations of the first communication system 110 and the second communication system 120, to allow the first communication system 110 and the second communication system 120 to simultaneously transmit images or videos captured by the camera 140.
For example, the controller 130 may be configured to control the operations of the first communication system 110 and the second communication system 120, to allow one of the first communication system 110 and the second communication system 120 to transmit an image or video captured by the camera 140 to a first device, and allow the other of the first communication system 110 and the second communication system 120 to transmit an image or video captured by the camera 140 to a second device.
Here, the first device may include, for example, a remote control for controlling the UAV 10. The second device may include, for example, a user device having an application capable of communicating with the first communication system 110 or the second communication system 120. For example, the user device may be a mobile phone.
The controller 130 may use various methods to control the first communication system 110 and the second communication system 120 to operate in a full-duplex manner. An example of such a control method is the use of multipath transmission control protocol (MPTCP). Specifically, according to the MPTCP, the controller 130 may perform operations such as connection initialization, data mapping, data transmission and retransmission, congestion control, and link management for a proprietary communication link provided by the first communication system 110 and a standard communication link provided by the second communication system 120. This allows the first communication system 110 and the second communication system 120 to operate simultaneously in a full-duplex manner without affecting each other. In this way, because the bandwidths provided by the two communication systems may be utilized at the same time, the speed of data transmission is greatly improved, and the accuracy of data transmission is also ensured.
Optionally, the first communication system 110 and the second communication system 120 may work in different frequency bands so as not to interfere with each other in a full-duplex communication process. For example, if the first communication system 110 communicates according to the OcuSync proprietary image transmission protocol and the second communication system 120 communicates according to the WiFi communication protocol, then the communication implemented according to the OcuSync proprietary image transmission protocol may use a 5.8 GHz frequency band, while the communication implemented according to the WiFi communication protocol may use a 2.4 GHz frequency band. Alternatively, the communication implemented according to the OcuSync proprietary image transmission protocol may use a 2.4 GHz frequency band, while the communication implemented according to the WiFi communication protocol may use a 5.8 GHz frequency band, and so on.
By adoption of the technical solutions of the disclosed embodiments, the communication bandwidth of the UAVs may be increased, and the transmission speed of the image/video data may be improved.
Each part of the method in
At block S200, the camera of the UAV captures an image or video. For example, the camera may include one or more cameras, which may be visible light cameras and/or infrared cameras, and so on. Accordingly, the captured images or videos may be visual and/or infrared images and/or videos.
At block S210, the first communication system of the UAV communicates according to a proprietary protocol. For example, the first communication system may communicate with a remote control or user device according to the Ocusync proprietary image transmission protocol.
At block S220, the second communication system of the UAV communicates according to a standard communication protocol. As described above, the second communication system may communicate with a remote control or user device according to the WiFi communication protocol.
At block S230, the controller of the UAV controls the operations of the first communication system and the second communication system, so that the first communication system and the second communication system simultaneously transmit images or videos captured by the camera of the UAV.
For example, the controller may control the operations of the first communication system and the second communication system such that one of the first communication system and the second communication system transmits an image or video captured by the camera to a first device, and the other of the first communication system and the second communication system transmits an image or video captured by the camera to a second device.
Here, the first device may include, for example, a remote control for controlling the UAV. The second device may include, for example, a user device having an application capable of communicating with the first communication system or the second communication system. For example, the user device may be a mobile phone.
The controller may use a variety of methods to control the first communication system and the second communication system to operate in a full-duplex manner. As described above, according to the MPTCP, the controller may perform operations such as connection initialization, data mapping, data transmission and retransmission, congestion control, and link management for a proprietary communication link provided by the first communication system and a standard communication link provided by the second communication system, to allow the first communication system and the second communication system to operate simultaneously in a full-duplex manner without affecting each other.
In some embodiments, the first communication system and the second communication system operate on different frequency bands. For example, the first communication system may communicate using a frequency band of 5.8 GHz, and the second communication system may communicate using a frequency band of 2.4 GHz, and vice versa.
In the above, a UAV and a method performed by the UAV according to an embodiment of the present disclosure have been described. In the following, a UAV system including a UAV and a corresponding remote control and a method performed by the UAV system are described in detail.
The UAV 10 may include the first communication system 110, the second communication system 120, the controller 130, and the camera 140, as shown in
The controller 130 in the UAV 10 may be configured to control operations of the first communication system 110 and the second communication system 120 such that the first communication system 110 and the second communication system 120 simultaneously transmit images or videos captured by the camera 140.
For example, the controller 130 may be configured to control the operations of the first communication system 110 and the second communication system 120 such that one of the first communication system 110 and the second communication system 120 transmits an image or video captured by the camera 140 to the remote control 310, and the other of the first communication system 110 and the second communication system 120 transmits an image or video captured by the camera 140 to a second device.
The remote control 310 may be configured to receive, from the UAV 10, an image or video captured by the camera 140 by communicating with the first communication system 110 and/or the second communication system 120 of the UAV 10. Further, the remote control 310 may send an image or video, received from the UAV, to the second device; or receive, from the second device, an image or video received by the second device from the UAV.
Here, the second device may include, for example, a user device having an application capable of communicating with the first communication system 110 or the second communication system 120. For example, the user device may be a mobile phone.
The controller 130 may use various methods to control the first communication system 110 and the second communication system 120 to operate in a full-duplex manner, such as using the MPTCP as described above.
In some embodiments, the first communication system 110 and the second communication system 120 of the UAV 10 may work in different frequency bands so as not to interfere with each other in a duplex communication process. For example, the first communication system 110 may use a frequency band of 5.8 GHz for communication, while the second communication system 120 may use a frequency band of 2.4 GHz for communication, and vice versa.
Each part of the method in
At block S400, the camera of the UAV captures an image or video. As mentioned above, the camera may include one or more cameras, which may be visible light cameras and/or infrared cameras, and so on.
At block S410, the first communication system of the UAV communicates according to a proprietary protocol. For example, the first communication system may communicate with the remote control or user device according to the Ocusync proprietary image transmission protocol.
At block S420, the second communication system of the UAV communicates according to a standard communication protocol. As described above, the second communication system may communicate with the remote control or user device according to a WiFi communication protocol.
At block S430, the controller of the UAV controls the operations of the first communication system and the second communication system, so that the first communication system and the second communication system simultaneously transmit the images or videos captured by the camera.
For example, the controller may control the operations of the first communication system and the second communication system such that one of the first communication system and the second communication system transmits an image or video captured by the camera to the remote control, and the other of the first communication system and the second communication system transmits an image or video captured by the camera to the second device.
At block S440, the remote control receives an image or video captured by the camera from the UAV by communicating with the first communication system and/or the second communication system of the UAV. Further, the remote control may also send an image or video received from the UAV to the second device, or receive from the second device an image or video received by the second device from the UAV.
Here, the second device may be a user device having an application capable of communicating with the first communication system or the second communication system.
In some embodiments, the first communication system and the second communication system may work on different frequency bands. For example, the first communication system may communicate using a frequency band of 5.8 GHz, while the second communication system may communicate using a frequency band of 2.4 GHz, and vice versa.
Furthermore, the embodiments of the present disclosure may be implemented by means of a computer program product. For example, the computer program product may be a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed on a computing device, related operations may be performed to implement the above described technical solutions of the present disclosure.
For example,
An example application scenario of the technical solutions of the present disclosure is described hereinafter with reference to
In
As can be seen from
Meanwhile, the remote control may send image and/or video data received from the UAV to the user device via a USB connection. In this way, the user device may combine the image and/or video data it receives from the UAV with the image and/or video data it receives from the remote control to generate the final image(s) and/or video(s) for a display to a user.
It should be noted that although it is shown in
In summary, in the UAV system presented in the present disclosure, the at least two communication systems of the UAV may simultaneously transmit image/video data captured by the UAV. This effectively increases the communication bandwidth, makes the transmission of image/video data faster, and thus greatly improves the user experience.
The methods and related devices of the present disclosure have been described above in conjunction with the specific embodiments. Those skilled in the art may understand that the methods shown above are merely for exemplary purposes. The methods of the present disclosure are not limited to the blocks and orders shown above.
It should be noted that the aforementioned embodiments of the present disclosure may be implemented by software, hardware, or a combination of both software and hardware. Such configuration of the present disclosure is typically provided as software, code, and/or other data structures configured or coded on a computer-readable storage medium such as an optical medium (e.g., CD-ROM), a floppy disk, or a hard drive, or as firmware or microcode on one or more ROM (read-only memory), RAM (random-access memory), PROM (programmable read-only memory) chips, or other storage media, or as downloadable software images and shared databases in one or more modules, etc. Such software, firmware, or configuration may be installed on a computing device, so that one or more processors in the computing device execute the technical solutions described in the embodiments of the present disclosure.
In addition, various functional modules or individual features of the devices used in each of the above embodiments may be implemented or performed by a circuit, which is typically one or more integrated circuits. Circuits designed to implement each function described in this specification may include general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs) or general-purpose integrated circuits, field programmable gate arrays (FPGAs) or other programming logic devices, discrete gate or transistor logic, or discrete hardware components, or any combination thereof. A general-purpose processor may be a microprocessor, or the processor may be an existing processor, controller, microcontroller, or state machine, etc. The general-purpose processor or each circuit may be configured by a digital circuit, or may be configured by a logic circuit. In addition, when an advanced technology capable of replacing a current integrated circuit appears due to advances in the semiconductor technology, the present disclosure may also use such integrated circuits obtained using the advanced technology.
The program running on the devices according to the present disclosure may be a program that causes a computer to implement the functions of the embodiments of the present disclosure by controlling a central processing unit (CPU). The program or the information processed by the program may be temporarily stored in a volatile memory (such as RAM), hard disk drive (HDD), non-volatile memory (such as flash memory), or other storage systems. A program for implementing the functions of the embodiments of the present disclosure may be recorded on a computer-readable recording medium. Corresponding functions may be implemented by causing a computer system to read the program recorded on the recording medium and execute the program. The so-called “computer system” herein may be a computer system embedded in the devices, and may include an operating system or hardware (such as a peripheral device).
As can be seen above, the embodiments of the present disclosure have been described in detail with reference to the drawings. However, the specific structure of the present disclosure is not limited to the foregoing embodiments. The present disclosure also includes any design modifications that do not deviate from the spirits and principles of the present disclosure. In addition, the present disclosure may be modified with different variations within the scope of the appended claims. Embodiments obtained by appropriately combining the technical solutions disclosed in the different embodiments are also included in the technical scope of the present disclosure. In addition, components having the same effects described in the above embodiments may be replaced with each other.
This application is a continuation application of International Application No. PCT/CN2017/113923, filed on Nov. 30, 2017, the entire content of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2017/113923 | Nov 2017 | US |
Child | 16865815 | US |