The present disclosure relates to the technical field of control technology and, more particularly, to a rotary photographing method, a mobile platform, and a machine readable storage medium.
Currently, in an existing unmanned aerial vehicle aerial photography system, a photographing device can be arranged at a gimbal and rotate with the gimbal to complete photographing of a photo or a video. However, the existing unmanned aerial vehicle aerial photography system lacks a rotary photographing scheme, i.e., a scheme in which the photographing device can perform an exposure when the gimbal rotates, so that photographing experience is reduced.
In accordance with the disclosure, there is provided a rotary photographing method including obtaining brightness information in a scene where a photographing target is located and a rotation mode of a gimbal that connects a photographing device to a mobile platform, and generating control information according to the brightness information and the rotation mode. The control information including rotation control information and exposure control information. The method further includes sending the rotation control information to the gimbal to control the gimbal to rotate according to the rotation control information to drive the photographing device to rotate, and sending the exposure control information to the photographing device to control the photographing device to perform exposure according to the exposure control information.
Also in accordance with the disclosure, there is provided a control device of a mobile platform including a processor and a memory storing computer instructions that, when executed by the processor, cause the processor to obtain brightness information in a scene where a photographing target is located and a rotation mode of a gimbal that connects a photographing device to a mobile platform, and generate control information according to the brightness information and the rotation mode. The rotation control information and exposure control information. The computer instructions further cause the processor to send the rotation control information to the gimbal to control the gimbal to rotate according to the rotation control information to drive the photographing device to rotate, and send the exposure control information to the photographing device to control the photographing device to perform exposure according to the exposure control information.
Also in accordance with the disclosure, there is provided a mobile platform including a gimbal mounted with a photographing device and a control device including a processor and a memory. The memory stores computer instructions that, when executed by the processor, cause the processor to obtain brightness information in a scene where a photographing target is located and a rotation mode of a gimbal that connects a photographing device to a mobile platform, and generate control information according to the brightness information and the rotation mode. The rotation control information and exposure control information. The computer instructions further cause the processor to send the rotation control information to the gimbal to control the gimbal to rotate according to the rotation control information to drive the photographing device to rotate, and send the exposure control information to the photographing device to control the photographing device to perform exposure according to the exposure control information.
In order to explain the technical solutions in the embodiments of the present disclosure more clearly, reference is made to the accompanying drawings, which are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained from these drawings without any inventive effort for those of ordinary skill in the art.
The technical solutions in the embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only some of rather than all the embodiments of the present disclosure. Based on the described embodiments, all other embodiments obtained by those of ordinary skill in the art without inventive effort shall fall within the scope of the present disclosure.
The present disclosure provides a rotary photographing method. Consistent with the present disclosure, rotation control information and exposure control information can be generated according to brightness information in a scene where a photographing target is located and a rotation mode of the gimbal; and then the rotation control information is sent to the gimbal and the exposure control information is sent to the photographing device. In this way, the gimbal can drive the photographing device to rotate when rotating according to the rotation control information, and meanwhile, the photographing device can perform exposure according to the exposure control information, so that rotation of the gimbal and exposure of the photographing device can be performed at the same time, so as to achieve an effect of rotary photographing.
A rotary photographing method consistent with the present disclosure can be applied to a mobile platform provided by the present disclosure.
In some embodiments, the mobile platform may include, but is not limited to, an aerial vehicle such as an unmanned aerial vehicle, a land vehicle such as an automobile, a water vehicle such as a ship, and another type of a motor vehicle. Those skilled in the art can make a selection according to a specific scene, which is not limited in the present disclosure.
At 201, brightness information in a scene where a photographing target is located and a rotation mode of the gimbal are obtained.
In some embodiments, the photographing device at the mobile platform has a field of view (FOV), and the photographing device can obtain an image (a picture and/or a video) by photographing a scene within the field of view. In order to obtain a better photographing effect, the photographing device can first detect the brightness information in the scene where the photographing target is located before photographing, and then the photographing device can send the brightness information to the control device of the mobile platform via the communication bus (not shown in the figure).
In some embodiments, the control device of the mobile platform can obtain a rotation mode selected by a user through an interaction interface, thereby obtaining the rotation mode of the gimbal. The rotation mode may include at least one of a constant speed rotation mode, an acceleration rotation mode, or a deceleration rotation mode. In some embodiments, the gimbal rotates about a roll axis in each rotation mode. For example, a rotation range of the rotation about the roll axis is 0-360 degrees.
In some embodiments, the constant speed rotation mode refers to a mode in which the gimbal rotates at a constant speed according to a certain angular speed, such as 5 rad/s. The certain angular speed may be an angular speed preset by the user, or an angular speed determined according to different scenes, which is not limited in the present disclosure.
It can be understood that, when the gimbal is in the constant speed rotation mode, the photographing device can take images at a certain time interval or at different time intervals. The certain time interval may be a time interval preset by the user, or a time interval determined according to different scenes, which is not limited in the present disclosure.
In some other embodiments, the acceleration rotation mode refers to a mode in which the gimbal performs an angular speed acceleration rotation according to a certain angular acceleration (positive value). The certain angular acceleration may be an angular acceleration preset by the user, or an angular acceleration determined according to different scenes, which is not limited in the present disclosure.
It can be understood that, when the gimbal is in the acceleration rotation mode, the photographing device can take images at a certain time interval or at different time intervals. The certain time interval and the different time intervals may be time intervals preset by the user, or time intervals determined according to different scenes, which is not limited in the present disclosure.
In some other embodiments, the deceleration rotation mode refers to a mode in which the gimbal performs an angular speed deceleration rotation according to a certain angular acceleration (negative value). The certain angular acceleration may be an angular acceleration preset by the user, or an angular acceleration determined according to different scenes, which is not limited in the present disclosure.
It can be understood that, when the gimbal is in the deceleration rotation mode, the photographing device can take images at a certain time interval or at different time intervals. The certain time interval and the different time intervals may be time intervals preset by the user, or time intervals determined according to different scenes, which is not limited in the present disclosure.
In some other embodiments, the gimbal can also be in a variable speed rotation mode, where the variable speed rotation mode can be a rotation with acceleration first and then deceleration, a rotation with deceleration first and then acceleration, or a combination of deceleration rotation, acceleration rotation, and constant speed rotation. A suitable combination can be selected according to a specific scene, and a corresponding scheme falls within the scope of the present disclosure, provided that a corresponding photographing effect can be achieved.
It should be noted that, in order to ensure that the photographing device is in the same state condition during each exposure, state condition of the mobile platform also needs to be determined in some embodiments. Referring to
In an example where the mobile platform is an unmanned aerial vehicle, the preset state condition may include that the mobile platform is in a hovering state. In some embodiments, the unmanned aerial vehicle can determine whether itself is in the hovering state. When the unmanned aerial vehicle is in the hovering state, the brightness information in the scene and the rotation mode of the gimbal are obtained to perform rotary photographing; when the mobile platform is not in the hovering state, the user is prompted to hover the unmanned aerial vehicle through a user interaction interface. It is predetermined that the mobile platform is in the hovering state, so that stability of the photographing device when performing the rotary photographing can be ensured, and the effect of rotary photographing is improved.
At 202, control information is generated according to the brightness information and the rotation mode, the control information including rotation control information and exposure control information.
In some embodiments, the control information may be generated according to the brightness information provided by the photographing device and the rotation mode of the gimbal, and the control information may include the rotation control information and the exposure control information. The rotation control information is configured to control the rotation of the gimbal to drive the photographing device to rotate, and the exposure control information is configured to control the photographing device to perform exposure.
In some embodiments, generating the control information according to the brightness information and the rotation mode may include the following processes.
In some embodiments, referring to
In some embodiments, obtaining the number of exposures and the exposure parameters of each exposure may include, referring to
Referring to
In some embodiments, determining the number of exposures and the exposure parameters may include the following processes.
In some embodiments, when the exposure mode is the short exposure mode, referring to
In some other embodiments, when the exposure mode is the short exposure mode, referring to
In some other embodiments, when the exposure mode is the long exposure mode, referring to
It should be noted that for the photographing device with the same exposure value (EV), if the aperture is unchanged, the higher the sensitivity value, the faster the shutter speed, that is, the shorter the exposure time of each exposure; or, if the shutter speed is unchanged, the higher the sensitivity value, the smaller the aperture. In some embodiments, the aperture of the photographing device is a fixed value, so the exposure parameters may be the sensitivity value and the exposure time of each exposure. In some other embodiments, when the aperture of the photographing device is not a fixed value, the exposure parameters may be the sensitivity value, the aperture, and the exposure time for each exposure. Those skilled in the art can adjust the exposure parameters according to a specific scene, and a corresponding scheme falls within the scope of the present disclosure.
The long exposure mode in the embodiments described above is suitable for a scene with low brightness, while the short exposure mode is suitable for a scene with high brightness or large brightness change (i.e., high dynamic range). Those skilled in the art can select a corresponding exposure mode according to a specific scene, which is not limited herein.
At 203, the rotation control information is sent to the gimbal, and the exposure control information is sent to the photographing device, so that the gimbal drives the photographing device to rotate when rotating according to the rotation control information, and the photographing device performs exposure according to the exposure control information.
In some embodiments, after receiving the rotation control information, the gimbal drives the photographing device to rotate when rotating according to the rotation mode. As shown in
Referring to
Refer to
In some embodiments, the multiple images may be synthesized. Referring to
In an example of the image brightness processing, referring to
In an example of the image geometry processing, referring to
It should be noted that, in view of quality of the photographed image, another image quality adjustment operation such as quality increase processing may also be performed on the image, so as to improve effect of the subsequent image synthesis. In some other embodiments, those skilled in the art can also select a suitable preprocessing mode according to a specific scene, and a corresponding scheme falls within the scope of the present disclosure.
In some embodiments, the photographing failure prompt message can be popped out in a form of a text file, flashed on a display screen, or voiced, so that the user can be prompted quickly and accurately, which is convenient for the user to continue photographing.
Referring to
In an example of the photographing device shown in
For example, assuming that a total of N images are photographed, a rotation angle of the nth (n≤N) image can be calculated according to the following formula:
θ=τ/t0×360°
τ is the photographing time of the nth image, t0 is a total photographing duration, and θ is the rotation angle. For example, assuming that the total photographing duration is 60 s, and the photographing time corresponding to the first image obtained in the first exposure is 0 s, then the rotation angle corresponding to the first image is 0 degrees; the photographing time corresponding to the second image obtained in the second exposure is 20 s, then the rotation angle corresponding to the second image is 120 degrees; the photographing time corresponding to the third image obtained in the third exposure is 35 s, then the rotation angle corresponding to the third image is 210 degrees; the photographing time corresponding to the fourth image obtained in the fourth exposure is 50 s, then the rotation angle corresponding to the fourth image is 300 degrees.
For example, areas of the various ones of fan-shaped images are related to rotation speed of the gimbal. For example, in the constant speed rotation mode, the areas of the various fan-shaped images are the same; as another example, in the acceleration rotation mode, the areas of the various fan-shaped images gradually become larger (or smaller) in a clockwise direction; as another example, in the deceleration rotation mode, areas of the various fan-shaped images gradually become smaller (or larger) in the clockwise direction.
Thus, in the embodiments of the present disclosure, the brightness information in the scene where the photographing target is located and the rotation mode of the gimbal can be obtained; then, the control information is generated according to the brightness information and the rotation mode, the control information including the rotation control information and the exposure control information; after that, the rotation control information is sent to the gimbal and the exposure control information is sent to the photographing device, so that the gimbal can drive the photographing device to rotate when rotating according to the rotation control information, and meanwhile, the photographing device can perform exposure. In the embodiments of the present disclosure, the photographing device is controlled to perform exposure while the gimbal is controlled to rotate, so that the effect of rotary photographing is achieved, and the photographing experience is improved.
The present disclosure also provides a rotary photographing method, which can also be applied to the mobile platform shown in
Referring to
Further, the brightness information is detected by the photographing device.
Further, the rotation mode includes at least one of a constant speed rotation mode, an acceleration rotation mode, or a deceleration rotation mode.
Further, the gimbal rotates about a roll axis in the rotation mode.
Further, a rotation range of the rotation about the roll axis is 0-360 degrees.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining number of exposures and exposure parameters of each exposure according to the brightness information and the rotation mode, the exposure parameters including a sensitivity value and an exposure time; generating the control information according to the number of exposures, the exposure parameters, and the rotation mode.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining whether the photographing device meets an overexposure condition in a case of a single exposure according to the brightness information and rotation time corresponding to the rotation mode; determining an exposure mode of the photographing device to be a short exposure mode when the overexposure condition is met, otherwise, determining the exposure mode to be a long exposure mode; determining the number of exposures and the exposure parameters of each exposure according to the brightness information, the rotation time corresponding to the rotation mode, and the exposure mode.
Further, when the exposure mode is the short exposure mode, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining the number of exposures and the exposure time of each exposure according to the rotation time corresponding to the rotation mode and a preset rotation radian and rotation speed of each rotation; determining the sensitivity value of each exposure according to the brightness information and the exposure time of each exposure.
Further, when the exposure mode is the short exposure mode, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining the exposure time and the sensitivity value of each exposure according to the brightness information; determining the number of exposures according to the rotation time corresponding to the rotation mode and the exposure time of each exposure.
Further, when the exposure mode is the long exposure mode, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining that the number of exposures is one, and the exposure time of each exposure is the rotation time corresponding to the rotation mode; determining the sensitivity value of each exposure according to the brightness information and the exposure time of each exposure.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: obtaining a range of the sensitivity value of the photographing device; determining that the overexposure condition is met when exposure amounts corresponding to the rotation time and various sensitivity values within the range of the sensitivity value are all greater than a preset exposure threshold.
Further, the processor 1702 is configured to read the computer instructions from the memory, and further execute the following processes: determining whether the photographing device is successful in photographing this time; outputting a single image obtained by the photographing or synthesizing multiple images obtained by the photographing when the photographing is successful; outputting a photographing failure prompt message when the photographing has failed.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: obtaining a first moment at which the gimbal ends rotating and a second moment at which the photographing device ends exposure; determining that the photographing device is successful in photographing when a difference between the first moment and the second moment is less than or equal to a time threshold, otherwise, determining that the photographing has failed.
Further, the processor 1702 is configured to read the computer instructions from the memory, and further execute the following processes: preprocessing the multiple images to obtain multiple preprocessed images; mapping various ones of preprocessed images to various time points of the same model space; splicing the various images in the model space to obtain a result image; inversely mapping the result image to a two-dimensional image plane to obtain a synthesized image.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining one image in the multiple images as a reference image; adjusting brightness of other images based on the reference image to keep the brightness of each image consistent.
Further, the processor 1702 is configured to read the computer instructions from the memory, and specifically execute the following processes: determining one image in the multiple images as a reference image; adjusting geometric parameters of other images based on the reference image to keep geometric information of each image consistent.
Further, the processor 1702 is configured to read the computer instructions from the memory, and further execute the following processes: obtaining an operation state of the mobile platform; executing the process of obtaining the brightness information in the scene and the rotation mode of the gimbal when the operation state of the mobile platform meets a preset state condition, the preset state condition including that the mobile platform is in a hovering state.
The memory 1701 may include a volatile memory, a non-volatile memory, or a combination of memories of different types described above. The processor 1702 may be a central processing unit (CPU), and may further include a hardware chip such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.
According to the control device of the mobile platform provided by the embodiments of the present disclosure, the brightness information in the scene where the photographing target is located and the rotation mode of the gimbal can be obtained; then, the control information is generated according to the brightness information and the rotation mode, the control information including the rotation control information and the exposure control information; after that, the rotation control information is sent to the gimbal, and the exposure control information is sent to the photographing device, so that the gimbal can drive the photographing device to rotate when rotating according to the rotation control information, and the photographing device can perform exposure according to the exposure control information. In the embodiments of the present disclosure, the photographing device is controlled to perform exposure while the gimbal is controlled to rotate, so that the effect of rotary photographing is achieved, and the photographing experience is improved.
The embodiments of the present disclosure also provide a mobile platform, which includes a gimbal mounted with a photographing device, and a control device of the mobile platform described above.
The embodiments of the present disclosure also provide a machine readable storage medium which stores machine readable instructions, and when the machine readable instructions are executed, processes of the method consistent with the present disclosure, such as the example method described above in connection with
It should be noted that relational terms such as first and second are only used herein to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The terms “include,” “involve” or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, object, or device including a series of elements not only includes those elements, but also includes other elements that are not explicitly listed, or also includes elements inherent to such processes, method, object, or device. Without further restrictions, the element associated with phrase “including a . . . ” does not exclude the existence of other identical elements in the process, method, object, or device that includes the element.
The above are detailed description of a detection device and method provided by the present disclosure. Some examples are used in this specification to illustrate the principles and embodiments of the present disclosure. The description of the embodiments is for the purpose of helping to understand the method of this disclosure and its core idea. For those of ordinary skill in the art, there will be changes in specific embodiments and application scope according to the idea of this disclosure. In summary, the content of this specification should not be understood as a limitation of the present disclosure.
This application is a continuation of International Application No. PCT/CN2019/079876, filed Mar. 27, 2019, the entire content of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2019/079876 | Mar 2019 | US |
Child | 17484227 | US |