Patent Grant
11015929
This application is the national stage entry of PCT/CN2017/091953, filed on Jul. 6, 2017, which claims the benefit of priority to Chinese Patent Application No. 201611270205.7, filed Dec. 29, 2016, which are incorporated by reference in their entirety herein.
The present invention relates to the surveying and mapping field, and in particular, to a positioning method and apparatus.
In the prior art, the positioning of an observation object by a floating platform requires that a high-precision inertial navigation system is fixed on the pan/tilt axis of an optical device to obtain an attitude, and the positioning of the observation object is completed by combining a high-precision ranging device.
However, the completion of the positioning of the observation object through this solution requires a relatively large hardware cost, and also requires a large hardware upgrade and transformation of the existing platform that has been put into use. Therefore, practicability is relatively low.
The attitude is obtained by fixing the high-precision inertial navigation system on the stable pan/tilt axis inside the optical device, and the positioning operation is completed by combining the high-precision ranging device.
In view of the above-mentioned high cost of accurately locating the observation object, no effective solution is currently proposed.
According to one aspect of the present invention, a positioning method is provided, the positioning method comprising:
acquiring a first image captured by an optical device; the first image comprising images of an observation object and a plurality of predetermined objects, and the predetermined objects having known geographic coordinates;
selecting a first predetermined object from the predetermined objects based on the first image;
acquiring a second image; the first predetermined object being located at the center of the second image;
determining a first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image;
modifying the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle;
calculating the geographic coordinate of the observation object based on the second attitude angle.
In one embodiment, the step of acquiring a first image captured by an optical device comprises:
acquiring the first image in a target area captured by the optical device; the target area comprising the observation object and the predetermined objects, and a range of the target area being determined according to an angle of field of view of the optical device.
In one embodiment, the step of acquiring a first image captured by an optical device comprises:
detecting whether an image, captured by the optical device, comprises images of the observation object and the predetermined objects;
increasing an angle of field of view of the optical device and reacquiring the image captured by the optical device if the image captured by the optical device does not comprise images of the observation object and the predetermined objects;
determining that the first image is captured if the image captured by the optical device comprises images of the observation object and the predetermined objects.
In one embodiment, the step of detecting whether an image captured by the optical device comprises images of the observation object and the predetermined objects comprises:
obtaining a predetermined image database of the observation object and the predetermined objects, the predetermined image database storing features of the observation object and the predetermined objects;
detecting whether the image captured by the optical device comprises the features of the observation object and the predetermined objects; and
determining that the image captured by the optical device comprises images of the observation object and the predetermined objects if it is detected that the image captured by the optical device comprises the features of the observation object and the predetermined objects.
In one embodiment, the step of selecting a first predetermined object from the predetermined objects based on the first image comprises:
determining distances between the observation object and the predetermined objects in the first image; and
determining the predetermined object, having the shortest distance from the observation object, as the first predetermined object.
In one embodiment, the step of determining a first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image comprises:
calculating the first attitude angle of the optical device, based on the measurement data obtained by the inertial navigation system and the first predetermined object in the second image, by using a first formula; wherein the first formula is
wherein
A and B represent preset rotation matrices that are determined based on the measurement data obtained by the inertial navigation system;
c and d are geographic coordinates of the center location of the second image, c represents a longitude coordinate, and d represents a latitude coordinate;
α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; and
wherein a represents the longest radius of the earth, and b represents the shortest radius of the earth.
In one embodiment, the step of modifying the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle comprises:
modifying the first attitude angle, based on the position relationship between the observation object and the first predetermined object in the second image, by using a second formula to obtain the second attitude angle; wherein the second formula is
wherein
h is a row number of pixels of the observation object in the second image, and l is a column number of pixels of the observation object in the second image;
α and β are the first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle;
Δβ is a modified value of the pitch angle, and Δα is a modified value of the azimuth angle;
ξ and ω are angles of field of view at which the optical device captures the second image, ξ represents the angle of field of view of the optical device in a vertical direction, and ω represents the angle of field of view of the optical device in a horizontal direction; and
β′=β−Δβ is a modified pitch angle, α′=α+Δα is a modified azimuth angle, and the second attitude angle comprises the modified pitch angle and the modified azimuth angle.
According to another aspect of the present invention, a positioning apparatus is provided, the positioning apparatus comprising:
a first acquiring unit, configured to acquire a first image captured by an optical device; wherein the first image comprises images of an observation object and a plurality of predetermined objects, and the predetermined objects have known geographic coordinates;
a first selection unit, configured to select a first predetermined object from the predetermined objects based on the first image;
a second acquiring unit, configured to acquire a second image, wherein the first predetermined object is located at the center of the second image;
a first arithmetic unit, configured to determine a first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image;
a second arithmetic unit, configured to modify the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle; and
a third arithmetic unit, configured to calculate the geographic coordinate of the observation object based on the second attitude angle.
In one embodiment, the first acquiring unit comprises:
a first acquiring module, configured to acquire the first image in a target area captured by the optical device; wherein the target area comprises the observation object and the predetermined objects, and a range of the target area is determined according to an angle of field of view of the optical device.
In one embodiment, the first acquiring unit comprises:
a detection module, configured to detect whether an image captured by the optical device comprises images of the observation object and the predetermined objects;
a first detection sub-module, configured to increase an angle of field of view of the optical device and reacquire the image captured by the optical device if the image captured by the optical device does not comprise images of the observation object and the predetermined objects; and
a second detection sub-module, configured to determine that the first image is captured if the image captured by the optical device comprises images of the observation object and the predetermined objects.
In one embodiment, the detection module comprises:
a second acquiring module, configured to obtain a predetermined image database of the observation object and the predetermined objects, wherein the predetermined image database stores features of the observation object and the predetermined objects;
a second detection module, configured to detect whether the image captured by the optical device comprises the features of the observation object and the predetermined objects; and
a third detection sub-module, configured to determine that the image captured by the optical device comprises images of the observation object and the predetermined objects if it is detected that the image captured by the optical device comprises the features of the observation object and the predetermined objects.
In one embodiment, the first selection unit is specifically configured to:
determine distances between the observation object and the predetermined objects in the first image; and
determine a predetermined object, having the shortest distance from the observation object, as the first predetermined object.
In one embodiment, the first arithmetic unit is specifically configured to:
calculate the first attitude angle of the optical device, based on the measurement data obtained by the inertial navigation system and the first predetermined object in the second image, by using a first formula; wherein the first formula is
wherein
A and B represent preset rotation matrices that are determined based on the measurement data obtained by the inertial navigation system;
c and d are geographic coordinates of the center location of the second image, c represents a longitude coordinate, and d represents a latitude coordinate;
α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; and
wherein a represents the longest radius of the earth, and b represents the shortest radius of the earth.
In one embodiment, the second arithmetic unit is specifically configured to:
modify the first attitude angle, based on the position relationship between the observation object and the first predetermined object in the second image, by using a second formula to obtain the second attitude angle; wherein the second formula is
wherein
h is a row number of pixels of the observation object in the second image, and l is a column number of pixels of the observation object in the second image;
α and β are the first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle;
Δβ is a modified value of the pitch angle, and Δα is a modified value of the azimuth angle;
ξ and ω are angles of field of view at which the optical device that captures the second image, ξ represents the angle of field of view of the optical device in a vertical direction, and ω represents the angle of field of view of the optical device in a horizontal direction; and
β′=−Δβ is a modified pitch angle, α′=α+Δα is a modified azimuth angle, and the second attitude angle comprises the modified pitch angle and the modified azimuth angle.
In the embodiments of the present invention, an optical device carried on a floating platform collects an image of a target on observation ground, extracts, from the collected image, an image including an observation target and a plurality of preset targets with known geographic coordinates, and uses the image as a first image; then selects a preset target from the first image, uses the preset target as a reference target for accurately locating the observation target subsequently, and names the reference target as a first preset target; then selects, from the first image, a second image in which the first preset target is located in an image center, determines, based on known coordinates of the first preset target and measurement data collected by an inertial navigation system of the floating platform, a first attitude angle of the optical device for collecting the second image; then modifies the first attitude angle based on a location relationship between the observation target and the first preset target in the second image, to obtain a second attitude angle; and further calculates geographic coordinates of the observation target based on the modified second attitude angle, so that the floating platform can accurately locate the observation target based on the optical device of the floating platform, the inertial navigation system of the floating platform, and the preset target on the ground, without a need of additionally adding a ranging module and an attitude determination module to locate the observation target, thereby resolving a prior-art technical problem that costs of accurately locating an observation target are high.
The drawings described herein provide further understanding of the present invention, and form a part of this application. Schematic embodiments of the present invention and descriptions thereof are used to explain the present invention but do not constitute an inappropriate limitation on the present invention. In the drawings:
Step S102: acquiring a first image captured by an optical device; wherein the first image includes images of an observation object and a plurality of predetermined objects, and the predetermined objects have known geographic coordinates.
Step S104: selecting a first predetermined object from the predetermined objects based on the first image.
Step S106: acquiring a second image; wherein the first predetermined object is located at the center of the second image.
Step S108: determining a first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image.
Step S110: modifying the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle.
Step S112: calculating the geographic coordinate of the observation object based on the second attitude angle.
In the above embodiment, the optical device mounted on the floating platform captures an image of the ground observation object, extracts an image, including the observation object and the predetermined objects that have known geographic coordinates, from the captured image; and determines the extracted image as a first image; then selects a predetermined object from the first image, determines the predetermined object as a reference object for accurately positioning the observation object subsequently, and names the reference object as the first predetermined object; then selects a second image from the first image, wherein the first predetermined object is located at the center of the second image; determines a first attitude angle at which the optical device captures the second image, based on known coordinates of the first predetermined object and measurement data obtained by the inertial navigation system of the floating platform; then modifies the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle; and further calculates geographic coordinate of the observation object based on the modified second attitude angle, such that the floating platform allows accurate positioning of the observation object based on the optical device of the floating platform, the inertial navigation system of the floating platform, and the predetermined object on the ground, without the need to additionally add a distance measuring module and an attitude measuring module to the floating platform so as to facilitate positioning the observation object, thereby solving the technical problem that the cost of accurate positioning of the observation object is high in the prior art.
It should be noted that the inertial navigation system is an autonomous navigation system that does not rely on external information and does not radiate energy to the outside. An estimating navigation manner is used, that is, self position coordinates are calculated based on a position of a known point and its own motion state.
In an optional embodiment, the step of acquiring a first image captured by an optical device includes: acquiring the first image in a target area captured by the optical device; wherein the target area includes the observation object and the predetermined objects, and a range of the target area is determined according to an angle of field of view of the optical device.
Optionally, the target area is determined by manually selecting the observation object as a center, and a plurality of predetermined objects are uniformly disposed in the target area, such that the optical device can more easily capture the first image that includes images of the observation object and the predetermined object.
Optionally, the target area may be determined based on the angle of field of view of the optical device. A range of an adjustable angle of field of view of the optical device and a flying height of the floating platform are obtained in advance. Such that a range of a ground image captured by the floating platform during flight may be determined, and then the target area is determined based on the range.
It should be noted that, in the current imaging state, the angle of field of view represents an image coverage area relative to a field angle of the optical device. For a zoom optical system, the angle of field of view changes only with the adjustment of the local length while ensuring that other optical parameters are unchanged.
In an optional embodiment, the step of acquiring a first image captured by an optical device includes: detecting whether an image, captured by the optical device, includes the observation object and the predetermined objects; increasing an angle of field of view of the optical device and reacquiring the image captured by the optical device if the image captured by the optical device does not include images of the observation object and the predetermined objects; or determining that the first image is captured if the image captured by the optical device includes images of the observation object and the predetermined objects.
Optionally, the angle of field of view of the optical device is expanded to expand the range of captured images, such that the first image can be obtained without changing the position of the floating platform and the attitude angle of the optical device.
In an optional embodiment, the step of detecting whether the image captured by the optical device includes images of the observation object and the predetermined objects includes: obtaining a predetermined image database, the predetermined image database storing features of the observation object and the predetermined objects; detecting whether the image captured by the optical device includes the features of the observation object and the predetermined objects; and determining that the image captured by the optical device includes images of the observation object and the predetermined objects if it is detected that the image captured by the optical device includes the features of the observation object and the predetermined objects.
Specifically, the image captured by the optical device may be compared with the image database in which the observation object and the predetermined objects are stored in advance, and the image captured by the optical device including images of the observation object and the predetermined objects may be determined.
In an optional embodiment, the step of selecting a first predetermined object from the predetermined objects based on the first image includes: determining distances between the observation object and the predetermined objects in the first image; and determining the predetermined object, having the shortest distance from the observation object, as the first predetermined object. Coordinates of the predetermined object closest to the observation object are obtained and used as parameters of subsequent operation, so as to facilitate operation.
In an optional embodiment, the step of determining a first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image includes: calculating, by using a first formula, the first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image, where the first formula is
where A and B represent preset rotation matrices that are determined based on the measurement data obtained by the inertial navigation system; c and d are geographic coordinates of the center location of the second image, c represents a longitude coordinate, and d represents a latitude coordinate; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; and
where a represents the longest radius of the earth, and b represents the shortest radius of the earth.
It should be noted that a represents the longest radius of the earth and a=6378137 m and b represents the shortest radius of the earth and b=6356752.3142 m.
Specifically, based on geographic coordinate of the first predetermined object in the second image and the measurement data obtained by the inertial navigation system of the floating platform, the first attitude angle at which the optical device captures the second image may be calculated by using the first formula, and data of the first attitude angle may be used in a subsequent calculation process. A correspondence between the attitude angle at which the optical device captures the second image and the geographic coordinates of the center location of the second image is established based on the first formula. The first attitude angle of the second image may be calculated according to the known geographic coordinate of the first predetermined object in the center location of the second image.
It should be noted that the direction in which the optical device captures the image may be represented by a direction line from the optical device to the center direction of the captured image. The optical device may rotate around a certain fixed point during the process of capturing the image. The rotation direction includes a horizontal direction and a vertical direction. In order to accurately express the direction in which the optical device captures the image, the concept of the attitude angle is used. The attitude angle includes an azimuth angle and a pitch angle. The azimuth angle represents the horizontal included angle between the direction line of the optical device and the north direction, and the azimuth angle increases as the direction line rotates clockwise around the fixed point. The pitch angle represents an angle between the direction line of the optical device and the horizontal direction. If the direction line is above the horizontal direction, the pitch angle is positive; or if the direction line is below the horizontal direction, the pitch angle is negative.
In an optional embodiment, the step of modifying the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle includes: modifying, by using a second formula, the first attitude angle based on the position relationship between the observation object and the first predetermined object in the second image, to obtain the second attitude angle, where the second formula is
where h is a row number of pixels of the observation object in the second image, and l is a column number of pixels of the observation object in the second image; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; Δβ is a modified value of the pitch angle, and Δα is a modified value of the azimuth angle; ξ and ω are angles of field of view at which the optical device captures the second image, ξ represents the angle of field of view of the optical device in a vertical direction, and ω represents the angle of field of view of the optical device in a horizontal direction; and β′=β−Δβ is a modified pitch angle, α′=α+Δα is a modified azimuth angle, and the second attitude angle includes the modified pitch angle and the modified azimuth angle.
Specifically, determining the position relationship between the observation object and the first predetermined object in the second image based on the second image. Then modifying the first attitude angle by using the second formula and based on the known first attitude angle for capturing the second image and the position relationship between the first predetermined object and the observation object in the second image, to obtain the second attitude angle. The second attitude angle represents an attitude angle at which the optical device captures the observation object when the observation object is in the center location of the image.
It should be noted that the second image captured by the optical device is a rectangular image. A vertical distance of the rectangular image is related to ξ, that is, ξ represents an angle of field of view of the optical device in a vertical direction. A horizontal distance of the rectangular image is related to ω, that is, ω represents an angle of field of view of the optical device in a horizontal direction.
Optionally, based on a location of a object in a known image, an attitude angle at which the optical device captures the object when the object is in a center location of the image may be calculated by using the second formula. That is, when the first predetermined object is not in the center of the image captured by the optical device, an attitude angle at which the optical device captures a first object when the first object is in the center location of the image, namely, the first attitude angle, may be calculated by using the second formula.
It should be noted that, before calculating the first attitude angle by using the second formula, a third image in which the first predetermined object is located in the center of the image is firstly captured. Then the first attitude angle for acquiring the second image is calculated by using the first calculation formula; and under the condition that the first attitude angle is kept unchanged, the first image including images of the first predetermined object and the observation object is captured. Then an attitude angle under the assumption that the first predetermined object is located at the center of the current image, namely, an assumed attitude angle, is calculated by using the second formula. The original first attitude angle is updated by the assumed attitude angle, and the assumed attitude angle is used as the first attitude angle for subsequent calculation.
In an optional embodiment, the step of calculating geographic coordinate of the observation object based on the second attitude angle includes: calculating the geographic coordinate of the observation object, based on the second attitude angle, by using the first formula.
Specifically, the geographic coordinate of the observation object is calculated, based on the known second attitude angle, by using the first formula that can represent the corresponding relationship between the geographic coordinate of the observation object and the second attitude angle.
Step S202: obtaining a first image.
Capturing an image on the observation ground by an optical device of a floating platform; comparing the captured image with an image database that stores images of an observation object and a predetermined object.
Determining whether the captured image includes images of the observation object and the predetermined object; if the captured image includes images of the observation object and the predetermined object, determining that the image captured by the optical device is the first image; or if the captured image does not include images of the observation object and the predetermined object, storing a current attitude of the optical device, increasing an angle of field of view, and reacquiring the image on the observation ground, until the captured image includes images of the observation object and the predetermined object.
The angle of field of view is the opening angle of the image coverage range relative to the camera in the current imaging state. For a zoom optical system of the optical device, if it is ensured that other optical parameters remain unchanged, an angle of field of view of the system changes only with adjustment of a local length.
It should be noted that the predetermined object is a reference point having known geographic coordinate that is set in advance and is adjacent to the observation object. The floating platform determines the predetermined image as a reference point, to improve the accuracy of positioning the observation object.
Optionally, in order to facilitate the optical device of the floating platform to capture the first image including images of the observation object and the predetermined object, a plurality of predetermined objects may be disposed in a target area that is adjacent to the observation object; the target area is a regular graphic area that is centered around the observation object. A range of the target area may be determined based on an angle of field of view at which the optical device of the floating platform captures the first image. If the angle of field of view of the optical device is large, the target area having a relatively large range is determined; or if the angle of field of view of the optical device is small, the target area having a relatively small range is determined. In addition, the predetermined objects disposed in the target area may be evenly arranged in the target area.
Optionally, in order to facilitate identifying the predetermined object in the first image, the predetermined object may be disposed in the target area at an open space or a higher ground position, such that the predetermined object is not covered and can be easily identified.
Step S204: extracting a first predetermined object from the first image.
Selecting a predetermined object from the first image and determining the predetermined object as the first predetermined object, determining a pixel location of the first predetermined object in the first image, so as to provide reference data for accurate positioning of the observation object subsequently.
Optionally, the first image includes images of the observation object and the predetermined object, wherein the predetermined object may be one or more. If there is one predetermined object in the first image, it is determined that the predetermined object is the first predetermined object; or if there are a plurality of predetermined objects in the first image, one of the predetermined objects may be selected as the first predetermined object.
In an alternative embodiment, the predetermined object closest to the observation object may be selected as the first predetermined object.
Optionally, determining distances between the observation object and the predetermined objects in the first image; and determining the predetermined object, having the shortest distance from the observation object, as the first predetermined object.
Step S206: obtaining a second image.
In the case of determining the first predetermined object, the optical device reacquires the first image in which the first predetermined object is located at the center of the image, and determines the reacquired first image as the second image.
Step S208: determining a first attitude angle of an optical device.
Establishing an accurate conversion matrix, that is, a first formula; based on a coordinate conversion principle and the measurement data obtained by an inertial navigation system of the floating platform. The first formula represents an attitude angle at which the optical device captures the second image, that is, a corresponding relationship between the first attitude angle and geographic coordinates of a center location of the second image. The first attitude angle may be determined by the geographic coordinate of a center position of the second image.
In an optional embodiment, the first formula may be
In the formula, A and B represent preset rotation matrices that are determined based on the measurement data obtained by the inertial navigation system; c and d are the geographic coordinates of the center location of the second image, c represents a longitude coordinate, and d represents a latitude coordinate; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; e is calculated by using a formula
N is calculated by using a formula
a represents the longest radius of the earth and a=6378137 m; and b represents the shortest radius of the earth and b=6356752.3142 m.
Step S210: obtaining a modified second attitude angle of the optical device.
Calculating, based on the position relationship between the observation object and the first predetermined object, an attitude angle by using the second formula under an assumption that the observation object is located in the center of the second image; that is, the second attitude angle is obtained.
Optionally, the second formula may be
Because the first predetermined object is located at the center of the second image, the observation object may be modified based on the center location of the second image. h is a row number of pixels of the observation object in the second image, and l is a column number of pixels of the observation object in the second image; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; Δβ is a modified value of the pitch angle, and Δα is a modified value of the azimuth angle; ξ and ω are angles of field of view at which the optical device captures the second image, ξ represents the angle of field of view of the optical device in a vertical direction, and ω represents the angle of field of view of the optical device in a horizontal direction; and β′=β−Δβ is a modified pitch angle, α′=α+Δα is a modified azimuth angle, and the second attitude angle includes the modified pitch angle and the modified azimuth angle.
Step S212: determining geographic coordinate of the observation object.
Substituting the modified second attitude angle into the first formula, and determining that the geographic coordinate of the center position of the second image is the geographic coordinate of the observation object.
In the above embodiment, the floating platform is equipped with the optical device for ground monitoring. The geographic coordinate of the observation object can be determined at the same time of detection. In addition, the accuracy of the geographic coordinate of the determined observation object is high. This can improve functions of the floating platform in actual application.
Therefore, in the absence of the ranging module or the accurate attitude measuring module, the optical platform can effectively improve positioning accuracy of the observation object and reduce positioning cost by using the existing optical device and the existing inertial navigation system with limited ground control points.
In the above embodiment, the optical device mounted on the floating platform captures an image of the ground observation object, extracts an image, including the observation object and the predetermined objects that have known geographic coordinates, from the captured image; and determines the extracted image as a first image; then selects a predetermined object from the first image, determines the predetermined object as a reference object for accurately positioning the observation object subsequently, and names the reference object as the first predetermined object; then selects a second image from the first image, wherein the first predetermined object is located at the center of the second image; determines a first attitude angle at which the optical device captures the second image, based on known coordinates of the first predetermined object and measurement data obtained by the inertial navigation system of the floating platform; then modifies the first attitude angle, based on a position relationship between the observation object and the first predetermined object in the second image, to obtain a second attitude angle; and further calculates geographic coordinate of the observation object based on the modified second attitude angle, such that the floating platform can achieve accurate positioning the observation object based on the optical device of the floating platform, the inertial navigation system of the floating platform, and the predetermined object on the ground, without the need to additionally add a distance measuring module and an attitude measuring module to the floating platform so as to facilitate positioning the observation object, thereby solving the technical problem that the cost of accurately positioning the observation object are high in the prior art.
In an optional embodiment, the first acquiring unit includes a first acquiring module, configured to acquire the first image in a target area captured by the optical device; wherein the target area includes the observation object and the predetermined objects, and a range of the target area is determined according to an angle of field of view of the optical device.
In an optional embodiment, the first acquiring unit includes: a detection module, configured to detect whether an image captured by the optical device includes images of the observation object and the predetermined objects; a first detection sub-module, configured to increase an angle of field of view of the optical device and reacquire an image captured by the optical device if the image captured by the optical device does not include images of the observation object and the predetermined objects; and a second detection sub-module, configured to determine that the first image is captured if the image captured by the optical device includes images of the observation object and the predetermined objects.
In an optional embodiment, the detection module includes: a second acquiring module, configured to obtain a predetermined image database of the observation object and the predetermined objects, wherein the predetermined image database stores features of the observation object and the predetermined objects; a second detection module, configured to detect whether the image captured by the optical device includes the features of the observation object and the predetermined objects; and a third detection sub-module, configured to determine that the image captured by the optical device includes images of the observation object and the predetermined objects if it is detected that the image captured by the optical device includes the features of the observation object and the predetermined objects.
In an optional embodiment, the first selection unit is specifically configured to: determine distances between the observation object and the predetermined objects in the first image; and determine a predetermined object, having the shortest distance from the observation object, as the first predetermined object.
In an optional embodiment, the first arithmetic unit is specifically configured to: calculate, by using a first formula, the first attitude angle of the optical device based on measurement data obtained by an inertial navigation system and the first predetermined object in the second image, where the first formula is
where A and B represent preset rotation matrices and are determined based on the measurement data obtained by the inertial navigation system; c and d are geographic coordinates of the center location of the second image, c represents a longitude coordinate, and d represents a latitude coordinate; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; and
where a represents the longest radius of the earth, and b represents the shortest radius of the earth.
In an optional embodiment, the second arithmetic unit is specifically configured to modify, by using a second formula, the first attitude angle based on the position relationship between the observation object and the first predetermined object in the second image, to obtain the second attitude angle, where the second formula is
where h is a row number of pixels of the observation object in the second image, and l is a column number of pixels of the observation object in the second image; α and β are first attitude angles at which the optical device captures the second image, α is an azimuth angle, and β is a pitch angle; Δβ is a modified value of the pitch angle, and Δα is a modified value of the azimuth angle; ξ and ω are angles of field of view at which the optical device captures the second image, ξ represents the angle of field of view of the optical device in a vertical direction, and ω represents the angle of field of view of the optical device in a horizontal direction; and β′=β−Δβ is a modified pitch angle, α′=α+Δα is a modified azimuth angle, and the second attitude angle includes the modified pitch angle and the modified azimuth angle.
Sequence numbers of the above embodiments of the present invention are merely used for description, and do not represent superiority or inferiority of the embodiments.
In the above embodiments of the present invention, descriptions of the embodiments have respective emphases. For a part not described in detail in an embodiment, reference may be made to related descriptions in another embodiment.
In the several embodiments provided in this application, it should be understood that the disclosed technical content may be implemented in other manners. The described apparatus embodiments are merely examples. For example, the unit division is merely logical function division and may be other division in actual implementation. For example, a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not performed. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be implemented by using some interfaces. The indirect couplings or communication connections between the units or modules may be implemented in electrical or other forms.
The units described as separate parts may or may not be physically separated, and parts shown as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual requirements to achieve the objectives of the solutions of the embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software functional unit.
When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such an understanding, the technical solutions of the present invention essentially, or the part contributing to the prior art, or all or some of the technical solutions may be implemented in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, a server, a network device, or the like) to perform all or some of the steps of the methods described in the embodiments of the present invention. The foregoing storage medium includes any medium that can store program code, such as a USB flash drive, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a removable hard disk, a magnetic disk, or an optical disc.
The foregoing descriptions are merely preferred implementations of the present invention. It should be noted that, improvements and modifications may be further made by a person of ordinary skill in the art without departing from the principles of the present invention, and these improvements and modifications shall also be construed as falling within the protection scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201611270205.7 | Dec 2016 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2017/091953 | 7/6/2017 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2018/120735 | 7/5/2018 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 10798343 | Davidson, Jr. | Oct 2020 | B2 |
| 20070031064 | Zhao | Feb 2007 | A1 |
| 20080074639 | Donoghue et al. | Mar 2008 | A1 |
| 20090326816 | Park et al. | Dec 2009 | A1 |
| 20110122257 | Kirk | May 2011 | A1 |
| 20140376821 | Meir et al. | Dec 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 101509782 | Aug 2009 | CN |
| 101620671 | Jan 2010 | CN |
| 101750067 | Jun 2010 | CN |
| 101793517 | May 2012 | CN |
| 202928582 | May 2013 | CN |
| 103424114 | Dec 2013 | CN |
| 103557871 | Feb 2014 | CN |
| 103674021 | Mar 2014 | CN |
| 103914855 | Jul 2014 | CN |
| 105222788 | Jan 2016 | CN |
| 105549060 | May 2016 | CN |
| 105761242 | Jul 2016 | CN |
| 2015081424 | Jun 2015 | WO |
| Entry |
|---|
| International Search Report for International Application No. PCT/CN2017/091953, dated Sep. 27, 2017, 2 pages. |
| EESR for corresponding European Patent Application No. 17888044.9, dated Jul. 9, 2020, 10 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20190339074 A1 | Nov 2019 | US |
