The present disclosure relates to the technical field of positioning, in particular, to a positioning method, apparatus, device and system, and a storage medium.
Positioning technologies are widely used in various devices (such as a mobile phone, a tablet computer, and a vehicle, and the like) whose positions and poses need to be estimated.
Positioning technologies include the technology of satellite navigation positioning, the technology of Ultra Wide Band (UWB) positioning, and the like. The technology of satellite navigation positioning has high positioning accuracy in open areas such as outdoor areas, but has low positioning accuracy in indoor areas due to insufficient signals. The technology of UWB positioning can achieve high-accuracy positioning in indoor areas, but has a low positioning capability in outdoor areas.
Different positioning technologies may be combined for positioning to improve the positioning accuracy. For example, the technology of UWB positioning is used for positioning in indoor areas. The technology of satellite navigation positioning is used in outdoor open areas. However, the two technologies achieve positioning in local spaces of the indoor or outdoor areas, and are poor in connection in indoor and outdoor areas. When a device to be positioned is transferred from an indoor area to an outdoor area or from an outdoor area to an indoor area, a relatively large positioning error will occur, and continuous high-accuracy positioning in the space cannot be achieved.
Therefore, the above positioning technologies still need to be improved.
Based on this, it is necessary to provide a positioning method, apparatus, device and system, and a storage medium.
In one aspect, a positioning method is provided, including: obtaining a moment to be positioned at which positioning is to be performed; obtaining an Inertial Measurement Unit (IMU) output value of an IMU mounted on a positioning device at the moment to be positioned; when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the first measurement signal; and when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the second measurement signal.
In another aspect, a positioning apparatus is provided, including: a moment obtaining component, configured to obtain a moment to be positioned at which positioning is to be performed; an IMU value obtaining component, configured to obtain an IMU output value of an IMU mounted on a positioning device at the moment to be positioned; a first positioning component, configured to: when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determine positioning information of the positioning device according to the IMU output value and the first measurement signal; and a second positioning component, configured to: when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determine positioning information of the positioning device according to the IMU output value and the second measurement signal.
In another aspect, a positioning device is provided, including an IMU component, a 5G component, a satellite positioning component, a memory and a processor; the IMU component, the 5G component, the satellite positioning component and the memory are respectively connected to the processor; the IMU component is configured to obtain an IMU output value of the positioning device at an IMU sampling moment, and output the IMU output value to the processor; the 5G component is configured to receive, from a 5G base station, a first measurement signal of an uplink reference signal of the positioning device measured by the 5G base station at a 5G sampling moment, and output the first measurement signal to the processor; the satellite positioning component is configured to receive, from a navigation satellite, a second measurement signal of the positioning device observed by the navigation satellite at a satellite sampling moment, and output the second measurement signal to the processor; the memory is configured to store a computer program; and the processor is configured to, when executing the computer program, implement the following method: obtaining a moment to be positioned at which positioning is to be performed; obtaining an IMU output value of an IMU mounted on the positioning device at the moment to be positioned; when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the first measurement signal; and when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the second measurement signal.
In another aspect, a positioning system is provided, including a 5G base station, a navigation satellite and a positioning device; the positioning device is in communication connection with the navigation satellite and the 5G base station respectively; the 5G base station is configured to measure a first measurement signal of an uplink reference signal of the positioning device at a 5G sampling moment, and output the first measurement signal to the positioning device; the navigation satellite is configured to observe a second measurement signal of the positioning device at a satellite sampling moment, and output the second measurement signal to the positioning device; and the positioning device is configured to perform the following method: obtaining a moment to be positioned at which positioning is to be performed; obtaining an IMU output value of an IMU mounted on the positioning device at the moment to be positioned; when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the first measurement signal; and when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the second measurement signal.
In one aspect, a computer-readable storage medium is provided, which stores a computer program. The computer program, when executed by a processor, implements the following method: obtaining a moment to be positioned at which positioning is to be performed; obtaining an IMU output value of an IMU mounted on the positioning device at the moment to be positioned; when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the first measurement signal; and when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determining positioning information of the positioning device according to the IMU output value and the second measurement signal.
Details of one or more embodiments of the present disclosure will be proposed in the following accompanying drawings and descriptions. Other features, objectives and advantages of the present disclosure will become apparent from the specification, the accompany drawings and the claims.
To describe the technical solutions in the embodiments of the present disclosure more clearly, accompanying drawings required to be used in the embodiments will be briefly introduced below.
Apparently, the drawings in the descriptions below are only some embodiments of the present disclosure. Those of ordinary skill in the art also can obtain other drawings according to these drawings without creative work.
In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the present disclosure is further described below in detail with reference to accompanying drawings and embodiments. It should be understood that the specific embodiments described here are merely to explain the present disclosure, and not intended to limit the present disclosure.
In order to achieve continuous high-accuracy positioning in space, a space can be divided according to the characteristics and limitations of positioning methods, namely, from villages to cities, and from outdoor to indoor. As shown in
The technology of 5th-Generation (5G) mobile communication technology-based positioning is a new emerging positioning technology, which can achieve decimeter or even centimeter-level positioning accuracy when 5G base stations are densely deployed. Compared with UWB positioning, the technology of 5G positioning does not require additional labor and equipment costs. More importantly, the spatial effective coverage range of 5G positioning is much greater than that of the UWB positioning, and a strong spatial complementarity is formed with the BDS positioning. As can be seen from
Therefore, in positioning methods provided in the following embodiments of the present disclosure, a satellite navigation system, 5G positioning, and an IMU are deeply fused to achieve advantage complementation, thereby effectively improving the continuity and effectiveness of positioning in time and space, that is, achieving temporal-spatial universal high-accuracy positioning.
The positioning method provided in the present disclosure may be applied to an application environment shown in
In one embodiment, referring to
In Step S402, a moment to be positioned at which positioning is to be performed is obtained.
The moment to be positioned at which positioning is to be performed refers to a moment at which positioning information of a positioning device needs to be determined. The moment to be positioned may be set according to a positioning requirement of the positioning device. In this step, the positioning device determines the moment to be positioned.
In Step S404, an IMU output value of an IMU mounted on the positioning device at the moment to be positioned is obtained.
The positioning device refers to a device to be positioned. The positioning device may be a device that performs the positioning method of the present disclosure, so that the positioning device may determine its own positioning information by performing the positioning method of the present disclosure.
The IMU is mounted on the positioning device. The IMU may include sensors such as an accelerometer and a gyroscope.
In Step S406, when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, positioning information of the positioning device is determined according to the IMU output value and the first measurement signal.
The first predetermined time period which includes the moment to be positioned may be determined according to actual conditions, such as according to the number of first measurement signals needing to be received. In this step, one or more first measurement signals may be received within the first predetermined time period. Respectively receiving three continuous first measurement signals at three continuous 5G sampling moments within the first predetermined time period is taken as an example. In this embodiment, a maximum possible time interval may be taken as the first predetermined time period, wherein the maximum possible time interval comprises one closest 5G measurement moment after the moment to be positioned and two 5G measurement moments before the closest 5G measurement moment. For example, if an IMU sampling interval is sampling once every 1 ms, a 5G sampling interval is sampling once every 9 ms, and the moment to be positioned is the 35th ms, the first predetermined time period may be set to (8 ms, 44 ms).
The first measurement signal of the 5G base station is a signal obtained by observing the positioning device by the 5G base station and used for positioning the positioning device. The 5G base station observes the positioning device within its observation range at the 5G sampling interval to obtain the first measurement signal and sends same to the positioning device.
The positioning information is information that represents a positioning result of the positioning device, and the positioning information may include, for example, a position, speed and pose of the positioning device.
In this step, if the positioning device receives the first measurement signal from the 5G base station at all the sampling moments within the first predetermined time period which includes the moment to be positioned, it indicates that the quality of the current first measurement signal from the 5G base station is good. Therefore, the first measurement signal may be combined with the IMU output value to accurately obtain the positioning information at the moment to be positioned. As shown in
In Step S408, when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, positioning information of the positioning device is determined according to the IMU output value and the second measurement signal.
The method for setting the second predetermined time period which includes the moment to be positioned at step S408 may be similar with the method for setting the first predetermined time period which includes the moment to be positioned at step S406. The second predetermined time period may be the same or different from the first predetermined time period. For example, the second predetermined time period may be determined according to the number of second measurement signals needing to be received within the second predetermined time period. Specific details will not be repeated here.
The navigation satellite refers to one or more navigation satellites in a navigation satellite system. The navigation satellite system may, for example, be a Global Navigation Satellite System (GNSS). For example, the navigation satellite system may include a BDS, a Global Positioning System (GPS), a Galileo Navigation Satellite System (Galileo) and/or a Global Orbiting Navigation Satellite System (GLONASS).
The second measurement signal of the navigation satellite is a signal obtained by observing the positioning device by the navigation satellite and used for positioning the positioning device. The navigation satellite observes the positioning device at the satellite sampling moment to obtain the second measurement signal and sends same to the positioning device.
In this step, if the positioning device receives the second measurement signal from the navigation satellite at all the sampling moments within the second predetermined time period which includes the moment to be positioned, it indicates that the quality of the current second measurement signal from the navigation satellite is good. Therefore, the second measurement signal may be combined with the IMU output value to accurately obtain the positioning information at the moment to be positioned. As shown in
According to the above positioning method, the 5G and IMU tightly coupled positioning, as well as the satellite navigation system and IMU tightly coupled positioning is applied. When the first measurement signal from the 5G base station is received within the first predetermined time period which includes the moment to be positioned, the first measurement signal and the IMU output value are combined to determine the positioning information of the positioning device. At the same time, when the second measurement signal from the navigation satellite is received within in the second predetermined time period which includes the moment to be positioned, the second measurement signal and the IMU output value are combined to determine the positioning information of the positioning device. Since 5G positioning and satellite positioning are highly complementary in indoor and outdoor environments, the positioning method for deeply fusing the satellite navigation system, the 5G and the IMU in the present disclosure can effectively improve the continuity and effectiveness of positioning in time and space.
The 5G and IMU tightly coupled positioning method involved in step S406 will be described in detail below.
Since the sampling moments of the 5G base station and the sampling moments of the IMU are often different, there is usually a time difference between the 5G sampling moment of the first measurement signal obtained in step S406 and the IMU sampling moment of the IMU output value. Therefore, it is necessary to solve the problem of high-accuracy time alignment between the two moments. That is, it is necessary to estimate output values of the 5G base station and the IMU at the same moment for positioning.
In one embodiment, as shown in
In this embodiment, the moment to be positioned is set to the IMU sampling moment. As at the IMU sampling moment, the second 5G output value of the 5G base station at the moment to be positioned is estimated. The third 5G output value of the IMU at the moment to be positioned is calculated according to the IMU output value and the base station position. Therefore, it can be able to conveniently and quickly determine the third 5G output value of the IMU and the second 5G output value of the 5G base station, as to facilitate subsequent positioning calculation based on data of the IMU and the 5G base station, wherein the third 5G output value of the IMU and the second 5G output value of the 5G base station correspond to the same moment and have the same form.
The first 5G output value, the second 5G output value, and the third 5G output value in above step S602 and step S604 refer to data with the same form of the data which is output by the 5G base station and used for positioning. In one embodiment, each of the first 5G output value, the second 5G output value and the third 5G output value may include an Angle of Arrival (AoA) and Time of Arrival (TOA).
As shown in
In one embodiment, the above first 5G output value may include: M first 5G output values of uplink reference signals of the positioning device measured by the 5G base station at M 5G sampling moments of the 5G base station within the first predetermined time period, and M is a positive integer.
The value of M may be determined according to an actual need. In this embodiment of the present disclosure, M may be greater than or equal to 2. For example, M may be 3. In other embodiments, M may be a larger or smaller value.
According to different values of M, different methods may be used to estimate the second 5G output value of the 5G base station at the moment to be positioned. For example, when M=1, that is, when there is only one first 5G output value, an extrapolation method may be used to estimate the corresponding second 5G output value. The extrapolation method may be any of the existing extrapolation estimation methods.
In one embodiment, when M≥2, a time alignment method between the 5G and the IMU involved in step S602, that is, the step that the second 5G output value of the 5G base station at the moment to be positioned is estimated according to the first 5G output value, may include: by using an interpolation method, the second 5G output value of the 5G base station at the moment to be positioned is estimated according to the M 5G sampling moments, the M first 5G output values and the moment to be positioned.
According to different values of M, different interpolation methods may be used to estimate the second 5G output value. For example, when M=2, any existing interpolation method may be used to estimate the corresponding second 5G output value. When M=3, for example, a Lagrange three-point interpolation method may be used to estimate the corresponding second 5G output value.
M=3 is taken as an example. As shown in
In this embodiment, by means of the interpolation method, the second 5G output value of the moment may be estimated according to the first 5G output values of a plurality of existing moments around the moment to be positioned.
Further, in addition to using the interpolation method to estimate the second 5G output value, a neural network may be further combined to estimate the second 5G output value.
In another embodiment, as shown in
In Step S902, at each of the moments to be positioned within a first time period after the positioning device is turned on, the second 5G output value of the 5G base station at the moment to be positioned is estimated by using an interpolation method, according to the M 5G sampling moments, the M first 5G output values and the moment to be positioned.
Similarly, M=3 is taken as an example. At the beginning when the positioning device performs the positioning method, namely, within the first time period (TI1-TINc) after the positioning device is turned on, the second 5G output value of the 5G base station at the moment to be positioned may be estimated by using the Lagrange three-point interpolation method. As an example in
In Step S904, in the first time period, a neural network model is trained according to a training set comprised by N 5G sampling moments within the first time period and N first 5G output values at the N 5G sampling moments, N≥2, and a second time period starts when the training is completed and a trained neural network model is obtained.
When step S902 of estimating the second 5G output value using the interpolation method is performed, in this step S904, within the first time period, that is, period TI1-TINc, a high-accuracy time alignment method based on a neural network is also running.
The following is taken as an example: the neural network uses a Long Short Term Memory Neural Network (LSTMNN), and M is equal to 3. At period TI1-TINc, three adjacent 5G sampling moments may be obtained in real time and the two first 5G output values of the first and last 5G sampling moments in the three adjacent 5G sampling moments are taken as input values of the LSTMNN. The first 5G output value corresponding to the middle 5G sampling moment among the three adjacent 5G sampling moments is taken as an output value of the corresponding LSTMNN, so that a plurality of pairs of input-output values are formed to be a training set. The training set is configured to train the LSTMNN in real time. The number of input-output value pairs may be determined according to actual situations. For example, 50 pairs input-output value pairs may be obtained, or more or fewer than 50 pairs input-output value pairs also may be obtained. Correspondingly, the value of N may be set according to the number of input-output value pairs. Obtaining 50 pairs of input-output value is taken as an example. Correspondingly, N may be 52, that is, 52 first 5G output values of 52 continuous 5G sampling moments are obtained. Every three adjacent 5G sampling moments and the corresponding three first 5G output values form one input-output value pair as above. Correspondingly, in the LSTMNN training phase, an input vector at a moment k is [TBk−1,BIk−1,TBk+1,BIk+1,TBk]T, and an output is BIk.
The LSTMNN is trained using an online training mode, and a training algorithm is an Unscented Kalman Filter (UKF)-based training method. At the moment TIN
In Step S906, at each of the moments to be positioned within the second time period, the moment to be positioned is input to the trained neural network model and an output value of the neural network model is used as the estimated second 5G output value of the 5G base station at the moment to be positioned.
The LSTMNN is also taken as an example. In this step, within the second time period, that is, after the moment TIN
During the high-accuracy time alignment, an input vector [TBk−1,BIk−1,TBk+1,BIk+1,TIα]T at any moment α may be input to the LSTMNN to obtain an output value BIα, where TBk−1≤TIα≤TBk+1, and the output value BIα is the second 5G output value of the 5G base station at the moment to be positioned α.
The neural network has higher estimation accuracy compared to the interpolation estimation method, but the neural network requires certain training time. In this embodiment, at the initial stage of positioning on the positioning device, the interpolation method is configured to estimate the second 5G output value at the moment to be positioned. Meanwhile, at the initial stage of positioning on the positioning device, the neural network is trained simultaneously. After the neural network converges, the neural network is configured to estimate the second 5G output value at the moment to be positioned, which can improve the accuracy of positioning time alignment while taking the overall time utilization efficiency into account.
In one embodiment, as shown in
The neural network model may have a set number of hidden layers and a set number of nodes in each of an input layer, a hidden layer, and an output layer. During the training of the neural network model, the adjustable parameters, including the bias values of the various layers and the weights of the various layers, of the neural network may be initialized, to preliminarily obtain an initialized neural network model.
In Step S1004, a state space model for the adjustable parameters of the neural network model is established.
The LSTMNN is taken as an example. To train the LSTMNN by using the UKF algorithm, it is necessary to first establish the state space model for the adjustable parameters of the LSTMNN. By using this state space model, the UKF algorithm may perform recursive estimation on the adjustable parameters in the LSTMNN. The state space model for the adjustable parameters of the LSTMNN is:
θ(k)=θ(k−1)+w(k−1)
y(k)=h[θ(k),u(k)]+v(k) (2)
where θ(k) is a set vector of the adjustable parameters of the LSTMNN at the moment k, namely, a weight matrix and bias vector of the LSTMNN; u(k)=[TBk−,BIk−1,TBk+1,BIk+1,TBk]T and y(k)=BIk are respectively an input value and an output value of the LSTMNN; h[⋅] represents an internal dynamic process of the LSTMNN; and w(k−1) and v(k) are state and observation noise vectors, respectively. By using the state space model shown in formula (2), the UKF algorithm may perform the recursive estimation on the adjustable parameters in the LSTMNN.
In Step S1006, by using a UKF algorithm, recursive estimation is performed on the adjustable parameters according to the state space model and the training set, until an output error of the neural network model reaches a predetermined error range, so that the trained adjustable parameters is determined.
In this step, the state space model shown in formula (2) may be used to substitute each input-output value pair in the training set into the LSTMNN for recursive estimation, until the output error of the LSTMNN reaches the predetermined error range, that is, until the LSTMNN converges. At this time, the adjustable parameters are the trained adjustable parameters.
In Step S1008, the trained neural network model is generated according to the trained adjustable parameters.
In this step, the trained neural network model is correspondingly determined by using the trained adjustable parameters.
In this embodiment, when the UKF method is used to train the neural network, and second-order derivative information may be used, the convergence is fast, and it is not easy to obtain local minima. Therefore, the time alignment accuracy of the ultimately trained neural network model, namely, the accuracy of the estimated second 5G output value, is high.
The neural network of the present disclosure has been described above by using the LSTMNN as an example. As a recursive neural network, applying the LSTMNN to the time alignment method provided in the present disclosure can effectively improve the accuracy of time alignment, but the neural network of the present disclosure is not limited to this. For example, the neural network of the present disclosure may also use a Multi-Layer Perceptron (MLP), and the UKF algorithm may also be used to train the MLP. For another example, the neural network of the present disclosure may also use a Radial Basis Function (RBF) neural network, and the like.
In one embodiment, as shown in
In the aforementioned step S404, the obtained IMU output value may include an acceleration, position, speed, and pose and so on of the positioning device. For example, the position may include a longitude, latitude, and altitude of the positioning device in a local level coordinate system; the speed may include east speed, north speed, and up speed of the positioning device in a navigation coordinate system; and the pose may include a heading angle, an elevation angle and a roll angle of the positioning device in a carrier coordinate system relative to the navigation coordinate system.
In this step, the positioning device may calculate the third 5G output value of the IMU at the moment to be positioned according to the above IMU output value and the base station position. The third 5G output value may be expressed as UIn=[rIl θIl φIl].
In Step S1104, a 5G and IMU error state equation at the moment to be positioned is constructed according to the positioning information of the positioning device obtained at a previous moment at which positioning has been performed, and the IMU output value at the previous moment.
For example, the positioning device may construct the 5G and IMU error state equations for the current moment to be positioned as formulas (3)-(5), and the IMU uses a triaxial accelerometer and a three-axis gyroscope.
{dot over (ϕ)}=Maaϕ+M4δVn+Mapδp−Cbnεb (3)
δ{dot over (v)}n=Mvaϕ+Mvvδvn+Mvpδp+Cbn∇b (4)
δ{dot over (p)}=MpvΓvn+Mppδp (5)
Where ϕ is an misalignment angle of the calculated navigation coordinate system relative to an ideal navigation coordinate system; {dot over (ϕ)} is a first-order derivative of the misalignment angle, δvn is a speed error vector in the navigation coordinate system; δ{dot over (v)}n is a first-order derivative of the speed error vector; δp=[δL δλ δh]T is a position error vector under the local level coordinate system, including a latitude error, a longitude error, and an altitude error in the local level coordinate system; δ{dot over (p)} is a first-order derivative of the position error vector; εb is a gyroscope zero drift error vector; ∇b is an accelerometer zero drift error vector; the navigation coordinate system is defined as an “east-north-up” geographic coordinate system; and Cbn is a coordinate transformation matrix from the carrier coordinate system to the navigation coordinate system.
In the above formulas 3 to (5):
where vn=[vE vN vU]T represents the east speed, north speed and up speed, in the navigation coordinate system, of the positioning device solved at the previous moment at which positioning has been performed, and p=[L λ h] represents the latitude, longitude and altitude, in the local level coordinate system, of the positioning device solved at the previous moment at which positioning has been performed; ωie is the Earth's rotation rate; RM is a principal radius of curvature of the meridian; RN is the principal radius of curvature of the prime vertical circle; ge is an equatorial gravity; gp is a polar gravity; Re is the equatorial radius; f is usually 1/298.257223563; β2 is usually 3.08×10−6 s−2; β3 is usually 8.08×10−9 s−2; and fsfn=(fsfxn,fsfyn,fsfzn)T and fsfb=(fsfxb,fsfyb,fsfzb)T fare measured values of the accelerometer in the IMU at the previous moment.
The 5G and IMU error state equations are used to model the error evolution of the IMU between the mechanization value and the actual value. The input value is an estimated value, namely a state error estimated value, output by an Error State Kalman Filter (ESKF) at the previous moment. The output value is a state error predicted value of a next moment. The output value acts on [δL δλ δh] in the error observation equation, and the 5G and IMU error state equations are used to predict a state error of the next moment.
In Step S1106, a 5G and IMU error observation equation at the moment to be positioned is constructed according to the second 5G output value and the third 5G output value at the moment to be positioned.
In this step, the positioning device may construct the 5G and IMU error observation equation at the current moment to be positioned, as shown in formula (24) below.
In the above formula (24):
where (xIl,yIl,zIl) is a coordinate value of the positioning device provided with the IMU in a local cartesian coordinate system of the 5G base station; we is an observed noise vector of the 5G base station; Cel is a coordinate transformation matrix from the local level coordinate system to the local coordinate system of the 5G base station, e=√{square root over (2f−f2)}.
In Step S1108, the 5G and IMU error state equation and the 5G and IMU error observation equation are combined, and iterative estimating the positioning information of the positioning device by using an ESKF method, as to determine the positioning information of the positioning device.
In this step, the positioning device combines the formulas (3)-(5) with the formula (24) and uses the error observation equations and the ESKF to correct the state error predicted value output from the error state equations, as to obtain the final state error estimated value. The input value includes a 5G observation value and an IMU mechanization value, and the output value includes the state error estimated value. The IMU mechanization value minus the state error estimated value is the final state estimated value (namely, position, speed and pose) of the positioning device. By using the error state equations in formulas (3)-(5), the error observation equations in formula (24), and the ESKF, a state error may be estimated recursively. The iterative estimation of the position, speed and pose of the positioning device at the current moment may be performed, as to determine the positioning information of the positioning device at the current moment to be positioned. The positioning information may include the position, speed and pose of the positioning device.
The 5G and IMU tightly coupled positioning method involved in step S406 has been described in detail above. The following will continue to describe the satellite navigation system and IMU tightly coupled positioning method involved in step S408 in detail. Many details described in the following satellite navigation system and IMU tightly coupled positioning method are similar to the above 5G and IMU tightly coupled positioning method. For example, the above time alignment method for the 5G base station and the IMU may be used in the same way in the time alignment method for the satellite navigation system and the IMU. For similar implementation details and beneficial effects, refer to the above description of the 5G and IMU tightly coupled positioning method.
In one embodiment, as shown in
In this embodiment, the moment to be positioned is set to belong to the IMU sampling moment. According to the IMU sampling moment, the second satellite output value of the navigation satellite at the moment to be positioned is estimated, and the third satellite output value of the IMU at the moment to be positioned is calculated according to the IMU output value and the satellite position, so that it can be possible to conveniently and quickly determine the third satellite output value of the IMU and the second satellite output value of the navigation satellite, wherein the third satellite output value of the IMU and the second satellite output value of the navigation satellite are at the same moment to be positioned and have the same form, as to facilitate subsequent positioning calculation based on data of the IMU and the navigation satellite.
The first satellite output value, the second satellite output value, and the third satellite output value in above step S606 and step S608 refer to data of which the form is the same to the data which is output by the navigation satellite and used for positioning. In one embodiment, each of the first satellite output value, the second satellite output value and the third satellite output value includes a pseudo-range and a pseudo-range rate.
In one embodiment, the first satellite output value includes: X first satellite output values of the positioning device observed by the navigation satellite at X satellite sampling moments of the navigation satellite within the second predetermined time period, and X is a positive integer.
The value of X may be determined according to an actual need. In this embodiment of the present disclosure, X may be greater than or equal to 2. For example, X may be 3. In other embodiments, X may be a larger or smaller value.
According to different values of X, different methods may be used to estimate the second satellite output value of the navigation satellite at the moment to be positioned. The examples of different estimation methods used when X takes different values, refer to the above example of estimating the second 5G output value of the 5G base station at the moment to be positioned when M takes different values, which will not be described in detail here.
In one embodiment, a time alignment method between the satellite and the IMU involved in step S606, that is, the step that the second satellite output value of the navigation satellite at the moment to be positioned is estimated according to the first satellite output value, may include: by using an interpolation method, the second satellite output value of the navigation satellite at the moment to be positioned is estimated according to the X satellite sampling moments, the X first satellite output values and the moment to be positioned.
In this embodiment, for the example and beneficial effects of using the interpolation method to estimate the second satellite output value of the navigation satellite at the moment to be positioned, refer to the above example and beneficial effects of using the interpolation method to estimate the second 5G output value of the 5G base station at the moment to be positioned, which will not be described in detail here.
In another embodiment, step S606, in which the second satellite output value of the navigation satellite at the moment to be positioned is estimated according to the first satellite output value, includes:
In this embodiment, for the example and beneficial effects of using the interpolation method in combination with the neural network model to estimate the second satellite output value of the navigation satellite at the moment to be positioned, refer to the above example and beneficial effects of using the interpolation method in combination with the neural network model to estimate the second 5G output value of the 5G base station at the moment to be positioned in the above step S902 to step S906, which will not be described in detail here.
In one embodiment, the above step that a neural network is trained according to the training set includes:
For the examples and beneficial effects of training the neural network model in this embodiment, refer to the examples and beneficial effects of training the neural network model in steps S1002-S1008 of the 5G and IMU tightly coupled positioning method described above, which will not be described in detail here.
In the above satellite navigation system and IMU tightly coupled positioning method of the present disclosure, the implementation details such as the calculation formulas in step S608 may be achieved by using a combined positioning method which combines any existing satellite navigation system and IMU. For example, the implementation details may be achieved by using the combined positioning method which combines the IMU and the satellite navigation system disclosed in references [1] Titerton D H, Weston J L. Strapdown industrial navigation technology [M]. 2004. and [2] Nouraldin A, Karamat T B, George J. Fundamentals of Industrial Navigation, Satellite based Positioning and Their Integration [M]. 2013. Disclosed contents of these references are incorporated by its reference.
In the positioning method of the present disclosure, when a first measurement signal from a 5G base station is received within a first predetermined time period which includes a moment to be positioned, and a second measurement signal from a navigation satellite is also received within a second predetermined time period which includes the moment to be positioned, the positioning device may selectively perform one of steps S406 and S408. Thus, one of the two positioning methods may be used to position the positioning device, wherein the two positioning methods include the 5G and IMU tightly coupled positioning method and the satellite navigation system and IMU tightly coupled positioning method. Or, the positioning device may also combine the 5G and IMU tightly coupled positioning method and the satellite navigation system and IMU tightly coupled positioning method to position the positioning device.
In one embodiment, the positioning method of the present disclosure may further include:
Further, in one embodiment, the first measurement signal includes a first 5G output value and a base station position of the 5G base station, and the second measurement signal includes a first satellite output value and a satellite position of the navigation satellite. The above positioning method may include:
Alternatively, in another embodiment, the positioning method of the present disclosure may also include:
Further, in one embodiment, the first measurement signal includes a first 5G output value and a base station position of the 5G base station, and the second measurement signal includes a first satellite output value and a satellite position of the navigation satellite. The above positioning method may include:
The technical solutions of the above two embodiments combine the 5G and IMU tightly coupled positioning method with the satellite navigation system and IMU tightly coupled positioning method to position the positioning device. For details such as the corresponding calculation formulas and beneficial effects, refer to the above relevant descriptions of the 5G and IMU tightly coupled positioning method and the satellite navigation system and IMU tightly coupled positioning method, which will not be described in detail here.
In the above two embodiments, when the first measurement signal from the 5G base station is received within the first predetermined time period which includes the moment to be positioned, and a second measurement signal from a navigation satellite is also received within a second predetermined time period which includes a moment to be positioned, the positioning device is positioned by combining the 5G and IMU tightly coupled positioning method combined with the satellite navigation system and IMU tightly coupled positioning method, thereby further improving the positioning accuracy.
It should be understood that although the steps in the flow charts of
In one embodiment, referring to
The moment obtaining component 1201 is configured to obtain a moment to be positioned at which positioning is to be performed.
The IMU value obtaining component 1202 is configured to obtain an IMU output value of an IMU at the moment to be positioned.
The first positioning component 1203 is configured to: when a first measurement signal from a 5G base station is received within a first predetermined time period which includes the moment to be positioned, determine positioning information of the positioning device according to the IMU output value and the first measurement signal.
The second positioning component 1204 is configured to: when a second measurement signal from a navigation satellite is received within a second predetermined time period which includes the moment to be positioned, determine positioning information of the positioning device according to the IMU output value and the second measurement signal.
According to the above positioning apparatus of this embodiment, by combining 5G and IMU tightly coupled positioning with satellite navigation system and IMU tightly coupled positioning, when the first measurement signal from the 5G base station is received within the first predetermined time period which includes the moment to be positioned, the first measurement signal and the IMU output value are combined to determine the positioning information of the positioning device; and at the same time, when the second measurement signal from the navigation satellite is received within in the second predetermined time period which includes the moment to be positioned, the second measurement signal and the IMU output value are combined to determine the positioning information of the positioning device. Since 5G positioning and satellite positioning are highly complementary in indoor and outdoor environments, the positioning method for deeply fusing the satellite navigation system, the 5G base station and the IMU in the present disclosure can effectively improve the continuity and effectiveness of positioning in time and space.
In one embodiment, referring to
The IMU component 1301 is configured to obtain an IMU output value of the positioning device at an IMU sampling moment, and outputs the IMU output value to the processor 1305.
The 5G component 1302 is configured to receive, from a 5G base station, a first measurement signal of an uplink reference signal of the positioning device, wherein the uplink reference signal of the positioning device is measured by the 5G base station at a 5G sampling moment, and output the first measurement signal to the processor 1305.
The satellite positioning component 1303 is configured to receive, from a navigation satellite, a second measurement signal of the positioning device observed by the navigation satellite at a satellite sampling moment, and output the second measurement signal to the processor 1305.
The memory 1304 is configured to store a computer program; and
In other embodiments, the processor 1305 in the above positioning device 1300 further implements the positioning method of any one of the above embodiments when executing the computer program.
In one embodiment, the positioning device 1300 may be any one of a mobile phone, a tablet computer, a portable wearable device, a vehicle and a ship. In other embodiments, the positioning device 1300 may also be a component that is mounted on a mobile phone, a tablet computer, a portable wearable device, a vehicle, or a ship.
In one embodiment, referring to
The 5G base station 1401 is configured to measure a first measurement signal of an uplink reference signal of the positioning device at a 5G sampling moment, and output the first measurement signal to the positioning device.
The navigation satellite 1402 is configured to observe a second measurement signal of the positioning device at a satellite sampling moment, and output the second measurement signal to the positioning device.
The positioning device 1300 is configured to perform the following method:
In other embodiments, the above positioning device 1300 also implements the positioning method of any one of the above embodiments.
In one embodiment, a computer-readable storage medium is further provided, which stores a computer program. The computer program, when executed by a processor, implements the following method:
In other embodiments, when executed by a processor, the above computer program further implements the positioning method of any one of the above embodiments.
The technical features of the embodiments described above can be arbitrarily combined. In order to make the description concise, all possible combinations of various technical features in the above embodiments are not completely described. However, the combinations of these technical features should be considered as the scope described in the present specification as long as there is no contradiction in them.
The foregoing embodiments represent only a few implementation modes of the present disclosure, and the descriptions are specific and detailed, but should not be construed as limiting the patent scope of the present disclosure. It should be noted that those of ordinary skill in the art may further make variations and improvements without departing from the conception of present disclosure, and these variations and improvements all fall within the protection scope of present disclosure. Therefore, the patent protection scope of present disclosure should be subject to the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2020/125174 | 10/30/2020 | WO |