Method to reduce data rates and power consumption using device based attitude generation

Information

  • Patent Grant
  • 11340247
  • Patent Number
    11,340,247
  • Date Filed
    Thursday, October 15, 2020
    4 years ago
  • Date Issued
    Tuesday, May 24, 2022
    2 years ago
Abstract
A method includes generating motion data by receiving a gyroscope data from a gyroscope sensor, performing integration using the gyroscope data and generating an integrated gyroscope data using a first processor. The method further includes receiving a data from one or more sensors, other than the gyroscope sensor, and performing sensor fusion using the integrated gyroscope data and the data to generate motion data using a second processor.
Description
BACKGROUND

Various embodiment of the invention relate generally to motion sensor data and particularly to integration of gyroscope data to generate motion data.


In applications using gyroscopes, gyroscope data from a gyroscope is collected along with data from a compass and/or an accelerometer and other sensors. The collected data is then fused together to determine the movement of the device. The collected data is also integrated over time and at a high rate to reduce errors. Such high rate data is typically sent from a semiconductor device (or integrated circuit) to a processor. Due to the high rate associated with the integrated data, transmitting high rate data to the processor causes increased power. There is therefore a need for efficient transmission of gyroscope data with a decrease in system power.


SUMMARY

Briefly, a method of the invention includes generating motion data by receiving a gyroscope data from a gyroscope, performing integration using the gyroscope data and generating an integrated gyroscope data using a first processor. The method further includes receiving a data from one or more sensors, other than the gyroscope, and performing sensor fusion using the integrated gyroscope data and the data to generate motion data using a second processor.


A further understanding of the nature and the advantages of particular embodiments disclosed herein may be realized by reference of the remaining portions of the specification and the attached drawings.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 shows lower rate quaternion data being passed from device 14 to device 10, in accordance with an embodiment of the invention.



FIG. 2 shows a block diagram of the relevant steps and/or data paths, of the embodiment of FIG. 1.



FIG. 3a shows a comparison of the integration of data by a conventional gyroscope, and the various embodiments of the invention.



FIG. 3b shows some of the relevant steps of the processing of gyroscope information, in accordance with a method of the invention.



FIGS. 4a-c show conventional processing of raw gyroscope data at 400 in comparison with that of the various embodiments of the invention at 402 and 404.



FIGS. 5a-d show various embodiments of the invention, 502, 504, 506, and 508, with each having MPU 14.



FIGS. 6 through 12 show various embodiments 600 through 1200 of the invention, respectively.



FIG. 13 shows an embodiment in accordance with the invention.





DETAILED DESCRIPTION OF EMBODIMENTS

In the following description of the embodiments, reference is made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration of the specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized because structural changes may be made without departing from the scope of the present invention. It should be noted that the figures discussed herein are not drawn to scale and thicknesses of lines are not indicative of actual sizes.


In accordance with an embodiment and method of the invention, integration of gyroscope data is performed in a single device, such as a single semiconductor device. Gyroscope integration is performed at a rate that is higher than the integrated output data rate to reduce the in-device processing requirements. In an embodiment of the invention, integration of the gyroscope data is performed using a curve-fit to reduce the in-device processing requirements. Integration over time, at a higher rate, causes fewer errors. Yet, the integrated data is sent at a lower data rate thereby reducing power consumption. The integrated gyroscope data can also be passed at the same rate as the gyroscope data to reduce computation on the second processor and maintain a consistency for the type of data being sent. In the described embodiments, the integrated gyroscope data is also referred to as a low power quaternion (LPQ).


In other embodiments and methods of the invention, sensor fusion is performed at a lower rate than the rate of the gyroscope data integration. The output of a gyroscope-only quaternion data is saved in a register. In another embodiment, the quaternion data is stored in a first-in-first-out (FIFO) that resides in the same device that includes the gyro. In the case of a semiconductor, the “same device” as used herein refers to the same chip. In some embodiments, the integration of a three-axis gyroscope in the same package as the gyroscope sensor.


In yet another embodiment and method of the invention, removal of a known gyroscope bias is performed after integration. In yet other embodiments the gyroscope bias is removed before integration.


In yet other embodiments, a 9-axis (gyroscope, accelerometer, and compass) motion tracking is employed in a variety of sensor platform architectures, some of which are disclosed herein, and the remainder of which are too numerous to list but that are contemplated.


In the described embodiments, a motion tracking device also referred to as Motion Processing Unit (MPU) includes at least one sensor in addition to electronic circuits. The sensors, such as the gyroscope, the compass, the accelerometer, microphone, pressure sensors, proximity, ambient light sensor, among others known in the art, are contemplated. Some embodiments include accelerometer, gyroscope, and magnetometer, which each provide a measurement along three axis that are orthogonal relative to each other referred to as a 9-axis device. Other embodiments may not include all the sensors or may provide measurements along one or more axis. The sensors are formed on a first substrate. Other embodiments may include solid-state sensors or any other type of sensors. The electronic circuit in the motion tracking device receive measurement outputs from the one or more sensors. In some embodiments, the electronic circuit processes the sensor data. The electronic circuit is implemented on a second silicon substrate. The first substrate is vertically stacked and attached to the second substrate in a single device.


In an embodiment of the invention, the first substrate is attached to the second substrate through wafer bonding, as described in commonly owned U.S. Pat. No. 7,104,129 (incorporated herein by reference) that simultaneously provides electrical connections and hermetically seals the MEMS devices. This fabrication technique advantageously enables technology that allows for the design and manufacture of high performance, multi-axis, inertial sensors in a very small and economical package. Integration at the wafer-level minimizes parasitic capacitances, allowing for improved signal-to-noise relative to a discrete solution. Such integration at the wafer-level also enables the incorporation of a rich feature set which minimizes the need for external amplification.


In the described embodiments, raw data refers to measurement outputs from the sensors which are not yet processed. Motion data refers to processed raw data. Processing may include calibration to remove error or applying a sensor fusion algorithm or applying any other algorithm. In the case of the sensor fusion algorithm, data from one or more sensors are combined to provide an orientation of the device. In the described embodiments, a motion processing unit (MPU) may include processors, memory, control logic and sensors among structures.


Referring now to FIG. 1, device 10 is shown, in accordance with an embodiment of the invention. Device 10 is shown to include a processor 12 and a motion processing unit (MPU) 14. Processor 12 resides externally to MPU 14 and can be a general purpose processor or a specialized processor. In some embodiments, processor 12 is referred to as Application processor (AP). MPU 14 may include a 2 or 3 axis gyroscope or a 3-axis accelerometer or a 6-axis sensor, i.e. 3-axis accelerometer and 3-axis gyroscope, or a 9-axis sensor, i.e. 3-axis accelerometer, 3-axis gyroscope, and 3-axis magnetometer (or compass). In another embodiment, MPU 14 may include a multitude of 3-axis accelerometers, where the accelerometers provide the 3-axes of gyroscope data by determining 3-degrees of freedom of angular velocity. MPU 14 may include a digital motion processor (DMP) 3, such as a specialized processor, memory, analog-to-digital converter (ADC), or a controller.


In operation, MPU 14 generally processes gyroscope data 9 (“gyroscope measurement output” or “gyroscope data”) transmitted by gyroscope 18 in DMP 3 and outputs the orientation of the gyroscope in the form of the integration gyroscope data 9a. MPU 14 may transmit data 7 from other sensors, such as but not limited to an accelerometer and/or a compass. MPU 14 generates a gyroscope data output 5 to processor 12. Data 5 has a data rate that is lower than the rate of the gyroscope data output 9. A part of the processing performed by the MPU 14 is quaternion and/or integration in DMP 3.


Similarly, MPU 14 receives raw motion data 11 from accelerometer 20 and the compass 22 and stores raw motion data 11 in FIFO 24 before transmitting to the processor 12.


In FIG. 1, processor 12 is shown to include a sensor fusion that receives the data output from the MPU 14 and generates motion data.


In some embodiments, processor 12 and MPU 14 are formed on different substrates and in other embodiments they reside on the same substrate. In yet other embodiments, the sensor fusion is performed externally to the processor 12 and MPU 14. In still other embodiments, the sensor fusion is performed by MPU 14.


Referring still to FIG. 1, MPU 14 is shown to include a high-rate and low-power Quaternion block 16. Block 16 is shown to receive input from the gyroscope 18 and processes the same using processor 3 (and hardware logic) and outputs Quaternion 9a. The output of gyroscope 18 is actually the output of the gyroscope. Raw data from compass 22 and accelerometer 20 along with the quaternion output 9a are transmitted to the processor. In some embodiments, quaternion, performed by block 16, is integration. In this respect, block 16 includes an integrator that integrates the output of gyroscope 18 at a high rate. In some embodiments, this high rate is at a rate higher than 200 Hz. The block 16, upon performing integration, provides the output of the integration (or Quaternion) to a bus, memory and register 26.


Register 26 and FIFO 24 each provide a low rate output to processor 12. Processor 12 further performs processing by performing a 6 or 9-axis sensor fusion calculation based upon the integrated 3-axis gyroscope data 5 and accelerometer and compass data 7. Data integration at high rate at the block 16 advantageously increases data reliability whereas the low rate between MPU 14 and processor 12 advantageously reduces power consumption. It is noteworthy that block 16, gyroscope 18, compass 22 and accelerometer 20 reside on the same package, in an embodiment of the invention and reside on the same substrate in another embodiment of the invention.


Separation of the MPU 14 and the processor 12 allows users of the MPU 14 to flexibly use the output of the MPU 14. For example, different users of the device 10 may choose the flexibility to use various sensor fusion algorithms while still lowering the power from a reduced transmission rate.


Integration may be performed using sampling that starts from the gyroscope measurement output. In other embodiments of the invention, the sampling starts after a predetermined number of samples and continues over a predetermined time period. In yet other embodiments of the invention, during a dead zone where the input of the integrator or Quaternion (gyroscope data) is close to zero, the output is made to remain the same.



FIG. 2 shows a block diagram of the relevant steps and/or data paths, of the embodiment of FIG. 1. In FIG. 2, gyroscope data, in its raw form, at 200 is provided to the integration and quaternion block 206, which is a part of the block 16 in FIG. 1. Further details of the Quaternion are provided later below. The integration at 206, as indicated above, is performed at a high rate and the output of 206 is provided to the FIFO/Register 24 for storage. The output of FIFO/register 24 is a Quaternion that is provided to the sensor fusion 208. In an embodiment of the invention, sensor fusion 208 is part of application processor (AP) 12. In another embodiment of the invention, sensor fusion 208 is part of MPU 14.


FIFO/Register 24 is also provided with a requested data rate at 210 and the requested data rate at 210 uses one of the outputs of the sensor fusion 208 to determine the data rate being requested before passing along this information to FIFO/Register 24. Another output of sensor fusion 208 is shown to be the motion data at 216.


Sensor fusion 208 is shown to further receive measurement outputs from accelerometer data 202 and compass data 204. If all three types of data, i.e. gyroscope data, accelerometer data, and compass data, are employed by the sensor fusion 208, the output 216 is a 9-axis Quaternion. In another embodiment, sensor fusion 208 may receive measurement outputs from other sensors such as pressure sensor or microphone. In some embodiments, sensor fusion block 208 may be part of MPU 14 or part of AP 12.


In some embodiments, a bias removal block 214 for removing an inherent bias in the gyroscope. For example, after the gyroscope data at 200 is provided, bias removal 214 can use used to remove the gyroscope's inherent bias. Alternately, bias removal 214 can be applied after integrating gyroscope data in the sensor fusion 208. As will be evident shortly, bias removal may be employed at stages other than at the output at 200.



FIG. 3a shows a comparison of the integration of data by a conventional method, at 300, and the various embodiments of the invention, at 302. FIG. 3b shows some of the relevant steps of the processing of gyroscope information, in accordance with a method of the invention.


Referring now to FIG. 3a, in conventional method 300, raw data from gyroscope is transmitted at a low data rate to a host processor for data integration. Precision of gyroscope data can be lost in this process and transmitting data at higher rates consumes more power. In the various embodiments of the invention, at 302, raw gyroscope data is integrated at a higher rate than done in the convention method due to the availability of processing power. Integrated data is then transmitted at slower speeds to the host processor for further processing by the latter while retaining the precision of gyroscope data as well consuming lower power. Graph 304 shows the precision loss of prior art integrations as compared to the higher precision shown in the graph at 306.



FIGS. 4a-c show conventional processing of raw gyroscope data at 400 in comparison with that of the various embodiments of the invention at 402 and 404. In 400, the gyroscope data rate and the sensor fusion rate can be the same. At 402, the sample rate is the same as shown at 400, except the read rate at 402 is equal to a lower rate, such as the screen refresh rate because the data is buffered. At 404, the sample rate is equal to the screen refresh rate ex. 60 Hz. By transmitting the 3-axis low power quaternion (LPQ) data at a rate lower than what is shown at 400, power is saved. The 3-axis refers to 3-axis of the gyro being integrated into a quaternion. 402 has a disadvantage as there is more data traffic than 404. A watermark in FIG. 4 refers to sending an interrupt every at a predetermined number of samples rather than at every sample.



FIGS. 5a, 5b, 5c and 5d show various embodiments of the invention, 502, 504, 506, and 508, with each having MPU 14 for receiving measurement outputs from sensors, and application processor 10 (AP) receiving its input in alternative ways from alternative sources via a bus. Optionally external sensor may provide measurement data from various external sensors 520 such as pressure, microphone, proximity, and Ambient Light sensor. In FIG. 5a, in the first embodiment 502, MPU 14 receives measurement output from the sensors, executes the low power quaternion on the raw gyroscope data and transmits sensor data to the AP 10 at a rate lower than the gyroscope data via a bus where sensor fusion algorithm in executed. Optionally, sensor fusion algorithm may be executed on the data from MPU 14 as well as from external sensors 520. In an embodiment, the bus can be an I2C bus or any other bus.


In FIG. 5b, in the second embodiment 504, AP 10 receives its input, through the bus, from the Micro Controller Unit (MCU) 522. In an embodiment, MCU 22 includes a processor and memory. In this embodiment, MPU 14 executes the Low Power Quaternion algorithm where it integrates the gyroscope data into a quaternion and the MCU 522 executes the sensor fusion algorithm. MCU 522 transmits processed motion data to the AP 10 at a lower rate.


In FIG. 5c, in another embodiment 506, MPU 14 transmits raw sensor data a higher rate to the MCU 522. MCU 522 executes the low power quaternion algorithm where it integrates the gyroscope data into a quaternion. MCU 522 transmits MPU 14 data to AP 10 at a lower rate optionally along with the raw data from the external sensors. In this embodiment, the sensor fusion algorithm is executed in AP 10.


In FIG. 5d, in another embodiment 508, MPU 14 executes the low power quaternion algorithm on the gyroscope data where it integrates the gyroscope data and transmits data to MCU 522. MCU 522 transmits data to AP 10 where sensor fusion algorithm is executes. Optionally, MCU 522 transmits data from external sensors 520.



FIGS. 6 through 12 show various embodiments 600 through 1200, respectively, of the invention. More specifically, these figures are of various configurations of a device. It is understood that these configurations are merely exemplary and that others are contemplated. FIG. 6 shows a device 600 to include an AP 602 that is in communication with a MPU 604, which includes an accelerometer and a gyro. The MPU 604 generates integrated gyro data that is sent to 602. In AP 602 the gyro bias is determined in 609 using the integrated gyro data. The gyro bias can be determined by using gyro data derived by taking the derivative of integrated gyro data or by use of a Kalman filter. The gyro bias is removed from the gyro integrated data for use in the 6-axis sensor fusion.



FIG. 7 shows a MPU 700 is shown to include a gyroscope, accelerometer, and a compass and generates a 9-axis motion data as well as a 6-axis motion data.



FIG. 8 shows another MPU 800 to include a gyroscope, accelerometer and a compass feeding into a sensor fusion, which outputs the motion data. The output of the gyroscope is integrated and bias correction is performed.



FIG. 9 shows a device 900 to include an AP that is in communication with a MPU through a MCU. Bias correction is performed by the AP and provided to the gyroscope, accelerometer, and compass of the MPU. The AP is shown to output motion data. In this embodiment, MCU functions as a feed through device.



FIG. 10 shows a device 1000 including an AP 10 to be coupled to a MCU 522, which is coupled to the MPU 14. Bias correction/removal is performed by the MCU 522 and the result provided to the MPU 14. The MPU includes a gyroscope, an accelerometer, and a compass.



FIG. 11a shows a device 1100a to include an AP that is coupled to a MCU. The MCU is shown coupled to the MPU. The MPU in addition to a gyroscope, accelerometer, and a compass, includes a LPQ whose output is used for bias removal by the MCU. The MCU has a block which takes a LPQ with a bias on it coupled to a bias correction block to remove the bias before sending the LPQ to the sensor fusion 6-axis block.



FIG. 11b shows a device 1100b that is analogous to the embodiment of FIG. 11a except that the LPQ of the MCU of the device 1100b is not coupled to the bias correction block. Bias is provided by the MCU, but the correction takes place in the MPU.



FIG. 12 shows a device 1200 to include an AP that is coupled to an MCU. The MCU is shown coupled to a MPU, which includes a gyroscope, an accelerometer, and a compass. Rather than integrating the output of the gyroscope, a bias correction block and a LPQ, both in the MPU, are coupled to each other and the bias correction block is coupled to the gyroscope. The LPQ generates an output to the MCU. The MPU generates a 6-axis and 9-axis corrections.


The sensor fusion of the various embodiments of the invention calculates the quaternion in accordance with the algorithm and relationships below.



FIG. 13 shows an embodiment 1300 where the sensor data is generated at 1301 and passed to processor11302. The sensor data includes gyroscope data as well as other sensor data. Processor11302 integrates gyroscope data into a quaternion and transmits the quaternion to another processor21303 where sensor fusion of the integrated gyroscope and other sensor data occurs. In an embodiment, sensor 1301, processor11302 and processor21303 can be on the same semiconductor chip or on three different semiconductor chips. In another embodiment, sensor 1301 and processor11302 can be on the same semiconductor chip. In another embodiment, sensor processor11302 and processor21303 are on the same semiconductor chip.


A unit quaternion, also referred to as “quaternion”, is a 4-element vector that describes how to go from one orientation to another orientation. Other equivalent ways to describe going from one orientation to another orientation include a rotation matrix and Euler angles. A unit quaternion has a scalar term and 3 imaginary terms and a magnitude of one for the four element vector. For the purpose of discussion herein, the scalar term is placed first followed by the imaginary term. One skilled in the art would be able to compute slightly different formulas using a different definition of a quaternion. Euler angles describe how to go from one orientation to another orientation by rotating 3 different angles about 3 different axes of rotation. Instead of moving 3 angles about 3 different axes of rotation, the same rotational motion can be described by rotating one angle around a single vector. In Equation 1 below, for a quaternion, the angle θ is the amount rotated about the unit vector, [ux, uy, uz].










Q
_

=

[


cos


(

θ
2

)


,


sin


(

θ
2

)


·

u
x


,


sin


(

θ
2

)


·

u
y


,


sin


(

θ
2

)


·

u
z



]





Equation





1







A quaternion multiplication is defined in Equation 2 as found in literature. The notation “⊗”, as used herein, represents quaternion multiplication in this document.

Q1=[q1w,q1x,q1y,q1z]
Q2=[q2w,q2x,q2y,q2z]
Q1Q2=[q1w·q2w−q1x·q2x−q1y·q2y−q1z·q2z,
q1w·q2x+q1x·q2w+q1y·q2z−q1z·q2y,
q1w·q2y−q1x·q2z+q1y·q2w+q1z·q2x,
q1w·q2z+q1x·q2y−q1y·q2x+q1z·q2w]   Equation 2

A quaternion inverse is defined as:

Q1=[q1w,−q1x,−q1y,−q1z]  Equation 3


Sensor fusion will take measurements from various sensors, such as a gyroscope, an accelerometer and a compass then combine the measurements to determine the orientation of a device referenced to a fixed frame. Each sensor has good points and bad points when combining the data. A rate gyroscope (gyroscope hereafter) is good indicating how the orientation changes overtime without being affected by magnetic disturbance or acceleration. However, a gyroscope often has an offset which leads to angular drift over time. There are many methods of implementing the sensor fusion, but one common aspect of many of those is that the gyroscope data must be integrated. If a gyroscope sensor was perfect and integration was perfect, there would be no need for sensor fusion. However, sensors are not perfect and integration is not perfect, so other sensors are used to correct the orientation. One of the errors incurred, is integration of the gyroscope data. To lower the integration error, the gyroscope data is often integrated at a high rate. Typically a sensor fusion algorithm will take raw sensor data and compute an orientation. The method presented here is to integrate the gyroscope data on one processor then the integrated data is sent to a different processor to do the sensor fusion. When the integrated gyroscope data is sent to the second processor, the integrated gyro data rate can be less than the original gyroscope data rate. The processor doing the gyroscope data integration can be designed to take less power than the processor doing the sensor fusion. Sending the integrated gyroscope data at a lower data rate than the data rate of the gyroscope data has similar performance to sending the gyroscope data out at the original gyroscope data rate. Running sensor fusion at the integrated gyroscope data rate has similar performance to running sensor fusion at the gyroscope data rate. Lowering the sample rate reduces data traffic. Lowering the sensor fusion rate reduces computation. The gyroscope data is not required to be sent out for the sensor fusion, which leads to further data traffic reductions. Approximate gyroscope data can be computed from the integrated gyroscope data being sent out, by computing the derivate of the integrated gyroscope data. The estimate gyroscope data derived from taking the derivative of the integrated gyroscope data (LPQ) can be used for other algorithms such as determining the gyroscope data bias. Sending out integrated gyroscope data also allows a sensor with a gyroscope to output this integrated gyroscope data as an output, and have others write a sensor fusion algorithm using a reduced data rate. In one embodiment, the gyroscope integration will be done into a quaternion and can be done in software, firmware, or hardware on a separate device from the sensor fusion. In an embodiment of the invention, the gyroscope and the processor, performing the integration are in separate packages. In yet another embodiment of the invention, the gyroscope and the processor, performing the gyroscope integration, are in the same package or substrate.


There are several methods of integrating gyroscope data. Given angular velocity in radians/second in Equation 4 with magnitude ωm shown in Equation 5.

ω=[ωxyz]  Equation 4
ωm=√{square root over (ωx·ωxy·ωyz·ωz)}  Equation 5

a quaternion can be defined as shown in Equation 6.











Q
ω

_

=

[




cos


(


ω
m

·


Δ





t

2


)









ω
0


ω
m


·

sin


(


ω
m

·


Δ





t

2


)










ω
1


ω
m


·

sin


(


ω
m

·


Δ





t

2


)










ω
2



ω
m







·

sin


(


ω
m

·


Δ





t

2


)






]





Equation





6







Where Δt is time elapsed between time step M−1 and time step M. To integrate a quaternion using constant angular velocity from time step M−1 to time step M, the formula in Equation 7 is used.

QM=QM−1Qω  Equation 7

There are other approximations that can be used to integrate quaternion data such as:












Q
M

_

=



Q

M
-
1


_

+


t
2

·



Q

M
-
1


_



[



0





ω
x






ω
y






ω
z




]













Q
M

_

=



Q
M

_





Q
M

_









Equation





8







In Equation 8, the previous quaternion is multiplied by the rotation rate from the gyroscope (in radians) using a quaternion multiply. This is scaled by the time between samples over 2 and added to the previous quaternion. Next, the quaternion is divided by the magnitude to maintain a magnitude of 1. Note, optimizations that may be used would be to use raw gyroscope units and to scale by a constant that encompasses both the conversion to radians and the sample rate over 2. Other optimizations for the normalization to 1, would be to use a Taylor series to avoid the inverse square root. Furthermore, this could be converted to fixed point or integer math by one skilled in the art.


The gyroscope data typically has noise on it. Integrating noise on the gyroscope data will cause the quaternion to drift. To overcome this drift in a stationary position, the gyroscope data could be set to zero if the absolute value of the gyroscope data is below a threshold.


If the gyroscope bias is known, the gyroscope bias could be subtracted out of the gyroscope data before integrating the gyroscope data. This can be done in software, firmware or hardware.


With each sample of quaternion data that is received, independent of the rate at which the angular velocity was integrated at, an angular velocity bias can be removed even after the bias was integrated into the solution. A quaternion going from one time step to another can be modeled as Equation 9 where QA is the adjustment between time steps N and N−1. QA is independent upon the mechanism of going from QN to QN−1. This is similar to


Equation 7 and








Q
M

_

=



Q
M

_





Q
M

_









Equation 8 going from QM to QM−1 with a constant angular rate.

QN=QN−1QA  Equation 9


The next step is to maintain a unit quaternion variable with the gyroscope bias removed after the gyroscope bias has been integrated into the quaternion. After combining these ideas, Equation 10 shows how to remove a constant bias.

QBR,N=QBR,N−1QM−1′⊗QMQB′  Equation 10


Where QB′ is computed by plugging the gyroscope bias into Equation 6 and taking the inverse as shown in Equation 3. QBR,N is the quaternion with the gyroscope bias removed. To use the integrated gyroscope quaternion with another correction, a transformation between the quaternion result for sensor fusion and the integrated gyroscope quaternion as shown in Equation 10. The sensor fusion quaternion at time N, is shown as QF,N in Equation 11 where QC is the correction.

QF,N=QCQBR,N  Equation 11


After doing sensor fusion and updating QF,N, to the new time step, QF,N+1, a new conversion (QC) from the integrated gyroscope quaternion is computed and saved.

QC=QF,N+1QBR,N′  Equation 12


If the bias correction is done before integrated the gyroscope data into a quaternion, QB would be identity and could be simplified or ignored in all the equations presented. The equations would stay the same.


The basic idea presented so far has the quaternion integration starting from zero and sending out the quaternion referenced from that point. Instead, the starting point could be reset at each time output step so only the change from one time step to the next is sent out. This will simplify some of the equations. This change can be represented as QA in Equation 9. This would simplify Equation 10 into Equation 13 as follows:

QBR,N=QBR,N−1QAQB′  Equation 13


Further optimization would allow the quaternion integration change with bias correction to be applied directly to the sensor fusion quaternion.

QF,N=QF,N−1QAQB′  Equation 14


Similarly, the QB term could be simplified or ignored in both Equation 13 and Equation 14 as mentioned above, if the bias correction is done before integrating.


Noted, that while outputting the integration over one time step yields simpler equations, it is less immune to dropping samples. Often, if a system gets overloaded, samples could get lost, if the integration is done cumulatively across many samples, losing a sample would causes less error.


To further reduce the data traffic, it can be noted, that a quaternion has magnitude one, doing so would allow 3 components to be transferred across a data line, and to have the fourth element reconstructed. When trying to reconstruct the fourth element, there can be some sign ambiguity. To overcome the sign ambiguity, it is possible to force the sign of the missing component to have a known value. This is because in quaternion space, Q=−Q. For example, suppose, you want to send the last 3 elements and reconstruct the first element, then if the first element is negative, simply negate all the terms being sent across the data line. Then when reconstructing the first element, it would be known, that that element is always positive.


Other embodiments would include but not limited to other ways to pass information equivalent to quaternion data. As a quaternion represents an orientation in space, an orientation matrix or Euler angles could be substituted for the quaternion.


There are various ways to integrate a quaternion. Below is a description on quaternion integration along with new methods.


Zero'th Order Quaternion Integration:


Integrating a quaternion is equivalent to solving the corresponding first order ordinary differential equation:

{dot over (Q)}(t)=½Ω(ω)Q(t)  Equation 15

Where








Ω


(
ω
)


=

[



0



-

ω
x





-

ω
y





-

ω
z







ω
x



0



ω
z




ω
x






ω
y




-

ω
z




0



-

ω
y







ω
z




ω
y




-

ω
x




0



]


,





is a skew symmetric matrix. Assuming the angular velocity vector ω is constant between time t and t+Δt. The generalized solution to this differential equation is











Q
¯



(

t
+

Δ

t


)


=


e


1
2



Ω


(
ω
)



Δ





t





Q
¯



(
t
)







Equation





16







In order to calculate the above solution, the matrix exponent of the skew-symmetric matrix Ω has to be calculated. Calculating the exponent of a matrix numerically is very expensive. In real-time implementations, a simplified approximation is used, with the procedure:

ΔQ{dot over (Q)}(t)⊗Δt  Equation 17

Where (1) is used with a Forward Euler approximation, and

Q(t+Δt)=Q(t)+ΔQ  Equation 18











Q
_



(

t
+

Δ

t


)


=



Q
_



(

t
+

Δ

t


)






Q
_



(

t
+
Δt

)









Equation





19







In this approximation, the change in the quaternion is not computed in the rotation space, i.e. Equation 18 violates the rules of quaternion algebra. This causes small errors in the quaternion calculation, which can grow over time. In order to maintain an accurate quaternion with unit norm, the quaternion is re-normalized, as shown in the final step Equation 19.


An alternative method to compute Equation 16 more accurately is as follows. First, the matrix






e


1
2



Ω


(
ω
)



Δ





t






is expanded in a Taylor Series as follows:











e


1
2



Ω


(
ω
)



Δ

L


=


I

4

x

4


+


1
2



Ω


(
ω
)



Δ

t

+


1

2
!





(


1
2



Ω


(
ω
)



Δ

t

)

2


+


1

3
!





(


1
2



Ω


(
ω
)



Δ

t

)

3


+








Equation





20







Using the properties of the skew-symmetric matrix Ω(ω) and the Euler formula, as discussed in the reference “Matrix Mathematics: Theory, Facts, and Formulas”, Princeton University Press, Second Edition, 2009, by Dennis S. Bernstein, p. 741, exponents of skew-symmetric matrices can be rewritten as:










e


1
2



Ω


(
ω
)



Δ

t


=



cos


(



ω
m

2


Δ

t

)




I

4

x

4



+


1

ω
m




sin


(



ω
m

2


Δ

t

)




Ω


(
ω
)








Equation





21







Where ωm is the magnitude of the angular rate ω, as defined in ωm=√{square root over (ωx·ωxy·ωyz·ωz)} Equation 5. Then,











Q
_



(

t
+

Δ

t


)


=


(



cos


(



ω
m

2


Δ

t

)




I

4

x

4



+


1

ω
m




sin


(



ω
m

2


Δ

t

)




Ω


(
ω
)




)




Q
_



(
t
)







Equation





22







Close inspection of Eqn. Equation 22 reveals that this matrix-vector multiplication is equivalent to a quaternion multiplication:











Q
_



(

t
+

Δ

t


)


=



[




cos


(



ω
m

2


Δ

t

)








ω

ω
m




sin


(


ω

ω
m



Δ





t

)






]




Q
_



(
t
)



=

Δ



Q
_




Q
_



(
t
)









Equation





23







Where







Δ


Q
_


=

[




cos


(



ω
m

2


Δ

t

)








ω

ω
m




sin


(


ω

ω
m



Δ





t

)






]






is the 4×1 quaternion that represents the quaternion rotation induced by the angular velocity co over time span Δt. Comparing this with Equation 18, it is noted that the formula in Equation 23 is exact, and it preserves the quaternion norm, i.e. no re-normalization of the quaternion is necessary.


Note that for very small angular velocity ω, the above expression can cause numerical instability. In this case, a first order approximation of Equation 21 can be used:













lim





ω

0






e


1
2



Ω


(
ω
)



Δ





t



=


I

4

x

4


+


1
2



Ω


(
ω
)



Δ

t






Equation





24








First Order Quaternion Integration:


The zero'th order quaternion integration assumes that the angular velocity ω is constant over the period Δt. A better and more accurate integration can be derived if the angular velocity is assumed to be evolving linearly over the time Δt. For this purpose, ω(tk) is introduced for the value of velocity ω at time tk, and ω(tk+1) for ω at time tk+1, with Δt=tk+1−tk.


The average angular velocity over the time Δt is:

ω=½(ω(tk+1)+ω(tk))  Equation 25


Also, define the derivative of the angular velocity as {dot over (ω)}. The corresponding matrix Ω({dot over (ω)}), in the linear case, is constant:










Ω


(

ω
.

)


=

Ω


(



ω


(

t

k
+
1


)


-

ω


(

t
k

)




Δ

t


)






Equation





26







And the higher order derivatives are zero due to the assumption of linearly changing angular velocity ω. In the following, Ω(ω) is represented as Ω, and Ω({dot over (ω)}) as {dot over (Ω)}, for conciseness. As described in the publication “Spacecraft Attitude Determination and Control”, edited by J. R. Wertz, D. Reidel Publishing Co., Dordrecht, The Netherlands, 1978, p. 565, Eqn. (17-21)] in order to derive the higher order quaternion derivative expression, the Taylor series expansion of the quaternion is done at time instant tk+1 in terms of the quaternion and its derivatives at time tk is as follows:











Q
¯



(

t

k
+
1


)


=



[


I

4

x

4


+


1
2


Ω

Δ

t

+


1

2
!





(


1
2


Ω

Δ

t

)

2


+


1

3
!





(


1
2


Ω

Δ

t

)

3


+


]




Q
¯



(

t
k

)



+


1
4




Ω





.


Δ






t
2




Q
¯



(

t
k

)



+


[



1

1

2




Ω
.






Ω

+


1

2

4



Ω






Ω
.



]




Q
¯



(

t
k

)



+






Equation





27







Using the fact that










Ω


(

ω
.

)


=


Ω


(



ω


(

t

k
+
1


)


-

ω


(

t
k

)




Δ

t


)


=


1

Δ

t




[


Ω


(

ω


(

t

k
+
1


)


)


-

Ω


(

ω


(

t
k

)


)



]







Equation





28







Ω(ω) can be written as:

Ω(ω)=Ω=½[Ω(ω(tk+1))+Ω(ω(tk))]=Ω(ω(tk))+½Ω({dot over (ω)}(tk))Δt=Ω+½{dot over (Ω)}Δt   Equation 29


Using Equation 29 the terms in Equation 27 can be rearranged as follows (Eqn. (17-23 in Wertz)):











Q
_



(

t

k
+
1


)


=



[


I

4
×
4


+


1
2



Ω
_






Δ





t

+


1

2
!





(


1
2



Ω
_






Δ





t

)

2


+


1

3
!





(


1
2



Ω
_






Δ





t

)

3


+


]




Q
_



(

t
k

)



+



1
48



[


(



Ω
.






Ω

-

Ω






Ω
.



)


Δ






t
3


]





Q
_



(

t
k

)








Equation





30







The first of the two terms on the right-hand side of Equation 30 is similar to the Taylor Series expansion of Equation 16, and thus has the same form. Note that this differs from Equation 16 in using time-averaged rate information rather than instantaneous rates. The second term with the derivatives of the angular rate can be expanded using Equation 26. This gives:










Q


(

t

k
+
1


)


=


[


e


1
2



Ω


(

ω
_

)



Δ





t


+


1

4

8




(



Ω


(

ω


(

t

k
+
1


)


)




Ω


(

ω


(

t
k

)


)



-


Ω


(

ω


(

t
k

)


)




Ω


(

ω


(

t

k
+
1


)


)




)


Δ






t
2



]




Q
¯



(

t
k

)







Equation





31







In order to simplify the expression in Equation 30, the following is noted.


First, form the cross product of the angular velocities ω(tk) and ω(tk+1):

ωΔ=ω(tk)×ω(tk+1)  Equation 32


For the second expression in Equation 31 the following holds:

Ω(ωΔ)=2Ω(ω(tk+1))Ω(ω(tk))−Ω(ω(tk))Ω(ω(tk+1))  Equation 33


i.e. the skew-symmetric form of ωΔ is the same as the right hand side of Equation 33. This can be verified by expanding the terms and comparing the elements. Introducing Equation 32 and Equation 33 into Equation 31, the following is derived:











Q
¯



(

t

k
+
1


)


=


[


e


1
2



Ω


(

ω
_

)



Δ





t


+


1

2

4




Ω


(

ω
Δ

)



Δ


t
2



]




Q
¯



(

t
k

)







Equation





34







It is noted that the second term of Equation 34, can be rewritten as:











Ω


(

ω
Δ

)





Q
¯



(

t
k

)



=



[



0





ω

Δ

x







ω

Δ

y







ω

Δ

z





]




Q
¯



(

t
k

)



=



Q
¯



(

ω
Δ

)





Q
¯



(

t
k

)








Equation





35







Comparing the above with Equation 20-Equation 23, the following can be derived:

Q(tk+1)=ΔQ⊗q(tk)+ 1/24Δt2QΔ)⊗Q(tk)  Equation 36


Where







Δ


Q
¯


=

[




cos


(




ω
m

_

2


Δ





t

)









ω
_



ω
m

_




sin


(




ω
m

_

2


Δ





t

)






]






is the 4×1 quaternion that represents the quaternion rotation induced by the average angular velocity ω over time span Δt. Next, simplifying the expression results in the following:

Q(tk+1)=(ΔQ+ 1/24Δt2QΔ))⊗Q(tk)=ΔQ(ωΔ)⊗Q(tk)  Equation 37


Note that the term (ΔQ+ 1/24Δt2QΔ)) needs to be normalized.


To summarize, the computational steps for the first order quaternion integration are as follows:


Calculate ω=½(ω(tk+1)+ω(tk))


Calculate quaternion







Δ


Q
¯


=

[




cos


(




ω
m

_

2


Δ





t

)









ω
_



ω
m

_




sin


(




ω
m

_

2


Δ





t

)






]





Calculate








ω
Δ

=


ω


(

t
k

)


×

ω


(

t

k
+
1


)




,


and







Q
¯



(

ω
Δ

)



=

[



0





ω

Δ

x







ω

Δ

y







ω

Δ

z





]






Calculate quaternion ΔQ(ωΔ)=ΔQ+ 1/24Δt2QΔ) and normalize ΔQ(ωΔ)


Calculate Q(tk+1)=ΔQ(ωΔ)⊗Q(tk).


A computationally simpler version of the first order quaternion integration is as follows: Given angular rates ω(t−Δt), ω(t), at time instants t and t−Δt, and the current quaternion Q(t), define ω as in Equation 25, and ωΔ as in Equation 32.








Let







Q
_


ω
_



=

[



0






ω
_

x







ω
_

y






ω
z




]


,


and







Q
_


ω
Δ



=


[



0





ω

Δ
x







ω

Δ
y







ω

Δ
z





]

.







Then, compute:

ΔQ=Q(t)⊗(½Δt*Qω+ 1/24Δt2*QωΔ)   Equation 38

and, as in Equation 39 the quaternion is computed and normalized with:









Q
¯



(

t
+

Δ

t


)


=



Q
¯



(
t
)


+

Δ


Q
¯












Q
¯



(

t
+

Δ

t


)


=



Q
¯



(

t
+

Δ

t


)






Q
¯



(

t
+

Δ

t


)










Although the description has been described with respect to particular embodiments thereof, these particular embodiments are merely illustrative, and not restrictive.


As used in the description herein and throughout the claims that follow, “a”, “an”, and “the” includes plural references unless the context clearly dictates otherwise. Also, as used in the description herein and throughout the claims that follow, the meaning of “in” includes “in” and “on” unless the context clearly dictates otherwise.


Thus, while particular embodiments have been described herein, latitudes of modification, various changes, and substitutions are intended in the foregoing disclosures, and it will be appreciated that in some instances some features of particular embodiments will be employed without a corresponding use of other features without departing from the scope and spirit as set forth. Therefore, many modifications may be made to adapt a particular situation or material to the essential scope and spirit.

Claims
  • 1. A device comprising; a first processor configured to receive sensor measurement data at a first data rate from one or more sensor devices including a gyroscope, the sensor measurement data including raw gyroscope data sensed by the gyroscope and representing angular velocity of a device in motion, the first processor further configured to perform a quaternion operation on the sensor measurement data at the first data rate to generate sensor data and to transmit the sensor data at a second data rate, the sensor data representing a change in the motion of the device,wherein the second data rate is lower than the first data rate,wherein the quaternion operation includes integration of the raw gyroscope data at the first data rate;a second processor configured to: receive the sensor data transmitted at the second data rate,perform sensor fusion on the sensor data to generate processed sensor data, andto transmit the processed sensor data to a third processor at a third data rate,wherein the second data rate being lower than the first data rate causes a reduction in data traffic and necessitates fewer computations, than if the sensor data were received at the first data rate performed by the second processor, thereby reducing power consumption and allowing the use of the sensor data with various sensor fusion algorithms.
  • 2. The device of claim 1, wherein during a dead zone, a set of sampled raw gyroscope data of the raw gyroscope data is close to a value of zero causing corresponding integration data from the integration to have a common value.
  • 3. The device of claim 1, wherein the integration is performed on the raw gyroscope data, sampled after a predetermined number of samples of the raw gyroscope data are received by the first processor and the integration continues over a predetermined time period after the integration of the predetermined number of samples of the raw gyroscope data begins.
  • 4. The device of claim 1, wherein the sensor measurement data further includes accelerometer data sensed by an accelerometer and received by the first processor, wherein the accelerometer data represents sensed acceleration of the device.
  • 5. The device of claim 4, wherein the accelerometer data is transmitted to the second processor at the second data rate for performing sensor fusion.
  • 6. The device of claim 1, wherein the sensor measurement data further includes magnetometer data sensed by a magnetometer and received by the first processor, wherein the magnetometer data represents a sensed orientation of the device.
  • 7. The device of claim 6, wherein the magnetometer data is transmitted to the second processor at the second data rate for performing sensor fusion.
  • 8. The device of claim 1, wherein the first processor is further configured to receive a requested data rate and in response to the requested data rate, the first processor is configured to utilize an output of the first processor to determine the data rate being requested.
  • 9. The device of claim 1, wherein the third data rate is equal to or lower than the second data rate.
  • 10. The device of claim 1, wherein the first processor is a motion processing unit (MPU) and the second processor is a Micro Controller Unit (MCU).
  • 11. The device of claim 1, wherein the third processor is an applications processor.
  • 12. The device of claim 1, wherein the second processor is configured to transmit a request for the second data rate to the first processor.
  • 13. A method comprising: at a first processor: receiving sensor measurement data at a first data rate from one or more sensor devices including a gyroscope, the sensor measurement data including raw gyroscope data sensed by the gyroscope and representing angular velocity of a device in motion;performing a quaternion operation on the sensor measurement data at the first data rate to generate sensor data;transmitting the sensor data at a second data rate, the sensor data representing a change in the motion of the device,wherein the second data rate is lower than the first data rate, andfurther wherein the quaternion operation includes integration of the raw gyroscope data at the first data rate;at a second processor: receiving the sensor data transmitted at the second data rate;generating processed sensor data;transmitting the processed sensor data to a third processor at a third data rate,wherein the second data rate being lower than the first data rate causes a reduction in data traffic and necessitates fewer computations, than if the sensor data were received at the first data rate performed by the second processor, thereby reducing power consumption and allowing the use of the sensor data with various sensor fusion algorithms.
  • 14. The method of claim 13, wherein during a dead zone, a set of sampled raw gyroscope data of the raw gyroscope data is close to a value of zero causing corresponding integration data from the integration to have a common value.
  • 15. The method of claim 13, further comprising: performing the integration on the raw gyroscope data, sampled after a predetermined number of samples of the raw gyroscope data are received by the first processor,wherein the integration continues over a predetermined time period after the integration of the predetermined number of samples of the raw gyroscope data begins.
  • 16. The method of claim 13, wherein the sensor measurement data further includes accelerometer data sensed by an accelerometer and the method further comprises receiving the sensor measurement data, at the first processor, wherein the accelerometer data represents sensed acceleration of the device.
  • 17. The method of claim 13, wherein the sensor measurement data further includes magnetometer data sensed by a magnetometer and the method further comprises receiving the sensor measurement data at the first processor, wherein the magnetometer data represents a sensed orientation of the device.
  • 18. The method of claim 13, wherein generating the processed sensor data comprises performing, at the second or the third processors, sensor fusion on the sensor data.
  • 19. The method of claim 13, wherein the third data rate is equal to or lower than the second data rate.
  • 20. The method of claim 13, further including the second processor transmitting a request for the second data rate to the first processor.
  • 21. A system comprising; a sensor processor configured to receive sensor measurement data at a first data rate from one or more sensor devices including a gyroscope, the sensor measurement data including raw gyroscope data sensed by the gyroscope and representing angular velocity of a device in motion, the sense processor further configured to perform a quaternion operation on the sensor measurement data at the first data rate to generate sensor data and to transmit the sensor data at a second data rate, the sensor data representing a change in the motion of the device,wherein the second data rate is lower than the first data rate,wherein the quaternion operation includes integration of the raw gyroscope data at the first data rate;a processor configured to: receive the sensor data transmitted at the second data rate,perform sensor fusion on the sensor data to generate processed sensor data, andto transmit the processed sensor data to an application processor at a third data rate,wherein the second data rate being lower than the first data rate causes a reduction in data traffic and necessitates fewer computations, than if the sensor data were received at the first data rate performed by the processor thereby reducing power consumption and allowing the use of the sensor measurement data with various sensor fusion algorithms.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. application Ser. No. 16/372,238 filed on Apr. 1, 2019, titled “Method to Reduce Data Rates and Power Consumption Using Device Based Attitude Generation”, by Keal et al., which is a continuation of U.S. patent application Ser. No. 14/194,799, filed on Mar. 2, 2014, now U.S. Pat. No. 9,880,185, titled “Method to Reduce Data Rates and Power Consumption Using Device Based Attitude Generation”, by Keal et al., which is a continuation of U.S. patent application Ser. No. 13/965,131, filed on Aug. 12, 2013, now U.S. Pat. No. 10,247,748, titled “Method to Reduce Data Rates and Power Consumption Using Device Based Attitude Generation”, by Keal et al., which claims priority to U.S. Provisional Application No. 61/786,414 filed on Mar. 15, 2013, titled “Method to Reduce Data Rates and Power Consumption Using Device Based Axis Quaternion Generation”, by Keal et al., the disclosures of which are incorporated herein by reference as though set forth in full.

US Referenced Citations (27)
Number Name Date Kind
4338818 Hill Jul 1982 A
5871517 Abrams Feb 1999 A
7104129 Nasiri Sep 2006 B2
7216055 Horton May 2007 B1
7932570 Eskridge May 2011 B1
8362949 Yang Jan 2013 B2
9880185 Keal Jan 2018 B2
10247748 Keal Apr 2019 B2
20050251328 van der Merwe Nov 2005 A1
20070032951 Tanenhaus Feb 2007 A1
20090184849 Nasiri Jul 2009 A1
20100121227 Stirling May 2010 A1
20110157318 Nalibotski Jun 2011 A1
20110270554 Hsieh Nov 2011 A1
20120053869 Owen Mar 2012 A1
20120065883 Williamson Mar 2012 A1
20120084050 Sato Apr 2012 A1
20120148113 Fraisse Jun 2012 A1
20120209555 Tang Aug 2012 A1
20120221244 Georgy Aug 2012 A1
20120326922 Yang Dec 2012 A1
20130103344 Bye Apr 2013 A1
20130158928 Hodgal Jun 2013 A1
20130211711 Kelly Aug 2013 A1
20140081592 Bellusci Mar 2014 A1
20140278215 Keal Sep 2014 A1
20190227093 Keal Jul 2019 A1
Foreign Referenced Citations (1)
Number Date Country
10-0643400 Nov 2006 KR
Non-Patent Literature Citations (3)
Entry
Wertz and Members of the Technical Staff Attitude Systems Operation Computer, Sciences Corporation, “Spacecraft Attitude Determination and Control”, Kluwer Academic Publishers (1978).
Bernstein, Dennis, “Matrix Mathematics Theory, Facts, and Formulas”, Princeton University Press, Princeton and Oxford (2009).
Blyth, Russel. “http://www.mathmistakes.info/facts/CalculusFacts/learn/doi/doi.html”, Derivative of an Integral (Fundamental Theorem of Calculus), Copyright © 2006-2008.
Related Publications (1)
Number Date Country
20210025914 A1 Jan 2021 US
Provisional Applications (1)
Number Date Country
61786414 Mar 2013 US
Continuations (3)
Number Date Country
Parent 16372238 Apr 2019 US
Child 17071782 US
Parent 14194799 Mar 2014 US
Child 16372238 US
Parent 13965131 Aug 2013 US
Child 14194799 US