The present invention relates to a camera body with mechanical FMC stabilization for an airborne or spaceborne surveying device and to such a surveying device itself.
EP 1 570 314 B1 is showing an exemplary camera module according to the art and a flying apparatus with such camera module. These kind of cameras are used to survey swathes of land by capturing photos of the earth surface underneath the aircraft. Due to small GSD (ground sampling distance), high flying speeds, the requirement to also survey at low light conditions and resulting relatively high exposure times, such cameras need an appropriate image stabilization, which is usually called forward motion compensation (FMC) in the art. With a stabilisation speed, which is a function of the current flight speed and the GSD, the camera or part thereof is, during the exposure time, moved essentially parallel to the flight direction in order to provide image data without forward motion blur. Typically, these kind of camera systems are operated with a gyro stabilized mount, to compensate for aircraft drift angles, and blur caused by aircraft vibrations and angular motion.
However, a downside of available mechanical solutions is a large construction of the involved FMC components, resulting in a large camera body size, which limits the usage in a size constrained application. Software solutions are not as performant and/or are extremely computation intensive.
Therefore, the invention provides an improved camera body and surveying device with a more compact design and lower mass inertia. A camera body and surveying device according to the invention allows for a reduced number of involved components, a lighter and smaller construction, and faster reaction times. In other words, the present invention provides a compact camera body with a mechanical FMC to allow compact integration in a multi-camera hybrid system.
The invention relates to a camera body for an airborne or spaceborne surveying device adapted to be mounted on an aircraft or satellite and to survey the earth surface, the camera body comprising an optics interface configured for receiving projection optics, a holder coupled with the optics interface, a sensor arranged on the holder and configured for being movable relative to the optics interface along a stabilisation axis, the stabilisation axis to be aligned with a movement direction of the aircraft or satellite relative to the earth surface, circuitry connected to the sensor and configured for generating surveying data, the holder comprising a first frame and a first movable part that is connected to the first frame via a first solid-state joint, the sensor arranged on the first movable part, the first solid-state joint configured for providing a movability of the first movable part relative to the first frame along the stabilisation axis, a motor having a mover and a stator, the motor connected to the circuitry, the mover operatively linked with the first movable part, and the stator fixedly arranged relative to the first frame.
In embodiments, the mover is a rotor and the camera body further comprises an eccentric element connected to the rotor, the rotor is operatively linked with the first movable part via the eccentric element the motor is configured for rotating the eccentric element, and the circuitry is configured for moving the sensor along the stabilisation axis by controlling the motor.
In embodiments, the eccentric element, the motor, and the circuitry are configured in such a way that the first movable part is movable forth and back along the stabilisation axis by at least ±50 μm. This range is typical and translates to about +−10 pixels, depending on the sensor technology.
In embodiments, the first movable part comprises a second frame and a second movable part that is connected to the second frame via a second solid-state joint, the sensor fixedly arranged relative to the second frame, the second solid-state joint configured for providing a movability of the second movable part relative to the second frame in a direction perpendicular to the stabilisation axis, and the eccentric element operatively linked with the second movable part.
In embodiments, the first frame surrounds the first movable part.
In embodiments, the circuitry is configured for generating the surveying data by controlling an exposure of the sensor, an exposure time is between 0.5 and 40 ms, in particular between 1 and 20 ms, and the eccentric element, the motor, and the circuitry are configured in such a way that the first movable part is movable, during the exposure time, with a stabilisation speed along the stabilisation axis, the stabilisation speed being at least nearly constant during the exposure time.
In embodiments, the circuitry is configured for determining the stabilisation speed based on (a) a height of the aircraft or satellite above the earth surface, (b) a velocity of the aircraft or satellite relative to the earth surface, the circuitry particularly being configured for receiving the velocity, and (c) a focal length of projection optics received by the optics interface, in particular and an alignment of the camera body relative to the earth surface.
In embodiments, the holder comprises a plate, and the first solid-state joint and/or the second solid-state joint formed by channels incorporated into the plate.
In embodiments, the channels forming at least one elastic zone (22) connecting the respective frame with the respective movable part, and the elastic zone having an elastic deformability significantly higher than the rest of the plate.
In embodiments, the motor is a stepper motor, a brushless DC motor, a linear motor, or a voice coil linear motor.
In embodiments, the camera body comprises an encoder configured for detecting a position of the first movable part relative to the first frame. This position can be used to enhance the geometric precision of the camera, while using the exact position of the FMC device at the exposure time.
In embodiments, the sensor is a CCD image sensor, a CMOS image sensor, a TOF sensor, or a thermal infrared sensor.
The invention further relates to an airborne or spaceborne surveying device adapted to be mounted on an aircraft or a satellite and to survey the earth surface, comprising at least one camera with projection optics and a camera body according to the description herein.
In embodiments, the surveying device comprises a LiDAR module for measuring distances to the earth surface, and the sensor of the at least one camera is a CCD sensor, a CMOS sensor, or an infrared sensor. The LiDAR module itself is to be considered comprising a TOF sensor.
In embodiments, the surveying device comprises six cameras, two cameras are aligned at least nearly towards Nadir, and four cameras are obliquely aligned with respect to Nadir.
Of course, the surveying device can be adapted to have any amount of such cameras according to the invention. As well, the cameras can be provided in any combination of LiDAR camera(s), RGB camera(s), and thermal camera(s). Oblique is to be understood as deviating from Nadir in an angle of between 1° and 45°.
By way of example only, preferred embodiments of the invention will be described more fully hereinafter with reference to the accompanying figures, wherein:
The camera of surveying device 1 further comprises a telephoto lens (projection optics) in order to enlarge depiction of the earth surface 3 and provide the field of view 5. Due to relatively long exposure times, the long focal distance, and the high speed of the aircraft, the surveying device 1 is reliant on a forward motion compensation (FMC).
The camera body and/or the surveying device according to the invention serves this purpose while allowing for a very compact and stiff construction. Further, the invention provides improvement of the surveying data generation because a high resolution of the sensor (up to 150 Megapixels and more) requires an extremely precise positioning of the FMC.
A second exemplary field of use is shown in
The shown configuration with two solid-state joints has the extra advantage that the system is even stiffer and more robust against incorrect positioning of the sensor due to vibrations or shocks, especially when the motor is not activated. However, to carry out the invention, the second solid-state joint is not necessarily required as well as the drive containing the eccentric element. The first solid-state joint 14 is designed such that only or essentially only the straight movement along the stabilisation axis is allowed. The second solid-state joint 18 can be provided to compensate for the lateral movements of the eccentric element 20. In particular, the first movable part 16 has a recess 23 wherein the motor or the rotor or the elements attached to the rotor is at least in part incorporated in the recess.
The circuitry can comprise not only the part 24 but also at least one further component, which is e.g. external to the camera body. The term circuitry as used herein can be understood in at least some embodiments as a computing system which can comprise one or more components. The circuitry 24 is connected to the sensor 18 so as to generate, and optionally also (pre-)process in particular with further circuitry external to the camera body, the surveying data. Since the sensor 18 can be an image sensor, such as CCD or CMOS sensor, a TOF sensor, or an infrared sensor, the surveying data can accordingly be b/w or colour images, reception pulses in particular with time stamp and/or the wave form, or thermal images. If the sensor is a TOF sensor, a surveying device according to the invention also comprises an emitter to send out the pulses of which the reflections are received by the TOF sensor, and in particular a clock to produce respective time stamps (of transmittal and arrival).
The circuitry (the element 24 or some other element belonging to the circuitry) is connected to the motor, and in particular configured for positioning the sensor along the stabilisation axis by controlling the motor. More specifically, in the shown embodiment, the eccentric element, the motor, and the circuitry are configured in such a way that the first movable part is movable forth and back along the stabilisation axis by at least ±50 μm. The motion must be extremely smooth and precise, to support sensor pixel sizes in the range of down to about 3 μm. The circuitry is, in embodiments, configured for generating the surveying data by controlling an exposure of the sensor, wherein an exposure time is between 0.5 and 40 ms, in particular between 1 and 20 ms, and wherein the eccentric element, the motor, and the circuitry are configured in such a way that the first movable part is movable with a stabilisation speed during the exposure time in a direction parallel to the flight direction. The stabilisation speed can be dimensioned by the circuitry based on a height of the aircraft or satellite above the earth surface, a velocity of the aircraft or satellite relative to the earth surface, and a focal length of projection optics received by the optics interface, in particular wherein the circuitry is configured for receiving the velocity, i.e. a value thereof. The sensor may be soldered onto the circuitry, in particular wherein the circuitry itself can also be soldered onto the first movable part.
The movement of the first movable part is following the movement of the eccentric element 20 in the directional component along the stabilisation axis. Due to the rotation, this movement follows a sine which means that at the reversal points there is a standstill towards which the movement of the first movable part is slowing down and from which it is accelerating again. These decelerating/accelerating areas are surrounding a range in which the first movable part is moving with a speed that is almost constant. When the first movable part 16, and with it the sensor 18, is moving in that range of almost constant speed, this piece of the movement (stabilisation speed) can be used for the FMC. There can either be a predetermined correlation between the current position of the rotor 19 and the current position of the first movable part, or the camera body or surveying device according to the invention may additionally comprise a positional encoder 27 for detecting a current position of the first movable part 16.
In any case, the circuitry 24 is configured to control the sensor 18 to sample the light from the earth surface during the above described range where the first moveable part 16 is travelling with the stabilisation speed, which is nearly constant. During the exposure time, the sensor is moving with this speed and avoids blur in the surveying data. The sensor 18 can in some embodiments also comprise a shutter, wherein for controlling the exposure of the sensor, the shutter can be controlled by the circuitry.
The invention allows for an extraordinarily compact construction and in particular in a very stiff one. The motor 17 can be chosen to be a flat motor that is particularly (at least in part) embedded into the FMC on the other (with respect to the sensor 18) side of the holder 13. The construction has, compared to generic devices known from prior art, an increased stability, stiffness and precision. This space-saving design is especially desirable when an airborne or spaceborne surveying device comprises more than one camera, in particular six cameras and/or further comprising a LiDAR system.
A camera comprises a camera body and projection optics.
Key:
Although the invention is illustrated above, partly with reference to some preferred embodiments, it must be understood that numerous modifications and combinations of different features of the embodiments can be made. All of these modifications lie within the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
20177489 | May 2020 | EP | regional |
Number | Name | Date | Kind |
---|---|---|---|
8548313 | Krueker | Oct 2013 | B2 |
10893200 | Ba-Tis | Jan 2021 | B2 |
11378398 | Hornung | Jul 2022 | B2 |
20090309982 | Rouvinen | Dec 2009 | A1 |
20100079101 | Sidman | Apr 2010 | A1 |
20110217029 | Wu | Sep 2011 | A1 |
20120082441 | Krueger | Apr 2012 | A1 |
20180079529 | Saika | Mar 2018 | A1 |
20180171991 | Miller | Jun 2018 | A1 |
20180346148 | Zhang | Dec 2018 | A1 |
20190174036 | Okutani | Jun 2019 | A1 |
20190379268 | Adams | Dec 2019 | A1 |
Number | Date | Country |
---|---|---|
110850429 | Feb 2020 | CN |
1 570 314 | Sep 2005 | EP |
Entry |
---|
European Search Report dated Jan. 21, 2021 as received in U.S. Appl. No. 20/177,489. |
Number | Date | Country | |
---|---|---|---|
20220053135 A1 | Feb 2022 | US |