This application is the U.S. National Phase under 35 U.S.C. §371 of International Application No. PCT/EP2010/069272 filed on Dec. 9, 2010, which in turn claims the benefit of European Application No. 09306239.6, filed on Dec. 15, 2009, the disclosures of which Applications are incorporated by reference herein.
The present invention relates to a method and a device for measuring the angular position of a substantially rectilinear contrasting edge of an object and to a system for fixing and tracking a target comprising at least one such contrasting edge. For example, the object is a picture or a landscape having a contrasting edge.
In particular, such systems for acquiring and tracking a target are used in microrobotics for the development of automatic flight control systems. For example, OSCAR (for Optical Scanning sensor for the Control of Autonomous Robots) gives a tethered aerial robot (the OSCAR Robot) the ability to fixate and track a target with a high level of accuracy, as described by S. Viollet and N. Franceschini in the article “Super-accurate Visual Control of an Aerial Minirobot”, a part of the Conference on Autonomous Minirobots for Research and Edutainment, AMIRE, Paderborn, Germany, 2001, pp. 215-224, ISBN 3-935433-06-9. The published article is designated A1.
Such method, device and system are described in patent document FR 2 869 494 (PCT: WO 2005/111536 A1). In particular, patent document FR 2 869 494 describes a method for detecting a contrasting edge having a luminance transition zone which is substantially rectilinear in a given direction and separating two regions of different luminances. This method is based on two optical sensors mounted behind a lens, their optical axes being separated by a small angle Δφ, the “angular pitch”, which is also called the inter-receptor angle.
This method consists in:
The periodic positional scanning is carried out, for example, by relative translation of the assembly formed by the two optical sensors in another direction, transverse to the given direction. But in FR 2869494 the vibrational law must be periodic and non-uniform for at least a portion of each period. Thus, the measurement of the time difference strongly depends on the vibrational law whose conformity has to be reproducible from one period to another.
The aim of the invention is to simplify the overall system. The signal processing according to the present invention allows for an increased precision in angular localization, while using a vibrational law that can be random and of very small amplitude. Scanning can therefore be achieved by using angular vibrations intrinsic to the machine or vehicle onto which the device is mounted, eliminating the need for an additional scanning actuator. Alternatively, scanning can simply result from the translational vibration of the luminance transition zone itself in front of the stationary device.
Therefore, the invention relates to a method for measuring the angular position of a contrasting edge of an object having a luminance transition zone which is substantially rectilinear in a given direction and separates two regions of different luminances, characterized in that it comprises at least the functional steps of:
In other embodiments, the method for measuring the angular position comprises one or several of the following features, taken in isolation or in any technically feasible combination:
The invention also relates to a device for measuring the angular position of a contrasting edge of an object having a luminance transition zone which is substantially rectilinear in a given direction, the device comprising at least a first and a second optical sensor having an inter-receptor angle (Δφ) delimited by the optical axes (O1Y1, O2Y2) of the first and second optical sensors, and the inter-receptor angle (Δφ) containing the object with the luminance transition zone, the device being characterized in that it further comprises:
In other embodiments, the device for measuring the angular position comprises one or several of the following features, taken in isolation or in any technically feasible combination:
The invention also relates to a set of devices for measuring the angular position characterized in that it comprises at least one lens, at least three optical sensors and a plurality of detection circuits, each pair of two consecutive optical sensors being placed close to the focal plane of one of the at least one lens and connected to one of the plurality of detection circuits; in that one device is formed by a pair of two optical sensors, one of the at least one lens and one detection circuit according to the invention; and in that each lens of the at least one lens and each optical sensor are arranged substantially on a spherical, cylindrical or curved surface surrounding at least one local common centre, the at least one local common centre constituting the optical centre of an inter-receptor angle (Δφ) which is the sum over all inter-receptor angles (Δφi) of each of the devices taken together.
In other embodiments, the set of devices for measuring the angular position comprises one or several of the following features, taken in isolation or in any technically feasible combination:
The method and device for measuring the angular position of a contrasting edge, according to the present invention, are used for industrial, noncontact and high accuracy measurements of the angular position of a contrasting edge. They are also used for industrial implementation of systems for fixating and fine tracking a target having at least one contrasting edge, in which a method for compensating for the line of sight akin to the VOR (for Vestibulo Ocular Reflex) process of human sight can be employed, owing (a) to the high precision and high speed of this method and this device and (b) to the high miniaturization and extreme lightness of this device, whose very low inertia permits such implementation in a particularly noteworthy manner.
The invention also relates to a steering aid system for the visual fixation and fine tracking of a target, the target being an object comprising at least one contrasting edge having a luminance transition zone which is substantially rectilinear in a given direction and for controlling the angular speed of an aircraft, characterized in that it comprises:
The invention will be better understood from the description below, which is provided solely by way of example and which refers to the drawings, wherein:
A more detailed description of the method and the device for measuring the angular position of a contrasting edge, which is substantially rectilinear in a given direction, according to the present invention, will now be given with reference to the
Referring to
In reference to
In a non-limiting embodiment, this inter-receptor angle Δφ is determined by a convex lens L, as shown in
The angular position of the contrasting edge E relative to a reference direction lying within the inter-receptor angle Δφ is denoted by ψC. The reference direction is advantageously the direction MOY12 substantially corresponding to the average direction of the bisector between the optical axes O1Y1 and O2Y2 of the first and second optical sensors D1, D2.
In a preferred non-limiting embodiment, the first and the second optical sensors D1 and D2 are each formed by a photoelectric receiver such as a photoelectric diode, whose spectral sensitivity can be selected in the spectral range of visible or ultraviolet light or, alternatively, in the range of near or far infrared radiation—for example for nocturnal or all-weather conditions.
The wavelength of maximum sensitivity of the aforementioned photodiodes can thus be chosen in dependence of the specific application of the device for measuring the angular position of a contrasting edge E according to the present invention.
Furthermore, the device comprises a means 1 (see
The given direction, which is substantially parallel to the Z axis, and the transverse direction are different, preferably orthogonal to each other.
Moreover, according to a particularly noteworthy aspect of the device and the method according to the invention, the vibrational law of the optical axes of the first and second optical sensors can be indifferent, aperiodic, unknown and even random without affecting the precision of the angular localization of the contrasting edge.
In
Some examples of the means of translation 4 for generating a translational displacement of the group G are shown and described in patent document FR 2 869 494 (PCT: WO 2005/111536 A1). In these examples, however, the vibrational law is always limited to a periodic vibrational law.
Moreover, the device for measuring the angular position of the contrasting edge according to the invention comprises a detection circuit 20 (see
The detection circuit 20 comprises a pair of band-pass filters 22, each of which is connected to an optical sensor, D1 or D2, in order to calculate the differentiated signals, denoted by Ph1′ and Ph2′, of the first and second optical sensors, respectively.
Moreover, the detection circuit comprises a calculator 24 for calculating an output signal Yout and the angular position ψC of the contrasting edge E depending on the output signal Yout.
Furthermore the detection circuit 20 comprises advantageously a pair of demodulators 26 connected between the band-pass filters 22 and the calculator 24, in order to demodulate the signals delivered by the first and the second optical sensors D1, D2 before calculating the output signal Yout and the angular position ψC. The demodulation of these two signals allows one to extract the information of amplitude of these two signals from noise. The amplitude of the differentiated signals is determined using the pair of demodulators 26. The demodulated signals are then used for the calculation of the output signal Yout.
Three techniques of amplitude demodulation, adapted to three different situations, make it possible to extract the amplitude of the two signals in a robust way. A more detailed description of these techniques and the corresponding demodulators 26 will be given later.
A more detailed description of the method for measuring the angular position of the contrasting edge according to the present invention will now be given.
The lens L placed in front of the two optical sensors confers them a given angular sensitivity. The angular sensitivity function is a bell-shaped (Gaussian-like) function, as shown in
The first and second optical sensors D1 and D2 have each a directional sensitivity, s(ψ) according to the angle Ψ of the light source:
The parameter Δρ is the full width at half maximum (FWHM) of the angular sensitivity function and results directly from the variance σ2 of the Gaussian curve by Δρ=σ×2√{square root over (2 ln 2)}.
Typical optical characteristics of the optical device are: Δρ=3° and Δφ=2.87°, which gives a ratio Δρ:Δφ of 1.04
Placed in front of a contrasting edge, each optical sensor gives the integral of the product of its angular sensitivity function s(ψ) and the luminance of the contrasting edge E. For example, the contrasting edge is a white/black contrasting edge, where the luminance of the dark zone is 0%, and the luminance of the white zone is 100%. The angular position of the contrasting edge E in the reference frame of the optical sensor is denoted by ψC.
The response of an optical sensor, like a photodiode, is the spatial integral of its angular sensitivity function over the whole white zone:
The integral (Eq. 1) does not have an analytical expression. The error function erf is defined as twice the integral of the Gaussian function with a variance σ2=½ and centred on 0:
The primitive of the integral of the angular sensitivity function of an optical sensor is denoted by S, which is equal to 0 in−∞:
Each optical sensor converts the signal into a current. The signals delivered by the first and second optical sensors D1 and D2 are denoted by Ph1 and Ph2.
Based on Eq. (3), one can calculate the responses of the two optical sensors D1 and D2 with their optical axes separated by Δφ and located at
from MOY12, respectively, as:
The gain k represents the difference in luminance between the two surfaces constituting the contrasting edge and depends at the same time on contrast and ambient illumination.
The method according to the invention comprises a step of modulating in a transverse direction, different from the given direction, the amplitude of the signals delivered by the first and the second optical sensors D1 and D2, by joint vibration of the optical axes O1Y1 and O2Y2 of the first and second optical sensors D1 and D2, respectively.
The given direction, substantially along the Z axis, and the transverse direction are preferably orthogonal to each other.
The vibration of the optical axes O1Y1 and O2Y2 of the first and second optical sensors D1 and D2, respectively, involves a vibration of the inter-receptor angle Δφ of the first and second optical sensors D1 and D2.
Referring to
The step of amplitude modulation results from subjecting the lens L or the group G, formed by the first and second optical sensors D1 and D2, to a translational vibration in the transverse direction.
According to a first embodiment of the method and in reference to
Thus, a linear displacement of amplitude c applied to the group G formed by the first and the second optical sensors D1 and D2, according to the translational scanning T, causes rotation of the inter-receptor angle Δφ and therefore causes each direction of observation OY1, OY2 to rotate by an angle Δξ, when the lens L is stationary.
Alternatively, a linear displacement applied to the lens L, of the same amplitude ε but in the opposite direction, in front of the first and second optical sensors D1 and D2 kept stationary with respect to the stationary reference mechanical support, will cause the directions of observation OY1, OY2, and therefore the inter-receptor angle Δφ, to rotate by the same angle Δξ.
The temporal evolution of the angular position denoted by Ψ(t) of the contrasting edge relative to the optical axes of the first and second optical sensors D1 and D2, as seen from the sensors, is the superposition of the relative angular position of the contrasting edge Ψc(t) with respect to the bisector MOY12 of the optical axes of the optical sensors, and of the modulation function Ψmod(t) which results from the vibration effect on the optical axes of the first and second optical sensors:
ψ(t)=ψC(t)+ψmod(t)
Each of the signals from the optical sensors D1 and D2 is filtered in order to extract their dynamical part by the pair of band-pass filters 22, which are generally analog circuits (
Part of the band-pass filters 22 essentially acts as a temporal differentiator of the signals delivered by the first and second optical sensors D1 and D2. The band-pass filters 22 also cancel the DC component and the high frequency noise, while acting as anti-aliasing filters for the subsequent digital processing. The differentiated signals are denoted by Ph1′(t) and Ph2′(t). The expression of the differentiated signals is:
Then, the pair of demodulators 26 isolates the envelope of the differentiated signals.
The output signal Yout is calculated by the calculator 24 starting from the demodulated signals of Ph1′(t) and Ph2′(t). The desired output signal Yout should depend only on the angular position ψc of the luminance transition zone within the inter-receptor angle Δφ, and should be, in particular, independent of the vibrational law. A convenient expression for the output signal Yout is the difference-to-sum ratio of the amplitudes of these temporally differentiated signals:
This ratio allows for the reduction of the common mode noise originating, e.g., from ambient artificial light (100 Hz and higher harmonics, if the frequency of the mains is 50 Hz), while providing a response which is independent from the luminance, the contrast, and the vibrational law.
Finally, the output signal Yout delivered by the calculator 24 is:
This method to detect a contrasting edge is also applicable to the detection of a bar, a bar being the succession of two contrasting edges of opposite polarities.
Indeed, in the same manner, for a bar of width I and centred on ψC, the responses of the two photodiodes are:
With this expression, a white bar on a black zone is modelled with a width I>0 and a black bar on a white zone is modelled with a width I<0.
Based on equations 1 and 7, the temporal differentiation realized by the band-pass analog circuit is:
The joint vibration of the optical axes of the optical sensors D1 and D2 is carried out by their relative translational displacement (
Finally,
In a second embodiment shown in
Means 1 for translational vibration of the lens L comprises a means of translation 8 for translational displacement of the support element 6 supporting the lens L. For example, the means of translation 8 comprises an actuator for generating the translational displacement of the lens L, like the actuator described in patent document FR 2 869 494.
In a third embodiment of the device shown in
Furthermore, means 1 for vibrational displacement comprises a means of displacement 12 for applying, to said support element 10, a stress for controlling the displacement in order to generate a rotational displacement of said group G′ in the transverse direction relative to said stationary reference mechanical support.
In this particular case, according to the method of the invention, a vibration of the optical axes O1Y1 and O2Y2 of the first and second optical sensors D1, D2, in the transverse direction, is carried out by relative rotation of the group G′ formed by the first optical sensor D1, the second optical sensor D2 and the lens L, around another axis substantially parallel to the given direction (see
As an example, referring to
Some examples of the means of displacement 12 for generating a rotational displacement of the group G′ are shown and described in the article by S. Viollet and N. Franceschini in the published article designated A2: “Visual servo system based on a biologically-inspired scanning sensor”, Sensor fusion and decentralized control in Robotics II, SPIE vol. 3839, pp. 144-155, 1999. In this article, however, the vibrational law is supposed to be exclusively periodic and follows a particular waveform.
A particularly noteworthy aspect of the device for measuring the angular position according to the invention, is that when the device is implemented as a visual sensor for fixation and/or tracking of a target with a contrasting edge, for example on board of an aerial robot, the natural vibrations caused by the displacement of the robot, or by the turbulences and/or by the robot's engine, will generate vibrations of the platform to which the support element 10 is firmly attached. The optical axes of the optical sensors D1 and D2 will therefore be subjected to the random vibrations of the platform. An advantage of the device according to the invention is its extreme lightness and robustness since additional actuators are not necessary.
A more detailed description of the demodulator 26, according to the present invention, will now be given with reference to
In the presence of noise, the relevant information contained in the signals Ph1′ and Ph2′, that is, the relative amplitude of these two signals, is extracted by demodulation. Several techniques of demodulation exist. Each technique requires adapted filters. In particular, three techniques of amplitude demodulation, adapted to three different situations, make it possible to extract the amplitude of the two signals in a robust way.
In the case considered above, the modulation is sinusoidal (
The asynchronous demodulator comprises moreover means 34 for calculating the absolute value of the signal in order to relocate the frequency peak 2fa towards 4fa. The absolute value is also necessary for the calculation of the output signal Yout.
The asynchronous demodulator comprises a low-pass filter 36 to preserve only the DC part of the signal which is the reflection of the amplitude of the signal with the initial frequency fa. This last step of low-pass filtering is more effective to remove the image frequency 2fa due to the frequency doubling resulting from the calculation of the absolute value.
Then, the calculator 24 (
According to an alternative and with reference to
The synchronous demodulator comprises a selective filter 40, a multiplier 42, a means 44 to calculate the absolute value of the signal and a low-pass filter 46, all components being comparable with those of the asynchronous demodulator of
The selective filter 40 for fa is adapted to retain only frequencies present within the modulation signal Ψmod.
If the modulation is a sine wave signal at frequency fa, the selective filter 40 tuned to the modulation frequency fa will allow the signals of the photodiodes Ph1′ and Ph2′ to be set in phase with the modulation signal Ψmod.
The synchronous demodulator comprises means 42 for calculating the demodulation, and is connected on the one hand to the selective filter 40 and on the other hand to means 44 for calculating the absolute value. The means 42 uses the sine wave signal Ψmod directly without the need to differentiate or delay the modulation signal because of the intrinsic properties of the sine function.
The calculation carried out during synchronous demodulation is simpler than that carried out during the asynchronous demodulation. It is the most effective demodulation if the modulation signal (Ψmod or Ψ′mod) is known or can be estimated. The result of demodulation is optimal when the signals coming from the photodiodes Ph1′ and Ph2′ are in phase with the signal used for demodulation. This setting in phase can be done by delaying the modulation signal (Ψmod or Ψ′mod).
Furthermore, the use of a selective filter 40 tuned to the modulation frequency fa makes it possible to eliminate all the noise present in the spectrum around fa. This filter is thus very efficient at the selected frequency but causes an important delay. An alternative is to use several selective filters to reject the identified noise (e.g., 100 Hz, 200 Hz).
According to another embodiment and with reference to
The great advantage of the envelope detector over the asynchronous and synchronous demodulators is that it is able to extract the relevant information for the estimation of the angular position of the contrasting edge E without any knowledge of the vibration of the platform supporting the detection device. This characteristic allows for the realization of a particularly simple detection device where the group G′ consisting of the lens and the optical sensors is mounted directly on the platform. The envelope detector will make it possible to use the visual information resulting from the vibration, irrespective of the vibrations of the platform and the origin of this vibration. The realization of an envelope detector is as simple as effective.
In reference to
By way of example, a device for optical detection of a rectilinear contrasting edge according to the present invention, in which the rotational scanning of the inter-receptor angle Δφ of the optical sensors is obtained by vibrations of two photodiodes placed substantially in the focal plane of a lens with a focal distance of f=8.5 mm, gave the following results:
The precision of angular localization of the contrasting edge is 0.01° which is amazingly greater (287 times greater) than the inter-receptor angle Δφ. The device according to the invention, although being simple, is therefore characterized by an outstanding level of precision.
According to one embodiment, several devices for measuring the angular position can be arranged in a set of devices, in order to increase the total field of view of the detection device until it is rendered panoramic. The set of devices comprises at least one lens, a plurality of N optical sensors (N being an integer and N≧2) placed in the focal plane of the lens and (N−1) detection circuits as described before. Each pair of consecutive optical sensors is connected to a detection circuit to calculate a plurality of output signal Yout(N)(t). The output signal delivered by each detection circuit can thus be sampled for subsequent digital processing. The method as described before is applied to each pair of optical sensors to detect a contrasting edge or a bar.
The plurality of optical sensors can be placed in the focal plane of a single lens, the so-called “camera eye” configuration. Alternatively, one or several pairs of consecutive optical sensors can be placed in the focal plane of one of several lenses. Such a set of devices comprises a plurality of adjacent devices, each consisting of a lens and a plurality of optical sensors with different optical axes, the so-called “compound eye” configuration.
In the compound eye configuration, the devices are arranged substantially on a spherical or cylindrical surface surrounding a common centre. This common centre constitutes, for the set of devices, the optical centre of an inter-receptor angle Δφ which is the sum over all inter-receptor angles Δφi of each of the devices taken together.
Furthermore, this set of devices can be generalized for detecting a two-dimensional target comprising at least two contrasting edges, substantially rectilinear and orthogonal.
In the following example the number of optical sensors is limited to three, D1, D2 and D3, in order to facilitate the description. The two pairs of optical sensors, D1-D2 and D2-D3, are arranged in two directions substantially orthogonal H and V. Each pair of optical sensors is placed in the focal plane of its own lens or all the optical sensors are placed in the focal plane of a single lens. Each lens and each optical sensor are arranged substantially on a spherical or cylindrical surface surrounding at least one common centre. A first centre constitutes the optical centre of an inter-receptor angle ΔφH, in the first direction, and a second centre, which can be identical to the first one, constitutes the optical centre of an inter-receptor angle ΔφV, in the second direction, substantially orthogonal to the first direction.
In the same manner as before, each pair of optical sensors is connected to a detection circuit to calculate two output signals Yout(H)(t) and Yout(V)(t), each output signal depending on the position of one contrasting edge of the target.
Finally, in a non-limiting embodiment, the plurality of optical sensors is arranged according to a matrix of optical sensors, each optical sensor constituting a pixel Dij. The rectangular matrix of optical sensors made up in this way forms a two-dimensional retina.
A more detailed description of a particularly advantageous embodiment of the device for detecting a contrasting edge according to the present invention will now be given. In general, the direction in which vibration of the optical axes of the first and the second optical sensors D1, D2 is carried out can in principle be any direction. In a non-limiting embodiment, however, when this vibration is carried out with the aim of detecting a single contrasting edge E, this direction can advantageously be perpendicular to the given direction along which the contrasting edge E extends.
Such a method may be facilitated by orienting the vibration direction within a plane substantially corresponding to the focal plane of the lens L.
For this purpose and in accordance with a particular embodiment of the detection device for measuring the angular position according to the present invention, the detection device advantageously comprises a means for orienting an assembly a1 formed by the support element, the lens L and the stationary reference mechanical support or an assembly a2 formed by the support element, the group G of the first and second optical sensors D1 and D2 and the stationary reference mechanical support. Consequently, the direction of the vibrational displacement of the lens L or of the group G, and thus of the optical axes of the optical sensors, is oriented in the other direction transverse to said given direction of the substantially rectilinear luminance transition zone. Such means for orientation are described in patent document FR 2 869 494 (PCT: WO 2005/111536 A1).
The detection device for measuring the angular position according to the invention can be implemented in a steering aid system.
In the following, a steering aid system for the visual fixation and fine tracking of a target comprising at least one contrasting edge having a luminance transition zone and for controlling the speed of an aircraft shall be described.
The objective of the steering aid system is to allow an aircraft to fixate and track a target while controlling its angular speed, the yaw speed. The target comprises at least one contrasting edge corresponding to a transition in luminance.
The steering aid system comprises both a device for detecting the angular position of the contrasting edge according to the invention and a device for measuring the relative angular velocity between the line of sight of the aircraft and the contrasting edge of the target. The aim is to maintain the line of sight constantly on the contrasting edge E by controlling the angular speed of the aircraft according to both, the angular position and the angular velocity of the target relative to the contrasting edge.
A detailed description of the device for measuring the relative angular velocity and a corresponding method will be given in the following with reference to
Referring to
The device for measuring the angular velocity 2002 according to the invention comprises at least one optical device 2004 comprising a first and a second optical sensor D1 and D2, separated by an inter-receptor angle, denoted by Δφ. The inter-receptor angle Δφ is the angle between the two optical axes O1Y1 and O2Y2 of the first and second optical sensors D1 and D2, respectively, with O1 and O2 being the centers of the first and second optical sensors, respectively.
The object P and its luminance transition zone are moving with a velocity denoted by V which is represented by an arrow in
In a non-limiting embodiment, the optical device 2004 comprises a convex lens L which determines this inter-receptor angle Δφ. The optical sensors D1 and D2 are placed substantially in the image focal plane of the lens L, so that the optical center O of the lens L is situated between the optical sensors D1, D2 and the luminance transition zone.
A reference direction is advantageously the direction OY12 substantially corresponding to the average direction of the angle bisector between the optical axes O1Y1 and O2Y2 of the first and second optical sensors D1, D2.
In a preferred non-limiting embodiment, the first and the second optical sensors D1 and D2 are formed by photoelectric sensors such as photoelectric diodes, whose spectral sensitivity can be selected either in the spectral range of visible or even ultraviolet light or, alternatively, in the range of near of far infrared radiation, for example for nocturnal detection.
The wavelength of maximum sensitivity of the aforementioned photodiodes can thus be chosen in dependence of the application of the device for detecting a contrasting edge E according to the present invention.
Moreover, the device 2002 for measuring the angular velocity of the contrasting edge E according to the invention comprises a detection circuit 2006 in order to compute, on the basis of the signals delivered by the first and the second optical sensors D1 and D2, the angular velocity ω(t) of the luminance transition zone.
The detection circuit 2006 is connected to the first and second optical sensors and receives the signals delivered by the first and second optical sensors D1 and D2 which are denoted by Ph1(t) and Ph2(t), respectively.
The detection circuit 2006 comprises a band-pass filter 2008 connected to the optical sensors in order to compute the temporal derivative signals of Ph1 and Ph2, denoted by Ph1′ and Ph2′, of the first and second optical sensors, respectively.
Furthermore, the detection circuit 2006 comprises a means 2010 for measuring the time delay Δt between the signals delivered by the first and the second optical sensors, the delay depending on the angular velocity of the luminance transition zone.
Optionally, the detection circuit 2006 can comprise a calculator 2012 for calculating, for example the angular velocity ω(t) (optic flow), or any mathematical function of the delay Δt (calculated between the output signals of the optical sensors). The angular velocity ω(t) is the ratio of the inter-receptor angle Δφ to the delay Δt:
Means 2010 for measuring the delay Δt will now be described in detail with reference to
The feedback loop 2013 for measuring the delay Δt comprises at least means 2014 to delay the temporally filtered signal Ph1′ delivered by the first optical sensor D1, an estimator 2016 of the temporal error Δterror of the delay Δt and a means 2018 to set the delay Δt to a value Δtinit calculated by an EMD when an error Phdiff, which is initializing means 2018, is above a predetermined limit during a predetermined time.
The means 2010 for measuring the delay Δt is shown in
A more detailed description of the method 2100 for measuring the angular velocity of the luminance transition zone according to the present invention will now be given with reference to
When a luminance transition zone moves in front of the optical device 2004, along the X axis in the direction from the first optical sensor D1 to the second one D2, the sensors D1 and D2 convert the luminance coming from the object, and in particular from the luminance transition zone, in analogical signals (current or voltage). The temporal signals delivered by the first and second sensors D1 and D2 are denoted by Ph1(t) and Ph2(t), respectively.
The method 2100 according to the invention comprises a step 2102 of spatial filtering the signals delivered by the optical sensors D1 and D2.
This spatial filtering 2102 is determined by the lens L (
The first and second optical sensors D1 and D2 have a directional sensitivity, according to the angular position Ψ of the light source:
The parameter Δρ shown in
Typical optical characteristics of the optical device 2004 are: Δρ=3° and Δφ=2.87°.
Placed in front of a contrasting edge, each optical sensor measures a value that is the integral of the angle ψ, of the sensitivity function s(ψ) of the optical sensor multiplied by the luminance of the contrasting edge E.
An example of the spatially filtered signals is shown in
Then, in step 2104 (
The high-pass filter acts as a temporal differentiator of the signals delivered by the first and second optical sensors D1 and D2, especially in the frequency range from 0 to 30 Hz which contains the relevant information. The high-pass filter also cancels the DC component of the signals Ph1(t) and Ph2(t).
The low-pass filter attenuates the high frequency components of the luminance and reduces noise and interferences.
After temporal filtering 2104, the temporally differentiated signals are sampled, for example at a sampling frequency of 2 kHz.
In step 2106, means 2010 determines the delay Δt between the signals Ph1(t) and Ph2(t) and in step 2108, the calculator 2012 calculates the angular velocity ω(t) according to the equation:
or another function of the delay Δt.
The determination 2106 of the delay Δt will now be described in detail. The delay Δt(t) is determined in a feedback loop The feedback loop comprises the steps of:
(a) estimating the delay Δt(t) between the temporally filtered signals Ph1′(t) and Ph2′(t) at an instant tn, this delay being denoted by Δt(tn);
(b) delaying the temporally filtered signal Ph1′(t) of the first optical sensor by the delay Δt(tn). The delayed signal is denoted by Ph1′(t−Δt(tn)). An example of this step is represented in
(c) calculating the error Phdiff(t) at the instant tn between the temporally filtered signal Ph2′(t) delivered by the second optical sensor at the instant tn and the temporally filtered signal Ph1′(t−Δt(tn)) delivered by the first optical sensor and delayed by the estimated delay Δt(tn) at the instant tn:
Phdiff(tn)=Ph1′(tn−Δt(tn))−Ph2′(tn)
If the estimated delay Δt(tn) is correct, i.e. corresponds to the real delay Δt at the instant tn, then Phdiff(tn) is zero. Otherwise Phdiff(tn) is different from zero.
When the output of the feedback loop Δt(tn) is incorrect, the feedback loop takes a signal Δterror(t) as an error signal which will be integrated and added to the current value of Δt(t) in order to correct Δt so that Δt converges toward the real value of Δt(t) and that the error Phdiff(t) converges toward zero.
The determination of the error Δterror(t) shall now be considered in detail.
In
In the opposite case (not shown), that is when the estimated delay Δt(tn) is too large, Phdiff(tn) is smaller than zero for signals with a positive slope at the instant tn and larger than zero for signals with a negative slope at the instant tn. Consequently, the direction of evolution of the estimated delays Δt(t) at the instant tn depends on the one hand on the sign of the slope of Ph2′(t) (or of Ph1′(t−Δt) at the instant tn (sign of Ph2″(tn) or of Ph1″(tn−Δtn)) and on the other hand on the error Phdiff(t) at the instant tn.
In the case that the error Phdiff(tn) is different from zero, the evolution of the delay Δt(t) at the instant tn should comply with the correlation given in the following table:
The feedback loop comprises furthermore the steps of:
(d) filtering the filtered signal of the second optical sensor Ph2′(t) by a derivate filter in order to compute the second-order temporal derivative function Ph2″(t) of the signal of the second optical sensor at the instant tn, denoted by Ph2″(tn);
(e) estimating the temporal error Δterror(tn) of the delay Δt(tn), on the basis of the error Phdiff(tn) and the second-order temporal derivative function Ph2″(tn) (or the signal Ph1″(tn−Δt(tn))); and
(f) estimating the evolution of Δt(t) from the temporal error Δterror(tn). Many alternatives exist. A first one consists in setting a fixed slope value, denoted by α, of the evolution, and then using the sign of Δterror(tn) to define the direction of evolution at each instant. The value of Δt(t) is then updated according to:
Δt(t)=Δtinit+∫t
wherein the sign function takes the value +1 for positive values of Δterror(t), and 0 for negative values. Other alternatives consist in defining a slope α proportional to the absolute value Δterror. This means that α becomes a function of the error Δterror(t).
Moreover, the feedback loop can reinitialize the value of Δt to a value Δtinit. This reinitialization occurs when the error Phdiff(t) between the delayed signal of the first optical sensor and the signal of the second optical sensor is important. The reinitialization of Δt may be triggered when the error Phdiff(t) stays above a predetermined value during a predefined time.
The reinitialization value Δtinit is the output of a classical Elementary Motion Detector (EMD) as described in the article “Bio-inspired optic flow circuits for the visual guidance of micro-air vehicles” by F. Ruffier, S. Viollet, S. Amic and N. Franceschini (IEEE Int. Symposium on Circuits and Systems ISCAS 2003, Bangkok, Thailand, pp. 846-849).
Now, four alternative methods, represented in
If the error Phdiff(tn) has the same sign as the second-order temporal derivative function Ph2″(tn), Δt(tn) is too small and Δt(t) has to increase with slope ε. If Phdiff(tn) and Ph2″(tn) have opposite signs, Δt(tn) is too large and Δt(t) has to decrease with slope ε.
A simplified expression determining the evolution of Δt(t) is
Δt(t)=Δtinit+∫t
where ε is a predetermined value and ⊕ is the exclusive or operator (xor). The sign function takes the value +1 for positive values, and 0 for negative values. This method is extremely simple to implement as the functions ⊕ (xor) and sign are basic and belong to the functions that are most quickly carried out in a microcontroller.
However the speed of evolution of the delay depends on the slope of +ε or −ε.
A second alternative of the estimator 2016 shown in
In practice, the signals are noisy, in particular Ph2″(t). Also, this relation for the evolution for Δt used as such gives a disturbed result and in the worst case it cannot lead to the solution. So, the ratio is weighted/by a factor α chosen in the interval [0;1]:
The smaller the factor α, the smoother will be the convergence of the estimated delay Δt. However, a small value of α will decrease the speed of convergence of the estimated delay Δt, which complicates the estimation of the delay, provided that Δt varies quickly (for example, during a rapid change of the angular speed rate).
In the two preceding alternative methods, the measurement noise on the estimation of Δt is constant and does not depend on the value of Δt itself. Thus, the computation of the angular velocity, which is reciprocally proportional to Δt, makes this noise not constant on the whole measurement range of ω(t). The measurement noise will be higher for high angular speed. The same reasoning can be applied for the speed of convergence of the method for computing Δt. This convergence speed or dynamic is constant over the whole range of the Δt measurement. Thus, the dynamic on the resulting angular speed ω(t) depends on the angular speed itself i.e. the higher the angular speed, the faster the dynamic.
A third embodiment of the estimator 2016 shown in
The update of the estimated delay is increased or decreased by the product of a function α(t) and the ratio of the error Phdiff(t) to the second-order temporal derivative function Ph2″(t). The function α (Δt(t) is proportional to the square of the estimated delay according to the equation:
αa(Δt(t))=α0×(Δt(t))2
wherein α0 is a factor chosen in the interval [0;1]. In a fourth embodiment, the function α (Δt(tn)) is modulated by |cos(2πΔt/10e−3)|:
αa(Δt(tn))=α0×(Δt(tn))2×|cos(2πΔt/10e−3)|
The corresponding estimator 2016 is shown in
αa(Δt(t))=α0×(Δt(t))2×cos(2πΔt(t)/10e−3)
When the sensor is used in the presence of an artificial light (neon, 100 Hz), the artificial light is mainly filtered by the analogical filters of the step (a). However, when weak angular velocities are measured, the amplitude of the temporally derived function of the signals is low and the residue at 100 Hz, which does not contain relevant information, becomes a possible source of noise on the sensor output. This residue at 100 Hz has a weak influence when the delay Δt is a multiple of 10 ms because the comparison of Ph2′ and delayed Ph1′ is carried out in phase with this noise at 100 Hz. Therefore, in this alternative method, α(Δt) has to be modulated by the function |cos(Δt*2πF)| where F is the 100 Hz frequency.
In another embodiment of the device 2002 for measuring the angular velocity according to the invention and shown in
The bidirectional detection circuit 2200 comprises, as the aforementioned detection circuit 2006 (
Furthermore, the bidirectional detection circuit 2200 comprises a first and second means 2010-A and 2010-B for measuring the delay Δt between the signals delivered by the first and second optical sensors, each of these means corresponding to means 2010 (
Means 2010-B delays the signal delivered by the first optical sensor Ph1′(step (b)) and uses the signal Ph2′ as such. In contrast to means 2010-B, means 2010-A delays the signal delivered by the second optical sensor Ph2′ and uses the signal Ph1′ as such.
In the following, the same steps (c) to (f) as described before are executed. Means 2202 which detects the direction of the movement of the luminance transition zone is connected between means 2010-A and 2010-B on the one hand, and the calculator 2012 on the other hand.
Then, means 2202 compares the errors Phdiff(A) and Phdiff(B) calculated by the first and second means 2010-A and 2010-B, respectively, and uses the output of that means 2010-A or 2010-B for which Phdiff converges to zero.
Indeed, means 2202 selects first means 2010-B. In that case, means 2202 can deduce the angular velocity if the luminance transition zone moves from the first to the second optical sensor. And then means 2202 selects means 2010-A. In this case, means 2202 can deduce if the luminance transition zone moves from the second to the first optical sensor.
A device 2002 comprising such a bidirectional detection circuit 2200 is a bidirectional device because it works in the direction of the displacement of the luminance transition zone of the object, as well as in the opposite direction.
Measurements have shown that the dynamics of the detection device according to the invention, i.e. the capacity to measure an abrupt variation of the measured value, is as fast as the “classical” device.
The detection device for measuring an angular velocity according to the invention brings the following advantages. According to one embodiment of the invention, the measurement of the angular velocity can be bidirectional. Experiments have shown that this device can be used in a wide range of luminosity. The measurement is not disturbed by a variation of luminosity or a sudden variation of the speed of the optical device relative to its visual environment (absence of transitory time). The angular velocity data are continuously updated. The device is simple and requires only few resources of calculation of a microcontroller. Its implementation is fast and measurements with the method are robust and more precise than by a classical method using thresholding.
According to an embodiment, several devices for measuring the angular velocity according to the invention can be combined forming a set of devices. Such a set of devices comprises at least one lens, a plurality of N optical sensors (N being an integer and N≧2) placed in the focal plane of the lens and a plurality of N−1 detection circuits as described hereinbefore. This embodiment has an increased total field of vision, which can even be panoramic, if necessary. Each pair of adjacent optical sensors is connected to a detection circuit to compute a plurality of output signals representing the angular velocity ω(t) within each inter-receptor angle of two adjacent optical sensors. The output signals delivered by the N−1 detection circuits can thus be sampled for subsequent digital processing. The method as described hereinbefore is applied to each pair of optical sensors to measure the angular velocity of a luminance transition zone.
The plurality of N optical sensors can be placed in the focal plane of a single lens, or each pair of consecutive sensors can be placed in the focal plane of one lens among a plurality of lenses.
Each lens and each optical sensor are arranged substantially on a spherical or cylindrical surface surrounding a common centre. This common centre constitutes, for the set of devices, the optical centre of an inter-receptor angle Δφbeing the sum over all inter-receptor angles Δφi of each of the devices taken together.
Furthermore, this set of devices can be generalized for detecting a two-dimensional target comprising at least two contrasting edges (E), substantially rectilinear and orthogonal to each other.
In the following example, the number of optical sensors is limited to three, D1, D2 and D3, in order to facilitate the description. The two pairs of optical sensors, D1-D2 and D2-D3, are arranged in two directions H and V substantially orthogonal to each other. Each pair of optical sensors is placed in the focal plane of one of two lenses or all the optical sensors are placed in the focal plane of a single lens. Each lens and each optical sensor are arranged substantially on a spherical or cylindrical surface surrounding at least one common centre. A first centre constitutes the optical centre of an inter-receptor angle ΔφH, in the first direction, and a second centre, which can be identical to the first one, constitutes the optical centre of an inter-receptor angle ΔφV, in the second direction, substantially orthogonal to the first one.
In the same manner as before, each pair of optical sensors is connected to a detection circuit to compute the angular velocities ωH(t) and ωV(t). Each output signal depends on the position of the contrasting edge (E) of the target.
Finally, in a non-limiting embodiment of the set of devices, the plurality of optical sensors is arranged according to a matrix of optical sensors, each optical sensor constituting a pixel Dij. The rectangular matrix of optical sensors made up in this way forms a two-dimensional retina.
A more detailed description of a particularly advantageous embodiment of the device for measuring the angular velocity according to the present invention will now be given. In general, the reference direction OY12 of the device can be any direction. In a non-limiting embodiment, however, this direction can advantageously be defined as perpendicular to the direction in which the luminance transition zone, and so the contrasting edge E, moves and to the direction in which it extends.
The corresponding method may be facilitated by orienting the reference direction OY12 orthogonally to a plane substantially corresponding to the focal plane of the lens L.
For this purpose and in accordance with an embodiment of the detection device according to the present invention, the detection device advantageously comprises a means to orient the optical device 2004 and with it the reference direction OY12 of the detection device in the direction transverse to said direction in which the substantially rectilinear luminance transition zone extends and to said direction in which the luminance transition zone moves.
Such means for orientation are described in patent document FR 2 869 494.
A steering aid system and its implementation are for example described in patent document FR 2 869 494 (PCT: WO 2005/111536 A1). In the steering aid system according to the present invention, the detection device for detecting the angular position of the contrasting edge and the detection device for measuring the angular velocity of the luminance transition are replaced by the detection devices as described herein before.
The two devices, the one for measuring the angular position, called a position sensor, and the other for measuring the angular velocity, called a velocity sensor, can use the same optical sensors D1, D2 and the same band-pass filters of the detection circuits, which calculate the differentiated signals of the first and second optical sensors.
The methods for measuring the relative angular position and the relative angular velocity can be implemented either in series or in parallel. The position sensor vibrates. However, the vibration amplitude is too small to influence the measurement of the angular velocity.
The angular position sensor and the angular velocity sensor will give complementary visual information to the automatic flight control systems.
The steering aid system allows one to maintain the line of sight of the detection device constantly on the contrasting edge E, therefore leading to visual fixation of this contrasting edge by the detection device, when the contrasting edge is stationary, and to tracking when the contrasting edge happens to move. The aerial robot OSCAR II, equipped with a velocity sensor and a position sensor that uses the vibration inherent to the robot, was shown to be able to keep its heading locked onto a stationary edge. During a 2-minutes lasting experiment, the heading standard deviation of the robot was only σ=0.15°. With a moving target, this standard deviation increased only slightly (σ=0.21°).
In conclusion, this detection device of the position of a contrasting edge has the enormous advantage to work on the simple basis of a random microvibration. It is thus possible to use the natural vibrations of a mobile platform, instead of an extra actuator to make the optical axes of the two optical sensors vibrate.
The robot OSCAR II, the aerial robot presented in the article designated A1, controls its yaw orientation by applying a differential command to its propellers. The detection device according to the present invention was shown to be able to operate by simply exploiting the natural vibrations of the robot, which were transmitted to the platform supporting the detection device. Due to the detection device, the robot is able to maintain its heading in the direction of a fixed contrasting edge, and to track this contrasting edge when it moves in the horizontal plane.
Number | Date | Country | Kind |
---|---|---|---|
09306239 | Dec 2009 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2010/069272 | 12/9/2010 | WO | 00 | 8/22/2012 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2011/073079 | 6/23/2011 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
4135815 | Masunaga et al. | Jan 1979 | A |
4443103 | Erdmann et al. | Apr 1984 | A |
4686683 | Martin | Aug 1987 | A |
4818101 | Soreide et al. | Apr 1989 | A |
4827436 | Sabersky et al. | May 1989 | A |
5026153 | Suzuki et al. | Jun 1991 | A |
6705566 | Trice et al. | Mar 2004 | B1 |
7667859 | Franceschini et al. | Feb 2010 | B2 |
Entry |
---|
PCT/EP2010/069272 International Search Report dated Feb. 8, 2011. |
Number | Date | Country | |
---|---|---|---|
20120305697 A1 | Dec 2012 | US |