1. Field of the Invention
The invention relates to a method and a device for hyperacuity-type optical detection of a substantially rectilinear contrast edge and to a system for acquiring and tracking a target comprising at least one such contrast edge.
2. Description of the Related Art
In the technical field of imaging, a solution for obtaining a very high resolution image sensor involves associating a sensor having a high density of pixels with a suitable optical system. In addition to significant bulk, this solution is very expensive.
Another solution involves moving an image sensor by displacement micro-steps, which are sub-multiples of the spacing between the pixels thereof, and reconstituting a final image on the basis of the partial images acquired during each micro-displacement. A solution of this type involves the use of a large-capacity storage memory as well as an image reconstruction algorithm which is particularly powerful and therefore expensive in time and computer resources.
In the corresponding technical field relating to detection of the horizon for automatic steering and stabilization of a ship or an aircraft, optical detection procedures have been proposed in addition to procedures employing inertial systems. The aforementioned optical detection procedures basically consist in measuring a difference in the intensity of infrared and/or visible radiation between the sky and the ground.
Other experimental systems have also been proposed. This type of system employs a CCD sensor and an image-processing algorithm, in order to extract the horizon therefrom with appropriate accuracy. However, a system of this type necessitates high luminance and a considerable processing power.
Detection by electromagnetic waves or radar waves is employed for detecting obstacles as steel cables and small-sized objects at a relatively great distance.
Radar systems with millimeter waves are capable of detecting a 6 mm diameter steel cable at a distance of about 25 m, and ultrabroadband radar systems are capable of detecting a steel cable of the same diameter at a distance of about 80 m.
In the same field a cable having a comparable diameter can be detected up to a distance limited to 6 m, however, by procedures employing a scanning laser. The corresponding scanning laser-type detectors are voluminous, bulky and heavy, weighing from 6 to 8 kg.
More recently, a detection procedure using an electronic eye subjected to micro-scanning, which rotates relative to a substantially rectilinear contrast edge was described by Stéphane Viollet and Nicolas Franceschini, Equipe Microrobotique UMR Mouvement et Perception, CNRS/Université de la Méditerrannée 31, Chemin Joseph Aiguier 13402 Marseille Cedex 20, during the fifth workshops of the microrobotic pole and first workshops of the microrobotic RTP held on 6 and 7 Nov. 2002 in Rennes, Irisa and ENS Cachan, Antenne de Bretagne, France.
The published article which resulted from these workshops and is designated A1, describes the design and production of a specific type of visual sensor known as a “neuromimetic” visual sensor, the operating laws of which are directly inspired from the living world. This sensor, known as OSCAR, for optical scanner for the control of autonomous robots, enables the angular position of a contrast having a substantially rectilinear edge to be determined by means of two spatially offset photodiodes, on which is imposed periodic rotational microscanning inspired by observations of the retina of a fly in flight.
Measurement of the relative movement of the visual environment, in other words of the substantially rectilinear edge, is carried out using an elementary movement detector (EDM) circuit, of which the use and operating law is inspired from that of fly movement detecting neurons.
For rotational scanning at variable speed, the signal delivered by the EMD circuit from the two photodiodes is a signal of which the amplitude depends on the angular position of the contrast edge relative to the average direction of the total field of vision of the sensor formed by the two photodiodes.
For a more comprehensive description of this OSCAR sensor, reference should be made to the published article A1 relating to these two workshops.
With reference to this article, it is mentioned that this OSCAR sensor allows the production, in particular, of:
A sensor of this type has adequate visual acuity ability to allow the integration thereof in a visuo-motor servo control loop, the static gain of the sensor also varying minimally according to the nature of the object, its contrast or its distance.
The present invention relates to the implementation of a method and a device for hyperacuity-type detection of a substantially rectilinear contrast edge, which are based on a similar law but by means of which the bulk and also the mass, inertia and the consumed power of the detection device are substantially reduced in comparison with the OSCAR sensor of the prior art, and which enables the reliability, in the sense of the repeatability of the scanning operation, of the hyperacuity-type detection device according to the invention to be improved in a particularly significant manner.
The present invention also relates to the implementation of a system for the fixing and fine tracking of a target comprising at least one contrast edge, having a substantially rectilinear light transition zone for monitoring and stabilizing the sighting direction of a hyperacuity-type detection device according to the subject of the invention, the capability of this system being comparable, at least qualitatively, to that of the VOR (vestibulo ocular reflex) process, which is known to stabilize the eye and therefore the human line of sight, owing to the combination, on the one hand, of the hyperacuity type detection method according to the invention and, on the other hand, of particularly rapid control inspired by the aforementioned VOR process.
The present invention finally relates to any application of the method and the device for detecting a contrast edge according to the invention and of the system for fixing and fine tracking of a target, in particular,
The method and the device for detecting a contrast edge having a light transition zone which is substantially rectilinear in a given direction, according to the invention, are noteworthy in that they involve or allow implementation, in another direction transverse to this given direction, of periodic positional scanning of the total angle of vision of a first and a second optical sensor by relative translation of the assembly formed by this first and second optical sensor in this other direction, the law of periodic scanning corresponding to non-uniform scanning for at least a portion of each period of periodic scanning, the total angle of vision being delimited by the average direction of observation of this first and second optical sensor and measurement, on the basis of the signals delivered by the first and second optical sensor, of a time difference between these signals which is linked to the angular position of this light transition zone, relative to the average direction of this total angle of vision forming a reference direction, based on the scanning law, this reference direction being linked to a specific value of this time difference.
The method and the device for detecting a contrast edge, according to the present invention, are used for industrial implementation of systems for the fixing and fine tracking of a target having at least one contrast edge, in which a method for compensating for the sighting line similar to the VOR process of human sight can be employed, owing to the high precision and high speed of this method and this device and also to the high miniaturization and extreme lightness of this device, of which the very low inertia permits such implementation in a particularly noteworthy manner.
A more detailed description of the method and the device for detecting a contrast edge and of a system for the fixing and fine tracking of a target comprising at least one contrast edge, according to the invention, will now be given in conjunction with the drawings hereafter, in which;
a to 2h show, by way of illustration, differing sub-steps for implementation of the method shown in
a shows, by way of illustration, a block diagram of a device for detecting a contrast edge according to the present invention;
b gives an example of static input/output characteristics (in volts per degree) of the detector according to the invention, obtained in front of a contrast edge (C1) or a black bar (C2) having a width of 1 cm, both placed 130 cm from this detector;
a, 4b, 4c, 4d and 4e show, by way of illustration, specific embodiments of the detection device according to the present invention, as shown in
a and 5b show, as a non-limiting example, a first and a second non-limiting variation of the detection device according to the invention, in which the translational scanning direction applied to the optical sensors can be adjusted in a direction substantially perpendicular to the contrast edge, for a specific application;
a and 6b show, by way of a non-limiting example, two further variations of the detection device according to the invention which can be used more particularly for two-dimensional scanning and are applicable to two-dimensional targets;
a is a plan view of the portion of the system for visual fixing and fine tracking according to the invention, for defining the operating parameters thereof, in the context of the visual fixing and fine tracking system shown in the aforementioned figure;
b shows, by way of illustration, a general block diagram of the visual fixing and fine tracking system according to the invention for the parameters or state variables shown in FIG. 7a when the detection device according to the invention incorporates the system for the visual fixing and fine tracking of a target according to the invention and the visual fixing and fine tracking process is assisted by a second system substantially corresponding to the VOR process for stabilizing the line of observation of human sight.
A more detailed description of the method for detecting a contrast edge having a light contrast zone which is substantially rectilinear in a given direction, according to the present invention, will now be given in conjunction with
Referring to the aforementioned
The process according to the invention consists at least in carrying out, in another direction transverse to the given direction corresponding to the edge E of the plate P, periodic scanning of the angular position of the total angle of vision Δφof a first and a second optical sensor denoted by D1 and D2.
Referring to
In a non-limiting embodiment, it is mentioned that this total angle of vision can be formed by a convex lens L, the optical sensors D1 and D2 thus being placed substantially in the image focal plane in the aforementioned lens L.
According to a particularly noteworthy aspect of the method according to the invention, periodic positional scanning of the total angle of vision Δφis carried out by relative translation of the assembly formed by the first and second optical sensor D1 and D2 and of the lens L in this other direction, this other direction, in
The law of periodic scanning corresponds to non-uniform scanning for at least a portion of each periodic scanning period, the total angle of vision denoted by Δφ=(O1Y1,O2Y2) thus being delimited by the average direction of observation of the first and second optical sensor D1, D2.
The method according to the invention also consists in detecting the time difference between the signals delivered by the first and second optical sensor D1 and D2, this time difference Δt being linked to the angular position of the light transition zone, in other words of the edge E of the plate P, relative to the reference direction. The reference direction is advantageously the direction MOY12 substantially corresponding to the average time direction of the bisector between the sighting directions of the first and second optical sensor D1, D2.
Thus, a linear displacement of amplitude ε applied to the assembly formed, for example, by the first and the second sensor D1 and D2 according to the translational scanning S causes rotation of the total angle of vision Δφand causes the directions of observation OY1, OY2 to rotate by an angle Δξ.
The process for measuring the aforementioned time difference Δt, the image of the angular position of the light contrast zone E relative to the reference direction MOY12, on the basis of the scanning law Ω, will now be described in conjunction with
a shows the process of periodic scanning of the angular position of the total angle of vision Δφ. In particular, it will be noted that the aforementioned total angle of vision is delimited by the directions OY1 and OY2 corresponding to the maximum sensitivity of each of the optical sensors D1 and D2, the sensitivity curves thereof in the plane OX,OY, the plane of
In the aforementioned
Scanning at angular velocity Ω, which can be varied by the total angle of vision Δφof the contrast edge E having the substantially rectilinear light contrast zone parallel to the axis OX, in
b shows a periodic scanning law corresponding to scanning non-uniform in time, the law of scanning Ω as a function of time being shown in
c, 2d and 2e show the output signals delivered by the optical sensors D1 and D2, depending on the position of the contrast edge E during the scanning operation for positions 1, 2 and 3 shown in
The aforementioned output signals are thus advantageously filtered by means of a high-pass filter of order 1, which allows thresholding of the aforementioned signals and therefore measurement of the time difference Δt, as shown in
The basic result is that the time difference Δt between the filtered signals delivered by the sensors D1 and D2 varies according to the position 1, 2, 3 of the contrast edge E: the process enables an angular position to be coded by a time difference.
The x-axis in
It will obviously be appreciated that, for carrying out the method according to the invention, it is possible to carry out translational scanning S of the assembly formed by the first D1 and the second D2 optical sensor with respect to the lens L and that, reciprocally, this step of periodic positional scanning can advantageously correspond to carrying out translation the lens of the same amplitude but in the opposite direction in front of the first and second optical sensor D1 and D2 which are kept stationary.
Under these conditions, it will be appreciated that the laws of delay Δt between the signals delivered by the first and the second optical sensor D1 and D2, as shown in
Preferably, in a non-limiting manner, the direction of the contrast edge E orthogonal to the plane of
With regard to implementation of the process for measuring the delay Δt, as shown in conjunction with
It will be appreciated that, with a particularly advantageous process for carrying out the method according to the present invention, translational scanning either of the assembly formed by the first and the second optical sensor D1 and D2 or, on the contrary, of the lens L facing them, when they are stationary, allows implementation of a law of scanning of angular position of the total angle of vision Δφ, according to an angular position thereof, corresponding for example to the law of angular scanning of the assembly formed by the first and the second sensor D1 and D2 and by the lens L, as described in the aforementioned document A2.
On the other hand and according to a noteworthy aspect of the method according to the present invention, the processing process, in the case of angular positional scanning, can thus be substantially identical to the one described in the aforementioned article, even though the scanning described therein is achieved by total rotation of the assembly comprising the lens+optical sensors D1, D2.
A more detailed description of a device for detecting a contrast edge, having a light contrast zone which is substantially rectilinear in a given direction in accordance with the subject of the present invention, will now be given in conjunction with
The device according to the invention obviously comprises at least the first and the second optical sensor D1 and D2 from
The first and the second optical sensor D1 and D2 are placed substantially in the image focal plane of the lens L, the average directions of observation of the first and second optical sensor D1 and D2 substantially corresponding to a line (O1OY1, O2OY2) linking the centre of the first or the second optical sensor respectively and the optical centre of the lens L, as shown in particular in
As shown in
The relative translational displacement resources are denoted by A and 1 in
In a preferred non-limiting embodiment, it is mentioned that the first and the second optical sensor D1 and D2 are each formed by a photoelectric sensor such as a photoelectric diode, of which the spectral sensitivity can be selected either in the visible range or even in the ultraviolet range or, alternatively, in the infrared range, for example for nocturnal detection.
The choice of the wavelength of maximum sensitivity of the aforementioned photodiodes can thus be made as a function of the application of the device for detecting a contrast edge according to the present invention.
With regard to the implementation of the detection circuit 2, it is mentioned that it can advantageously comprise a separating amplifier 20, also called a trans-impedance amplifier, and an elementary movement detection (EMD) circuit 21 receiving the signals delivered by the first and second optical sensor D1 and D2 after amplification by the separating amplifier 20 and, on the basis of the time delay Δt and the non-uniform scanning law Ω, enabling delivery of an output signal V substantially proportional to the reciprocal, 1/Δt, of the time difference Δt and consequently substantially proportional to the angular position of the light contrast zone E relative to the reference direction MOY12.
With regard to the implementation of the elementary movement detector circuit 21, it is mentioned that this circuit can substantially correspond to the circuit described in the aforementioned article A2 edited in 1999 and to which reference may be made for a more detailed description of this circuit, in particular Chapter 3 thereof which is entitled “Measuring angular speed with an LMD”.
b shows the output signal V delivered by the elementary movement detector circuit 21, the x-axis of
It is noted that the value of this signal is substantially linear in the case of angular position offsets of between −2° and +2°.
A more detailed description of the relative translational displacement resources of the assembly formed by the first and the second optical sensor D1 and D2 or of the lens L with regard to the light contrast zone E will now be given in conjunction with
As shown in
The aforementioned resources also comprise a circuit for application to the deformable support A, which thus forms an actuator, of a periodic displacement control stress for generating a periodic translational displacement in the other direction, the scanning direction S, of the assembly formed by the first and the second optical sensor D1, D2, according to the scanning law relative to the stationary reference mechanical support.
Referring to
Preferably, and as shown in
A more detailed description of the actuator A for generating the translational displacement will now be given in conjunction with
Preferably, as shown in
It will be appreciated, in particular, that the piezoelectric blades can be made up in a non-limiting manner of two matched bimorphic or monomorphic piezoelectric blades, or else of a piezoelectric blade and a spring blade, for example, or of equivalent means. Under these conditions, the application of an electrical voltage adapted in accordance with the scanning law allows the application of a stress for controlling periodic displacement in the scanning direction S, as shown in
In a variation, one of the two piezoelectric blades can be used as a position sensor for the photodiodes D1, D2,
As shown in
With regard to the application of the aforementioned displacement control stress, it is mentioned that this displacement stress can be brought back to a mere calibration of the angular displacement described by the article A2 edited in 1999. As shown in
According to a variation shown in
In the aforementioned
Under these conditions, each pair of first and second sensors O11, O12; O21, O22 and O31, O32 for the lenses L1, L2 and L3 respectively can thus be connected to an elementary movement detecting device actually comprising a detection circuit, symbolized by 20-21, for each of the elementary devices. The output signal delivered by each V1, V2 and V3 can thus be sampled for subsequent digital processing.
A more detailed description of a particularly advantageous embodiment of the device for detecting a contrast edge according to the subject of the present invention will now be given in conjunction with
In general, it will be recalled that the direction S, in which periodic scanning by relative translation of the assembly formed by the first and the second optical sensor D1, D2 with respect to the contrast edge E is carried out can theoretically be any direction. In a non-limiting embodiment, however, when this scanning is carried out with the aim of detecting a single contrast edge E, this direction can advantageously be perpendicular to the given direction in which the contrast edge E extends.
It is mentioned that such a mode of operation may be facilitated by orienting the scanning direction S in a plane substantially corresponding to the focal plane of the lens L.
For this purpose and in accordance with an advantageous embodiment of the detection device according to the present invention, the detection device, as shown in
In the case of
It will thus be appreciated that the scanning direction S is thus oriented relative to the direction (not shown in the drawings) of the contrast edge E.
If, on the other hand, the assembly formed by the optical sensors D1 and D2 is placed opposite a stationary lens L, as shown in
Finally, for detecting a two-dimensional target comprising at least two contrast edges, the device for detecting a contrast edge according to the present invention can comprise, as shown in
In a non-limiting embodiment, as shown in
Under these conditions, the two directions of periodic relative displacement are thus substantially perpendicular and are referenced SV and SH in
An arrangement of this type can preferably be achieved, as shown in
Under these conditions, to perform horizontal scanning SH or vertical scanning SV and according to a specific embodiment of the detection device according to the present invention, it is mentioned that the vertical periodic scanning and horizontal periodic scanning can thus be carried alternately. Detection can therefore be carried out in synchronization with the vertical scanning and the horizontal scanning respectively.
By way of example, a contrast edge detector according to the present invention, in which the rotational scanning of the total angle of vision of the optical sensors is obtained by rectilinear translational scanning of two photodiodes placed substantially in the focal plane of a lens of focal distance f=8.5 mm gave the following results:
Δα (minimum visible)
The piezoelectric type actuator with a broad bandwidth of 500 Hz having a small mass of 1.4 g allows the generation of amplitude translation which is a great as 1 mm, in an open loop, with low response times.
The use of a lens L of which the focal distance is 50 times greater than that of 8.5 mm of the tested detector device according to the invention enables a 50 mm wide black bar, such as a high-voltage cable for an electric line, to be detected at a distance of 500 m, or else a 100 mm diameter black bar such as an aerial tramway cable at a distance of 1 km.
A more detailed description of a system for the fixing and fine tracking of a target comprising at least one contrast edge having a light contrast zone which is substantially rectilinear in a given direction which constitutes this contrast edge E will now be given in conjunction with
a is a plan view of an assembly constituting a stabilization system for the line for the sighting and fine tracking of a target comprising at least one contrast edge E according to the subject of the present invention.
The aforementioned system comprises a detection device DD as described hereinbefore in the description in conjunction with
In the aforementioned figure, ET designates a housing which symbolically represents the spatial reference of the human skull and the device DD is therefore a faithful representation of a human eye capable of moving in its socket. An electronic micromotor μME, via a joint system comprising a screw V, link B and crank M without play, allows orientation of the detection device D according to the subject of the present invention relative to the external housing ET and allows a movement comparable to that of the eyeball in its socket in the human skull.
The angular position of the housing ET in an absolute marker is denoted by θh. The sighting line of the detection device DD (axis MOY12 in
Referring to
The system shown in
According to a noteworthy characteristic of the system according to the invention, all this occurs in spite of the rotational disturbances applied to the support ET. In man, the line of sight of the eye is frequently disturbed by movements of the head. The vestibulo-ocular reflex (VOR) enables these disturbances to be rejected. This reflex enables the line of sight to be kept constant despite the rotational disturbances generated by the head.
b shows the block diagram of the system of stabilizing the line of sight and of fine tracking according to the invention.
Referring to the aforementioned
It also comprises a direct control resource, on the basis of an open loop control signal of the orientation of the reference direction of the detection device DD, this resource delivering a direct control signal UVOR on the basis on the measurement of the speed of rotation Ωh of the mechanical support ET.
It finally comprises a loop for visual servo control of the reference direction MOY12 relative to the detected direction θt of at least one contrast edge belonging to the target. This visual servo control loop is formed by the detection device DD, an invertor Inv, a non-linear circuit ZSL and a corrector Cv(p) and delivers the control signal Uv.
Finally, a merger resource enables a linear combination of the direct control signal UVOR and the control signal Uv to be obtained. Referring to
The difference between θg and θt is an error signal which is measured by the detection device DD. It will be appreciated that the control Ue of the electronic micromotor μME ultimately results at each instant from the difference between a signal Uv originating from the visual servo control loop based on the detection device DD and a signal UVOR originating from a corrector CVOR of which the input is the angular velocity of the housing ET measured using the gyrometer H(p).
The angular position θn of the housing constitutes both:
A rotation of the housing ET leads to a rotation of the detection device DD and therefore an angular difference between θg and θt. This difference is compensated by the corrector Cv but with slow dynamics because it is limited by the scanning frequency of the detection device DD. The visual loop alone can reject only rotational disturbances having a maximum frequency of 0.4 Hz for an amplitude of 2°. To accelerate the rejection dynamics of the disturbance θh, a control UVOR of which the function is to drive the orientation of the detection device DD on the basis of a direct measurement of the angular velocity of the disturbance θh (direct control) has thus been added to the control Uv associated with very slow rejection dynamics.
In the ideal theoretical case, CVOR is calculated so as to perfectly compensate for the dynamics introduced by OP and by H(p):
Consequently, when Uv=0, the following is obtained:
θeh=−θh
This means that a rotation of the support ET is perfectly compensated by a rotation of the detection device DD of the same amplitude but in the opposite direction.
However, the transfer function CVOR(p) cannot be used directly, as it is not sufficiently stable. This theoretical transfer function has therefore been approximated by the following transfer function:
This filter made up in this way, is formed by a pseudo-integrator which is cascaded with an all-pass filter which provides the negative phase without modifying the gain curve of the pseudo-integrator.
Ultimately, the system in
The aforementioned merging or combination of the detection device system DD according to the invention with a gyrometric system represents a major development thereof.
It has been established by experiments that the oculomotor system shown in
Tests on the system modeled in this way, as shown in
The aforementioned tests have shown that the introduction of a disturbance corresponding to a rotation of the external housing ET by an angle θh generates a disturbance for the visual corrector Cv and for the corrector CVOR. This disturbance can be broken down into two portions:
Tests conducted in a laboratory have shown that the direction of sight θg is substantially fixed in space, owing to the use of the complete system of which the block diagram is given in
This mode of operation can be compared particularly advantageously to the compensation for the sighting direction of human sight. The tests have shown that, owing to the merging of the visual controls signal Uv and the inertial control signal UVOR, a disturbance of the scale interval type, with an amplitude of 3°, applied to the orientation θh of the external housing ET is rejected at 90% of its final value in 30 ms.
The tests have therefore shown that, even in the presence of a substantially sinusoidal disturbance at a rapid frequency at 2 Hz imposed on the external housing ET, such a disturbance is immediately compensated by a counter-rotation in phase-opposition of the detection device DD representing the eye, the only effect of this compensation being to cause a slight deviation in the angle of sight θg, the effective value of θg having been evaluated at 0.32°, which is 19 times less than the peak-to-peak disturbance of 6° applied to the external housing ET simulating the head.
Finally, tests on the harmonic disturbance applied to the external housing ET were carried out at differing frequencies, the frequency of these disturbances having been selected from a range of values between 0.5 and 6 Hz.
Under these conditions, the variation in the direction of sight θg never exceeded 0.55° up to the aforementioned maximum frequency of 6 Hz.
As a comparison, the maximum frequency of the disturbances that the visual retroaction loop alone is capable of rejecting, in other words in the absence of the combination with the direct control loop VOR, is limited to 0.4 Hz for a peak-to-peak amplitude of 6° applied to the housing.
The performance of the system for stabilizing the line of sight and of fine tracking of a target according to the present invention is noteworthy because the aforementioned system, as described, is capable, when used on board a real-sized helicopter, of compensating the fundamental mode of the vibrations at approximately 5 Hz introduced by the main rotor.
A method and a device for detecting a contrast edge have thus been described, which are particularly powerful in so far as the method and the device according to the invention allow the use of a system which reproduces the behavior of the vision and therefore of the line of sight of the eye of man or of superior mammals.
In particular, the method and the device for detecting a contrast edge according to the present invention and the corresponding system, employing the method and the device, have a wide variety of applications, as mentioned hereinbefore in the introduction to the description.
In particular, it is mentioned as a non-limiting example that the device for detecting a contrast edge according to the present invention, as shown in
Number | Date | Country | Kind |
---|---|---|---|
04 04352 | Apr 2004 | FR | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/FR2005/000643 | 3/16/2005 | WO | 00 | 4/20/2007 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2005/111536 | 11/24/2005 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
3444544 | Busch et al. | May 1969 | A |
3507991 | Scotchie et al. | Apr 1970 | A |
Number | Date | Country | |
---|---|---|---|
20070216910 A1 | Sep 2007 | US |