The invention relates to an obstacle detection device arranged on a mobile vehicle and applies in particular to the field of navigation. The invention also relates to an obstacle detection method employing such a device.
When a mobile vehicle such as a robot is moving around, it is desirable to avoid any collision between the mobile vehicle and an obstacle situated in the environment in which the mobile vehicle is moving, for example in order not to damage the mobile vehicle and/or the obstacle.
For any mobile vehicle and, therefore, also for a robot able to move, it is very important to take into account the safety of the mobile vehicle and of the elements in its environment. The safety of the vehicle and of the elements in its environment notably includes detecting obstacles in the environment and avoiding collisions with these obstacles. There are various techniques for avoiding collisions. Most of these techniques involve significant implementation costs and require significant computation power in order, for example, to determine the position of the robot in a certain frame of reference. Other existing techniques are very expensive and are therefore not suited to use in a robot.
The invention seeks to alleviate all or some of the problems mentioned hereinabove by proposing a device for detecting obstacles situated in the environment of a mobile vehicle and a method employing such a device.
To this end, one subject of the invention is an obstacle detection device intended to be fitted to a mobile vehicle able to move parallel to a reference plane, characterized in that it comprises:
According to one embodiment, the vehicle has a favored direction of travel in a first direction along an axis X and the device further comprises a first emitter referred to as an oblique emitter of a first oblique beam extending in a first oblique virtual plane in the first direction along the axis X and secant with the reference plane, and a second emitter referred to as an oblique emitter of a second oblique beam extending in a second oblique virtual plane in the first direction along the axis X and secant with the reference plane. The device also comprises a first image sensor able to produce an image around the intersection of the first and second oblique virtual planes with the reference plane.
According to one embodiment of the invention, the device comprises a first emitter referred to as a horizontal emitter of a first horizontal electromagnetic beam extending in a first virtual plane substantially parallel to the reference plane and the first image sensor is able to produce an image of the intersection of the first virtual plane and of the obstacle.
According to another embodiment, the first virtual plane forms an angular sector around the axis X, and the device further comprises a second emitter referred to as a horizontal emitter of a second horizontal beam extending in a second virtual plane in a first direction, forming an angular sector about an axis Y perpendicular to the axis X and substantially parallel to the reference plane. The device comprises a second image sensor able to produce an image of the intersection of the second virtual plane and of the obstacle. The device comprises a third emitter referred to as a horizontal emitter of a third horizontal beam extending in a third virtual plane in a second direction, the opposite of the first direction, forming an angular sector about the axis Y and substantially parallel to the reference plane, and a third image sensor able to produce an image of the intersection of the third virtual plane and of the obstacle.
Advantageously, the angular sector formed by the first horizontal beam is spaced away from the angular sectors formed by the second and third horizontal beams by a predefined angle.
Advantageously, the angular sector is 120°.
According to another embodiment, the device further comprises positioning means for positioning a virtual plane referred to as a horizontal plane, which means are intended to position said virtual plane referred to as a horizontal plane in such a way that it does not intersect the reference plane.
The positioning means may consist of a control loop able to determine an angular position of the virtual plane referred to as a horizontal plane with respect to the reference plane and to transmit a new angular position to the emitter referred to as a horizontal emitter that forms the virtual plane referred to as a horizontal plane.
The positioning means may also consist of a positive angle between the virtual plane referred to as a horizontal plane and the reference plane.
According to another embodiment, the device further comprises an emitter referred to as a shovel emitter of a shovel beam extending in a virtual plane configured to intersect with the reference plane along a straight line perpendicular to the axis X, and the first image sensor is able to produce an image of the straight line.
Advantageously, the beam or beams are laser beams.
Advantageously, the device comprises control means configured to selectively deactivate emitters and sensors according to the direction of travel of the vehicle.
Advantageously, the device further comprises a processing circuit configured to sequence the emissions of beams by the emitters and to synchronize the emissions of beams with the capturing of images by the sensors.
Another subject of the invention is a vehicle employing such a device.
Another subject of the invention is an obstacle detection method employing such a device, characterized in that it comprises the following steps:
According to one embodiment, the method according to the invention may also involve the following steps:
The mobile vehicle is, for example, a robot. This robot may have wheels to allow it to move around on a reference plane. The invention also applies to a humanoid robot moving on legs.
Alternatively, the mobile vehicle may be any type of vehicle moving around parallel to a reference plane, either in contact with the reference plane via wheels, or on air cushions.
Another subject of the invention is a humanoid robot comprising a detection device according to the invention.
A humanoid robot means a robot exhibiting similarities with the human body. This may be the upper part of the body, or just an articulated arm ending in a gripper that can be likened to a human hand. In the present invention, the upper part of the robot body is similar to that of a human torso. A detection device according to the invention makes it possible to determine obstacles in the environment of the robot.
The invention will be better understood and further advantages will become apparent on reading the detailed description of one embodiment given by way of example, which description is illustrated by the attached drawing in which:
For the sake of clarity, the same elements will bear the same references in the various figures.
In the description, the invention is described with the example of an implementation on a robot and, more particularly, on a robot moving around by means of wheels. However, the invention applies to any mobile vehicle. A mobile vehicle 11 has a favored direction of travel in a first direction along an axis X.
The device 10 comprises a first emitter referred to as a horizontal emitter 14 of a first horizontal beam 15 extending in a first virtual plane 22 substantially parallel to the reference plane 12 and the first image sensor 5 able to produce an image of the intersection of the first virtual plane 22 and of the obstacle.
Because the mobile vehicle 11 has a favored direction of travel in the first direction along the axis X, the first virtual plane 22 forms an angular sector about the axis X, and the device 10 further comprises a second emitter referred to as a horizontal emitter 16 of a second horizontal beam 17 extending in a second virtual plane 23 in a first direction, forming an angular sector about an axis Y perpendicular to the axis X and substantially parallel to the reference plane 12. The device 10 comprises a second image sensor 6 able to produce an image of the intersection of the second virtual plane 23 and of the obstacle. The device comprises a third emitter referred to as a horizontal emitter 19 of a third horizontal beam 20 extending in a third virtual plane 24 in a second direction that is the opposite of the first direction, forming an angular sector about the axis Y and substantially parallel to the reference plane 12. The device 10 comprises a third image sensor 7 able to produce an image of the intersection of the third virtual plane 23 and of the obstacle.
Advantageously, the angular sector 22 formed by the first horizontal beam 15 is spaced away from the angular sectors 23, 24 formed by the second and third horizontal beams 17, 20 by a predefined angle.
The angular sector may be 60° and the predefined angle 30°. It is also possible to have an angular sector of 90°. Advantageously, the angular sector is 120° and the predefined angle is 0°. This configuration provides complete coverage of the environment around the mobile vehicle 11.
The first, second and third emitters referred to as horizontal emitters 14, 16, 19 are positioned on the mobile vehicle 11 at a certain height 25 from the reference plane 12 (visible in
The image sensor 5 may also be a “wide angle” image sensor able on its own to capture images of the three virtual planes 22, 23 and 24.
Advantageously, the detection device according to the invention comprises means 67 so that the virtual plane 22 is always above the reference plane 12 in a field 36 covered by the image sensor 5.
The means 67 whereby the virtual plane 22 is always above the reference plane 12 in a field 36 may consist of a control loop that allows the emitter 14 of the beam 15 to be oriented in such a way as to orient the virtual plane 22 according to its orientation when the mobile vehicle 11 is in motion. Thus, if the mobile vehicle 11 is moving over a reference plane that has unevennesses, as depicted in
According to another configuration, the positioning means consist of an angle 72 between the virtual plane referred to as a horizontal plane 22 and the reference plane 12. The virtual plane 22 may therefore be oriented slightly upward. In other words, it forms the angle 72, which is a positive angle, with the reference plane 12. Thus, the virtual plane 22 never intersects the reference plane 12 even when the mobile vehicle 11 is in motion. The image sensor 5 is able to produce an image of the intersection of the virtual plane 22 and of a potential obstacle.
It is also possible to define a detection surface 71 which corresponds to the intersection of the virtual plane 22 and of the cone formed by the field 36 covered by the image sensor 5. The virtual plane 22 alone may intersect with a potential obstacle having approximately a height greater than or equal to the height 25 and which may be situated at infinity. Because of the positive angle 72 and the field 36 of the image sensor 5, the detection surface 71 is situated near the mobile vehicle 11. Detecting a potential obstacle therefore amounts to detecting the appearance of an image at the detection surface 71.
The oblique beams 30, 31 may intersect with small obstacles, holes or larger obstacles with which the horizontal beams 15, 17, 20 may possibly not have been able to intersect.
In other words, the virtual plane 26 formed by the shovel beam 27 allows a scan to be made of the reference plane 12. The image sensor 5 is able to produce an image of the straight line 70. An image analysis means is able to determine the presence of the obstacle, the analysis means being configured to compare the image from the sensor 5 with a reference image. It is therefore a matter of projecting a line onto the reference plane 12 in the field 36 of the image sensor 5. The use of the virtual plane 26 instantaneously makes it possible to detect, if an obstacle is present, a deformation of the line 70. Moreover, it is possible to store in memory everything that lies in the volume between the virtual plane 26 and the reference plane 12. Thus, in a use coupled with time (namely with successive positions of the mobile vehicle 11) and with memory storage, the moment in time at which there is an obstacle in the environment of the mobile vehicle 11 is known. In other words, it is possible to store in memory, at different moments in time, a first image and a second image of the intersection of the virtual plane 26 formed by the shovel beam 27 with the reference plane 12. The first and second images are compared in order to define the location of the obstacle. The obstacle may be located in a fixed frame of reference or in a frame of reference connected with the mobile vehicle 11. This obstacle detection and location may be performed when the mobile vehicle is moving in the first direction along the axis X, but also in the opposite direction from the first direction (which means to say when moving forward or backward). It is then possible to slow the mobile vehicle 11 and stop it before it collides with the obstacle or to make it divert its path. Finally, in the extreme case of the line 70 disappearing, that means that the mobile vehicle 1 is near a cliff or a step of a staircase, because the image sensor 5 is then no longer able to produce an image of the straight line 70 which is then at a lower level than the reference plane 12. Conversely, as soon as the image sensor 5 is able to produce an image, which means to say a break in the virtual plane 26, that means either that the mobile vehicle 11 can move forward and back on the reference plane 12 without the risk of falling into a void (cliff, staircase, etc.), or that the mobile vehicle 11 is in the presence of an obstacle nearby.
It should be noted that the shovel beam can be used alone, independently of the other oblique and horizontal beams. Likewise it is entirely possible to use only the oblique beams. Finally, it is possible to use several beams together, for example a shovel beam with a horizontal beam, a shovel beam with an oblique beam, an oblique beam with a horizontal beam or another other combination of two or more beams.
Thus, the six beams 15, 17, 20, 27, 30, 31 allow the device 10 to form an intersection with virtual planes and any obstacle situated in a nearby environment.
More specifically, the virtual planes 26, 28, 29 intersect the reference plane 12 (which in most cases corresponds to the ground on which the mobile vehicle 11 is moving) and thus form a straight line. If an obstacle is present, the line thus formed is perturbed, and it is the perturbation of the line that reveals the presence of an obstacle.
It is important to note that the image sensor 5, for example a camera, is advantageously synchronized with the beam emitters, allowing the beam emitters to be active only during the exposure time of the image sensor 5. It is also necessary to take into account the offset between the moment in time the decision to expose is taken (for example on the part of a processor PROC arranged in the mobile vehicle 11) and the moment in time at which the image sensor actually does capture the image.
It is also particularly advantageous to sequence all the beam-emitting apparatus with one another by using a common pulse. This synchronization makes it possible to avoid interference between various beams, which would supply incorrect information to the image capture and image analysis apparatus.
In order to do this, as depicted in
The device 10 further comprises a processing circuit 9 configured to sequence the emissions of beams by the emitters and to synchronize the emissions of beams with the capturing of images by the sensors. Thus, the beams are emitted one after the other or simultaneously depending on the configuration the mobile vehicle 11 is in. And, on each emission of a beam, the associated image sensor captures an image. For example, in order to obtain a panoramic view of the environment of the mobile vehicle 11, the three horizontal beams 15, 17, 20 are emitted simultaneously and the three image sensors 5, 6, 7 each produce an image. If a view of the favored direction of travel along the axis X is desired, the first horizontal beam may be emitted before the beam referred to as the shovel beam, and the corresponding image sensor 5 is activated in sequence, capturing a first image at the same time as the horizontal beam is emitted, then a second image at the same time as the beam referred to as the shovel beam is emitted.
Advantageously, the beam or beams are laser beams.
The device 10 according to the invention may also have an exposure control means available and this may consist of a contrast-enhancing algorithm enhancing the contrast between the light of the emitted beam and the environment. Such a control means may notably allow the device 10 to consider only a zone referred to as a safety zone in a close environment of the mobile vehicle 11. The precision with which the obstacle is determined is thus improved.
Because a component cannot be produced with a rigorously exact geometry and dimensions, and in order for the component to be able to perform its functions in a mechanism, tolerances (dimensional and geometric) are defined. These tolerances may have an impact on the precision of the measurements. The device 10 may have available to it a mechanism for calibrating the angle of inclination of the image sensor 5 and the angle of inclination of the emitters 14, 16, 19 of the beams 15, 17, 20. Such a calibration mechanism is generally employed in a known environment and ensures good precision of the measurements and therefore of the determination of the obstacle.
The method further comprises the following steps:
After the obstacle has been determined (step 120) it is possible for the vehicle 11 to perform a further action. Mention may be made by way of example of a navigation action with a change in path or a stoppage. The device 10 according to the invention may also have a library of reference images available to it. These reference images correspond to predefined images allowing, in addition to obstacle detection, obstacle recognition by comparing the image produced by the image sensor 5 with the reference images. The image analysis thus performed may notably allow the mobile vehicle 11 to recognize its recharging base and head in that direction in order to recharge its battery.
Advantageously, after image capture and obstacle determination (step 110), the location of the obstacle is communicated in Cartesian coordinates in the frame of reference containing the axes X and Y. That allows the information transmitted to be compressed.
Finally, it is possible to reduce the resolution of the images captured by the image sensor in order to reduce the cost of the device 10. It is also possible to manage all the beam emitters and image sensors using one single processor, again with a view to reducing the costs of the device 10.
Number | Date | Country | Kind |
---|---|---|---|
1455099 | Jun 2014 | FR | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2015/062214 | 6/2/2015 | WO | 00 |