A solid-state Lidar system includes a photodetector, or an array of photodetectors that is essentially fixed in place relative to a carrier, e.g., a vehicle. Light is emitted into the field of view of the photodetector and the photodetector detects light that is reflected by an object in the field of view. For example, a Flash Lidar system emits pulses of light, e.g., laser light, into essentially the entire the field of view. The detection of reflected light is used to generate a 3D environmental map of the surrounding environment. The time of flight of the reflected photon detected by the photodetector is used to determine the distance of the object that reflected the light.
The solid-state Lidar system may be mounted on a vehicle to detect objects in the environment surrounding the vehicle and to detect distances of those objects for environmental mapping. The output of the solid-state Lidar system may be used, for example, to autonomously or semi-autonomously control operation of the vehicle, e.g., propulsion, braking, steering, etc. Specifically, the system may be a component of or in communication with an advanced driver-assistance system (ADAS) of the vehicle.
Since the solid-state Lidar system is fixed in place relative to the vehicle, ride-height and/or angle of the vehicle can change the aim of the field of view. The ride-height and/or angle of the vehicle may change, e.g., from changes in weight and/or center of gravity. This may be caused by, for example, varying weight, location, and/or age of occupants, varying weight and/or location of cargo, changes in an active-suspension system of the vehicle, changes in an active-ride-handling system of the vehicle, etc. Difficulties can arise in properly aiming the vertically-narrow field of view during such changes in the vehicle and over the lifetime of the vehicle.
With reference to the Figures, wherein like numerals indicate like parts throughout the several views, a system 10 is generally shown. Specifically, the system 10 is a light detection and ranging (Lidar) system 10. The system 10 includes a light emitter 12 that emits light into a field of illumination FOI and a photodetector 14 that has a field of view FOV that overlaps the field of illumination FOI. For the purpose of this disclosure “photodetector” includes a single photodetector or an array of photodetectors (including 1D arrays, 2D arrays, etc). The system 10 detects the emitted light that is reflected by an object in the fields of view, e.g., pedestrians, street signs, vehicles, etc.
The system 10 independently adjusts the vertical and/or horizontal aim of the field of illumination FOI and the vertical aim of the field of view FOV to align the field of illumination FOI and the field of view FOV. This alignment may be performed repeatedly and in the field, i.e., during use of the system 10, such that the system 10 can recalibrate the relative positions of the field of illumination FOI and field of view FOV in the field, e.g., before, during, and/or after operation. For example, the system 10 may be mounted on a vehicle 16 and the alignment of the field of illumination FOI and the field of view FOV may be performed at any suitable time, e.g., before, during, and/or after operation of the vehicle 16. As examples, changes in the ride-height and/or angle of the vehicle 16 may be caused by changes in weight, center of gravity of the vehicle 16. This may be cause by, for example, varying weight, location, and/or age of occupants, varying weight and/or location of cargo, changes in an active-suspension system of the vehicle 16, changes in an active-ride-handling system of the vehicle 16, etc. In such an event, the field of view FOV may be adjusted to a desired vertical position, and the field of illumination FOI may be independently adjusted to align the field of illumination FOI with the field of view FOV. Specifically, due to the requirement of a high-resolution Lidar system, the height of the vertical aim of the field of view FOV may be limited, and the system 10 allows for adjustment of the vertical aim of the system 10. This improves the system requirements on the field of view FOV. The system 10 adjusts the field of illumination FOI to align with the field of view FOV.
In the examples shown in
The system 10 is shown in
The system 10 may be a solid-state Lidar system. In such an example, the system 10 is stationary relative to the vehicle 16. For example, the casing 18 that is fixed relative to the vehicle 16, i.e., does not move relative to the component of the vehicle to which the casing 18 is attached, and a silicon substrate of the system 10 is supported by the casing 18.
As a solid-state Lidar system, the system 10 may be a Flash Lidar system. In such an example, the system 10 emits pulses of light into the field of illumination FOI. More specifically, the system 10 may be a 3D Flash Lidar system that generates a 3D environmental map of the surrounding environment, as shown in part in
With reference to
The controller 26 may be a microprocessor-based controller or field programmable gate array (FPGA) implemented via circuits, chips, and/or other electronic components. In other words, the controller 26 is a physical, i.e., structural, component of the system 10. For example, the controller 26 may include a processor, memory, etc. The memory of the controller 26 may store instructions executable by the processor, i.e., processor-executable instructions, and/or may store data. The controller 26 may be in communication with a communication network of the vehicle 16 to send and/or receive instructions from the vehicle 16, e.g., components of the ADAS.
As described further below, the controller 26 (as shown in
The light source 28 emits light into the field of illumination FOI for detection by the photodetector 14 when the light is reflected by an object in the field of view FOV, as shown in
With continued reference to
As one example, the beam-steering device 20 includes an active mirror 32, i.e., a movable mirror, that is adjustable to aim light from the light emitter 12 into the field of illumination FOI. In other words, the light emitter 12 (and potentially other components of the light source 28) is positioned to emit light at the active mirror 32 directly from the light emitter 12 or indirectly from the light emitter 12 through intermediate components.
Specifically, the active mirror 32 may be a micromirror. For example, the beam-steering device 20 may be a micro-electro-mechanical systems (MEMS) mirror. As an example, the beam-steering device 20 may be a digital micromirror device (DMD). The MEMS mirror may include one mirror or may include an array of mirrors that are capable of being tilted to deflect light. As another example, the MEMS mirror may include one or more mirrors each on a gimbal that is tilted, e.g., by application of voltage.
In addition to or in the alternative to the MEMS mirror, the beam-steering device 20 may include a diffuser. As another example, the beam-steering device 20 may be a liquid-crystal solid-state device, which can steer the light beam through a change in index of refraction due to an applied voltage.
The field of illumination FOI is the area exposed to light that is emitted from the light source 28. In one example, as shown in
As set forth above, the system 10 aligns the field of view FOV and the field of illumination FOI. In other words, the system 10 positions the field of view FOV and the field of illumination FOI to a desired relative position, vertically and optionally horizontally. As one example, the field of view FOV and the field of illumination FOI are “aligned” when positioned such that the maximum intensity of reflected light in the field of view FOV is detected by the photodetector 14. The field of view FOV and the field of illumination FOI may be centered to the positions that provide the maximum detected intensity. As another example, the field of illumination FOI and the field of view FOV may be centered in order to optimize the horizon at the desired level of the scene.
With continued reference to
Three examples of the light source 28 are shown in
With reference to
In the example shown in
In the example shown in
The second light emitter 46 is stationary relative to the casing 18 and the second beam-steering device 48 is configured to direct light from the second light emitter 46 into a second field of illumination. The second photodetector 44 is pivotally supported by the housing 24 and has a second field of view overlapping the second field of illumination. In other words, the second photodetector 44 detects light that was emitted by the second light emitter 46 and reflected by an object in the second field of view. The field of view FOV and field of illumination FOI may be different than the second field of view and second field of illumination, respectively. As an example, the field of view FOV/field of illumination FOI may be shorter and/or wider than the second field of view/field of illumination FOI, e.g., for short-range and long-range detection.
With continued reference to
With reference to
The receiving unit 30 includes the photodetector 14 and may include receiving optics 54. The photodetector 14 may be, for example, an avalanche photodiode detector or PIN detector. As one example, the photodetector 14 may be a single-photon avalanche diode (SPAD). The field of view FOV is the area in which reflected light may be sensed by the photodetector 14. Light reflected in the field of view FOV is reflected to receiving optics 54. The receiving optics 54 may include any suitable number of lenses, filters, etc.
With reference to
Specifically, the light emitter 12 is stationary relative to the casing 18. In other words, the light emitter 12 does not move relative to the casing 18 during operation of the system 10. The light emitter 12 may be mounted to the casing 18 in any suitable fashion such that the light emitter 12 and the casing 18 move together as a unit.
The system 10 includes a heat sink 56 on the casing 18 adjacent the light emitter 12. The heat sink 56 may include, for example, a wall 58 adjacent the light emitter 12 and fins 60 extending away from the wall 58 exterior to the casing 18 for dissipating heat away from the light emitter 12. The wall 58 and/or fins 60, for example, may be material with relatively high heat conductivity. The light emitter 12 may, for example, abut the wall 58 to encourage heat transfer. The first light emitter 12 and second light emitter 46 may also include additional cooling methods, e.g. thermal electric coolers TEC.
The stationary mirrors and diffusers are supported by the casing 18. Specifically, the stationary mirrors and diffusers are stationary relative to the casing 18. The stationary mirrors and diffusers may be mounted to the casing 18 in any suitable fashion so as to move with the casing 18 as a unit.
The beam-steering device 20 is supported by the casing 18. In the example in which the beam-steering device 20 includes a micromirror, the micromirror may be movable relative to the casing 18 to direction the reflection of the light emitted from the light emitter 12.
As set forth above, the housing 24 supports the photodetector 14, 44 and is pivotally supported by the casing 18 for pivoting (i.e., tilting, swiveling, etc.) the photodetector 14, 44. Specifically, the housing 24 may be pivotally engaged with the casing 18, i.e., directly in contact with the housing 24, or may be coupled to the housing 24 through an intermediate component. The photodetector 14, 44 is stationary relative to the housing 24, i.e., moves as a unit with the housing 24, such that the housing 24 can be pivoted relative to the casing 18 to adjust the field of view FOV of the photodetector 14, 44.
The housing 24 is pivotable relative to the casing 18 about a horizontal axis A, i.e., can swivel, tilt, etc., about the horizontal axis A. Specifically, horizontal pivot points 62, i.e., pivot points 62 that allow for pivoting about a horizontal axis A, connect the housing 24 to the casing 18. The horizontal pivot points 62 are spaced from each other along a horizontal axis A. The casing 18 and/or the housing 24 may include brackets 64 that support the horizontal pivot points 62. The housing 24 may be horizontally fixed to the casing 18, i.e., does not move relative to the casing 18 about a vertical axis. As another example, the housing may be movable relative to the casing about a vertical axis to horizontally selectively steer the field of illumination FOI, and in such an example, the housing may be moveble through a fixed range of angles, e.g., less than 180°. In other words, system 10 is not a 360° scanning system.
The actuator 22 is between the housing 24 and the casing 18 for pivoting the housing 24 relative to the casing 18. For example, the actuator 22 may be fixed to the casing 18 and the housing 24 to move the casing 18 and the housing 24 relative to each other about the horizontal pivot points 62.
The actuator 22 may be, for example, an electric motor. As one example, the motor may include a base 66 fixed to one of the casing 18 and the housing 24 and a plunger 68 fixed to the other of the casing 18 and the housing 24. The motor may be powered to retract the plunger 68 into the base 66 or extend the plunger 68 from the base 66 to move the housing 24 relative to the casing 18. In such an example, the actuator 22 is spaced from the horizontal pivot points 62 such that force exerted between the casing 18 and the housing 24 by the actuator 22 moves the casing 18 and the housing 24 about the horizontal pivot points 62. As another example, the motor may provide a rotary input to the housing 24. For example, the motor may be between the housing 24 and the casing 18 at one or both horizontal pivot points 62 and may exert a rotational force at the pivot point to rotate the housing 24 relative to the casing 18.
As set forth above, the controller 26 is schematically shown in
The controller 26 may be programmed to receive indication that the field of view FOV needs adjustment. For example, it may be detected that the field of view FOV is vertically offset from a horizontal position, e.g., horizon, to a degree that the field of view FOV needs to be readjusted. As an example, the field of view FOV may change when the ride-height and/or angle of the vehicle 16 change, as described above. In response to such an indication, the controller 26 adjusts the position of the photodetector 14. For example, the controller 26 pivots the photodetector 14 to vertically position the field of view FOV to a desired position, e.g., to a horizontal position. Specifically, the controller 26 may pivot the housing 24 relative to the casing 18, which adjusts the field of view FOV of the photodetector 14 because the photodetector 14 moves as a unit with the housing 24. For example, the controller 26 may be programmed to power the actuator 22 to pivot the housing 24. In the example in which the actuator 22 is the motor, the actuator 22 may be powered to extend or retract the plunger 68 to move the housing 24 relative to the casing 18.
After adjustment of the field of view FOV, the field of illumination FOI may be adjusted to align the field of view FOV and the field of illumination FOI. In other words, the beam-steering device 20 is adjusted in response to adjustment of the field of view FOV to align the field of view FOV and the field of illumination FOI. Specifically, the field of illumination FOI may be adjusted vertically and/or horizontally to align the field of view FOV and the field of illumination FOI.
Specifically, the controller 26 is programmed to activate the light emitter 12, i.e., to instruct the light emitter 12 to emit light. Similarly, with reference to the example in
The controller 26 is programmed to receive data from the photodetector 14 indicating detection of light from the light emitter 12 that was reflected by an object in a field of view FOV of the photodetector 14. Similarly, in the example shown in
After the position of the photodetector 14 has been set for the new vehicle position (e.g., in block 1020 in
In the example where the beam-steering device 20 is the micro-electro-mechanical systems mirror, the controller 26 is programmed to adjust the voltage supplied to the micro-electro-mechanical systems mirror to adjust the vertical and/or horizontal position of the field of illumination FOI. Specifically, the change in voltage turns the active mirror 32, e.g., about a gimbal, to adjust the position of the field of illumination FOI.
As set forth above, the alignment of the field of view FOV and the field of illumination FOI may be based on maximum detection of reflected light on an object in the field of view FOV. In other words, the controller 26 is programmed to adjust the beam-steering device 20 (vertically and//or horizontally) and the photodetector 14 to align the field of view FOV and the field of illumination FOI to the position that provides the maximum intensity of light reflected by an object in the field of view FOV.
In such an example, the controller 26 is programmed to identify changes in intensity of light reflected by an object in the field of view FOV as the beam-steering device 20 and/or photodetector 14 are adjusted. As an example, the controller 26 may be programmed to set the position of the field of view FOV and scan through various vertical and/or horizontal positions of the field of illumination FOI to identify the position of the field of view FOV that provides the maximum intensity of detected reflections. In the example in which the position of the photodetector 14 is also adjusted to align the field of view FOV and the field of illumination FOI, the field of view FOV may be set to several other positions and controller 26 scans through the various vertical positions of the field of illumination FOI at each of these positions of the field of view FOV. In addition to scanning through the various vertical positions of the field of illumination FOI, the controller 26 may scan through various horizontal positions of the field of illumination FOI. During the scanning of the various vertical positions of the field of view FOV and the various vertical and/or horizontal positions of the field of illumination FOI, the combination of position of the field of view FOV (i.e., the vertical position) and the position of the field of illumination FOI (the vertical and/or horizontal positions) that provide the maximum illumination of reflections in the field of view FOV may be identified. In other words, the controller 26 is programmed to determine the position of the beam-steering device 20 and the photodetector 14 that provide the maximum intensity of light reflected by an object in the field of view FOV. Once these positions are identified, the processor is programmed to adjust the beam-steering device 20 and the photodetector 14 to these positions, i.e., to center the field of illumination FOI on the field of view FOV based on the changes in intensity.
A method 1000 of operating the examples shown in
In block 1010, the method includes receiving an indication that the field of view FOV needs vertical adjustment. As set forth above, the field of view FOV may need to be adjusted when the field of view FOV is vertically offset from a horizontal position, e.g., the horizon, to a degree that the field of view FOV needs to be readjusted. The detection that the field of view FOV needs vertical adjustment may be made by the system 10 itself and/or by other components of the vehicle 16, e.g., components that monitor ride characteristics of the vehicle 16.
In block 1020, the method includes, in response the indication that the field of view FOV needs vertical adjustment, adjusting the position of the photodetector 14. Block 1020 includes pivoting the housing 24 relative to the casing 18, which adjusts the field of view FOV of the photodetector 14 because the photodetector 14 moves as a unit with the housing 24. Specifically, the method includes powering the motor to extend or retract the plunger 68 to move the housing 24 relative to the casing 18. The system 10 itself may determine the desired position to be set in block 1020 and/or the desired position may be based on data and/or instruction from other components of the vehicle 16.
The method includes activating a light emitter 12, receiving data from the photodetector 14 indicating detection of light from the light emitter 12 that was reflected by an object in a field of view FOV, and adjusting the beam-steering device 20 to vertically and/or horizontally) align the field of view FOV with the field of illumination FOI. Specifically, in blocks 1030, 1040, and 1050, the method includes setting the position of the field of view FOV and scanning through various positions of the field of illumination FOI. This data is used to identify the position of the field of view FOV that provides the maximum intensity of detected reflections.
In decision block 1060, the method includes determining whether the scan in blocks 1030, 1040, and 1050 is to be repeated for another position of the photodetector 14. As set forth above, the photodetector 14 may be adjusted within a predetermined acceptable deviation from the position set in block 1020. In such an example, the method may repeat blocks 1030, 1040, and 1050 for a predetermined number of sample angles, i.e., if the answer is yes in block 1060. In other words, the method may include scanning several positions of the photodetector 14 at several positions of the beam-steering device 20. If blocks 1030, 1040, and 1050 are to be repeated, block 1065 includes adjusting the position of the photodetector 14 before block 1030 is performed again.
If the answer is no in decision block 1060, the method includes determining the position of the beam-steering device 20 and/or the photodetector 14 that provide the maximum intensity reflection. In block 1080, the method includes adjusting the beam-steering device 20 (i.e., vertically and/or horizontally) and/or the position of the photodetector 14 (i.e., vertically) to the position that provides the maximum intensity reflection.
A method 1100 of operating the example shown in
Similar to blocks 1030, 1040, and 1050 in
In block 1150, the method includes determining the positions (vertical and/or horizontal) of the beam-steering device 20 and the second beam-steering device 48 that provide the maximum intensity reflection, respectively. In block 1060, the method includes adjusting the beam-steering device 20 and the second beam-steering device 48 to the respective positions that provide the maximum intensity reflections.
The disclosure has been described in an illustrative manner, and it is to be understood that the terminology which has been used is intended to be in the nature of words of description rather than of limitation. Many modifications and variations of the present disclosure are possible in light of the above teachings, and the disclosure may be practiced otherwise than as specifically described.