Patent Application
20220230016
The present disclosure relates to driver assist and autonomous vehicle systems, and more specifically to a system and method of locating a vehicle relative to objects proximate a vehicle.
Vehicles may be equipped with a driver assist and/or autonomous vehicle operation system to operate a vehicle partially and/or fully independent of a vehicle operator.
In automated driving scenarios, it is important to know where the vehicle is exactly located on a map (a process known as localization) and simultaneously where things are in the world around the vehicle (a process known as mapping). Localization is often achieved using landmarks however situations arise when a landmark is not available or cannot be classified by the sensor data.
The background description provided herein is for the purpose of generally presenting a context of this disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present disclosure.
A simultaneous localization and mapping system for a motor vehicle according to one example disclosed embodiment includes, among other possible things, a plurality of sensors disposed within a vehicle operable to detect an object proximate the vehicle and generate a plurality of data points representing sensor returns corresponding to the detected objects surrounding the vehicle, and a controller configured to receive the data points representing the sensor returns of the detected objects surrounding the vehicle, to define an occupancy grid based on the data points and to generate vehicle operating instructions based on the defined occupancy grid, wherein the controller is configured to define at least one geometric anchor from the detected data points and localizing the vehicle based on the at least one geometric anchor.
In another embodiment of the foregoing simultaneous localization and mapping system, the controller is configured to locate the vehicle relative to the at least one geometric anchor.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the plurality of data points representing sensor returns comprise an initial set of data points and additional sets of data points and the controller is further configured to correlate each of the additional sets of data points to the at least one geometric anchor.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the controller is further configured to estimate a position of the vehicle based on the correlation between additional sets of data points and the at least one geometric anchor.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the controller is further configured for correcting an odometry model of the vehicle based on the estimated position of the vehicle provided by the correlation between the additional sets of data points and the at lease one geometric anchor.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the controller is further configured to redefine the at least one geometric anchor in response to at least one of a redefined distance of vehicle travel or a predefined number of additional sets of data points.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the at least one geometric anchor comprises two or more geometric anchors that define boundaries of a path of the vehicle.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the at least one geometric anchor comprises a set of data points on the generated occupancy grid arranged in a straight line.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the at least one geometric anchor comprises a set of data points on the generated occupancy grid arranged in a rectilinear shape or a curvilinear shape.
In another embodiment of any of the foregoing simultaneous localization and mapping systems, the plurality of sensors comprises at least one of a radar device, a lidar device and a camera.
A simultaneous localization and mapping method for a vehicle according to another disclosed example embodiment includes, among other possible things, detecting objects proximate to a vehicle with a plurality of sensors and generating a plurality of data points representing sensor returns corresponding to the detected objects surrounding the vehicle, and generating an occupancy grid based on the data points representing sensor returns with a processing device disposed within the vehicle and defining at least one geometric anchor from the detected data points and localizing the vehicle relative to the at least one geometric anchor.
Another embodiment of the foregoing method of simultaneous localization and mapping further includes generating a plurality of data points representing data points comprises generating an initial set of data points and additional sets of data points and generating the occupancy grid further comprises correlating each of the additional sets of data points with the at least one geometric anchor.
Another embodiment of any of the foregoing methods of simultaneous localization and mapping further comprises estimating a position of the vehicle based on the correlation between additional sets of data points and the at least one geometric anchor.
Another embodiment of any of the foregoing methods of simultaneous localization and mapping further comprises correcting an odometry model of the vehicle based on the estimated position of the vehicle provided by the correlation between the additional sets of data points and the at lease one geometric anchor.
Another embodiment of any of the foregoing methods of simultaneous localization and mapping further comprises redefining the at least one geometric anchor in response to a redefined distance of vehicle travel.
Another embodiment of any of the foregoing methods of simultaneous localization and mapping further comprises redefining the at least one geometric anchor in response to obtaining a predefined number of additional sets of data points.
In another embodiment of any of the foregoing methods of simultaneous localization and mapping, the at least one geometric anchor comprises two or more geometric anchors that define boundaries of a path of the vehicle.
In another embodiment of any of the foregoing methods of simultaneous localization and mapping, the at least one geometric anchor comprises a set of data points on the generated occupancy grid arranged in a straight line.
In another embodiment of any of the foregoing methods of simultaneous localization and mapping, the at least one geometric anchor comprises a set of data points on the generated occupancy grid arranged in a rectilinear shape.
In another embodiment of any of the foregoing methods of simultaneous localization and mapping, the at least one geometric anchor comprises a set of data points arranged in a curvilinear shape.
Although the different examples have the specific components shown in the illustrations, embodiments of this disclosure are not limited to those particular combinations. It is possible to use some of the components or features from one of the examples in combination with features or components from another one of the examples.
These and other features disclosed herein can be best understood from the following specification and drawings, the following of which is a brief description.
Referring to
The SLAM 25 is an algorithm executed by a controller 24 of the vehicle 20. The controller 24 is schematically shown and includes at least a processing device 26 and a memory device 30. The controller 24 and the processing device 26 may be a hardware device for executing software, particularly software stored in the memory 30. The processing device 26 can be a custom made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the computing device, a semiconductor based microprocessor (in the form of a microchip or chip set) or generally any device for executing software instructions.
The memory 30 can include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, VRAM, etc.)) and/or nonvolatile memory elements. Moreover, the memory 30 may incorporate electronic, magnetic, optical, and/or other types of storage media. Note that the memory can also have a distributed architecture, where various components are situated remotely from one another, but can be accessed by the processor.
The software in the memory 30 may include one or more separate programs, each of which includes an ordered listing of executable instructions for implementing disclosed logical functions and operation. A system component embodied as software may also be construed as a source program, executable program (object code), script, or any other entity comprising a set of instructions to be performed. When constructed as a source program, the program is translated via a compiler, assembler, interpreter, or the like, which may or may not be included within the memory.
Input/Output devices (not shown) that may be coupled to system I/O Interface(s) may include input devices, for example but not limited to, a keyboard, mouse, scanner, microphone, camera, proximity device, etc. Further, the Input/Output devices may also include output devices, for example but not limited to, a printer, display, etc. Finally, the Input/Output devices may further include devices that communicate both as inputs and outputs, for instance but not limited to, a modulator/demodulator (modem; for accessing another device, system, or network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, etc.
When the SLAM system 25 is in operation, the processor 26 can be configured to execute software stored within the memory 30, to communicate data to and from the memory 30, and to generally control operations of the system 25 pursuant to the software. Software in memory, in whole or in part, is read by the processor, perhaps buffered within the processor, and then executed. The controller 24 may control vehicle systems schematically indicated at 28 to either autonomously control the vehicle 20 or provide driver assist functions to aid an operator of the vehicle 20.
Referring to
In this disclosed example, data points are generated for portions of a first home 38, edges of a drive way 36, a second home 42 and a curb 40 across a roadway 46 from the first home 38. The background images of the homes and other features are provided for context of real world objects to the proximate location of the data points 34. The data points 34 are shown in
The vehicle 20 may utilize the occupancy grid 35 to define a path 44 to a desired destination. In this example, the desired destination is a parking spot within a garage of the first home 38. The SLAM system 25 takes multiple passes of the environment such that additional data points are continually added to the occupancy grid 35 to improve the information and understanding of the environment around the vehicle 20.
Referring to
As is shown in
Referring to
Once the vehicle 20 changes its position and the new sensor data 54 accumulated over multiple measurement cycles is correlated with the existing data in the occupancy grid 35. The occupancy grid 35 as is shown in
The correlation between the geometric anchors 48, 50 and 52 is used to estimate the vehicle position and correct any error in the odometry model of the vehicle 20.
The occupancy grid 35 can then be built around the corrected position of the vehicle 20 with the latest data points 54. In one disclosed example, the geometric anchors 48,50 and 52 are recomputed after a predefined number of sensor data gathering cycles. In another disclosed embodiment, the geometric anchors 48, 50 and 52 can be recomputed after a predefined distance travelled by the vehicle 20.
Accordingly, the example SLAM system 25 utilizes at least one geometric anchor 48, 50 and 52 to correlate subsequently gathered data points for localizing a vehicle. The use of the geometric anchor features for correlating subsequently gathered data points reduces overall computing requirements to improve system efficiency.
Although the different non-limiting embodiments are illustrated as having specific components or steps, the embodiments of this disclosure are not limited to those particular combinations. It is possible to use some of the components or features from any of the non-limiting embodiments in combination with features or components from any of the other non-limiting embodiments.
It should be understood that like reference numerals identify corresponding or similar elements throughout the several drawings. It should be understood that although a particular component arrangement is disclosed and illustrated in these exemplary embodiments, other arrangements could also benefit from the teachings of this disclosure.
The foregoing description shall be interpreted as illustrative and not in any limiting sense. A worker of ordinary skill in the art would understand that certain modifications could come within the scope of this disclosure. For these reasons, the following claims should be studied to determine the true scope and content of this disclosure.
