This application is a U.S. National Stage application under 35 U.S.C. § 371 of International Application PCT/NL2016/050820 (published as WO 2017/091066 A1), filed Nov. 23, 2016 which claims the benefit of priority to Application NL 2015843, filed Nov. 23, 2015. Benefit of the filing date of each of these prior applications is hereby claimed. Each of these prior applications is hereby incorporated by reference in its entirety.
The invention relates to a method of automatic docking of a vehicle, in particular of a trailer truck combination.
State of the art heavy trucks today are equipped with steering systems, mainly based on hydraulic boosting in a fixed “passive” manner. Newest trends however are the introduction of an electromotor (either as add-on system or even as full replacement of the hydraulic system) that engages the wheels and supports the steering wheel movements. These electric steering system all have in common that they need an ECU based control system with sensors. Moreover, mostly CAN interfaces are provided to connect them to other vehicle control systems. Such active steering systems may also be used to implement Advanced Driver Assistance Systems, that may be used to interact with the driver, aid him in traffic situations, and even facilitate autonomous driving. A major challenge is to provide driver assistance, or even autonomous driving support for docking a trailer—i.e. driving in reverse to park a trailer against a dock for loading and unloading of the trailer, greatly relieving the burden for the driver in this highly precise low speed maneuvering task (with reduced vision at the target) on the one hand and increasing the efficiency of these logistic activity (as part of daily operation at the warehouse system) on the other hand
One of the many challenges is the limited room for maneuvering in typical docks, where a trailer has to drive in reverse in a straight line without a possibility of small adjustments, especially for fixed rear axle arrangements.
However, while these systems are beginning to surface in personal vehicles, in truck vehicles, in particular of the type of more than 6 tonnes, there is a considerable challenge for dimensioning these systems, in view of the difficulty of driving in reverse with a trailer combination.
In other prior art systems, e.g. DE102004047214 it is contemplated to determine a position of a transport vehicle and analyzing a scene. Destination objects and free spaces are identified in the scene. An associated docking vector is calculated from a preset position of the vehicle to the objects. A route for the objects is planned and a three- or two-dimensional characteristics of the identified object are recorded to obtain a new position information of the vehicle during a journey. In the DE'214 a substantial effort is necessary to analyze a complex 3D scene, which is less optimal also because the analysis requires constant updating and adaptation when the vehicle is in motion and a precise known vehicle location is necessary to perform a docking maneuver. Michalek, in “The concept of passive control-assistance for docking maneuvers with N-trailer vehicles” Mechatronics, IEEE/ASME IEEE/ASME Transactions on Mechatronics (10 Nov. 2014, Volume:20, Issue: 5) describes an advanced control algorithm for active or passive control assistance, building on a earlier concepts such as described in “Exact Motion Planning for Tractor-Trailer Robots” IEEE International Conference on Robotics and Automation Robotics and Automation, Proceedings 1995 (Svestka, Vleugels, Volume:3). The authors focus on path solutions that can be planned. However a reliable match with the surroundings in an actual set up is not contemplated. There is a need to provide a reliable method for autonomously docking a trailer truck combination in a practical set up. Furthermore an efficient computing algorithm for localization of the back of the trailer with respect to the dock is needed that minimizes the load on the controller.
It is aimed to provide a method for guiding of a motor vehicle on the basis of image data, particularly when manoeuvring trucks toward docking stations by a docking controller coupled to a steering system, comprising: identifying, by the docking controller the vehicle's current position; receiving a collision free path; and manoeuvring the vehicle by said docking controller according to said free path, wherein the vehicle's current position is identified by means of an off board vehicle scanner that is mounted in a fixed position relative to the dock station; wherein said vehicle scanner produces scan data signifying a set that are analyzed to identify a reference point of the vehicle and a vehicle's orientation; wherein said reference point and vehicle orientation are transmitted to the docking controller to update the vehicle's current position.
The invention will be further elucidated in the figures:
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs as read in the context of the description and drawings. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein. In some instances, detailed descriptions of well-known devices and methods may be omitted so as not to obscure the description of the present systems and methods. Terminology used for describing particular embodiments is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. The term “and/or” includes any and all combinations of one or more of the associated listed items. It will be further understood that the terms “comprises” and/or “comprising” specify the presence of stated features but do not preclude the presence or addition of one or more other features. All publications, patent applications, patents, and other references mentioned herein are incorporated by reference in their entirety. In case of conflict, the present specification, including definitions, will control.
The term “controller” is used in a conventional way to signify any structural hardware or software arrangement having a capability of executing program logic in order to provide a certain basic function. A skilled person is typically aware of how to operate or implement a circuit in the context of the description, with processor elements elucidated here below. For example, a ‘docking controller’ comprises hard/and or software elements dedicated to the purpose, as further illustrated here below, of identifying a truck's current position.
The term “program logic” is used in a conventional way to signify the operating instructions, which may be embodied in hard- or software structures, that control a circuit to the designated functional behavior.
The term “signal line” is used in a conventional way to signify an information exchanged via signal transmission, which may be in the form of coded signals, in analog or digital fashion by any conventional communication device, where it is not excluded that other signal lines are available, but merely to signify that a certain connectivity is available. This may also indicate indirect connectivity, that is, a signal line may be provided by indirect signaling, for example, via another functional device.
The term “user interface” may comprise one or more hardware elements configured to perform operational acts in accordance with the present systems and methods, such as to provide control signals to the various other module components. The processor may be a dedicated processor for performing in accordance with the present system or may be a general-purpose processor wherein only one of many functions operate for performing in accordance with the present system. The processor may operate utilizing a program portion, multiple program segments, or may be a hardware device utilizing a dedicated or multi-purpose integrated circuit. Any type of processor may be used such as a dedicated or shared one. The processor may include micro-controllers, central processing units (CPUs), digital signal processors (DSPs), ASICs, or any other processor(s) or controller(s) such as digital optical devices, or analog electrical circuits that perform the same functions, and employ electronic techniques and architecture. The controller or processor may further comprise a memory that may be part of or operationally coupled to the controller. The memory may be any suitable type of memory where data is stored. Any medium known or developed that can store and/or transmit information suitable for use with the present systems and methods may be used as a memory. The memory may also store user preferences and/or application data accessible by the controller for configuring it to perform operational acts in accordance with the present systems and methods.
While example embodiments are shown for systems and methods, also alternative ways may be envisaged by those skilled in the art having the benefit of the present disclosure for achieving a similar function and result. E.g. some components may be combined or split up into one or more alternative components. Finally, these embodiments are intended to be merely illustrative of the present system and should not be construed as limiting the appended claims to any particular embodiment or group of embodiments. Thus, while the present system has been described in particular detail with reference to specific exemplary embodiments thereof, it should also be appreciated that numerous modifications and alternative embodiments may be devised by those having ordinary skill in the art without departing from the scope of the present systems and methods as set forth in the claims that follow. The specification and drawings are accordingly to be regarded in an illustrative manner and are not intended to limit the scope of the appended claims.
The 2D or 3D vehicle scanner 10, 20 produce scan data 2D, 3D formed by sets of reflection angles and corresponding reflection distances. The scan data, signifying a set of laser reflections (2D or 3D angle and reflection distance) are analyzed to identify at least a reference point of the trailer and a trailer's orientation. The reference point and trailer's orientation are transmitted to the docking controller to update the truck's current position, and feeding the docking controller with the reference point and trailer orientation. The docking controller can be embodied in software and/or hardware and can be on-board or off board of the truck. It calculates the vehicle steering and driving parameters, necessary to steer and drive the vehicle to the docking controller's instructions i.e. according to a collision free path that docks the vehicle in a designated vehicle dock.
Advantageously, the reference point P is identified from a scanner plot, as shown in
Furthermore, optionally, the reference point may be calculated or validated, e.g. by Kalman type filtering, from other sensors, e.g. in areas where the scanner cannot look. E.g. when the trailer approaches the final distance to the dock, the reference position can be further measured by conventional means, e.g. on-board parking sensors, ABS encoders and accelerators. These additional sensors can also be used to optimize the driver interaction; e.g. by smoothen the accelerations or steering action according to preset constraints. The information obtained from the laser scanner is a distance at which every beam in the laser's viewing area reflects. Since the angle of each beam is known, this data in polar coordinates can be converted to a set of points in the (x,y)-plane, where the laser scanner is at the origin, as shown in
To find the position and heading of the trailer, first the set of points actually belonging to this object (refer to area of interest A) is filtered out from the remaining data. When multiple trucks and trailers can be present in the environment, the analysis starts an approximate truck's position, such that the correct vehicle can be tracked. In particular, scan data is prefiltered by the controller to identify an approximate vehicle trailer position from a prefiltered data set. This can for instance be done by a signaler that signals the trucks position and is in connection with the steering controller, e.g. by it's GPS coordinates or from a marker signal that may be derived from the sensor data. For example, said prefiltering is provided by matching said scan data with a truck's GPS coordinate provided by the truck's GPS detector. Said GPS data are transmitted by the docking controller 15 to the off board vehicle scanner 10 and a dock side engine control unit processor 11 that processes the scanner data. Parts of the processing can be exchanged between the dock side processor 11 and the docking controller 30.
Once the trailer is identified by vehicle scanner 10 and/or corresponding processing in the dockside processor 11, it can be locked, by successive analysis of capture frames, and only selecting points that match a predetermined constraint derived from the instantaneous vehicle movement; so that the trailer is locked in. Using this initial estimate of the position, a set of points can be filtered out in a box surrounding this position, with a size based on the accuracy of the estimate. In addition, to filter out the tractor or possibly other nearby objects, one can make use of the knowledge that the laser scanner scans in one direction and thus fills the array of points from left to right or right to left. This means that measurements of the same solid object are in adjacent positions in the array of points. In between different objects, when there is a gap of sufficient size, several beams will not reflect back, enabling the algorithm to identify where the set of points belonging to the trailer ends. When tracking the truck in consecutive frames, the center position from the previous frame can be used as estimate for the initial filtering step.
Thus, the scan data is prefiltered by the controller to identify an approximate vehicle trailer position from a prefiltered data set. The controller matches a found vehicle trailer to one of a number of visibility scenario's wherein one or more vehicle trailer sides are visible by fitting a line through the data, or if a certain error level is exceeded, computing the location of a corner point and fitting a line through the datapoints for each of the two visible sides. Thus, after a correct set of points is obtained, the controller determines from the prefiltered data a single set of data points forming a corresponding line segment; or, when an error level is exceeded, multiple sets of data points forming multiple corresponding line segments belonging to multiple mean values. The algorithm interprets the remaining points to identify which part of the trailer is visible, and what way the trailer is facing, thus, the sets of data points are matched to one of a number of visibility scenario's wherein one or more vehicle trailer sides are visible. For example, using a two-dimensional laser scanner, at most two sides of the trailer can be visible, resulting in four different visibility scenarios, as is depicted in
An example of a set of measurement points belonging to a trailer is shown in
Then the residual (squared sum of the errors) is computed. If the residual exceeds a certain threshold, the points do not lie on a line, so multiple sides of the trailer must be visible. When the points do lie on a line, case 1 can be distinguished from case 2 based on the length of the line, or based on the previous orientation (a slow moving trailer cannot transition from case 1 to case 2 within a fraction of a second).
When the points do not lie on a line, the algorithm determines where the trailers corner point is by splitting the data set into two separate sets. A distinction is subsequently made to identify scenario 3 or 4, i.e. to subsequently identify whether the long side of the trailer is on the left or the right side. Since the line segments may be tracked in consecutive frames, their known lengths can be used, or the orientation in the previous frame (noting that the trailer cannot transition between cases 3 and 4 within a fraction of a second). Effectively this means that, during the first measurement, a sufficiently large part of the trailer has to be visible to determine where the long and short side of the trailer are, along with an indication which way the truck is facing (which cannot always be determined from the laser measurement alone). After the initial measurement, the trailer can be tracked throughout the next frames, by propagating the previous orientation and heading.
To determine the location of the corner point (or split point) for cases 3 and 4, the orientation angle (w.r.t the x-axis) of line segments connecting two adjacent data-points is used. For each side of the trailer, this angle is approximately constant (α1 and α2 in
Once the splitting point and orientation of the trailer are known, the location of the rear axle of the trailer can be determined. This position along with the newly found orientation angle are then sent to the truck for control, and then propagated to the next frame, where the trailer fitting procedure restarts.
An effective way of obtaining a feasible path in an exact formulation, is to construct this path from lines and circles, and connect these parts using so called bend and stretch maneuvers. While driving on a straight line or circle, the articulation angle of the vehicle is constant. This is known to simplify the solution to the differential equations describing the equations of motion, allowing an exact solution as mentioned in Svesta cited hereabove. Additionally, constant articulation angle means that no additional steering is required. In an embodiment, the vehicle speed is increased in segments where the articulation angle is kept constant without violating limitations in rotation speed of the steering wheel necessary to follow the path. Conversely, the vehicle speed is lowered in the interconnection phase where the articulation angle is not constant.
The most common manoeuver to dock a tractor semi-trailer truck consists of a forward driving path to a turning point, followed by reverse driving towards the dock. Such a path (describing the motion of the rear axle of the trailer) can be constructed by interconnected lines and circles, i.e. said path is formed from segments where the articulation angle is kept constant. An example of such a path is given in
The deviation d is calculated from a reference point S, e.g. a reference point having a fixed geometric relation relative to the corner point P that is derived from the scanner data. In the drawing it is illustrated that in the bicycle presentation, where corner point P is related with axle mid point A and look ahead point S.
The lateral deviation d and the heading error with respect to the path are observed at the look ahead point S. In an embodiment the look ahead point S is dependent on the vehicle speed. Such a look-ahead point S may improve the performance of the system in terms of stability and damping. By looking a distance L in forward or backward directions, i.e, e.g. relative to a middle rear axle while driving forward, or behind the rear axle when driving in reverse, the damping in the system is improved. Increasing the look-ahead distance further increases the damping in the system, but may also introduce corner cutting in case of a curved reference trajectory, which may provide a constraint for calculating a maximum look-ahead distance.
Number | Date | Country | Kind |
---|---|---|---|
2015843 | Nov 2015 | NL | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/NL2016/050820 | 11/23/2016 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2017/091066 | 6/1/2017 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
3061855 | Layne | Nov 1962 | A |
4646075 | Andrews | Feb 1987 | A |
5663879 | Trovato et al. | Sep 1997 | A |
6405132 | Breed | Jun 2002 | B1 |
6677889 | Van Rees | Jan 2004 | B2 |
6965816 | Walker | Nov 2005 | B2 |
7085637 | Breed | Aug 2006 | B2 |
7313467 | Breed | Dec 2007 | B2 |
7444210 | Breed | Oct 2008 | B2 |
7527288 | Breed | May 2009 | B2 |
8047149 | Antonelli | Nov 2011 | B1 |
8314732 | Oswald | Nov 2012 | B2 |
8576235 | Sumner | Nov 2013 | B1 |
8798957 | Feiten | Aug 2014 | B2 |
9008369 | Schofield | Apr 2015 | B2 |
9290202 | Lavoie | Mar 2016 | B2 |
9500497 | Lavoie | Nov 2016 | B2 |
9506774 | Shutko | Nov 2016 | B2 |
9609289 | Schofield | Mar 2017 | B2 |
9683848 | Lavoie | Jun 2017 | B2 |
9697730 | Thakur | Jul 2017 | B2 |
9708000 | Hafner | Jul 2017 | B2 |
9854209 | Aich | Dec 2017 | B2 |
9926008 | Hafner | Mar 2018 | B2 |
9948904 | Schofield | Apr 2018 | B2 |
9969428 | Hafner | May 2018 | B2 |
10035457 | Singh | Jul 2018 | B2 |
10160382 | Pliefke | Dec 2018 | B2 |
10173722 | Pourrezaei Khaligh | Jan 2019 | B2 |
10196088 | Lavoie | Feb 2019 | B2 |
10306190 | Schofield | May 2019 | B1 |
10471992 | Brennan | Nov 2019 | B2 |
10514700 | Cantrell | Dec 2019 | B2 |
20060269896 | Liu | Nov 2006 | A1 |
20090040095 | Ogawa | Feb 2009 | A1 |
20120139325 | Norberg | Jun 2012 | A1 |
20130080044 | Tyers | Mar 2013 | A1 |
20150256034 | Stone | Sep 2015 | A1 |
20150291179 | Tagesson | Oct 2015 | A1 |
20160292872 | Hammond | Oct 2016 | A1 |
20180197139 | Hill | Jul 2018 | A1 |
20180346029 | Kabos | Dec 2018 | A1 |
20180364738 | Bridges | Dec 2018 | A1 |
20190039425 | Dodd | Feb 2019 | A1 |
20190343429 | Elhawary | Nov 2019 | A1 |
Number | Date | Country |
---|---|---|
101772446 | Jul 2013 | CN |
103576134 | Feb 2014 | CN |
102004047214 | Mar 2006 | DE |
102005036794 | Feb 2007 | DE |
102012016980 | Feb 2013 | DE |
1559629 | Aug 2005 | EP |
2373558 | Oct 2011 | EP |
2634071 | Jan 2015 | EP |
2979461 | Mar 2013 | FR |
200358758 | Aug 2004 | KR |
200374351 | Jan 2005 | KR |
WO-03029922 | Apr 2003 | WO |
WO-2008080211 | Jul 2008 | WO |
2010064989 | Jun 2010 | WO |
WO-2014185828 | Nov 2014 | WO |
WO-2017091066 | Jun 2017 | WO |
Entry |
---|
Nov. 14, 2014—Michalek, Maciej “The concept of passive control-assistance for docking maneuvers with N-trailer vehicles” vol. 20, Issue 5. |
1995—Svestka “Exact Motion Planning TractorTrailer Robots” IEEE International Conference on Robotics and Automation Robotics and Automation vol. 3. |
Feb. 24, 2017—ISR and WO—PCT/NI2016/050820. |
Number | Date | Country | |
---|---|---|---|
20180346029 A1 | Dec 2018 | US |