This disclosure relates to a camera monitoring system (CMS) for a vehicle, and specifically to CMS that includes jackknife warning features.
Mirror replacement systems, and camera systems for supplementing mirror views, are utilized in commercial vehicles to enhance the ability of a vehicle operator to see a surrounding environment. Camera monitoring systems (CMS) utilize one or more cameras to provide an enhanced field of view to a vehicle operator. In some examples, the camera systems cover a larger field of view than a conventional mirror, or include views that are not fully obtainable via a conventional mirror.
In addition to mirror replacement, the images provided via the cameras in a CMS can be utilized to detect aspects of the environment and aspects of the vehicle in an image-processing-based detection process. Among the aspects of the vehicle that can be detected are trailer properties and trailer positioning relative to the vehicle. During some maneuvers, such as backup or turning, the position of the trailer can impact the maneuver, and corrective action may be desired in order to prevent jackknifing and/or similar positioning problems. Knowledge of the current trailer angle is particularly helpful in operating such systems.
A camera monitoring system (CMS) for a vehicle according to an example embodiment of the present disclosure includes a camera mounted to a tractor and configured to record images that depict a trailer attached to the tractor, an electronic display configured to display the images, and a CMS controller. The CMS controller is operatively connected to the camera and electronic display and is configured to determine whether a trailer angle of the trailer exceeds a jackknife warning threshold based on a depiction of the trailer in the images; and based on a particular one of the images indicating a trailer angle above the jackknife warning threshold, provide a jackknife warning.
In a further embodiment of the foregoing embodiment, the CMS controller is configured to determine that a trailer angle of the trailer exceeds the jackknife warning threshold based on a percentage of the particular one of the images that depicts the trailer exceeding a predefined threshold.
In a further embodiment of any of the foregoing embodiments, the CMS controller is configured to determine that a trailer angle of the trailer exceeds the jackknife warning threshold based on a distance between predefined reference position of the trailer and a predefined image location in a particular one of the images crossing a threshold.
In a further embodiment of any of the foregoing embodiments, the predefined reference position of the trailer is a rear vertical edge of the trailer.
In a further embodiment of any of the foregoing embodiments, the predefined reference position is an intermediate location on a side of the trailer between ends of the trailer.
In a further embodiment of any of the foregoing embodiments, the images depict at least one of a Class II view and a Class IV view.
In a further embodiment of any of the foregoing embodiments, the warning includes a proposed corrective steering direction.
In a further embodiment of any of the foregoing embodiments, the warning includes an indication of a severity of a risk of a jackknife condition occurring.
In a further embodiment of any of the foregoing embodiments, the warning is an audible warning.
A camera monitoring system (CMS) for a vehicle according to an example embodiment of the present disclosure includes a camera configured to record images that depict a trailer attached to the vehicle, an electronic display configured to display the images, and a CMS controller. The CMS controller is operatively connected to the camera and electronic display and is configured to, based on occurrence of at least one trigger condition: determine that a trailer angle of the trailer exceeds a jackknife warning threshold and provide a jackknife warning. The at least one trigger condition includes at least one of: a percentage of a particular one of the images that depicts the trailer exceeding a first threshold; and a distance between predefined reference position of the trailer and a predefined image location in the particular one of the images crossing a second threshold.
A method for preventing jackknifing between a vehicle and a trailer according to an example embodiment of the present disclosure includes using a camera mounted to a tractor to record images that depict a trailer attached to the tractor; displaying the images on an electronic display; determining whether a trailer angle of the trailer exceeds a jackknife warning threshold based on a depiction of the trailer in the images; and based on a particular one of the images indicating a trailer angle above the jackknife warning threshold, provide a jackknife warning.
In a further embodiment of the foregoing embodiment, the determining includes determining that the trailer angle exceeds the jackknife warning threshold based on a percentage of the particular one of the images that depicts the trailer exceeding a predefined threshold.
In a further embodiment of any of the foregoing embodiments, the determining includes determining that the trailer angle exceeds the jackknife warning threshold based on a distance between a predefined reference position of the trailer in the particular one of the images and a predefined image location crossing a predefined threshold.
In a further embodiment of any of the foregoing embodiments, the predefined reference position of the trailer is a rear vertical edge of the trailer.
In a further embodiment of any of the foregoing embodiments, the predefined reference position is a marker on the trailer.
In a further embodiment of any of the foregoing embodiments, the images depict at least one of a Class II view and a Class IV view.
In a further embodiment of any of the foregoing embodiments, the warning is provided on the electronic display.
In a further embodiment of any of the foregoing embodiments, providing the jackknife warning includes indicating a proposed corrective steering direction to a driver of the vehicle.
In a further embodiment of any of the foregoing embodiments, providing the jackknife warning includes providing an indication of a severity of a risk of the jackknife condition occurring.
In a further embodiment of any of the foregoing embodiments, providing the jackknife warning includes providing an audible warning.
The embodiments, examples and alternatives of the preceding paragraphs, the claims, or the following description and drawings, including any of their various aspects or respective individual features, may be taken independently or in any combination. Features described in connection with one embodiment are applicable to all embodiments, unless such features are incompatible.
These and other features of the present invention can be best understood from the following specification and drawings, the following of which is a brief description.
The disclosure can be further understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:
A schematic view of a commercial vehicle 10 is illustrated in
As shown in
If the trailer angle is sufficiently high, a jackknife condition can occur where the trailer 14 contacts the tractor 12, potentially causing damage and requiring expensive and/or time consuming repairs. As will be discussed below in greater detail, the vehicle 10 includes a camera monitor system (CMS) 15 (see
Although the vehicle 10 is depicted as a commercial truck in this disclosure, it is understood that other types of vehicles may be used, and it should also be understood that other configurations may be utilized for the vehicle cab 12 and/or trailer 14.
Referring now to
Each of the camera arms 16a, 16b includes a respective base 17 (one of which is shown in
Referring to
If video of Class V and/or Class VI views are also desired, a camera housing 16c and camera 20c may be arranged at or near the front of the vehicle 10 to provide those views (
If video of Class VIII views is desired, camera housings can be disposed at the sides and/or rear of the vehicle 10 to provide fields of view including some or all of the Class VIII zones of the vehicle 10. As illustrated, the Class VIII view includes views immediately surrounding the trailer, and in the rear proximity of the vehicle including the rear of the trailer. In one example, a view of the rear proximity of the vehicle is generated by a rear facing camera disposed at the rear of the vehicle, and can include both the immediate rear proximity and a traditional rearview (e.g., a view extending rearward to the horizon, as may be generated by a rearview mirror in vehicles without a trailer). In such examples, the third display 18c may include one or more frames displaying the Class VIII views. Alternatively, additional displays can be added near the first, second and third displays 18a, 18b, 18c and provide a display dedicated to providing a Class VIII view.
Certain visual characteristics of the trailer 14 that are visible in one or more CMS views can provide warning of an upcoming potential jackknife condition by indicating an approximate trailer angle. Some example visual characteristics may include (1) a percentage of a particular one of the images that depicts the trailer exceeding a first threshold, and (2) a distance between predefined reference position of the trailer and a predefined image location crossing a second threshold. The distance may be measured in pixels, or any other uniform unit relative to the image, for example.
These visual characteristics serves as trigger conditions for triggering a warning. The CMS 15 analyzes images recorded by the cameras 20A-B to determine whether the images are indicative of a trigger condition. By correlating the visual characteristics of the images with one or more trailer angles corresponding to jackknife warning thresholds, the CMS 15 can determine when a jackknife warning should be provided. If desired, the CMS 15 can also use a look-up table to determine an approximate trailer angle.
Different trailer angles may represent different likelihoods of a jackknife condition occurring, and may trigger warnings with different severity levels. Assume that a jackknife condition will occur at an angle of X°. If the trailer angle is X minus 20° then a first warning corresponding to a first severity may be provided, and once the angle is X minus 10° a second warning corresponding to a second severity may be provided, with the second severity being greater than the first severity, and so on. In some cases, the warning from the CMS 15 may include a suggested operation change (e.g., steering direction change) to correct or prevent the potential jackknife condition.
In one example, the CMS 15 utilizes different jackknife warning thresholds based on a speed of the vehicle 10. When the vehicle 10 is parking, for example, a higher trailer angle may be acceptable because the vehicle is moving at low speeds. However, when the vehicle is driving on a road, such as a highway, the CMS 15 may lower the threshold because the likelihood of a jackknife condition occurring is greater at higher speeds. Thus, in one example the CMS 15 uses a first jackknife warning threshold (e.g., images indicating a trailer angle of 80° or 90°), at a first range of speeds, and uses a second jackknife warning threshold (e.g., images indicating a trailer angle of 60° or 70°) that is lower than the first jackknife warning threshold at a second range of speeds that is higher than the first range of speeds.
With continued reference to
Step 306 includes the CMS controller 13 analyzing images from the camera(s) 20A and/or 20B for an indication of whether the trailer angle exceeds the jackknife warning threshold. These indications may be “trigger conditions” in that they may trigger the jackknife warning of step 310. One example trigger condition corresponds to a percentage of a particular one of the images that depicts the trailer 14 exceeding a first threshold (e.g., 50% of the image). As the trailer angle increases, the trailer 14 will occupy more and more of the recorded images. This trigger condition correlates the percentage of the image (e.g., a percentage of pixels) that depict the trailer 14 in the overall image to a particular trailer angle at which a warning should be provided (e.g., 60° or 70°). The percentage of the image that corresponds to the trailer 14 can be determined using techniques such as edge detection and/or analyzing a color of the trailer compared to other parts of the image.
Another example trigger condition corresponds to a distance between a predefined reference position of the trailer (e.g., a vertical rear edge of the trailer 14 or a marker on the trailer 14) and a predefined image location (e.g., an edge of the image as depicted in
The distance may be measured between the predefined position in the trailer 14 and an edge of the image farthest from the trailer 14 when the trailer angle is zero (in which case “crossing” the threshold would be falling below the threshold), or between the predefined position of the trailer 14 and an edge of the image closest to the trailer when the trailer angle is zero (in which case “crossing” the threshold would be exceeding the threshold).
In some cases, one of the visual characteristics (e.g., the trailer end 410 which corresponds to a rear vertical edge of the trailer) may have passed out of the field of view of the given Class view (Class II in
The Class IV image 402 illustrated in 4B provides a wider view and the CMS 15 identifies a distance 432B between the trailer end 410 and the vertical boundary 412 corresponding to an edge of the Class II image 400 and a distance 434B between the center reference point 420 and the vertical boundary 412. The CMS 15 may determine a distance 434 between the center of the trailer reference position 420 and the vertical boundary 412. In this example, approximately 50% of the image 401A depicts the trailer 14, and approximately 25% of the image 403A depicts the trailer 14. Although the distances 432 and 434 are shown in
The “jackknife warning” that is provided in step 310 may include providing an indicator/indication on the CMS display 18. In one example, the indicator takes the form of an icon 810, illustrated in
As described above, the method 300 does not require determining a trailer angle during performance of the method, because the trigger conditions have already been correlated to the jackknife warning threshold(s). Optionally though, a lookup table could be created and referenced during performance of the method 300 that correlates the image characteristics to specific trailer angles (e.g., correlate various percentages of the image 401 and/or 403 that depicts the trailer with specific trailer angles and/or correlate specific distances between the trailer reference position and predefined image location with specific trailer angles).
As discussed an example trigger condition for providing a jackknife warning may include percentage of a particular one of the images that depicts the trailer exceeding a first threshold. In the examples above, different percentages were discussed in relation to how much of the images 401 and/or 403 were occupied by the trailer 14. Because there is a correlation between trailer angle and this percentage, the percentage can be used as a criterion for determining whether a jackknife warning should be provided.
As also discussed above, another example trigger condition for providing a jackknife warning may include a distance between predefined reference position of the trailer and a predefined image location crossing a second threshold. The predefined reference position of the trailer could include the end 412 of the trailer or the reference position 420, for example. The predefined image location could include edge 412 of the images 401 and/or 403 (right edge in
Optionally, by correlating these visual indicators in the Class II view and the Class IV view with empirically determined trailer angles during testing, a look up table can be constructed for a given tractor 12/trailer 14 configuration that maps the values discussed above (percentage of image occupied by trailer 14 and/or distance between trailer reference position and predefined image location) with specific trailer angles.
The above described examples are specific to one example configuration, and alternate configurations may have different numbers, but will have similar correlations where the combined positioning of the reference points and the visible trailer percentage in the images correlates to the trailer angle. Further, it is appreciated that differencing conditions (e.g., speed, icy, snowy, rainy, direction of travel, etc.) may impact the particular trailer angle correlations. In such examples, the process may include an adjustment of the jackknife warning thresholds based on driving conditions, and may include a separate look up table for each driving condition.
While the system described above is able to use the reference points to determine the potential jackknifing condition without the need for a trailer angle sensor, and without needing to determine a specific trailer angle, it is appreciated that some alternate systems can be constructed including a trailer angle sensor intended to provide additional operational details, and to provide a check against false determinations (e.g., if the CMS view includes an obstruction resulting in a false read of 60 degrees, but the trailer angle sensor indicates that the trailer is only at 30 degrees). In such a case, the CMS can determine the faulty read and disable the jackknifing awareness software.
Although an example embodiment has been disclosed, a worker of ordinary skill in this art would recognize that certain modifications would come within the scope of the claims. For that reason, the following claims should be studied to determine their true scope and content.