Method for adapting to a driver position an image displayed on a monitor in a vehicle cab

Information

  • Patent Grant
  • 12071076
  • Patent Number
    12,071,076
  • Date Filed
    Thursday, January 23, 2020
    5 years ago
  • Date Issued
    Tuesday, August 27, 2024
    6 months ago
Abstract
The invention relates to a method for adapting to a driver position an image displayed on a monitor in a cab of the vehicle. The invention also relates to a system for adapting to a driver position an image displayed on a monitor in a cab of the vehicle. The invention further relates to a vehicle comprising such a system.
Description
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a 35 U.S.C. § 371 national stage application of PCT International Application No. PCT/EP2020/051679 filed on Jan. 23, 2020, the disclosure and content of which is incorporated by reference herein in its entirety.


TECHNICAL FIELD

The invention relates to a method and a system for adapting to a driver position an image displayed on a monitor in a cab of the vehicle. The invention further relates to a vehicle comprising such a system.


The invention is particularly well suited for heavy-duty vehicles, such as trucks, buses and construction equipment. The invention may also be used in other vehicles such as a car.


BACKGROUND

A trend in industrial vehicles is to replace conventional mirrors by a camera assembly that can comprise a supporting arm mounted on the vehicle cab and a camera arranged on said supporting arm, for providing a captured image of an area located rearwards and along a vehicle side. An image, resulting from the processing of the captured image, can typically be displayed on a monitor inside the driver's compartment.


The camera assembly must be arranged to provide to the vehicle driver an appropriate image displayed on the monitor, to ensure good visibility, hence safety.


However, the field of view of a camera assembly is fixed In that sense a camera differs drastically from a mirror as in a vehicle equipped with standard mirrors the driver can modify the vision field by moving his or her position on the vehicle seat to change the vision filed and therefore, for example, minimise the occurrence of blind spot.


However, in a vehicle equipped with camera instead of rear mirrors, although the driver change position on the driver seat, the field of view is not modified meaning that the image displayed on the monitoring is also not modified.


This can be disturbing especially for an experienced driver who would typically anticipate certain driving conditions such as overtaking a vehicle by changing position to change the mirror field of view so as to minimise the occurrence of a blind spot.


The patent application DE102010023160 discloses a vehicle mirror system having a mirror, whose adjustment is made as a result of head- or eye position of the driver. The adjustment of declination, height and displacement of the driver seat is taken into account during the adjustment evaluation of the mirror positioning. The head- or eye position is recorded with an image recording camera or with any sensor.


Nevertheless, this camera system is not easy to implement in a vehicle. Moreover, a significant computational power is needed to process the captured images. Finally, the reaction time of the system is quite low.


SUMMARY

An object of the invention is to provide an easy-to-implement solution to improve the visibility for a vehicle's driver, without affecting comfort and driver experience


The object is achieved by a method for adapting to a driver position an image displayed on a monitor in a cab of the vehicle, the vehicle comprising a camera assembly comprising a supporting arm mounted on the cab and at least one camera arranged on said supporting arm, for providing a captured image of an area located rearwards and along a vehicle side.


The method comprises:

    • determining the position of the driver on the driver seat using a determining member comprising at least one sensor located in the driver seat;
    • automatically processing the captured image, according to the position of the driver on the driver seat, to display on the monitor the displayed image.


By the provision of the method for adapting to a driver position an image displayed on a monitor in a cab of the vehicle according to the present invention, the advantage is to provide an easy-to-implement method allowing an automatic adjustment of the image displayed on the monitor depending on the position of the driver on the driver seat. Additionally, this system is comfortable for the driver, less expensive than the systems of the prior art and the reaction time of this system is fast.


Preferably, the image displayed on a monitor is:

    • either a first image which corresponds to a part of the captured image defined by a first field of view, in case the position of the driver is in a first configuration, i.e. an initial position of the driver on the seat,
    • or a second image which corresponds to a part of the captured image defined by a second field of view, distinct from the first field of view, in case the position of the driver is in a second configuration, i.e. any driver position different from the initial position.


Preferably, the at least one sensor is selected a load sensor.


Preferably, the at least sensor is located in the seat base of the driver seat and optionally in the seat backrest of the driver seat.


Advantageously, the method further comprises transmitting the driver position information provided by said sensor through a vehicle internal communication network. In an embodiment, the second field of vision comprises a portion of the captured image that is located at any other place other than the first field of vision. In other words, the second image shows an area located lower, above, on the left or on the right with respect to the first image.


Optionally, the second field of vision further includes the first field of vision. In other words, the second image shows at least a portion of the first image in addition to the portion of the captured image that is located at any other place than the first image. For example, the second image can correspond to a zoom out or a zoom in of the first image.


Preferably, the camera assembly comprising at least one supporting arm mounted on at least one side of the vehicle and at least one camera arranged on the supporting arm. In another embodiment, the camera assembly comprises at least one camera arranged at the back of the vehicle. In another embodiment, the camera assembly comprises at least one camera arranged on the supporting arm mounted on at least one side of the vehicle and at least one camera arranged at the back of the vehicle.


According to a second aspect, the invention relates to a system for adapting to a driver position an image displayed on a monitor in a cab of the vehicle, the vehicle comprising a camera assembly for providing a captured image of an area located rearwards and along a vehicle side, characterized in that the system comprises:

    • a determining member comprising at least one sensor located in the driver seat, for determining a driver position on the driver seat;
    • a controller capable of receiving a driver position information from the determining member, and of automatically processing the captured image, according to said driver position information, to display on the monitor the image displayed.


The system may further comprises a vehicle internal communication network which links the sensor and the controller.


According to a third aspect, the invention relates to a vehicle comprising:

    • a cab having front wheels and rear wheels;
    • a camera assembly for providing a captured image of an area located rearwards and along a vehicle side;
    • a monitor located in the cab, for displaying an image based on the captured image;
    • a vehicle internal communication network;


characterized in that it further comprises a system according to the present invention, wherein the determining member and the controller are linked by the vehicle internal communication network.


Preferably, the camera is fixed relative to the cab, in the use position. Thus, the difference between the displayed first image and second image cannot be obtained through movement of the camera assembly relative to the cab, for providing different positions of the camera. For example, in this embodiment, the supporting arm of the camera assembly is fixedly mounted on the cab (but can be folded along the cab side when the vehicle is stopped).


The first image may correspond to a first field of vision of the camera and the second image corresponds to a second field of vision of the camera, wherein, as seen along a transverse direction, the lower boundary of the second field of vision is shifted from the lower boundary of the first field of vision by an angle α comprised between 5 and 45°.


It has to be noted that, in case the camera is fixed relative to the cab, in the use position, the above first and second fields of vision are virtual. In other words, the camera has one real and unique field of vision. The first field of vision would be the field of vision of a virtual camera that would provide a captured image that would be identical to the first displayed image, without image processing for altering the geometrical parameters (size, position, etc.) of the image. Similarly, the second field of vision would be the field of vision of a virtual camera that would provide a captured image that would be identical to the second displayed image, without image processing for altering the geometrical parameters (size, position, etc.) of the image.


The first and second fields of vision can have substantially the same spanning angle β. The optical axis of the second field of vision can be shifted from the optical axis of the first field of vision by said angle α.


In an embodiment, the controller is part of a camera monitoring system including the camera assembly. In other words, in this embodiment, the controller is not the electrical control unit of the vehicle.


Further advantages and advantageous features of the invention are disclosed in the following description and in the dependent claims.





BRIEF DESCRIPTION OF THE DRAWINGS

With reference to the appended drawings, below follows a more detailed description of embodiments of the invention cited as examples.


In the drawings:



FIG. 1 is a perspective view of a vehicle according to the invention,



FIG. 2 is a perspective view forward from the interior of a vehicle, showing a camera assembly and a monitor for displaying an image based on the image captured by the camera assembly;



FIG. 3 is the position of the driver in the first configuration;



FIG. 4 is the position of the driver in the second configuration;



FIG. 5 shows the captured image as well as a first frame corresponding to a first image displayed and a second frame corresponding to a second displayed image;



FIGS. 6a and 6b respectively show the first image displayed and the second image displayed based on the captured image of FIG. 5;



FIG. 7 is a perspective view forward the interior of a vehicle, showing two different fields of vision for displaying two different images, according to a embodiment of the invention;





DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS OF THE INVENTION

As illustrated in FIG. 1, the vehicle 1 comprises a cab 2 defining a driver's compartment 3. The cab 2 has side walls 4 each comprising a door 5, a bumper 6 including a windscreen 7. The cab 2 further comprises front wheels 8, and rear wheels 9.


X is defined as the longitudinal direction of the vehicle 1, Y is defined as the transversal direction and Z is defined as the vertical direction of the vehicle 1.


The vehicle 1 may comprise an electrical control unit (ECU) 10 for controlling the various electric systems of the vehicle 1.


The vehicle 1 also comprises a camera assembly 11 mounted on the cab 2, typically above a front portion of the door 5, at least on the side wall 4 of the cab 2 adjacent the driver's seat. Basically, the camera assembly 11 can comprise a supporting arm 12 and a camera 13 arranged on said supporting arm 12, for providing a captured image 60 of an area surrounding the vehicle 1, more specifically an area located rearwards and along a vehicle side. The supporting arm 12 can be fixedly mounted on the cab 2, and can be equipped with a mechanism (not shown) allowing the camera assembly 11 to be:

    • either in a parking position, when not in use (typically when the vehicle 1 is stopped), in which the camera assembly 11 is folded against the cab side wall 4 to prevent damages;
    • or in a use position, in which the camera assembly 11 is protruding from the cab side wall 4, to allow the camera 13 to capture images (FIGS. 1 and 2).


Such a camera assembly 11 can typically be part of a so-called camera monitoring system (CMS) 20 which further includes a monitor 21 inside the driver's compartment 3 for displaying an image based on the captured image provided by the camera 13. Thus, the vehicle 1 according to the invention can be devoid of side exterior mirrors, and possibly also devoid of an interior mirror. The camera monitoring system 20 also includes a controller 22. The controller 22 can be connected to the ECU 10.


The vehicle 1 also can also comprise a vehicle CAN bus 23. This network 23 includes electrical wiring 24 of the vehicle 1 configured to establish electric connection and communication between the cab 2, the driver seat 20 and various vehicle components. The wiring 24 can typically be linked to the ECU 10.


According to the invention, the vehicle 1 comprises a system 25 for adapting an image displayed on the monitor 21, based on the captured image 50, to a driver configuration.


The system 25 comprises a determining member for determining the driver position. As shown in FIG. 3, the position of the driver is in a first configuration, i.e. the initial position of the driver on the seat 30. The determining system can comprise four pressure sensors 31 such as deformation gauge to determine a first position of the driver on the driver seat.



FIG. 4 shows the position of the driver is in a second configuration, i.e. any other position different from the first configuration. In this example, the driver is leaning forward to look at the dead angle as if the driver would do with an exterior rear mirror. One understand that by changing position form the first position to the second position, the driver weight distribution on the seat is altered. The change in the weight distribution is detected by the sensor 31. Said sensors 31 are linked to the controller 22 via the vehicle internal communication network 23 (more generally via the bundle 24 of cables). The ECU 10 can possibly be arranged between the sensor(s) 31 and the controller 22, as shown in FIG. 2, or otherwise functionally connected to both the sensor 31 and the controller 22.


The controller 22, which is part of the system 25, is capable of receiving the driver configuration information from the determining member, here the sensor(s) 31. Said information provided by the sensor(s) 31 is either “the driver is in the initial position”, i.e. the driver position is in the first configuration, or “the driver has changed its position”, i.e. the driver position is in the second configuration.


According to the driver configuration determined by the sensor(s) 31 and the corresponding information provided to the controller 22, the controller 22 automatically processes the captured image 50, to display on the monitor 21 a displayed image.


The image displayed can be:

    • either a first image 51 which corresponds to a part of the captured image 50 defined by a first field of view 61, in case the position of the driver is in a first configuration, i.e. an initial position of the driver on the seat,
    • or a second image 52 which corresponds to a part of the captured image 50 defined by a second field of view 62, distinct from the first field of view 61, in case the position of the driver is in a second configuration, i.e. any driver position different from the initial position.


Depending on the driver position, the areas of the vehicle 1 that should be visible for the driver, for driving safely and for avoiding damages to the vehicle 1 or surrounding structures, can vary.


For that purpose, and because the camera 11 is preferably fixed relative to the cab 2, in the use position, the first image 51 displayed on the monitor 21 corresponds to a first field of vision 61 of the camera 13 as illustrated in FIGS. 5 and 6a in solid lines, while the second image 52 displayed on the monitor 21 corresponds to a second field of vision 62 of the camera 13 as illustrated in FIGS. 5 and 6b in dotted lines.


In practice, the camera 13 has one real and unique field of vision that includes at least the first field of vision 61 and the second field of vision 62 which are theoretically defined as follows. The first field of vision 61 would be the field of vision of a virtual camera which would provide a captured image that would be identical to the first image displayed 51, without image processing for altering the geometrical parameters (size, position, etc.) of the image. Similarly, the second field of vision 62 would be the field of vision of a virtual camera which would provide a captured image that would be identical to the second image displayed 52, without image processing for altering the geometrical parameters (size, position, etc.) of the image.


When seen along a transverse direction Y towards the vehicle 1, as in FIG. 7, the first field of vision 61 has an optical axis A71, a lower boundary 73 and an upper boundary 74. Similarly, the second field of vision 62 has an optical axis A72, a lower boundary 75 and an upper boundary 76.


So that the first image 51 can show an area on the right and the second image 52 can show an area on the left, the lower boundary 75 of the second field of vision 62 can be shifted from the lower boundary 73 of the first field of vision 61 by an angle α. This angle α can be comprised between 5 and 45°.


As a result, as seen in FIG. 5, the second field of vision 62—which defines the second image 52—comprises a portion 63 of the captured image 50 that is located on the left side of the first field of vision 61—which defines the first image 51.


According to an embodiment, illustrated in FIGS. 5, 6a, 6b and 7, the first and second fields of vision 61, 62 have substantially the same spanning angle β, and the optical axis A72 of the second field of vision 62 is shifted from the optical axis A71 that of the first field of vision 61 by angle α. In other words, the upper boundary 76 of the second field of vision 62 is also shifted from the upper boundary 74 of the first field of vision 61 by angle α.


As shown in FIGS. 5, 6a and 6b, this results in the second field of vision 62 being shifted relative to the first field of vision 61.


According to another embodiment (not illustrated), the first and second fields of vision 61, 62 have substantially the same optical axis, for example A71. Furthermore, the upper boundary 76 of the second field of vision 62 is upwardly offset from the upper boundary 74 of the first field of vision 61 by an angle α′. Angle α′ can be comprised between 5 and 45°. It can be identical to angle α.


This results in the field of vision 62 including the whole first field of vision 61, as well as the above mentioned portion of the captured image 50 that is located below the first field of vision 61, and a portion of the captured image 50 that is located above the first field of vision 61. The second field of vision 62 may also comprise side portions outside and on each side of the first field of vision 61. In other words, the second image 52 is a zoom-out of the first image 51.


It is to be understood that the present invention is not limited to the embodiments described above and illustrated in the drawings; rather, the skilled person will recognize that many changes and modifications may be made within the scope of the appended claims.

Claims
  • 1. A method for adapting, to a driver head position, an image displayed on a monitor in a cab of a vehicle, the vehicle comprising a camera assembly comprising at least one camera for providing a captured image of a field of view located rearwards and along a vehicle side, wherein the method comprises: detecting a change in a head position of a driver relative to a driver seat using at least one sensor located in the driver seat; andprocessing the captured image, in response to the detected change in head position of the driver relative to the driver seat, to display on the monitor the image displayed.
  • 2. The method according to claim 1, wherein the image displayed on the monitor is: either a first image which corresponds to a part of the captured image defined by a first camera field of view, in case the head position of the driver is in a first configuration,or a second image which corresponds to a part of the captured image defined by a second camera field of view, distinct from the first camera field of view, in case the head position of the driver is in a second configuration.
  • 3. The method according to claim 1, wherein the at least one sensor is a load sensor.
  • 4. The method according to claim 1, wherein the at least one sensor is located in a seat base of the driver seat.
  • 5. The method according to claim 1, wherein the at least one sensor is located in a seat backrest of the driver seat.
  • 6. The method according to claim 1, wherein the camera assembly comprises at least one camera-arranged on a supporting arm-mounted on at least one side of the vehicle and/or at least one camera arranged at a back of the vehicle.
  • 7. The method according claim 1, wherein the second camera field of view comprises a portion that is located outside of the first camera field of view.
  • 8. The method according to claim 1, wherein the second camera field of view further comprises the first camera of view.
  • 9. A system for adapting, to a driver head position, an image displayed on a monitor in a cab of a vehicle, the vehicle comprising a camera assembly for providing a captured image of an area located rearwards and along a vehicle side, wherein the system comprises: at least one sensor located in a driver seat, for detecting a change in a head position of a driver relative to the driver seat; anda controller that receives driver head position information, based on the detected change in the head position of the driver, from the at least one sensor, and that processes the captured image, according to the driver head position information, to display on the monitor the image displayed.
  • 10. A vehicle comprising: a cab;a camera assembly for providing a captured image of an area located rearwards and along a vehicle side;a monitor located in the cab, for displaying an image based on the captured image;a vehicle internal communication network;a driver seat; anda system for adapting, to a driver head position, an image displayed on the monitor in the cab of the vehicle, the vehicle comprising the camera assembly for providing the captured image of the area located rearwards and along the vehicle side, wherein the system comprises: at least one sensor located in a driver seat, for detecting a change in a head position of a driver relative to the driver seat;a controller that receives driver head position information, based on the detected change in the head position of the driver, from the at least one sensor, and that processes the captured image, according to the head position information, to display on the monitor the image displayed;wherein the at least one sensor and the controller are linked by the vehicle internal communication network.
  • 11. The vehicle according to claim 10, wherein the camera is fixed relative to the cab.
  • 12. The vehicle according to claim 10, wherein, as seen along a transverse direction, a lower boundary of the second camera field of view is shifted from a lower boundary of the first camera field of view by a first angle between 5° and 45°.
  • 13. The vehicle according to claim 12, wherein the first camera field of view and the second camera field of view have substantially a same spanning angle, and wherein an optical axis of the second field of view is shifted from an optical axis of the first field of view by the first angle.
  • 14. The vehicle according to claim 10, wherein the controller is part of a camera monitoring system including the camera assembly.
PCT Information
Filing Document Filing Date Country Kind
PCT/EP2020/051679 1/23/2020 WO
Publishing Document Publishing Date Country Kind
WO2021/148125 7/29/2021 WO A
US Referenced Citations (35)
Number Name Date Kind
7884977 Mori Feb 2011 B2
8086044 Feng Dec 2011 B2
8878773 Bozarth Nov 2014 B1
9274597 Karakotsios Mar 2016 B1
9557568 Ouderkirk Jan 2017 B1
10217286 Angel Feb 2019 B1
10466484 Yoon Nov 2019 B1
10466779 Liu Nov 2019 B1
10502963 Noble Dec 2019 B1
20080143820 Peterson Jun 2008 A1
20080212942 Gordon Sep 2008 A1
20090196460 Jakobs Aug 2009 A1
20110234750 Lai Sep 2011 A1
20120249957 Shibata Oct 2012 A1
20120250980 Gillard Oct 2012 A1
20120254369 Gillard Oct 2012 A1
20120257005 Browne Oct 2012 A1
20130038732 Waite et al. Feb 2013 A1
20130182066 Ishimoto Jul 2013 A1
20140037213 Niederberger Feb 2014 A1
20140049452 Maltz Feb 2014 A1
20160029883 Cox Feb 2016 A1
20160085300 Robbins Mar 2016 A1
20160241892 Cole Aug 2016 A1
20160280136 Besson Sep 2016 A1
20160342205 Shigeta Nov 2016 A1
20180046859 Jarvenpaa Feb 2018 A1
20180262719 Jo Sep 2018 A1
20180275409 Gao Sep 2018 A1
20180307048 Alexander Oct 2018 A1
20190086674 Sinay Mar 2019 A1
20200183174 Noui Jun 2020 A1
20200368616 Delamont Nov 2020 A1
20210011284 Andreev Jan 2021 A1
20210041948 Berkner-Cieslicki Feb 2021 A1
Foreign Referenced Citations (1)
Number Date Country
2417847 Mar 2006 GB
Non-Patent Literature Citations (1)
Entry
International Search Report and Written Opinion of the International Searching Authority, PCT/EP2020/051679, mailed Aug. 31, 2020, 10 pages.
Related Publications (1)
Number Date Country
20230049492 A1 Feb 2023 US