The present disclosure relates generally to the technical field of electronic assistance of a driver of a motor vehicle. It relates in particular to a wearable apparatus for use by a driver of a motor vehicle and to a method for using the apparatus.
At present, motor vehicles are being increasingly equipped with devices for electronic assistance of the driver. These devices are, for example, sensor devices, such as cameras and distance sensors which detect the environment of the motor vehicle and in doing so generate environment data.
The environment data is provided to the driver typically in the form of a visual display (e.g., a camera image) or in the form of an acoustic signal (e.g., in dependence on a distance to an obstacle in the environment of the motor vehicle). This data is customarily displayed by a display device which is fixedly integrated in the motor vehicle in the region of the instrument display or centre console.
Depending on the driving situation (e.g., forward driving or reversing, parking procedure), sensor devices arranged at different positions of the motor vehicle may be interrogated in order to adapt the environment data provided to the driver, for example, to the driving direction of the motor vehicle. However, in some driving situations (e.g., reversing) the driver typically changes the orientation of his/her viewing direction inside the motor vehicle. This may result in the display device, for displaying the environment data and fixedly integrated in the motor vehicle, not lying in the viewing direction, and thus lying outside the field of view, of the driver.
To avoid such disadvantages, a parking aid is described in published application DE 10 2011 121 285 A1. In this aid, obstacles are detected by sensor devices at least in an environment located at the front side and at the rear side of the motor vehicle. The environment data generated during this is displayed in dependence on the driving direction of the motor vehicle by means of a display device arranged in the region of the windscreen or by means of a display device arranged in the region of the rear window (e.g., a head-up display).
An improved solution for electronic assistance of a driver of a motor vehicle is to be provided.
According to a first aspect, a wearable apparatus for use by a driver of a motor vehicle is provided. The wearable apparatus comprises a communication device which is configured to communicate with a complementary communication device of the motor vehicle, a display device and a processor device. The processor device is configured to receive, via the communication device, sensor-acquired data regarding an environment of the motor vehicle from the complementary communication device of the motor vehicle and to control the display device to display the received environment data or environment data derived therefrom.
The communication device may be configured for wireless communication at least with the complementary communication device of the motor vehicle. The communication may take place here, for example, via Bluetooth, WLAN, ultra-wideband or another wireless communication technology.
The display device may be a liquid crystal display. Alternatively thereto, another display system (e.g., OLEDs) may be provided.
The sensor-acquired environment data may be data of an external sensor. In particular, it may be data of a distance sensor and/or a camera of the motor vehicle.
The distance sensor may be configured to determine a distance between the motor vehicle and an obstacle. For example, a distance sensor based on ultrasound, on radar or on light in the infrared (IR) wavelength range (approx. 700 nm to 1100 nm) may be provided. Distance data acquired by the distance sensor may be displayed in the form of numerical values (e.g., absolute values) or in the form of a graphical element (e.g., in the form of a bar variable in size) by means of the display device. The camera may be configured to detect light in the visible wavelength range (approx. 300 nm to 700 nm) and/or to detect IR light. Provision may be made to display a camera image detected by the camera, additionally or alternatively to the distance data, by means of the display device. Furthermore, provision may be made for the processor device of the apparatus and/or a processor device of the motor vehicle to be configured to process (e.g., to aggregate) environment data. The processed environment data may be displayed by means of the display device.
Regarding the environment of the motor vehicle, an environment located at the rear side, at the front side and/or laterally of the motor vehicle may be provided. In this case, the environment may include in particular a traffic space located at the rear side, at the front side and/or laterally of the motor vehicle. Provision may be made for the sensor-acquired environment data to be environment data regarding the environment located at the rear side of the motor vehicle.
The processor device may be configured to request and/or receive data which indicates a driving direction of the motor vehicle. The data indicating the driving direction of the motor vehicle may indicate an engaged gear or be derived therefrom. For this purpose, the processor device may be configured, for example, to communicate with a gearbox sensor arranged in the motor vehicle. The gearbox sensor may be provided to detect the gear engaged by the driver or the gear engaged in an automated manner (automatic transmission).
Alternatively or additionally thereto, the data indicating the driving direction of the motor vehicle may indicate an orientation of the driver inside the motor vehicle or be derived therefrom. In this case, the apparatus may comprise a device which is configured to detect the orientation of the driver inside the motor vehicle. Provision may be made for the orientation detection device to be configured to determine an orientation of the apparatus inside the motor vehicle. This may take place by interaction with at least one complementary orientation detection device arranged in the motor vehicle. The at least orientation detection device may comprise, for example, electrical contact surfaces, functional units of a (e.g., inductive) proximity sensor or an inertial sensor. The inertial sensor may comprise at least one translation sensor and/or at least one gyroscopic sensor.
The apparatus may further comprise a detection device which is configured to detect a user input. The detection device may, for example, be integrated with the display device in the manner of a touch-sensitive screen. Alternatively or additionally thereto, the detection device may have one or more mechanical operating elements. These elements may be buttons, switches, slide controls or other operating elements to be operated mechanically. Furthermore, the detection device may comprise a microphone for detecting an acoustic user input and/or the inertial sensor for detecting a movement executed by the apparatus.
Provision may be made for the processor device to be configured to control the display device to display the received environment data or the environment data derived therefrom when the data indicating the driving direction of the motor vehicle indicates a reversing. Furthermore, for active (e.g., performed by the driver of the motor vehicle) control of the display, provision may be made for the processor device to be configured to control the display device to display the received environment data or the environment data derived therefrom, based on the user input, selectively regarding an environment located at the rear side and/or the front side and/or laterally of the motor vehicle. Thus, the display device may be controlled, for example in a reverse parking procedure, to display the environment located at the rear side and, in at least some embodiments, laterally of the motor vehicle. This driving may take place in response to a user input or automatically (e.g., in dependence on the detected or desired driving direction).
The processor device may further be configured to control the communication device based on the user input to request and/or receive the data regarding an environment of the motor vehicle. Alternatively thereto, the processor device may be configured to request and/or receive data regarding an environment of the motor vehicle via the communication device, as soon as the apparatus is situated within a range of the complementary communication device of the motor vehicle.
The apparatus may be configured to be wearable on the wrist or on the arm of the driver. Thus, the apparatus may comprise a housing and also an arrangement by which the apparatus is wearable by the driver on the wrist or on the arm. The display device, the processor device and the communication device may be accommodated in the housing. The arrangement for wearing the apparatus may be, for example, a strap (e.g., wrist strap) or a garment.
The apparatus may be a smartwatch. The smartwatch may be used inside and/or outside the motor vehicle in the manner of a conventional watch.
According to a second aspect, a system is provided. The system comprises the apparatus, presented here, wearable by a driver of the motor vehicle and a motor vehicle which comprises a sensor device for acquiring data regarding an environment of the motor vehicle, and a communication device. According to a third aspect, a method for using a wearable apparatus by a driver of a motor vehicle is provided, wherein the apparatus comprises a communication device and a display device. The communication device is configured to communicate with a complementary communication device of the motor vehicle. The method comprises the steps of receiving, via the communication device, sensor-acquired data regarding an environment of the motor vehicle from the complementary communication device of the motor vehicle and driving the display device to display the received environment data or environment data derived therefrom.
According to a fourth aspect, a computer program product is provided, which is stored on a computer-readable storage medium. The computer program product is operable to cause a processor device to carry out the method presented here.
Further advantages, details and features of the solution described here will become apparent from the following description of exemplary embodiments and from the figures, in which:
In the exemplary embodiment shown in
In another exemplary embodiment, the mechanical operating element 26 and/or the electrical interface 27 may be arranged on another section of the housing 22 of the apparatus 10 or be completely omitted. Moreover, further elements (not shown) may be integrated in the housing 22, such as, for example, an interface which is configured as an electrical contact surface, an interface for inserting a data carrier, a loudspeaker or a microphone.
In the exemplary embodiment shown in
The apparatus 10 according to
The processor device 32 comprises at least one processor 38 (e.g., a CPU) and a storage medium (store) 40. The store 40 is configured to store at least one computer program product (program) 42. The program 42 controls operations to be executed by the processor 38. The store 40 may be, for example, a hard-disk store, a removable store or a semiconductor store. The processor device 32 is configured to control (e.g. based on the detected user input) the display device 24, the communication device 34 and/or the orientation detection device 36.
The communication device 34 of the apparatus 10 communicates with a complementary communication device 44, arranged in the motor vehicle 14, by unidirectional or bidirectional data transmission. The data transmission according to
Via the communication with the control system 46 of the motor vehicle 14, the processor device 32 of the apparatus 10 is configured to control sensor detection devices 48 of the motor vehicle 14 and/or receive data from the sensor detection devices 48. In the exemplary embodiment shown, the sensor detection devices 48 are a gearbox sensor 50, a camera 52 and a distance sensor 54. Alternatively or additionally thereto, the motor vehicle 14 may comprise further sensor detection devices 48 (e.g., further cameras 52 and/or further distance sensors 54). Provision may furthermore be made for the processor device 32 to be configured to read out further motor vehicle system functions (e.g. a speedometer) via the communication with the control system 46 of the motor vehicle 14.
The gearbox sensor 50 is configured to detect a gear of the motor vehicle 14 engaged by the driver or in an automated manner (automatic transmission). The camera 52 and the distance sensor 54 are configured to acquire environment data of the motor vehicle 14. Depending on the arrangement of the environment data sensor 52, 54 on the motor vehicle 14, the data here is data regarding an environment located at the rear side, at the front side and/or laterally of the motor vehicle 14. The environment here may be, in particular, a traffic space surrounding the motor vehicle 14.
The camera 52 is configured to detect electromagnetic waves. Provision may be made here for the camera 52 to be configured to detect light in the visible wavelength range (approx. 300 nm to 700 nm) and/or light in the infrared (IR) wavelength range (approx. 700 nm to 1100 nm). The camera 52 may comprise, for example, a CCD sensor (charge coupled device) and/or a CMOS sensor (complementary metal oxide silicon). The sensor may furthermore comprise a filter, in order to filter out light of a particular wavelength range (e.g. of the visible wavelength range). At least in this case, the camera 52 may comprise an image converter for visualising IR light. The distance sensor 54 is configured to detect a distance to an obstacle. As the distance sensor 54, for example a transmitter-receiver arrangement for ultrasonic waves or IR light may be provided.
The orientation detection device 36 of the apparatus 10 is configured to detect an orientation of the driver 12 inside the motor vehicle 14. Provision may be made here for the orientation of the driver 12 to be deduced from a determination of the position of the apparatus 10 wearable by the driver 12. For this purpose, in the exemplary embodiment shown in
Alternatively or additionally thereto, the orientation detection device 36 may be configured to detect an orientation of the driver 12 inside the motor vehicle 14 without interacting with the complementary orientation detection device 56. Here the orientation detection device 36 of the apparatus 10 may be, for example, the inertial sensor. The inertial sensor may comprise at least one translation sensor and/or at least one gyroscopic sensor. Provision may be made for a predetermined movement of the apparatus 10 (e.g., from the region of the steering wheel 20 into the region of the driver's seat or of the passenger's seat) to be detected as a change in orientation.
According to the exemplary embodiment in
In the following method step 62, the display device 24 (cf.
In addition to the method shown in
Applied to the exemplary embodiment in
In the exemplary embodiment shown in
Alternatively or additionally thereto, in the method step 66 the user input is detected. With reference to the exemplary embodiments in
Provision may furthermore be made for the processor device 32 to be configured to control (step 62) the display device 24 to display the received environment data or the environment data derived therefrom, based on the detected user input (step 66), selectively regarding an environment located at the rear side and/or at the front side and/or laterally of the motor vehicle 14 or to deactivate the display. Thus, provision may be made, for example, to activate and to deactivate the display of the rear-side environment by means of the user input. Provision may also be made to switch, by means of the user input, between the display of the front-side environment and the display of the rear-side environment (e.g., for a reverse parking procedure). Additionally or alternatively thereto, provision may be made to switch, by means of the user input, between the display of a rear-side environment and the display of the rear-side and of the lateral environment (e.g., for a reverse parallel parking procedure). In each of the above-mentioned cases, the activating/deactivating or the switching of the display may also take place automatically (for example in dependence on the detected or intended driving direction).
With reference to the embodiments described above, the apparatus 10 may be utilised for assisting the driver 12 of the motor vehicle 14. By attaching the apparatus 10 to the wrist or to the forearm of the driver, this apparatus is arranged in a viewing direction of the driver 12 both on forward driving of the motor vehicle 14 and on reversing of the motor vehicle 14. The environment data provided by means of the display device 24 for assistance lies in the intuitive field of view of the driver 12. The latter is thus not forced, particularly on reversing, to look away from the driving direction of the motor vehicle 14 in the direction of a display device, for example, fixedly integrated in the region of the dashboard 18. As a result of the environment data displayed in the viewing direction (e.g., camera image), moreover the driver's 12 understanding of the environment data is improved.
The exemplary embodiments described provide various features and use of a solution regarding the electronic assistance of a driver of a motor vehicle. In a different exemplary embodiment, these features may be combined or modified as desired.
Number | Date | Country | Kind |
---|---|---|---|
10 2014 017 599 | Nov 2014 | DE | national |
Number | Name | Date | Kind |
---|---|---|---|
20050046953 | Repetto et al. | Mar 2005 | A1 |
20100253543 | Szczerba | Oct 2010 | A1 |
20140253419 | Tanada | Sep 2014 | A1 |
20160023602 | Krishnan | Jan 2016 | A1 |
20160086491 | Choi | Mar 2016 | A1 |
Number | Date | Country |
---|---|---|
198 11 161 | Sep 1999 | DE |
102 26 278 | Dec 2003 | DE |
10 2004 060 776 | Jul 2006 | DE |
10 2007 002 258 | Jul 2008 | DE |
10 2008 034 606 | Jan 2010 | DE |
10 2011 121 285 | Jun 2013 | DE |
10 2012 005 277 | Jul 2013 | DE |
10 2012 200 721 | Jul 2013 | DE |
2 295 281 | Mar 2011 | EP |
2005-096750 | Apr 2005 | JP |
2005-204143 | Jul 2005 | JP |
2005-212709 | Aug 2005 | JP |
2011-109170 | Jun 2011 | JP |
2013-543979 | Dec 2013 | JP |
2014-197179 | Oct 2014 | JP |
10-1335344 | Dec 2013 | KR |
03023801 | Mar 2003 | WO |
2012068089 | May 2012 | WO |
Entry |
---|
Office Action dated Nov. 8, 2016, issued in counterpart Japanese Patent Application No. 2015-196406, with Partial English translation. (11 pages). |
Number | Date | Country | |
---|---|---|---|
20160152185 A1 | Jun 2016 | US |