System and method for warning a driver of pedestrians and other obstacles when turning

Abstract

A system for warning of potential hazards when a vehicle is turning has a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle. A control unit is coupled to the sensor for processing the data captured by the sensor to generate graphical representations of objects captured by the sensor, graphical representations of projected paths of moving objects captured; and a graphical representation of a projected turning path of the vehicle.

Description

TECHNICAL FIELD

The present application generally relates to a vehicle warning system, and, more particularly, to a system and method for enhancing a driver's awareness of pedestrians and other objects by showing projected travel paths of the vehicle and pedestrian and/or moving object when the vehicle is making a turn.

BACKGROUND

Motorized vehicles may be equipped with various kinds of warning systems. These warning systems may be general warning systems that inform the driver of different operating conditions of the vehicle. For example, vehicles may be equipped with warning systems which may be used to warn the driver of low fuel amounts, high and or low engine temperature, a drop in oil pressure, problems in charging the vehicle battery, doors and or trunks that are open and the like.

Motorized vehicles may further be equipped with more advanced warning systems which may be used to warn the driver of the vehicle about potentially dangerous situations involving other traffic participants. For example, warning systems have been designed for vehicles that may be used to provide a driver with back-up collision warning, blind spot detection, lane-departure warnings, as well as driver-alertness monitoring, assisted parking, traffic sign recognition, and the like.

While the above systems do provide the driver with warnings of potential dangers, these systems fail to provide any information about a projected path of the projected danger. For example, while a blind spot detection system is able to monitor if a vehicle or other object is located in a blind spot of a vehicle, the blind spot detection system does not provide any information as to whether the vehicle and or object detected is moving towards or away from the vehicle. Similarly, while back-up warning systems may alert a driver to potential objects located behind the vehicle while the vehicle is in reverse, these systems also fail to provide any information as to whether the object is moving towards or away from the vehicle.

Therefore, it would be desirable to provide a vehicle warning system and method that overcome the above problems.

SUMMARY

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the DESCRIPTION OF THE APPLICATION. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

A system for warning of potential hazards when a vehicle is turning has a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle. A control unit is coupled to the sensor for processing the data captured by the sensor to generate graphical representations of objects captured by the sensor, graphical representations of projected paths of moving objects captured by the sensor; and a graphical representation of a projected turning path of the vehicle.

A system for warning of potential hazards when a vehicle is turning has image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle. Monitoring sensors are coupled to the vehicle to measure the speed and turning angle of the vehicle. A control unit is coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors and to generate graphical representations of pedestrians captured by the image sensors, graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle; and graphical representations indicating a projected turning path of the vehicle. A display is used to show the graphical representations of pedestrians captured by the sensor, graphical representations of the virtual crosswalks associated with pedestrians moving near the vehicle; and graphical representations indicating the projected turning path of the vehicle.

A system for warning of potential hazards when a vehicle is turning has image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle. Monitoring sensors are coupled to the vehicle to measure a speed and a turning angle of the vehicle. A control unit is coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors, wherein the control unit generates graphical representations of pedestrians captured by the sensor, graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle; and graphical representations indicating a projected turning path of the vehicle when the monitoring sensors indicates that the vehicle is turning, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having an indicator, wherein each indicator illustrates a probability of impact with the moving pedestrian. A Heads-Up Display HUD system is coupled to the control unit to show the graphical representations of pedestrians captured by the sensor, graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle; and graphical representations indicating the projected turning path of the vehicle.

BRIEF DESCRIPTION OF DRAWINGS

Embodiments of the disclosure will become more fully understood from the detailed description and the accompanying drawings, wherein:

FIG. 1 is an elevated perspective view of a vehicle implementing an exemplary warning system that may be used to enhance a driver's awareness of surrounding pedestrians and objects when the vehicle is turning in accordance with one aspect of the present application;

FIG. 2 is a simplified functional block diagram of the exemplary warning system depicted in FIG. 1 in accordance with one aspect of the present application;

FIG. 3 is a simplified functional block diagram of a control unit shown in FIG. 2 in accordance with one aspect of the present application;

FIG. 4 shows one embodiment of an exemplary Augmented Reality (AR) visual generated by the warning system of FIG. 1 in accordance with one aspect of the present application; and

FIG. 5 is another embodiment showing an exemplary Augmented Reality (AR) visual generated by the warning system of FIG. 1 in accordance with one aspect of the present application.

DESCRIPTION OF THE APPLICATION

The description set forth below in connection with the appended drawings is intended as a description of presently preferred embodiments of the disclosure and is not intended to represent the only forms in which the present disclosure can be constructed and/or utilized. The description sets forth the functions and the sequence of steps for constructing and operating the disclosure in connection with the illustrated embodiments. It is to be understood, however, that the same or equivalent functions and sequences can be accomplished by different embodiments that are also intended to be encompassed within the spirit and scope of this disclosure.

Referring to FIG. 1, an exemplary vehicle 10 is shown. The vehicle 10 may be equipped with a warning system 12 that may be used to enhance a driver's awareness of surrounding pedestrians and objects when the vehicle 10 is turning. The warning system 12 may be configured to project an actual location and dynamics of pedestrians or other moving objects. The warning system 12 may also show a projected path of the vehicle 10 calculated based on a current speed and steering angle of the vehicle 10.

Referring now to FIGS. 1 and 2, the warning system 12 may have a plurality of sensors 16. The sensors 16 may be positioned around a perimeter of the vehicle 10. In the embodiment shown in FIG. 1, the sensors 16 may be configured to be mounted within the body of the vehicle 10. However, this is only shown as an example and should not be seen in a limiting manner. The sensors 16 may be used to capture data of objects located around the vehicle 10. The sensors 16 may be cameras, image sensing devices, radar or the like. The above mentioned types of sensors 16 are given as an example and should not be seen in a limiting manner. Alternatively, the sensors 16 may be located on the street the vehicle 10 is traveling. The sensors 16 may be configures to capture data of objects located around the vehicle 10 and transmit the captured data to the vehicle 10.

The warning system 12 may further have one or more monitoring sensors 18. The monitoring sensor 18 may be coupled to one or more operating systems 20 of the vehicle 10. The monitoring sensor 18 may be used to detect operating conditions of the vehicle 10. For example, the monitoring sensor 18 may be used to monitor a speed of the vehicle 10, whether the vehicle 10 is making a turn, or the like. In accordance with one embodiment, the warning system 12 may be configured to not process and display the location and dynamics of pedestrians detected unless the monitoring sensors 18 detects that the vehicle 10 is making a turn. A threshold value may be established so that common road vibrations and slight movement of the a steering mechanism of the vehicle 10 may not accidently trigger the warning system 10 to project the location and dynamics of the pedestrians detected. In one embodiment, the warning system 10 may be used when the user enables their left hand signal.

In accordance with another embodiment, a Global Positioning Satellite (GPS) unit 28 located in the vehicle 10 may be used to determine if the vehicle 10 is moving and or turning. Since the GPS unit 28 may be able to provide speed and direction of travel data on the vehicle 10, the GPS unit 28 may be used to determine if the vehicle 10 is moving and or turning. The warning system 12 may be configured to not process and display the location and dynamics of pedestrians detected unless the GPS unit 28 detects that the vehicle 10 is making a turn and or moving.

The sensors 16 and the monitoring sensors 18 may be coupled to a control unit 22. The control unit 22 may take and process the data captured by the sensors 16. The control unit 22 may process the data in order to detect and identify the different objects detected by the sensors 16. The control unit 22 may identify the position of the different objects as well as the whether the object is moving. If moving, the control unit 22 may be used to calculate the speed and direction of the moving object. The control unit 22 may then take the process data and generate graphical representations of the objects captured by the sensors 16 and provide graphical representations of the projected paths of the moving objects.

The control unit 22 may also process data generated by the monitoring sensors 18 of the vehicle 10. The control unit 22 may receive data from the monitoring sensors 18 in order to determine if the vehicle 10 is making a turn and the speed the vehicle 10 may be traveling. If the control unit 22 determines that the vehicle 10 is turning, the control unit 22 may generate a graphical representation indicating the projected turning path of the vehicle 10.

The warning system 12 is a dynamic system. Thus, the control unit 22 may continuously update graphical representations of the objects captured by the sensors 16 as the vehicle 10 is turning. Thus, graphical representations of projected paths of the objects detected that are moving may be continuously updated. Graphical representations indicating the projected turning path of the vehicle 10 may also be continuously updated as the vehicle 10 progresses into the turn.

The control unit 22 may be coupled to a display 24. The display 24 may be used to show the graphical representations generated by the control unit 22 of the objects captured by the sensors 16, projected paths of the moving objects, as well as the graphical representation indicating the projected turning path of the vehicle 10. Alternatively, the control unit 22 may be coupled to a Heads Up Display (HUD) system 26. The HUD system 26 may be used to display the graphical representations generated by the control unit 22 of the objects captured by the sensors 16, projected paths of the moving objects, as well as the graphical representation indicating the projected turning path of the vehicle 10.

The warning system 12 may be configured so that the display 24 and or HUD system 26 displays the general area viewable in front of the driver when the driver is seated in the vehicle 10 (hereinafter Field of View (FOV) of the driver). However, for objects detected by the sensors 16 but not in the FOV of the driver or towards a far edge of the FOV, for example a pedestrian located behind the vehicle 10, symbols and or warning text and a string indicating a general position of the detected object may be generated and shown on the display 24 and or HUD system 26.

As stated above, a Global Positioning Satellite (GPS) unit 28 may be coupled to the control unit 22. The GPS unit 28 may be used to provide geographical information to the control unit 22. Based on the location indicated by the GPS unit 28, the GPS unit 28 may load and transfer location data about the indicated location. For example, the GPS unit 28 may load and transfer satellite imagery of the current location. This imaging may be sent to the control unit 22 which may generate a graphical representation of the satellite images to be shown on the display 24 and or HUD system 26. Further, as disclosed above, the GPS unit 28 may be used to determine if the vehicle 10 is turning and or moving by monitoring the speed and direction of the vehicle 10.

Referring now to FIG. 3, a functional block diagram of the control unit 22 may be seen. The control unit 22 may have an image processing module 30. The image processing module 30 may be coupled to the sensors 16. The image processing module 30 may process the data from the sensors 16 in order to detect and identify the different objects detected by the sensors 16. The image processing module 30 may identify the different objects detected as well as determine whether the object is moving. In accordance with one embodiment, the image processing module 30 may be configured to identify and distinguish pedestrians from other objects detected around the vehicle 10. Thus, the image processing module 30 may be used to identify potential hazardous situations to the driver, such as pedestrians or bicyclist, as opposed to non-hazardous objects such as a fire hydrant or the like. The control unit 22 may be configured so that potential hazardous objects like pedestrians are shown, while non-hazardous objects may not be processed and or displayed.

If an object is detected as moving, the image processing module 30 may be used to calculate the speed and direction of the moving object. Based on the calculated speed and direction of the moving object, a path processing module 32 of the control unit 22 may be used to calculate a projected path of the moving object. The path processing module 32 may further be used to calculate a projected turning path of the vehicle 10. The path processing module 32 may receive data from the monitoring sensor 18 and or GPS unit 28 indicating speed and directional information of the vehicle 10. Based on this information, the path processing module 32 may calculate the projected turning path of the vehicle 10.

An augmented reality processing module 34 of the control unit 22 may be used to generate graphical representations of the different objects detected by the sensors 16, graphical representations of the projected paths of the moving objects and graphical representations indicating the projected turning path of the vehicle 10. The augmented reality processing module 34 may further generate graphical representations of location data provided by the GPS unit 28. The graphical representations generated by the augmented reality processing module 34 may be two dimensional representations or three dimensional representations.

The graphical representations generated by the augmented reality processing module 34 may be shown on a display 24 located within the vehicle 10. Alternatively, the HUD system 26 may be used to display the graphical representations generated by the augmented reality processing module 34.

Referring now to FIGS. 1-4, an exemplary embodiment of an augmented reality generated and displayed by the warning system 10 may be seen. The augmented reality shown may be the FOV in front of the driver when the driver is seated in the vehicle 12. The exemplary embodiment shown in FIG. 4 may illustrate the vehicle 10 making a left turn.

The control unit 22 may generate one or more graphical representations of pedestrians 40 detected by the sensors 16. In the present embodiment, two pedestrians 40 may be seen as being in the FOV of the driver. To highlight the position of the pedestrians 40, a sign 42 or other symbol may be placed adjacent to each pedestrian 40. In the embodiment shown, the signs 42 may be positioned above each respective pedestrian 40 in the FOV of the driver. The signs 42 may flash and or blink to further draw the driver's attention to the pedestrians 40 in the FOV of the driver.

If a pedestrian 40 is out of the FOV or towards the outer edge of the FOV of the driver, a sign 42 with a pointer 44 may be used to indicate a general position of the pedestrian 40 who is out of or towards the outer edge of the FOV of the driver. The sign 42 and pointer 44 may flash and or blink to further draw the driver's attention to the pedestrians 40 who may be out of or towards the outer edge of the FOV of the driver.

The augmented reality shown may further include a virtual crosswalk 46 for pedestrians 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be used to identify a projected path of the pedestrians 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be dynamic and change position based on the movement of the pedestrians 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be calculated based on the position, speed and direction of the pedestrians 40.

The augmented reality shown may further include a graphical representation of a projected turning path 48 (hereinafter turning path 48) of the vehicle 10. The turning path 48 may be dynamic and adjust in length/size as the vehicle 10 moves during the turn. The turning path 48 may be calculated based on the speed and turning angle of the vehicle 10.

The turning path 48 may be color coded based on the distance between the vehicle 10 intersecting with a particular pedestrian 40. In accordance with one embodiment, the turning path 48 may be color coded to provide a visual indication/warning to the driver. For example, in the turning path 48 shown in FIG. 4, a first section 48A of the turning path 48 may be shown in a first color (for example green) to indicate that in the first section 48A, based on present speed and direction of the vehicle 10, the driver generally will not intersect with the particular pedestrian 40. The turning path 48 may further have a second section 48B which may be shown in a second color (for example yellow) to indicate that in the second section 48B, based on present speed and direction of the vehicle 10, the driver should slow down and or yield so as not to intersect with the particular pedestrian 40. The turning path 48 may further have a third section 48C which may be shown in a third color (for example red) to indicate that in the third section 48B, based on present speed and direction of the vehicle 10, the driver should stop so as not to intersect with the particular pedestrian 40.

The augmented reality shown may further include a warning sign 50. The warning sign 50 may be positioned along the turning path 48. The warning sign 50 may be used to further provide a visual warning to the driver. For example, based on the current speed and turning angle of the vehicle 10, the warning sign 50 may indicate to the driver to go, yield, stop or the like.

Referring now to FIGS. 1-3 and 5, another exemplary embodiment of an augmented reality generated and displayed by the warning system 10 may be seen. The augmented reality shown may be the FOV in front of the driver when the driver is seated in the vehicle 12. The exemplary embodiment shown in FIG. 5 may illustrate the vehicle 10 making a right turn.

The control unit 22 may generate one or more graphical representations of a pedestrian 40 detected by the sensors 16. In the present embodiment, one pedestrian 40 may be seen as being in the FOV of the driver. To highlight the position of the pedestrian 40, a sign 42 or other symbol may be placed adjacent to each pedestrian 40. In the embodiment shown, the sign 42 may be positioned above the pedestrian 40 in the FOV of the driver. The sign 42 may flash and or blink to further draw the driver's attention to the pedestrian 40 in the FOV of the driver.

If a pedestrian 40 is out of the FOV or towards the outer edge of the FOV of the driver, a sign 42 with a pointer 44 may be used to indicate a general position of the pedestrian 40 who is out of or towards the outer edge of the FOV of the driver. The sign 42 and pointer 44 may flash and or blink to further draw the driver's attention to the pedestrians 40 who may be out of or towards the outer edge of the FOV of the driver.

The augmented reality shown may further include a virtual crosswalk 46 for the pedestrian 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be used to identify a projected path of the pedestrian 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be dynamic and change position based on the movement of the pedestrian 40 who may be seen as being in the FOV of the driver. The virtual crosswalk 46 may be calculated based on the position, speed and direction of the pedestrian 40.

The augmented reality shown may further include a graphical representation of a projected turning path 48 (hereinafter turning path 48) of the vehicle 10. The turning path 48 may be dynamic and adjust in length/size as the vehicle 10 moves during the turn. The turning path 48 may be calculated based on the speed and turning angle of the vehicle 10.

The turning path 48 may be color coded based on the distance between the vehicle 10 intersecting with a particular pedestrian 40. In accordance with one embodiment, the turning path 48 may be color coded to provide a visual indication/warning to the driver. For example, in the turning path 48 shown in FIG. 5, a first section 48A of the turning path 48 may be shown in a first color (for example green) to indicate that in the first section 48A, based on present speed and direction of the vehicle 10, the driver generally will not intersect with the particular pedestrian 40. The turning path 48 may further have a second section 48B which may be shown in a second color (for example yellow) to indicate that in the second section 48B, based on present speed and direction of the vehicle 10, the driver should slow down and or yield so as not to intersect with the particular pedestrian 40. The turning path 48 may further have a third section 48C which may be shown in a third color (for example red) to indicate that in the third section 48B, based on present speed and direction of the vehicle 10, the driver should stop so as not to intersect with the particular pedestrian 40.

The augmented reality shown may further include a warning sign 50. The warning sign 50 may be positioned along the turning path 48. The warning sign 50 may be used to further provide a visual warning to the driver. For example, based on the current speed and turning angle of the vehicle 10, the warning sign 50 may indicate to the driver to go, yield, stop or the like.

While embodiments of the disclosure have been described in terms of various specific embodiments, those skilled in the art will recognize that the embodiments of the disclosure may be practiced with modifications within the spirit and scope of the claims.

Claims

1. A system for warning of potential hazards when a vehicle is turning comprising: a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle;monitoring sensors coupled to the vehicle to measure a speed and a turning angle of the vehicle; anda control unit coupled to the sensor for processing the data captured by the sensor to:generate graphical representations of objects captured by the sensor;generate graphical representations of projected paths of moving objects captured by the sensors based on speeds and travel directions of the moving objects;calculate a projected turning path of the vehicle based on the speed and the turning angle of the vehicle; andgenerate a graphical representation of the projected turning path, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having a respective indicator, wherein each indicator illustrates a probability of impact with the moving object in the respective section of the projected turning path.

2. The system of claim 1, wherein each section is color coded to illustrate the probability of impact with the moving object in the respective section of the projected turning path.

3. The system of claim 1, further comprising monitoring sensors coupled to the vehicle and the control unit for monitoring at least one of the turning angle or the speed of the vehicle.

4. The system of claim 1, wherein the control unit generates the graphical representations of objects captured by the sensor, the graphical representations of projected paths of moving objects captured by the sensor, and the graphical representation of a projected turning path of the vehicle when the sensor indicates that the vehicle is turning.

5. The system of claim 1, further comprising a Global Positioning Satellite (GPS) system coupled to the vehicle and the control unit.

6. The system of claim 5, wherein the GPS system transfers imagery of a current location of the vehicle to the control unit, the control unit generating graphical representations of imagery transferred from the GPS of the current location.

7. The system of claim 1, further comprising a display coupled to the control unit to show the graphical representations of objects captured by the sensor, the graphical representations of projected paths of moving objects captured by the sensor, and the graphical representation indicating the projected turning path of the vehicle.

8. The system of claim 1, wherein the control unit comprises: an image processing module coupled to the sensor to identify the objects detected by the sensors;a path processing module to calculate the projected paths of moving objects detected by the sensor and the projected turning path of the vehicle; andan Augmented Reality (AR) processing module to generate the graphical representations of the objects detected by the sensor, the graphical representations of the projected paths of the moving objects and the graphical representations indicating the projected turning path of the vehicle, wherein the projected turning path of the vehicle is dynamic and adjusts in size as the vehicle moves during the turn.

9. The system of claim 1, wherein the graphical representations of the objects detected by the sensor are two dimensional.

10. The system of claim 1, wherein the graphical representations of the objects detected by the sensor are three dimensional.

11. The system of claim 1, wherein the graphical representations of the objects include a first sign associated with at least one of the objects detected by the sensor which is in a Field of View (FOV) of a driver of the vehicle.

12. The system of claim 11, wherein the graphical representations of the objects include: a second sign associated with at least one of the objects detected by the sensor which is outside of the FOV of the driver of the vehicle; anda pointer sign associated with the second sign and positioned to indicate a location of the at least one of the objects detected by the sensor which is outside the FOV of the driver.

13. A system for warning of potential hazards when a vehicle is turning comprising: image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle;monitoring sensors coupled to the vehicle to measure speed and turning angle of the vehicle;a control unit coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors and to:generate graphical representations of pedestrians captured by the image sensors;generate graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle showing projected pathways of the pedestrians based on a speed and a travel direction of each of the pedestrians;calculate a projected turning path of the vehicle based on a speed and turning angle of the vehicle; andgenerate a graphical representation indicating the projected turning path of the vehicle, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having a respective indicator, wherein each indicator illustrates a probability of impact with the moving object in the respective section of the projected turning path; anda display to show the graphical representations of pedestrians captured by the sensor, the graphical representations of the virtual crosswalks associated with pedestrians moving near the vehicle; and the graphical representation indicating the projected turning path of the vehicle.

14. The system of claim 13, further comprising a Global Positioning Satellite (GPS) system coupled to the vehicle and the control unit to transfer imagery of a current location of the vehicle to the control unit.

15. The system of claim 13, wherein the control unit comprises: an image processing module coupled to the image sensors;a path processing module to calculate the virtual crosswalks and the projected turning path of the vehicle; andan Augmented Reality (AR) processing module to generate the graphical representations of the pedestrians detected by the sensor, the graphical representations of the virtual crosswalks and the graphical representations indicating the projected turning path of the vehicle, wherein the projected turning path of the vehicle is dynamic and adjusts in size as the vehicle moves during the turn.

16. The system of claim 13, wherein the control unit generates the graphical representations of pedestrians captured by the image sensors, the graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle; and the graphical representations indicating the projected turning path of the vehicle when the monitoring sensors indicate that the vehicle is turning.

17. A system for warning of potential hazards when a vehicle is turning comprising: image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle;monitoring sensors coupled to the vehicle to measure a speed and a turning angle of the vehicle;a control unit coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors, wherein the control unit is configured to:generate graphical representations of pedestrians captured by the sensor;generate graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle showing projected pathways of the pedestrians based on a speed and a travel direction of each of the pedestrians;calculate a projected turning path of the vehicle based on a speed and turning angle of the vehicle; andgenerate a graphical representation indicating the projected turning path of the vehicle when the monitoring sensors indicate that the vehicle is turning, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having a respective indicator, wherein each indicator illustrates a probability of impact with the moving pedestrian in the respective section of the projected turning path; anda Heads-Up Display HUD system coupled to the control unit to show the graphical representations of pedestrians captured by the sensor, the graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle, and the graphical representations indicating the projected turning path of the vehicle.

18. The system of claim 17, wherein the control unit comprises: an image processing module coupled to the image sensors;a path processing module to calculate the virtual crosswalks and the projected turning path of the vehicle; andan Augmented Reality (AR) processing module to generate the graphical representations of the pedestrians detected by the sensor, the graphical representations of the virtual crosswalks and the graphical representation indicating the projected turning path of the vehicle.