Patent Application
20230026519
The present disclosure relates to providing an image on a display of a vehicle of a rear view from the vehicle. Vehicles currently can include a number of cameras that provide images of the area surrounding the vehicle on a display. The images of the surrounding area may be generated from a rear view camera or a side view camera that monitors a blind spot on the vehicle.
In one exemplary embodiment, a method of providing image includes obtaining at least one first image of a surrounding area from a first camera, At least one second image of the surrounding area is obtained from a second camera. The at least one first image is fused with the at least one second image to generate a three-dimensional model of the surrounding area. A first image of the three dimensional model is displayed to a display by determining a first position of an operator. A second image of the three-dimensional model is provided to the display by determining when the operator is in a second position to simulate motion parallax.
In another embodiment according to any of the previous embodiments, tracking information is received on the operator to determine when the operator is in the first position or in the second position
In another embodiment according to any of the previous embodiments, the tracking information includes an eye position of the operator.
In another embodiment according to any of the previous embodiments, the first image of the three-dimensional model is provided based on a first eye position of the operator. The second image is provided based on a second eye position of the operator.
In another embodiment according to any of the previous embodiments, the first camera is located on a first sideview mirror of a vehicle.
In another embodiment according to any of the previous embodiments, the second camera is located on a second sideview mirror of the vehicle.
In another embodiment according to any of the previous embodiments, at least one third image of the surrounding area is obtained from a third camera.
In another embodiment according to any of the previous embodiments, the at least one third image is fused with the at least one first image and the at least one second image to generate the three-dimensional model of the surrounding area.
In another embodiment according to any of the previous embodiments, the at least one third image is provided by the third camera from a location intermediate a first sideview mirror and a second sideview mirror.
In another embodiment according to any of the previous embodiments, the third image source is from a rear-view camera.
In another embodiment according to any of the previous embodiments, the first camera and the second camera are located on a first sideview mirror of a vehicle.
In another embodiment according to any of the previous embodiments, at least one third image is obtained from a third camera and at least one fourth image from a fourth image source.
In another embodiment according to any of the previous embodiments, the first camera and the second camera are located on a second sideview mirror of the vehicle.
In another embodiment according to any of the previous embodiments, the at least one third image and the at least one fourth image are fused with the at least one first image and the at least one second image to generate the three-dimensional model of the surrounding area.
In another exemplary embodiment, an image simulation assembly includes a first camera, a second camera and a controller are configured for obtaining at least one first image of a surrounding area from a first camera. At least one second image of the surrounding area is obtained from a second camera. The at least one first image is fused with the at least one second image to generate a three-dimensional model of the surrounding area. A first image of the three dimensional model is provided to a display by determining a first position of an operator. A second image of the three-dimensional model is provided to the display by determining when the operator is in a second position to simulate motion parallax.
In another embodiment according to any of the previous embodiments, tracking information on the operator is received to determine when the operator is in the first position or in the second position.
In another embodiment according to any of the previous embodiments, the tracking information includes an eye position of the operator.
In another embodiment according to any of the previous embodiments, the first image of the three-dimensional model is provided based on a first eye position of the operator. The second image is provided based on a second eye position of the operator.
In another embodiment according to any of the previous embodiments, the first camera is located on a first sideview mirror of a vehicle. The second camera is located on a second sideview mirror of the vehicle.
In another embodiment according to any of the previous embodiments, at least one third image of the surrounding area is obtained from a third camera.
The various features and advantages of the present disclosure will become apparent to those skilled in the art from the following detailed description. The drawings that accompany the detailed description can be briefly described as follows.
Vehicles include several features to improve visibility of the surrounding area to allow a driver to safely navigate along roads or along other driving surfaces. As shown in
In the illustrated example, the sideview mirrors 24 include a first camera 38 on a first one of the sideview mirrors 24 and a second camera 40 on a second one of the sideview mirrors 24. The cameras 26, 33, 38, and 40 and the display 34 are in electrical communication a controller 42 located in the vehicle 20. The controller 42 includes a processor and memory for performing the functions outlined below.
The controller 42 also receives position information from the eye tracking camera 33 in the passenger cabin 22 to monitor movement of the operator's eyes 50. Without the discloses system, an operator of a vehicle 20 may use the rear view mirror 28 to assess a position of objects in a field of view of the rear of the vehicle 20.
In order to improve depth perception with the rear view mirror 28 or sideview mirrors 24, the operator may move his or her head in a side to side motion to see how a perception of the objects in the surrounding area 52 changes to help judge distance. The amount of motion may only be 1-9 inches (2.54-22.86 cm). However, when viewing rear view images on the display 34 in the dash of a traditional vehicle 20, the rear view image does not change based on a position of the operator viewing the image. The controller 42 monitors position of the operator's head or eyes 50 and uses that information to provide differing rear view images 54A, 54B based on the determined position. In particular, the operator may perform the same side to side movement when looking at the display 34 as when looking at the rear view mirror 28 or side view mirrors 24 to obtain a greater sense of depth of the objects in the surrounding area 52. The controller 42 is therefore able to simulate motion parallax on the display 34 based at least on a position of the operator. The controller 42 can then display the proper simulated image 54A or 54B of the 3D model 51 based on operator position.
The passenger cabin 22 includes a view of the sideview mirrors 24 and the rear view mirror 28 from the driver's seat 32. In the illustrated example, the display 34 is located in a central portion of the dash 36 of the vehicle 20 to allow the operator in the driver's seat 32 to easily view the display 34 and any images projected thereon. The cabin 22 also includes the eye tracking camera 33 for tracking movement of the driver's eyes 50 and or head to determine changes in position.
The sideview mirrors 24 also include a first pair of cameras 38A, 38B on a first one of the sideview mirrors 24 and a second pair of cameras 40A, 40B on a second one of the sideview mirrors 24. The cameras 26, 33, 38A, 38B, 40A, and 40B and the display 34 are in electrical communication to the controller 42 located in the vehicle 20.
The mirror image simulation assemblies 60 and 160 provide improved image simulation of the surrounding area 52 by simulating motion parallax for the driver of the vehicle 20. Motion parallax provides the operator of the vehicle 20 with improved depth perception of the objects being shown in the display 34. In particular, the assemblies 60 and 160 provide improved motion parallax with the display 34 being a traditional display found in vehicles with a pixel density of between 50 and 200 PPI
Similarly, in the case of the assembly 160, the first image may be obtained from the camera 38A and the second image may be obtained by the camera 38B or the first image may be obtained from the camera 40A and the second image may be obtained by the camera 40B. Alternatively, the first image may be obtained from one of the cameras 38A, 38B and the second image may be obtained from the cameras 40A, 40B. Additionally, it is possible that a third, fourth, or fifth image can be provided by one of the cameras 26, 38A, 38B, 40A, or 40B that has not already provided one of the first or second images to the controller 42.
Once, the first and second images have been obtained by the controller 42, the controller 42 fuses the images the images to generate the three-dimensional model 51 of the surrounding area 52 (Block 106).
The controller 42 monitors a position of the driver's eyes 50 or head and provide a first view of the 3D model 51 to the display 34 when the operator is in a first position (Block 108) and provide a second view of the 3D model 51 to the display 34 when the operator is in a second position (Block 110). The controller 42 determines when the operator is in the first portion or the section position by receiving images from the camera 33 that the controller 42 can use to determine the eye 50 and/or head position. In particular, the images collected from the camera 33 can be used to determine when the driver is looking at the display 34 projecting the rear view image and then provide the simulated rear view image 54A, 54B as the operator moves his or her head accordingly.
One feature of providing the first and second rear view images 54A, 54B with differing views of the 3D model 51 is a simulation of motion parallax as described above to improve the operator's depth perception of the surrounding area 52. The simulation of motion parallax for the operator provides improved usability of the rear view image on the display 34 over traditional rear view images that only project static images and do not project different images 54 based on position.
Although the different non-limiting examples are illustrated as having specific components, the examples of this disclosure are not limited to those particular combinations. It is possible to use some of the components or features from any of the non-limiting examples in combination with features or components from any of the other non-limiting examples.
It should be understood that like reference numerals identify corresponding or similar elements throughout the several drawings. It should also be understood that although a particular component arrangement is disclosed and illustrated in these exemplary embodiments, other arrangements could also benefit from the teachings of this disclosure.
The foregoing description shall be interpreted as illustrative and not in any limiting sense. A worker of ordinary skill in the art would understand that certain modifications could come within the scope of this disclosure. For these reasons, the following claim should be studied to determine the true scope and content of this disclosure.
