This disclosure generally relates to systems, devices, structures, and methods for displaying virtual graphics on a heads-up display.
Known heads-up display (HUD) systems used in vehicles such as cars and airplanes provide a vehicle operator with computer-generated virtual graphics that augment the operator's visual sensory perception of real-world objects viewable to the operator during vehicle operation. The HUD systems may be configured to generate virtual graphics and project the virtual graphics as images or text through the windshield so that the operator can view the information while holding their heads up and without taking their attention away from the real-world objects viewable during vehicle operation. When the distance to the real object and the perceived distance to the virtual graphic generated by HUD do not match, it may cause discomfort to the driver and might result in additional delay because the human eye will take a certain amount of time to refocus and converge for a different distance each time the driver takes a look at a different object.
On HUD systems designed for airplanes in particular, most objects of interest may be farther than 100 meters away from the airplane so it may be assumed that an airplane HUD with a fixed focal distance locked at infinity would provide satisfactory results for the airplane pilot.
For objects located distances of 100 meters or more, the human eye focuses on the object as if it was located infinitely far away because the rays of light that are reflected from the object essentially arrive at the operator as parallel light rays. Accordingly, the computer generated virtual graphics of known HUD systems for airplanes may be displayed to the operator to appear at an image plane set at infinity to match the focal plane of other objects visible to the operator.
Road vehicles, e.g., automobiles, present a different environment for HUD systems since objects visible to the operator are often much closer than these objects appear to airplane pilots (e.g., less than 100 meters). A HUD image set to infinity or some other arbitrary distance in many scenarios may force the operator to refocus between the HUD-generated virtual graphic and the associated real world object, as a result of the discrepancy between focal distances (unlike most airborne airplanes). Known HUD systems designed for road vehicles may be set with a fixed focal plane of between 7.5 meters to 20 meters to be in the middle of a typical focal range. The HUD system focal plane may be set at a time of manufacture to approximate the typical distances to objects of interest outside a vehicle.
Since road vehicles may operate in vastly different road environments, e.g., crowded highways, suburban streets, or open country roads, the focal plane selected by the HUD manufacturer may not be optimized for a particular road environment. Overlaying computer generated virtual graphics on an object associated with a different focal plane may make the virtual graphics appear out of focus to the operator, or create confusion for the operator if it is not clear which object is associated with the virtual graphics.
A need remains for improvements in HUD systems.
When vehicle 50 is moving at relatively high speeds, such as on an uncongested highway at speeds above 40 mph, an image projection system 150 may be configured to display one or more computer-generated virtual graphics, e.g., images, text, or other types of imaging information, to a vehicle operator or observer 75 on third image plane 30. In some examples, third image plane 30 may approximate a predetermined distance, e.g., a distance greater than twenty meters, from vehicle 50. At relatively high speeds, operator 75 may typically be looking down the road and scanning for objects that may be located at distances of greater than the predetermined distance of twenty meters. Accordingly, display system 100 may be configured to have the focal plane associated with the computer generated virtual graphics coincide with the relatively distant objects that are being viewed by operator 75.
On the other hand, when the vehicle is moving at medium range speeds, such as when the operator 75 drives vehicle 50 on city streets or on congested highways at speeds above 20 mph but below 40 mph, display system 100 may project virtual graphics on second image plane 20 to coincide with objects that are located at focal distance B from vehicle 50. In some examples, focal distance B associated with second image plane 20 may be less than twenty meters, e.g., approximately ten meters.
When vehicle 50 is moving at relatively slow speeds, such as when operator 75 operates vehicle 50 around a parking lot or accident scene at speeds below 20 mph, display system 100 may be configured to project virtual graphics at first image plane 10 to coincide with objects that are located at focal distance A from vehicle 50. In some examples, focal distance A associated with first image plane 10 may be less than ten meters, e.g., approximately three to five meters.
Display system 100 may be configured to project virtual images at dynamically varying image planes having dynamically varying focal distances to operator 75 according to operational parameters, including a speed of vehicle 50, location of the real-world objects, and the like. For example, as vehicle 50 starts to accelerate from a stopped position, display device 100 may be configured to sequentially vary the focal distance of the image plane that is displayed to operator 75 from first image plane 10 to second image plane 20, and from second image plane 20 to third image plane 30. In some examples, display system 100 may comprise manual controls that enable operator 75 to selectively display the virtual graphics at one or more of image planes 10, 20, 30, or the like, or at different vertical or horizontal positions on the windshield. In still other examples, display system 100 may be configured to display a first portion of computer generated virtual graphics at an image plane selected based on vehicle travel speed, and a second portion of graphics may be displayed on an auxiliary image plane selected by operator 75.
Display system 100 may be configured to project virtual graphics at dynamically varying focal distance image planes, based at least in part on, operational parameters including a distance between an actual real-world object and vehicle 50, as determined by the display system 100 or associated navigation device. For example, when vehicle 50 is turning, system 100 may track a distance to the curve and dynamically change the image planes to project virtual graphics to avoid having operator 75 refocus from the virtual graphics to the curve. In other words, system 100 dynamically changes the image plans on which it projects virtual graphics to be consistent with a changing distance between vehicle 50 and any real object.
System 100 may augment real-world objects visible through windshield 210 with virtual graphics projected onto windshield 210 at a plurality of focal image planes. For example, system 100 may project a highway designation 221 associated with current road 220 on third image focal plane 30. Highway designation 221 may appear located at some distant point up ahead of current road 220 to operator 75, which in some examples may approximate a focus point of infinity. System 100 may project a graphical alert 241 over incoming vehicle 240 to alert operator 75 of incoming vehicle 240's presence and proximity.
System 100 may project graphical alert 241 over or around, partially or fully, over vehicle 240. System 100 may project graphical alert 241 in any color or shape known to persons of ordinary skill in the art. Graphical alert 241 may be accompanied by an audible alert heard by operator 75 using the vehicle's on-board sound system, e.g., speakers. In some examples, system 100 may project graphical alert 241 to track the relative movement of vehicle 240 by dynamically changing the image plane it uses to project graphical alert 241. When public safety vehicle 240 is located some distance down current road 220 from vehicle 50, such as greater than twenty meters, system may project graphical alert 241 at a focal distance corresponding with third image plane 30, similar to the projection image plane used to project highway designation 221. As vehicle 240 approaches vehicle 50, system 100 changes the focal image plane it uses to project graphical alert 241 from third image plane 30 to second image plane 20 such that graphical alert 241 tracks the movement of vehicle 240.
System 100 may project on windshield 221 additional information 245 associated with vehicle 50, road 220, object visible through windshield 221, or the like. For example, system 100 may be configured to display speed limit 245 associated with current road 220 in response to identifying that vehicle 240 is a public safety vehicle or in response to identifying road 220 as a highway. System 100 may be able to determine that vehicle 240 is a public safety vehicle by detecting the presence of certain characteristics of vehicle 240, e.g., equipment, flashing lights, vehicle markings, and the like using any known system either internal or external to vehicle 50, e.g., headlight and other sensors. Additionally, system 100 may be configured to alert operator 75 if vehicle 50 is traveling faster than the posted speed limit for current road 220 by e.g., flashing additional information 245 or providing an audible alert through vehicle 50's sound system. In some examples, system 100 may be configured to display additional information 245 at any appropriate image plane, e.g., first image plane 10.
System 100 may be configured to project navigation information 251, such as a turn indicator, associated with a route 231 onto windshield 210. System 100 may project navigation information 251 on windshield 210 while audibly providing turn by turn instructions, e.g., “turn right onto Oakwood Avenue,” using any audible means available, e.g., vehicle 50's sound system. System 100 may substantially simultaneously project a route name 235, overlaid or otherwise, in a same image plane as side road 230. In some examples, system 100 may be configured to display navigation information 251, route 231, and route name 235 at any same image plane, e.g., second image plane 20. In some examples, system 100 may be able to project certain virtual graphics, e.g., additional information 245, at a first image plane 10, while projecting other virtual graphics, e.g., route name 235, at second image plane 20 different from first image plane 10. In some examples, system 100 may determine the image planes at which to project virtual graphics based on operational parameters, e.g., location of real-world objects, vehicle speed, vehicle location, operator position, traffic, and the like, as explained in more detail below.
Display device 100 may be configured to display different portions of route 331 on a tilted or inclined image plane. For example, system 100 may project, on windshield 310, a first portion of route 331 at a first focal distance 315, a second portion of route 331 at a second focal distance 325 greater than first focal distance 315, and a third portion of route 331 at a third focal distance 335 greater than second focal distance 325. In some examples, focal distances 315, 325, and 335 associated with the graphical overlay of route 331 may continuously vary between the first portion and the third portion to provide a smooth continuum or graduation of focal distances associated with route 331, comparable with the focal distances of the real-world objects that correspond to route 331.
As vehicle 50 approaches side street 330, side street 330 may appear lower down near the middle of the windshield 310 because of the tilted or inclined image plane. System 100 may project route 331 and navigation information 351 lower down near the middle of windshield 310 from the positions shown in
In addition to tracking the location of the real-world objects relative to the horizontal and vertical two-dimensional coordinates of the windshield 310 so that virtual graphics augment or appear overlaid onto the real-world objects from the perspective of operator 75, system 100 may also be configured to track the relative distances to the real-world objects and adjust the focal points and/or image planes or the graphics that are overlaid onto the real-world objects. System 100 may detect, generate, or otherwise determine the relative distances using any known means, including the use of optical sensors, global positioning systems, and other devices (not shown) attached or otherwise coupled to vehicle 50.
System 100 may be configured to gradually decrease the focal distance of side street 330 such that it appears at a second focal distance 325, rather than at third focal distance 335. Similarly, system 100 may be configured to decrease the focal distance of the second portion of route 331 prior to side street 330 from second focal distance 325 to first focal distance 315. In some examples, by dynamically varying and/or adjusting the focal point of one or more portions of route 331, operator 75 may more readily ascertain the distance and/or location of navigation information 351 relative to route 330.
In an example embodiment, projection system 400 may comprise a translation device 480 configured to move the relative position of the imaging matrix 460 and/or imaging plane, so that operator 75 may view computer generated virtual graphics at dynamically changing image focal planes and/or focal positions based, at least in part, on a position of operator 75. Translation device 480 may dynamically move imaging matrix 460 in a horizontal or vertical direction, as well as change the incline angle of imaging matrix 460 based, at least in part, on operational parameters or vehicle settings. Translation device 480 may comprise an electric motor, such as a linear motor, a DC motor, a brushless motor, a stepper motor, or an ultrasonic piezo motor with optional position feedback. In still other examples, translation device 480 may comprise a screw-type motor, a servo-motor, a mechanical gear, a magnetic switch, a position sensor, other types of positional devices or electric motors, or any combination thereof.
Physically moving imaging matrix 460 inside projection system 400 closer to collimator 415 may result in moving a focal plane of a projected virtual graphic further away from operator 75, until the focal plane reaches infinity. Conversely, moving imaging matrix 460 inside projection system 400 farther from collimator 415 may result in moving a focal plane of a projected virtual graphic closer to operator 75. In some examples, imaging matrix 460 may comprise a liquid crystal display (LCD), a digital micro-mirror device (DMD), a microelectromechanical (MEMS) laser scanner, a liquid crystal on silicon (LCoS) matrix, a matte glass with a projected image, other types of imaging matrices, or any combination thereof.
Imaging matrix 550, in turn, may be configured to selectively distribute and/or propagate the virtual image received as light from projection device 530 or optical devices 540 as one or more wave fronts to a display device 560. In some examples, display device 560 may comprise a vehicle windshield, e.g., windshield 410 shown in
In some examples, imaging matrix 550 may comprise a holographic phase-amplitude modulator configured to simulate an arbitrary wave front of light. In an example embodiment, imaging matrix 550 may simulate a wave front for each of multiple image planes, each wave front representing a virtual image. Imaging matrix 550 may be configured to implement an arbitrary number of virtual image planes with information displayed on them simultaneously and arbitrarily.
Imaging matrix 550 may comprise a high-resolution phase modulator, such as a full high-definition modulator having any resolution known to a person of ordinary skill in the art, e.g., 4000 or higher pixel resolution. Imaging matrix 550 may be illuminated by coherent light received from projection device 530 or optical devices 540 with a predefined beam divergence. Imaging matrix 550 may produce a digital hologram on the modulator and may project a wave front representative of the hologram onto a display device 560 on multiple simultaneous virtual image planes 570.
Display system 500 may be configured to generate one or more virtual graphics, e.g., images, text, or any other graphical information known to a person of ordinary skill in the art, on image plane 570. In some examples, image plane 570 may be associated with a focal distance 575. Although image plane 570 is illustrated as being located on an opposite side of display device 560 from imaging matrix 550, in some example embodiments, display device 500 may be configured to reflect light associated with the wave front propagated by imaging matrix 550 so that the resulting image is reflected back to operator 75. While the image may be reflected back from display device 560 to operator 75, the image plane may nevertheless appear to the operator to be located on the opposite side of the display device 560 (e.g., on the same side of the display device as the real-world objects, outside of the vehicle).
Additionally, display system 500 may comprise a translation device or motor 580 configured to dynamically vary the focal distance 575 associated with image plane 570. In some examples, motor 580 may be configured to move imaging matrix 550 relative to display device 560 in any direction, e.g., vertical or horizontal, as well as change the incline angle of imaging device 550. In other examples, motor 580 may be configured to move one or more optical devices 540 relative to imaging matrix 550. Still further, motor 580 may be configured to vary a focal distance 545 between the one or more optical devices 540 and imaging matrix 550. Motor 580 may dynamically vary the focal distance 575 by moving imaging matrix 550 relative to display device 560 or relative to optical devices 540 or by moving optical devices 540 relative to imaging matrix 550. In an example embodiment, motor 580 may dynamically vary the focal distance 575 based, at least in part, on a predetermined operational parameters including vehicle parameters, e.g., speed, location, travel direction, destination, windshield location, traffic, and the like, road parameters, e.g., location or presence of real world objects, roads, and the like, vehicle operator parameters, e.g., operator location within vehicle, operator's eye location and tracking, operator parameters, e.g., eye tracking, eye location, position of system, and the like, or a combination thereof. Operational parameters may further include any input received from any of a plurality of sources including vehicle systems or settings, e.g., user recognition system 970, camera 930, sensors 920, user input 960, vehicle input 950, audio device 915, GPS 940, or a combination thereof as shown in
In addition to varying the focal distance 575 of image plane 570, motor 580 may be configured to adjust the relative distance of image plane to operator 75. In an example embodiment, display system 500 may be configured to be compatible with a number of different types of vehicles which may be associated with different operator positions, including height of the operator's eyes or distance from the operator to windshield, e.g., windshield 410 shown in
A motor 680 associated with display system 600 may be configured to dynamically vary an angle of incline of imaging matrix 650 to affect the angle of inclined image plane 670 based, at least in part, on operational parameters including vehicle parameters, e.g., speed, location, travel direction, destination, windshield location, and the like, road parameters, e.g., location or presence of real world objects, roads, and the like, vehicle operator parameters, e.g., operator location within vehicle, operator's eye location and tracking, or operator parameters, e.g., eye location, eye tracking, head position, and the like, or a combination thereof.
For example, by tilting imaging matrix 650, a lower portion of inclined image plane 670 may be associated with a first focal distance 672, and an upper portion of inclined image plane 670 may be associated with a second focal distance 674, greater than first focal distance 672. Additionally, a central portion of inclined image plane 670 may be associated with an intermediate focal distance 676 between first focal distance 672 and second focal distance 674, e.g., a focal distance equal to an average distance of first and second focal distances 672 and 674, respectively. In some example embodiments, in addition to varying an angle of inclined image plane, motor 680 may be configured to adjust the relative distance of image plane to operator 75 on a substantially horizontal axis. For example, display system 600 may be configured to be compatible with a number of different types of vehicles which may be associated with different operator positions, including height of an operator 75's eyes or a distance from operator 75 to a windshield, e.g., windshield 410 shown in
In some example embodiments, in addition to varying an angle of incline of imaging matrix 650, motor 680 may be configured to linearly displace imaging matrix 650 and/or optical device 640 by a distance 645 to translate inclined image plane 670 closer to or further from display device 660.
For example, first imaging matrix 752 may be configured to generate one or more virtual graphics, e.g., images or text, at a first image plane 782 located at a first focal distance 772, and second imaging matrix 754 may be configured to generate one or more virtual graphics, e.g., images or text, at a second image plane 784 located at a second focal distance 774. Additionally, third imaging matrix 756 may be configured to generate one or more virtual graphics, e.g., images and/or text, at a third image plane 786 located at a third focal distance 776. In some examples, first focal distance 772 may be approximately three to five meters, second focal distance 774 may be approximately ten to twenty meters, and third focal distance 776 may be approximately set at infinity. A person of ordinary skill in the art will understand that focal image planes 782, 784, and 786 may be set at any focus distance depending on operational parameters or other characteristics.
Display system 700 may be configured to direct light from a projection device 730 onto each of the imaging matrices 752, 754, and/or 756. In some examples, one or more optical devices 740 may be configured to direct the light onto each of the matrices 752, 754, and/or 756. A first focal point 742 may be associated with a first imaging device 752. A second focal point 744 may be associated with a second imaging device 754. And a third focal point 746 may be associated with third imaging device 756. In an example embodiment, each of the imaging devices 752, 754, and 756 may be associated with a corresponding translation device 780A, 780B, or 780C, respectively, to vary the focal distance, e.g., first focal point 742, second focal point 744, and third focal point 746. Additionally, an angle of incline of one or more of the image planes 782, 784, or 786 may be varied by varying an angle of incline of the imagining matrices 752, 754, or 756 by one or more translation devices or motors 780A, 780B, or 780C. Persons of ordinary skill in the art should recognize that a single motor 780 may be used to change the incline angle of imaging matrices 752, 754, and 756. Alternatively, each imaging matrix 752, 754, or 756 may be operatively coupled to an individual translation device or motor 780A, 780B, or 780C, respectively. Persons of ordinary skill in the art should recognize that motors 780A, 780B, or 780C may have a similar construction to motor 680 shown in
The multiple imaging matrices or projection devices 852 and 854 may be configured to display different images for operator 75's right and left eyes to thereby together form a stereo image that is displayed on display device 860 at image planes 882 and 884. In an example embodiment, a camera 930 (
First imaging matrix 852 or second imaging matrix 854 may be configured similarly to imaging matrix 550 shown in
First imaging matrix 852 may be configured to project light representative of virtual graphics, e.g., one or more images and/or text, at a first image plane 882. In some examples, first image plane 882 may generally be associated with a focal distance 872, such that each virtual graphic generated by first imaging matrix 852 may be understood to be located at approximately the same focal distance 872.
Additionally, second imaging matrix 854 may be configured to project light representative of virtual graphics, e.g., one or more images and/or text, at a second image plane 884. In some examples, second image plane 884 may comprise an inclined image plane corresponding to one or more focal distances, such as a first focal distance 874 and a second focal distance 876. A first virtual graphic generated by second imaging matrix 854 may be understood to be located at approximately first focal distance 874 and a second virtual graphic generated by second imaging matrix 854 may be understood to be located at approximately second focal distance 876. In some examples, second image plane 884 may be associated with a continuum of focal points which incrementally and/or continuously vary between first focal distance 874 and second focal distance 876.
A first class of virtual graphics may be associated with first image plane 882 and a second class of virtual graphics may be associated with second image plane 884. For example, virtual graphics, e.g., images and/or text, associated with the vehicle such as vehicle speed or the time of day may be displayed on first image plane 882. Virtual graphics, e.g., images and/or text, associated with vehicle navigation may be displayed on second image plane 884.
Processing device 910 may be configured to perform substantially all of the calculations associated with the preparation and/or generation of virtual graphics and/or other types of information that are to be projected by a projection system 980 and/or displayed on a display device 990, in real time. Additionally, processing device 910 may be configured to gather information from sensors 920, process a video feed from a camera 930, obtain user input 960, and obtain vehicle input 950 substantially in real time. Some or all of the input may be received and/or transmitted over a WiFi module, a Bluetooth module, any other types of communication modules known to persons of ordinary skill in the art, or any combination thereof.
Sensors 920 may comprise an inertial sensor, a digital barometer, a light intensity meter, a camera, a temperature sensor, any other type of sensors known to persons of ordinary skill in the art, or any combination thereof. In some examples, sensors 920 may be used to corroborate and/or refine information provided by a global navigation satellite system (GNSS) 940, such as a Global Position Sensor (GPS), GLONASS, GALILEO, BeiDou, any other types of navigational or position detection systems known to persons of ordinary skill in the art, or any combination thereof. For example, a barometer may be used in conjunction with the GNSS 940 to more accurately determine the relative altitude of the vehicle, and therefore also determine the position of the vehicle relative to a mapped coordinate system.
Similarly, input from camera 930 may be used in conjunction with the GNSS 940 to more accurately determine the relative distance between the vehicle and particular feature or landmark associated with the mapped coordinate system, such as a turn or a destination. Camera 930 may comprise a digital camera, a LIDAR camera, an infrared camera, a thermal camera, other types of cameras, or any combination thereof. GNSS 940 may comprise a global system for mobile communications (GSM). In examples in which the vehicle may have its own GNSS or positional system, processing device 910 may be configured to obtain positional information directly from vehicle input 950.
Input from camera 930 may be used to measure the relative movement of an object/image and to calculate the vehicle movement speed and turn speed to improve the precision of the position sensor. Similarly, input from an inertial sensor 920 may be used in the calculation and/or determination of vehicle speed, turn speed, and position of the vehicle.
Additionally, processing device 910 may be configured to receive audio input, or to output audio, over an audio device 915. For example, processing device 910 may be configured to provide audible instructions to accompany the displayed navigational route information or to provide audible alerts.
User input 960 may comprise voice commands, control input (such as buttons or knobs), an interface with a smartphone, or any combination thereof. Additionally, processing device 910 may be configured to locate and/or identify the vehicle operator by a user recognition device 970. User recognition device 970 may comprise a camera or tracking device configured to identify the operator and/or to locate the operator's relative position and/or height relative to display device 990. Based on information received from user input 960 and/or user recognition device 970, processing device 910 may be configured to initialize, customize, adjust, calibrate, or otherwise modify the functionality of system 900 to accommodate a particular user.
Processing device 910 may include any type of memory device known to a person of ordinary skill in the art. Processing device 910 may execute instructions stored in the memory device to generate virtual graphics based, at least in part, on any number of parameters, including user input 960, vehicle input 950, user recognition 970, sensors 920, audio device 915, GNSS 940, or the like, or any combination thereof.
At operation 1020, the display system may determine a mode of operation based on operational parameters or vehicle settings. For example, the display system may identify that the operator has requested navigation instructions, such as directions to a destination. In other examples, the display system may automatically identify a driving mode or a parking mode, in response to detecting movement of the vehicle.
At operation 1030, the display system may receive sensory input on one or more real-world objects located outside of the operator's vehicle. The objects may include a geographic landmark such as building, a road, a bridge, a sign, another vehicle, a pedestrian, an animal, other types of objects, or any combination thereof.
At operation 1040, the display system may determine a distance to the object. The distance to the object may be based, at least in part, on the sensory input received at operation 1030 and/or the location of the vehicle as identified at operation 1010. In some examples, the sensor input may be used to augment and/or refine the location of the vehicle relative to the object.
At operation 1050, display system may display graphical information associated with the object at a first focal distance. The first focal distance may match or correspond approximately to the distance to the object that was determined at operation 1040.
At operation 1060, the display system may update one or both of the sensory input received at operation 1030 and the location of the vehicle as identified at operation 1010. In some examples, both the object and the vehicle may be moving at the same time. In other examples, only one or the other of the object and the vehicle may be moving at any one time. Accordingly, the updated sensory input and/or vehicle location may be used to update the relative distance between the vehicle and the object.
At operation 1070, the display system may display updated graphical information at a second focal distance. In some examples, the second focal distance may correspond to or match the updated distance between the vehicle and the object as determined from operation 1060. The display system may be configured to update the focal distance and display the updated graphical information in real time. In some examples, one or more graphics may be displayed at the second focal distance while one or more other graphics are displayed at the first focal distance. In still other examples, a portion of an object may be concurrently displayed at the second focal distance while another portion of the object is displayed at the first focal distance.
At operation 1080, the display system may display auxiliary information at a third focal distance. The auxiliary information may include vehicle travel speed, vehicle location, temperature, time, other types of information, or any combination thereof. In some examples, the auxiliary information may be statically displayed at the third focal distance while the focal distance for a graphic associated with an object located outside of the vehicle may be dynamically varied over time.
At operation 1120, the position of a vehicle may be calculated and/or recalculated based, at least in part, on the input from the one or more sensors.
At operation 1130, the distances to one or more virtual planes may be determined and/or adjusted based on information associated with the vehicle environment. The vehicle environment may be monitored by the one or more sensors to determine, for example, the location of one or more actual objects in proximity to the vehicle.
At operation 1140, graphical information and/or graphical images may be displayed at one or more focal distances corresponding to the vehicle environment and distances to the actual objects.
References to a vehicle in this application are not intended to be limited to an automobile, and in some examples, one or more of the example display systems disclosed herein may be configured for use in a bus, a truck, a motorcycle, a boat, an airplane, a train, a spacecraft, or other types of vehicles. Additionally, whereas some of the examples provided refer to the implementation of display systems for a vehicle, the display systems may also be configured for use in other types of devices, system, or usage applications, including a head-mounted HUD, a motorcycle helmet, a virtual reality device, a home entertainment system, gaming system, and other types of systems.
In instances where the user may be wearing a head-mounted HUD, specialized glasses, or other types of wearables, one or more virtual images provided to the user may be superimposed or otherwise combined with the images of actual objects in order to augment or enhance the user's perception of the environment, similar to the example display devices described herein as being used with a vehicle windshield.
Having described and illustrated various examples herein, it should be apparent that other examples may be modified in arrangement and detail.
Number | Name | Date | Kind |
---|---|---|---|
2471284 | Rea | May 1949 | A |
3353893 | Bamberger | Nov 1967 | A |
4998784 | Freeman | Mar 1991 | A |
5510983 | Lino | Apr 1996 | A |
5651047 | Moorman | Jul 1997 | A |
6441968 | Okayama | Aug 2002 | B1 |
7649545 | Antonis | Jan 2010 | B2 |
7660499 | Anderson | Feb 2010 | B2 |
7995136 | Endo | Aug 2011 | B2 |
8690339 | Lenchenkov | Apr 2014 | B2 |
9310769 | Smithwick | Apr 2016 | B2 |
10237542 | Hasegawa | Mar 2019 | B2 |
20070182812 | Ritchey | Aug 2007 | A1 |
20080291317 | Endo | Nov 2008 | A1 |
20090005961 | Grabowski | Jan 2009 | A1 |
20100002319 | Maekawa | Jan 2010 | A1 |
20120140028 | Tomita | Jun 2012 | A1 |
20130222384 | Futterer | Aug 2013 | A1 |
20130278631 | Border | Oct 2013 | A1 |
20140036374 | Lescure | Feb 2014 | A1 |
20140361957 | Hua | Dec 2014 | A1 |
20150312560 | Deering | Oct 2015 | A1 |
20160003636 | Ng-Thow-Hing | Jan 2016 | A1 |
20170020627 | Tesar | Jan 2017 | A1 |
Number | Date | Country |
---|---|---|
60192912 | Oct 1985 | JP |
2009184406 | Aug 2009 | JP |
2015029598 | Mar 2015 | WO |
Entry |
---|
European Patent Office (EPO); Invitation to Pay Fees-Partial Search Report PCT/IB2017/000602; dated Sep. 28, 2017; Rijswijk NL;16 Pages. |
European Patent Office (EPO); International Search Report PCT/IB2017/000602 and Written Opinion; dated Jan. 4, 2018; Rijswijk NL;16 Pages. |
Number | Date | Country | |
---|---|---|---|
20170329143 A1 | Nov 2017 | US |
Number | Date | Country | |
---|---|---|---|
62334898 | May 2016 | US |