Patent Application
20240296599
The present specification relates to consumer vehicle evaluation and, more particularly, systems and methods for displaying updated vehicle interiors to a user
Purchasing a new vehicle may be a significant life event for many people. Therefore, new vehicle purchasers typically like to sit in different vehicles and take the different vehicles for test drives to ensure that the vehicles they purchase are the right vehicles for them. A purchaser may like to sit in the driver's seat and make sure she likes the placement of the gauges, the design of the interior, and the functionality of the infotainment system, for example.
However, it may take significant time for a vehicle purchaser to test drive or otherwise sit in vehicles prior to a purchase. The vehicle purchaser may live far away from car dealerships, or the nearby car dealerships may not have the desired vehicle on the lot to test drive.
Accordingly, systems and methods for experiencing vehicle interiors may be desired.
In one embodiment, a system for modifying an appearance of a vehicle interior includes a display device including an electronic display operable to display images overlaid on the vehicle interior, a camera operable to acquire video data of the vehicle interior, one or more processors, and a computer-readable medium storing computer-readable instructions that cause the one or more processors to identify three or more reference fiducials within the vehicle interior using the video data, and display an updated vehicle interior using the electronic display such that the updated vehicle interior is overlaid on the vehicle interior, wherein the updated vehicle interior comprises three or more image fiducials that are overlaid on the three or more reference fiducials and the updated vehicle interior modifies the vehicle interior.
In another embodiment, a system for displaying a vehicle interior includes a vehicle interior mock-up including a driver seat and a passenger seat, a dashboard comprising one or more display surfaces, and three or more reference fiducials. The system further includes a display device including an electronic display operable to display images overlaid on the vehicle interior, and a camera operable to acquire video data of the vehicle interior. The system also includes one or more processors, and a computer-readable medium storing computer-readable instructions that cause the one or more processors to identify the three or more reference fiducials of the interior vehicle mock-up using the video data, and display an updated vehicle interior using the electronic display such that the updated vehicle interior is overlaid on at least one of the dashboard, the driver seat, and the passenger seat, wherein the updated vehicle interior comprises three or more image fiducials that are overlaid on the three or more reference fiducials and the updated vehicle interior modifies the vehicle interior.
The embodiments set forth in the drawings are illustrative and exemplary in nature and not intended to limit the disclosure. The following detailed description of the illustrative embodiments can be understood when read in conjunction with the following drawings, where like structure is indicated with like reference numerals and in which:
The embodiments disclosed herein are directed to systems and methods for modifying an appearance of a vehicle interior. Generally, embodiments of the present disclosure utilize augmented reality to change the appearance of a vehicle in which a user is sitting in. In one non-limiting example, the vehicle in which the user is sitting in his or her current vehicle. In another non-limiting example, the vehicle is a mock-vehicle having smooth and white surfaces on which to project a vehicle interior ofa new vehicle. Such mock-vehicles may be at car dealerships, shopping districts, amusement parks, and/or the like. A display device, such as a projector, augmented reality glasses, virtual reality glasses, a tablet, and/or a smartphone may be used to display a vehicle interior of a new or different vehicle onto the interior of the vehicle in which the user is sitting. By using augmented reality (and/or virtual reality), a user may experience many different vehicle interiors in a short period of time, thereby making the vehicle buying process much for efficient and well-informed.
Various embodiments of systems and methods for modifying an appearance of a vehicle interior are described in detail below.
Referring now to
The vehicle interior 100 may be an interior of any type of vehicle, such as, without limitation, a sedan, a hatchback, a sports car, a truck, a bus, and the like. It should be understood that although the figures illustrate the cockpit portion of the vehicle interior, embodiments of the present disclosure are not limited thereto. For example, the vehicle interior that is simulated may be from a second row or third row of seats of a vehicle.
Generally, the vehicle interior 100 may have two seats 116 (e.g., a driver's seat and a passenger's seat), a center console 110, a dashboard 101 and a steering wheel 104. The center console 110 may have a cup holder 117 and a shifter 112. The dashboard 101 may have various vents 106, an instrument cluster 102 having gauges, meters, and/or the like, a head unit 114 for displaying graphical user interfaces of an infotainment system, for example, and trim pieces 108. It should be understood that other non-numbered elements are present in the vehicle interior 100, such as a glove box, door handles, window controls, hazard lights button and many others. The presence, placement, and design of each feature create the overall design, look and feel of the vehicle interior 100. Luxury vehicles will have a different design, look and feel as compared to economy vehicles, for example.
The systems of the present disclosure generate augmented reality display content that is overlaid on the physical vehicle interior 100. Thus, the virtual features of the augmented reality vehicle interior, referred to herein as “updated vehicle interior” because it is updated from the physical vehicle interior 100 of the vehicle that the user is sitting in, should be placed in the accurate positions of the physical vehicle interior 100 as viewed by the user. Thus, in some embodiments, the system is configured to identify three or more reference fiducials within the physical vehicle 100. As described in more detail below, these reference fiducials are used by the system to accurately display the virtual features of the updated vehicle interior on the physical vehicle interior 100. The updated vehicle interior comprises three or more image reference fiducials that are overlaid on the three or more reference fiducials of the physical vehicle interior. The example physical interior 100 of
The systems of the present disclosure include a display device that renders an updated vehicle interior over the physical vehicle interior for the user. Many different display devices may be used, including, but not limited to, virtual reality headsets, augmented reality glasses, tablets, and smartphones. Referring now to
The camera of the display device, such as the one or more cameras 111 of augmented reality glasses 103 generates image data of the vehicle interior 100 when the user 10 is sitting in the vehicle. The image data may be in the form of a video of the vehicle interior 100, for example. Referring once again to
The reference fiducials are also used by the system to locate the position of the head of the user 10 within the vehicle interior 100. When the user 10 moves his or her head, the position of the reference fiducials in the image data changes.
As stated above, embodiments of the present disclosure enable a user to view various vehicle interiors different from the physical vehicle interior of the vehicle she is sitting in. Referring now to
A comparison between
The display representing the updated vehicle interior 200 is overlaid on the physical vehicle interior 100 using the reference fiducials. Thus, the updated vehicle interior 200 is sized appropriately for the physical vehicle interior in which the user 10 is sitting. As a user 10 turns his or her head, the display of the updated vehicle interior 200 changes with the motion of the head so that it is overlaid on the proper locations within the physical vehicle interior 100. The reference fiducials aid in the placement of the updated vehicle interior 200 on the physical vehicle interior 100 as the user moves about the physical vehicle interior 100.
The display device (e.g., augmented reality glasses 103) or another computing device (e.g., a smartphone working in conjunction with the display device) may display a menu from which a user may select different vehicle interiors to virtually experience the different vehicle interiors. For example, the menu may be organized by vehicle style, model and trim level. In some embodiments, the system automatically changes the updated vehicle interior 200 every few minutes so that the user can experience the different vehicle interiors without having to manually switch them. As another example, the user may provide feedback using the display device, another computing device, or the physical vehicle's hardware. As a non-limiting example, the user may audibly say “I really like the color of the interior,” or “I can't see the head unit.” The user can also save different vehicle interiors to revisit later.
The user 10 may also be able to select and change different options, such as upholstery color, trim color, floor mats, and the like. Many updated interior options may be displayed for selection by the user.
In some embodiments, a virtual test drive may be provided to the user 10 in the physical vehicle interior 100. For example, a simulated environment may be overlaid on the windshield and the windows to give the user the impression that she is physically moving and driving the vehicle. A turning of the physical steering wheel may make a corresponding turn in the simulated virtual environment that is displayed. In this manner, the user 10 may take a virtual test drive of the vehicle while viewing the updated vehicle interior.
In some embodiments, manipulation of features in the updated vehicle interior 200 will control vehicle features in the physical vehicle. The one or more cameras 111 of the display device may monitor gestures of the user's hand, and the system may be programmed to detect certain user gestures. The system may be communicably coupled to the control system of the physical vehicle such that actions taken on features of the updated vehicle interior 200 (e.g., input devices such as touch screens, buttons, knobs and the like) by gestures cause real-world actions. For example, when a user moves her finger to the location of the horn button in the updated vehicle interior 200, the horn of the physical vehicle will sound. As another example, the updated vehicle interior 200 may display a list of songs on the head unit which are not displayed on the physical head unit. When the user moves her finger toward an individual song, that song will be played by the physical vehicle. Thus, the selection of a song produces using the updated vehicle interior produces audio data comprising information, and an audio signal corresponding to the audio data is received and played by an audio device of the vehicle (e.g., a speaker).
In some embodiments, the system includes a vehicle interior mock-up 300, as shown in
The vehicle interior mock-up 300 is configured to replicate a real vehicle interior; however, the surfaces of a vehicle interior mock-up 300 may be a white color and generally free of contours and features such that they act as projection surfaces onto which an updated vehicle interior may be projected and displayed. As used herein, “white color” means each of the red, green and blue values of a RGB code are within a range of 220 and 255, including endpoints. Referring to both
In some embodiments, one or more surfaces of the vehicle interior mock-up 300 may three-dimensionally morph according to the shapes of the updated vehicle interior. For example, ridges, buttons, knobs and other features may physically appear in the surfaces of the vehicle interior mock-up 300, such as the dashboard. This may provide a more realistic updated vehicle interior. As an example, the dashboard 308 may be made of a shape-memory material, or a compliant material having actuators beneath it to push it up and down. Any known or yet-to-be-developed morphing surface may be utilized.
As stated above, the surfaces of the features of the vehicle interior mock-up 300 may be a white color and smooth without significant contours and shapes to provide a projection surface. As shown in
Referring to
In some embodiments, no projectors 305 are provided. Rather, a display device is used to overlay the updated vehicle interiors onto the surfaces of the vehicle interior mock-up 300, such as the augmented reality glasses 103 shown in
The vehicle interior mock-up 300 may include a sound system including speakers such that the user can interact with a virtual head unit to perform tasks such as selecting a song or radio station, changing the volume, changing the equalizer, and/or the like.
As in the physical vehicle embodiments, the one or more projectors 305 may display an environment through the windshield and/or windows up based at least in part on inputs from one or more of the steering wheel, the brake pedal, the accelerator pedal, and the shifting device to simulate a driving experience.
Embodiments of the present disclosure may be implemented by a computing device, and may be embodied as computer-readable instructions stored on a non-transitory memory device. Referring now to
As also illustrated in
Additionally, the memory component 540 may be configured to store operating logic 541, video logic 542 for receiving and processing video data from one or more cameras, vehicle interior logic 543 for creating the various updated vehicle interiors, and vehicle interior augmented reality logic 544 for displaying the updated vehicle interiors onto a physical vehicle interior or vehicle interior mock-up (each of which may be embodied as computer readable program code, firmware, or hardware, as an example). It should be understood that the data storage component 548 may reside locally to and/or remote from the computing device 535, and may be configured to store one or more pieces of data for access by the computing device 535 and/or other components.
A local interface 550 is also included in
The processor 545 may include any processing component configured to receive and execute computer readable code instructions (such as from the data storage component 548 and/or memory component 540). The input/output hardware 546 may include a virtual reality headset, augmented reality headset, smartphone, tablet, graphics display device, keyboard, mouse, printer, camera, microphone, speaker, touch-screen, and/or other devices for receiving, sending, and/or presenting data. The network interface hardware 547 may include any wired or wireless networking hardware, such as a modem, LAN port, wireless fidelity (Wi-Fi) card, WiMax card, mobile communications hardware, and/or other hardware for communicating with other networks and/or devices. The network interface hardware 547 may communicate via the Internet to receive vehicle data provided from one or more sources as well as communicate with a display device, such as augmented reality glasses 103 to display the updated vehicle interiors.
The components illustrated in
It should now be understood that embodiments of the present disclosure are directed to systems and methods for displaying updated vehicle interiors onto an existing physical vehicle interior or a vehicle interior mock-up. Embodiments enable a user to “sit in” and experience many different vehicle interiors from their own vehicles or a mock-up, thereby saving significant time. Users may save preferences and generate their own interior combinations to view.
It is noted that the terms “substantially” and “about” may be utilized herein to represent the inherent degree of uncertainty that may be attributed to any quantitative comparison, value, measurement, or other representation. These terms are also utilized herein to represent the degree by which a quantitative representation may vary from a stated reference without resulting in a change in the basic function of the subject matter at issue.
While particular embodiments have been illustrated and described herein, it should be understood that various other changes and modifications may be made without departing from the spirit and scope of the claimed subject matter. Moreover, although various aspects of the claimed subject matter have been described herein, such aspects need not be utilized in combination. It is therefore intended that the appended claims cover all such changes and modifications that are within the scope of the claimed subject matter.
