Patent Application
20240367689
The present disclosure relates to providing an immersive vehicle driving experience, such as but not necessarily limited to an immersive vehicle driving experience whereby one or more vehicle operating systems may be selectively controlled to expose a driver or other vehicle occupant to one or more challenging driving conditions.
A vehicle may experience challenging driving conditions for a number of reasons, such as in response to one or more vehicle systems onboard the vehicle operating outside of typical or desired operating ranges and/or in response to inclement weather, traffic congestion, construction, and/or other external influences affecting vehicle performance. It may be beneficial to provide a driver or other occupant assistance in learning how to understand and operate the vehicle before being faced with such challenging driving conditions and/or to educate a mechanic or other repair individual in understanding traits, symptoms, and other operational factors that a driver may have noticed before requesting repair work.
One non-limiting aspect of the present disclosure relates to providing an immersive vehicle driving experience whereby a driver or other occupant of a vehicle may be exposed to various challenges. The challenges may be configured to immerse a vehicle occupant in challenging driving conditions for purposes of learning how to understand and operate the vehicle and/or to educate a mechanic or other repair individual in understanding traits, symptoms, and other operational factors that a driver may have noticed before requesting repair work. The immersive vehicle driving experience may be undertaken at a test track or other controlled environment before encountering challenging driving conditions in the real-world or an uncontrolled environment. The immersive vehicle driving experience may also occur within the real-world, such as by implementing the challenges while the vehicle is traveling upon a roadway occupied by other vehicles, objects, etc.
One non-limiting aspect of the present disclosure relates to a method for an immersive vehicle driving experience. The method may include determining one or more vehicle systems configured for controlling one or more functions of a vehicle and determining one or more real parameters for the vehicle systems. The real parameters may control the vehicle system associated therewith to provide a real driving experience. The method may further include determining a challenge to be implemented as at least part of the immersive vehicle driving experience. The challenge may expose a driver of the vehicle to circumstances selected to simulate challenging driving conditions. The method may further include generating one or more challenge parameters for the challenge. The challenge parameters may differ from the real parameters to relatedly alter operation of the vehicle system associated therewith to correspondingly implement the challenge.
The challenge may include a roadway event to y cause the driver to experience a challenge condition while traversing a roadway, optionally with the challenge condition differing from a real condition of the roadway the driver would otherwise experience during the real driving experience.
The challenge may include a deteriorated performance event to cause the driver to experience deteriorated performance for one or more vehicle systems, optionally with the deteriorated performance differing from a real performance the driver would otherwise experience for the vehicle systems during the real driving experience.
The challenge including a complex driving situation to direct the driver to navigate the vehicle to a complex traffic situation while undertaking the immersive vehicle driving experience.
The complex traffic situation may correspond with a construction area, a lane convergence area, a traffic shift area, and/or a traffic congested area.
The challenge may include challenge instructions for navigating the vehicle to the complex traffic situation. The challenge instructions may identify a time, a location, a set of positioning coordinates, and/or a route to be traversed for the complex traffic situation.
The challenge may include an augmented reality (AR) event resulting in one or more virtual objects being interfaced with the driver during the immersive vehicle driving experience, optionally such that the virtual objects appear within a real environment exterior to the vehicle.
The method may include monitoring operating states for one or more of the vehicle systems while the vehicle is operating according to the immersive vehicle driving experience and implementing an override in response to one or more of the operating states exceeding a threshold. The override may cause the vehicle to operate thereafter according to the real driving experience.
The method may include activating the immersive vehicle driving experience in response to an input of the driver made to a user interface of the vehicle and automatically implementing the override without requiring the driver to correspondingly engage the user interface.
The method may include monitoring a performance of the driver during the immersive driving experience and generating a performance report based on the performance, the performance report including driving and/or operating errors made by the driver during the immersive driving experience.
The method may include monitoring biometric data of the driver during the immersive driving experience and generating a biometrics report based on the biometric data, the biometrics report including a stress mapping of stress experienced by the driver during the immersive driving experience.
The challenge may include one or more of a flat tire, hard braking, heavy traffic, traffic shifts, event traffic, potholes, towing, a construction zone, hard rain, fog, ice, depleted battery, low wiper fluid waring, low fuel warning, service engine warning, overheat warning, camera or mirror inoperability, reduced engine or motor power, and/or hard acceleration.
One non-limiting aspect of the present disclosure relates to a system for providing an immersive vehicle driving experience. The system may include a vehicle operating system configured for controlling a plurality of vehicle systems operating onboard a vehicle. The vehicle systems may be configured for controlling related operations of the vehicle. The system may include an immersive module configured for controlling the vehicle operating system to implement the immersive vehicle driving experience. The immersive vehicle driving experience may provide a challenge to expose a driver of the vehicle to one or more challenging driving conditions.
The challenge may include a roadway event for causing the driver to experience a challenge condition while traversing a roadway. The challenge condition may differ from a real condition of the roadway the driver would otherwise experience during a real driving experience.
The challenge may include a deteriorated performance event for causing the driver to experience deteriorated performance for one or more vehicle systems. The deteriorated performance may differ from a real performance the driver would otherwise experience for the vehicle systems during the real driving experience.
The challenge may include a complex driving situation for directing the driver to navigate the vehicle to a complex traffic condition while undertaking the immersive vehicle driving experience.
The challenge may include an augmented reality (AR) event resulting in one or more virtual objects being interfaced with the driver during the immersive vehicle driving experience.
The immersive module is configured for monitoring biometrics of the driver while undertaking the challenge and providing a biometric report based on the biometrics, the biometric report including stress related responses of the driver during the challenge.
One non-limiting aspect of the present disclosure relates to an immersive module for providing an immersive vehicle driving experience. The module may be configured for controlling a vehicle operating system of a vehicle to provide the immersive vehicle driving experience. The immersive vehicle driving experience may provide a challenge to expose a driver of the vehicle to one or more challenging driving conditions, optionally with the challenge including each of a roadway event, a deteriorated performance event, a complex driving situation, and an augmented reality (AR) event. The module may be further configured for monitoring biometric data of the driver during the immersive driving experience, and based thereon, generating a biometrics report, the biometrics report including stress related responses of the driver during the challenge.
These features and advantages, along with other features and advantages of the present teachings, are readily apparent from the following detailed description of the modes for carrying out the present teachings when taken in connection with the accompanying drawings. It should be understood that even though the following figures and embodiments may be separately described, single features thereof may be combined to additional embodiments.
The accompanying drawings, which are incorporated into and constitute a part of this specification, illustrate implementations of the disclosure and together with the description, serve to explain the principles of the disclosure.
As required, detailed embodiments of the present disclosure are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the disclosure that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present disclosure.
As one skilled in the art may appreciate, the vehicle operating system 16 may be configured for managing, controlling, directing, etc. a vast quantity of vehicle systems, modules, circuits, etc. While not exclusive and for non-limited purposes, the vehicle operating system 16 may include functions controlled or associated with one or more of the following modules or systems: Anti-lock Braking System (ABS); AC (Air Conditioning); Accelerator Pedal Position (APP) Control; Adaptive Cruise Control (ACC) Control; Air Suspension Control; Airbag Control; Anti-lock Braking System (ABS) Control; Audio Amplifier; Audio Equalization; Audio Filter; Audio Mixer; Audio/Infotainment system 47 Control; Automatic Headlamp Control; Automatic Transmission Control; Automatic Wiper Control; Auxiliary Power Outlet Control; Backup Camera Control; Battery Management System (BMS); Blind Spot Monitoring Control; Body Control (BCM); Brake Assist; Camshaft Control; Charging Control; Charging Control; Climate Control; Collision Avoidance; Collision Warning; Comfort Access Control; Compass Control; Cruise Control; Cylinder Deactivation Control; Daytime Running Light Control; Diesel Exhaust Fluid (DEF) Control; Differential Control; Digital Sound Processor (DSP); Direct Injection Control; Door Control; Drive Mode Selector; Driver Attention Warning; Electric Parking Brake (EPB); Electronic Power Steering (EPS) Control; Electronic Stability Control (ESC) Control; Electronic Throttle Control (ETC); Engine Control (ECM); Powertrain Control (PCM); Engine Cooling Fan Control; Engine Heater Control; Engine Oil Cooler Control; Engine Oil Pressure Control; Engine Start Control; Engine Stop Control; Entertainment System Control; Exhaust Gas Recirculation (EGR) Control; Exhaust System Control; Exterior Lighting Control; Fuel Delivery Control; Fuel Injection Control; Fuel Pump Control; Fuel Tank Pressure Control; Gateway; Headlight Control; Head-Up Display Control; Heater Control; High Beam Control; Hill Descent Control; Hill Start Assist Control; HVAC (Heating, Ventilation, and Air Conditioning) Control; Hybrid Control; Idle Air Control; Ignition Control; In-car Temperature Sensor Control; Infotainment Control; Instrument Cluster; Instrument Cluster; Intake Air Control; Intelligent Cruise Control; Interior Lighting Control; Key Fob Control; Keyless Entry; Lane Departure Warning (LDW) Control; Lane Keeping Assist; Lighting Control; Lighting Control Mod; Lock Control; Low Tire Pressure Warning; Lumbar Support Control; Mass Airflow Sensor (MAF); Mirror Control; Motor Control Unit (MCU); Multi-Information Display Control; Multi-Zone Climate Control; Navigation Control; Navigation Control; Occupant Classification System; Oil Cooler Fan Control; Oil Pressure Control; On-board Charger Control; Parking Assist Control; Parking Brake Control; Passive Entry; Power Steering Control; Powertrain Control (PCM); Radiator Fan Control; Rear Camera Control; Rear Differential Control; Rear Seat Entertainment; Remote Start Control; Restraint Control; Satellite Radio Control; Seat Control; Security Control; Shift Control; Side View Camera Control; Smart Key Control; Start-Stop Control; Steering Control; Steering Control; Suspension Control; Suspension Control; Transmission Control; Throttle Control; Tire Pressure Monitoring System (TPMS); Traction Control; Trailer Tow Control; Transmission Control (TCM); Transmission Range Control; Transmission Shift Control; Turbocharger Control; Vehicle Control Unit (VCU); Vehicle Dynamics Control; Vehicle Stability Control; Video Display Control; Voice Recognition Control; Voltage Regulator Control; Washer Fluid Control; Wiper Control; and/or Wireless Charging Control.
One non-limiting aspect of the present disclosure contemplates the vehicle 12 including an immersive module 40 configured for controlling the vehicle operating system 16 to implement the immersive vehicle driving experience. The immersive module 40 may be configured for enabling the immersive vehicle driving experience by providing one or more challenges to the driver, or other occupant of the vehicle 12, optionally while the vehicle 12 is stationary, such as through augmented reality (AR) and/or virtual reality (VR) and/or while the vehicle 12 is in motion or being actively driven, which may also include AR and/or VR activities. The immersive module 40 may be configured to facilitate implementing the immersive vehicle driving experience through corresponding control of the vehicle operating system 16 and/or the vehicle systems 18 controlled thereby, such as by generating instructions for controlling the vehicle operating system 16 to deliver the challenging driving conditions even if the vehicle 12 is not actually experiencing the driving conditions in the real-world. The immersive module 40, in other words, may be configured to control differing combinations of the vehicle systems 18 so that the vehicle 12 appears, at least to the driver or other occupant, to be experiencing challenging driving conditions even if the challenging driving conditions are not actually occurring in the real-world and/or to supplement actual conditions occurring within the real-world with fabricated or simulated challenging driving conditions implemented via corresponding control of the vehicle operating system 16.
The immersive module 40, for example, may be configured to implement various challenges by correspondingly adapting operating parameters for one or more of the vehicle systems 18. The immersive module 40 may be configured to design the challenges according to capabilities of the operating system 16 to selectively control operating parameters of the modules, controllers, etc. comprising the vehicle systems 18. The immersive module 40 may be operable for generating challenge parameters for each of the desired challenges. The challenge parameters may differ from real parameters typically utilized for the corresponding vehicle systems 18 when providing a real driving experience. The real driving experience may correspond with normal or typical configurations of the vehicle systems 18 to support normal or regular driving of the vehicle 12. This real driving experience may utilize the real parameters to specify decisions, functions, operations, ranges, limits, and/or other parameters for operating the corresponding vehicle systems. The real parameters, accordingly, may be considered as those typically employed to provide desirable or non-challenging operating conditions for the vehicle 12. The immersive module 40 may be configured for providing the immersive vehicle driving experience by altering the real parameters to the challenge parameters, i.e., changing real operating parameters to challenging operating parameters or abnormal operating parameters, for purposes of providing a challenge to the vehicle 12 occupant.
The present disclosure contemplates the immersive module 40 having capabilities sufficient to generate a wide variety of challenges. The challenges may be generated according to a predefined set of characteristics or challenging operating conditions intended for presentation to the driver or other vehicle occupant. The challenges may correspond with different levels such that differing combinations of the vehicle systems 18 and their attendant operating parameters may be altered from the real parameters to the challenge parameters as needed, at least temporarily, to implement a corresponding one or more of the challenges. One non-limiting aspect of the present disclosure contemplates combining multi-phase immersive experiences from virtual, to blended, to 100% real, or real world experiences. The immersive experience may include leveraging simulations such as augmented reality with a stationary or moving vehicle 12 (e.g. Level 1); actuating events from various vehicle systems or subsystems 18 like low fuel indication, propulsion systems, steering systems, braking systems, low washer fluid, and slippery driving indications (e.g., Level 2); identifying time, event, and/or location based complex driving situations, like sporting or concert events, rush hour, lane convergences, traffic tunnels, and traffic shifts (e.g., Level 3); and/or compilating multi-complex event driving events like a concert event, rush hour event and a traffic shift (e.g., Level 4). The immersive module 40 may be configured for marrying varying levels of simulated and real events to allow vehicle occupants to progressively exercise without having to actually attempt challenging and complex driving situations within the real world.
The foregoing are merely illustrative of the vast capabilities available in accordance with the present disclosure to facilitate providing an immersive vehicle driving experience. The foregoing is predominantly described with respect to the immersive module 40 generating challenge parameters, instructions, etc. to facilitate altering or otherwise controlling the vehicle operating system 16 to provide various challenges, i.e., to operate the vehicle 12 such that the driver may be intentionally exposed with aforethought to complex situations and/or such that events may be simulated in a manner that causes the driver of the occupant of the vehicle 12 to understand conditions differing from those that would otherwise be understood during a real driving experience. The immersion module may correspondingly provide the immersive driving experience while virtual or simulated events are presented while the vehicle 12 is stationary (e.g.
The immersive module 40 may optionally be controlled according to instructions provided from a mobile device 62, a back office controller 64, etc., optionally with an instructor or other individual being present within the vehicle 12 to control the immersive vehicle driving experience. A mobile application may operate on the mobile device 62 such that driving instructors may be enabled to create a sequence of challenges for a student driver before commencing a driving test, to generate challenges in real-time while a student driver is operating the vehicle 12, e.g., to provide virtual objects in simulation of real objects or to direct the driver to a complex traffic situation, and/or to override over otherwise superseding the immersive module 40, such as by terminating simulations, virtual objects, etc. in response to the student driver experiencing undesirable levels of stress. The mobile device 62 may also be beneficial with mechanics and technicians insofar as it may be used in cooperation with the immersive module 40 to facilitate generating the challenges to represent conditions, traits, influences, etc. communicated by a driver bringing a vehicle in for repair and/or as an educational tool, i.e., the challenges may be simulated to present tests or challenges for mechanics as part of a learning experience used to diagnose mechanical or other operational issues for a vehicle without the vehicle 12 having to actually experience the symptoms in the real world.
Block 70 relates to a challenge process for generating a challenge to be implemented as part of an immersive vehicle driving experience to expose vehicle occupants to challenging driving conditions. The challenge process may include delineating one or more simulations, virtual objects, events, etc. to be presented to the driver and/or other vehicle occupant during the immersive driving experience, such as to emulate a flat tire, hard braking. heavy traffic, traffic shifts, event traffic, potholes, towing, a construction zone, hard rain, fog, ice, depleted battery, low wiper fluid waring, low fuel warning, service engine warning, overheat warning, camera or mirror inoperability, reduced engine or motor power, and/or hard acceleration challenge. The challenge may include a roadway event configured for causing the driver to experience a challenge condition while traversing a roadway that may differ from a real condition of the roadway the driver would otherwise experience during the real driving experience. The challenge may include a deteriorated performance event configured for causing the driver to experience deteriorated performance for one or more vehicle systems that may differ from a real performance the driver would otherwise experience for the vehicle systems 18 during the real driving experience. The challenge may include a complex driving situation configured for directing the driver to navigate the vehicle 12 to a complex traffic situation while undertaking the immersive vehicle driving experience. The challenge may include an augmented reality (AR) event or simulated event configured for providing one or more virtual objects or otherwise controlling features of the vehicle 12 to interface unreal conditions with the driver. The challenge or multiple challenges included as part of the immersive vehicle driving experience may optionally be selected through a menu or other interface, which may be actuated by the driver and/or vehicle occupant, such as through the infotainment system 47 or the mobile device 62.
Block 72 relates to a parameters process for generating challenge parameters to implement the challenge. The parameters process may relate to the immersive module 40 determining alterations, variations, disablements, or other control methodologies needed to for directing the vehicle operating system 16 to implement the challenge. This may include determining real parameters utilized by the control modules, ECUs, processors, etc. employed by the vehicle systems 18 to provide a real driving experience. The real driving experience may correspond with a typical or desired operating configuration utilized by the vehicle operating system 16 to control operation of the vehicle 12 when the vehicle 12 is normally operating. The parameters process may include determining alterations to be made to the real parameters for the immersive vehicle driving experience. This may include generating challenge parameters to replace or supplement the real parameters for the relevant control modules, ECUs, etc. comprising the corresponding vehicle systems. The challenge parameters may be generated such that driver inputs, passenger inputs, communications with the vehicle 12, and other operations of the vehicle 12 may be temporarily altered while the immersive vehicle driving experience is being provided.
Block 74 relates to an immersive process for implementing the immersive vehicle driving experience. The immersive process may include the immersive module 40 directing the vehicle operating system 16 to implement the real parameters, such as by correspondingly replacing, re-flashing or otherwise overwriting the attendant vehicle systems, control modules, etc. The simulation process may including generating override parameters or other information to be used during the immersive vehicle driving experiences to determine whether vehicle is encountering situations whereby it may be desirable to supersede the challenge parameters in favor of returning to operating the vehicle 12 according to the real parameters, i.e., resetting the vehicle 12 to operate according to the real driving experience. The simulation process, accordingly, may relate to defining a set of characteristics, values, metrics, etc. as part of the corresponding of the challenge parameters to be used during the immersive vehicle driving experience and to contrast the settings associated therewith relative to the real driving experience. The capability to differentiate the challenge parameters from the real parameters may be beneficial in implementing the challenges at a granular level while maintaining the capability to override the challenges or revert to real driving conditions when needed.
Block 76 relates to a monitoring process for monitoring the immersive vehicle driving experience. The monitoring process may include monitoring biometrics of the driver and/or vehicle occupants. The biometrics may be monitored to track reactions, stresses, and other biometric influences experienced by the vehicle 12 occupants during the immersive driving experience. The corresponding biometrics may be tabulated in a report generated at a conclusion of the immersive vehicle driving experience to represent stresses experienced by the vehicle 12 occupants during the challenges. The monitoring process may also include monitoring performance of the driver during the immersive driving experience, e.g., determining whether the driver has made any mistakes or errors when operating the vehicle 12. The mistakes or errors may be determined relative to a checklist rather predefined set of variables selected to measure performance. The monitoring process may similarly include monitoring environmental influences, driving situations, and other circumstances to log activities surrounding the immersive vehicle driving experience. The data or other information collected as part of the monitoring process may be tabulated and reported for use in modifying vehicle course training, highlighting areas of stress, providing feedback for areas of improvement, etc.
As supported above, the immersive module may be configured to create an immersive vehicle driving experience that blends virtual and real-world driving experiences that are complex and user customized. This may consist of varying levels of virtual or simulated complex driving situation as well as actual complex driving situation enablements. The challenging driving conditions may be implemented in a controlled area, such as degraded vehicle conditions (low fuel, low air pressure, slippery road conditions, service engine soon, power steering degradation, etc. . . . ) while driving on a test track for simulated experiences, optionally leveraging AR as desired. The immersive module may be operable for utilizing sensors, indicators, etc. of the vehicle may be controlled to create a challenging driving situation for a driver, rider, and car enthusiast for a further immersive, simulated experience, such as by identifying complex situations and opportunities, e.g., one-way roads, construction, and high traffic are imminent for a driver to experience firsthand as an actual experience, and/or to identify concert or large traffic events will create congestion or complex low speed maneuvering, or convergent points (traffic shifts, multi lane to single lane) or otherwise high stress driving conditions for actual experience.
The terms “comprising”, “including”, and “having” are inclusive and therefore specify the presence of stated features, steps, operations, elements, or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, or components. Orders of steps, processes, and operations may be altered when possible, and additional or alternative steps may be employed. As used in this specification, the term “or” includes any one and all combinations of the associated listed items. The term “any of” is understood to include any possible combination of referenced items, including “any one of” the referenced items. “A”, “an”, “the”, “at least one”, and “one or more” are used interchangeably to indicate that at least one of the items is present. A plurality of such items may be present unless the context clearly indicates otherwise. All numerical values of parameters (e.g., of quantities or conditions), unless otherwise indicated expressly or clearly in view of the context, including the appended claims, are to be understood as being modified in all instances by the term “about” whether or not “about” actually appears before the numerical value. A component that is “configured to” perform a specified function is capable of performing the specified function without alteration, rather than merely having potential to perform the specified function after further modification. In other words, the described hardware, when expressly configured to perform the specified function, is specifically selected, created, implemented, utilized, programmed, and/or designed for the purpose of performing the specified function.
While various embodiments have been described, the description is intended to be exemplary, rather than limiting and it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible that are within the scope of the embodiments. Any feature of any embodiment may be used in combination with or substituted for any other feature or element in any other embodiment unless specifically restricted. Accordingly, the embodiments are not to be restricted except in light of the attached claims and their equivalents. Also, various modifications and changes may be made within the scope of the attached claims. Although several modes for carrying out the many aspects of the present teachings have been described in detail, those familiar with the art to which these teachings relate will recognize various alternative aspects for practicing the present teachings that are within the scope of the appended claims. It is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative and exemplary of the entire range of alternative embodiments that an ordinarily skilled artisan would recognize as implied by, structurally and/or functionally equivalent to, or otherwise rendered obvious based upon the included content, and not as limited solely to those explicitly depicted and/or described embodiments.
