The present disclosure generally relates to a system and method for operating a dynamic display program on a vehicle.
Newer vehicles include a variety of drive features. Some drive features are only suitable under rare or specific circumstances. Because activation (or in some cases, deactivation) of these features is rarely proper, some users may be unfamiliar these features and, as a result, fail to apply them when proper.
In various embodiments, various dynamic display systems and methods solve the above problems. One example dynamic display system includes: (a) a vehicle including steering, an accelerator, brakes, sensors recording sensor data, a display, a processor, and memory; (b) a display program operatively coupled to the processor and configured to: determine a user hindrance rating based on the sensor data, and select instructions from a pool of instructions based on the hindrance rating and a user-selectable fidelity level, the pool of instructions including visual cues, and audio cues.
One example dynamic display method for a vehicle having steering, an accelerator, a brakes, sensors recording sensor data, a display, a processor, and memory, includes: determining, via a display program operatively coupled to the processor, a user hindrance rating based on the sensor data, and selecting instructions, via the display program, from a pool of instructions based on the hindrance rating and a user-selectable fidelity level, the pool of instructions including visual cues, and audio cues.
For a better understanding of the invention, reference may be made to embodiments shown in the following drawings. The components in the drawings are not necessarily to scale and related elements may be omitted, or in some instances proportions may have been exaggerated, so as to emphasize and clearly illustrate the novel features described herein. In addition, system components can be variously arranged, as known in the art. Further, in the drawings, like reference numerals designate corresponding parts throughout the several views.
While the invention may be embodied in various forms, there are shown in the drawings, and will hereinafter be described, some exemplary and non-limiting embodiments, with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated.
In this application, the use of the disjunctive is intended to include the conjunctive. The use of definite or indefinite articles is not intended to indicate cardinality. In particular, a reference to “the” object or “a” and “an” object is intended to denote also one of a possible plurality of such objects. Further, the conjunction “or” may be used to convey features that are simultaneously present instead of mutually exclusive alternatives. In other words, the conjunction “or” should be understood to include “and/or”.
Vehicle 100 may include sensors 102. The sensors 102 can be arranged in and around the car in a suitable fashion. The sensors can all be the same or different. There can be many sensors, as shown in
As shown in
The processor or controller 210 may be any suitable processing device or set of processing devices such as, but not limited to: a microprocessor, a microcontroller-based platform, a suitable integrated circuit, or one or more application-specific integrated circuits (ASICs).
The memory 208 may be volatile memory (e.g., RAM, which can include non-volatile RAM, magnetic RAM, ferroelectric RAM, and any other suitable forms); non-volatile memory (e.g., disk memory, FLASH memory, EPROMs, EEPROMs, memristor-based non-volatile solid-state memory, etc.); unalterable memory (e.g., EPROMs); read-only memory; a hard drive; a solid state hard drive; or a physical disk such as a DVD. In an embodiment, the memory includes multiple kinds of memory, particularly volatile memory add non-volatile memory.
The communication devices 214 may include a wired or wireless network interface to enable communication with an external network. The external network may be a collection of one or more networks, including standards-based networks (e.g., 2G, 3G, 4G, Universal Mobile Telecommunications Autonomous valet parking system (UMTS), GSM® Association, Long Term Evolution (LTE)™, or more); WiMAX; Bluetooth; near field communication (NFC); WiFi (including 802.11 a/b/g/n/ac or others); WiGig; Global Positioning System (GPS) networks; and others available at the time of the filing of this application or that may be developed in the future. Further, the external network(s) may be a public network, such as the Internet; a private network, such as an intranet; or combinations thereof, and may utilize a variety of networking protocols now available or later developed including, but not limited to, TCP/IP-based networking protocols. The communication devices 214 may also include a wired or wireless interface to enable direct communication with an electronic device, such as a USB or Bluetooth interface.
The user interface 212 may include any suitable input and output devices. The input devices enable a driver or a passenger of the vehicle to input modifications or updates to information referenced by the dynamic display program 120 as described herein. The input devices may include, for instance, a control knob, an instrument panel, a keyboard, a scanner, a digital camera for image capture and/or visual command recognition, a touch screen, an audio input device (e.g., cabin microphone), buttons, a mouse, or a touchpad. The output devices may include instrument cluster outputs (e.g., dials, lighting devices), actuators, a display (e.g., a liquid crystal display (“LCD”), an organic light emitting diode (“OLED”), a flat panel display, a solid state display, a cathode ray tube (“CRT”), or a heads-up display), and speakers. It should be appreciated that the term pressing a button or feature also includes pressing or activating a virtual button or feature, such as using a mouse to click on an item on a display, or pressing a virtual button on a touch screen.
The disk drive 216 is configured to receive a computer readable medium. In certain embodiments, the disk drive 216 receives the computer-readable medium on which one or more sets of instructions, such as the software for operating the methods of the present disclosure including dynamic display program 120 can be embedded. The instructions may embody one or more of the methods or logic as described herein. In a particular embodiment, the instructions may reside completely, or at least partially, within any one or more of the main memory 208, the computer readable medium, and/or within the processor 210 during execution of the instructions.
The term “computer-readable medium” should be understood to include a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable medium” also includes any tangible medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a system to perform any one or more of the methods or operations disclosed herein.
In one embodiment, the vehicle 100 includes a dynamic display program 120 in the memory 208. When executed by the processor, the dynamic display program 120 generates or selects instructions for other elements of the vehicles to perform. In various embodiments, the dynamic display program is configured to direct instructions to the user interface 212, the communication devices 214, the vehicle drive 206, the sensors 102, the processor 210, and any other component operatively connected to the vehicle data bus 202. It should be appreciated that vehicle 100 may be fully autonomous or partially autonomous.
In various embodiments, a computing device 105 is operatively connected to the vehicle 100 via any suitable data connection such as WiFi, Bluetooth, USB, or a cellular data connection. In one embodiment, shown in
Turning now to
With specific reference to
The user actions 401 include acts performed by the user of the vehicle 100. The user actions 401 may include: an order or sequence in which the user has engaged various features by, for example, pressing buttons; a number of times in which the user has engaged a particular feature; a magnitude of engagement of a particular feature, for example, a magnitude of accelerator activation; a magnitude of the user's physical engagement level with the buttons or touch screens, for example, and a force with which the user has pressed a button or touch screen. In various embodiments, the user actions 401 include responses to prompts generated by the dynamic display program 120. For example, the dynamic display program 120 may display a prompt asking whether the vehicle is stuck.
The drive events 402 may include any status, property, or event of or related to the vehicle 100. In various embodiments, drive events 402 include vehicle position, vehicle orientation, vehicle speed, vehicle torque, vehicle acceleration, vehicle braking, vehicle oscillations, vehicle pulsations, vehicle wheel movement (including speed, torque, and orientation), gear selection, level of gear engagement, fuel level, content of displayed data, content of sound broadcast, hindrance 405, fidelity level 501, door opening, and any other event related to the vehicle that is capable of being sensed and recorded.
The response time 403 may include a time starting with one or more specific or predetermined user actions or predetermined drive events. For example, response time 403 may begin when a user presses a specific button three times in a row. In various embodiments, the dynamic display program 120 simultaneously counts multiple response times. In various embodiments, the dynamic display program 120 may compare the driver's measured response time 403 to an expected response time or an average response time. Based on the comparison (e.g., the driver is responding more quickly, more slowly, more often, or more erratically than expected or average), the dynamic display program 120 may determine the probability or magnitude of hindrance.
The conditions 404 may include any status or property of the user, the vehicle, or the outside world. In various embodiments, conditions 404 include weather (measured or downloaded), temperature, precipitation, kind of drive surface for each of the wheels, frictional constant of the drive surface for each of the wheels, time, day, health properties of the user including heart rate and level of alertness, a field of vision of the user, a position or location of the user, and an orientation of the user.
In various embodiments, the dynamic display program 120 factors in a degree or magnitude of contributing factors when performing its methods or functions.
The dynamic display program 120 may be configured to record the user actions 401, drive events 402, response time 403, and conditions 404 in a chart or database for assessment. The chart or database may associate each user action 401, drive event 402, response time, and condition 404 with a current time. A storage length of content in the database may be user-adjustable. For example, the user may choose for the dynamic display program 120 to only store content for to a user-selected length of time, a key cycle, an arbitrary number of key cycles, or permanently. Alternatively or in addition, the user may choose for the dynamic display program 120 to store an arbitrary number of most recent content via a first in-first out algorithm, such that new content causes oldest stored content to be erased from memory.
A frequency with which the user actions 401, drive events 402, response time 403, and conditions 404 are recorded may vary. In various embodiments, each category is recorded at a separate frequency. In various embodiments, each category is recorded at a predetermined frequency. In various embodiments, each category is recorded in response to a new user action 401, a new drive event 402, or a predetermined number of new entries in the chart or database.
In various embodiments, the user actions 401, the drive events 402, the response time 403, and the conditions 404 are evaluated, with one or more predetermined algorithms, to generate the hindrance 405 and more specifically, a hindrance rating 406 and a hindrance topic 407. Specific examples of predetermined algorithms are explained in greater detail below.
The hindrance rating 405 is a number or value that indexes the degree or level of customer confusion or frustration. A low hindrance rating 405, such as a rating of 1, indicates an absence of user confusion. A medium hindrance rating, such as a rating of 3, indicates some user confusion. A high hindrance rating, such as a rating of 5, indicates total user confusion. The hindrance rating 405 changes over time and more specifically, is reassessed in light of new user actions 401, drive events 402, response time 403, and conditions 404. In various embodiments, the hindrance rating 405 escalates with time.
The hindrance topic 407 is selected from a predefined plurality of hindrance topics. In some cases, the hindrance topics may be user-adjustable such that the user may contribute hindrance topics. In various embodiments, a manufacturer of the vehicle 100 is capable of editing, deleting, or adding hindrance topics. The selected hindrance topic 407 changes over time and more specifically, is reassessed in light of new user actions 401, drive events 402, response time 403, and conditions 404.
Each hindrance topic may correspond to a hindrance diagnosis and a hindrance solution. The diagnosis is a possible or likely source of the hindrance. The solution is a likely fix for the hindrance. The dynamic display program 120 performs the diagnostics based on inputs from the vehicle sensors. Based on those inputs, the dynamic display program determines a hindrance topic and hindrance factor. In various embodiments, each hindrance topic is associated with one or more diagnoses and one or more solutions. The dynamic display program 120 presents the solution via the user interface 212.
In various embodiments, the vehicle 100 may present a plurality of hindrance topics 407 to the user if the vehicle 100 cannot pick a specific hindrance topic 407 with sufficient certainty. In various embodiments, the degree of sufficient certainty is manufacturer or user adjustable. In various embodiments, the vehicle 100 may present, for user selection, a list of most likely hindrance topics 407 in light of the user actions 401, drive events 402, response time 403, and conditions 404.
Turning now to
In various embodiments, the hindrance rating 406 is multiplied by or otherwise combined with the fidelity level 501 to determine a presentation quality level 506. For example, if the vehicle 100 calculates a hindrance rating of 3 and the user has selected a fidelity level of 5, then the quality of presentation level would be 15. In another example, if the vehicle 100 calculates a hindrance rating of 4 and the user has selected a fidelity level of 2, then the quality of presentation level would be 8.
In various embodiments, the dynamic display program 120 selects instructions 502 for presentation based on the presentation quality level 506 and the hindrance topic 407. In some cases, a plurality of instructions or a plurality of instruction sets may be associated with a hindrance topic 407. In these cases, the dynamic display program 120 may select the instructions or a set of instructions for presentation based on the presentation quality level 506. For example, a first set of low-detail instructions may correspond with a presentation quality level range of 6 to 14. A second set of medium or semi-detailed instructions may correspond to a presentation quality level range of 15 to 19. A third set of high detail instructions may correspond to a presentation quality level range of 20 to 24. A fourth set of even more extreme detail instructions may correspond to a presentation quality level of 25. In various embodiments, some of the instructions overlap between sets such that some instructions corresponding to one set are equivalent to, or the same as, instructions corresponding to another set.
Instructions 502 are commands generated or selected by the dynamic display program 120 that cause the various elements of the vehicle 100 (depicted in
Cues 503 include any sequence and combination of audio cues, visual cues, and haptic cues generated by the user interface 212. The audio cues may include alarms or spoken instructions, or any combination thereof. The visual cues may include text displays, video displays, photographic displays, lights, or any combination thereof. In various embodiments, low-key cues, such as a flashing light on the vehicle dashboard are associated with low presentation quality. In various embodiments, more distracting cues, such as training videos are associated with medium or high presentation quality. In various embodiments, highly distracting cues such as alarms or spoken commands are associated with medium or high presentation quality. In various embodiments, cues may also include virtual selectors or buttons pulled up on the vehicle display for immediate user selection. For example, a virtual button to deactivate the traction control may be included in a specific page of the user interface. In these embodiments, the dynamic display program 120 may present the virtual button on the presently displayed screen without requiring the user to page through the user interface.
It should be appreciated that the kinds of cues 503 may vary across hindrance topics 407, such that given a same quality level for hindrance topics A and B, a different set of cues are performed for hindrance topic A than for hindrance topic B. In various embodiments, the various cues for a given hindrance topic are designed or intended to cause the driver to perform the same ultimate act, such a gear change or feature selection. In various embodiments, the cues for a given hindrance topic are cumulative, such that a higher quality level results in extra cues. In various embodiments, the cues 503 across hindrance topics 407 have the same form, but different content (e.g., a first quality level range is always associated with blinking dashboard LEDs, a second quality level range is always associated with images on the dashboard, a third quality level range is associated with videos on the dashboard and an audio command).
Autonomous controls 504 include commands issued by the dynamic display program 120 that cause the vehicle to perform one or more drive events. In various embodiments, autonomous controls 504 include commands to brake, accelerate, open doors, change gears, and activate or deactivate driving features such as four wheel drive.
Feedback 505 includes data generated by the dynamic display program 120 and sent to an external server. In particular, the feedback 505 may include any of the user actions 401, drive events 402, response time 403, and conditions 404. In some embodiments, the feedback 505 includes all of factors 401 to 404 and is transmitted at a predetermined frequency. In various embodiments whether to transmit feedback 505 is a user-selectable option. In various embodiments, the frequency of transmission of feedback 505 is user-adjustable. In various embodiments, the frequency of transmission is based on the frequency with which the planning program 120 records or deletes the factors 401 to 404.
It should be appreciated that an external server, such as computing device 105, may, in some cases, run a polling program that automatically organizes feedback 505 from a plurality of vehicles 100. In some cases, the polling program is configured to display the organized information to a user, enabling the user to refine the hindrance topics 407 and the instructions 502 based on the feedback 505. In some embodiments, the polling program automatically refines the hindrance topics 407 and instructions 502 at least partially based on the feedback 505 collected from a plurality of vehicles.
With reference to
In some cases, the vehicle 100 must transition from 4×4 high to 4×4 low after a user has selected 4×4 low. More specifically, prior to physically transferring to or engaging 4×4 low, some vehicles require a user to (1) place the transmission into neutral, (2) press the 4×4 low selector, and (3) slightly depress and hold the accelerator pedal until 4×4 low is fully engaged. In some cases, a user may not understand that step (3) is required to fully engage 4×4 low. In some cases, step (3) is necessary to cause gear rotation and subsequent gear tooth alignment in order to resolve abutted gears.
The method 600 identifies and at least partially resolves this problem. More specifically, the method 600 detects (a) that the user selected 4×4 low 601, (b) that the vehicle is stuck 602 (i.e., is in a situation where 4×4 low could be useful), and (c) that the 4×4 low has not yet fully engaged 603. In various embodiments, the method 600 that the vehicle is stuck 602 by comparing individual wheel speeds against vehicle specific reference wheel speeds.
In response to the factors 601 to 603, the dynamic display program 120 may select a 4×4 low hindrance topic. The dynamic display program 120 may measure the magnitude of factors 601 to 603 and other factors, such as factors 401 to 404 in determining the hindrance rating 406. As discussed above, the quality level 506 is based on the hindrance rating 406 and the user selectable fidelity level 501.
The dynamic display program 120 selects instructions 502 in view of the quality level 506 and the hindrance topic 407. In various embodiments, the instructions 502 selected with the method 600 include an audio announcement for the user to press and hold the accelerator pedal. In various embodiments the instructions 502 selected with the method 600 also include autonomous activation of the accelerator pedal until the 4×4 low has fully engaged.
With reference to
The method 700 of the dynamic display program 120 identifies and at least partially resolves this problem. More specifically, the method 700 detects (a) a kind of surface 701 below the vehicle (detected via vehicle sensors 102), (b) vehicle torque 702, (c) vehicle speed 703, (d) vehicle location 704, and (e) whether the vehicle is stuck 705.
In various embodiments, at a low quality level, the planning program 120 may display text identifying the e-locker and its added traction functionality. If, after ten seconds, the vehicle is still substantially stuck and the B-locker is still off, the planning program 120 may escalate to a medium quality level and instruct the user, via an audio command, that the e-locker is associated with a specific menu or button. In various embodiments, the planning program 120 may automatically display a virtual button or selector that enables the user to activate the e-locker. If, after another twenty seconds, the vehicle is still substantially stuck and the e-locker is off, the planning program may show a short video or clip or a user selecting the e-locker. After another thirty seconds, if still stuck, the vehicle may autonomously activate the e-locker.
With reference to
The method 800 of the dynamic display program 120 identifies and at least partially resolves these problems. More specifically, the method detects (a) a kind of surface 801 below the vehicle, (b) vehicle oscillation 802 (i.e., abnormal movement back and forth), and (c) vehicle pulsation 803 (i.e., abnormal vibration).
The dynamic display program 120 assesses these factors with a predetermined algorithm and determines whether 4×4 high or AWD is proper. More specifically, the dynamic display program 120 determines that 4×4 high is proper when the surface 801 is suitable for 4×4 high and the vehicle exhibits a specific pattern of oscillation 802, pulsation 803, or sustained slip (not shown) indicating that AWD is improper. Corresponding steps apply to determining that AWD is proper. The dynamic display program 120 issues instructions 502 accordingly.
With reference to
Generally, traction control and stability control reduce engine torque to maintain control in icy conditions, making the features counter-productive when a vehicle is stuck. In some cases, a user may be unaware of these effects.
The method 900 of the dynamic display program 120 identifies and at least partially resolves these problems. More specifically, the method 900 detects (a) a user's steering, (b) wheel movement, (c) torque applied to the wheels, (d) a vehicle acceleration, and (e) whether the vehicle is stuck.
The dynamic display program 120 assesses these factors with a predetermined algorithm and determines whether traction control or stability control (or only one, or both) are proper. The dynamic display program 120 issues corresponding instructions. In various embodiments, the method 900 of the dynamic display program 120 identifies when only one of traction control and stability control has been deactivated and generates instructions informing the user that turning both off will enhance torque. In various embodiments, under sufficient circumstances, the dynamic display program 120 issues autonomous instructions 502 causing both of the traction control and the stability control to disengage until the vehicle is no longer stuck.
Turning now to
It should be appreciated that for the purposes of the claims, a “loaded vehicle” is hereby defined to be a vehicle comprising a steering system, an acceleration system with an engine or motor, a braking system including brakes configured to decelerate the vehicle, wheels, wherein at least one of the wheels is configured to receive torque generated by the engine or motor, one or more seats, at least one processor, memory operatively coupled to the processor, and at least one display operatively coupled to the processor. It should be appreciated that the above definition applies, and only applies, when the claims specifically include the term “loaded vehicle.”
The above-described embodiments, and particularly any “preferred” embodiments, are possible examples of implementations and merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above-described embodiment(s) without substantially departing from the spirit and principles of the techniques described herein. All modifications are intended to be included herein within the scope of this disclosure and protected by the following claims.
Number | Name | Date | Kind |
---|---|---|---|
7162346 | Berry et al. | Jan 2007 | B2 |
7796019 | Yamada | Sep 2010 | B2 |
8209093 | Hill | Jun 2012 | B2 |
8447460 | Nihei | May 2013 | B2 |
8718862 | Gwozdek et al. | May 2014 | B2 |
9415779 | Popham | Aug 2016 | B2 |
9440659 | Kelly | Sep 2016 | B2 |
9646428 | Konrardy | May 2017 | B1 |
9667742 | Weng | May 2017 | B2 |
20070182529 | Dobler | Aug 2007 | A1 |
20110087398 | Lu et al. | Apr 2011 | A1 |
20120095659 | Rodrigues et al. | Apr 2012 | A1 |
20120212353 | Fung | Aug 2012 | A1 |
20130224693 | Gilling et al. | Aug 2013 | A1 |
20140156126 | Yung et al. | Jun 2014 | A1 |
20140365070 | Yano et al. | Dec 2014 | A1 |
20150210290 | Robert | Oct 2015 | A1 |
20170101116 | Shubs, Jr. | Apr 2017 | A1 |
20170305434 | Ratnasingam | Oct 2017 | A1 |
Number | Date | Country |
---|---|---|
1961606 | Aug 2008 | EP |
2958590 | Oct 2011 | FR |
2534174 | Jul 2016 | GB |
1020090093146 | Sep 2009 | KR |
Entry |
---|
Search Report dated Jul. 5, 2014 for GB Patent Application No. GB1701049.7 ( 3 pages). |
Qu et al., “Choosing When to Interact With Learners”, Proceedings of the 9th International Conference on Intelligent User Interfaces, Jan. 2004, pp. 307-309. (Year: 2004). |
Number | Date | Country | |
---|---|---|---|
20170213401 A1 | Jul 2017 | US |