Patent Application
20140253415
The present disclosure generally relates to integrated virtual environment (IVE) or other wearable computing devices. More particularly, the following discussion relates to systems, methods and devices to improve compatibility between wearable computing devices and vehicle display systems.
Mobile computing devices have become ubiquitous in recent years. Millions of consumers now carry mobile phones, tablet computers and other devices that are able to provide a wealth of immediate information to the user. Such information often includes messaging, voice or video communications, textual or graphical data, or even audio or video media streaming.
Consumers are now demanding even smaller devices with increased connectivity and processing power. In particular, there is intense interest in computers that are integrated into eyeglasses or other wearable devices. These so-called “integrated virtual environments” (IVEs) provide augmented reality, communications, media and/or other computing features in a device that can be conveniently and comfortably carried throughout the day. There is some concern, however, that too much attention could be focused on an IVE at some times or during some activities. If a user is operating a vehicle, for example, excessive focus on a media stream or other IVE presentation could be distracting to more urgent tasks, such as controlling the vehicle.
It is therefore desirable to build systems, devices and techniques for allowing a user to continue use of messaging or other IVE data even in situations where focusing attention on the IVE device itself could be undesirable. These and other desirable features and characteristics will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and this background section.
Some embodiments provide methods executable by a vehicle display system to provide imagery intended for an integrated virtual environment (IVE) device on a display of a vehicle. The method suitably comprises detecting that the IVE device is in physical proximity to the vehicle, and when the IVE device is in physical proximity to the vehicle, providing a first message to the IVE device to thereby temporarily disable presentation of data on an IVE display of the IVE device and directing the presentation of the data on the display of the vehicle instead of on the IVE display.
Other embodiments provide a display management system to provide imagery on a display of a vehicle. The display management system suitably comprises a communications interface configured to receive data communications signals from an antenna and a controller. The controller is configured to identify an integrated virtual environment (IVE) device in physical proximity to the vehicle and, when the IVE device is in physical proximity to the vehicle, to instruct the IVE to disable its display and to instead provide content otherwise presented on the IVE as the imagery for presentation on the display of the vehicle.
Other embodiments, aspects and other features are described in more detail below.
Exemplary embodiments will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and
The following detailed description of the invention is merely exemplary in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by any theory presented in the preceding background or the following detailed description.
According to various exemplary embodiments, displays provided by an integrated virtual environment device are temporarily suspended when the user is in relatively close physical proximity to a vehicle. Further, some or all of the information that would otherwise be displayed on the IVE device can be presented instead on a display that is associated with a vehicle. This allows users to continue receiving messages, enjoying a media stream and/or performing other functions ordinarily carried out using the IVE even though the user is controlling or riding in a vehicle.
These general concepts may be applied in any number of different settings. As a driver enters an automobile or truck, for example, the vehicle display system could automatically detect the presence of the driver's IDE device, and could automatically transfer imagery and/or data from the IDE to a dashboard or heads up display in the vehicle. This would allow the driver to continue viewing of messages or other content in a safer and less distracting manner than would otherwise be available from the IDE itself. Other embodiments could consider multiple passengers within a vehicle. A cabin entertainment system for an aircraft, for example, could transfer messaging, video or other data from a passenger's IDE to a seat-back entertainment system for more convenient viewing in the passenger's seat during flight. Additional details of these and other exemplary embodiments are set forth in more detail below.
Turning now to the drawing figures and with initial reference to
IVE devices 102A-B are any sort of wearable computing devices capable of providing enhanced reality, media content or other information to the viewer. Examples of IVE devices 102A-B could include the GOOGLE GLASS products available from Google Inc. of Mountain View, Calif., although any number of other products could be equivalently used. Typically, IVE devices 102A-B augment the user's regular vision with computerized displays providing additional information about objects viewed, messages intended for the viewer, media content and/or any other data desired by the user. Each IVE 102A-B typically includes a suitable processor and memory for storing and executing software commands, along with a display for providing output to the user. Some IVE devices 102A-B could display generated imagery within a pair of eyeglasses, for example, or in a projection that is visible to the user, or in any other manner. Although
Vehicle display system 110 is a vehicle entertainment system, vehicle information system, or other computing system capable of providing visual presentations to operators and/or passengers of a vehicle. Typically, such visual presentations are made on a display 120 that is visible within the vehicle, such as a dashboard display, a heads up display (HUD), a helmet mounted display (HMD), or simply a flat panel or other display that is present anywhere within the vehicle. Vehicles could include (without limitation) aircraft, automobiles, trucks, boats, ships, bicycles, motorcycles, transit vehicles such as buses and trains, and/or any other vehicles as desired.
Display system 110 suitably includes a microprocessor, digital signal processor or other controller 116 that receives data inputs from one or more sources via one or more interfaces 112, 114. In the example illustrated in
Vehicle communications service 125 is any sort of backend service capable of supporting communications with one or more vehicle display systems 110. In practice, service 125 may incorporate a proxy or the like for obtaining content on network 105. Such content may be forwarded to display system 110 via network 105 or via a separate communications channel, such as a satellite link or cellular network, as desired.
As noted above, it is typically desirable to suspend data presentation using the IVE device 102A-B while the user is operating a vehicle, or when excessive attention on the device 102A-B could be detrimental. To that end, vehicle communications service 110 and IVE device 102 interact with each other to transfer the display of relevant information from the IVE display to the vehicle display 120 at appropriate times. When the user is operating the vehicle, for example, messages or other relevant information can be transferred from the user's IVE device 102 to a cockpit or dashboard display, to a HUD, or to any other display 120 located within the vehicle. Presentation can be returned to the IVE device 102 when the user exits the vehicle, when the vehicle is turned off, or at any other appropriate time.
Turning now to
Vehicle display system 110 typically scans for IVE devices 102 that are in relatively close physical proximity (function 202). Scanning may be performed on any regular or irregular temporal basis, or may be initiated by the user in any manner. Various embodiments may use conventional IEEE 802.15 communications, for example, to locate IVE devices 102 that are operating within wireless range of the vehicle. When an IVE device 102 is located, then the device can be paired with the display system 110 as desired (function 204). Pairing may involve, for example, the user approving the connection with display system 110, or the pairing may be automated as desired. User approval may be obtained from the IVE 102, from buttons or other input features of vehicle display system 110, or any combination of inputs from the IVE 102 and display system 110 as desired.
When an IVE is paired with the display system 110, then display of imagery on the IVE display is suitably disabled (function 206). In various embodiments, the display system 110 transmits an instruction to the IVE 102 that initiates the suspension of further displays. In other embodiments, IVE 102 may be programmed (e.g., in software or firmware) to disable its own display when it is paired with a vehicle display system 110, as desired.
Content display is then transferred from the IVE 102 to the vehicle display 120 as desired (function 208). In various embodiments, video streams that would ordinarily be presented on the IVE display are instead streamed to the display system 110 for rendering on display 120. In such embodiments, IVE 102 is still involved in generating output imagery that is streamed or otherwise provided to display system 110 via interface 114 for presentation on display 120. Other embodiments may simply provide messages or other raw data processed at IVE 102 to the display system 110 so that display system 110 can generate output images on display 120 that incorporate the received data. Text messages, for example, could be provided in a relatively raw format from IVE 102 to display system 110 via interface 114 in some embodiments. Display system 110 would then format the received raw data into still or moving imagery that could be provided on display 120.
In still other embodiments, display system 110 performs an actual handoff of data streaming from IVE 102 so that data is provided directly to the display system 110 without first passing through the IVE 102. Such embodiments may make use of a separate interface 112 to a satellite, mobile telephone or other source of data rather than receiving data directly from the IVE via interface 114. The handoff could be performed in any manner; in various embodiments, a backend service 125 suitably acts as a proxy on network 105 to retrieve messaging or other data directly from the content source 104. Backend service 125 could also monitor connection status between the IVE 102 and the display system 110 so that messaging or other data streams can be restored to the IVE after pairing with the display system 110 has ended. Other embodiments could operate in any number of alternate but equivalent ways to achieve similar results.
Display could be returned to the IVE 102 in any manner (function 212). In various embodiments, heartbeat messages are transmitted between the display system 110 and the IVE 102 on a regular temporal basis (e.g., every few seconds or so) to ensure that the IVE 102 is still present within the vehicle (function 210). Heartbeat messages may not be needed at times that the IVE 102 is otherwise engaged in active communications with the display system 110. If the IVE 102 is providing a video stream or steady stream of data, for example, then heartbeat messages may not be needed. If display system 110 stops receiving heartbeat messages from IVE 102 after a period of relative inactivity, however, it can be determined that the IVE 102 is no longer present in proximity to the vehicle. The IVE display may be released at that time so that data presentation can continue. Similarly, the presentation of IVE data on vehicle display 120 can be discontinued as desired. Equivalent embodiments could monitor heartbeat messages from within the IVE device 102. In such embodiments, the IVE 102 would reinstate its own display when it was determined that the vehicle display system 110 was no longer present, or no longer in physical proximity. Other embodiments could be modified or enhanced as desired.
As noted above, various embodiments could consider multiple IVE devices 102A-B operated by multiple users that may be present in proximity to the same vehicle. With reference now to
As noted above, vehicle display system 110 suitably monitors for IVE devices 102A-B that may be present within the physical proximity of the vehicle (function 302). Proximity may be defined by the range of wireless signaling protocols used to communicate with the IVE 102A-B in many embodiments. When one or more IVE devices 102A-B are discovered, then the display system 110 attempts to pair with the devices 102A-B as desired (functions 304, 305). Note that the IVE devices 102A-B may not come into contact with the vehicle at the same time; in practice, the devices 102A-B may be discovered minutes, hours or even days apart from each other, depending upon the vehicle and the implementation.
In the example illustrated in
In the example of
Imagery may be generated and presented on the vehicle display 120 in any manner (function 316). As noted above, imagery presented on the display 120 may be generated on the paired IVE 102A or on the display system 110 based upon information received from IVE 102A via interface 114 and/or information received via a separate interface 112. Even though
In the example of
Communications may be maintained though heartbeat messages 318, 319, as described above, or in any other manner. When heartbeat messages and/or other data is no longer received from an IVE 102A-B, then the vehicle display system 110 suitably disconnects the IVE 102 A-B as desired. At that point another IVE 102 may be selected, if one is available, or the display could remain idle, or content from other sources (e.g., content from server 125) could be provided. When the IDE 102A-B is no longer in proximity to the vehicle (or when the IDE is no longer paired to the display system no), then the IDE is released and presentation of content on the IDE's display can resume as desired (functions 322, 323).
Generally speaking, the various steps of processes 200 and 300 may be carried out with any sort of hardware, software and/or firmware logic within system 100. Process 200 may be carried out, for example, by a vehicle display system 110 (
The various processes and structures set forth herein could therefore provide an effective solution to the challenge of presenting IVE data within a vehicle without distracting a driver or operator of the vehicle. As an IVE is discovered within communications range of the vehicle, the vehicle display system is able to automatically pair with the IVE so that presentation of some or all of the content presented on the IVE is instead presented on a vehicle display.
The term “exemplary” is used herein to represent one example, instance or illustration that may have any number of alternates. Any implementation described herein as exemplary is not necessarily to be construed as preferred or advantageous over other implementations. While several exemplary embodiments have been presented in the foregoing detailed description, it should be appreciated that a vast number of alternate but equivalent variations exist, and the examples presented herein are not intended to limit the scope, applicability, or configuration of the invention in any way. To the contrary, various changes may be made in the function and arrangement of elements described without departing from the scope of the claims and their legal equivalents.
