The described embodiments relate generally to an input device. More particularly, the present embodiments relate to a movable input device capable of detecting multiple forms of input.
Electronic devices are continually increasing in their functionality and capabilities. Accordingly, there is a need for input mechanisms that can operate with the increased performance of these devices. Electronic devices include a variety of input members for receiving input from users. Examples of input members include keyboards, touch screens, displays, joysticks, microphones, speakers, crowns, trackpads, track balls, and so on.
Some input devices include a moveable member and one or more sensors to detect touch or other user inputs. Further, certain input devices can be adapted or configured to suit particular electronic devices, such as smartphones, smart watches, head-mounted displays (HMDs), etc.
According to some aspects of the present disclosure, a head-mounted display includes a housing, a display attached to the housing, and a tactile input disposed on the head-mounted display, the tactile input including a movable touch-sensitive region.
In some examples, the touch sensitive region includes a first electrical path, and a second electrical path, isolated from the first electrical path. Additionally, in some examples, the tactile input can include a cap configured to rotate and translate relative to the housing, the touch-sensitive region positioned on the cap, a stem extending from the cap through an opening defined by the housing, the stem at least partially defining the first electrical path and the second electrical path, and a non-conductive material positioned between the first electrical path and the second electrical path.
In some examples, a first end of the stem can be attached to the cap, and a second, opposite end of the stem can be attached to a component within the housing. Further, in some examples, the movable touch-sensitive region can include a first electrode electrically connected to the first electrical path, and a second electrode, electrically isolated from the first electrode and electrically connected to the second electrical path. A processor can be electrically connected to the first electrical path and the second electrical path, wherein the processor can receive a first finger detection signal from the first electrode via the first electrical path, receive a second finger detection signal from the second electrode via the second electrical path, and determine a translation of a finger across the touch-sensitive region based at least in part on the first finger detection signal and the second finger detection signal. In some examples, the processor can modify an output of the display in response to the determined translation.
In some examples, the head-mounted display can further include a proximity camera disposed on the housing and directed to the moveable touch-sensitive region. The display can present a visual indicator based on a location of a user's finger relative to the touch-sensitive region detected by the proximity camera.
In another example embodiment of the head mounted display, the stem defines an axis and the cap can be rotatable about the axis and translatable in a direction that is substantially parallel to the axis. According to this example, the axis can be pivotable relative to the housing, and the system can further include a pivot detection sensor disposed adjacent to the stem. In yet another example, the system can further include a gaze camera disposed adjacent to the display.
According to some aspects, a capacitive input member includes a crown defining an outer region electrically connected to a first electrical path, and an inner region electrically connected to a second electrical path, the inner region electrically isolated from the outer region. According to this example, the first electrode can be electrically connected to the first electrical path, a second electrode can be electrically isolated from the first electrode and electrically connected to the second electrical path, a shaft can be physically and electrically connected with the crown, and a signal output sensor can be electromagnetically connected to the shaft. In this example, the shaft can be configured to transfer electrical and physical inputs from the crown to the signal output sensor.
In some examples, the outer region of the crown is translatable relative to the inner region. In some examples, the shaft of the capacitive input member defines an axis, and the crown is rotatable about the axis and translatable in a direction that is substantially parallel to the axis. In some examples of the capacitive input member, the axis can be pivotable relative to the signal output sensor. Additionally, the capacitive input member can include an array of perimeter electrodes disposed on a perimeter of the outer region.
According to some aspects, a wearable device can include a housing, a display carried by the housing, a processor disposed in the housing and electrically connected to the display, and a capacitive sensor carried by the housing and electrically connected to the processor. In this example, the capacitive sensor can include a movable outer surface, a first conductive path extending from the movable outer surface, a second conductive path extending from the movable outer surface, and a non-conductive insulator electrically isolating the first conductive path from the second conductive path.
In some examples, the wearable device can further include a first electrode disposed on the movable outer surface and electrically connected to the first conductive path, and a second electrode disposed on the movable outer surface electrically isolated from the first electrode, and electrically connected to the second conductive path, wherein the processor receives a first finger detection signal from the first electrode via the first electrical path, receives a second finger detection signal from the second electrode via the second electrical path, and determines a translation of a finger across the touch-sensitive region based at least in part on the first finger detection signal and the second finger detection signal.
In other examples of the wearable device, the processor modifies an output of the display in response to the determined translation. The wearable device can further include a proximity sensor connected to the housing, the proximity sensor being configured to detect a proximity of a user's hand relative to the capacitive sensor. In some examples, the proximity sensor can include a camera.
The disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
Reference will now be made in detail to representative embodiments illustrated in the accompanying drawings. It should be understood that the following descriptions are not intended to limit the embodiments to one preferred embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as can be included within the spirit and scope of the described embodiments, as defined by the appended claims.
The following disclosure relates to an input device that includes a moveable member and a touch-sensitive interface. The moveable member can be manipulated in a variety of directions. In some examples, the movement includes translation in one or more directions, rotation, tilt, and so on. Moving the moveable member can be used to generate a predetermined input signal corresponding to the motion. The input device can define a touch-sensitive interface having multiple electrical paths capable of transmitting signals through the input device. For example, a touch by a user on one or more of the electrical paths can be used to generate a predetermined input signal corresponding to the received touch input. Further, a sequence of touches along predetermined electrical paths can correspond to specific touch-gesture inputs resulting in predetermined commands. In a particular example, the input device can be a crown positioned on a head-mounted display/smart glasses (HMD).
The following disclosure provides particular benefits in the field of HMDs. Specifically, the input device provides additional utility without adding a separate remote control, thereby reducing complexity of the system. An input device positioned on an HMD can enhance the user's experience by providing an intuitive interface between the HMD and the user's hand. Further, the ability to detect presence and directional input, coupled with additional input technologies, such as eye tracking, enhances the user's experience and adds functionality and control to the user interface of the HMD.
These and other embodiments are discussed below with reference to
In some embodiments, the electronic device 100 can include one of a variety of portable electronic devices or portable computing devices. Examples include cell phones, smart phones, tablet computers, laptop computers, time-keeping devices, head-mounted displays, computerized glasses and other wearable devices navigation devices, sports devices, accessory devices, health-monitoring devices, medical devices, and the like. As discussed below, the depicted components of the electronic device 100 improve the user experience by providing additional functionality and control of the applications executed on or by the electronic device.
The processor 116 can receive data, such as from a data storage unit, the sensor unit 112, the input device 120, the human interface unit 108, or a combination thereof. The processor 116 can perform or execute computer program instructions based on received data. For example, the processor 116 can receive and execute the computer program instructions stored on a data storage unit in response to receiving input at the input device 120. The processor 116 is operable to receive/output data. For example, the processor 116 can receive/output data from/to the sensor unit 112, the battery 118, the input device 120, and the human interface unit 108. The processor 116 can control the battery 118, the sensor unit 112, the input device 120, and the human interface unit 108.
The sensor unit 112 can detect or determine one or more aspects of the operational environment or physical environment of the electronic device 100. Although only one sensor unit 112 is shown in
The sensor unit 112 can be operatively coupled to the input device 120. In some examples, the sensor unit 112 can include one or more proximity sensors capable of detecting a proximity of a user. In some examples, the proximity sensor can detect a proximity of a user's hand and/or finger relative to the electronic device 100, or relative to a portion of the electronic device. The proximity sensor can be used to determine that the user's hand is approaching the input device 120. The proximity sensor can include at least one of a camera, a laser, ultrasonic transducer, or any other sensor capable of detecting a proximity of a user.
The input device 120 can be accessible to a user and can receive user input. The input device 120 can be a tactile input that is engaged, modified, selected, or actuated by touch, either via mechanical manipulation, and/or capacitive detection. As discussed in greater detail below, the input device 120 can include a moveable member or element and a touch-sensitive interface. The moveable member can be manipulated in a variety of directions corresponding to various input commands. For example, the movements can include translation in one or more directions, rotation, tilt, combinations thereof, and so on. The input device 120 can define a touch-sensitive interface having multiple electrical paths capable of transmitting signals through the input device. For example, a touch by a user on one or more of the electrical paths can be used to generate a predetermined input signal corresponding to the received touch input. Further, a sequence of touches along predetermined electrical paths can correspond to certain touch-gesture inputs. In some examples, input received by the input device 120 can results in visual data output to the user through the human interface unit 108. In some examples, the input device 120 can include a biometric sensor. In a particular example, the input device 120 can be a crown input mechanism positioned on a head-mounted display (HMD). The input device 120 can include or be paired with a light-based user input receiver, such as a camera, optical encoder, or infrared receiver, a sound-based receiver, such as a microphone, a mechanical receiver, such as a button, joystick, dial, or slider, a switch, a motion-based input, a touch-based input, or a combination thereof. Although
The human interface unit 108, or user interface, can output, present, or display data to a user of the electronic device 100, such as data received from the battery 118, the processor 116, the sensor unit 112, the input device 120, and/or the charging station 210. For example, the human interface unit 108 can include a light-based display, a sound-based display, a haptic feedback system, a motion-based display, or a combination thereof.
The human interface unit 108 can receive user input and communicate user input data representing the user input to the battery 118, the processor 116, the sensor unit 112, the input device 120, or a combination thereof. In some examples, the human interface unit 108 can receive one or more signals from the sensor unit 112 and/or the input device 120, and can display a representative image of the received signals.
It will be understood that the electronic device 100 can include other components not shown in
The wearable electronic device 200 can include a housing 222 and a display 226 positioned within an opening formed in a top surface of the housing 222. Generally, the display 226 can be used to present visual output to the user. For example, the display 226 can be used to present or display a graphical user interface having one or more graphical elements. The electronic device 200 can also include one or more user input devices, including, for example, a touch screen integrated with the display 226, a button 228 (or other input mechanism) positioned on a surface of the housing 222, and an input device 220 positioned on a side surface of the housing 222. The input device 220 can be substantially similar to, and can include some or all of the features of the input device 120 discussed above, and the input devices 320, 420 discussed below. As discussed in greater detail below, the input device 220 includes a dial or knob for receiving rotational and translational input from the user and is equipped with a touch-sensitive interface having multiple electrical paths for receiving capacitive touch input from a user capable of providing directional detection and signals that can be utilized to enhance control and operation of the electronic device.
In some examples, the wearable device 200 includes a processor coupled with or in communication with a memory, one or more communication interfaces, output devices such as displays and speakers, and one or more additional input devices such as buttons, dials, microphones, or touch-based interfaces. The communication interface(s) can provide electronic communications between the electronic device and any external communication network, device or platform, such as but not limited to wireless interfaces, Bluetooth interfaces, Near Field Communication (NFC) interfaces, infrared interfaces, Universal Serial Bus (USB) interfaces, Wi-Fi interfaces, Transmission Control Protocol/Internet Protocol (TCP/IP) interfaces, network communications interfaces, or other communication interface. The wearable electronic device 200 can include computer-readable instructions or software that is configured to be executed by the processor to perform various functions or operations. In some examples, the device 200 can be configured to provide information regarding time, health, event notifications, device status, and other information. The device 200 can also be externally connected to or communicating with separate devices and/or software executing on separate devices. In some examples, the device 200 can be configured to send and receive messages, video, and commands, in addition to other electronic communications.
In some examples, the display 226 is configured to output a graphical user interface that displays information about the electronic device 200, as well as other information that is stored in a memory of the electronic device 200. For example, the user interface can present information corresponding to one or more applications that are being executed on the electronic device 200. Such applications can include a time keeping application, an email application, a phone application, a calendaring application, a game application, and the like.
In some examples, and as will be discussed below, movement sensors can be used to determine movement or actuation information associated with the input device 220. The movement can be rotational movement, translational movement, angular movement, and so on. Further, touch sensors can be used to determine touch inputs on the input device 220. The touch inputs can be taps, presses, and swipes. Output representing movement or touch on the input device 220 can be used to manipulate graphics, images, icons, and/or other graphical elements of a user interface on the display 226 of the wearable electronic device 200.
In some examples, the button 228 or the input device 220 can be used to select, adjust or change various images that are output on the display 226. For example, if the display 226 of the electronic device 200 is used to display a time keeping application that simulates the face of a watch, the input device 220 can be used to adjust the position of the hands or index the digits that are displayed for the watch face simulation. In some examples, the input device 220 can be rotated to move a cursor or other type of selection mechanism from a first displayed location to a second displayed location in order to select an icon or move the selection mechanism between various icons that are output on the display 226. Likewise, the input device 220 can be pushed, pressed, touched, or otherwise actuated to provide another input to the device 200.
Although omitted from
As shown in
In some embodiments, the wearable electronic device 200 can also include a joystick, controller, keyboard or other similar separate input mechanism. The input device 220 can be operatively coupled with the separate input mechanism. In some examples the input device 220 is used in conjunction with the separate input mechanism to provide certain inputs to the wearable electronic device 200. In some examples, the input device 220 eliminates the need for one or more separate input mechanisms. Additionally, the electronic device 200 can include one or more components that enable the wearable electronic device 200 to connect to the Internet and/or access one or more remote databases or storage devices.
The housing 254 of the HMD 250 can be a physical structure that incorporates, contains, or connects electrical components such as those discussed above with reference to
The sensor unit 258 can detect or determine one or more aspects of the physical environment of the HMD 250. The sensor unit 258 can include one or more of a camera, a microphone, an infrared receiver, a global positioning system unit, a gyroscopic sensor, an accelerometer, a pressure sensor, a capacitive sensor, a biometric sensor, a magnetometer, a radar unit, a LIDAR unit, an ultrasound unit, a temperature sensor, or any other sensor capable of detecting or determining one or more aspects or conditions of the environment of the HMD 250. In some examples, the sensor unit 258 is a camera capable of detecting a hand of the user and determine that the hand is travelling toward input device 220. Further, the input device 220 can be capable of performing a hover detection of the user's hand. Thus, a user's upcoming use of the input device 220 can be predicted using the sensor unit 258 and/or a hover detect feature of the input device 220.
In some examples, input provided to the input device 220 can be used to determine that a user is about to use the HMD 250. The input provided to the input device 220 can prompt the HMD 250 to change modes or activity levels of the HMD 250.
In some examples, the input device 220 positioned on the HMD 250 can be used to determine one or more physical characteristics of the user wearing the HMD 250. For example, a user can place a finger onto the input device 220 to enable a physical or health determination of the user. In some examples, the HMD 250 is able to perform an electrocardiogram or other health measurement.
The input device 220 can be used to perform a variety of actions on the HMD 250. In some specific examples, rotation of the input device 220 can cause content displayed on the display 256 to zoom in or out depending on the direction of rotation. A finger swipe across the input device 220 can scroll displayed content up or down or can also be used to move among or between displayed pages. Input provided at the input device 220 can adjust a variety of setting on the HMD 250, such as volume, video speed/position, brightness, etc., as detailed further below with reference to
In some examples, the HMD 250 can be operably coupled with a controller for providing input to the HMD 250. The input device 220 can be used in conjunction with the controller, or in lieu of the controller. In some examples, a command corresponding to an input on the input device 220 changes based on an application or setting of the HMD 250. For instance, when the HMD 250 is in a first mode, an input performed on the input device 220 is interpreted as a first command, and when the HMD 250 is in a second mode, the input performed on the input device 220 is interpreted as a second, different command.
In some examples, the input device 220 protrudes or is proud of the housing 254 of the HMD. In other examples, the input device 220 is flush with the housing 254. In some examples, the input device 220 is operatively coupled to an optical or magnetic encoder used to measure rotation or translation of the dial or knob. Further details of an input device 220 are provided below with reference to
The crown 328 can include an outer region 329, at least partially surrounding an inner region 326. In some examples, the outer region 329 in the inner region 326 of the crown 328 is a unitary component. In some examples, the outer region 329 and the inner region 326 are electrically coupled. In some examples, the outer region 329 and the inner region 326 are not electrically coupled. For instance, the outer region 329 can include a non-conductive material.
The crown 328 can include a central region 322 that is at least partially surrounded by the inner region 326. In some examples, the central region 322 can be electrically isolated from the inner region 326. For example, an insulator 330 can be positioned between the central region 322 and the inner region 326. As shown in
The input surface 321 of the input device can be defined by portions of the outer region 329, the inner region 326, and/or the central region 322. The input surface 321 can at least partially define an external surface of an electronic device on which the input device 320 is housed. In other words, the input surface 321 can be accessible to a user. As shown, a user's finger 324 can touch the input surface 321 (i.e., provide capacitive input). The input surface 321 can define a touch-sensitive interface at least partially defining multiple electrical paths capable of transmitting signals through the input device 320. For example, a touch by a user on one or more of the electrical paths can be used to generate a predetermined signal corresponding to the received touch input. Further, a sequence of touches along predetermined electrical paths can correspond to certain touch-gesture inputs.
The input device 320 can include a stem 331 extending from the crown 328. In some examples, the outer region 329, the inner region 326, and the central region 322 can be mechanically or physically coupled to the stem 331. Specifically, the stem 331 can include an inner cylinder 334 and an outer cylinder 332 that is electrically isolated from the inner cylinder 334 using an insulator 336. The outer cylinder 332 can include a notch or protrusion that engages with the inner region 326 such that a downward force exerted upon the inner region 326 and/or the outer region 329 transfers to the outer cylinder 332, causing downward motion of the inner region 326 and the outer cylinder 332. The outer cylinder 332 can include components 338 that are electromechanically coupled with brushes 340. Thus, the inner region 326 and/or the outer region 329 can be in electrical communication with the outer cylinder 332 and the components 338 such that a capacitive touch by the user's finger 324 on the inner region 326 or the outer region 329 is transferred to the outer cylinder 332, then to the components 338, and ultimately to the brushes 340, establishing a first electrical path.
In some examples, the central region 322 can be electrically and mechanically coupled with the inner cylinder 334 of the stem 331. The mechanical connection between the central region 322 and the inner cylinder 334 allows a force exerted on the central region 322 to be transferred to the inner cylinder 334. The inner cylinder 332 can include signal contacts or components 342 that are electromagnetically coupled to brushes 344. Thus, a capacitive touch by a finger 324 on the central region 322 can be transferred to the inner cylinder 334, then to the components 342, and ultimately to the brushes 344, establishing a second electrical path. It will be understood that extrapolating the described configuration, more than two electrical paths are possible. The multiple electrical paths of the input device 320 can be used to mitigate false signals produced by water or moisture on the input surface. The distinct electrical paths can identify different capacitances between moisture, a finger, and a ground capacitance, and can accordingly disregard input determined to be produced by a moisture event.
In some examples, the bottom portion of the stem 331 is the point of contact between the input device 320 and the electronic device which carries the input device 320. The bottom of the stem 331 can be the only point of physical contact with the electronic device (i.e., the crown 328 does not, in some examples, contact the housing or any other portion of the electronic device).
The stem 331 can be made with a compliant or flexible material. In some examples, the stem 331 includes a spring. The stem 331 can include strain gauges to determine the movement of the stem 331. In some examples, the brushes 340, 344 can have springs to deflect or depress in response to a change in the angle of the stem 331 relative to the brushes 340, 344, as detailed below with reference to
In some examples, the input device 320 can include touch pixels, electrocardiogram (ECG) sensors, and other electrical inputs. In some examples, the input device 320 includes at least one of an optical encoder and a magnetic encoder. Signals can be detected using optical, conductive, magnetic, or mechanical encoders, individually or in any combination.
In some examples, the input device 320 can be translationally fixed. An attempted or intended translation of the input device 320 (e.g., push or press) can be determined using one or more sensors positioned on the input surface 321. For example, the capacitive sensors and/or force pressure sensors can be used to detect an intended translation of the input device 320. Further details of example features of the input device are provided below with reference to
In some examples, a swipe can be detected by registering a series of capacitive touches that occur in rapid succession among the first set of electrodes 430, the second set of electrodes 427, or the third set of electrodes 423. In a specific example, a swipe can be determined by detecting, in order, signals at the first electrical path 429, the second electrical path 426, the third electrical path 422, the second electrical path 426, and the first electrical path 429. Further, depending on which electrodes are activated, the direction, speed, and/or magnitude of the swipe can be determined (e.g., swipe up, down, left, right, diagonally, etc.). Further, non-linear gestures or swipes can be detected by the crown 428. For example, a circular gesture can be detected in response to detecting a succession of touches on the electrodes positioned in a circular configuration (e.g., a counter-clockwise circular gesture can be determined by detecting touches along the left, bottom, right, and top electrodes 430 within a predetermined amount of time). Alternatively, an array of electrodes can be positioned on the exterior of the crown, which when touched, can signal a desired rotation of the crown. A swiping motion as described above is illustrated in
In some examples, the crown 428 is rotationally fixed. An attempted or intended rotation of the crown 428 can be determined using one or more sensors positioned on the crown. For example, the outer perimeter or sidewall of the crown 428 can include conductive pads or electrodes that can be used detect an intended rotation of the crown 428. A determination that the user is attempting to rotate the crown 428 can be made upon detecting a first touch at a first location on the perimeter of the crown 428 and subsequently detecting a second touch at a second location on the crown 428. In some examples, the first touch and the second touch occurring within a predetermined amount of time results in a determination of intended rotation. In some examples, the first touch and the second touch occurring without the user removing their finger results in a determination of intended rotation.
Using the systems, methods, and processes discussed above, a vision system of a wearable device can have enhanced user interaction and can improve the user experience.
Physical environment: A physical environment refers to a physical world that people can sense and/or interact with without aid of electronic systems. Physical environments, such as a physical park, include physical articles, such as physical trees, physical buildings, and physical people. People can directly sense and/or interact with the physical environment, such as through sight, touch, hearing, taste, and smell.
Computer-generated reality: in contrast, a computer-generated reality (CGR) environment refers to a wholly or partially simulated environment that people sense and/or interact with via an electronic system. In CGR, a subset of a person's physical motions, or representations thereof, are tracked, and, in response, one or more characteristics of one or more virtual objects simulated in the CGR environment are adjusted in a manner that comports with at least one law of physics. For example, a CGR system may detect a person's head turning and, in response, adjust graphical content and an acoustic field presented to the person in a manner similar to how such views and sounds would change in a physical environment. In some situations (e.g., for accessibility reasons), adjustments to characteristic(s) of virtual object(s) in a CGR environment may be made in response to representations of physical motions (e.g., vocal commands). A person may sense and/or interact with a CGR object using any one of their senses, including sight, sound, touch, taste, and smell. For example, a person may sense and/or interact with audio objects that create 3D or spatial audio environment that provides the perception of point audio sources in 3D space. In another example, audio objects may enable audio transparency, which selectively incorporates ambient sounds from the physical environment with or without computer-generated audio. In some CGR environments, a person may sense and/or interact only with audio objects. Examples of CGR include virtual reality and mixed reality.
Virtual reality: A virtual reality (VR) environment refers to a simulated environment that is designed to be based entirely on computer-generated sensory inputs for one or more senses. A VR environment includes a plurality of virtual objects with which a person may sense and/or interact. For example, computer-generated imagery of trees, buildings, and avatars representing people are examples of virtual objects. A person may sense and/or interact with virtual objects in the VR environment through a simulation of the person's presence within the computer-generated environment, and/or through a simulation of a subset of the person's physical movements within the computer-generated environment.
Mixed reality: In contrast to a VR environment, which is designed to be based entirely on computer-generated sensory inputs, a mixed reality (MR) environment refers to a simulated environment that is designed to incorporate sensory inputs from the physical environment, or a representation thereof, in addition to including computer-generated sensory inputs (e.g., virtual objects). On a virtuality continuum, a mixed reality environment is anywhere between, but not including, a wholly physical environment at one end and virtual reality environment at the other end. In some MR environments, computer-generated sensory inputs may respond to changes in sensory inputs from the physical environment. Also, some electronic systems for presenting an MR environment may track location and/or orientation with respect to the physical environment to enable virtual objects to interact with real objects (that is, physical articles from the physical environment or representations thereof). For example, a system may account for movements so that a virtual tree appears stationery with respect to the physical ground. Examples of mixed realities include augmented reality and augmented virtuality. Augmented reality: an augmented reality (AR) environment refers to a simulated environment in which one or more virtual objects are superimposed over a physical environment, or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person may directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, so that a person, using the system, perceives the virtual objects superimposed over the physical environment. Alternatively, a system may have an opaque display and one or more imaging sensors that capture images or video of the physical environment, which are representations of the physical environment. The system composites the images or video with virtual objects, and presents the composition on the opaque display. A person, using the system, indirectly views the physical environment by way of the images or video of the physical environment, and perceives the virtual objects superimposed over the physical environment. As used herein, a video of the physical environment shown on an opaque display is called “pass-through video,” meaning a system uses one or more image sensor(s) to capture images of the physical environment, and uses those images in presenting the AR environment on the opaque display. Further alternatively, a system may have a projection system that projects virtual objects into the physical environment, for example, as a hologram or on a physical surface, so that a person, using the system, perceives the virtual objects superimposed over the physical environment. An augmented reality environment also refers to a simulated environment in which a representation of a physical environment is transformed by computer-generated sensory information. For example, in providing pass-through video, a system may transform one or more sensor images to impose a select perspective (e.g., viewpoint) different than the perspective captured by the imaging sensors. As another example, a representation of a physical environment may be transformed by graphically modifying (e.g., enlarging) portions thereof, such that the modified portion may be representative but not photorealistic versions of the originally captured images. As a further example, a representation of a physical environment may be transformed by graphically eliminating or obfuscating portions thereof. Augmented virtuality: an augmented virtuality (AV) environment refers to a simulated environment in which a virtual or computer generated environment incorporates one or more sensory inputs from the physical environment. The sensory inputs may be representations of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but people with faces photorealistically reproduced from images taken of physical people. As another example, a virtual object may adopt a shape or color of a physical article imaged by one or more imaging sensors. As a further example, a virtual object may adopt shadows consistent with the position of the sun in the physical environment.
Hardware: there are many different types of electronic systems that enable a person to sense and/or interact with various CGR environments. Examples include head mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields having integrated display capability, windows having integrated display capability, displays formed as lenses designed to be placed on a person's eyes (e.g., similar to contact lenses), headphones/earphones, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop/laptop computers. A head mounted system may have one or more speaker(s) and an integrated opaque display. Alternatively, a head mounted system may be configured to accept an external opaque display (e.g., a smartphone). The head mounted system may incorporate one or more imaging sensors to capture images or video of the physical environment, and/or one or more microphones to capture audio of the physical environment. Rather than an opaque display, a head mounted system may have a transparent or translucent display. The transparent or translucent display may have a medium through which light representative of images is directed to a person's eyes. The display may utilize digital light projection, OLEDs, LEDs, μLEDs, liquid crystal on silicon, laser scanning light sources, or any combination of these technologies. The medium may be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to become opaque selectively. Projection-based systems may employ retinal projection technology that projects graphical images onto a person's retina. Projection systems also may be configured to project virtual objects into the physical environment, for example, as a hologram or on a physical surface.
To the extent applicable to the present technology, gathering and use of data available from various sources can be used to improve the delivery to users of invitational content or any other content that may be of interest to them. The present disclosure contemplates that in some instances, this gathered data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data can include demographic data, location-based data, telephone numbers, email addresses, TWITTER® ID's, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other identifying or personal information.
The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to deliver targeted content that is of greater interest to the user. Accordingly, use of such personal information data enables users to calculated control of the delivered content. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.
The present disclosure contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure. Such policies should be easily accessible by users, and should be updated as the collection and/or use of data changes. Personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection/sharing should occur after receiving the informed consent of the users. Additionally, such entities should consider taking any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices. In addition, policies and practices should be adapted for the particular types of personal information data being collected and/or accessed and adapted to applicable laws and standards, including jurisdiction-specific considerations. For instance, in the US, collection of or access to certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly. Hence different privacy practices should be maintained for different personal data types in each country.
Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of advertisement delivery services, the present technology can be configured to allow users to select to “opt in” or “opt out” of participation in the collection of personal information data during registration for services or anytime thereafter. In another example, users can select not to provide mood-associated data for targeted content delivery services. In yet another example, users can select to limit the length of time mood-associated data is maintained or entirely prohibit the development of a baseline mood profile. In addition to providing “opt in” and “opt out” options, the present disclosure contemplates providing notifications relating to the access or use of personal information. For instance, a user may be notified upon downloading an app that their personal information data will be accessed and then reminded again just before personal information data is accessed by the app.
Moreover, it is the intent of the present disclosure that personal information data should be managed and handled in a way to minimize risks of unintentional or unauthorized access or use. Risk can be minimized by limiting the collection of data and deleting data once it is no longer needed. In addition, and when applicable, including in certain health related applications, data de-identification can be used to protect a user's privacy. De-identification may be facilitated, when appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of data stored (e.g., collecting location data a city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and/or other methods.
Therefore, although the present disclosure broadly covers use of personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing such personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data. For example, content can be selected and delivered to users by inferring preferences based on non-personal information data or a bare minimum amount of personal information, such as the content being requested by the device associated with a user, other non-personal information available to the content delivery services, or publicly available information.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the described embodiments. However, it will be apparent to one skilled in the art that the specific details are not required in order to practice the described embodiments. Thus, the foregoing descriptions of the specific embodiments described herein are presented for purposes of illustration and description. They are not target to be exhaustive or to limit the embodiments to the precise forms disclosed. It will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings.
This application claims the benefit of U.S. Provisional Patent Application No. 63/188,979, filed May 14, 2021, entitled “MULTI-INPUT FOR ROTATING AND TRANSLATING CROWN MODULES”, the disclosure of which is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
2288215 | Taubert | Jun 1942 | A |
3040514 | Dinstman | Jun 1962 | A |
4131033 | Wright | Dec 1978 | A |
5508978 | Kalbermatter | Apr 1996 | A |
5867082 | Van Zeeland | Feb 1999 | A |
8570273 | Smith | Oct 2013 | B1 |
8878657 | Periquet | Nov 2014 | B2 |
8922399 | Bajaj | Dec 2014 | B2 |
8941585 | Minamitani | Jan 2015 | B2 |
9009626 | Tsuk | Apr 2015 | B2 |
9028134 | Koshoji | May 2015 | B2 |
9105413 | Hiranuma | Aug 2015 | B2 |
9123483 | Ferri | Sep 2015 | B2 |
9244438 | Hoover | Jan 2016 | B2 |
9437357 | Furuki | Sep 2016 | B2 |
9632318 | Goto | Apr 2017 | B2 |
9800717 | Ma | Oct 2017 | B2 |
9946297 | Nazzaro | Apr 2018 | B2 |
10061399 | Bushnell | Aug 2018 | B2 |
10234828 | Ely | Mar 2019 | B2 |
10379629 | Bushnell et al. | Aug 2019 | B2 |
10599101 | Rothkopf | Mar 2020 | B2 |
10642467 | Merminod | May 2020 | B2 |
10964422 | Desnerck | Mar 2021 | B2 |
11162579 | Park | Nov 2021 | B2 |
11181863 | Ely | Nov 2021 | B2 |
11194298 | Roach | Dec 2021 | B2 |
11360440 | Perkins | Jun 2022 | B2 |
11387058 | Hwang | Jul 2022 | B2 |
11422692 | Kamath | Aug 2022 | B2 |
20010004337 | Paratte | Jun 2001 | A1 |
20040060807 | Nishimoto | Apr 2004 | A1 |
20050259077 | Adams | Nov 2005 | A1 |
20070279401 | Ramstein | Dec 2007 | A1 |
20080055241 | Goldenberg | Mar 2008 | A1 |
20080238879 | Jaeger | Oct 2008 | A1 |
20100271342 | Nagashima | Oct 2010 | A1 |
20110242064 | Ono | Oct 2011 | A1 |
20120055763 | Chou | Mar 2012 | A1 |
20120186951 | Wu | Jul 2012 | A1 |
20130220779 | Kerner | Aug 2013 | A1 |
20130342222 | Yokoyama | Dec 2013 | A1 |
20140062841 | Ishikawa | Mar 2014 | A1 |
20140204062 | Goto | Jul 2014 | A1 |
20150002465 | Tsukahara | Jan 2015 | A1 |
20150041289 | Ely | Feb 2015 | A1 |
20150185757 | Jantke | Jul 2015 | A1 |
20150341031 | Marquas | Nov 2015 | A1 |
20150350413 | Ma | Dec 2015 | A1 |
20160020045 | McAllister | Jan 2016 | A1 |
20160036966 | Ka | Feb 2016 | A1 |
20160041048 | Blum | Feb 2016 | A1 |
20160058375 | Rothkopf | Mar 2016 | A1 |
20160061636 | Gowreesunker | Mar 2016 | A1 |
20160098016 | Ely | Apr 2016 | A1 |
20160116306 | Ferri | Apr 2016 | A1 |
20160313703 | Ely | Oct 2016 | A1 |
20160320583 | Hall, Jr. | Nov 2016 | A1 |
20160327911 | Eim | Nov 2016 | A1 |
20160378187 | Moussette | Dec 2016 | A1 |
20170090572 | Holenarsipur | Mar 2017 | A1 |
20170090599 | Kuboyama | Mar 2017 | A1 |
20170104902 | Kim | Apr 2017 | A1 |
20170139489 | Chen | May 2017 | A1 |
20170269715 | Kim | Sep 2017 | A1 |
20180225701 | Han | Aug 2018 | A1 |
20190012003 | Grant | Jan 2019 | A1 |
20190391539 | Perkins | Dec 2019 | A1 |
20200064774 | Ely | Feb 2020 | A1 |
20200064779 | Pandya | Feb 2020 | A1 |
20200073339 | Roach | Mar 2020 | A1 |
20200122575 | Chion | Apr 2020 | A1 |
20200324613 | Dalia | Oct 2020 | A1 |
20210255590 | Ely | Aug 2021 | A1 |
Number | Date | Country | |
---|---|---|---|
63188979 | May 2021 | US |