Handheld controller with trigger button and sensor retainer assembly

Abstract

Handheld controllers are disclosed herein. In one embodiment, the controller includes a main body and a sensor assembly at least partially disposed in the main body. The sensor assembly can include a control surface (e.g., a button) configured to receive at least a portion of a user's finger. A sensor portion can be disposed between the control surface and a rear member. The sensor portion can comprise a foam layer, a backing layer and a sensor layer between the foam layer and the backing layer. The foam layer can be compressed toward the control surface to minimize an air gap between the sensor layer and the control surface.

Description

TECHNICAL FIELD

This patent application is directed to handheld controllers and, more specifically, to virtual reality handheld controllers.

BACKGROUND

In a virtual reality system, a user wears a head-mounted display that presents a selected virtual reality (VR) environment in front of the user's eyes. In some VR systems, a user can manipulate items in the virtual environment with handheld controllers. The controllers can include, for example, tracking patterns comprised of a pattern of lights. The system monitors the movement of the tracking patterns with a tracking camera and reproduces the user's hand movements in the virtual environment. However, buttons traditionally used on game controllers, for example, do not typically detect detailed hand movements. Conventional button configurations cannot usually capture, for example, individual finger movements and gestures and/or opened or closed hand movements.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the methods and apparatus for detecting a user's hand presence or motion introduced herein may be better understood by referring to the following Detailed Description in conjunction with the accompanying drawings, in which like reference numerals indicate identical or functionally similar elements:

FIG. 1 is an isometric view of a pair of handheld controllers each configured to detect a user's hand presence or motion in accordance with embodiments of the disclosed technology.

FIG. 2 is an isometric view of a user's right hand grasping the right-hand controller of FIG. 1.

FIG. 3 is an isometric view of a portion of the right-hand controller shown in FIGS. 1 and 2.

FIG. 4A is a partially exploded schematic right side view of a control button with a sensor assembly configured in accordance with an embodiment of the disclosed technology.

FIG. 4B is a partially exploded left side view of the sensor assembly shown in FIG. 4A.

FIG. 4C is an enlarged view of a portion of FIG. 4A.

The headings provided herein are for convenience only and do not necessarily affect the scope or meaning of the claimed embodiments. Further, the drawings have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be expanded or reduced to help improve the understanding of the embodiments. Moreover, while the disclosed technology is amenable to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and are described in detail below. The intention, however, is not to limit the embodiments described. On the contrary, the embodiments are intended to cover all modifications, equivalents, and alternatives falling within the scope of the embodiments as defined by the appended claims.

DETAILED DESCRIPTION

Overview

Handheld controllers with trigger buttons connected to a sensor retaining assemblies are disclosed herein. In one embodiment, for example, a handheld controller includes a trigger button on the controller's handle. The trigger button includes a sensor stack positioned between the finger-engaging portion and the rear member. The sensor stack includes a sensor support layer sandwiched between a compressible layer and a backing layer. The trigger button is configured so that the finger engaging portion presses against the compressible layer so as to minimizing any gap between the sensor support layer and control member, thereby providing improved feel and responsiveness of the trigger button.

In one embodiment, a handheld controller includes a housing and a button at least partially disposed in the housing. The button includes a control member, a rear member and a sensor stack disposed between the control member and the rear member. The sensor stack comprises a first layer comprising a compressible material, a second layer including a sensor and a backing layer. The backing layer and the control member have substantially the same shape. The rear member engages the backing layer such that the first layer is compressed toward the control member, thereby minimizing a gap between the second layer and the control member.

In another embodiment, for example, a handheld controller includes a main body and a sensor assembly at least partially disposed in the main body. The sensor assembly includes a control surface (e.g., a button) configured to receive at least a portion of a user's finger. A sensor portion is disposed between the control surface and a rear member. The sensor portion comprises a foam layer, a backing layer and a sensor layer (e.g., a capacitive touch-sensitive layer) between the foam layer and the backing layer. The foam layer is compressed toward the control surface to minimize an air gap between the sensor layer and the control surface. In some aspects, the backing layer and the control surface have substantially the same shape.

General Description

Various examples of the devices introduced above will now be described in further detail. The following description provides specific details for a thorough understanding and enabling description of these examples. One skilled in the relevant art will understand, however, that the techniques discussed herein may be practiced without many of these details. Likewise, one skilled in the relevant art will also understand that the technology can include many other features not described in detail herein. Additionally, some well-known structures or functions may not be shown or described in detail below so as to avoid unnecessarily obscuring the relevant description.

The terminology used below is to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of some specific examples of the embodiments. Indeed, some terms may even be emphasized below; however, any terminology intended to be interpreted in any restricted manner will be overtly and specifically defined as such in this section.

FIG. 1 illustrates a pair of handheld controllers 100 according to a representative embodiment. The pair of handheld controllers 100 includes a right-hand controller 102 and a left-hand controller 104. The primary structure of the right-hand controller 102 and the left-hand controller 104 when held adjacent to each other in a similar orientation, as illustrated, are substantially symmetric with respect to each other. Both controllers 102/104 are described herein with respect to the right-hand controller 102, as both controllers include the same or similar features, albeit in mirror image. The right-hand controller 102 includes a main body 106 and a handle 108 extending from the main body 106. In some embodiments, a surrounding ring portion 110 extends from the main body 106. The controllers 102/104 can be part of a VR system 1. Each of the controllers 102/104 includes a plurality of tracking features positioned in a corresponding tracking pattern, such as the right-hand controller's tracking pattern 112. The tracking features in the tracking patterns are configured to be accurately tracked by a tracking camera 3 to determine the motion, orientation, and/or spatial position of the controller for reproduction in a virtual environment. The tracking features can include, for example, fiducial markers or light emitting diodes (LED).

The right-hand controller 102 further includes a sensor assembly 120 having a control member 122 (e.g., one or more buttons, knobs, switches) configured to receive touch input from a user's finger (e.g., a user's index finger). As described in further detail below with reference to FIGS. 3-4C, the sensor assembly 120 can be configured to detect the presence, movements and/or gestures of the user's finger(s) (e.g., a trigger-pull gesture). In the illustrated embodiment of FIG. 1, the control member 122 is shown as a trigger button and/or switch configured to at least partially retract toward the main body 106. In some embodiments, however, the control member 122 can comprise a stationary surface having a pressure sensitive sensor (e.g., a pressure-sensitive capacitive sensor).

As shown in FIG. 2, the handle portion 108 of the right-hand controller 102 is grasped by a user's right hand 5. When the controller 102 is grasped, the user's thumb 7 (i.e., the user's first finger) is positioned above the main body 106 and rests on a thumbstick 114. The user's second or index finger 9 is positioned on the control member 122. The user's third or middle finger 11 is positioned to contact a third finger button 118 on the handle portion 108. The controllers 102 and 104 are configured to detect a user's hand and/or finger gestures (e.g., a trigger-pull gesture, a thumbs-up gesture). As described in further detail below, the system 1 can be configured to detect a trigger-pull gesture when the user applies rearward pressure onto the control member 122 similar to the pulling of a gun trigger. The system 1 can be further configured to detect the presence of a user's finger on the control member 122 using, for example, one or more sensors (e.g., one or more capacitive touch sensors). The presence of a finger can include, for example, an indication that the user's finger is touching the sensor and/or hovering over the sensor within a selected distance (e.g., 1 cm or less).

Further explanation of finger and/or movement detection can be found, for example, in U.S. patent application Ser. No. 14/939,431, titled “HANDHELD CONTROLLER WITH THIRD FINGER GRIP DETECTION,” filed Nov. 12, 2015, and U.S. patent application Ser. No. 14/939,470, titled “METHOD AND APPARATUS FOR DETECTING HAND GESTURES WITH A HANDHELD CONTROLLER,” filed Nov. 12, 2015, and U.S. patent application Ser. No. 14/975,049, titled “HANDHELD CONTROLLER WITH ACTIVATION SENSORS,” filed Dec. 18, 2015, and U.S. patent application Ser. No. 15/172,099, titled “HANDHELD CONTROLLER WITH HAND DETECTION SENSORS.” The foregoing patent applications are hereby incorporated by reference in their entireties.

FIG. 3 is an isometric side view of the controller 102 of FIGS. 1 and 2 with certain features of the controller 102 hidden for clarity. In the illustrated embodiment of FIG. 3, the controller 102 is shown with the control member 122 removed to show a sensor portion 330 and a rear portion 350 of the sensor assembly 120. As explained in further detail below in reference to FIGS. 4A-4C, the sensor portion 330 can include one or more sensors configured to detect a gesture of the user's index finger 9 (FIG. 2) (e.g., a trigger-pull gesture) and/or to detect a presence or spatial movement of the user's index finger 9 on or proximate to the control member 122.

The control member 122 includes a control surface 324 configured to receive at least a portion of the user's index finger 9 (FIG. 2). In some embodiments, the control surface 324 has a substantially three-dimensionally curved shape. In other embodiments, however, the control surface 324 may be substantially flat. In further embodiments, the control surface 324 can have any suitable shape. Moreover, in some embodiments, the control surface 324 may include a recess and/or a raised portion that provides the user tactile confirmation that the user's index finger 9 is positioned on the control surface 324. One or more retention features 326 (e.g., one or more tabs, projections, protrusions) extends from a side surface portion 325 and are configured to at least partially retain the control member 122 within the main body 106 of the controller 102 while allowing the control member 122 to move rearward and forward in response to movements of the user's index finger 9 (e.g., a trigger-pull movement). One or more holes 328 are configured to receive a pin (not shown) in the controller 102 that is configured to pivotally couple the control member 122 thereto.

FIGS. 4A and 4B are partially exploded schematic right and left side views, respectively of the sensor assembly 120 shown with certain portions of the controller 102 hidden for clarity. FIG. 4C is an enlarged view of a portion of FIG. 4A. Referring to FIGS. 4A-4C together, the sensor assembly 120 has the sensor portion 330 between the rear portion 350 and the control member 122. The rear portion 350 includes a first surface 451 (FIG. 4A) facing toward the sensor portion 330, and an opposing second surface 452 (FIG. 4B) facing away from the sensor portion 330. A pair of arms 454 and 455 (FIG. 4B) extend rearwardly away from the second surface 452 and connect to a retention receptacle 456 configured to retain a magnet 460, such that the magnet moves with the sensor assembly 120 in response to a trigger pull or the like. In the illustrated embodiment, the rear side 427 of the control member 122 has rearwardly extending support members 426 that extend through a gap 438 in the sensor portion 330 and through an aperture 453 in the rear portion 350. The support members 426 define a shelf surface 431 positioned just below the retention receptacle 456 to help securely retain the magnet 460 in the retention receptacle 456. Accordingly, when the user presses against and moves the control member 122, such as during a trigger pull, the rear portion 350 and the associated magnet 460 move substantially simultaneously relative to the handle 108 (FIG. 3).

The top portion of the control member 122 securely snaps together with the rear portion 350 so as to firmly sandwich the sensor portion 330 therebetween. In the illustrated embodiment, the top portion of the control member 122 has a pair of grooves 423 (FIG. 4B) that receives corresponding projections 458 extending laterally from the top of the rear portion 350. The sides of the control member 122 also have notches or indents 429 (FIG. 4B) that receive corresponding attachment features 459 on corresponding sides of the rear portion 350. The attachment features 459 snap into the side indents 429, and the upper projections 458 snap into the grooves 423 via a friction fit, such that the rear portion 350 is securely fixed to the control member 122 and moveable together as a unit with the sensor portion 330 therebetween.

In the illustrated embodiment of FIGS. 4A-4C, the sensor portion 330 comprises a stack of layers including a first layer 432 facing toward the control member 122, a second layer 434 on the rear side of the first layer 432, and a third layer 436 on the rear side of the second layer 434 and facing toward the rear portion 350. In some embodiments, the first layer 432 comprises a compressible, conductive material, and the second layer 434 supports a sensor, such as a capacitive touch-sensor, pressure sensor, a proximity sensor, or other sensor, configured to detect the presence of a user's finger on or adjacent to the sensor assembly 120.

The first layer 432 may include, for example, a conductive foam material configured to be compressible to a suitably small thickness (e.g., less than 1 mm) to minimize air gaps between the control member 122 and the sensor on the second layer 434. In other embodiments, the first layer 432 comprises any suitable material having a dielectric constant different than air (e.g., a material having a dielectric constant greater than 1.0). The third layer 436 comprises a backing layer having substantially the same shape as the first and second layers 432 and 434. In some embodiments, the third layer 436 comprises a rigid material (e.g., a metal, a plastic) that provides structural integrity to the sensor portion 330 and provides a backing that can react compressive forces applied to the compressible first layer 432.

In operation, a compressive force between the rear portion 350 and the control member 122 urges the third layer 436 toward the control member 122, thereby compressing the first layer 432 toward the rear surface of the control member. This configuration keeps the sensor portion 330 in contact with the control member 122 and eliminates any dead space therebetween. Accordingly, any movement of the control member is immediately translated to the sensor portion 330 and the rear portion, which improves the detection of a user's index finger on the control member 122 by improving sensitivity and responsiveness of the touch-sensitive sensor comprising the second layer 434. The configuration with the compressible first layer 432 of the sensor portion 330 provides a smooth trigger feel for the sensor assembly 120 throughout the full travel or stroke during a trigger pull movement. The compressible first layer 432 of the sensor portion 330 also adds a biasing force to help return the sensor assembly 120 to an extended, released position, for example after a user releases the sensor assembly 120 after a trigger pull movement.

A flexible electrical link 442 (e.g., one or more wires, cables, circuits) electrically couples the sensor portion 330 to electronics 440 (e.g., electronic components on one or more printed circuit boards) in the controller's main body 106 and/or handle 108. In some embodiments, the electronics 440 can include one or more electronic components configured to electrically couple the controller 102 to the system 1. In some embodiments, the electronics 440 includes one or more electrical power sources (e.g., one or more batteries) configured to provide electrical power to the sensor portion 330 and other electronic components in and/or on the controller 102. A plurality of sensors 444 and 445 are also electrically coupled to the electronics 440 and can be configured to determine movement of the control member 122. In some embodiments, for example, the sensors 444 and 445 comprise one or more Hall effect sensors connected to a fixed mounting portion 446, which is connected to the flexible electrical links 441, such that the control member 122, the sensor portion 330, and rear portion 350 can move substantially as a unit relative to the mounting portion 446 and the sensors 444 and 445. Accordingly, the sensors 444 and 445 can be configured to detect movement of a magnet 460 indicative of the user's finger movement on the control assembly 120, such as a trigger-pull movement.

REMARKS

The techniques introduced here can be embodied as special-purpose hardware (e.g., circuitry), as programmable circuitry appropriately programmed with software and/or firmware, or as a combination of special-purpose and programmable circuitry. Hence, embodiments may include a machine-readable medium having stored thereon instructions which may be used to program a computer, a microprocessor, processor, and/or microcontroller (or other electronic devices) to perform a process. The machine-readable medium may include, but is not limited to, optical disks, compact disc read-only memories (CD-ROMs), magneto-optical disks, ROMs, random access memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing electronic instructions.

The above description and drawings are illustrative and are not to be construed as limiting. Numerous specific details are described to provide a thorough understanding of the disclosure. However, in some instances, well-known details are not described in order to avoid obscuring the description. Further, various modifications may be made without deviating from the scope of the embodiments. Accordingly, the embodiments are not limited except as by the appended claims.

Reference in this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Moreover, various features are described which may be exhibited by some embodiments and not by others. Similarly, various requirements are described which may be requirements for some embodiments but not for other embodiments.

The terms used in this specification generally have their ordinary meanings in the art, within the context of the disclosure, and in the specific context where each term is used. It will be appreciated that the same thing can be said in more than one way. Consequently, alternative languages and synonyms may be used for any one or more of the terms discussed herein, and any special significance is not to be placed upon whether or not a term is elaborated or discussed herein. Synonyms for some terms are provided. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification, including examples of any term discussed herein, is illustrative only and is not intended to further limit the scope and meaning of the disclosure or of any exemplified term. Likewise, the disclosure is not limited to various embodiments given in this specification. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. In the case of conflict, the present document, including definitions, will control.

Claims

1. A handheld controller, comprising: a housing; anda button at least partially disposed in the housing, wherein the button includes a control member, a rear member, and a sensor stack disposed between the control member and the rear member, wherein the control member, the rear member, and the sensor stack are movable as a unit relative to the housing, and wherein the sensor stack comprises— a first layer including a compressible material and facing toward a rear side of the control member;a second layer including a sensor, the second layer directly adjacent a rear side of the first layer; anda third layer directly adjacent a rear side of the second layer, wherein at least portions of the first layer, the second layer, the third layer, and the control member have substantially the same contoured shape, and wherein the rear member engages the third layer such that the first layer is compressed toward the control member by way of the rear member being fixed to the control member via a friction fit, thereby minimizing a gap between the second layer and the control member.

2. The handheld controller of claim 1 wherein the compressible material comprises a conductive foam.

3. The handheld controller of claim 1 wherein the first layer is configured to have a compressed thickness less than 1 mm.

4. The handheld controller of claim 1 wherein the compressible material has a dielectric constant different than the dielectric constant of air.

5. The handheld controller of claim 1 wherein the sensor is a touch-sensitive sensor.

6. The handheld controller of claim 1 wherein the sensor is a capacitive sensor.

7. The handheld controller of claim 1 wherein the sensor is a first sensor, and further comprising a second sensor configured to detect movement of the button relative to the housing.

8. The handheld controller of claim 7 wherein the second sensor comprises a Hall effect sensor configured to detect movement of a magnet coupled to the rear member.

9. A handheld controller, comprising: a main body; anda sensor assembly at least partially disposed in the main body, wherein the sensor assembly includes a control member, a rear member, and a sensor portion disposed between the control member and the rear member, wherein the control member, the rear member, and the sensor portion are movable as a unit relative to the main body, and wherein the sensor portion comprises a foam layer facing toward a rear side of the control member, a backing layer, and a sensor layer between and directly adjacent to the foam layer and the backing layer, and wherein the foam layer is compressed toward the rear side of the control member to minimize an air gap between the sensor layer and the control member by way of the rear member being fixed to the control member via a friction fit.

10. The handheld controller of claim 9 wherein at least portions of the backing layer, the sensor layer, the foam layer, and the control member have substantially the same shape.

11. The handheld controller of claim 9 wherein the sensor layer comprises a capacitive touch-sensitive layer.

12. The handheld controller of claim 9 wherein the foam layer has a compressed thickness less than 1 mm.

13. The handheld controller of claim 9, further comprising a second sensor configured to detect movement of the control member relative to the main body.

14. The handheld controller of claim 13 wherein the second sensor comprises a Hall effect sensor configured to detect movement of a magnet disposed on a support structure extending from the control member through the sensor portion toward the rear member.

15. The handheld controller of claim 13, further comprising electronics in the main body configured to communicatively couple the sensor layer to a virtual reality system.

16. A handheld controller, comprising: a main body;a handle extending from the main body;a trigger button connected to the handle and positioned for engagement by a finger of a user, the trigger button comprising a control member, a rear member, and a sensor stack between the control member and the rear member and immediately adjacent to the control member, wherein the control member, the rear member, and the sensor stack are movable as a unit relative to the handle, and wherein the sensor stack comprises— a first layer including a compressible material and facing toward a rear side of the control member;a second layer including a sensor, the second layer directly adjacent a rear side of the first layer; anda third layer directly adjacent a rear side of the second layer, wherein at least portions of the first layer, the second layer, the third layer, and the control member have substantially the same shape, and wherein the rear member engages the third layer such that the first layer is compressed toward the control member by way of the rear member being fixed to the control member via a friction fit, thereby minimizing a gap between the second layer and the control member.

17. The handheld controller of claim 16 wherein the compressible material comprises a conductive foam.

18. The handheld controller of claim 16 wherein the compressible material has a dielectric constant different than the dielectric constant of air.

19. The handheld controller of claim 16 wherein the sensor is a capacitive sensor.

20. The handheld controller of claim 16 wherein the sensor is a first sensor, and further comprising a second sensor connected to the sensor stack and configured to detect movement of the trigger button relative to the handle.