The video game industry has become large and important, and has spawned many innovations in both software and related hardware. Various hand-held video game controllers have been designed, manufactured, and sold, for a variety of game applications. Some of those innovations have applicability outside of the video game industry, such as for controllers of industrial machines, defense systems, robotics, etc. Virtual reality (VR) systems are an application of great contemporary interest and rapid technical advancement, both within and outside of the video game industry. The controllers for VR systems have to perform several different functions, and meet strict (and sometimes competing) design constraints, often while optimizing certain desired characteristics like ease of use, etc. Hence, there is a need in the art for an improved controller design that may improve VR systems and/or better facilitate user operation.
In the embodiment of
The controller 100 preferably includes a tracking member 130 that is fixed to the controller body 110, and optionally includes two noses 132, 134, each protruding from a corresponding one of two opposing distal ends of the tracking member 130. In the embodiment of
The foregoing tracking transducers may be tracking sensors that are responsive to electromagnetic radiation (e.g. infrared light) emitted by the electronic system, or they may alternatively be tracking beacons that emit electromagnetic radiation (e.g. infrared light) that is received by the electronic system. For example, the electronic system may be a VR gaming system that widely broadcasts, i.e. paints, pulsed infrared light towards the controller 100, with the plurality of tracking transducers of the tracking member 130 being infrared light sensors that may receive or be shadowed from the broadcast pulsed infrared light. The tracking transducers in each nose 132, 134 (e.g. 3 sensors in each nose) preferably overhang the user's hand on each distal end of the tracking member 130, and so are better exposed (around the user's hand) to receive electromagnetic radiation emitted by the electronic system or to transmit the electromagnetic radiation to the electronic system, at more angles without an unacceptable amount of shadowing.
Preferably, the tracking member 130 and the controller body 110 are made of a substantially rigid material such as hard plastic, and are firmly fixed together so that they do not appreciably translate or rotate relative to each other. In this way, the tracking of the translation and rotation of the constellation of tracking transducers in space, is preferably not complicated by motion of the tracking transducers relative to each other. For example, as shown in
In certain embodiments, the tracking member 130 and the controller body 110 may comprise an integral monolithic component having material continuity, rather than being assembled together. For example, the tracking member 130 and the controller body 110 may be molded together by a single injection-molding process step, resulting in one integral hard plastic component that comprises both the tracking member 130 and the controller body 110. Alternatively, the tracking member 130 and the controller body 110 may be initially fabricated separately, and then later assembled together. Either way, the tracking member 130 may be considered as fixed to the controller body 110.
The hand retainer 120 is shown in the open position in
The hand retainer 120 optionally may be adjustable in length, for example by including a draw cord 126 that is cinched by a spring-biased chock 128. The draw cord 126 may optionally have an excess length that may be used as a lanyard. The sheath 124 optionally may be attached to the draw cord. In certain embodiments, the curved resilient member 122 may be preloaded by the tension of the cinched draw cord 126. In such embodiments, the tension that the curved resilient member 122 imparts to the hand retainer 120 (to bias it in the open position) causes the hand retainer to automatically open when the draw cord 126 is un-cinched. This disclosure also contemplates alternative conventional ways to adjust the length of a hand retainer 120, such as a cleat, an elastic band (that temporarily stretches when the hand is inserted, so that it applies elastic tension to press against the back of the hand), a hook & loop strap attachment that allows length adjustment, etc.
The hand retainer 120 may be disposed between the handle 112 and the tracking member 130, and be configured to contact the back of the user's hand.
The handle 112 of the controller body 110 preferably includes an array of proximity sensors that are spatially distributed partially or completely around its outer surface. The proximity sensors of the array are not necessarily of equal size and do not necessarily have equal spacing between them, although the array may comprise a grid. The array of proximity sensors is preferably responsive to the proximity of the user's fingers to the outside surface of the handle 112. For example, the array of proximity sensors may be a plurality of capacitive sensors embedded under the outer surface of the handle 112, with that outer surface comprising an electrically insulative material. The capacitance between such an array of capacitive sensors and a portion of the user's hand is inversely related to the distance there between. The capacitance may be sensed by connecting an RC oscillator circuit to an element of the capacitance sensor array, and noting that the time constant of the circuit (and therefore the period and frequency of oscillation) will vary with the capacitance. In this way, the circuit may detect a release of a user's fingers from the outer surface of the handle 112.
When the hand retainer 120 (e.g. a hand-retention strap) is closed tightly, it may serve not only to prevent the controller 100 from falling out of hand, but also to keep fingers from excessively translating relative to the proximity sensor array of the handle 112, to more reliably sense finger motion. The electronic system may include an algorithm embodying anatomically-possible motions of fingers, to better use the sensing from the proximity sensor array to render the opening of a controlled character's hand, finger pointing, or other motions of fingers relative to controller or relative to each other. In this way, the user's movement of the controller 100 and/or fingers may help control a VR gaming system, defense system, medical system, industrial robot or machine, or another device. In VR system applications (e.g. for gaming, training, etc.), the system may render a throwing motion based on the movement of the tracking transducers, and may render the release of a thrown object based on the sensed release of the user's fingers from the outer surface of the handle of the controller.
Hence, the function of the hand retainer 120 (to allow the user to “let go” of the controller 100 without the controller 100 actually separating from the hand or being thrown or dropped to the floor) may enable additional functionality of the controlled electronic system. For example, if the release and restoration of the user's grasp of the handle 112 of the controller body 110 is sensed, then such release or grasping may be incorporated into the game to display (e.g. in VR) throwing or grasping objects. The hand retainer 120 may allow such a function to be accomplished repeatedly and safely. For example, the location of the hand retainer 120 in the embodiment of
In certain embodiments, the controller 100 may include a rechargeable battery disposed within the controller body 110, and the hand retainer 120 (e.g. hand retention strap) may include an electrically-conductive charging wire that is electrically coupled to the rechargeable battery. The controller 100 preferably also includes a radio frequency (RF) transmitter for communication with the rest of the electronic system. Such RF transmitter may be powered by the rechargeable battery and may be responsive to the thumb-operated controls 114, 115, 116, the proximity sensors in the handle 112 of the controller body 110, and/or tracking sensors in the tracking member 130.
As shown in
In the embodiment of
In the embodiment of
One or more of the tracking transducers 632, 633, 634 optionally may be structured as shown in the embodiment of
According to the embodiment of
The upper portion of
Alternatively, one or more of the tracking transducers 632, 633, 634 optionally may be structured as shown in the embodiment of
The upper portion of
In the embodiment of
In the embodiment of
The tubular housing 612a, 612b of the handle need not have a circular cross-section, and that the word “circumference” is used herein whether or not the tubular housing 612a, 612b of the handle has a circular cross-section. Herein, the term “circumference” implies the complete perimeter about the tubular housing 612a, 612b of the handle, which may be circular if the tubular housing 612a, 612b is a right circular hollow cylinder, but which may be a closed shape other than a circle if the tubular housing is shaped as a non-circular cylinder or hollow prism.
In the embodiment of
In certain embodiments, the outer shell 640 has a shell thickness (measured radially in
The invention is described with reference to specific exemplary embodiments herein, but those skilled in the art will recognize that the invention is not limited to those. It is contemplated that various features and aspects of the invention may be used individually or jointly and possibly in a different environment or application. For example, features shown with regards to a right-hand controller may be implemented also in a left-hand controller, and vice versa. The specification and drawings are, accordingly, to be regarded as illustrative and exemplary rather than restrictive. For example, the word “preferably,” and the phrase “preferably but not necessarily,” are used synonymously herein to consistently include the meaning of “not necessarily” or optionally. “Comprising,” “including,” and “having,” are intended to be open-ended terms.
This application claims priority under 35 U.S.C. § 120 as a continuation-in-part to pending U.S. patent application Ser. No. 15/679,521 filed on 17 Aug. 2017, entitled “Electronic controller with hand retainer and finger motion sensing,” which itself claims priority as a continuation-in-part to U.S. patent application Ser. No. 29/580,635 filed 11 Oct. 2016, and claims priority to U.S. Provisional Patent Application 62/520,958 filed 16 Jun. 2017.
Number | Name | Date | Kind |
---|---|---|---|
5184120 | Schultz | Feb 1993 | A |
5302936 | Yaniger | Apr 1994 | A |
7932892 | Chen et al. | Apr 2011 | B2 |
8062126 | Marks et al. | Nov 2011 | B2 |
8636199 | Slayden | Jan 2014 | B1 |
8816964 | Edwards | Aug 2014 | B2 |
9690408 | Krah | Jun 2017 | B1 |
9696223 | Lisseman et al. | Jul 2017 | B2 |
10353506 | Vosgueritchian et al. | Jul 2019 | B2 |
10386224 | Shim et al. | Aug 2019 | B2 |
20020010020 | Johnson | Jan 2002 | A1 |
20020175894 | Grillo | Nov 2002 | A1 |
20040012557 | Daniel | Jan 2004 | A1 |
20050172734 | Alsio et al. | Aug 2005 | A1 |
20050179644 | Alsio et al. | Aug 2005 | A1 |
20050259069 | Baker et al. | Nov 2005 | A1 |
20060146018 | Arneson et al. | Jul 2006 | A1 |
20060293864 | Soss | Dec 2006 | A1 |
20070078316 | Hoarau et al. | Apr 2007 | A1 |
20070146349 | Errico et al. | Jun 2007 | A1 |
20070249422 | Podoloff | Oct 2007 | A1 |
20080136778 | Hursh | Jun 2008 | A1 |
20080146336 | Feldman et al. | Jun 2008 | A1 |
20080261693 | Zalewski | Oct 2008 | A1 |
20080311990 | Chiu et al. | Dec 2008 | A1 |
20090005166 | Sato | Jan 2009 | A1 |
20090256817 | Perlin et al. | Oct 2009 | A1 |
20090305786 | Chang | Dec 2009 | A1 |
20100245239 | Sternberg | Sep 2010 | A1 |
20110059796 | Kondo et al. | Mar 2011 | A1 |
20110080339 | Sun et al. | Apr 2011 | A1 |
20110084932 | Simmons et al. | Apr 2011 | A1 |
20110159959 | Mallinson et al. | Jun 2011 | A1 |
20120088580 | Takeda et al. | Apr 2012 | A1 |
20120143091 | Annett et al. | Jun 2012 | A1 |
20120214594 | Kirovski et al. | Aug 2012 | A1 |
20130027341 | Mastandrea | Jan 2013 | A1 |
20130063342 | Chen et al. | Mar 2013 | A1 |
20130096849 | Campbell et al. | Apr 2013 | A1 |
20140098018 | Kim | Apr 2014 | A1 |
20140240267 | Luo | Aug 2014 | A1 |
20150091858 | Rosenberg et al. | Apr 2015 | A1 |
20150120777 | Ramos | Apr 2015 | A1 |
20150352437 | Koseki et al. | Dec 2015 | A1 |
20160026253 | Bradski et al. | Jan 2016 | A1 |
20160030835 | Argiro | Feb 2016 | A1 |
20160085355 | Pirogov et al. | Mar 2016 | A1 |
20160124500 | Lee | May 2016 | A1 |
20160246369 | Osman | Aug 2016 | A1 |
20160259404 | Woods | Sep 2016 | A1 |
20160306932 | Fateh | Oct 2016 | A1 |
20160317267 | Meerbeek et al. | Nov 2016 | A1 |
20160342218 | Burba | Nov 2016 | A1 |
20160356658 | Hou et al. | Dec 2016 | A1 |
20160357261 | Bristol | Dec 2016 | A1 |
20170031503 | Rosenberg et al. | Feb 2017 | A1 |
20170139481 | Long | May 2017 | A1 |
20170205903 | Miller et al. | Jul 2017 | A1 |
20170351345 | Nirjon et al. | Dec 2017 | A1 |
20180025531 | Terahata | Jan 2018 | A1 |
20180067545 | Provancher et al. | Mar 2018 | A1 |
20180099219 | Hope et al. | Apr 2018 | A1 |
20180161670 | Boev | Jun 2018 | A1 |
20190076716 | Chiou et al. | Mar 2019 | A1 |
20190138107 | Nietfeld et al. | May 2019 | A1 |
20190232160 | Hope et al. | Aug 2019 | A1 |
Entry |
---|
Brown et al, “5 improvements we're excited to see from Valve's ‘Knuckles’ controllers”, retrieved on Jan. 20, 2019 at <<https://www.vrheads.com/5-Improvements-were-exclted-see-valves-knuckles-controllers>>, VR Heads, Jul. 11, 2017. |
Non Final Office Action dated Jan. 8, 2019 for U.S. Appl. No. 15/679,521 “Electronic Controller With Hand Retainer and Finger Motion Sensing” Mucha, 11 pages. |
PCT Search Report and Written Opinion dated Feb. 6, 2019 for PCT Application No. PCT/US2018/064116, 8 pages. |
PCT Search Report and Written Opinion dated Feb. 8, 2019 for PCT Application No. PCT/US2018/064120, 11 pages. |
Non Final Office Action dated Jul. 15, 2019 for U.S. Appl. No. 16/010,385 “Electronic Controller with Finger Motion Sensing” Nietfeld, 11 pages. |
Freescale Semiconductor, Inc. “Touch Sensors”, 2009, <<https://www.freescale.com/touch>>, 2 pages. |
Invitation to Pay Fees dated Aug. 6, 2019 for Application PCT/US2019/32982 “Sensor Fusion Algorithms for a Handheld Controller That Includes a Force Sensing Resistor (FSR)”, 2 pages. |
Non Final Office Action dated Jul. 23, 2019 for U.S. Appl. No. 15/984,245 “Sensor Fusion Algorithms for a Handheld Controller That Includes a Force Sensing Resistor (FSR)” Dalton, 18 pages. |
Non Final Office Action dated Sep. 18, 2019 for U.S. Appl. No. 16/289,420 “Sensor Fusion Algorithms for a Handheld Controller That Includes a Force Sensing Resistor (FSR)” Leinbaugh, 13 pages. |
Non Final Office Action dated Sep. 19, 2019 for U.S. Appl. No. 15/984,231 “Force Sensing Resistor (FSR) With Polyimide Substrate, Systems, and Methods Thereof” Campbell, 35 pages. |
PCT Search Report and Written Opinion dated Jul. 24, 2019 for PCT Application No. PCT/US19/32928, 4 pages. |
PCT Search Report and Written Opinion dated Aug. 15, 2019 for PCT Application No. PCT/US2019/032968, 12 pages. |
PCT Search Report and Written Opinion dated Sep. 10, 2019 for PCT Application No. PCT/US2019/037794, 10 pages. |
PCT Search Report and Written Opinion dated Sep. 17, 2019 for PCT Application No. PCT/US2019/037802, 7 pages. |
Number | Date | Country | |
---|---|---|---|
20180104576 A1 | Apr 2018 | US |
Number | Date | Country | |
---|---|---|---|
62520958 | Jun 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15679521 | Aug 2017 | US |
Child | 15834425 | US | |
Parent | 29580635 | Oct 2016 | US |
Child | 15679521 | US |