The subject matter is related to an apparatus and methods for providing haptic feedback in a handheld game controller.
A game controller is a device used to provide input to a video game, for example to control an object or character in the video game. The video game may be running on a computer, a specially designed gaming system, or a mobile device.
In today's electronic gaming entertainment, haptic engines for game controllers are widely used to increase feelings immersion within the video game. When a user-controlled video-game character opens a virtual door in game, this action can be assigned through hooks in the game software to actuate haptic feedback within the gaming device. The tactile sensation in the game player's fingertip is interpreted by the game player's brain to associate it with, in this example, the heft of the door opening. This helps to promote immersion of the game player into the game.
Conventional haptic engines for game controllers are generally of two types: eccentric rotating mass (ERM) and linear resonant actuator (LRA). The ERM-type of haptic engine includes a mass attached to a motor shaft, where the mass is not evenly distributed around the shaft. Thus, when the motor shaft rotates the mass, it causes the device to which the ERM haptic engine is attached to shake. The LRA-type of haptic engine creates vibration by moving a mass in a reciprocal manner by means of a voice-coil drive pushing the mass against a spring. The spring tends to resist the motion of the mass and push the mass back toward its starting point.
Configurations of the disclosed technology address shortcomings in the prior art.
As described herein, aspects are directed to an apparatus and method for providing haptic feedback in a handheld game controller. In configurations, a handheld game controller includes a haptic actuator as part of the assembly for a touch-input hardware interface. The touch-input hardware interface may be, for example, a bumper or trigger, and other examples are noted below. The haptic actuator includes a piezoelectric actuator that provides haptic feedback to the user through the touch-input hardware interface (e.g., the bumper or trigger). Additionally, configurations include capacitive touch sensor to engage and disengage the piezoelectric actuator in response to the user's touch. Also, in configurations having more than one piezoelectric actuator on a given touch-input hardware interface (e.g., a bumper or trigger), the separate piezoelectric actuators may be engaged simultaneously or at separate times (and perhaps in a certain sequence) to provide different types of haptic feedback to the user's finger. In addition to the benefits just noted, configurations of the disclosed technology help to differentiate haptics coming from a haptic engine in the mobile device from the haptics generated from within the game controller. This is accomplished by, for example, focusing the haptic feedback on a particular part of the game controller, such as a particular bumper or trigger.
As illustrated in
As illustrated in
As illustrated, the first handle 101 includes a user-accessible, first hardware interface 103 on the main body portion 105 of the first handle 101. The first hardware interface 103 could be a button, a bumper, a trigger, an analog stick, a touchscreen, a touchpad, a knob, a slider, a switch, a wheel, a dial, a directional pad, or another such feature configured to accept touch inputs from a user's finger or a stylus. As shown in
As best illustrated in
Referring to
As illustrated, the second handle 102 further includes a user-accessible, second hardware interface 104 on the main body portion 106 of the second handle 102. As above for the first hardware interface 103 of the first handle 101, the second hardware interface 104 could be a button, a bumper, a trigger, an analog stick, a touchscreen, a touchpad, a knob, a slider, a switch, a wheel, a dial, a directional pad, or another such feature configured to accept touch inputs from a user's finger or a stylus. The second hardware interface 104 may include multiple such hardware interfaces, as illustrated in
As best illustrated in
One or both of the first handle 101 and the second handle 102 may include a connector 125 for physical and electrical connection to the mobile device 199. The connector 125 may be, for example, a USB-C connector.
It is noted that each of
Hence, as illustrated the bridge 119 is in sliding engagement with the first handle 101. In the illustrated configuration, the bridge 119 is not telescoping, meaning that segments of the bridge 119 do not slide within another segment of the bridge 119 to allow for lengthening or shortening of the bridge 119. The bridge 119 has a span 120 extending away from the main body portion 105 of the first handle 101, and the span 120 has a transverse midline 121.
The bridge 119 and the first handle 101 are configured to allow the main body portion 105 of the first handle 101 to translate in a retraction direction 122 toward the midline 121 of the bridge 119 and into a retracted configuration, an example of which is illustrated in
As used in this disclosure, the transverse midline 121 of the bridge 119 is a reference datum used to define the extension direction 123 and the retraction direction 122. That is, the retraction direction 122 is toward the transverse midline 121, while the retraction direction 122 is away from the transverse midline 121. Accordingly, the transverse midline 121 of the bridge 119 may or may not coincide with a physical structure on the game controller 100.
Likewise, the bridge 119, as illustrated, is in sliding engagement with the second handle 102, and the span 120 of the bridge 119 extends away from the main body portion 106 of the second handle 102. The bridge 119 and the second handle 102 are configured to allow the main body portion 106 of the second handle 102 to translate in the retraction direction 122 toward the midline 121 of the bridge 119 and into the retracted configuration. The bridge 119 and the second handle 102 are configured to allow the main body portion 106 of the second handle 102 to also translate in the extension direction 123 away from the midline 121 of the bridge 119 into the extended configuration.
In configurations, the bridge 119 is configured such that the first handle 101 and the second handle 102 are equidistant from the midline 121 of the bridge 119 in the retracted configuration and in the extended configuration. In configurations, the bridge 119 is configured such that the first handle 101 and the second handle 102 are equidistant from the midline 121 of the bridge 119 when the first handle 101 and the second handle 102 are translating from the retracted configuration to the extended configuration. In configurations, the bridge 119 is configured such that the first handle 101 and the second handle 102 are equidistant from the midline 121 of the bridge 119 when the first handle 101 and the second handle 102 are translating from the extended configuration to the retracted configuration.
As illustrated in
The touch-input hardware interface is configured to accept touch inputs from a user. In configurations, the touch-input hardware interface may be, for example, a button, a bumper, a trigger, an analog stick, a knob, a slider, a switch, a wheel, a dial, or a directional pad. In the illustrated configuration, the touch-input hardware interface is a bumper or trigger that the user might depress, typically with the user's index finger or middle finger.
As illustrated, the haptic actuator 109 includes a first plate 111, a second plate 112, and a piezoelectric actuator 117. While the illustrated configuration shows two plates, the first plate 111 and the second plate 112, some configurations have just one plate and some configurations have more than two plates. As illustrated, the first plate 111, the second plate 112, and the piezoelectric actuator 117 are in layers, with the piezoelectric actuator 117 being between the first plate 111 and the second plate 112.
The piezoelectric actuator 117, or piezoelectric transducer, is configured to receive an electrical signal, convert the electrical signal to mechanical motion, translate the mechanical motion to the first plate 111 and the second plate 112, and cause the first plate 111 and the second plate 112 to vibrate. The electrical signal to the piezoelectric actuator 117 may come from, as examples, a processor within the game controller 100 or a processor within the mobile device 199. The processor within the game controller 100 may be, for example, part of a printed circuit board within the second handle 102. Vibration of the plates, in turn, causes the second touch-input hardware interface 130 to vibrate. Accordingly, the haptic actuator 109 causes haptic vibration without the use of an eccentric rotating mass (ERM) or a linear resonant actuator (LRA). ERM- and LRA-type haptic actuators 109 are too bulky for the application described here and would not allow the second touch-input assembly 108 (which includes the haptic actuator 109) to translate as a unit relative to the second handle or to focus the haptic feedback sensation (i.e. the vibrations) to a specific portion of the game controller 100, such as to the second touch-input assembly 108. In addition, ERM- and LRA-type haptic actuators 109 require more electrical power than the technologies discussed in this disclosure. Thus, the described technologies require less battery power, resulting in longer battery life, less frequent recharging of the battery, and less need to be tethered by a cord to an electrical outlet to provide power to depleted batteries.
In some example configurations, the layers of the haptic actuator 109 include a capacitive touch sensor 128, such as a capacitive touch film. The capacitive touch sensor 128 is configured to detect presence of a finger of the user on the second touch-input hardware interface 130. Such capacitive touch sensors 128 typically have a grid of electrodes that complete an electrical circuit in response to a user's touch. Accordingly, in configurations the haptic actuator 109 is “off” unless the capacitive touch sensor 128 detects a user's finger on the second touch-input hardware interface 130. If a user's finger is detected, then the haptic actuator 109 is “on” and will cause the plate(s) to vibrate in response to an electrical signal as described above. In such configurations, battery power may be conserved by not activating the haptic feedback when the user's finger is not in place on the corresponding touch-input hardware interface. As illustrated in
In configurations, the layers of the haptic actuator 109 include a flexible, printed circuit board 110. In configurations, the flexible circuit board 110 is connected via a flexible cable to the main circuit board of the game controller 100. As noted above, that main printed circuit board may be within the second handle 102, or it may be elsewhere within the game controller 100.
As illustrated in
As illustrated, a track slot 134 is rigidly coupled to the housing 133, and the second touch-input hardware interface 130 includes a pivot rod 124. The pivot rod 124 is configured to engage the track slot 134 of the second handle 102. The pivot rod 124 is configured to rotate within the track slot 134 and to translate within the track slot 134. Accordingly, the pivot rod 124 and track slot 134 provide a dual-action coupling between the second touch-input assembly 108 and the housing 133 of the second handle 102, the two actions being rotation and translation. The spring 118 is configured to bias the second touch-input hardware interface 130 into the upward, or undepressed, position, an example of which is shown in
As noted above,
As best illustrated in
In configurations, a single touch-input hardware interface may include more than one haptic actuator 109. The haptic actuators 109 may be spaced apart to provide haptic feedback (i.e. vibrations) to different parts of the input surface. While
Although described with respect to the illustrated bumper, it is recognized that the disclosed haptics technology could be applied to other types of user-accessible, touch-input hardware interfaces such as, for example, a button, an analog stick, a touchscreen, a touchpad, a knob, a slider, a switch, a wheel, a dial, a directional pad, and a trigger.
In use, the user holds the game controller in the customary way. That typically means holding each handle with the user's thumbs available to activate the hardware interfaces 103, 104 (e.g., buttons, joysticks, etc.) on the front side of the handles 101, 102. The user's index or middle finger is typically available to activate the touch-input hardware interfaces 129, 130 (e.g. the bumpers, triggers, etc.) at the top edge 131 of the handle 101, 102. With the user's finger(s) resting on the touch-input hardware interface(s), in configurations having the capacitive touch sensor 128, the capacitive touch sensor 128 would detect the presence of the user's finger and send a signal, either directly to the corresponding haptic actuator 109 or to another processor, to turn the haptic actuator 109 “on” so that it will vibrate in response to a received electrical signal indicative of when haptic feedback should occur during gameplay. As noted, each touch-input hardware interface may have more than one haptic actuator 109. In such configurations, the haptic actuators 109 can be controlled separately to provide haptic feedback to the user that is more complex and immersive than (a) the haptics provided by the mobile device itself, (b) a single haptic engine rigidly coupled to the housing of the game controller, or (c) a single haptic actuator 109 for the particular touch-input hardware interface.
Illustrative examples of the disclosed technologies are provided below. A particular configuration of the technologies may include one or more, and any combination of, the examples described below.
Example 1 includes a handheld game controller comprising: a handle; and a bumper assembly on the handle, the bumper assembly comprising: a bumper configured to accept touch inputs from a user, and a haptic actuator comprising at least one plate and a piezoelectric actuator configured to receive an electrical signal, convert the electrical signal to mechanical motion, translate the mechanical motion to the at least one plate, and cause the at least one plate and the bumper to vibrate.
Example 2 includes the handheld game controller of Example 1, in which the bumper assembly is configured to translate as a unit relative to the handle.
Example 3 includes the handheld game controller of any of Examples 1-2, in which the handle further comprises a housing from which the bumper projects, and in which the bumper assembly is not rigidly coupled to the housing.
Example 4 includes the handheld game controller of Example 3, in which the bumper assembly is connected to the housing through at least one spring and at least one pivot.
Example 5 includes the handheld game controller of any of Examples 1-4, in which the bumper has a contact surface area of an outward surface of the bumper, the outward surface of the bumper being configured to receive touch inputs from the user, the haptic actuator having a planform area, the planform area of the haptic actuator being less than the contact surface area of the outward surface of the bumper.
Example 6 includes the handheld game controller of any of Examples 1-5, in which the haptic actuator further includes a capacitive touch sensor configured to detect presence of a finger of the user on the bumper.
Example 7 includes the handheld game controller of any of Examples 1-6, in which the haptic actuator does not include an eccentric rotating mass or a linear resonant actuator to cause vibration.
Example 8 includes the handheld game controller of any of Examples 1-7, in which the haptic actuator comprises layers, the layers including a first plate; a second plate; and the piezoelectric actuator; the piezoelectric actuator being between the first plate and the second plate, the piezoelectric actuator configured to receive the electrical signal and mechanically vibrate the first plate and the second plate in response to the electrical signal.
Example 9 includes the handheld game controller of Example 8, the layers of the haptic actuator further including a capacitive touch sensor configured to detect presence of a finger of the user on the bumper.
Example 10 includes the handheld game controller of any of Examples 1-9, in which the haptic actuator is in direct, physical contact with the bumper.
Example 11 includes the handheld game controller of any of Examples 1-10, in which the haptic actuator is embedded in the bumper.
Example 12 includes the handheld game controller of any of Examples 1-11, in which the handle is a first handle, the handheld game controller further comprising: a second handle; a bridge connecting the first handle and the second handle; a second bumper assembly on the second handle, the second bumper assembly comprising: a second bumper configured to accept touch inputs from the user, and a second haptic actuator comprising at least one plate and a piezoelectric actuator configured to receive an electrical signal, convert the electrical signal to mechanical motion, translate the mechanical motion to the at least one plate of the second haptic actuator, and cause the at least one plate of the second haptic actuator and the second bumper to vibrate.
Example 13 includes the handheld game controller of Example 12, in which the bridge is in sliding engagement with the first handle and the second handle, the bridge having a span extending away from the first handle, the span having a transverse midline, the midline of the bridge being between the first handle and the second handle, the bridge and the first handle being configured for the first handle to translate in a retraction direction toward the midline of the bridge and into a retracted configuration and also to translate in an extension direction away from the midline of the bridge into an extended configuration, the bridge and the second handle being configured for the second handle to translate along the bridge in the retraction direction toward the midline of the bridge and into the retracted configuration and also to translate in the extension direction away from the midline of the bridge and into the extended configuration.
Example 14 includes the handheld game controller of any of Examples 1-13, further comprising a mobile device contacted and supported by the first handle and the second handle.
Example 15 includes the handheld game controller of any of Examples 1-14, in which the haptic actuator is a plurality of haptic actuators, each haptic actuator of the plurality of haptic actuators comprising at least one plate and a piezoelectric actuator configured to receive an electrical signal, convert the electrical signal to mechanical motion, translate the mechanical motion to the at least one plate, and cause the at least one plate and the bumper to vibrate, each haptic actuator of the plurality of haptic actuators being separably controllable to turn off and on independently of another haptic actuator of the plurality of haptic actuators.
Example 16 includes a handheld game controller comprising: a handle; and a touch-input assembly on the handle, the touch-input assembly comprising: a touch-input hardware interface configured to accept touch inputs from a user, and a haptic actuator comprising at least one plate and a piezoelectric actuator configured to receive an electrical signal, convert the electrical signal to mechanical motion, translate the mechanical motion to the at least one plate, and cause the at least one plate to vibrate.
Example 17 includes the handheld game controller of Example 16, in which the touch-input assembly is configured to translate as a unit relative to the handle.
Example 18 includes the handheld game controller of any of Examples 16-17, in which the handle further comprises a housing from which the touch-input hardware interface projects, and in which the touch-input assembly is not rigidly coupled to the housing.
Example 19 includes the handheld game controller of any of Examples 16-18, in which the haptic actuator does not include an eccentric rotating mass or a linear resonant actuator to cause vibration.
Example 20 includes the handheld game controller of any of Examples 16-19, in which the haptic actuator comprises layers, the layers including: a first plate; a second plate; and a piezoelectric transducer between the first plate and the second plate, the piezoelectric transducer configured to receive an electrical signal and mechanically vibrate the first plate and the second plate in response to the electrical signal.
Example 21 includes the handheld game controller of Example 20, the layers of the haptic actuator further including a capacitive touch sensor configured to detect presence of a finger of the user on the touch-input hardware interface.
Example 22 includes the handheld game controller of any of Examples 16-21, in which the touch-input hardware interface is selected from the group consisting of a button, an analog stick, a knob, a slider, a switch, a wheel, a dial, a directional pad, and a trigger.
Aspects may operate on a particularly created hardware, on firmware, digital signal processors, or on a specially programmed general purpose computer including a processor operating according to programmed instructions. The terms “controller” or “processor” as used herein are intended to include microprocessors, microcomputers, ASICs, and dedicated hardware controllers. One or more aspects may be embodied in computer-usable data and computer-executable instructions, such as in one or more program modules, executed by one or more computers (including monitoring modules), or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types when executed by a processor in a computer or other device. The computer executable instructions may be stored on a non-transitory computer readable medium such as a hard disk, optical disk, removable storage media, solid state memory, RAM, etc. As will be appreciated by one of skill in the art, the functionality of the program modules may be combined or distributed as desired in various configurations. In addition, the functionality may be embodied in whole or in part in firmware or hardware equivalents such as integrated circuits, field programmable gate arrays (FPGA), and the like. Particular data structures may be used to more effectively implement one or more aspects of the disclosed systems and methods, and such data structures are contemplated within the scope of computer executable instructions and computer-usable data described herein.
The previously described versions of the disclosed subject matter have many advantages that were either described or would be apparent to a person of ordinary skill. Even so, all of these advantages or features are not required in all versions of the disclosed apparatus, systems, or methods.
Additionally, this written description makes reference to particular features. It is to be understood that the disclosure in this specification includes all possible combinations of those particular features. For example, where a particular feature is disclosed in the context of a particular example configuration, that feature can also be used, to the extent possible, in the context of other example configurations.
Also, when reference is made in this application to a method having two or more defined steps or operations, the defined steps or operations can be carried out in any order or simultaneously, unless the context excludes those possibilities.
Furthermore, the term “comprises” and its grammatical equivalents are used in this application to mean that other components, features, steps, processes, operations, etc. are optionally present. For example, an article “comprising” or “which comprises” components A, B, and C can contain only components A, B, and C, or it can contain components A, B, and C along with one or more other components.
Also, directions such as “vertical,” “horizontal,” “right,” and “left” are used for convenience and in reference to the views provided in figures. But the game controller may have a number of orientations in actual use. Thus, a feature that is vertical, horizontal, to the right, or to the left in the figures may not have that same orientation or direction in actual use.
Although specific example configurations have been described for purposes of illustration, it will be understood that various modifications may be made without departing from the spirit and scope of the disclosure.
This patent application is a continuation-in-part of application Ser. No. 17/504,299 filed Oct. 18, 2021, which is a continuation-in-part of application Ser. No. 16/808,339 filed Mar. 3, 2020, now U.S. Pat. No. 11,389,721, application Ser. Nos. 16/808,339 and 17/504,299 are each incorporated into the present disclosure by this reference.
Number | Name | Date | Kind |
---|---|---|---|
4636593 | Novak | Jan 1987 | A |
6238289 | Sobota | May 2001 | B1 |
6640268 | Kumar | Oct 2003 | B1 |
6684062 | Gosior | Jan 2004 | B1 |
6761462 | Yoshida | Jul 2004 | B2 |
6965368 | Andrews et al. | Nov 2005 | B1 |
7477239 | Ray | Jan 2009 | B2 |
7580728 | Vance et al. | Aug 2009 | B2 |
7905627 | Chiang | Mar 2011 | B2 |
8462810 | Spinar | Jun 2013 | B2 |
8760394 | Chiang | Jun 2014 | B2 |
8822851 | Walker | Sep 2014 | B2 |
9053243 | Townsend | Jun 2015 | B2 |
9677740 | Steiner | Jun 2017 | B2 |
10025644 | Iwaya et al. | Jul 2018 | B2 |
10258876 | Wells et al. | Apr 2019 | B2 |
10259384 | Teng | Apr 2019 | B2 |
10300386 | Leung et al. | May 2019 | B1 |
10483969 | Kontani | Nov 2019 | B2 |
10599233 | Amalou | Mar 2020 | B1 |
10725557 | Kontani | Jul 2020 | B2 |
10741215 | Sundareson | Aug 2020 | B1 |
10868436 | Chen et al. | Dec 2020 | B1 |
11000759 | Palmer et al. | May 2021 | B2 |
11090557 | Downs et al. | Aug 2021 | B2 |
11105969 | Sasagawa | Aug 2021 | B2 |
11389721 | Khaira et al. | Jul 2022 | B2 |
11662855 | Sorensen et al. | May 2023 | B1 |
11707670 | Khaira et al. | Jul 2023 | B2 |
11826642 | Khaira et al. | Nov 2023 | B2 |
11839810 | Khaira et al. | Dec 2023 | B2 |
11853505 | Sorensen et al. | Dec 2023 | B1 |
20020173354 | Winans | Nov 2002 | A1 |
20050017953 | Pekka | Jan 2005 | A1 |
20050172045 | Bermudez et al. | Aug 2005 | A1 |
20050243585 | Marchant | Nov 2005 | A1 |
20050247550 | Hamada | Nov 2005 | A1 |
20060132458 | Garfio | Jun 2006 | A1 |
20060234794 | Baseflug et al. | Oct 2006 | A1 |
20060236002 | Valenci | Oct 2006 | A1 |
20070152965 | Krzyzanowski | Jul 2007 | A1 |
20070155511 | Grundstedt | Jul 2007 | A1 |
20070236959 | Tolbert | Oct 2007 | A1 |
20080202907 | Kyowski | Aug 2008 | A1 |
20080294453 | Baird-Smith | Nov 2008 | A1 |
20090065337 | Chiang | Mar 2009 | A1 |
20090077277 | Vidal | Mar 2009 | A1 |
20090219734 | Sawada | Sep 2009 | A1 |
20090284397 | Lee | Nov 2009 | A1 |
20100067424 | Sun | Mar 2010 | A1 |
20100115050 | Sultenfuss | May 2010 | A1 |
20100137033 | Lee | Jun 2010 | A1 |
20100271839 | Chan | Oct 2010 | A1 |
20110014984 | Penman | Jan 2011 | A1 |
20110084904 | Tan | Apr 2011 | A1 |
20120145522 | Lee | Jun 2012 | A1 |
20120200475 | Baker | Aug 2012 | A1 |
20120225258 | Hill | Sep 2012 | A1 |
20130033829 | Furubo et al. | Feb 2013 | A1 |
20130077346 | Chen | Mar 2013 | A1 |
20130191625 | Mullens et al. | Jul 2013 | A1 |
20130225288 | Levin et al. | Aug 2013 | A1 |
20130237322 | Sobel | Sep 2013 | A1 |
20140018173 | Urhman | Jan 2014 | A1 |
20140024392 | Su | Jan 2014 | A1 |
20140125619 | Panther et al. | May 2014 | A1 |
20140161417 | Kurupacheril | Jun 2014 | A1 |
20140184508 | Tamasi et al. | Jul 2014 | A1 |
20140274394 | Willis | Sep 2014 | A1 |
20140304494 | Hawver | Oct 2014 | A1 |
20140317329 | Barnett et al. | Oct 2014 | A1 |
20140375545 | Ackerman et al. | Dec 2014 | A1 |
20150018101 | Schoenith et al. | Jan 2015 | A1 |
20150031452 | Rundell | Jan 2015 | A1 |
20150128042 | Churchill et al. | May 2015 | A1 |
20150217191 | Yan | Aug 2015 | A1 |
20150273325 | Falc | Oct 2015 | A1 |
20150281422 | Kessler et al. | Oct 2015 | A1 |
20160132114 | Rihn | May 2016 | A1 |
20160180811 | Colenbrander | Jun 2016 | A1 |
20160317919 | Gassoway et al. | Nov 2016 | A1 |
20160329533 | Tajima | Nov 2016 | A1 |
20170056762 | Gafni | Mar 2017 | A1 |
20170205881 | Yamashita | Jul 2017 | A1 |
20180004250 | Barnett et al. | Jan 2018 | A1 |
20180056176 | Sakamoto | Mar 2018 | A1 |
20180133594 | Guo | May 2018 | A1 |
20180250588 | Winick | Sep 2018 | A1 |
20180345136 | Schmitz et al. | Dec 2018 | A1 |
20180369692 | Winick | Dec 2018 | A1 |
20190079584 | Bonanno | Mar 2019 | A1 |
20190080549 | Lewis | Mar 2019 | A1 |
20190230400 | Van Os | Jul 2019 | A1 |
20190358534 | Fang et al. | Nov 2019 | A1 |
20190379231 | Gonzalez et al. | Dec 2019 | A1 |
20200155928 | Guo | May 2020 | A1 |
20200206636 | Schultz et al. | Jul 2020 | A1 |
20200278758 | McAllen | Sep 2020 | A1 |
20200282309 | Liao | Sep 2020 | A1 |
20200353351 | Mao | Nov 2020 | A1 |
20200353369 | Esselstrom et al. | Nov 2020 | A1 |
20200406140 | Sundareson | Dec 2020 | A1 |
20210093951 | Mahlmeister et al. | Apr 2021 | A1 |
20210104907 | Chen et al. | Apr 2021 | A1 |
20210154584 | O'Connor et al. | May 2021 | A1 |
20210197082 | Seibert et al. | Jul 2021 | A1 |
20210275907 | Khaira et al. | Sep 2021 | A1 |
20210308566 | Kong et al. | Oct 2021 | A1 |
20220032178 | Khaira et al. | Feb 2022 | A1 |
20220032179 | Khaira et al. | Feb 2022 | A1 |
20220032180 | Khaira et al. | Feb 2022 | A1 |
20220096923 | O'Leary et al. | Mar 2022 | A1 |
20220135273 | Malone | May 2022 | A1 |
20220317798 | Stryker | Oct 2022 | A1 |
20220323857 | Khaira et al. | Oct 2022 | A1 |
20220331688 | Khaira et al. | Oct 2022 | A1 |
20220339533 | Schoenith et al. | Oct 2022 | A1 |
20220347563 | Khaira et al. | Nov 2022 | A1 |
20220347564 | Khaira et al. | Nov 2022 | A1 |
20220382559 | Tu et al. | Dec 2022 | A1 |
20220395754 | Ballard | Dec 2022 | A1 |
20230271082 | Khaira et al. | Aug 2023 | A1 |
Number | Date | Country |
---|---|---|
3169951 | Sep 2021 | CA |
101739162 | Jun 2010 | CN |
204129699 | Jan 2015 | CN |
106356228 | Jan 2017 | CN |
107008005 | Aug 2017 | CN |
207532765 | Jun 2018 | CN |
207838250 | Sep 2018 | CN |
208115138 | Nov 2018 | CN |
208636809 | Mar 2019 | CN |
209392718 | Sep 2019 | CN |
113426104 | Sep 2021 | CN |
115427123 | Dec 2022 | CN |
115427123 | Feb 2024 | CN |
1380324 | Jan 2004 | EP |
1380324 | Sep 2005 | EP |
2025369 | Feb 2009 | EP |
2136225 | Dec 2009 | EP |
2136225 | Jun 2012 | EP |
4114540 | Jan 2023 | EP |
2608588 | Jan 2023 | GB |
2004139847 | May 2004 | JP |
2014210079 | Nov 2014 | JP |
2023516421 | Apr 2023 | JP |
201036020 | Oct 2010 | TW |
WO2009073819 | Jun 2009 | WO |
WO2015072625 | May 2015 | WO |
WO2017218303 | Dec 2017 | WO |
WO2021102146 | May 2021 | WO |
WO2021178242 | Sep 2021 | WO |
WO2022161834 | Aug 2022 | WO |
WO2023034596 | Mar 2023 | WO |
WO2023172202 | Sep 2023 | WO |
WO2024006587 | Jan 2024 | WO |
Entry |
---|
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2021/019941, dated Jun. 9, 2021 (12 pages). |
Notice of allowance in U.S. Appl. No. 17/856,895, dated Apr. 16, 2024. |
Office Action in U.S. Appl. No. 18/405,077, dated May 7, 2024. |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2024/010404, mailed Apr. 24, 2024 (16 pages). |
U.S. Appl. No. 16/693,080, filed Nov. 2019, O'Connor. |
U.S. Appl. No. 16/808,339, filed Mar. 2020, Khaira et al. |
U.S. Appl. No. 17/504,260, filed Oct. 2021, Khaira. |
U.S. Appl. No. 17/504,283, filed Oct. 2021, Khaira et al. |
U.S. Appl. No. 17/504,299, filed Oct. 2021, Khaira. |
U.S. Appl. No. 17/850,912, filed Jul. 2022, Khaira. |
U.S. Appl. No. 17/856,895, filed Jul. 2022, Khaira. |
U.S. Appl. No. 17/866,166, filed Jul. 2022, Khaira et al. |
U.S. Appl. No. 17/866,234, filed Jul. 2022, Khaira et al. |
U.S. Appl. No. 17/987,772, filed Nov. 2022, Sorensen. |
U.S. Appl. No. 18/076,121, filed Dec. 2022, Donlan et al. |
U.S. Appl. No. 18/076,146, filed Dec. 2022, Wei et al. |
U.S. Appl. No. 18/076,172, filed Dec. 2022, Chow et al. |
U.S. Appl. No. 18/086,077, filed Dec. 2022, Maker. |
U.S. Appl. No. 18/086,103, filed Dec. 2022, Maker. |
U.S. Appl. No. 18/136,509, filed Apr. 2023, O'Connor. |
U.S. Appl. No. 18/138,377, filed Apr. 2023, Sorensen et al. |
U.S. Appl. No. 18/195,152, filed May 2023, Khaira. |
U.S. Appl. No. 18/202,755, filed May 2023, Aldridge et al. |
U.S. Appl. No. 18/214,917, filed Jun. 2023, O'Connor. |
U.S. Appl. No. 18/214,949, filed Jun. 2023, O'Connor. |
U.S. Appl. No. 18/226,883, filed Jul. 2023, Khaira et al. |
U.S. Appl. No. 18/226,892, filed Jul. 2023, Boegli. |
U.S. Appl. No. 18/237,680, filed Aug. 2023, O'Connor. |
U.S. Appl. No. 18/237,698, filed Aug. 2023, O'Connor. |
U.S. Appl. No. 18/242,672, filed Sep. 2023, Aldridge et al. |
U.S. Appl. No. 18/369,000, filed Sep. 2023, Koch et al. |
U.S. Appl. No. 18/369,025, filed Sep. 2023, Koch et al. |
U.S. Appl. No. 18/388,631, filed Nov. 2023, Khaira et al. |
U.S. Appl. No. 18/388,636, filed Nov. 2023, Khaira et al. |
U.S. Appl. No. 18/388,922, filed Nov. 2023, O'Connor et al. |
U.S. Appl. No. 18/389,063, filed Nov. 2023, Maker et al. |
U.S. Appl. No. 18/405,077, filed Jan. 2024, Lake et al. |
U.S. Appl. No. 63/422,797, filed Nov. 2022, Khaira et al. |
U.S. Appl. No. 63/425,655, filed Nov. 2022, Maker et al. |
U.S. Appl. No. 63/435,089, filed Dec. 2022, O'Connor. |
U.S. Appl. No. 63/437,580, filed Jan. 2023, Lake et al. |
U.S. Appl. No. 63/452,551, filed Mar. 2023, Aldridge et al. |
U.S. Appl. No. 63/524,014, filed Jun. 2023, O'Connor. |
U.S. Appl. No. 63/530,230, filed Aug. 2023, Khaira et al. |
U.S. Appl. No. 63/533,580, filed Aug. 2023, Khaira et al. |
Office Action in CN Application No. 202180019131.2, dated Jul. 27, 2023. |
Office Action in CN Application No. 202180019131.2, dated Mar. 28, 2023. |
Office Action—Communication pursuant to Rules 161(1) and 162 EPC, dated Oct. 26, 2022. |
Notice of allowance in U.S. Appl. No. 18/224,508, dated Jan. 24, 2024. |
Office Action in U.S. Appl. No. 16/693,080, dated Jan. 25, 2021. |
Office Action in U.S. Appl. No. 16/693,080, dated Jun. 8, 2021. |
Office Action in U.S. Appl. No. 17/504,283, dated Feb. 13, 2024. |
Office Action in U.S. Appl. No. 17/856,895, dated Jul. 18, 2023. |
Office Action in U.S. Appl. No. 17/856,895, dated Nov. 1, 2023. |
Office Action in U.S. Appl. No. 17/856,895, dated Oct. 27, 2022. |
Office Action in U.S. Appl. No. 17/856,895, dated Mar. 12, 2024. |
Office Action in U.S. Appl. No. 18/076,146, dated Dec. 12, 2023. |
Office Action in U.S. Appl. No. 18/086,077, dated Apr. 17, 2023. |
Office Action in U.S. Appl. No. 18/086,077, dated Aug. 17, 2023. |
Office Action in U.S. Appl. No. 18/086,103, dated Dec. 7, 2023. |
Office Action in U.S. Appl. No. 18/195,152, dated Aug. 4, 2023. |
Office Action in U.S. Appl. No. 18/224,508, dated Oct. 3, 2023. |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/031919, mailed Nov. 17, 2023 (14 pages). |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/036609, mailed Feb. 12, 2024 (15 pages). |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/079518, mailed Feb. 9, 2024 (12 pages). |
International Search Report and Written Opinion of the International Searching Authority, issued in International Application No. PCT/US2020/061291, mailed Feb. 24, 2021, 20 pages. |
“AVPictureInPictureController: A controller that responds to user-initiated Picture in Picture playback of video in a floating, resizable window”; Apple Developer Documentation, AVKit; downloaded from the Internet on Nov. 27, 2022 at https://developer.apple.com/documentation/avkit/avpictureinpicturecontroller; Apple Inc.; 2022; 8 pages. |
“Backbone—Next-Level Play”; Apple App Store preview; downloaded from the Internet on Nov. 29, 2022 at https://apps.apple.com/US/app/backbone-next-level-play/id1449660663; Apple Inc.; 2022; 4 pages. |
“Backbone One”; Mobile gaming hardware product page; Backbone; Dec. 9, 2022; 7 pages. |
“Digital Depth: ALL Controller Universal & Fully Customizable”; Kickstarter project page for customizable game controller; Digital Depth Inc.; Aug. 4, 2021; 25 pages. |
“Displaying live data with Live Activities”; Apple Developer Documentation Activity Kit article; downloaded from the Internet on Nov. 28, 2022 at https://developer.apple.com/documentation/activitykit/displaying-live-data-with-live-activities; Apple Inc.; 2022; 37 pages. |
“Game Center”; Apple Developer Game Center overview; downloaded from the Internet on Nov. 29, 2022 at https://developer.apple.com/game-center/; Apple Inc.; 2022; 4 pages. |
“Gamepass App now supports Picture in Picture”; Reddit, xcloud comments; downloaded from the Internet on Nov. 28, 2022 at https://www.reddit.com/r/xcloud/comments/mvathi/gamepass_app_now_supports_picture_in_picture/; Reddit Inc.; 2022; 6 pages. |
“GitHub—Kofktu/PIPKit: Picture in Picture for iOS”; downloaded from the Internet on Nov. 27, 2022 at https://github.com/Kofktu/PIPKit; GitHub, Inc.; 2022; 11 pages. |
“How to implement Picture in Picture Webview on IOS Swift?”; StackOverflow Questions; downloaded from the Internet on Nov. 28, 2022 at https://stackoverflow.com/questions/69565199/how-to-implement-picture-in-picture-webview-on-ios-swift; StackOverflow; Oct. 14, 2021; 2 pages. |
“PhoneJoy Play: Turn your phone into a console!”; Kickstarter project page for compact gamepad; PhoneJoy Solutions America, Inc.; Jul. 29, 2014; 42 pages. |
“Picture-in-picture (PiP) support”; Android Developers UI Guide; downloaded from the Internet on Nov. 27, 2022 at https://developer.android.com/develop/ui/views/picture-in-picture; Nov. 11, 2022; 10 pages. |
“Picture-in-Picture API—Web APIs / MDN”; downloaded from the Internet on Nov. 27, 2022 at https://developer.mozilla.org/en-US/docs/Web/API/Picture-in-Picture_API; Mozilla Corporation; Oct. 10, 2022; 4 pages. |
“Pip (picture in picture) mode on android with the xbox game pass beta app”; Reddit, XboxGamePass comments; downloaded from the Internet on Nov. 29, 2022 at https://www.reddit.com/r/XboxGamePass/comments/n7f5bk/pip_picture_in_picture_mode_on_android_with_the/; Reddit Inc.; 2022; 6 pages. |
“Rayz Pro”; Pioneer Rayz™ Pro earbuds product page; downloaded from the Internet on Aug. 16, 2023 at Rayz Pro Earphone—Pioneer Rayz; Pioneer Rayz; 2023; 9 pages. |
“User Notification: Push user-facing notifications to the user's device from a server, or generate them locally from your app”; Apple Developer Documentation; downloaded from the Internet on Nov. 28, 2022 at https://developer.apple.com/documentation/usernotifications; 2022; 16 pages. |
“Why queue in geforce now so long? I try to answer for this question” Reddit, GeForceNOW comments; downloaded from the Internet on Jun. 7, 2023 at why queue in geforce now so long? I try to answer for this question : r/GeForceNOW (reddit.com); Reddit Inc.; Jun. 1, 2023; 6 pages. |
Adler, M.; “Backbone One Review: Mobile gaming reenvisioned”; IGN review; downloaded from the Internet on Nov. 29, 2022 at https://www.ign.com/articles/backbone-one-review; IGN; Nov. 7, 2021; 18 pages. |
Box.co.uk; “How Does the Samsung Gaming Hub Work?”; YouTube product tutorial; downloaded from the Internet on Nov. 29, 2022 at https://www.youtube.com/watch?v=uAT4tZR3mNk; YouTube; Oct. 2022; 5 pages. |
Dickinson, “Instant Replay; Building a Game Engine with Reproducible Behavior,” Jul. 13, 2001, Retrieved from the Internet: URL: http://www.gamasutra.com/features/20010713/dickinson_01.htm [retrieved on Oct. 2, 2007], 6 pages. |
Faulkner, C.; “Backbone's excellent phone controller is now shipping for Android” The Verge, entertainment tech review webpage; downloaded from the Internet on Nov. 29, 2022 at https://www.theverge.com/2022/11/16/23462127/backbone-one-phone-controller-android-usb-c-features; Vox Media LLC; Nov. 16, 2022; 20 pages. |
Faulkner, C.; “The Backbone One is a stunning controller that turns your iPhone into a more capable gaming device”; The Verge, entertainment tech review webpage; downloaded from the Internet on Nov. 29, 2022 at https://www.theverge.com/21525741/backbone-one-iphone-ios-controller-gaming-portable-review; Vox Media LLC; Apr. 27, 2021; 12 pages. |
Hinton, L.; “Xbox Cloud Gaming ‘Lots of people are playing’ Fix: Why is queue taking so long? and How to fix Xbox Cloud Gaming ‘Lots of people are playing’error”; downloaded from the Internet on Jun. 7, 2023 at Xbox Cloud Gaming ‘Lots of people are playing’ Fix: Why is queue taking so long?—GameRevolution; Game Revolution; Dec. 13, 2021; 6 pages. |
Max Tech; Backbone One Review—The Best iPhone Gaming Controller!; YouTube product review video; downloaded from the Internet on Nov. 29, 2022 at https://www.youtube.com/watch?v=zRJQjt2nzDo; YouTube; Jun. 2022; 4 pages. |
Osterberg, J.; “Picture in Picture Across All Platforms”; Kodeco / iOS & Swift Tutorials; downloaded from the Internet on Nov. 28, 2022 at https://www.kodeco.com/24247382-picture-in-picture-across-all-platforms; Jul. 26, 2021; 14 pages. |
Schofield, T.; “Logitech G Cloud Unboxing and Hands On!”; YouTube product review video; downloaded from the Internet on Nov. 29, 2022 at https://www.youtube.com/watch?v=speoPL5vqX0; YouTube; Nov. 2022; 3 pages. |
Sholtz, M.; “The Razer Kishi V2 offers a new Virtual Controller mode, and it's pretty slick”; Android Police Newsletter article; downloaded from the Internet on Aug. 16, 2023 at The Razer Kishi V2 offers a new Virtual Controller mode, and it's pretty slick (androidpolice.com); Jan. 21, 2023; 7 pages. |
Tech & Design; “How to Set Up New Nintendo Switch | Beginners Guide | First Time Turning On”; YouTube product review video; downloaded from the Internet on Nov. 29, 2022 at https://www.youtube.com/watch?v=XtMcQ9IAkCc; YouTube; 2021; 4 pages. |
Vinyals et al., “Grandmaster level in StarCraft II using multi-agent reinforcement learning,” Nature, Macmillan Journals Ltd., London, vol. 575, No. 7782, Oct. 30, 2019, pp. 350-354, 22 pages. |
Voorhees, J.; “Deeper Controller Support and a Revitalized Game Center: Exploring Apple's 2020 Gaming Updates”; MacStories Weekly Extras; downloaded from the Internet on Nov. 29, 2022 at https://www.macstories.net/stories/deeper-controller-support-and-a-revitalized-game-center-exploring-apples-2020-gaming-updates/; MacStories, Inc.; Aug. 27, 2020; 14 pages. |
Wagner, “Developing Your Own Replay System,” Feb. 4, 2004, Retrieved from the Internet: URL: http://www.jamasutra.com/features/20040204/wagner_01.shtml [retrieved on Oct. 9, 2007], 11 pages. |
Notice of allowance in U.S. Appl. No. 17/504,299, dated Apr. 15, 2024. |
Notice of allowance in U.S. Appl. No. 18/076,146, dated Apr. 15, 2024. |
Notice of allowance in U.S. Appl. No. 18/086,103, dated Mar. 25, 2024. |
Notice of allowance in U.S. Appl. No. 18/086,103, dated Apr. 3, 2024. |
Office Action in U.S. Appl. No. 17/504,260, dated Mar. 21, 2024. |
Office Action in U.S. Appl. No. 17/504,299, dated Mar. 22, 2024. |
Office Action in U.S. Appl. No. 18/195,152, dated Mar. 26, 2024. |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/036567, mailed Mar. 11, 2024 (18 pages). |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/081101, mailed Mar. 11, 2024 (19 pages). |
Bluetooth Special Interest Group: “Bluetooth Human Interface Device (HID) Profile Specifications”, Bluetooth Adopted Specification Web page, Feb. 21, 2012 (Feb. 21, 2012), pp. 1-123, XP055133797, Retrieved from the Internet: URL:https://www.bluetooth.org/en-us/specification/adopted-specifications [retrieved on Aug. 7, 2014]. |
Notice of allowance in U.S. Appl. No. 17/504,283, dated May 29, 2024. |
Notice of allowance in U.S. Appl. No. 17/504,299, dated Jun. 12, 2024. |
Notice of allowance in U.S. Appl. No. 17/856,895, dated Jun. 12, 2024. |
Notice of allowance in U.S. Appl. No. 18/076,146, dated Jun. 13, 2024. |
Notice of allowance in U.S. Appl. No. 18/086,103, dated May 28, 2024. |
International Search Report and Written Opinion of the International Searching Authority issued in International Application No. PCT/US2023/079521, mailed May 24, 2024 (15 pages). |
Anonymous: “Using the wireless controller”, Playstation 4 User's Guide, Mar. 15, 2023 (Mar. 15, 2023), pp. 1-3, XP093178521, Retrieved from the Internet: URL:https://web.archive.org/web/20230315012624/https://manuals.playstation.net/document/en/ps4/basic/usercontroller.html [retrieved on Jun. 5, 2024] the whole document, 3 pages. |
Number | Date | Country | |
---|---|---|---|
20230356076 A1 | Nov 2023 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17504299 | Oct 2021 | US |
Child | 18224508 | US | |
Parent | 16808339 | Mar 2020 | US |
Child | 17504299 | US |