The present disclosure is directed to sensing configurations and game controllers for electronic games, including controller configurations, gaming device controllers, gaming device controller operation, and interactive entertainment device configurations.
Computer and console games often utilize a controller or computer keypad as control interface for a user. These conventional controllers typically require a user to press buttons or control moveable elements to provide game controls. Often these controllers adhere to a similar control interface of having a directional pad on one side of the controller and buttons on the other side of the controller. One of the drawbacks of existing designs may be the fixed configuration. By way of example, a fixed layout may be too small, or too large, for a user. Similarly, a fixed layout may not be comfortable to a user. Manufacturers typically do not veer from layout or controller size to reduce cost. As result, controllers may include button configurations for hand sizes that do not accommodate all players. There exists a desire for game controllers to allow for different configurations, and accommodate hand sizes without having to customize or manufacture controller size.
Another drawback of conventional controllers may be the fixed nature of input controls. For example, a controller only has enough space to include a directional pad and joystick, and each element is usually located in a different location. Due to size of physical control elements, game controls may be limited. In addition, inclusion of controls can increase controller size. There exists a need and a desire to allow for improvements and modifications to game controllers.
Disclosed and described herein are game controller devices, sensors and methods. In one embodiment, a game controller device includes a body, and at least one input control sensor supported by the body, wherein the at least one input control sensor includes an input surface and at least one optical sensor to detect game controller input to the input surface. The game controller device also includes a controller coupled to the at least one input control sensor. The controller is configured to receive game controller input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.
In one embodiment, the at least one input control sensor is configured to detect at least one of touch, tap, swipe, press, pinch and joystick input.
In one embodiment, the at least one optical sensor is configured to detect input relative to at least one region of the input surface.
In one embodiment, the at least one optical sensor is configured to detect a pretouch relative to the input surface, wherein the pretouch is at least one of an input approaching at least one region of the input surface and an input prior to engagement with at least one region of the input surface.
In one embodiment, the input surface includes an optically transmissible surface.
In one embodiment, the controller identifies the at least one input command relative to at least one reference point of the control sensor.
In one embodiment, the controller is configured to present at least one reference point for an input control location.
In one embodiment, the controller is configured to detect input control locations based on at least one input reference update, wherein the input reference update is a user specified location for an input control location.
In one embodiment, the controller is configured to identify a user and configure the game controller based on user identification to include at least one input control location.
In one embodiment, the game controller device includes a memory coupled to the controller and configured to store executable instructions, wherein the memory is further configured to store at least one input control location.
In one embodiment, the game controller device includes at least one of a temperature sensor and pressure sensor configured to detect condition of the input surface.
Another embodiment is directed to an input control sensor for a game controller device. The input control sensor includes an input surface, at least one optical sensor to detect input to the input surface, and a controller coupled to the at least one optical sensor. The controller is configured to receive input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.
In one embodiment, the at least one optical sensor is configured to detect at least one of touch, tap, swipe, press, pinch and joystick input.
In one embodiment, the at least one optical sensor is configured to detect input relative to at least one region of the input surface.
In one embodiment, the at least one optical sensor is configured to detect a pretouch relative to the input surface, wherein the pretouch is at least one of an input approaching at least one region of the input surface and an input prior to engagement with at least one region of the input surface
In one embodiment, the input surface includes an optically transmissible surface.
In one embodiment, the controller identifies the at least one input command relative to at least one reference point of the control sensor.
In one embodiment, the controller is configured to present at least one reference point for an input control location.
In one embodiment, the controller is configured to detect input control locations based on at least one input reference update, wherein the input reference update is a user specified location for an input control location.
In one embodiment, the controller is configured to identify a user and configure a game controller based on user identification to include at least one input control location.
In one embodiment, the input control sensor includes a memory coupled to the controller, the memory configured to store executable instructions and to store at least one input control location.
In one embodiment, the input control sensor includes at least one of a temperature sensor and pressure sensor configured to detect condition of the input surface.
Other aspects, features, and techniques will be apparent to one skilled in the relevant art in view of the following detailed description of the embodiments.
The features, objects, and advantages of the present disclosure will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference characters identify correspondingly throughout and wherein:
One aspect of the disclosure is directed to game controller configurations and input devices for game controllers. Embodiments are directed to systems, devices and methods for detecting user input and outputting control signals to a gaming device or interactive entertainment device. Gaming systems may include consoles that play game media, consoles that provide network data for games, handheld devices, mobile devices (e.g., tablets, mobile phones, etc.) and devices in general configured for electronic gaming. A game controller device may be an independent or integrated device configured to provide user controls to the gaming system. According to embodiments, a game controller design is provided to include at least one input surface including at least one sensor to detect user input, such as touch, tap swipe, press, pinch and joystick controls. The game controller can include one or more input areas and one or more input control sensors. Unlike conventional game controllers with a fixed arrangement of physical buttons, input control locations may be selected and/or adjusted by a user.
According to embodiments, a buttonless game controller input configuration is provided. Configurations and input sensors are provided to allow for a game controller to include at least one input surface that does not require a button or joystick. Input surfaces of the controller may be configured to detect user touch and user inputs similar to activation of a button or manipulation of a directional pad without requiring actual push buttons or a directional pad. Game controller configurations can be used in addition to and/or independent from physical push buttons. According to embodiments, an input control sensor is provided to allow for buttonless operation by the game controller. The input control sensor can be used for game control and non-game applications.
Embodiments are also directed to input control sensors. According to embodiments, an input control sensor can include an input surface that may be supported by the body of a game controller or a housing in general. According to embodiments, one or more optical sensors may be used to detect user contact and interaction with the input surface. The input surface may eliminate the need for physical buttons and allow for a single surface to detect one or more of touch, tap, swipe, slide, press, pinch, etc. Unlike a conventional button that is configured to provide a single function in a single location, input control sensors described herein can allow for one or more input control locations to be provided on an input surface. In that fashion, traditional button functions may be provided by the input control sensor, in that a user may press or contact a location of the input surface such that the contact is identified as a button press. Similarly, one or more regions of an input surface may be associated with directions of a directional pad or joystick such that contact with the region may be interpreted as operation of a directional pad. The input control sensor may include or more input control locations. In addition, the input control sensor may allow a user to move to reposition input control locations. One benefit of repositioning input control locations is to accommodate different hand and/or finger sizes. Another benefit may be to allow for controller arrangement to be modified and/or inverted. By way of example, instead of only allowing a directional pad to be on the left side of the controller, the controller can be configured to allow for the right side of the controller to include the directional pad. Similarly, directional pad input locations of button locations may be placed more stretched apart or closer together. As such, the controller can offer players a personalized experience.
Input control sensors may be configured to operate using one or more optical sensors configured internally of the input control sensor. Optical control sensors can detect contact with an input surface. According to embodiments, optical control sensors may detect a user finger or hand approaching the input surface. By detecting contact, the input control sensors may detect the duration and movement of a user relative to the input surface to allow for detection of a press, or direction associated with a swipe or motion. Input control sensors may also detect pretouch of a user. Pretouch may be used to more accurately characterize multiple button presses. Input control sensors may include an input surface that is light transmissible or at least partially light transmissible for the optical sensors to detect objects in close proximity and/or in contact with the controller. Input control sensors may also include one or more of a temperature and pressure sensors. One or more of temperature and pressure output can be used for generating an output control signal.
As used herein, the terms “a” or “an” shall mean one or more than one. The term “plurality” shall mean two or more than two. The term “another” is defined as a second or more. The terms “including” and/or “having” are open ended (e.g., comprising). The term “or” as used herein is to be interpreted as inclusive or meaning any one or any combination. Therefore, “A, B or C” means “any of the following: A; B; C; A and B; A and C; B and C; A, B and C”. An exception to this definition will occur only when a combination of elements, functions, steps or acts are in some way inherently mutually exclusive.
Reference throughout this document to “one embodiment,” “certain embodiments,” “an embodiment,” or similar term means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of such phrases in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner on one or more embodiments without limitation.
According to embodiments, operation of game controller device 100 may include a user contacting one or more of input control sensors 1101-n. These interactions may be detected by game controller device 100 to determine or identify commands for a gaming console. According to embodiments, input control sensors 1101-n may support a plurality of input control locations. In certain configurations, game controller 100 may detect user input to input control sensors 1101-n without a reference point. By way of example, a user tapping or swiping input control sensors 1101 may be detected and the tap, swipe or both may be communicated to a device being controlled, such as a gaming device. According to embodiments, game controller 100 may allow for input control sensors 1101-n to detect inputs and identify commands from the inputs such as a directional command or button press. Embodiments provide multiple configurations allowing for regions to be associated with a button or directional pad. In addition, configurations allow for detecting user preference or input to set a region as a button, directional pad or game control feature in general. Embodiments also include outputting a control reference to aide a user in determining input control locations.
According to embodiments, input control sensors 1101-n may be supported by body 105. Body 105 may be a plastic, a molded material or other material including one or more handles, grips or surfaces for a user to grip. Body 105 may house one or more electronics, power sources, etc. for game controller 100. Game controller may include a controller configured to detect and output input commands.
Input control sensor 1101 may be configured to include top surface 120 including a plurality of planar surfaces, one or more curved surfaces, and in one or more shapes. Shape and configuration of input surface 115 may be based on the outer contours of a game controller.
According to embodiments, optical sensors 1251-n may be configured to detect touch and contact locations, contact duration, contact rate, and contact shape (e.g., swipe pattern, swipe arc, slide shape, drawn shapes, etc.). According to embodiments, input control sensor 1101 includes optical sensors 1251-n configured to identify a user. User identification may be based on one or more of finger size, finger characteristics, fingerprint detection and controller grip type. Based on user identification and/or detection, a game controller may configure at least one input control location. Input control sensor 1101 may include one or more of a temperature and pressure senor to detect user temperature and pressure. According to embodiments, temperature and pressure sensors may be integrated within input surface 115. For example, input surface 115 may include a touch screen configuration.
According to embodiments, input control sensors may detect a user finger or hand approaching the input surface, which may be a pretouch at block 205. Pretouch may be used as an input. According to embodiments, a pretouch may be detected as an input for use contact that approaches at least one region of an input surface. Alternatively or in combination, pretouch may be an input prior to engagement of a finger or user with at least one region of the input surface. Pretouch may be detected relative to input surfaces in one or more regions to provide commands from any input type prior to a user, such as a user's fingertip, contacting an input surface. Detected touch inputs and pretouch projections may be detected and stored to provide an aggregated data set for player input data. According to embodiments, pretouch data may be used to offer players an alternate or optimized input scheme. Pretouch may also offer a proximity-based input scheme that does not rely on physically touching the surface. According to embodiments, pretouch may be detected and/or sensed to track when one or more of a user's fingers are in proximity to an input surface. Pretouch may be detected to track movement of a user's finger relative to the input surface, including a pattern or movement. Systems and processes herein may be detect pretouch to allow for increased response time. By detecting pretouch, a game controller can provide an output to a gaming system or console to initiate one or more controls or processes prior to user contact.
At block 210, process includes identifying and/or determining a command. Based on received optical sensor output, a controller may identify at least one input command based on input detected for a user. Identifying of a command by the controller allows for the input control sensor and game controller to provide multiple uses of a detection area. Unlike requiring a directional pad and a joystick to allow for direction input and joystick functions in different locations, presses to an input contact location and swipes, slides or movement relative to the input control location can allow for one input control location to provide multiple functions. At block 210, a controller may identify the at least one input command relative to at least one reference point of the control sensor. An input control sensor may be configured to output a control reference or reference element to notify a user of a control location.
At block 215, the device may be configured to output a control command. Control commands may be based on user inputs or contacts detected by input control sensors. According to embodiments, a game controller can detect user inputs such as tap, touch, press, swipe, etc. and output the detected contact to a gaming device. Alternatively or in combination, a game controller can include one or more input control locations associated with regions or reference points of an input control sensor. By way of example, a directional pad may be provided by including at least four reference points, a reference point for each of up, down, left and right relative to a location of an input surface. The game controller can allow for a user to specify the location of the directional pad reference points on the input surface. According to embodiments, the game controller can provide a reference to the location of the reference points. Reference points may be provided by providing a lighted output or indication. By way of example, using one or more of back lighting and light elements of a touch screen, the location of the four reference points of the directional pad may be illuminated on a controller surface. If and when a user provides a request to modify the location of the reference points, the game controller can adjust or move the position of the directional pad components to different reference points to allow for a different input control location of the directional pad. In addition, the game controller can include reference points for a plurality of controls. By way of example, the game controller can include reference points for a directional pad, reference points for locations associated with a button or type of control input for a game (e.g., square button, X button, triangle button, plus button, home button, menu button, etc.). The game controller an output control signals based on detected and identified input commands.
Process 200 may optionally include identifying a user at block 206. According to embodiments, a game controller may be configured to detect one or more characteristics of a user and identify the user. User identification may be based on prior use, such that one or more of user hand size, grip location, fingerprints and user characteristic may be detected to identify the user. Based on a user identified at optional block 206, one or more reference points may be determined or set for determining commands at block 210.
Process 200 may optionally include outputting a control reference at block 207. According to embodiments, one or more reference points may be indicated to a user. A control reference or reference point indication may be optional, as such the controller may detect inputs to the controller based on repetitive user operation. Alternatively, the reference points or an indication of regions associated with particular commands of a controller can be provided. In the gaming space, game controllers are often tied to the gaming console or platform. As such a gaming console may include a controller with a fixed layout or fixed controls including a directional pad, often a plurality of buttons and possibly one or more joystick controls, trigger/paddle keys, menu/home button, etc. Outputting reference controls at optional block 207 can include providing one or more of a lighted indication of the control input location for each control feature. Alternatively or in combination, control references may be provided by way of a haptic or movable surface.
According to embodiments, a game controller can allow for the control input locations of game controller commands to be modified. As such, users with different hand or finger sizes can reposition the game controls to their liking. Alternatively, the modification may be based on user preference and not based on user characteristics. By way of example, a user may wish to invert the control locations and have a directional pad on the right side of a control instead of a left side, or vice versa. Process 200 may optionally include detecting a reference update at block 208 and storing one or more reference locations at optional block 209. By way of example, using a gaming console display or other game controller feature, the user can request to modify one or more game control input locations. User modification can include a request to reposition a directional pad to move down and the right, for example. According to embodiments, control input locations may be determined by a user pressing desired locations on game controller at block 208. At block 209, one or more reference points may be identified based on the updated input location and used to store one or more control input locations for a user. According to embodiments, reference updates may be determine by a game controller when a user repeatedly contacts a particular location for a feature such that the game controller can automatically perform operations at blocks 208 and 209.
According to embodiments, game controller device 300 is configured to detect input to one or more input surfaces by input control sensors 3051-n, and output control signals. Controller 310 may relate to a processor or control device configured to execute one or more operations stored in memory 315, such as processes for detecting and outputting player controls. Controller 310 may be coupled to input control sensors 3051-n, memory 315, I/O interface 320. Memory 315 may be non-transitory memory configured to provide data storage and working memory operations for device 300. Memory 315 may be configured to store computer readable instructions for execution by controller 300 for one or more processes described herein. Memory 315 may also be configured to store at least one input control location. I/O interface 320 may be a communications module configured to receive and transmit data such as commands or controls to a gaming device. Game controller 300 may be configured for at least one of wired and wireless communication with a gaming console by way of I/O interface 320.
According to one embodiment, controller 310 may be configured to support a plurality of control input locations. Controller 310 may also be configured to allow a user to modify one or more control input locations. According to embodiments, game controller 300 may optionally include one or more input reference elements 330. Input reference elements 330 may include lighted elements to illuminate at least a portion of an input surface to notify a user of an input control location. In certain embodiments, input reference elements 330 may include a touch screen surface integrated with an input surface that allows to control of lighted elements. According to embodiments, Input reference elements 330 may include one or more of a haptic or deformable surface element that a user can feel the location of elements. The haptic or deformable surface may adjust its configuration such that a user could feel the input control location.
According to embodiments, game controller 300 may optionally include one or more of optional pressure and temperature sensors 335. Optional pressure and temperature sensors 335 may be configured to detect one or more of a surface temperature, user finger temperature, control temperature, and pressure applied to one or more portions of the game controller. According to embodiments, one or more of pressure and temperature detections may be used in combination with sensor output for detecting and characterizing user contact and conditions of an input surface. By combining temperature and/or pressure with contact locations, information can be provided to the gaming console with respect to the amount of force, and user condition.
According to embodiments,
According to embodiments, game controller 400 includes at least three optical sensors (e.g., cameras) to track contact and movement across each input control sensor. Input control sensors may be configured to capture and store motion and final touch location as unique data points and to create privatized input locations. Although
While this disclosure has been particularly shown and described with references to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the claimed embodiments.