Computing devices, such as desktop and laptop computers, may include a backlit keyboard. Some backlit keyboards allow for user customization. A user may customize an illumination pattern of the keyboard, such as the illumination color of keys on the keyboard. The user may prefer one illumination color for one application and another illumination color for another application.
Non-limiting and non-exhaustive examples of the disclosure are described with reference to the figures outlined below.
A user may utilize a computing system to execute word processing applications, spreadsheet applications, graphics editing applications, presentation development applications, e-mail messaging applications, web browsing applications, etc. A user may also utilize a computing system as an entertainment device to provide applications such as electronic games and audio/video material (e.g., movies and television programs).
The present disclosure generally relates to systems and methods for dynamically illuminating a keyboard with an illumination pattern based on tracked user interactions. For example, a dynamic environment response (DER) system may monitor a keyboard to determine how frequently each key on the keyboard is pressed during execution of an application by an underlying computing system. The DER system may then illuminate keys on the keyboard based on, for example, the frequency that each key is pressed.
For example, a user may use a computing device to execute an electronic game application. The electronic game may have a character set in a virtual world that the user navigates using a keyboard of the computing system. The keyboard may be integrated into the computing device (e.g., as part of a laptop device) or connected to the keyboard via a communication interface (e.g., wired or wireless). To advance the character through the game, the user may utilize (i.e., press) a first set of keys on the keyboard to move the character and a second set of keys on the keyboard to make the character interact in the virtual world.
Many of the keys on the keyboard may be rarely or never used during execution of the electronic game. The DER system may track the utilization of each key during execution of the electronic game. The DER system may create a table identifying the relative frequency with which each key is pressed and/or derive a heatmap of the keys pressed during execution of the electronic game. For instance, a heatmap of the keys pressed during execution of the electronic game may be generated to highlight the relative frequency with which each key is pressed. The DER system may generate a heatmap with frequently used keys shown brighter or in a different color than less frequently used keys and/or unused keys.
Keys used below a threshold level and/or significantly less than other keys in the table may be omitted from the table. The DER system may develop a heatmap of the keys based on usage. In one example, the keys pressed 15 or more times (all the keys listed in the table 130) may be shown on the heatmap in a first color while the other keys may be illuminated with a second color. The heatmap can be implemented as an illumination pattern during subsequent or continued execution of the FPS game.
In yet another example, the DER system may monitor the utilization frequency of the keys on the keyboard and classify some keys as “frequently used” and other keys as “infrequently used” based on a relative grouping or threshold level. To distinguish the frequently used keys from the infrequently used keys, the DER system may illuminate the frequently used keys with one color and not illuminate the infrequently used keys or illuminate the infrequently used keys with a different color.
In some examples, the arrow keys 162, 164, 166, and 168 may be illuminated with a first color or brightness and the other illuminated keys 170-180 may be illuminated with a second color or brightness. The remaining keys may be illuminated with a third color or brightness, or not be illuminated at all. In some examples, when the computing system ceases execution of the FPS game, the DER system may revert the illumination pattern 160 to a default illumination pattern. The default illumination pattern may, for example, be an all-white illumination pattern, a single-color illumination pattern, and/or a user-defined illumination pattern. The DER system may detect subsequent execution of the FPS game and apply the previously determined illumination pattern 160 based on previously tracked key usage. As described below, the DER system may also detect execution of different applications and apply different illumination patterns based on the different key usage associated with each different application.
The computing system displaying the streaming content may indicate to the DER system that a second streaming content application is being utilized and the DER system may respond by illuminating a different combination of buttons based on tracked key utilization data for the second streaming content application.
The DER system 410 may be implemented as hardware, firmware, and/or instructions to be executed by the processor 404 (e.g., instructions stored on a non-transitory computer-readable medium). The DER system 410 may include a keystroke analyzer module 412 and a key illumination module 414. Each of the keystroke analyzer module 412 and the key illumination module 414 may be implemented as hardware components, firmware components, computer-executable instructions, and/or a combination thereof.
The keystroke analyzer module 412 may determine a frequency with which each key on a keyboard is utilized during execution of a first application. In some instances, the keystroke analyzer module 412 may be integrated with or be in communication with a USB driver or keyboard-specific driver of the keyboard used with the computing system. In other examples, the keystroke analyzer module 412 may be comprise sensors in the keyboard itself to detect key presses during execution of an application. The keystroke analyzer module 412 may alternatively operate at the operating system (OS) level to collect key press information provided by the OS during execution of the application by the computing system.
The keystroke analyzer module 412 may determine the frequency with which each key on the keyboard is utilized during execution of the first application only when the first application is the active application. Keystrokes made while the first application is inactive may be ignored for the purposes of determine the frequency with which each key on the keyboard is utilized. For example, an OS of the computing device may facilitate the execution of multiple applications at the same time. However, only one of the applications is considered “active” at any given time. User inputs provided by the keyboard only affect the active application and not concurrently executed “inactive” applications. Accordingly, the keystroke analyzer module 412 may associate keystrokes with the active application and not inactive applications.
The key illumination module 414 may illuminate the keys on the keyboard with a first illumination pattern that visually distinguishes a first subset of keys on the keyboard from a second subset of keys on the keyboard based on utilization frequency during execution of the first application. The keystroke analyzer module 412 may generate heatmaps of key utilization on the keyboard during execution of each of the Applications A-Z in the computer-readable medium 420. The DER system 410 may detect execution of each different application. The key illumination module 414 may illuminate the keys on the keyboard based on the respective heatmaps of key utilization generated for each of the different applications by the keystroke analyzer module 512.
As described herein, the DER system 410 may divide the set of keys on the keyboard into two subsets of keys. A first subset of keys may include those keys used above a threshold frequency during execution of a first application. A second subset of keys may include those keys used below the threshold frequency during execution of the second application. The threshold frequency may be defined as a fixed number or as a relative value grouping frequently used keys separate from less frequently used keys.
The key illumination module 414 may illuminate the first subset of keys on the keyboard with the first illumination pattern in which each key in the first subset of keys is illuminated with a first color to visually distinguish the first subset of keys from the second subset of keys. In some examples, the second subset of keys may be illuminated with a second color.
In other examples, each subset of keys may be illuminated with the same color but with different intensities. In still other examples, each key may be illuminated with a wavelength corresponding to a key-specific utilization frequency. In such an example, each key may be illuminated a different color based on utilization frequency. In other examples, the keys may be divided into N number of subsets, where N is an integer value and each of the N subsets may be illuminated a different color.
The keystroke analyzer module 412 may determine a frequency with which each key on the keyboard is utilized during execution of a second application, a third application, a fourth application, etc. The key illumination module 414 may illuminate the keys according to a unique illumination pattern depending on which application (e.g., Application A-Z) is currently being executed by the computing system 400.
If an illumination pattern has not already been developed, at 504, then a keystroke analyzer of the DER system may track, at 512, key presses during execution of the application. The DER system may determine (e.g., develop, calculate, or create), at 514, a keyboard illumination pattern for the application that distinguishes frequently used keys from other keys. The key illumination module of the DER system may then apply, at 506, the keyboard illumination pattern to the keyboard until the application is closed, at 508, and the default illumination pattern is applied to the keyboard, at 510, and/or the DER system detects that another application is being executed by the computing system, at 502.
While specific examples and applications of the disclosure have been illustrated and described, it is understood that the disclosure is not limited to the precise configurations and components disclosed herein. Accordingly, many changes may be made to the details of the above-described examples without departing from the underlying principles of this disclosure consistent with the following claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2019/056336 | 10/15/2019 | WO |