Mobile computing devices have been developed to increase the functionality that is made available to users in a mobile setting. For example, a user may interact with a mobile phone, tablet computer, or other mobile computing device to check email, surf the web, compose texts, interact with applications, and so on. However, traditional mobile computing devices often employed a virtual keyboard that was accessed using touchscreen functionality of the device. This was generally employed to maximize an amount of display area of the computing device.
Use of the virtual keyboard, however, could be frustrating to a user that desired to provide a significant amount of inputs, such as to enter a significant amount of text to compose a long email, document, and so forth. Thus, conventional mobile computing devices were often perceived to have limited usefulness for such tasks, especially in comparison with ease at which users could enter text using a conventional keyboard, e.g., of a conventional desktop computer. Use of the conventional keyboards, though, with the mobile computing device could decrease the mobility of the mobile computing device and thus could make the mobile computing device less suited for its intended use in mobile settings.
Audio feedback techniques are described. In one or more implementations, a signal is received from a pressure sensitive key of an input device and audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key. The determined audio feedback is then caused to be output.
In one or more implementations, a keyboard comprises a plurality of keys, each configured to be selected using one or more fingers of a user's hand and to cause output of audio feedback responsive to the selection, the output of the audio feedback configured to appear to the user as originating from a location of a respective key.
In one or more implementations, a system comprises one or more modules implemented at least partially in hardware and configured to cause output of audio feedback that is determined based on a location at which a key of a keyboard is pressed.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items. Entities represented in the figures may be indicative of one or more entities and thus reference may be made interchangeably to single or plural forms of the entities in the discussion.
Input devices used by a mobile device may be difficult to interact with due to compromises made in configuring the input device to support the mobile form factor of the device. For example, pressure sensitive keys may be used as part of an input device to support a relatively thin form factor, such as approximately less than three and a half millimeters. However, pressure sensitive keys may not provide a degree of feedback that is common with conventional mechanical keyboards and therefore may result in missed hits and partial hits to intended keys of the keyboard. In another example, a virtual keyboard that is displayed by a display device of the computing device may have similar difficulties.
Audio feedback techniques are described. These techniques may be used to provide audio feedback responsive to user interaction with an input device. For example, these techniques may be used to output different sounds for different keys, sounds dependent on where a key is pressed, sounds that appear to originate from a key that is being pressed, adjustment based on environment, adjustment based on how hard the key is pressed (e.g., timbre, volume), support themes that are user selectable for different sounds, provide audio feedback to indicate when one or more fingers of the user's hand are positioned at a home row of a keyboard, and so on. Thus, the audio feedback techniques may support a variety of functionality for a variety of different input device, such as pressure sensitive keyboards, virtual keyboards, mechanically switched keyboards, and other input devices, further discussion of which may be found in relation to the following figures.
In the following discussion, an example environment is first described that may employ the techniques described herein. Example procedures are then described which may be performed in the example environment as well as other environments. Consequently, performance of the example procedures is not limited to the example environment and the example environment is not limited to performance of the example procedures.
The computing device 102, for instance, is illustrated as including an input/output module 108. The input/output module 108 is representative of functionality relating to processing of inputs and rendering outputs of the computing device 102. A variety of different inputs may be processed by the input/output module 108, such as inputs relating to functions that correspond to keys of the input device 104, keys of a virtual keyboard displayed by the display device 110 to identify gestures and cause operations to be performed that correspond to the gestures that may be recognized through the input device 104 and/or touchscreen functionality of the display device 110, and so forth. Other input devices are also contemplated, such as a mouse, track pad, camera to detect gestures, and so on. Thus, the input/output module 108 may support a variety of different input techniques by recognizing and leveraging a division between types of inputs including key presses, gestures, and so on.
In the illustrated example, the input device 104 is configured as a keyboard having a QWERTY arrangement of keys although other arrangements of keys are also contemplated. Further, other non-conventional configurations are also contemplated, such as a game controller, configuration to mimic a musical instrument, and so forth. Thus, the input device 104 and keys incorporated by the input device 104 may assume a variety of different configurations to support a variety of different functionality.
As previously described, the input device 104 is physically and communicatively coupled to the computing device 102 in this example through use of a flexible hinge 106. The flexible hinge 106 is flexible in that rotational movement supported by the hinge is achieved through flexing (e.g., bending) of the material forming the hinge as opposed to mechanical rotation as supported by a pin, although that embodiment is also contemplated. Further, this flexible rotation may be configured to support movement in one direction (e.g., vertically in the figure) yet restrict movement in other directions, such as lateral movement of the input device 104 in relation to the computing device 102. This may be used to support consistent alignment of the input device 104 in relation to the computing device 102, such as to align sensors used to change power states, application states, and so on.
The flexible hinge 106, for instance, may be formed using one or more layers of fabric and include conductors formed as flexible traces to communicatively couple the input device 104 to the computing device 102 and vice versa. This communication, for instance, may be used to communicate a result of a key press to the computing device 102, receive power from the computing device, perform authentication, provide supplemental power to the computing device 102, and so on. The flexible hinge 106 may be configured in a variety of ways, further discussion of which may be found in relation to the following figure.
The connection portion 202 is flexibly connected to a portion of the input device 104 that includes the keys through use of the flexible hinge 106. Thus, when the connection portion 202 is physically connected to the computing device the combination of the connection portion 202 and the flexible hinge 106 supports movement of the input device 104 in relation to the computing device 102 that is similar to a hinge of a book.
For example, rotational movement may be supported by the flexible hinge 106 such that the input device 104 may be placed against the display device 110 of the computing device 102 and thereby act as a cover. The input device 104 may also be rotated so as to be disposed against a back of the computing device 102, e.g., against a rear housing of the computing device 102 that is disposed opposite the display device 110 on the computing device 102.
Naturally, a variety of other orientations are also supported. For instance, the computing device 102 and input device 104 may assume an arrangement such that both are laid flat against a surface as shown in
The connecting portion 202 is illustrated in this example as including magnetic coupling devices 204, 206, mechanical coupling protrusions 208, 210, and a plurality of communication contacts 212. The magnetic coupling devices 204, 206 are configured to magnetically couple to complementary magnetic coupling devices of the computing device 102 through use of one or more magnets. In this way, the input device 104 may be physically secured to the computing device 102 through use of magnetic attraction.
The connecting portion 202 also includes mechanical coupling protrusions 208, 210 to form a mechanical physical connection between the input device 104 and the computing device 102. The mechanical coupling protrusions 208, 210 are shown in greater detail in the following figure.
The mechanical coupling protrusions 208, 210 are configured to be received within complimentary cavities within the channel of the computing device 102. When so received, the mechanical coupling protrusions 208, 210 promote a mechanical binding between the devices when forces are applied that are not aligned with an axis that is defined as correspond to the height of the protrusions and the depth of the cavity.
For example, when a force is applied that does coincide with the longitudinal axis described previously that follows the height of the protrusions and the depth of the cavities, a user overcomes the force applied by the magnets solely to separate the input device 104 from the computing device 102. However, at other angles the mechanical coupling protrusion 208, 210 are configured to mechanically bind within the cavities, thereby creating a force to resist removal of the input device 104 from the computing device 102 in addition to the magnetic force of the magnetic coupling devices 204, 206. In this way, the mechanical coupling protrusions 208, 210 may bias the removal of the input device 104 from the computing device 102 to mimic tearing a page from a book and restrict other attempts to separate the devices.
The connecting portion 202 is also illustrated as including a plurality of communication contacts 212. The plurality of communication contacts 212 is configured to contact corresponding communication contacts of the computing device 102 to form a communicative coupling between the devices. The communication contacts 212 may be configured in a variety of ways, such as through formation using a plurality of spring loaded pins that are configured to provide a consistent communication contact between the input device 104 and the computing device 102. Therefore, the communication contact may be configured to remain during minor movement of jostling of the devices. A variety of other examples are also contemplated, including placement of the pins on the computing device 102 and contacts on the input device 104.
The flexible contact layer 402 in this example includes a force sensitive ink 410 disposed on a surface of the flexible contact layer 402 that is configured to contact the sensor substrate 404. The force sensitive ink 410 is configured such that an amount of resistance of the ink varies directly in relation to an amount of pressure applied. The force sensitive ink 410, for instance, may be configured with a relatively rough surface that is compressed against the sensor substrate 404 upon an application of pressure against the flexible contact layer 402. The greater the amount of pressure, the more the force sensitive ink 410 is compressed, thereby increasing conductivity and decreasing resistance of the force sensitive ink 410. Other conductors may also be disposed on the flexible contact layer 402 without departing from the spirit and scope therefore, including other types of pressure sensitive and non-pressure sensitive conductors.
The sensor substrate 404 includes one or more conductors 412 disposed thereon that are configured to be contacted by the force sensitive ink 410 of the flexible contact layer 402. When contacted, an analog signal may be generated for processing by the input device 104 and/or the computing device 102, e.g., to recognize whether the signal is likely intended by a user to provide an input for the computing device 102. A variety of different types of conductors 412 may be disposed on the sensor substrate 404, such as formed from a variety of conductive materials (e.g., silver, copper), disposed in a variety of different configurations such as inter-digitated trace fingers, and so on.
This flexibility permits a relatively large area of the flexible contact layer 402, and thus the force sensitive ink 410, to contact the conductors 412 of the sensor substrate 404. Thus, a relatively strong signal may be generated. Further, because the flexibility of the flexible contact layer 402 is relatively high at this location, a relatively large amount of the force may be transferred through the flexible contact layer 402, thereby applying this pressure to the force sensitive ink 410. As previously described, this increase in pressure may cause a corresponding increase in conductivity of the force sensitive ink and decrease in resistance of the ink. Thus, the relatively high amount of flexibility of the flexible contact layer at the first location may cause a relatively stronger signal to be generated in comparison with other locations of the flexible contact layer 402 that are located closer to an edge of the key, an example of which is described in relation to the following figure.
This reduced flexibility may cause a reduction in an area of the flexible contact layer 402, and thus the force sensitive ink 410, that contacts the conductors 412 of the sensor substrate 404. Thus, a signal produced at the second location may be weaker than a signal produced at the first location of
Further, because the flexibility of the flexible contact layer 402 is relatively low at this location, a relatively low amount of the force may be transferred through the flexible contact layer 402, thereby reducing the amount of pressure transmitted to the force sensitive ink 410. As previously described, this decrease in pressure may cause a corresponding decrease in conductivity of the force sensitive ink and increase in resistance of the ink in comparison with the first location of
However, as previously described techniques may be employed to provide feedback and thus promote consistency of the contact of the flexible contact layer 402 with the sensor substrate 404 as well as other features, further discussion of which may be found in relation to the following section.
In another example, functionality of the audio feedback module 702 may be implemented in part by both the input device 104 and the computing device 102. For instance, audio feedback module 702 functionality of the input device 104 may be used to detect and determine audio feedback that is to be output and then cause the computing device 102 to perform this output. This may be performed through interaction with an operating system, directly to an amplifier and speakers 704, 706 of the computing device 102 (thereby reducing latency), and so on.
In a further example, the functionality of the audio feedback module 702 may be substantially implemented by the computing device 102, e.g., as part of the input/output module 108. For instance, audio feedback module 702 functionality of the input/output module 108 may receive a signal from the input device 104. The signal may then be processed to determine audio feedback that is to be output, which may then be performed by the computing device 102 itself. Thus, the audio feedback module 702 may be implemented in a variety of different ways to provide the functionality described herein and therefore the following discussion is not to be taken as limited to any particular said implementation unless stated otherwise.
The audio feedback module 702 may leverage audio data 708 to provide a wide variety of feedback. For example, the audio data 708 may support themes (e.g., collections of sounds) that are user selectable, e.g., via a menu in a user interface. These themes may also be selected automatically based on an input device attached to the computing device, based on applications that are being executed by the computing device 102, and so forth. For instance, a first set of sounds may be utilized as audio feedback for a word processing application while a second set of sounds may be utilized as audio feedback for a video game. In another example, sounds may be associated with a key and/or group of keys. Therefore, when a key is pressed a sound from a set of sounds may be selected, e.g., via round robin, random, by pressure, and so on. In another example, sounds may be associated with key groups, e.g., letters, numbers, modifier keys (shift, control), navigation keys (arrows, page up, page down), function keys, and so on.
Audio feedback may be output in a variety of ways. In the illustrated example, speaker 704, 706 are disposed within a housing of the computing device 102, although other examples are also contemplated as previously described, such as incorporated as part of the input device 104. Further, the audio feedback module 702 may be configured to support a variety of different techniques regarding how this output is performed.
The audio feedback module 702, for instance, may leverage techniques such that audio feedback appears to be output from a location at which interaction with a device occurred. The audio feedback module 702, for instance, may be configured to leverage the speakers 704, 706 to give an impression to a user of the input device 104 that the feedback occurred at a particular key that was pressed by the user. This may include use of stereophonic techniques, head transfer function models, and so on that may give an indication of origination of the audio feedback that is different from where the output actually occurs.
This may include alteration of a left to right and even up or down appearance of a point of origination of the audio feedback to a user such that that point appears to correspond to a location at which the input occurred. Further, this may also be based on a likely location of a user. This location, for instance, may be modeled statically based on a likely head position of a user when typing. The location may also be determined dynamically, such as through use of one or more sensors, e.g., a forward facing image capture device, microphone, and so on.
The audio feedback module 702 may be configured to provide a wide range of audio feedback based on the audio data 708. In the illustrated example, for instance, the audio feedback module 702 may be configured to provide audio feedback that is dependent on which key of a keyboard is pressed. The audio data 708, for instance, may be configured to model a keystroke of individual keys of a keyboard. The audio feedback module 702 may then determine which key was pressed and provide audio feedback that corresponds to that key. A variety of other examples are also contemplated, such as feedback for alphabetic and/or numeric keys being different from feedback for non-alphanumeric keys, e.g., a carriage return or “enter” key. A variety of other examples are also contemplated, further instances of which may be found in relation to the following discussion of the next figure.
As previously described, conventional input devices configured to mobile use may provide insufficient feedback and thus may make it increasingly difficult for a user to interact with the device. Accordingly, audio feedback techniques may be leveraged to aid this interaction. For example, an audio feedback technique may be supported by the audio feedback module 702 to aid a user in locating a home row of keys of a keyboard. This may include output of sounds that get increasingly more harmonious the closer a user's fingers are initially located to the home row. This feedback may cease once the home row is located, after a defined period of time, responsive to removal of the user's fingers from a surface of the input device 104, and so on.
In another example, an output of audio feedback may be adjusted based on an environment in which the input device 104 is located. For instance, the input device 104 and/or computing device 102 may leverage one or more sensors (e.g., a microphone) to determine an ambient noise level of an environment and adjust a volume or other characteristic of the audio feedback accordingly, such as to be just above the ambient noise level. This determination may be performed automatically such that the audio feedback does not intrude upon the user's experience, such as when changing from a noisy to a quiet environment and vice versa.
In a further example, the output of the audio feedback may be adjusted based on an amount of pressure that is detected for a press of the key. This may be performed using the pressure sensitive keys described earlier, a contact area for a capacitive touchscreen, and so on. Further, the adjusting may be performed in a variety of ways, which may include adjusting volume, timbre, or other audio characteristics of the audio feedback. A variety of other examples are also contemplated which may be used to aid a user in locating key of the input device, an example of which is described as follows.
First and second key presses 902, 904 are shown through circles that are illustrated in phantom for the same key, which is the “i” key in the illustrated example. In this example, the first key press 902 is positioned proximal to a center of the key while a second key press 904 is positioned proximal to an edge of the key. As described in relation not
The audio feedback module 702 may therefore be configured to provide audio feedback that is dependent on where a key is pressed. This may include an output of audio feedback that mimics a regular key press as performed for a mechanical keyboard for the first key press 902 and therefore readily informs the user that the press was “good.” However, for the second key press 904 the audio feedback may be configured to indicate a miss hit of the key. Thus, even if a user is unable to “feel” the edge of the key (e.g., for a virtual keyboard) the audio feedback may indicate a potential miss hit of the key. The user may then readily correct where the key is subsequently pressed, thereby promoting an efficient user experience. A variety of other examples are also contemplated.
The following discussion describes audio feedback techniques that may be implemented utilizing the previously described systems and devices. Aspects of each of the procedures may be implemented in hardware, firmware, or software, or a combination thereof. The procedures are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. In portions of the following discussion, reference will be made to
Audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key (block 1004). As previously described, the audio feedback may be determined based on a variety of factors. These factors may be used to output different sounds for different keys, sounds dependent on where a key is pressed, sounds that appear to originate from a key that is being pressed, adjustment based on environment, adjustment based on how hard the key is pressed (e.g., timbre, volume), support themes that are user selectable for different sounds, provide audio feedback to indicate when one or more fingers of the user's hand are positioned at a home row of a keyboard, and so on.
The determined audio feedback is then caused to be output (block 1006). This may include the input device 104 causing speakers 704, 706 of the computing device 102 to output the sounds, output by the input device 104 itself, and so forth as previously described in relation to
The example computing device 1102 as illustrated includes a processing system 1104, one or more computer-readable media 1106, and one or more I/O interface 1108 that are communicatively coupled, one to another. Although not shown, the computing device 1102 may further include a system bus or other data and command transfer system that couples the various components, one to another. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures. A variety of other examples are also contemplated, such as control and data lines.
The processing system 1104 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 1104 is illustrated as including hardware element 1110 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors. The hardware elements 1110 are not limited by the materials from which they are formed or the processing mechanisms employed therein. For example, processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor-executable instructions may be electronically-executable instructions.
The computer-readable storage media 1106 is illustrated as including memory/storage 1112. The memory/storage 1112 represents memory/storage capacity associated with one or more computer-readable media. The memory/storage component 1112 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth). The memory/storage component 1112 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth). The computer-readable media 1106 may be configured in a variety of other ways as further described below.
Input/output interface(s) 1108 are representative of functionality to allow a user to enter commands and information to computing device 1102, and also allow information to be presented to the user and/or other components or devices using various input/output devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to recognize movement as gestures that do not involve touch), and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth. Thus, the computing device 1102 may be configured in a variety of ways to support user interaction.
The computing device 1102 is further illustrated as being communicatively and physically coupled to an input device 1114 that is physically and communicatively removable from the computing device 1102. In this way, a variety of different input devices may be coupled to the computing device 1102 having a wide variety of configurations to support a wide variety of functionality. In this example, the input device 1114 includes one or more keys 1116, which may be configured as pressure sensitive keys, mechanically switched keys, and so forth.
The input device 1114 is further illustrated as include one or more modules 1118 that may be configured to support a variety of functionality. The one or more modules 1118, for instance, may be configured to process analog and/or digital signals received from the keys 1116 to determine whether a keystroke was intended, determine whether an input is indicative of resting pressure, support authentication of the input device 1114 for operation with the computing device 1102, and so on.
Various techniques may be described herein in the general context of software, hardware elements, or program modules. Generally, such modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. The terms “module,” “functionality,” and “component” as used herein generally represent software, firmware, hardware, or a combination thereof. The features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
An implementation of the described modules and techniques may be stored on or transmitted across some form of computer-readable media. The computer-readable media may include a variety of media that may be accessed by the computing device 1102. By way of example, and not limitation, computer-readable media may include “computer-readable storage media” and “computer-readable signal media.”
“Computer-readable storage media” may refer to media and/or devices that enable persistent and/or non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media refers to non-signal bearing media. The computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data. Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
“Computer-readable signal media” may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 1102, such as via a network. Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism. Signal media also include any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.
As previously described, hardware elements 1110 and computer-readable media 1106 are representative of modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein, such as to perform one or more instructions. Hardware may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware. In this context, hardware may operate as a processing device that performs program tasks defined by instructions and/or logic embodied by the hardware as well as a hardware utilized to store instructions for execution, e.g., the computer-readable storage media described previously.
Combinations of the foregoing may also be employed to implement various techniques described herein. Accordingly, software, hardware, or executable modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 1110. The computing device 1102 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of a module that is executable by the computing device 1102 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 1110 of the processing system 1104. The instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 1102 and/or processing systems 1104) to implement techniques, modules, and examples described herein.
Although the example implementations have been described in language specific to structural features and/or methodological acts, it is to be understood that the implementations defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed features.
This application claims priority under 35 U.S.C. Section 119(e) to U.S. Provisional Patent Application No. 61/646,799, filed May 14, 2012, the disclosure of which is hereby incorporated by reference in its entirety, this application also incorporates the following applications by reference in their entirety: U.S. patent application Ser. No. 13/470,633, filed May 14, 2012, Attorney Docket Number 336554.01, and titled “Flexible Hinge and Removable Attachment;” and U.S. patent application Ser. No. 13/471,186, filed May 14, 2012, Attorney Docket Number 336563.01, and titled “Input Device Layers and Nesting.”
Number | Date | Country | |
---|---|---|---|
61646799 | May 2012 | US |