Example embodiments of the present invention generally relate to communication technology, and more particularly, relate to an apparatus and method for a user input device that is worn by a user.
The modern communications era has brought about a tremendous expansion of wireline and wireless networks. Computer networks, television networks, and telephony networks are experiencing an unprecedented technological expansion fueled by consumer demands. Together with these expanding network capabilities and communication speeds, the devices that use these networks have experienced tremendous technological steps forward in capabilities, features, and user interface. Such devices may also use accessories such as remote input devices, Bluetooth™ headsets or wired headsets with limited functional capabilities. Devices communicating via these networks may be used for a wide variety of purposes including, among other things, Short Messaging Services (SMS), Instant Messaging (IM) service, E-mail, voice calls, music recording/playback, video recording/playback, and internet browsing. Such capabilities have made these devices very desirable for those wishing to stay in touch and make themselves available to others.
Hands free devices have increased in popularity through the advent of laws prohibiting hand-held mobile device usage when driving a vehicle and the desire of users to communicate without monopolizing the use of a hand. Such devices may include a wired headset that is physically connected to a mobile device or a Bluetooth™ headset that is connected to a mobile device through a wireless Personal Area Network connection. Additionally, Bluetooth™ vehicle accessories may allow a user to use a speaker and microphone within a vehicle to communicate over their mobile device. Such devices may enable the user of a mobile device to carry on a voice call through their mobile device without having to hold the device. Further, a Bluetooth™ headset or vehicle accessory may allow a user to carry on a voice call while the device remains in a purse, pocket, glove box, or other nearby location that may not be readily accessible. Such Bluetooth™ devices or headsets and vehicle accessories using other communications protocols may have limited functionality with respect to the device to which they are paired or synchronized. For example, a Bluetooth™ headset may be capable of adjusting the volume of a speaker, answering an incoming call, and ending a call.
While accessories exist that enable a user to carry on a phone call, listen to music, or provide voice commands, few accessories provide more than a limited amount of functionality with respect to the device to which they are paired.
In general, example embodiments of the present invention provide an improved method of providing input to a user device. In particular, the method of example embodiments provide for receiving sensor information of a device configured to be worn by a user, determining a motion input indicated by the received information such that the motion input relates to motion of the device relative to the user, determining a function based at least in part on the motion input, and causing the function to be performed. The device may be configured to be worn on a device bearing part of the user and the motion input may relate to motion of the device relative to the device bearing part of the user. The device bearing part of the user may be a finger and the device may substantially encircle the finger. The motion input may include at least one of axial movement along a first axis which extends along the length of the device bearing part of the user, rotational movement about the first axis, or rotational movement about a second axis that is perpendicular to the first axis. The motion input may be detected using a sensor disposed on an inner surface of the device and the inner surface may include a surface that is in contact with the device bearing part of the user. The method may further include learning the motion input bay a learning process that includes receiving a motion input from the user where the motion input causes a motion of the device relative to the user, causing the motion input to be stored, and associating the motion input with a function. The function may include causing a command to be sent to another device.
According to another embodiment of the invention, an apparatus may be provided that includes at least one processor and at least one memory including computer program code where the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to receive sensor information of a device configured to be worn by a user, determine a relative motion input indicated by the received information, where the motion input relates to motion of the device relative to the user, determine a function based at least in part on the motion input, and causing the function to be performed. The device may be configured to be worn on a device bearing part of the user and the motion input may relate to motion of the device relative to the device bearing part of the user. The device bearing part of the user may be a finger and the device may substantially encircle the finger. The motion input may include at least one of axial movement along a first axis which extends along the length of the device bearing part of the user, rotational movement about the first axis, or rotational movement about a second axis which is perpendicular to the first axis. The motion input may be detected using a sensor disposed on an inner surface of the device and the inner surface may include a surface that is in contact with the device bearing part of the user. The at least one memory and the computer program code may further be configured to, with the at least one processor, cause the apparatus to receive a motion input from the user, where the motion input causes a motion of the device relative to the user, cause the motion input to be stored, and associate the motion input with a function. The function may include causing a command to be sent to another device.
According to still another embodiment of the invention, a computer program product is provided that comprises at least one computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions including program code instructions for receiving sensor information of a device configured to be worn by a user, program code instructions for determining a motion input indicated by the received information, where the motion input relates to motion of the device relative to the user, program code instructions for determining a function based at least in part on the motion input, and program code instructions for causing the function to be performed. The device may be configured to be worn on a device bearing part of the user and the motion input may relate to motion of the device relative to the device bearing part of the user. The device bearing part of the user may be a finger and the device may substantially encircle the finger. The motion input may include at least one of axial movement along a first axis which extends along the length of the device bearing part of the user, rotational movement about the first axis, or rotational movement about a second axis that is perpendicular to the first axis. The motion input may be detected using a sensor disposed on an inner surface of the device and the inner surface may include a surface that is in contact with the device bearing part of the user. The computer executable program code instructions may further include program code instructions for receiving a motion input from the user, wherein the motion input causes a motion of the device relative to the user, program code instructions for causing the motion input to be stored, and program code instructions for associating the motion input with a function.
According to yet another embodiment of the invention, a means is provided for providing input to a user device. In particular, example embodiments provide means for receiving sensor information of a device configured to be worn by a user, means for determining a motion input indicated by the received information such that the motion input relates to motion of the device relative to the user, means for determining a function based at least in part on the motion input, and means for causing a function to be performed. The device may be configured to be worn on a device bearing part of the user and the motion input may relate to motion of the device relative to the device bearing part of the user. The device bearing part of the user may be a finger and the device may substantially encircle the finger. The motion input may include at least one of axial movement along a first axis which extends along the length of the device bearing part of the user, rotational movement about the first axis, and rotational movement about a second axis that is perpendicular to the first axis. The motion input may be detected using a sensor disposed on an inner surface of the device and the inner surface may include a surface that is in contact with the device bearing part of the user. The motion input may be learned through a learning process that includes means for receiving a motion input from the user where the motion input causes a motion of the device relative to the user, means for causing the motion input to be stored, and means for associating the motion input with a function. The function may include causing a command to be sent to another device.
Having thus described the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
Some example embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. Indeed, various embodiments of the invention may be embodied in many different forms and should not be construed as limited to the example embodiments set forth herein; rather, these example embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like reference numerals refer to like elements throughout. As used herein, the terms “data,” “content,” “information” and similar terms may be used interchangeably to refer to data capable of being transmitted, received and/or stored in accordance with embodiments of the present invention.
Additionally, as used herein, the term ‘circuitry’ refers to (a) hardware-only circuit implementations (e.g., implementations in analog circuitry and/or digital circuitry); (b) combinations of circuits and computer program product(s) comprising software and/or firmware instructions stored on one or more computer readable memories that work together to cause an apparatus to perform one or more functions described herein; and (c) circuits, such as, for example, a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation even if the software or firmware is not physically present. This definition of ‘circuitry’ applies to all uses of this term herein, including in any claims. As a further example, as used herein, the term ‘circuitry’ also includes an implementation comprising one or more processors and/or portion(s) thereof and accompanying software and/or firmware. As another example, the term ‘circuitry’ as used herein also includes, for example, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or a similar integrated circuit in a server, a cellular network device, other network device, and/or other computing device.
While several embodiments of the user device may be illustrated and hereinafter described for purposes of example, other types of user devices, such as personal digital assistants (PDAs), pagers, mobile televisions, gaming devices, all types of computers (e.g., laptops or mobile computers), cameras, audio/video players, radio, global positioning system (GPS) devices, or any combination of the aforementioned, and other types of communication devices, may employ embodiments of the present invention. As described, the user device may include various means for performing one or more functions in accordance with embodiments of the present invention, including those more particularly shown and described herein. It should be understood, however, that a user device may include alternative means for performing one or more like functions, without departing from the spirit and scope of the present invention.
The user device 10 illustrated in
It is understood that the apparatus, such as the processor 40, may include circuitry implementing, among others, audio and logic functions of the user device 10. The processor may be embodied in a number of different ways. For example, the processor may be embodied as various processing means such as processing circuitry, a coprocessor, a controller or various other processing devices including integrated circuits such as, for example, an ASIC (application specific integrated circuit), an FPGA (field programmable gate array), a hardware accelerator, and/or the like. In an example embodiment, the processor may be configured to execute instructions stored in a memory device or otherwise accessible to the processor. As such, the processor may be configured to perform the processes, or at least portions thereof, discussed in more detail below with regard to
The user device 10 may also comprise a user interface including an output device such as an earphone or speaker 44, a ringer 42, a microphone 46, a display 48, and a user input interface, which may be coupled to the processor 40. The user input interface, which allows the user device to receive data, may include any of a number of devices allowing the user device to receive data, such as a keypad 50, a touch display (not shown) or other input device. In embodiments including the keypad, the keypad may include numeric (0-9) and related keys (#, *), and other hard and soft keys used for operating the mobile terminal 10. Alternatively, the keypad may include a conventional QWERTY keypad arrangement. The keypad may also include various soft keys with associated functions. In addition, or alternatively, the user device may include an interface device such as a joystick or other user input interface. The user device may further include a battery 54, such as a vibrating battery pack, for powering various circuits that are used to operate the user device, as well as optionally providing mechanical vibration as a detectable output.
The user device 10 may further include a user identity module (UIM) 58, which may generically be referred to as a smart card. The UIM may be a memory device having a processor built in. The UIM may include, for example, a subscriber identity module (SIM), a universal integrated circuit card (UICC), a universal subscriber identity module (USIM), a removable user identity module (R-UIM), or any other smart card. The UIM may store information elements related to a mobile subscriber. In addition to the UIM, the user device may be equipped with memory. For example, the user device may include volatile memory 60, such as volatile Random Access Memory (RAM) including a cache area for the temporary storage of data. The user device may also include other non-volatile memory 62, which may be embedded and/or may be removable. The non-volatile memory may additionally or alternatively comprise an electrically erasable programmable read only memory (EEPROM), flash memory or the like. The memories may store any of a number of pieces of information, and data, used by the user device to implement the functions of the user device. For example, the memories may include an identifier, such as an international mobile equipment identification (IMEI) code, capable of uniquely identifying the user device. Furthermore, the memories may store instructions for determining cell id information. Specifically, the memories may store an application program for execution by the processor 40, which determines an identity of the current cell, e.g., cell id identity or cell id information, with which the user device is in communication.
In general, example embodiments of the present invention provide a method, apparatus, and computer program product for entering user input into a device through an accessory device. Devices, and particularly mobile terminals such as a cellular telephone, may use a variety of accessories intended to improve the user interface and more seamlessly integrate the device with a user's daily activities. Such devices may include wired or wireless headsets that enable a user to engage in a voice call through their device without requiring the device to be at or near the user's ear or mouth. Such accessories include Bluetooth™ headsets that may allow a user to merely be in proximity to the device while actively carrying on a conversation via the device. Such accessories may prove valuable when the user is otherwise occupied, such as when the user is driving, or performing any task that may require the use of both hands. While the wired and wireless headsets described above provide an improved method of communicating verbally via a device, initiating a voice call or activating other features of a device may still require the device to be physically manipulated.
An example embodiment of the present invention may allow the user of a device, such as user device 10, to interact with the user device without requiring physical manipulation of the device. The user input device of example embodiments of the present invention may allow a user to dial a phone number from a mobile phone, interact with services or applications available on a device, or otherwise operate a device without handling the user device itself. Such a user input device may be desirable when a user is driving a vehicle, jogging, or if the user is simply seeking an easier way to perform functions on a user device. Further, user input devices as described herein may be useful for discretely operating a user device in situations where it may be impolite or improper to physically handle, view, and operate a user device. Such situations may include meetings, formal ceremonies, during meals, at theaters, or other events where distractions are discouraged. Example embodiments of the present invention may provide a user input device that may rely on motion relative to a user to provide input to a device that is paired or synchronized with the remove user input device.
Various embodiments of the present invention may include an apparatus 300 that is configured to be worn by a user, such as on a finger as depicted in
An example embodiment of the present invention is depicted in
The sensor information received by the sensor 510 may be determined by the processing device 520 to be a motion input that is determined to be associated with a function. The function may include transmitting or sending a command to a user device that the user input device is configured to control. A command may be an instruction such as increasing a volume, placing a call, answering a call, changing a radio station, etc. The user input device 500 may determine that the motion input is associated with a function that causes a command to be sent and subsequently cause the command to be transmitted or sent to a user device; however, the user input device may also cause only the motion input to be transmitted to a user device such that the user device associates the motion input with a function. Association between the motion input and the examples of functions that may be performed using user input devices according to an example embodiment of the present invention may include controlling a volume (e.g., a ringer volume, a call volume, a music playback volume, etc.) by, for example, rotating the ring around the finger. One direction of rotation may increase the volume while the opposite way may decrease the volume. Another function may include answering a voice call, such as when a headset is connected to the user device and the user does not or cannot physically manipulate the user device to answer the call. Any number of functions may be performed through inputs received by user input devices according to the present invention and the functions may be user configurable such that the user dictates which motions of the user input device correspond to which functions of the user device. While the number of single-stage motions (e.g., sensor information in a single direction), may be limited, single-stage motions may be multiplexed (e.g., back-and-forth sensor information) to achieve a much greater number of functions. The association between the motion input and the function may be stored in a memory at either the user device or the user input device such that either the user input device or the user device may determine the function based at least in part on the motion input received.
The sensor depicted in
Example embodiments of the present invention may include multiple sensors that may be configured to cooperate by receiving sensor information related to movement in or about different axes or redundant sensors that receive sensor information confirm the movement observed by other sensors. An example embodiment of the present invention that includes the use of multiple sensors that cooperate to determine the movement of a user input device relative to a user is illustrated in
Example embodiments of the present invention may include a sensor capable of receiving sensor information for reading a user's fingerprints such as with an optical sensor, ultrasonic sensor, passive capacitance sensor, or active capacitance sensor disposed within or on a ring-type form factor of the user input device. Such sensors may further be capable of determining a fingerprint of a wearer of the device. Example embodiments may include a security feature whereby the user input device is configured to properly function only when worn by a recognized, authorized user. An authorized user may register the fingerprint (or multiple fingerprints) with the user input device using a configuration program or wizard presented on a user device, such as a mobile terminal, and configure a fingerprint or multiple fingerprints to be used in conjunction with the user input device much in the same way a password or key-sequence may be entered on a mobile terminal to unlock the device. When such an embodiment is worn by a user that is not recognized or not authorized, the user input device may not function or may function with limited functionality.
Further embodiments that may employ fingerprint-reading sensors may be configured to alter their function based upon the fingerprint observed by the user input device. Such functionality may be used to operate the user input device differently when worn by different users (e.g., users may personalize the functions of a user input device to their liking). Fingerprint recognition may also be used to alter the function of a user input device based upon where the device is worn on a user's hand. As depicted in
As the skin surfaces or fingerprints differ for each person and necessarily differ between fingers of an individual, user input devices according to example embodiments of the present invention may have a “learning” mode to learn the unique characteristics of each of the front and back surfaces of each of the phalanges of the index, middle, ring, and pinky fingers for a given user. A learning mode may require a user of the user input device to place the device on each phalange and identify on which finger and phalange they are wearing the device. A learning application may be executed by a device, such as a mobile terminal, which guides a user through the learning mode by instructing the user which finger, phalange, and surface to contact as a form of calibration. This learning mode may store fingerprint data information for a user such that when a fingerprint is obtained, the fingerprint data is compared to the fingerprint data of stored fingerprints to determine which finger and which phalange corresponds to the obtained fingerprint data. The fingerprint data information may be stored on a memory within the user input device. The fingerprint data may also or alternatively be stored in a memory of a user device that is “paired” with the user input device such that the user input device obtains the fingerprint and sends that fingerprint data to the user device for the user device to determine which finger and which phalange has been read to ascertain which functions to perform. Once a user completes such a “learning” mode, the user may be able to assign functions to any one of the surfaces of the phalanges to correspond to a function of the user device.
While embodiments of the present invention have been described herein with reference to a ring-type embodiment of a user input device, embodiments of the present invention are not limited to ring-type devices, but could be embodied in other form factors such as bracelets, buttons, or other wearable configurations that permit movement of the device relative to a wearer of the device.
User input devices according to embodiments of the present invention may be “paired” or synchronized with a user device, such as a mobile terminal (e.g., establish a unique path of communication shared only between the user input device and the user device), such as a mobile device, through a wireless Personal Area Networks such as for example Bluetooth™ connection which would prevent the user input device from interfering with other user devices and would prevent other user devices from interfering with the input of the paired user device. The “pairing” may occur at the time of manufacture if a user device is to be sold with a user input device according to embodiments of the present invention, or the “pairing” may be performed by a user in instances where the input device is sold separately as an accessory.
According to example embodiments of the user input device of the present invention, the user input device may be worn whether or not the user device is in use. In this regard, a need may exist to be able to “wake up” or unlock the input device to preclude accidental input. A sequence of movements or motions may be configured as a “wake up” sequence that is unlikely to occur accidentally. The sequence of movements or motions may be stored, for example, in a memory of a user device or the user input device such that upon detection of a sequence of movements or motions, the user device or user input device may compare the movements or motions with those required to “wake up” the device or user input device. Further, another sequence of movements or motions may be configured to lock the user input device from further input until the “wake up” sequence is given to unlock the user input device. The locking functionality may be useful for when a user is not actively using the user input device and intends for any accidental motion of the user input device that would otherwise cause an unintended input to be precluded. Such a “wake up” sequence may include rocking the user input device back-and-forth several times or rotating the user input device in a complete 360 degree turn. The “wake up” sequence may be user configurable as individual users may be more prone to certain unintended motions that would work well as “wake up” sequences for other users.
The sensor information received by a sensor as depicted in the example embodiment of
The example embodiment of
Example embodiments of the present invention may further be configured to receive sensor information from both motion and touch such that the user input device is capable of both a touch input and a motion input. For example, embodiments such as the embodiment of
The functions associated with each of the available touch inputs or motion inputs of a user input device according to example embodiments of the present invention may be user-configurable such that the user can select the desired function that each different input performs. Further, with the aid of multiplexing single-mode inputs, the user may configure a large multitude of functions with only a limited number of available inputs. The functions may be user device dependent such that a user input device may be configured to operate with multiple user devices and with each device, a different set of functions may be used. For example, if the user input device is “paired” with a mobile phone, the available functions may correspond to inputs related to answering, ignoring, or silencing a phone call. If the user input is “paired” with a music player device, an alternative set of functions may be available that includes pause, play, volume, fast-forward, and reverse among other inputs.
As user devices often have multiple functions, such as a mobile phone that is also a music player device, the user input device may be capable of switching between sets of functions based upon the active application of a user device. For example, while the mobile device is in a music playback mode, the user input device may function with the music player controls described above. If the user device is in a phone call mode, for example with a Bluetooth™ headset, the user input device may operate with a separate set of functions related to the phone call functionality.
User input devices according to example embodiments of the present invention may be further configured such that a user may associate each available motion input or touch input to a function. The user may enter a learning or set-up mode in which the user may touch or move the user input device to provide sensor information corresponding to a motion input or a touch input. The user may then choose a function to which they wish to generate an association to the motion input or touch input with. The motion input or touch input association with the function may be stored such that when the user replicates the motion or touch that corresponds to the motion input or touch input, the appropriate function is determined based at least in part on the motion input or the touch input.
Additionally, the functions of the user input device may be switched by the user device without user input in instances such as when a user is listening to music and the music player functions are active and a phone call is received by the user device. The user device may cause the user input device to switch from the music player mode to the phone function mode. Optionally, there may be a separate set of functions that corresponds to an incoming phone call during music player mode in which abbreviated functions or phone call specific functions are available to a user, such as “answer” and “ignore” among other possible functions.
As a display may not be visible for a user device while operating a user input device according to embodiments of the present invention, the user input device may be configured to provide non-visual feedback to a user to confirm that an instruction was received when the user input device receives an input. Such non-visual feedback may be in the form of an audible tone or a vibratory response from the user device, the user input device, or another accessory such as a headset worn by the user.
A flowchart illustrating operations performed by a user input device of
Accordingly, blocks of the flowcharts support combinations of means for performing the specified functions. It will also be understood that one or more blocks of the flowcharts, and combinations of blocks in the flowcharts, can be implemented by special purpose hardware- based computer systems which perform the specified functions, or combinations of special purpose hardware and computer instructions. The function of each operation of the flowcharts described herein may be performed by a processor bringing about the operation or transformation set forth in the flow chart operations. Blocks of the flowcharts and flowchart elements depicted in dashed lines may be optional operations that can be omitted from example embodiments of the present invention.
A method according to an example embodiment of the present invention is illustrated in the flowchart of
Another method according to an example embodiment of the present invention is illustrated in the flowchart of
Embodiments of the present invention may be configured as a system, method or electronic device. Accordingly, embodiments of the present invention may be comprised of various means including entirely of hardware or any combination of software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product on a computer-readable storage medium having computer-readable program instructions (e.g., computer software) embodied in the tangible, non-transitory storage medium. Any suitable computer-readable storage medium may be utilized including hard disks, CD-ROMs, optical storage devices, or magnetic storage devices.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although the foregoing descriptions and associated drawings describe example embodiments in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the spirit and scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.