1. Field of the Invention
The invention relates to a user interface and, more particularly, to a user interface which uses haptics.
2. Brief Description of Prior Developments
Haptics combine robotics and the physiology of touch for greater realism, interactivity, accuracy, and performance. U.S. Patent Application Publication No. 2001/0035854 A1 discloses use of a haptic feedback for touchpads and other touch controls. Haptics with physical feedback have been studied and implemented to high end gaming devices, virtual hand 3D modeling software, and automotive industry and remote control devices for the home (e.g. Sony NAVITUS™). Previously, haptic systems have been hidden in the device resulting in a need for a larger device volume to cover the system.
Tactile cues of pressing the keys have been implemented with domes or in the case of virtual keys on a touch screen with sound and graphical cues. Sony NAVITUS™ has used a piezo element to move the touch screen to give a tactile cue. This, however, has only been a single pulse. Touch screens can also be expensive and prone to damage when used in a hand-held portable device.
There is a desire to provide a new type of input system which can use haptics for signaling location of a user depressible input actuator on an electronic device without necessarily using a touch screen. There is also a desire to provide a haptics signaling system for a user input which uses a profiled or textured tactile element and/or a vibratory tactile element.
In accordance with one aspect of the invention, a user input system for an electronic device is provided including an input actuator adapted to be depressed by a user to input a signal into the electronic device; and an actuator location signaling system adapted to signal location of the input actuator to the user. The actuator location signaling system includes a textured surface proximate the input actuator for a finger of the user to contact, and a system for moving the textured surface to enhance sensory input to the user's finger while contacting the textured surface.
In accordance with another aspect of the invention, a method of signaling a user of an electronic device of a location of a user input on the electronic device is provided comprising providing the electronic device with a textured surface proximate the user input which is adapted to be depressed by a user to input a signal into the electronic device; and moving the textured surface to enhance sensory input of the textured surface to the user while the user is touching the textured surface.
In accordance with another aspect of the invention, a user input system for an electronic device is provided comprising a cover of the electronic device having a textured surface proximate a user depressible input area; an input actuator located beneath the user depressible input area of the cover; and a vibration system for vibrating the cover at the textured surface to thereby enhance sensory input to a user's touch of the cover at the textured surface such that tactile signaling of location of the input actuator to the user's touch is enhanced.
In accordance with another aspect of the invention, a user input system for an electronic device is provided comprising a cover of the electronic device having a transparent window; and a haptic actuator located beneath the window. The haptic actuator is adapted to move the window for providing tactile sensory input to a user's touch on the window. The haptic actuator comprises an indicium viewable by the user through the window.
In accordance with another aspect of the invention, a user input system for an electronic device is provided comprising an input actuator adapted to be depressed by a user to input a signal into the electronic device; a cover of the electronic device having a portion located over the input actuator which is adapted to be depressed inward by the user to actuate the input actuator; and a haptic actuator comprising a vibrator adapted to vibrate the portion of the cover over the input actuator.
In accordance with another aspect of the invention, a cover for a hand-held portable electronic device is provided comprising a haptic feedback textured surface area and a system for removably mounting the cover to a main section of the hand-held portable electronic device. The haptic feedback textured surface area is adapted to be located above a user depressible input actuator of the hand-held portable electronic device. The textured surface area is adapted to be depressed by a user to actuate the user depressible input actuator and thereby input a signal into the electronic device. The textured surface area has an aesthetic design shape observable by a user. The main section of the hand-held portable electronic device is adapted to have one of a plurality of different covers, having different shaped haptic feedback textured surface areas, mounted thereto such that the cover is adapted to replace a different cover on the main section of the hand-held portable electronic device having a different shaped haptic feedback textured surface area.
In accordance with another aspect of the invention, a cover for a hand-held portable electronic device is provided comprising a system for attaching the cover to a main section of the hand-held portable electronic device to thereby cover a user depressible input actuator on the main section which is adapted to input a signal into the hand-held portable electronic device when the user input actuator is depressed by a user; and a haptic textured surface on an exterior side of the cover which is adapted to be located over the user input actuator. The haptic textured surface comprises a series of symmetrical grooves and/or projections around and/or directly over the user input actuator which is adapted to be felt by touch of the user to indicate location of the user input actuator. The series of symmetrical grooves and/or projections form an aesthetic design which is viewable by the user.
In accordance with another aspect of the invention, a program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine for performing operations to enhance tactile sensation to indicate location of a user input, the operations are provided comprising sensing location of a user's finger on a cover having a haptic textured surface area above the user input; and when the location of the user's finger is sensed proximate the haptic textured surface area above the user input, vibrating the haptic textured surface area to thereby enhance the tactile sensation to the user's finger at the haptic textured surface area.
The foregoing aspects and other features of the invention are explained in the following description, taken in connection with the accompanying drawings, wherein:
Referring to
The device 10 in this embodiment is a mobile telephone. However, features of the invention could be used in any suitable type of user input section of a device including, for example, hand-held portable electronic device such as a music player, a digital camera, a PDA, an Internet browser, a gaming handset, or even with non-portable electronic devices such as a user input of a keypad of a larger electronic device or an industrial tool for example. The mobile telephone 10 can include applications other than a telephone application including, for example, a music player application, a digital camera application, an Internet browser application, and/or a gaming application.
In the embodiment shown in
The electronic circuitry 14 and the housing 12 combine to form user input sections for various features of the telephone 10. In this embodiment the user input sections include a power key feature 20, a volume and/or zoom control feature 22, a navigation and function key feature 24, and an alphanumeric keypad feature 26. More or less user input sections could be provided. In this embodiment, all of these user input sections are adapted to be actuated by depressing a portion of the housing 12 inward to actuate the user input section. However, in alternate embodiments one or more of these user input sections might not be user depressible, or might not have a portion of the housing forming that specific user input section.
Referring also to
The alphanumeric keypad feature 26 generally comprises twelve input sensors 30 located beneath the keypad section 32 of the cover 28. This generally corresponds to an ITU-T (International Telecommunication Union-Telecommunication Standardization Sector) keypad for phone dialing. An ITU-T keypad has a keypad layout utilizing twelve keys. The ITU-T keypad associates letters of the alphabet with the numbers on the keys of the keypad. By example, the number “2” key carries the letters ABC, the number “3” key carries the letters DEF, etc., as is well known. Other types of letter to number arrangements used in key layouts include those disclosed in U.S. Patent Application Publication No. 2006/0103623 which is hereby incorporated by reference in its entirety. In an alternate embodiment, the sensors might not necessarily be discrete.
Referring also to
Referring also to
Preferably the controller 42 only actuates and de-actuates the motion actuator 38 based upon a predetermined event. For example, the predetermined event could be an event in an application software. Preferably, however, the predetermined event comprises a signal from a sensor. More specifically, and referring also to
In a preferred embodiment one finger sensor 46 is provided for each motion actuator 38. The finger sensor 46 is operably coupled to the controller 42. In this embodiment the finger sensor 46 comprises a capacitive sensor which is adapted to sense the presence of a user's finger directly above the sensor 46 at the portion of the cover 28 above the input sensor 30. However, in alternate embodiments, any suitable type of finger sensor for sensing the presence of a user's finger on the cover 28 could be provided. The finger sensor 46 is mounted to the frame 44 directly below the cover 28 and spaced from the motion actuator 38 by an electrical insulator 48.
When the finger sensor 46 senses the presence of the user's finger on the cover 28 above the actuator 38, the sensor 46 is adapted to send a signal to the controller 42. The controller, in turn, is adapted to actuate the motion actuator 38. The user can feel the motion of the cover at that limited location with the user's finger. This signals the user that his or her finger is above the input sensor 30. The user can depress the cover 28 to thereby depress the sensor 46 and actuator 38 to depress and actuate the input sensor 30. When the user removes his or her finger, as sensed by the finger sensor 46, the controller 42 can turn the actuator 38 OFF until the user's finger is sensed again.
The software can be stored in a program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine for performing operations to enhance tactile sensation to indicate location of a user input, the operations comprising sensing location of a user's finger on a cover having a haptic textured surface area above the user input; and when the location of the user's finger is sensed proximate the haptic textured surface area above the user input, vibrating the haptic textured surface area to thereby enhance the tactile sensation to the user's finger at the haptic textured surface area.
In mobile phone applications, certain sizes and orientations of piezo actuators, vibrators or vibration solenoids can be placed underneath a touch-sensitive flat display screen or cover part to give tactile and haptic feedback. This allows the use of touch screens or pads as input device instead of using conventional keypads. The tactile feedback for the input device enhances user experience by improving communication interactivity and intuitive user interface. The haptic devices, actuators, systems and features can be used as decorative elements.
A deco-functional haptics keyboard interface allows the haptics area to integrate both decorative and functional purposes. Instead of placing haptics component assemblies underneath opaque housings or displays, use of part of Haptics components as a functional decorative piece can be provided by placing them underneath transparent or translucent housings. The haptic elements, such as metallic amplifier plates for piezo actuators for example, can be used as decorative elements providing a visual metallic surface that can be plain or have graphics, such as key numbers, etched onto it.
In the deco-functional haptics interface a user can feel the locations of the keys by sliding his or her finger on the surface. Discontinuities and variations in the surface texture can be felt by the moving finger to indicate locations of functional areas such as keys. Some subtle visual cues from the reflection of light from the texture can also indicate location of keypad keys or other input elements. The lighting from below the cover can be used to change the visual perception of the input elements, thus, changing the functionality of the input area based on the needs of the software application or use context. There are several ways to create the haptic surface textures indicating the functional areas on the mobile device covers or even on the display. As a result, the textures can also be used as decorative and industrial design elements.
Amplifying the feel of texture on device covers by vibrating the surface can be provided. When the user holds his finger still the piezo element (or other vibration generator) can slightly vibrate the surface to allow the user to feel the texture although his finger is not moving. As a result the user knows his finger is on the right position for a key press. The vibration can be of constant or could vary in amplitude and/or frequency.
If the surface at a certain location on the mobile device is not textured, the vibration of the vibrating elements can be controlled in amplitude and/or frequency to generate a simulated surface texture. The device can use a capacitive or other similar touch sensitive area (that can signal coordinate locations on the cover or display) to locate the user's finger and change the vibratory feedback depending on the position the finger is pointing or touching, (e.g., soft vibration on a key hard on the edges of the key area and no vibration when the finger is not on the key). This is useful when a “hidden key” needs to be indicated haptically to the user. It is also usable when a key with a haptic cue needs to be placed on an optically restricted surface such as on the display.
A functional haptic device with a touch-sensitive area has been implemented by placing the haptic device underneath a flat surface; especially in display applications. The present invention can extend haptics applications to providing tactile feedback to other types of input devices, and can also serve as decorative purposes by using its components as a part of decoration rather than hidden components. Additionally the invention can bring the deco-haptic devices to any part of the mobile device; not just a flat surface such as the display.
With the invention, haptics in touch sensitive and touch feed back devices consists of one or both of two types of haptic elements: a passive haptics element and an active haptics element. A passive haptics element is where the covers of the devices by their shape or texture indicate the functional locations, such as the locations of keys. An active haptics element is where vibration or repetitive motion is used to jive impressions of texture or movement of the surface of the device to the users finger. This can be provided in conjunction with finger position information and press force. The third way of using haptics is using the combination of active and passive haptics in a hybrid haptic system.
A passive haptic implementation can be done by grooving the surface and creating a dynamic or disruptive change in the groove or ridge pitch, height and direction. Changing the direction of the grooves with a corner or rounded turn or through abrupt or gradual change in the height and pitch of the grooves can indicate key areas. The combination of a number of grooves and their variation can indicate to the user, moving his finger on the surface, the locations of functional areas (e.g. keys).
An active haptics implementation of the deco-functional haptic device can involve placing a capacitive sensor underneath the area where user uses his fingers for human-device interaction, such as the keypad or volume keys. The capacitive sensor can indicate the coordinates of the finger. Comparing these coordinates to the coordinate map of where the used applications keys are, the device can then vibrate the surface to hapticaly indicate the locations of keys.
Combining the two previous cases allows for the creation of a hybrid system that can also be felt without the moving of the finger on the grooves or projections. Additional functionality can be obtained by the ability to create new haptic keys with vibration on to places where the surface texture does not indicate keys to be.
Advantages of the invention include:
In the past, tactile (touch) cues for key location, input devices and other elements of design have been large. There is a desire in modern design and applications to hide these elements at times or in certain designs, and bring more subtle indications of functionally active (keys, input device) areas in the covers (i.e. hidden keys that are turned on in certain applications). This can be done with actively and passively haptic/tactile textures.
New mobile devices are small in size and have several functions requiring different input and output methods and devices. The user, or the device's own software application, cannot switch between current discrete input device solutions. The solutions of this invention allow the use of a single input device (such as a capacitive touch sensor for example) as a touch pad and keypad by controlling the haptic output, but still maintaining the possibility for the user to locate keys when the device is in non-active-haptic mode.
In the past, surface texture has not been used to haptically indicate key locations, neither has active vibration been used to simulate surface texture, or to enhance the ‘feeling’ of surface texture by moving the surface. This invention allows the ability to provide these features.
The invention can be used to develop a series of functional textural surfaces for use with haptic touch. The aim can be to create a highly sensorial and emotional interface where the physical feedback capabilities of haptic touch can be exploited through 3D textural surface rather than the existing screen based products which use Haptic touch would allow manufactures to develop intricate covers mouldings which could replace a conventional keymat entirely and create a more human interface for this technology. Specific functional textural areas have been considered for physical input—accelerating textures addresses volume and zoom functions; navigation keys and joystick; alpha numeric keys and power. An overall textural aesthetic has been developed which can morph throughout the form factor of a product, framing and housing these areas of textural functionality.
In the embodiment shown in
Referring also to
Referring back to
The invention can provide a sense of increasing and decreasing volume control through varying intensity of texture.
Referring now to
Referring now to
The embodiment shown in
The embodiment shown in
In an alternate embodiment, features of the invention could be used under a touch screen, such as providing a vibratory sensation to the touch screen. The invention could also be used with a non-textured surface, such as with a touch screen for example or a flat surface of the housing cover.
It should be understood that the foregoing description is only illustrative of the invention. Various alternatives and modifications can be devised by those skilled in the art without departing from the invention. Accordingly, the invention is intended to embrace all such alternatives, modifications and variances which fall within the scope of the appended claims.