One embodiment is directed generally to a computer interface, and in particular to a handheld computer interface that includes haptic feedback.
Haptic feedback can be generated by a device and sensed by kinesthetic receptors to allow a user of the device to perceive forces such as inertia and acceleration. Typically, this kind of haptic feedback is created by applying a force to the body through a physical interface which is grounded to a wall or desk. Also known as “tethered” interfaces, such devices are limited in their range, mobility, and ultimately usability because of their reliance on being coupled to an external structure.
Various systems, devices, and methods are provided for generating an impact and/or surface haptic effect for a handheld computer interface such as a video game controller. The computer interface can be used with, for example, computer games and device simulators to create a high intensity, high frequency, short duration haptic effect used to simulate collisions with external objects such as baseballs or swords, or recoil from shooting projectiles.
According to various embodiments of the invention, the handheld computer interface may include a handle coupled to an impact actuator. The impact actuator may include a movable mass and an end stop. The impact actuator may receive a haptic effect signal and in response cause the mass to contact the end stop to generate a haptic effect.
According to various embodiments of the invention, a smart material that outputs a surface haptic effect may be coupled to a surface of the handle such that the surface haptic effect is output substantially from the smart material rather than the handle or otherwise housing of the handheld computer interface.
According to various embodiments of the invention, the handle may be coupled to an end piece having a shape that simulates an object such as a tennis racket, golf club, or other object. In some embodiments, the end piece may be removably coupled to the handle. In this manner, the handheld computer interface may be used to simulate various real-world objects.
a is a plan view of an impact actuator in accordance with another embodiment.
b is a plan view of an end stop or blocker in accordance with another embodiment.
a,
9
b,
9
c, and 9d are examples of a reflex component, according to various embodiments.
One embodiment is a handheld computer interface that generates a haptic feedback effect with an impact actuator that impacts a portion of a handle of the interface. The computer interface can be used with, for example, computer games and device simulators to create a high intensity, high frequency, short duration haptic effect used to simulate collisions with external objects such as baseballs or swords, or recoil from shooting projectiles.
Sensors 12 may include one or more of the following types of sensors:
In other embodiments, handheld interface 15 includes other actuators in addition to impact actuator 18. These additional actuators can be used to create other haptic feedback in addition to the haptic feedback that is generated by impact actuator 18. The additional actuators may include:
According to various embodiments of the invention, handle 14 may include or otherwise be coupled with a smart material 19, which may include a piezo, shape-memory alloy, or other smart material. Smart material 19 may be coupled to a surface of handle 14, thereby directly imparting a surface haptic effect to the user substantially from smart material 19 rather than from handle 14. In some embodiments, the surface haptic effect may supplement (i.e., be in addition to) vibrotactile haptic feedback described above. Smart material 19 may be in a shape of a strip coupled to the surface of handle 14, may encompass (fully or partially wrap) handle 14, and/or other configuration coupled to the surface of handle 14.
In some embodiments, a cover portion (not otherwise illustrated in
In operation, computer system 28 of
Computer readable media may be any available media that can be accessed by processor 32 and includes both volatile and nonvolatile media, removable and non-removable media, and communication media. Communication media may include computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
Processor 32 is further coupled via bus 37 to a display 44, such as a Liquid Crystal Display (“LCD”), for displaying information to a user. A keyboard 46 and a cursor control device 48, such as a computer mouse, is further coupled to bus 37 to enable a user to interface with system 28 as an alternative or in addition to using handheld interface 15.
In one embodiment, memory 34 stores software modules that provide functionality when executed by processor 32. The modules include an operating system 35 that provides operating system functionality for system 28. The modules further include a haptic feedback module 36 that generates haptic feedback on handheld interface 15 through impact actuator 18. System 28 further includes a polymodal haptic feedback and applications module 38 that generates additional haptic feedback on handheld interface 15, and includes an application such as a video game that requires haptic feedback to be generated on handheld interface 15 in conjunction with the application. In another embodiment, the functionality of modules 36 and 38 is subsumed in a single haptic feedback management module that is responsible for synthesizing and displaying polymodal haptic effects, including mass bias (kinesthesia), mass motion (kinesthesia), vibration (vibrotaction), impact (vibrotaction), etc. The haptic feedback management module takes a generalized, physics-based feedback profile (e.g., size of interface, position of interface, position of ball impact, and other contextual factors within the virtual environment) and dispatches haptic feedback signals to individual actuators as appropriate (e.g., vibration, impact, COM, etc.).
In one embodiment, haptic feedback module 36 initiates impact haptic effects on handheld interface 15.
At 402, haptic feedback module 36 receives a request from application 38 to generate an impact haptic effect on handle 14 of handheld interface 15. Application 38 may be an interactive video game such as a golf or baseball game, or any type of application that may be enhanced or requires an impact haptic effect.
At 404, haptic feedback module 36 initiates the application of energy to motor 21 to cause mass 27 to spin around motor shaft 24.
At 406, bumper 28 impacts end stop 25, thus causing an impact haptic effect. The functionality of 402, 404 and 406 can be repeatedly applied to generate multiple impact haptic effects. Further, bumper 28 can repeatedly contact end stop 25 at high frequency and a small travel path to generate a vibration haptic effect.
Concurrently with the haptic feedback requests at 402, polymodal haptic feedback and application module 38 may also generate other haptic feedback requests that are sent to other actuators of handheld interface 15 to generate other types of haptic feedback such as vibrations, COM variations, etc.
a is a plan view of an impact actuator 50 in accordance with another embodiment. Similar to impact actuator 18 of
b is a plan view of end stop or blocker 55 in accordance with another embodiment. Blocker 55 includes bumpers 58 and 59 on opposite sides made from different impact materials to create different impact sensations depending on the rotation direction of mass 57. For example, bumper 58 can be made from soft rubber and bumper 59 can be made from hard plastic.
In operation, a signal is generated by haptic feedback module 36 which energizes coils 62, which causes mass 64 to travel along shaft 63. To create the impact haptic effect, mass 64 can be allowed to impact one of bumpers 63, or can be stopped by one of brakes 67 for a shorter travel length. The variations in travel length causes different impact haptic effects. For example, to emulate the impact from a relatively long golf swing, mass 64 can travel the full length of shaft 63. To emulate the impact from a relatively short ping pong swing, brakes 67 can shorten the length of travel of mass 64. Further, the material properties of brakes 67 and bumpers 63 can be used to modulate the properties of an impact haptic effect. For example, to emulate the impact for a baseball bat, a foul tip can use soft rubber materials while a hard solid baseball hit can use hard rubber materials.
In some embodiments, linear impact actuator 60 may be configured such that a user-generated motion at least partially causes mass 64 to travel along shaft 63, thereby supplementing the travel of mass 64 along shaft 63 caused by energizing coils 62. For example, a golf swing motion may cause mass 64 to travel along shaft 63, supplementing the travel of mass 64 caused by energizing coils 62. In this manner, energizing coils 62 and the motion of linear impact actuator 60 may cause mass 64 to travel along shaft 63. In some embodiments, linear impact actuator 60 may include sensors (not otherwise illustrated in
In addition to the impact actuator, one embodiment includes eccentric rotating mass (“ERM”) actuators and linear resonant actuators (“LRAs”), possibly at each end of the interface, in order to create complimentary haptic effects. In one embodiment, the audio speaker generates less than 30 decibels and is located on the various end pieces to create realistic impact sounds at the virtual impact location. In one embodiment, the interface includes a sensor for sensing six degree of freedom of the interface's position, and a sensor for sensing the position of the shaft of the rotary actuator or the position of the mass of the linear actuator.
As an example of scenarios that can effectively utilize the interface in accordance with embodiments, consider a user facing a large screen capable of displaying three-dimensional images. The user is holding a computer interface in accordance with one embodiment that has an end piece with the appearance of a badminton racquet. On the screen an opponent is getting ready to serve. After the serve the bird appears to come out of the screen towards the user who swings and hits the bird back toward the screen. The sensation of impact is faithfully conveyed to the user via the impact haptic actuator in the handle and the “swish” of contact is heard from the speaker that is located on the end piece. The opponent successfully returns the bird and this time the user misses and receives no haptic feedback and a low audible whoosh of the racquet from the speaker as it passes through thin air.
In another scenario, a large flat screen may be placed on a table, displaying a pool table in three-dimensions. The balls are capable of interacting in a familiar and natural manner. The user is holding a computer interface in accordance with one embodiment that has an end piece with the appearance of a pool cue. As the user lines up for a shot, vibrotactile haptic feedback is generated to guide the user to the right position. The vibrotactile haptic feedback is a changing haptic pattern that is conveyed to allow the user to recognize when the cue is properly aligned for a tricky combination shot. The user initiates the shot and feels the impact of the cue hitting the white ball through the impact actuator. The user then feels a vibrotactile haptic pattern that provides feedback on the quality of the stroke, as the balls move naturally on the table.
In another scenario, the user is holding a computer interface in accordance with one embodiment that is used to control a virtual sword and has an end piece with the appearance of a sword. As the user causes the virtual sword to move using the computer interface, vibrotactile haptic feedback may be provided. In some embodiments, when the user causes the virtual sword to impact another virtual object (such as, for instance, another virtual sword, a virtual shield, a virtual character), vibrotactile haptic feedback may be provided. The vibrotactile haptic feedback may differ based on a type of virtual object impacted by the virtual sword, thereby providing different vibrotactile haptic feedback for different types and/or materials of virtual objects that are impacted.
In some embodiments, the reflex haptic effect may supplement (i.e., be in addition to) or be resistive to the haptic effect caused by actuator 82 and vice versa. In other embodiments, actuator 82 causes substantially all of the haptic effect on handheld computer interface 15. Thus, according to various embodiments, reflex component 80 and/or actuator 82 may cause a haptic effect to be imparted on handheld computer interface 15. In some embodiments, handheld computer interface 15 may include sensors (not otherwise illustrated in
a, 9b, 9c, and 9d are examples of reflex component 80, according to various embodiments.
a is a cut-away view of handheld computer interface 15 that illustrates reflex component 80, according to an embodiment. According to the embodiment illustrated in
Movement of moving mass 94 in response to the user-generated force may cause the moving mass 94 to impact an inner surface of cavity 93 or other component of handheld computer interface 15, thereby imparting a haptic effect to handheld computer interface 15. In some embodiments, the haptic effect caused by moving mass 94 may cause substantially all of the haptic effect imparted to handheld computer interface 15. In other embodiments, the haptic effect caused by moving mass 94 may supplement (i.e., be in addition to) a haptic effect caused by actuator 82 and vice versa. In other embodiments, actuator 82 causes substantially all of the haptic effect on handheld computer interface 15. Thus, according to various embodiments, moving mass 94 responsive to user-generated motion and/or actuator 82 may cause a haptic effect to be imparted on handheld computer interface 15.
In some embodiments, cavity 93 may include or otherwise be coupled with bumpers 96 that are made of the same material (e.g., soft rubber) as one another or different materials (e.g., soft rubber, hard rubber) from one another. Moving mass 94 may impact bumpers 96, thereby causing a haptic effect.
In some embodiments, cavity 93 may include or otherwise be coupled with bumps 97, which may each be made of the same material (e.g., soft rubber) as one another or different materials (e.g., soft rubber, hard rubber) from one another. Bumps 97 may stop, slow down, or otherwise cause friction on moving mass 94, thereby causing a haptic effect as moving mass 94 moves within cavity 93.
In the embodiment illustrated in
In some embodiments, cavity 93, moving mass 94, bumpers 96, and/or bumps 97 may be configured such that only force provided by a user that exceeds a predefined threshold will cause moving mass 94 to move. Thus, only force that exceeds the predefined threshold will cause moving mass 94 to impart a haptic effect.
Although illustrated in
b is a cut-away view of handheld computer interface 15 that illustrates reflex component 80, according to an embodiment. According to the embodiment illustrated in
c is a cut-away view of handheld computer interface 15 that illustrates reflex component 80, according to an embodiment. According to the embodiment illustrated in
d is a cross-sectional view of handheld computer interface 15 that illustrates reflex component 80, according to an embodiment. According to the embodiment illustrated in
Those having skill in the art will appreciate that various components illustrated in
As disclosed, a handheld computer interface generates haptic feedback from an impact actuator as well as from other actuators. The haptic effects generated by the impact actuator, other actuators, and/or components described herein provide effective and realistic sensations to simulate the impact from a ball or other object.
Several embodiments are specifically illustrated and/or described herein. However, it will be appreciated that modifications and variations of the disclosed embodiments are covered by the above teachings and within the purview of the appended claims without departing from the spirit and intended scope of the invention.
This application is a divisional of U.S. patent application Ser. No. 12/624,577, filed Nov. 24, 2009, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 12624577 | Nov 2009 | US |
Child | 14034001 | US |