This disclosure relates generally to creating custom vibration patterns for playback by a mobile electronic device, for example, in response to receiving a notification event.
Mobile devices are currently capable of providing unique audible indications in response to receiving notifications or alerts at the mobile device, for example, the receipt of a phone call, email message, or text message. For example, a user of a mobile device may assign unique ringtones to associated contacts in the user's contact address book. When the mobile device detects that one of these unique contacts is calling, or otherwise attempting to communicate with, the user, the mobile device can provide audible playback of the unique ringtone assigned to the calling contact.
In addition, a user of a mobile device can assign unique sounds to essentially any notification event associated with a mobile device. For example, phone calls, SMS/MMS messages, email receipt, calendar alerts, and the like may be assigned to corresponding sounds that can audibly inform the user of the underlying notification event or alert.
This disclosure describes technology, which can be implemented as a method, apparatus, and/or computer software embodied in a computer-readable medium, and which, among other things, be used to create custom vibration patterns in response to user input, for example, in response to the user tapping out a desired pattern on the display of a mobile device.
In general, in one aspect, a method performed by one or more processes executing on a computer system includes receiving tactile input from a user of an electronic device specifying a custom vibration pattern, in concert with receiving tactile input, providing visual feedback to the user corresponding to the received tactile input, and storing the specified custom vibration pattern for use by the electronic device to actuate haptic feedback signaling a predetermined notification event. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.
This, and other aspects, can include one or more of the following features. The tactile input may comprise a cadence of tap-down and tap-up events received on a touch-sensitive surface of the electronic device. The visual feedback may comprise a progress bar illustrating the custom vibration pattern over time. The progress bar may include an indication of vibration segments within the custom vibration pattern, the vibration segments corresponding to tap-down events. The indication of each vibration segment in the progress bar may include a length, wherein the length of each vibration segment corresponds to a duration of a tap-down event. The visual feedback may visually accentuate an origin of a tap-down event. The visual feedback may vary in relation to at least one of intensity and duration of the tap-down event. The visual feedback may be noticeably lesser regarding at least one of color intensity, size, and speed for a shorter duration tap-down event as compared to a longer duration tap-down event. The method can further include, in concert with receiving the tactile input, providing haptic feedback to the user corresponding to the received tactile input specifying the custom vibration pattern. The haptic feedback may vary in relation to at least one of intensity and duration of a tap-down event. The haptic feedback may be noticeably lesser regarding at least one of duration and intensity for a shorter duration tap-down event as compared to a longer duration tap-down event. The method may further include replaying the custom vibration pattern, where the replaying further includes providing the visual feedback to the user corresponding to the tactile input and actuating haptic feedback corresponding to the custom vibration pattern. The method may further include assigning the custom vibration pattern to a notification event and upon detection of the notification event by the electronic device, actuating haptic feedback in accordance with custom vibration pattern.
Potential advantages that may arise from the described subject matter may include enhanced visualization feedback during the recording and replay phases of a custom vibration pattern. For example, while recording a custom vibration pattern, a user may tap out a pattern on the display of a mobile device. Upon detecting a tap-down event, the mobile device can provide visualizations in the display corresponding to the tap-down event. For example, a progress bar may be displayed that contains indications of the length of a tap-down event and/or periods between tap-down events. In addition, other visual feedback may be provided simultaneously in another portion of the display. For example, a pebble-in-pond ripple effect may be displayed in which ripples visually appear on the display screen to be emanating from the origin of the tap-down event. The ripple effect may vary in intensity and color corresponding to the force and duration of the tap-down event.
Another potential advantage may include a method for vibrating a mobile device in a customized way so as to provide recognizable vibration feedback for a notification event or alert. For example, a unique vibration pattern can be assigned to a particular contact in an address book, a SMS/MMS notification, a calendar alert, email receipt, and the like. Upon detecting a notification event or alert, if the notification event or alert is assigned to a vibration pattern, the mobile device can actuate haptic feedback corresponding to the vibration pattern to inform a user of the mobile device of the underlying notification event or alert.
Details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, aspects, and potential advantages will be apparent from the description and drawings, and from the claims.
a-2d are exemplary user interfaces for creating custom vibration patterns on a mobile device.
a-3b are exemplary user interfaces for replaying custom vibration patterns on a mobile device.
Like reference symbols in the various drawings indicate like elements.
A measure of intensity (e.g., a detected force with which the user asserted a finger or stylus against the touch sensitive surface) may be detected with each tap-down event and translated into variable intensity (e.g., varying levels of vibration) for a corresponding vibration segment in the vibration pattern. In some implementations, intensity of a vibration segment may be variable based on the duration of a tap-down event. For example, at the start of a tap-down event, a vibration segment may be associated with a particular intensity. As the duration of the tap-down event increases, the intensity associated with the vibration segment may increase or decrease as a function of the duration of the tap-down event, e.g., proportionally to the duration of the tap-down event or inversely to the duration of the tap down event. In some implementations, the intensity associated with a vibration segment may reach a maximum intensity based on the capabilities of the haptic mechanisms in a mobile device.
In another implementation, intensity may be determined based on an amount of force applied to a touch-sensitive surface or the location on a touch-sensitive surface of a tap-down event. For example, varying forces (e.g., a finger or stylus applying different amounts of force) can be detected on a touch-sensitive surface during a single tap-down event. Such varying forces can be translated to varying vibrations in the vibration segment corresponding to the tap-down event. Additionally, specific regions of a touch-sensitive surface may be associated with varying levels of intensity such that when a tap-down event occurs in a specific region, a specific intensity is assigned to the corresponding vibration segment. For example, a tap-down event sensed in one specific region of the touch sensitive surface, for example, the center, may correspond to a higher intensity vibration whereas a tap-down sensed in another specific region of the touch sensitive surface, for example, a corner, may correspond to a lower intensity vibration. In some implementations, intensity may be determined based on a particular tap-down and drag pattern across a touch-sensitive surface. For example, a tap-down event may start in one portion of a touch-sensitive surface and end in another. An intensity may be assigned to a corresponding vibration segment based on the direction of travel for the tap-down event. For example, a tap-down event that starts near the bottom and ends near the top of the touch sensitive surface may correspond to a high, or increasing, intensity, while a tap-down event detected moving in the opposite direction may correspond to a low, or decreasing, intensity. Tap-down events moving left-to-right, right-to-left, or diagonally similarly may correspond to predetermined intensity levels and/or patterns of varying intensities.
User input received in step 112 may also be detected by a motion sensing component of a mobile device. For example, a user can make a physical gesture with the mobile device (e.g., accelerate the device in a direction such as up, down, left, or right) which can be translated into a corresponding vibration segment in a vibration pattern.
In step 114, feedback may be provided in response to the user input received in step 112. Feedback may be provided visually, tactilely, audibly, or through any other suitable means for providing feedback. In some implementations, the duration of a tap-down event may correspond to the duration of a particular vibration segment in a vibration pattern. Visual feedback may be provided depicting the duration of the vibration segment based on the duration of the tap-down event. For example, a progress bar may be displayed that indicates the duration of a vibration pattern over time and the duration of the vibration segments within the vibration pattern over time. In some implementations, a shorter duration tap-down event, e.g., a tap-down without a tap-down hold, may be represented by a dot whereas a longer duration tap-down event, e.g., a tap-down with a tap-down hold, may be represented by a growing rectangle of variable length in the progress bar.
Other visual feedback may be provided on the display of a mobile device in step 114 in response to receiving user input to create a vibration pattern, e.g., a “pebble-in-pond” effect such as shown in
Other visual feedback may be provided on the display of a mobile device in step 114 in response to receiving user input to create a vibration pattern, e.g., a circle emanating from the origin of a tap-down event that grows and shrinks based on the duration and/or intensity of the tap-down event. In some implementations, a circle can expand indefinitely from the origin of the tap-down event as a solid circle until a threshold circular size is reached, at which point the circle may start pulsating to provide the visualization that the circle has reached a maximum bound and continues to bump up against that maximum bound. Upon release of the tap-down event, i.e., a tap-up event, the circle can begin to shrink. Additionally, colors may be associated with the circle to indicate intensity for a vibration segment in a vibration pattern. For example, a circle could start emanating from the origin of the tap-down event in one color, e.g., green, indicating that the vibration segment may have a low intensity. The circle may then transition to a different color, e.g., red, as the circle expands to indicate that the vibration segment may have a stronger intensity.
In addition, in step 114 haptic feedback may be provided during the recording phase of a vibration pattern. For example, during a tap-down event, a mobile device can provide haptic feedback, or vibrations, corresponding to the tap-down event. The haptic feedback may vary in intensity and duration depending on the detected duration and intensity of the tap-down event. In some implementations, the haptic feedback tracks or relates to the vibration segments in the custom vibration pattern being created by the user input. For example, the haptic feedback provided in step 114 in response to the user input received in step 112 may correspond to vibration in the vibration pattern. That is, the haptic feedback provided in step 114 may be the same haptic feedback or vibrations actuated in step 118 to notify a user of a mobile device that a notification event has been received, where the vibration pattern corresponding to the haptic feedback has been assigned to the notification event in step 116.
Feedback provided in step 114 in response to receiving user input may be provided in a real-time manner. For example, although the mobile device may not know how long a tap-down event will last, visualization and haptic feedback can be provided in real-time for an indefinite amount of time by providing instructions to the mobile device to start and stop the feedback based on the received user input.
In step 114, in addition to providing real-time feedback during the recording phase of a vibration pattern, visual and haptic feedback can be provided during a replay portion of the recording phase. For example, after recording has ended, a user of the mobile device may desire to preview the vibration pattern before assigning it to a notification event. In some implementations, the user can select to replay the vibration pattern just recorded. During replay, any of the visualizations discussed in this disclosure can be displayed and haptic feedback can be provided corresponding to the recorded vibration pattern.
In step 116, the custom vibration pattern created in step 112 can be assigned to a notification event. For example, the custom vibration pattern may be assigned to a particular contact in an address book, universally for all phone calls, SMS/MMS messages, email receipts, calendar alerts, and the like. In step 118, upon detection of a notification event by a mobile device, e.g., a call from a contact with an assigned vibration pattern, the mobile device can actuate haptic feedback at the mobile device corresponding to the vibration pattern.
In addition to or in place of assigning a custom vibration pattern to a notification event, preset or stock vibration patterns may be assigned to a notification event in step 116. For example, a number of preset and stock vibration patterns may be provided to a mobile device. A user of the mobile device may assign any of such preset or stock vibration patterns to a notification event.
a-2d are exemplary user interfaces for creating a custom vibration pattern on a mobile device. In
In
a-3b are exemplary user interfaces for replaying a custom vibration pattern on a mobile device. For example,
Sensors, devices, and subsystems can be coupled to peripherals interface 606 to facilitate multiple functionalities. For example, motion sensor 610, light sensor 612, and proximity sensor 614 can be coupled to peripherals interface 606 to facilitate orientation, lighting, and proximity functions of the mobile device. Motion sensor 610 can include one or more accelerometers configured to determine change of speed and direction of movement of the mobile device. Location processor 615 (e.g., GPS receiver) can be connected to peripherals interface 606 to provide geopositioning. Electronic magnetometer 616 (e.g., an integrated circuit chip) can also be connected to peripherals interface 606 to provide data that can be used to determine the direction of magnetic North. Thus, electronic magnetometer 616 can be used as an electronic compass. Gravimeter 617 can be coupled to peripherals interface 606 to facilitate measurement of a local gravitational field of Earth.
Camera subsystem 620 and an optical sensor 622, e.g., a charged coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) optical sensor, can be utilized to facilitate camera functions, such as recording photographs and video clips.
Communication functions can be facilitated through one or more wireless communication subsystems 624, which can include radio frequency receivers and transmitters and/or optical (e.g., infrared) receivers and transmitters. The specific design and implementation of the communication subsystem 624 can depend on the communication network(s) over which a mobile device is intended to operate. For example, a mobile device can include communication subsystems 624 designed to operate over a CDMA system, a WiFi™ or WiMax™ network, and a Bluetooth™ network. In particular, the wireless communication subsystems 624 can include hosting protocols such that the mobile device can be configured as a base station for other wireless devices.
Audio subsystem 626 can be coupled to a speaker 628 and a microphone 630 to facilitate voice-enabled functions, such as voice recognition, voice replication, digital recording, and telephony functions. In addition, microphone 630 may detect ambient noise and other audible frequencies.
Haptic subsystem 680 and haptic mechanism 682, e.g., spinning motor, servo motor, or piezoelectric motor, can be utilized to facilitate haptic feedback, such as vibration, force, and/or motions.
I/O subsystem 640 can include touch screen controller 642 and/or other input controller(s) 644. Touch-screen controller 642 can be coupled to a touch screen 646 or pad. Touch screen 646 and touch screen controller 642 can, for example, detect contact and movement or break thereof using any of a plurality of touch sensitivity technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch screen 646.
Other input controller(s) 644 can be coupled to other input/control devices 648, such as one or more buttons, rocker switches, thumb-wheel, infrared port, USB port, and/or a pointer device such as a stylus. The one or more buttons (not shown) can include an up/down button for volume control of speaker 628 and/or microphone 630.
In one implementation, a pressing of the button for a first duration may disengage a lock of the touch screen 646; and a pressing of the button for a second duration that is longer than the first duration may turn power to mobile device 600 on or off. The user may be able to customize a functionality of one or more of the buttons. The touch screen 646 can, for example, also be used to implement virtual or soft buttons and/or a keyboard.
In some implementations, mobile device 600 can present recorded audio and/or video files, such as MP3, AAC, and MPEG files. In some implementations, mobile device 600 can include the functionality of an MP3 player. Mobile device 600 may, therefore, include a pin connector that is compatible with the iPod. Other input/output and control devices can also be used.
Memory interface 602 can be coupled to memory 650. Memory 650 can include high-speed random access memory and/or non-volatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, and/or flash memory (e.g., NAND, NOR). Memory 650 can store operating system 652, such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks. Operating system 652 may include instructions for handling basic system services and for performing hardware dependent tasks. In some implementations, operating system 652 can include a kernel (e.g., UNIX kernel).
Memory 650 may also store communication instructions 654 to facilitate communicating with one or more additional devices, one or more computers and/or one or more servers. Memory 650 may include graphical user interface instructions 656 to facilitate graphic user interface processing; sensor processing instructions 658 to facilitate sensor-related processing and functions; phone instructions 660 to facilitate phone-related processes and functions; electronic messaging instructions 662 to facilitate electronic-messaging related processes and functions; web browsing instructions 664 to facilitate web browsing-related processes and functions; media processing instructions 666 to facilitate media processing-related processes and functions; GPS/Navigation instructions 668 to facilitate GPS and navigation-related processes and instructions; camera instructions 670 to facilitate camera-related processes and functions; magnetometer data 672 and calibration instructions 674 to facilitate magnetometer calibration. The memory 650 may also store other software instructions (not shown), such as security instructions, web video instructions to facilitate web video-related processes and functions, and/or web shopping instructions to facilitate web shopping-related processes and functions. In some implementations, the media processing instructions 666 are divided into audio processing instructions and video processing instructions to facilitate audio processing-related processes and functions and video processing-related processes and functions, respectively. An activation record and International Mobile Equipment Identity (IMEI) or similar hardware identifier can also be stored in memory 650. Memory 650 can include haptic instructions 676. Haptic instructions 676 can be configured to cause the mobile device to perform haptic-based operations, for example providing haptic feedback to a user of the mobile device as described in reference to
Each of the above identified instructions and applications can correspond to a set of instructions for performing one or more functions described above. These instructions need not be implemented as separate software programs, procedures, or modules. Memory 650 can include additional instructions or fewer instructions. Furthermore, various functions of the mobile device may be implemented in hardware and/or in software, including in one or more signal processing and/or application specific integrated circuits.
In some implementations, both voice and data communications can be established over wireless network 712 and the access device 718. For example, mobile device 702a can place and receive phone calls (e.g., using voice over Internet Protocol (VoIP) protocols), send and receive e-mail messages (e.g., using Post Office Protocol 3 (POP3)), and retrieve electronic documents and/or streams, such as web pages, photographs, and videos, over wireless network 712, gateway 716, and wide area network 714 (e.g., using Transmission Control Protocol/Internet Protocol (TCP/IP) or User Datagram Protocol (UDP)). Likewise, in some implementations, the mobile device 702b can place and receive phone calls, send and receive e-mail messages, and retrieve electronic documents over the access device 718 and the wide area network 714. In some implementations, mobile device 702a or 702b can be physically connected to the access device 718 using one or more cables and the access device 718 can be a personal computer. In this configuration, mobile device 702a or 702b can be referred to as a “tethered” device.
Mobile devices 702a and 702b can also establish communications by other means. For example, wireless mobile device 702a can communicate with other wireless devices, e.g., other mobile devices 702a or 702b, cell phones, etc., over the wireless network 712. Likewise, mobile devices 702a and 702b can establish peer-to-peer communications 720, e.g., a personal area network, by use of one or more communication subsystems, such as the Bluetooth™ communication devices. Other communication protocols and topologies can also be implemented.
The mobile device 702a or 702b can, for example, communicate with one or more services 730 over the one or more wired and/or wireless networks. For example, one or more vibration pattern delivery services 730 can be used to deliver one or more vibration patterns. In some implementations, a vibration pattern delivery service may be a virtual store to buy and download vibration patterns. A vibration pattern delivery service may also be part of a push notification delivery service. For example, a vibration pattern associated with a particular push notification may be pushed to a mobile device to inform a user of the mobile device of the particular notification, e.g., a distinctive vibration pattern may be associated with a team scoring in a sports game, when the team scores, the distinct vibration pattern can be pushed to the mobile device to notify the user of the mobile device of the score.
Mobile device 702a or 702b can also access other data and content over the one or more wired and/or wireless networks. For example, content publishers, such as news sites, Really Simple Syndication (RSS) feeds, web sites, blogs, social networking sites, developer networks, etc., can be accessed by mobile device 702a or 702b. Such access can be provided by invocation of a web browsing function or application (e.g., a browser) in response to a user touching, for example, a Web object.
A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. In addition, other steps may be provided, or steps may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Accordingly, other implementations are within the scope of the following claims.