Patent Grant
9946365
This application is related to U.S. application Ser. No. 13/793,152 filed Mar. 11, 2013 and titled “Stylus-Based Slider Functionality for UI Control of Computing Device” and to U.S. application Ser. No. 13/793,256 filed Mar. 11, 2013 and titled “Stylus-Based Touch-Sensitive Area for UI Control of Computing Device.” Each of these applications is herein incorporated by reference in its entirety.
This disclosure relates to electronic computing devices, and more particularly, to stylus-based user interface techniques for interacting with electronic computing devices.
Electronic display devices such as tablets, eReaders, mobile phones, smart phones, personal digital assistants (PDAs), and other such touch screen electronic display devices are commonly used for displaying consumable content. The content may be, for example, an eBook, an online article or blog, images, documents, a movie or video, and the like. Such display devices are also useful for displaying a user interface that allows a user to interact with the displayed content. The user interface may include, for example, one or more touch screen controls and/or one or more displayed labels that correspond to nearby hardware buttons. The user may interact with the touch-sensitive device using fingers, a stylus, or other implement. The touch screen display may be backlit or not, and may be implemented for instance with an LED screen or an electrophoretic display. Such devices may also include other touch-sensitive surfaces, such as a track pad (e.g., capacitive or resistive touch sensor) or touch-sensitive housing (e.g., acoustic sensor).
Techniques are disclosed for interacting with a computing device using a stylus. The stylus is configured with one or more control features that can be activated to perform various actions while the stylus is touching or otherwise sufficiently proximate to a stylus detection surface of the device. In one embodiment, the stylus includes a pressure-sensitive control feature around the stylus body in the grip area, and a pressure (such as a squeeze or tap) action on that pressure-sensitive control feature can be associated with a variety of tasks on the computing device such as: adjusting variables, executing a particular command, switching between tools, modifying a particular tool's settings, and launching an application. In some embodiments, the stylus-based, pressure-sensitive control feature allows for single-finger pressure (e.g., finger tap thumb tap) and squeeze actions (e.g., between thumb and index finger). In some such embodiments, for example, when the stylus-based, pressure-sensitive control feature is engaged with a finger tap or a thumb tap, or a squeeze action (e.g., via the user's finger and thumb together), the resulting signal can be used to change variables or tool features such as volume, font size, font type, colors, line thickness or hardness, margin size, pagination, and other such variables. In other such embodiments, the stylus-based, pressure-sensitive control feature can be engaged with a finger tap or a thumb tap, or a squeeze action to, for example, invoke an undo or redo command, to advance through content (paging/scrolling), to switch between open applications, or to launch a specific application. In some cases, the stylus may have a power source and processor or some degree of intelligence to receive and signals from the pressure-sensitive control feature, but other embodiments don't necessarily include such componentry. An appropriate animation or sound or haptic response can also be provided that may be indicative of or otherwise related to the action being taken. Other embodiments may include similar functionality with one or more different stylus-based control features, such as a push-button, a rotatable knob, a slider-switch, or a touch-sensitive surface, to name a few examples. As will be appreciated in light of this disclosure, the attributes of the control feature can be tailored to the target function or functions to be performed and/or to a targeted use case (e.g., student attending class in classroom or via a cloud-based educational program) so as to provide a more intuitive user experience.
General Overview
As previously explained, electronic display devices such as tablets, eReaders, and smart phones are commonly used for displaying user interfaces and consumable content. In some instances, the user might desire to switch tools within a particular application, or customize the settings within a particular tool in a given application. For instance, the user might wish to change the font in a word processing or eReader application, or change from a pencil tool to a paintbrush tool. While many computing devices provide for a series of actions for interacting with a device to make such changes, there does not appear to be an intuitive stylus-based user interface for doing so.
Thus, and in accordance with an embodiment of the present invention, stylus-based techniques are provided for performing functions in a computing device using stylus control feature actions while the stylus is touching or otherwise sufficiently proximate to a stylus detection surface of the device. To this end, direct contact with the stylus detection surface is not necessary. In one particular embodiment, a stylus-based, pressure-sensitive control feature around the stylus shaft in the user grip area allows for pressure-based actions such as finger taps or thumb taps, or a squeezing action on the pressure-sensitive control feature. Each stylus-based pressure action can be associated with a function such as increasing volume, increasing font size, creating a note (e.g., such as notes taken during an educational lecture, or a message for another user of the device, or a reminder, etc), undo, recording a lecture or other ambient sounds, etc. In a more general sense, any uniquely identifiable stylus-based pressure action or combination of actions performed while touching or otherwise sufficiently proximate to a stylus detection surface of the computing device may be configured to perform a stylus or device function. In some embodiments, the stylus may be pointing to a specific selection of content or a tool, a UI control feature or icon, or a specific area of a stylus-sensitive display. In such an example, the stylus-based pressure action may be used to perform an operation on the selected content, change tools, or cycle through a given tool's customizations, open the selected file or application, manipulate the UI control feature, etc. In one specific such example case, a stylus-based pressure action may be associated with a different function depending on the area of the stylus detection surface with which the stylus is directly contacting or hovering over, or otherwise sufficiently proximate to so as to cause a detectable event in that area of the stylus detection surface. In other embodiments, the stylus-based pressure action may be configured to perform a certain function regardless of whether content is selected or where the stylus is pointing. In some such selection-free embodiments, the stylus-based pressure action may perform a certain function based on a currently running application, or a specific stylus-based pressure action may be globally associated with a specific device function. For instance, a selection-free stylus-based pressure action may be used to trigger an undo or redo command, or to launch a given application (e.g., launch a browser for conducting online research, or a text messaging application to notify peers in a study group of a particular question or a new meeting time, or a sound/video recording application while attending a lecture, or an application that transcribes handwritten notes on a touch-sensitive display of the computing device into a text file). Numerous selection-free stylus-based pressure actions will be apparent in light of this disclosure, and such functions may be user-configurable or hard-coded such that no or minimal user-configuration is necessary.
In some embodiments, the pressure sensitive control feature may use quantum tunneling composites (QTC) technology or a so-called soft-switch actuator deployed around or otherwise on the nozzle or elongated body of the stylus. QTC-based actuators can be used for ultra-thin, low power pressure-sensitive switches and is available, for example, from Peratech Limited. In a more general sense, any suitable pressure-sensor technology can be used that translates user provided pressure into an actionable signal, wherein the pressure action may be in the form of a squeeze-and-release, squeeze-and-hold, touch-and-release (or tap), press-and-hold, or any other pressure-type action or combination of applied pressure actions on the pressure-sensitive area. For ease of description, a squeeze or tap is used in the various examples, but any suitable pressure-types can be used that generate a unique detection signal from the pressure-sensitive surface, as will be further appreciated in light of this disclosure. In some specific such embodiments, the stylus-based pressure function allows for finger taps, thumb taps, or squeeze actions, so as to provide for a broader range of uniquely identified pressure-based functions. As previously explained, the stylus-based pressure function can be associated with a variety of tasks on the computing device. For example, in some such embodiments, when a stylus-based, pressure-sensitive control feature is engaged with a squeeze action or a finger tap or a thumb tap, it can change variables or tool features such as volume, font size, font type, colors, line thickness or hardness, margin size, and any other such variables adjustable by a user interface control feature. In other such embodiments, the stylus-based, pressure-sensitive control feature can be engaged with a squeeze action or a finger tap or a thumb tap to invoke an undo or redo command, or to launch a specific application. In a more general sense, the stylus-based, pressure-sensitive control feature can be engaged with a squeeze or series of squeezes, a tap or series of taps, or any combination of pressure-types to invoke a specific action, in accordance with an embodiment.
In some embodiments, the pressure-based action may be combined with or otherwise preceded by a content selection action (e.g. a single item selection, a select-and-drag action, a book-end selection where content between two end points is selected, or any other available content selection technique). As will be appreciated, the stylus may be used to make the content selection, but it need not be; rather, content may be selected using any means. In one example embodiment, the user may select a section of text, and then perform the copy function (or other function assigned to a stylus control feature), which will save the selected text onto the stylus. In a more general sense, the stylus may be used to perform functions on content that was pre-selected with or without the stylus, or to simultaneously select and perform functions on target content. The degree to which the selection and other functions overlap may vary depending on factors such as the type of content and the processing capability of the stylus and/or related device.
In some example embodiments, the pressure actions are accompanied with animation, sound and/or haptic effects to further enhance the user interface experience. For example, copy animation might show a vortex or sucking of the selected content into the stylus if the stylus pressure action is being used to copy content into the stylus or other target location. In a similar fashion, a volume increase animation might show a speaker with an increasing number of sound waves coming from it if the stylus pressure action is being used to increase volume. If a selection-free, no-contact undo stylus-based pressure action is being executed, then a sound could accompany the undo function, such as a custom sound selected by the user, or any other suitable sound. A combination of animation, sound, haptic and/or other suitable notifications can be used as well, as will be appreciated in light of this disclosure.
The techniques have a number of advantages, as will be appreciated in light of this disclosure. For instance, in some cases, the techniques can be employed to provide a discreet and intuitive way for a user to interact with a device without overly distracting the user (or others nearby) from other events occurring during the interaction. For instance, in some such embodiments, a student attending a lecture (either live or via a network) can activate note taking and voice recording applications via stylus-based pressure control actions, without having to look at the device (or with minimal looking). In such cases, for instance, the student can hold the stylus generally over the stylus-sensitive surface while still maintaining focus and concentration on the lecturer and presentation materials, and readily activate tools that can supplement the educational experience.
Numerous uniquely identifiable engagement and notification schemes that exploit a stylus and a stylus detection surface to effect desired functions without requiring direct contact on the touch sensitive (stylus detection) surface can be used, as will be appreciated in light of this disclosure. Further note that any stylus detection surface (e.g. track pad, touch screen, electro-magnetic resonance (EMR) sensor grid, or other stylus-sensitive surface, whether capacitive, resistive, acoustic, or other stylus detecting technology) may be used to detect the stylus action and the claimed invention is not intended to be limited to any particular type of stylus detection technology, unless expressly stated.
Architecture
As can be seen with this example configuration, the device comprises a housing that includes a number of hardware features such as a power button, control features, and a press-button (sometimes called a home button herein). A user interface is also provided, which in this example embodiment includes a quick navigation menu having six main categories to choose from (Home, Library, Shop, Search, Light, and Settings) and a status bar that includes a number of icons (a night-light icon, a wireless network icon, and a book icon), a battery indicator, and a clock. Other embodiments may have fewer or additional such user interface (UI) features, or different UI features altogether, depending on the target application of the device. Any such general UI controls and features can be implemented using any suitable conventional or custom technology, as will be appreciated.
The hardware control features provided on the device housing in this example embodiment are configured as elongated press-bars and can be used, for example, to page forward (using the top press-bar) or to page backward (using the bottom press-bar), such as might be useful in an eReader application. The power button can be used to turn the device on and off, and may be used in conjunction with a touch-based UI control feature that allows the user to confirm a given power transition action request (e.g., such as a slide bar or tap point graphic to turn power off). Numerous variations will be apparent, and the claimed invention is not intended to be limited to any particular set of hardware buttons or features, or device form factor.
In this example configuration, the home button is a physical press-button that can be used as follows: when the device is awake and in use, tapping the button will display the quick navigation menu, which is a toolbar that provides quick access to various features of the device. The home button may also be configured to cease an active function that is currently executing on the device, or close a configuration sub-menu that is currently open. The button may further control other functionality if, for example, the user presses and holds the home button. For instance, an example such push-and-hold function could engage a power conservation routine where the device is put to sleep or an otherwise lower power consumption mode. So, a user could grab the device by the button, press and keep holding as the device is stowed into a bag or purse. Thus, one physical gesture may safely put the device to sleep. In such an example embodiment, the home button may be associated with and control different and unrelated actions: 1) show the quick navigation menu; 2) exit a configuration sub-menu; and 3) put the device to sleep. As can be further seen, the status bar may also include a book icon (upper left corner). In some cases, selecting the book icon may provide bibliographic information on the content or provide the main menu or table of contents for the book, movie, playlist, or other content.
In one particular embodiment, a stylus control feature action configuration sub-menu, such as the one shown in
As will be appreciated, the various UI control features and sub-menus displayed to the user are implemented as UI touch screen controls in this example embodiment. Such UI touch screen controls can be programmed or otherwise configured using any number of conventional or custom technologies. In general, the touch screen translates the user touch (e.g., finger or stylus) in a given location into an electrical signal which is then received and processed by the underlying operating system (OS) and circuitry (processor, etc). Additional example details of the underlying OS and circuitry in accordance with some embodiments will be discussed in turn with reference to
The stylus detection surface (or stylus detection display, in this example case) can be any surface that is configured with stylus detecting technologies capable of direct contact and/or non-contact (hovering) detection, whether capacitive, resistive, acoustic, active-stylus, and/or other input detecting technology. The screen display can be layered above input sensors, such as a capacitive sensor grid for passive touch-based input such as with a finger or passive stylus in the case of a so-called in-plane switching (IPS) panel, or an electro-magnetic resonance (EMR) sensor grid. In some embodiments, the stylus detection display can be configured with a purely capacitive sensor, while in other embodiments the touch screen display may be configured to provide a hybrid mode that allows for both capacitive input and EMR input, for example. In still other embodiments, the stylus detection surface is configured with only an active-stylus sensor. Numerous touch screen display configurations can be implemented using any number of known or proprietary screen-based input detecting technologies. In any such embodiments, a stylus detection surface controller may be configured to selectively scan the stylus detection surface and/or selectively report stylus inputs detected proximate to (e.g., within a few centimeters, or otherwise sufficiently close so as to allow detection) the stylus detection surface.
In one example embodiment, a stylus input can be provided by the stylus hovering some distance above the stylus detection display surface (e.g. one to a few centimeters above the surface, or even farther, depending on the sensing technology deployed in the stylus detection surface), but nonetheless triggering a response at the device just as if direct contact were provided directly on the stylus detection display. As will be appreciated in light of this disclosure, a stylus as used herein may be implemented with any number of stylus technologies, such as a DuoSense® pen by N-Trig® (e.g., wherein the stylus utilizes a touch sensor grid of a touch screen display) or EMR-based pens by Wacom technology, or any other commercially available or proprietary stylus technology. Further, recall that the stylus sensor in the computing device may be distinct from an also provided touch sensor grid in the computing device. Having the touch sensor grid separate from the stylus sensor grid allows the device to for example, only scan for an stylus input, a touch contact, or to scan specific areas for specific input sources, in accordance with some embodiments. In one such embodiment, the stylus sensor grid includes a network of antenna coils that create a magnetic field which powers a resonant circuit within the stylus. In such an example, the stylus may be powered by energy from the antenna coils in the device and the stylus may return the magnetic signal back to the device, thus communicating the stylus' location above the device, angle of inclination, speed of movement, and control feature activation (e.g., pressure-sensitive squeeze/tap action). In one particular example, the stylus sensor grid of the computing device includes more than one set of antenna coils. In such an example embodiment, one set of antenna coils may be used to merely detect the presence of a touching or hovering or otherwise sufficiently proximate stylus, while another set of coils determines with more precision the stylus' location above the device and can track the stylus' movements.
As previously explained, and with further reference to
If the UI Control Feature check box is checked, the user can use the squeeze/tap function to operate on various UI control features currently displayed or otherwise relevant to current device performance, and particularly a given UI control feature to which the stylus is pointing. For instance, the squeeze/tap function can be engaged to change variables or tool features such as volume (e.g., if the stylus is touching or otherwise pointing at a displayed UI volume control feature, or a playback application is playing music or a video, then squeeze/tap action corresponds to volume control), font size or type (e.g. if the stylus is touching or otherwise pointing at a displayed UI font control feature, or a portion of text is selected on screen, then squeeze/tap action corresponds to font control), color (e.g., if the stylus is touching or otherwise pointing at a displayed UI color control feature, then squeeze/tap action corresponds to color control), line thickness or color (e.g., if the stylus is touching or otherwise pointing at a displayed UI line control feature, then squeeze/tap action corresponds to line control), margin size (e.g., if the stylus is touching or otherwise pointing at a displayed UI margin control feature, then squeeze/tap action corresponds to margin control), zoom (e.g., if the stylus is touching or otherwise pointing at a displayed UI zoom control feature, then squeeze/tap action corresponds to zoom control), painting or drawing tool (e.g., if the stylus is touching or otherwise pointing at a displayed UI painting/drawing tool control feature, then squeeze/tap action corresponds to changing that particular tool's configuration with respect to line width or color, for instance), switching tools within an active application (e.g. if a drawing or note taking application is running and no tool is yet selected, or if the stylus is touching or otherwise pointing at a displayed UI tool box control feature, then squeeze/tap action corresponds to selecting or otherwise changing to a desired tool), and other such variables. As will be appreciated in light of this disclosure, the computing device with which the stylus is interacting may display menus in response to the stylus-based pressure-sensitive control feature action, which can be navigated using further stylus-based pressure-sensitive control feature actions or other user input types (e.g., finger touch directly on touch screen of device, etc). In any such cases, the user can assign a given function to a squeeze or tap action using the pull-down menus shown in
If the Custom UI Control check box is checked, the user can use the stylus-based pressure-sensitive control feature to perform some pre-selected or assigned task, which may depend, for example, upon the active application or context currently active on the computing device. For instance, in the example shown, if a note taking application is active and the user has taken notes therein, a squeeze action will cause the notes to be converted to a text file. In another example, if an application is active where the currently displayed work or content can be centered on the screen (e.g., artwork or any content with a designated center point), a tap action will cause that displayed work or content to be centered on the screen. Further note in this example embodiment that the user may also check the ‘Squeeze Speed Diff’ check box and/or the ‘Tap+Hold Diff’ check box. As previously explained, the degree or applied pressure or duration of a given tap can also be used as a speed differential. However, in other embodiments, it can be used to allow for numerous squeeze/tap combinations and corresponding assigned functions. For instance, note that some functions may be associated with multiple squeeze/tap actions, in accordance with an embodiment. For example. Table 1 shows some example pressure-based squeeze/tap actions and corresponding functions. If the Custom UI Control check box is not checked, then intermediate squeeze actions can be treated the same a full-squeeze actions, for example.
Further note in Table 1 that in some embodiments where a combination of squeeze and/or tap actions is used for a given function, that there may be a time period in which the overall squeeze and/or tap action must be completed to be treated as a single action. To this end, the processor (either in the stylus or the computing device) that receives signals that correspond to each squeeze/tap action can execute a timing function to detect combination squeeze/tap actions. For instance, as long as each sequential squeeze and/or tap action commences within 2 seconds of the previous squeeze and/or tap action ending, then that group of squeeze/tap actions will be treated as a squeeze/tap action that corresponds to a single function. On the other hand, if more than 2 seconds has elapsed from the end of one squeeze and/or tap action to the beginning of the next squeeze and/or tap action, then those squeeze and/or tap actions will be treated as two separate actions that may correspond to two separate functions. Further note that similar functionality can be applied to other stylus control features, such as a multiple stylus push-button presses used to represent a single action that corresponds to a single function, or multiple taps/gestures on a stylus-based touch-sensitive surface to represent a single action that corresponds to a single function.
If the Secondary Functions check box is checked, the user can use the stylus-based pressure-sensitive control feature to perform some pre-selected or assigned task, which is more global in nature and does not necessarily depend upon the content currently displayed or the currently active application or context of the computing device. With such Secondary Functions, further note that the stylus need not be pointing in any particular direction or at any particular content, but merely needs to be within an acceptable distance for its control feature actions to be detected by the stylus detection surface of the computing device. As previously explained, the user may also check the ‘Squeeze Speed Diff’ check box and/or the ‘Tap+Hold Diff’ check box, thereby allowing for a speed differential or various multi-squeeze/tap combinations (and the various corresponding functions). Examples of Secondary Functions include: select content/icon, run application, cut, copy, delete, undo, redo, next page, zoom in/out, adjust font size, adjust brightness, adjust volume, switch tool or application, skip scene, create a note (on device), or start an audio or video recording of a classroom lecture or other event (from device or stylus if stylus is configured to record/store sounds/video). Further examples of Secondary Functions include low-pressure-squeeze for next page/previous page; high-pressure-squeeze for next chapter/previous chapter; a tap to cut or copy; and a tap+hold for 3 to 5 seconds to paste the selected text.
In addition to squeezes of different pressure, a squeeze-and-hold on the pressure-sensitive area can be used do a squeeze action, but holding the squeeze action may keep the action going, in accordance with some embodiments. Thus, a squeeze-and-hold could be used for functions such as, for instance, cycling through fonts, colors, line thicknesses, and other such variables like a carousel. Similarly, if the action is to paginate/scroll pages, then a squeeze-and-hold on the pressure-sensitive area may continue to scroll pages until the hold is released. In some example cases, the user could increase a given variable or rate of action by some factor based on squeeze pressure in a given location before a hold point. For instance, if user executes a high-pressure-squeeze followed by a hold point, the UI can be configured to paginate 10 pages forward at a time, whereas a medium-pressure-squeeze followed by a hold point would paginate 5 pages forward at a time, whereas a low-pressure-squeeze would paginate 1 page forward at a time and would continue to paginate at a suitable rate (e.g., 1 page every 2-3 seconds) until a finger and/or thumb tap is received.
Thus, and as will be appreciated in light of this application, numerous stylus-based pressure functions may be configured on a content-specific level, an application-specific level, or on a global level wherein the action performs the same function regardless of the application running or type of content currently displayed at the time, and regardless of whether content is selected or what the stylus is pointing at. Note that the top button of the stylus shown in
With further reference to the example embodiment of
As can be further seen, a back button arrow UI control feature may be provisioned on the screen for any of the menus provided, so that the user can go back to the previous menu, if so desired. Note that configuration settings provided by the user can be saved automatically (e.g., user input is saved as selections are made or otherwise provided). Alternatively, a save button or other such UI feature can be provisioned, which the user can engage as desired. Numerous other configurable aspects will be apparent in light of this disclosure. Note that in some embodiments the various stylus actions may be visually demonstrated to the user as they are carried out via suitable function animations. Such animations may provide clarity to the function being performed, and in some embodiments the animations may be user-configurable while they may be hard-coded in other embodiments. Again, while
In this example embodiment, the memory includes a number of modules stored therein that can be accessed and executed by the processor (and/or a co-processor). The modules include an operating system (OS), a user interface (UI), and a power conservation routine (Power). The modules can be implemented, for example, in any suitable programming language (e.g., C, C++, objective C, JavaScript, custom or proprietary instruction sets, etc.), and encoded on a machine readable medium, that when executed by the processor (and/or co-processors), carries out the functionality of the device including a UI having a stylus-based, squeeze/tap function as described herein. The computer readable medium may be, for example, a hard drive, compact disk, memory stick, server, or any suitable non-transitory computer/computing device memory that includes executable instructions, or a plurality or combination of such memories. Other embodiments can be implemented, for instance, with gate-level logic or an application-specific integrated circuit (ASIC) or chip set or other such purpose built logic, or a microcontroller having input/output capability (e.g., inputs for receiving user inputs and outputs for directing other components) and a number of embedded routines for carrying out the device functionality. In short, the functional modules can be implemented in hardware, software, firmware, or a combination thereof.
The processor can be any suitable processor (e.g., 800 MHz Texas Instruments OMAP3621 applications processor), and may include one or more co-processors or controllers to assist in device control. In this example case, the processor receives input from the user, including input from or otherwise derived from the power button and the home button. The processor can also have a direct connection to a battery so that it can perform base level tasks even during sleep or low power modes. The memory (e.g., for processor workspace and executable file storage) can be any suitable type of memory and size (e.g. 256 or 512 Mbytes SDRAM), and in other embodiments may be implemented with non-volatile memory or a combination of non-volatile and volatile memory technologies. The storage (e.g., for storing consumable content and user files) can also be implemented with any suitable memory and size (e.g., 2 GBytes of flash memory). The display can be implemented, for example, with a 6-inch E-ink Pearl 800×600 pixel screen with Neonode® zForce® touch screen, or any other suitable display and touch screen interface technology.
The communications module can be configured to execute, for instance, any suitable protocol which allows for connection to the stylus so that stylus-based pressure-sensitive control feature actions may be detected by the device, or to otherwise provide a communication link between the device and the stylus or other external systems. Note in some cases that squeeze/tap actions of the stylus are communicated to the device by virtue of the stylus detection surface and not the communication module. For instance, the detection signals generated by the pressure-sensitive area of the stylus can be used to manipulate the resonant frequency of a stylus-based tank circuit that interacts with a stylus detection circuit of the computing device. In this sense, the communication module may be optional. Example communications modules may include an NFC (near field connection), Bluetooth, 802.11 b/g/n WLAN, or other suitable chip or chip set that allows for wireless connection to the stylus (including any custom or proprietary protocols). In some embodiments, a wired connection can be used between the stylus and device. In some specific example embodiments, the device housing that contains all the various componentry measures about 6.5″ high by about 5″ wide by about 0.5″ thick, and weighs about 6.9 ounces. Any number of suitable form factors can be used, depending on the target application (e.g., laptop, desktop, mobile phone, etc). The device may be smaller, for example, for smartphone and tablet applications and larger for smart computer monitor applications.
The operating system (OS) module can be implemented with any suitable OS, but in some example embodiments is implemented with Google Android OS or Linux OS or Microsoft OS or Apple OS. As will be appreciated in light of this disclosure, the techniques provided herein can be implemented on any such platforms. The power management (Power) module can be configured, for example, to automatically transition the device to low power consumption mode or sleep mode after a period of non-use. A wake-up from that sleep mode can be achieved, for example, by a physical button press and/or a pressure-sensitive, stylus-based squeeze/tap action, a touch screen swipe, or other action. The user interface (UI) module can be programmed or otherwise configured, for example, to carryout user interface functionality, including that functionality based on stylus-based control feature action detection as discussed herein and the various example screen shots and use-case scenarios shown in
The communications module can be, for instance, any suitable module which allows for connection to a nearby electronic device so that information may be passed between the device and the stylus. Example communication modules may include an NFC. Bluetooth, 802.11 b/g/n WLAN, or other suitable chip or chip set which allows for connection to the electronic device. In other embodiments, the communication module of the stylus may implement EMR or other similar technologies that can communicate stylus information to a device, including stylus location and whether a stylus control feature action has been performed, without a separate communications chip or chip set. In one such example, the stylus may include a communication module comprising a resonator circuit that may be manipulated using the various control features of the stylus, such as the pressure-sensitive control feature and/or push-button. In such an example, performing squeeze and tap actions on the stylus-based pressure-sensitive control feature can be used to adjust the resonant frequency of the resonator circuit (e.g., control signal generated by pressure-sensitive control feature is applied to varactor of tank, so as to vary resonant frequency). The altered resonant frequency may be detected by the stylus detection surface of the device, thus triggering a response at the device. Note in such a case that a separate dedicated communication module (e.g., Bluetooth, NFC, etc) may be optional, as previously explained. Further note that such a resonator circuit can be passive, and therefore not require any stylus-based battery or power source to operate.
In another example case, the stylus may include a processor and a communication module arrangement that can receive input from the various control features of the stylus, such as a pressure-sensitive control feature and/or push-button. The stylus further comprises an independent power source (e.g., a battery) in some embodiments, but may do without if the pressure-sensing control feature can function in a passively (e.g., by scavenging radiated power or otherwise function in a passive manner). The stylus-based pressure-sensitive surface is effectively a transducer that converts pressure into an actionable signal that a processor can then interpret and then direct the communication module (e.g., a transceiver) to send a corresponding control signal back to the computing device to implement the corresponding action on the device, in accordance with some embodiments. The mechanism by which the pressure-sensitive surface can translate pressure into signals may include, for example, piezoelectric technology, quantum tunneling composites technology, or other suitable transducer technology. In some such example cases, the stylus may also include a resonator circuit to facilitate interaction with the stylus detection surface as previously explained.
In another example case, the communications module may receive input directly from stylus control features such as the pressure-sensitive control feature and/or push-button, wherein such inputs can be used to enable a corresponding control signal to be sent by the communications module. As will be appreciated, commands may be communicated and/or target content may be transferred between (e.g., copied or cut or pasted) the stylus and the electronic device over a communication link. In one embodiment, the stylus includes memory storage and a transceiver, but no dedicated processor. In such an embodiment, the transceiver of the electronic device communicates with the stylus-based transceiver and the processor of the electronic device can then perform the various functions based on information received from the device-based transceiver. In this way, stylus-based user input can be used to control the device.
Example Stylus-Based Pressure-Sensitive Control Actions
As can be further seen with reference to
Pressure-Sensitive Squeeze/Tap Feature
Methodology
In general, any stylus-sensitive surface may be used on the computing device to detect the stylus touching, hovering over, or being otherwise sufficiently proximate to the device. As discussed above, EMR or other suitable technology may be implemented to detect the presence of a stylus directly or indirectly touching (e.g., hovering over) a stylus-sensitive display, as well as to communicate stylus actions to the electronic device. In one particular example, EMR technology may be implemented to power and/or track a stylus touching or otherwise being sufficiently proximate to a stylus-sensitive display. In one such example, a control feature action may be passively communicated from the stylus to the device by manipulating the resonant frequency of a resonant circuit within the stylus. As previously explained, this change in resonant frequency may be detected by the antenna coils of the stylus detection grid, thus triggering a response at the device, in accordance with some such embodiments. Various control features and/or control feature actions of the stylus may create different changes in resonant frequency, and thus may be assigned distinct functions. The stylus detection grid may track the location of the stylus, thus determining whether the stylus is pointing at selected content, a UI control feature or icon, a specific area of the stylus sensitive display, etc. These main detections can be used in various ways to implement UI functionality. In other example embodiments, stylus pressure-sensitive control feature actions can be actively detected and communicated to the device.
In this example case, the method is used in conjunction with a stylus-based pressure-sensitive control feature and includes determining 601 whether user input has been received, which may include input received when the stylus is hovering over or is otherwise sufficiently proximate to the stylus detection surface, or any other user input. In some embodiments, monitoring for stylus input includes monitoring all or part of a stylus sensitive display screen. In general, the user input monitoring is effectively continuous, and once a user input has been detected, the method may continue with determining 603 whether a stylus-based pressure-sensitive control feature signal has been received. If not, the method continues with reviewing 604 the user input for other UI requests (such as pressure-based stylus input).
If, however, a stylus-based pressure control feature signal has been received, the method continues with determining 605 if the stylus is pointing to a UI control feature. If so, the method continues with determining 607 if the stylus is pointing to a variable (e.g., such as a UI control feature that can be manipulated to directly control a value such as volume, font size, line size, or any other such variables). If so, then the method continues with adjusting 608 the target variable up or down, depending on the pressure action provided. If the stylus is not pointing to a variable, then the method continues with determining 609 if the stylus is pointing to a menu. If so, then the method continues with navigating 610 the target menu, depending on the pressure action provided. In some cases, once the user has navigated to the choice of interest in a given menu, the user may select that choice, for example, by touching it with the stylus tip, clicking a button on the stylus, tapping the pressure-sensitive area, or hovering over that menu item for more than 2 or 3 seconds. If the stylus is not pointing to a menu, then the method continues with determining 611 if the stylus is pointing to a specific tool. If so, then the method continues with scrolling or otherwise navigating 612 the target tool customizations, depending on the pressure action provided. Just as with a menu item, once the user has navigated to a tool customization of interest, the user may select that choice with further appropriate stylus action. If the stylus is not pointing to a specific tool, then the method continues with determining 613 if a customized action should be performed. In some such cases, the custom action may have been configured by the user (as explained with reference to
With further reference to the determination at 605, if the stylus is not pointing to a UI control feature, then the method continues with determining 615 if a pressure-based secondary action should be performed. In some such cases, the secondary action may have been configured by the user (as explained with reference to
Numerous variations and embodiments will be apparent in light of this disclosure. One example embodiment of the present invention provides a system including an electronic device having a display for displaying content to a user and a stylus detection surface for allowing user input via a stylus, and a user interface executable on the device and configured to perform a function in response to a stylus-based pressure-sensitive control feature input provided without direct contact between the stylus detection surface and stylus. In some cases, the function that is performed in response to the stylus-based pressure-sensitive control feature input is user-configurable. In some cases, the stylus detection surface comprises at least one set of antenna coils configured to detect changes in a resonant circuit within the stylus. In some such cases, the stylus detection surface includes a second set of antenna coils configured to detect at least one of location, speed of stylus movement, angle of stylus inclination and/or a change in resonant frequency of the resonant circuit within the stylus. In some cases, the system includes the stylus, wherein the stylus comprises a pressure-sensitive control feature input for providing the stylus-based pressure-sensitive control feature input. In some such cases including the stylus, manipulating the pressure-sensitive control feature creates a change in resonant frequency of a resonant circuit within the stylus. In some such other cases including the stylus, the stylus is configured to communicate with the electronic device over a wireless communication link. In some such cases, the stylus can be configured in real-time over the wireless communication link. In some cases, the stylus-based pressure-sensitive control feature input comprises a combination of squeeze and/or tap actions. In some cases, the function that is performed in response to the stylus-based pressure-sensitive control feature input is one of a plurality of functions that can be performed in response to specific stylus-based pressure-sensitive control feature input. In some cases, the electronic device is configured to provide at least one of an audio and/or visual notification associated with a function. In some cases, the function that is performed in response to the stylus-based pressure-sensitive control feature input is determined based on stylus location over the stylus detection surface. In some cases, the display is a touch screen display and includes the stylus detection surface. In some cases, the electronic device is an eReader device or a tablet computer or a smartphone. In some cases, the function performed in response to a stylus-based pressure-sensitive control feature input includes at least one of adjusting a variable, executing a particular command, switching between tools, modifying a particular tool's settings, and/or launching an application.
Another example embodiment of the present invention provides a system including an electronic device having a display for displaying content to a user and a stylus detection surface for allowing user input, a stylus having a pressure-sensitive control feature (wherein the stylus is configured to communicate with the electronic device), and a user interface executable on the device and configured to perform a function in response to a stylus-based pressure-sensitive control feature input. In some cases, the stylus-based pressure-sensitive control feature input is derived from one or more squeeze-types, one or more tap-types, or a combination thereof on the pressure-sensitive control feature.
Another example embodiment of the present invention provides a computer program product including a plurality of instructions non-transiently encoded thereon to facilitate operation of an electronic device according to a process. The computer program product may include one or more computer readable mediums such as, for example, a hard drive, compact disk, memory stick, server, cache memory, register memory, random access memory, read only memory, flash memory, or any suitable non-transitory memory that is encoded with instructions that can be executed by one or more processors, or a plurality or combination of such memories. In this example embodiment, the process is configured to display content to a user via an electronic device having a stylus detection surface for allowing user input via a stylus, and perform a function in response to a stylus-based pressure-sensitive control feature input provided without direct contact between the stylus detection surface and stylus. In some cases, the function comprises at least one of performing an undo action, performing an redo action, launching a note taking application, recording a sound and/or images, or switching from a first tool to a second tool. In some cases, the stylus detection surface is configured to detect a change in stylus resonant frequency caused by a stylus-based pressure-sensitive control feature that provides the stylus-based pressure-sensitive control feature input.
The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4896543 | Gullman | Jan 1990 | A |
| 5045843 | Hansen | Sep 1991 | A |
| 5576502 | Fukushima | Nov 1996 | A |
| 5633471 | Fukushima | May 1997 | A |
| 5844557 | Shively, II | Dec 1998 | A |
| 6005555 | Katsurahira et al. | Dec 1999 | A |
| 6259438 | Fleck et al. | Jul 2001 | B1 |
| 6271830 | Berstis | Aug 2001 | B1 |
| 6498601 | Gujar | Dec 2002 | B1 |
| 6577299 | Schiller et al. | Jun 2003 | B1 |
| 6956564 | Williams | Oct 2005 | B1 |
| 7292229 | Morag et al. | Nov 2007 | B2 |
| 7646379 | Drennan | Jan 2010 | B1 |
| 7649524 | Haim et al. | Jan 2010 | B2 |
| 7840912 | Elias et al. | Nov 2010 | B2 |
| 7898541 | Hong et al. | Mar 2011 | B2 |
| RE42738 | Williams | Sep 2011 | E |
| 8059101 | Westerman et al. | Nov 2011 | B2 |
| 8239413 | Hubert | Aug 2012 | B2 |
| 8274536 | Chaudhri et al. | Sep 2012 | B2 |
| 8286104 | Yonge-Mallo | Oct 2012 | B1 |
| D670713 | Cranfill et al. | Nov 2012 | S |
| RE44103 | Williams | Mar 2013 | E |
| 8400417 | Ording et al. | Mar 2013 | B2 |
| 8508494 | Moore | Aug 2013 | B2 |
| 9411461 | Marshall et al. | Aug 2016 | B2 |
| 9483138 | Harris et al. | Nov 2016 | B2 |
| 9589538 | Davidson et al. | Mar 2017 | B2 |
| 20010025289 | Jenkins et al. | Sep 2001 | A1 |
| 20020047834 | Okamoto | Apr 2002 | A1 |
| 20020116421 | Fox et al. | Aug 2002 | A1 |
| 20020134594 | Taylor et al. | Sep 2002 | A1 |
| 20020190823 | Yap | Dec 2002 | A1 |
| 20030095115 | Brian et al. | May 2003 | A1 |
| 20040095333 | Morag et al. | May 2004 | A1 |
| 20040252110 | Defuans et al. | Dec 2004 | A1 |
| 20050110777 | Geaghan | May 2005 | A1 |
| 20050156914 | Lipman et al. | Jul 2005 | A1 |
| 20050200293 | Naugler, Jr. | Sep 2005 | A1 |
| 20060267966 | Grossman et al. | Nov 2006 | A1 |
| 20060284854 | Cheng et al. | Dec 2006 | A1 |
| 20070047002 | Hull et al. | Mar 2007 | A1 |
| 20070070053 | Lapstun et al. | Mar 2007 | A1 |
| 20070176908 | Lipman et al. | Aug 2007 | A1 |
| 20070247425 | Liberty et al. | Oct 2007 | A1 |
| 20080012835 | Rimon et al. | Jan 2008 | A1 |
| 20080036747 | Hope | Feb 2008 | A1 |
| 20080166048 | Raif | Jul 2008 | A1 |
| 20080309621 | Aggarwal et al. | Dec 2008 | A1 |
| 20090078476 | Rimon | Mar 2009 | A1 |
| 20090115722 | Shan | May 2009 | A1 |
| 20090115744 | Zhang | May 2009 | A1 |
| 20090167728 | Geaghan et al. | Jul 2009 | A1 |
| 20090231613 | Imai | Sep 2009 | A1 |
| 20100013792 | Fukushima | Jan 2010 | A1 |
| 20100021022 | Pittel et al. | Jan 2010 | A1 |
| 20100084468 | Lapstun | Apr 2010 | A1 |
| 20100100854 | Russell et al. | Apr 2010 | A1 |
| 20100192086 | Kocienda et al. | Jul 2010 | A1 |
| 20100229130 | Edge et al. | Sep 2010 | A1 |
| 20100238521 | Rusman et al. | Sep 2010 | A1 |
| 20100259482 | Ball | Oct 2010 | A1 |
| 20100262659 | Christiansen et al. | Oct 2010 | A1 |
| 20100277327 | Lee | Nov 2010 | A1 |
| 20100318895 | Steinberger et al. | Dec 2010 | A1 |
| 20100321345 | Pearce et al. | Dec 2010 | A1 |
| 20110012849 | Cho et al. | Jan 2011 | A1 |
| 20110115741 | Lukas et al. | May 2011 | A1 |
| 20110163972 | Anzures et al. | Jul 2011 | A1 |
| 20110169756 | Ogawa | Jul 2011 | A1 |
| 20110193776 | Oda | Aug 2011 | A1 |
| 20110216091 | Song et al. | Sep 2011 | A1 |
| 20110241832 | Lipman et al. | Oct 2011 | A1 |
| 20110241988 | Bensler | Oct 2011 | A1 |
| 20110242006 | Thompson et al. | Oct 2011 | A1 |
| 20110258542 | Kenney et al. | Oct 2011 | A1 |
| 20110304577 | Brown | Dec 2011 | A1 |
| 20120032880 | Kim | Feb 2012 | A1 |
| 20120032909 | Wang | Feb 2012 | A1 |
| 20120056821 | Goh | Mar 2012 | A1 |
| 20120127110 | Amm et al. | May 2012 | A1 |
| 20120139879 | Kim et al. | Jun 2012 | A1 |
| 20120194457 | Cannon et al. | Aug 2012 | A1 |
| 20120212412 | Mizuno | Aug 2012 | A1 |
| 20120221938 | Patterson et al. | Aug 2012 | A1 |
| 20120229428 | Tavakoli et al. | Sep 2012 | A1 |
| 20120235901 | Binder | Sep 2012 | A1 |
| 20120242579 | Chua | Sep 2012 | A1 |
| 20120242584 | Tuli | Sep 2012 | A1 |
| 20120249768 | Binder | Oct 2012 | A1 |
| 20120280911 | Su | Nov 2012 | A1 |
| 20120280947 | Weaver et al. | Nov 2012 | A1 |
| 20120280950 | Stephanick et al. | Nov 2012 | A1 |
| 20120311438 | Cranfill et al. | Dec 2012 | A1 |
| 20120327040 | Simon et al. | Dec 2012 | A1 |
| 20120329529 | van der Raadt | Dec 2012 | A1 |
| 20120331546 | Falkenburg et al. | Dec 2012 | A1 |
| 20130016045 | Zhao et al. | Jan 2013 | A1 |
| 20130036383 | Yuan et al. | Feb 2013 | A1 |
| 20130038579 | Boyd et al. | Feb 2013 | A1 |
| 20130038859 | Boyd et al. | Feb 2013 | A1 |
| 20130044083 | Basnett et al. | Feb 2013 | A1 |
| 20130057505 | Yu et al. | Mar 2013 | A1 |
| 20130063364 | Moore | Mar 2013 | A1 |
| 20130063366 | Paul | Mar 2013 | A1 |
| 20130076632 | Sirpal et al. | Mar 2013 | A1 |
| 20130076637 | Teltz | Mar 2013 | A1 |
| 20130076638 | Sirpal et al. | Mar 2013 | A1 |
| 20130076781 | Sirpal et al. | Mar 2013 | A1 |
| 20130082937 | Liu et al. | Apr 2013 | A1 |
| 20130082976 | Kang | Apr 2013 | A1 |
| 20130088464 | Pearce | Apr 2013 | A1 |
| 20130100022 | Thompson et al. | Apr 2013 | A1 |
| 20130106714 | Shahpamia et al. | May 2013 | A1 |
| 20130106719 | Sundara-Rajan et al. | May 2013 | A1 |
| 20130106723 | Bakken et al. | May 2013 | A1 |
| 20130106731 | Yilmaz et al. | May 2013 | A1 |
| 20130106782 | Nowatzyk et al. | May 2013 | A1 |
| 20130106796 | Yilmaz et al. | May 2013 | A1 |
| 20130106798 | Sundara-Rajan et al. | May 2013 | A1 |
| 20130106800 | Yilmaz et al. | May 2013 | A1 |
| 20130113699 | Lim | May 2013 | A1 |
| 20130113723 | Chen et al. | May 2013 | A1 |
| 20130113762 | Geaghan | May 2013 | A1 |
| 20130120271 | Lee et al. | May 2013 | A1 |
| 20130120463 | Harris | May 2013 | A1 |
| 20130135220 | Alameh et al. | May 2013 | A1 |
| 20130135234 | Hisano et al. | May 2013 | A1 |
| 20130135262 | Alameh et al. | May 2013 | A1 |
| 20130139078 | Chuang et al. | May 2013 | A1 |
| 20130139107 | Jung | May 2013 | A1 |
| 20130162532 | Cheng et al. | Jun 2013 | A1 |
| 20130162589 | Lien et al. | Jun 2013 | A1 |
| 20130176247 | Jogo et al. | Jul 2013 | A1 |
| 20130185680 | Chaudhri et al. | Jul 2013 | A1 |
| 20130194308 | Privault et al. | Aug 2013 | A1 |
| 20130201162 | Cavilia | Aug 2013 | A1 |
| 20130207937 | Lutian et al. | Aug 2013 | A1 |
| 20130229389 | DiVerdi | Sep 2013 | A1 |
| 20130229390 | DiVerdi | Sep 2013 | A1 |
| 20130229391 | Diverdi | Sep 2013 | A1 |
| 20130285934 | Ting et al. | Oct 2013 | A1 |
| 20130321305 | Liang et al. | Dec 2013 | A1 |
| 20130321360 | Huang | Dec 2013 | A1 |
| 20140002422 | Stern et al. | Jan 2014 | A1 |
| 20140028577 | Krah et al. | Jan 2014 | A1 |
| 20140028634 | Krah et al. | Jan 2014 | A1 |
| 20140049467 | Laligand et al. | Feb 2014 | A1 |
| 20140078116 | Mercea et al. | Mar 2014 | A1 |
| 20140085269 | Armstrong-Muntner | Mar 2014 | A1 |
| 20140092069 | Bentov | Apr 2014 | A1 |
| 20140098033 | Simmons | Apr 2014 | A1 |
| 20140104224 | Ih et al. | Apr 2014 | A1 |
| 20140111426 | Inamoto et al. | Apr 2014 | A1 |
| 20140146021 | Trethewey et al. | May 2014 | A1 |
| 20140150026 | Mountain | May 2014 | A1 |
| 20140160089 | Fletcher et al. | Jun 2014 | A1 |
| 20140168175 | Mercea et al. | Jun 2014 | A1 |
| 20140168176 | Nowatzyk et al. | Jun 2014 | A1 |
| 20140192028 | Leydon | Jul 2014 | A1 |
| 20140210797 | Kreek | Jul 2014 | A1 |
| 20140232693 | Schuckle | Aug 2014 | A1 |
| 20140232699 | Viswanathan | Aug 2014 | A1 |
| 20140267120 | Zhang et al. | Sep 2014 | A1 |
| 20140347329 | Ware | Nov 2014 | A1 |
| 20150002486 | Valicek | Jan 2015 | A1 |
| 20150029162 | Harris et al. | Jan 2015 | A1 |
| 20150040243 | Mittal | Feb 2015 | A1 |
| 20150074578 | Liang et al. | Mar 2015 | A1 |
| 20150103040 | Huang et al. | Apr 2015 | A1 |
| 20150169059 | Behles et al. | Jun 2015 | A1 |
| 20150205479 | Zhu et al. | Jul 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 0722150 | Jul 1996 | EP |
| Entry |
|---|
| PAiA-Touch Switches, PAiA Corporation USA, file:///S:/Client%20Files/Barnes%20%20Noble/IDS%20Master%20Folder/S&G%20-%2 . . . , 3 pages, printed from the Internet on Aug. 27, 2013. |
| “Adonit Jot Touch (for iPad),” Adonit Jot Touch (for iPad) Review & Rating—PCMag.com; http://www.pcmag.com/article2/0,2817,2411192,00.asp; 6pages, printed from the Internet on Jun. 20, 2013. |
| Volpe, Joseph, Amazon patents intelligent pen for adding annotations to digital and printed media (updated), posted Mar. 6, 2012 at 5:39PM, http://www.engadget.com/2012/03/06/amazon-patents-intelligent-pen/, 3 pages, printed from the Internet on Jun. 20, 2013. |
| “Apple Secretly Filed Three Dynamic Smart Pen Patents in Europe that are Chock Full of Cool Ideas,” http://www.patentlyapple.com/patently-apple/2013/02/apple-secretly-filed-three-dynamic-smart-pen-patents-in-europe-that-are-chock-full-of-cool-ideas.html, originally published Feb. 28, 2013, 13 pages, printed from the Internet on Aug. 13, 2013. |
| “Bamboo Stylus,” Wacom Americas, http://www.wacom.com/en/products/stylus, 5 pages, printed from the Internet on Jun. 20, 2013. |
| Robertson, Adi, “Blue Tiger pressure-sensitive iOS stylus will work over Bluetooth 4.0,” http://www.theverge.com/2012/3/7/2851562/blue-tiger-ten-one-design-pressure-sensitive-bluetooth-4-0-stylus, 1 page, printed from the Internet on Aug. 2, 2013. |
| Malacria, et al., “Clutch-Free Panning and Integrated Pan-Zoom Control on Touch-Sensitive Surfaces: The CycloStar Approach,” CHI 2010, Apr. 10-15, 2010, Atlanta, Georgia, USA. Copyright 2010 ACM 978-1-60558-929-9, 10 pages, Sep. 10, 2004. |
| “Pen,” DuoSense Pen, N-trig Hands-on computing, http://www.n-trig.com/Content.aspx?Page=DigitalPencil, 3 pages, printed from the Internet on Jun. 20, 2013. |
| “Easing functions,” Easing Functions Cheat Sheet, http://easings.net/, 3 pages, printed from the Internet on Jun. 17, 2013. |
| Kirupa, Easing Functions (aka Timing Functions) in CSS3, printed Apr. 3, 2013, kirupa.com, http://www.kirupa.com/html5/easing_functions_css3.htm, 16 pages, printed from the Internet on Jun. 18, 2013. |
| “EMR (Electro-Magnetic Resonance) Technology—The De Facto Standard for Pen Tablet Devices is Realized using EMR Technology,” Wacom Components : Input Technology : EMR Technology, http://wacom-components.com/english/technology/emr.html, 5 pages, printed from the Internet on Aug. 2, 2013. |
| “Simultaneous Pen & Touch: The Natural Way to Work,” Perceptive Pixel Active Stylus, www.perceptivepixel.com/_literature_136086/Active_Stylus, 2 pages, printed from the Internet on Dec. 14, 2012. |
| “Future Apple Notebooks & Tablets may use Acoustic Commands—Patently Apple,” originally published Feb. 18, 2011, http://www.patentlyapple.com/patently-apple/2011/02/future-apple-notebooks-tablets-may,6 pages, printed from the Internet on Nov. 3, 2012. |
| “Guidelines for selecting text and images (Windows Store apps),” http://msdn.microsoft.com/en-us/library/windows/apps/hh465334, 5 pages, printed from the Internet on Jun. 20, 2013. |
| Lutz, Zachary, “Hands-on with wireless, ultrasonic stylus an touchless gestures at MWC (video),” posted Mar. 1, 2012 at 8:28 AM, http://www.engadget.com/2012/03/01/hands-on-with-wireless-ultrasonic-stylus-and-touchl, 3 pages, printed from the Internet on Jun. 20, 2013. |
| “HEX3 JaJa Pressure Sensitive Stylus,” HEX3 JaJa Pressure Sensitive Stylus Review & Rating—PCMag.com, http://www.pcmag.com/article2/0,2817,2411194,00.asp, 6 pages, printed from the Internet on Jun. 20, 2013. |
| “How do WACOM tablets work?,” tablet4u.co.uk, http://www.tablet4u.co.uk/techinfo.html, 2 pages, printed from the Internet on Jun. 20, 2013. |
| Kim, Arnold, “Multi-Touch Page Flipping eBook Concept Shown on an iPad,” posted Jan. 22, 2012 at 10:52pm PST, MacRumors—news and rumors you care about, http://www.macrumors.com/2012/01/23/multi-touch-page-flipping-ebook-concept-shown-6 pages, printed from the Internet on Nov. 3, 2012. |
| “Desktop Touchscreens,”—Desktop touchscreens explained, http://www.touchscreenmagazine.nl/touchscreen-solutions/desktop-touchscreens, 1 page, printed from the Internet on Nov. 3, 2012. |
| “MTStylus Wireless Stereo Stylus for iPhone/Andriod Phone & Tablet,” dexim-MTStylus Wireless Stereo Stylus, http://www.dexim.net/content.php?id=165&pid=11, 2 pages, printed from the Internet on Jun. 20, 2013. |
| “Padblue 2,” BRANDO—mobile.brando.com, http://mobile.brando.com/Padblue-2_p9162c1577d94.html., 4 pages, printed from the Internet on May 10, 2013. |
| Fingas, Jon, “Panasonic mobile devices to use Anoto's pattern-based pen input technology,” posted Jan. 8, 2013 at 1:00PM, http://www.engadget.com/2013/01/08/panasonic-mobile-devices-to-use-anoto-pattern-pen-, 4 pages, printed from the Internet on Jun. 20, 2013. |
| “Bluetooth 4.0 SmartPen The future just got a little brighter,” Pogo Connect, http://tenonedesign.com/connect.php, 7 pages, printed from the Internet on Jun. 20, 2013. |
| Quick, Darren, “Pressure sensitive technology set to bring 3D capability to touchscreens,” posted on Jan. 31, 2010, Mobile Technology, http://www.gizmag.com/new-touchscreen-technology, 4 pages, printed from the Internet on Aug. 2, 2013. |
| Rigg, Jamie, “Sony tries to patent stylus with friction-based haptic feedback,” posted on Nov. 22, 2012 at 9:50 AM, http://www.engadget.com/2012/11/22/sony-haptic-feedback-stylus-patent/, 2 pages, printed from the Internet on Jun. 20, 2013. |
| “Stylus Hanging Bluetooth Headset,” BRANDO—mobile.brando.com, http://mobile.brando.com/prod_detail.php?prod_id=03291, 4 pages, printed from the Internet on May 10, 2013. |
| “The JukeStyle is a great budget stylus for your iOS devices,” stylus Archives—iPad News, http://www.ipadnews.nl/tag/stylus/, 44 pages, printed from the Internet on Jun. 20, 2013. |
| Lavrinc, Damon, “Why Flipping Through Paper-Like Pages Endures in the Digital World,” originally posted on May 11, 2012 at 3:48PM, Gadget Lab, http://www.wired.com/gadgetlab/2012/05/why-flipping-through-paper-like-pages-endures-in-the-digital-world/, 5 pages, printed from the Internet on May 6, 2013. |
| Bragdon, et al., “Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 403-412 (2011). |
| “Gesture Search for Google Mobile”, Google Mobile, www.google.com/mobile/gesture-search, 1 page, printed from the Internet on Dec. 26, 2012. |
| “Comics by comiXology,” Comic Book Reader Guide, http://www.comicbookreaderguide.com/comics-by-comixology/, 24 pages, printed from the Internet on May 6, 2013. |
| “NFC Forum: Frequently Asked Questions,” http://www.nfc-forum.org/resources/faqs#acknowledge, 11 pages, printed from the Internet on Feb. 18, 2013. |
| “How to Remote Wipe an iPhone or iPad,” OSXDaily, http://osxdaily.com/2012/06/05/remote-wipe-iphone-or-ipad/, 4 pages, printed from the Internet on Feb. 2, 2013. |
| “Screen hotspot,” Wikipedia, the free encyclopedia, http://en.wikipedia.org/wiki/Screen_hotspot, 1 page, printed from the Internet on May 15, 2013. |
| “Explaining how the sPen tech works (and is very diff than other styluses),” http://forum.xda-developers.com/showthread.php?t=, 1 page, printed from the Internet on Jan. 15, 2013. |
| Kanai, et al., “Intra-Rendition Navigation,” Copyright 2012-2013 International Digital Publishing Forum (IDPF), 13 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20140253522 A1 | Sep 2014 | US |
