This relates generally to electronic devices, and, more particularly, to input-output components for electronic devices.
Electronic equipment sometimes include touch sensitive components for gathering user input. For example, devices such as tablet computers and cellular telephones include touch-sensitive displays that can be used to display selectable menu options and virtual keyboards. With this type of input arrangement, a user's fingers may be used to provide input to a device.
The surfaces of touch sensitive displays are generally rigid. As a result, a user's finger motion will be abruptly halted upon contact with a display surface. If care is not taken, finger impact events may be jarring and fatiguing.
A user may provide finger press input to a touch sensitive input surface or other input surface. The input surface may be formed from a two-dimensional touch sensor overlapping a display of an electronic device. The electronic device and associated equipment such as a finger-mounted device may form a system for gathering the finger press input from the user.
A sensor such as an optical proximity sensor or capacitive proximity sensor may be used in monitoring when the finger-mounted device and a user's finger in the device approach the input surface of the electronic device. In response to detection of motion of the finger towards the input surface, actuators in the finger-mounted device may squeeze the finger inwardly. This causes a finger pad portion of the finger to protrude outwardly towards the input surface, thereby softening impact between the finger and the input surface.
The electronic device may also have an array of components that repel the finger-mounted device and/or the finger in response to detection of the motion of the finger towards the input surface. These components may produce repulsive force using electrostatics, magnetic repulsion or attraction, ultrasonic output, and mechanical output. The components may, as an example, include an array of electromagnetics overlapping the input surface that magnetically repel a component such as a permanent magnet in the finger-mounted device.
Electronic equipment such as cellular telephones, tablet computers, embedded systems, and other equipment may include touch sensitive input devices. For example, electronic devices may include touch sensitive displays. A user may supply user input to a touch sensitive display using one or more fingers. In some situations, finger swipes and other gestures may be provided as input. In other situations, a user's fingers may strike the surface of a touch sensitive display in a direction that is normal to the surface. This type of finger press input (sometimes referred to as finger stroke input, keystroke input, virtual keyboard input, or virtual button input) may be used, for example, when a user is typing on a virtual keyboard. Virtual keyboards may be formed on touch sensitive displays by displaying key icons on the display and capturing respective touch sensor input. If desired, input surfaces such as virtual keyboards can be formed on other structures (e.g., table tops, vehicle dashboards, refrigerators, etc.). For example, finger press input may be gathered form an input surface onto which key icons have been projected using a projector and/or finger press input may be gathered from an input surface without any visible key icons. Configurations in which finger press input is gathered using two-dimensional touch sensors overlapping displays are sometimes described herein as examples.
To lessen fatigue and improve a user's experience when providing finger press input, the forces imposed on a user's fingers as the user is providing input to an electronic device can be modified using components coupled to a user's finger and/or components in the electronic device. As an example, components in a finger-mounted device and/or in a device with a touch sensitive input surface may be used to help soften the impact between a user's finger and the input surface.
An unmodified finger impact event may be characterized by an abrupt force-versus-displacement profile (e.g., rapidly rising force on a user's finger when traveling a relatively short distance toward an input surface). By modifying these forces, a user may be provided with softer finger-to-input-surface interactions, with finger sensations that mimic the action of clicking on a physical button, and/or other finger sensations.
The way in which a user's finger interacts with a conventional input surface is illustrated in connection with
In the scenario of
When finger pad 16 initially contacts surface 24, bone 12 is at distance D1 from surface 24. As finger 10 is moved further in the +Z direction towards surface 24, finger pulp 14 will be compressed and will flatten while expending laterally (to the left and right in the present example). When finger pulp 14 is fully compressed, finger 10 will come to rest against surface 24 and further motion of finger 10 in the +Z direction will be prevented. As shown in
The process of arresting downward motion of finger 10 in this way can be abrupt. To reduce the abruptness of finger impacts against an input surface, the user's finger and/or an electronic device associated with input surface 24 may be provided with components that help soften the impact of the user's finger with surface 24 and/or that otherwise control user finger motion and user finger sensations during finger press events.
Consider, as an example, the system arrangement of
With the arrangement of
Due to the inward pressure on finger 10 and the extension of finger pad 16, finger pad 16 will contact surface 24 of device 26B earlier than if finger 10 had not been squeezed. As shown in
In the examples of
In a first illustrative arrangement (see, e.g.,
In a second illustrative arrangement (see, e.g.,
A third illustrative arrangement is associated with curve 36. In this illustrative arrangement, the inward force from the actuators in regions 26A′ of device 20A is modulated dynamically, so curve 32 is characterized by a relatively early initial increase (at position ZE), a local peak (at position ZP), and a local valley (at position ZV), before rising sharply at fully compressed finger pulp position ZC. The rapid increase in force F between position ZE and ZP relative to curve 34 may be achieved by increasing inward squeezing of finger pulp 14 during motion of finger 10 from position ZE to position ZP. The rapid decrease in force F between position ZP and position ZV relative to curve 34 may be achieved by decreasing the inward squeezing of finger pulp 14 between position ZP and position ZV (e.g., by moving actuators in portions 26′ outwardly). Force F may be increased again (after reaching a local minimum at position ZV) by increasing inward squeezing force using actuators in portions 26′ as finger 10 moves from position ZV towards position ZC.
Use of a force profile of the type shown by curve 34 may help reduce fatigue as a user types or otherwise provides touch input to input surface 24 with fingers such as finger 10. Use of a force profile of the type shown by curve 36 may help provide the user with haptic feedback while providing user input. For example, curve 36 may be associated with a clicking sensation of the type that a user may experience when pressing on a physical button. Other force profiles may be applied to finger 10, if desired. The examples of
With one illustrative configuration, which may sometimes be described herein as an example, device 26A is a finger-mounted device (e.g., a finger-mounted pad, a finger-mounted housing with a U-shaped body that grasps the user's finger, a finger-mounted device with other shapes, etc.) and device 26B is a cellular telephone, tablet computer, laptop computer, wristwatch device, or other device with a touch sensitive input surface that is mounted on a device housing or that overlaps a pixel array in a display. In some configurations, only device 26A or only device 26B is used to modify finger forces. In other configurations, components in devices 26A and 26B operate in corporation with each other to modify finger forces.
Devices 26A and 26B may include control circuitry 40A and 40B. Control circuitry 40A and 40B may include storage and processing circuitry for supporting the operation of system 28. The storage and processing circuitry may include storage such as nonvolatile memory (e.g., flash memory or other electrically-programmable-read-only memory configured to form a solid state drive), volatile memory (e.g., static or dynamic random-access-memory), etc. Processing circuitry in control circuitry 40A and 40B may be used to gather input from sensors and other input devices and may be used to control output devices. The processing circuitry may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors and other wireless communications circuits, power management units, audio chips, application specific integrated circuits, etc. To support communications between devices 26A and 26B and/or to support communications between equipment in system 28 and external electronic equipment, control circuitry 40A and/or 40B may include antennas, radio-frequency transceiver circuitry, and other wireless communications circuitry and/or wired communications circuitry. Control circuitry 40A and/or 40B may, for example, support bidirectional wireless communications between devices 26A and 26B over a wireless local area network link, a near-field communications link, or other suitable wired or wireless communications link (e.g., a Bluetooth® link, a WiFi® link, a 60 GHz link, etc.).
Devices 26A and/or 26B may include sensors 44A and/or 44B. Sensors 44A and/or 44B may include force sensors, touch sensors such as capacitive touch sensors, capacitive proximity sensors, optical sensors (e.g., ambient light sensors that detect light and/or optical proximity sensors that emit light and detect reflected light), image sensors, sensors for detecting position, orientation, and/or motion (e.g., accelerometers, magnetic sensors such as compass sensors, gyroscopes, inertial measurement units that contain some or all of these sensors), muscle activity sensors (EMG) for detecting finger actions, and/or other sensors. In some arrangements, devices 26A and/or 26B may use sensors 44A and/or 44B and/or other devices to gather user input (e.g., buttons may be used to gather button press input, touch sensors overlapping displays can be used for gathering user input, touch pads may be used in gathering touch input, microphones may be used for gathering audio input, accelerometers in device 26A and/or 26B may be used in monitoring when a finger contacts an input surface and may therefore be used to gather finger press input, etc.).
Devices 26A and/or 26B may include output devices such as actuators 46A and/or 46B. Actuators 46A and/or 46B may include electromagnetic actuators, motors, piezoelectric actuators, electroactive polymer actuators, vibrators, linear actuators, rotational actuators, actuators that bend bendable members, and may include output devices that create and/or control repulsive and/or attractive forces between devices 26A and/or 26B (e.g., components for creating electrostatic repulsion and/or attraction such as electrodes, components for producing ultrasonic output such as ultrasonic transducers, components for producing magnetic interactions such as electromagnets for producing direct-current and/or alternating-current magnetic fields, permanent magnets, magnetic materials such as iron or ferrite, and/or other circuitry for producing repulsive and/or attractive forces between devices 26A and/or 26B). In some situations, actuators 46A and/or 46B or other devices for creating forces in devices 26A and/or 26N may be used in squeezing finger 10 and/or otherwise directly interacting with finger pulp 12. In other situations, these components may be used to interact with each other (e.g., by creating a dynamically adjustable electromagnetic repulsion and/or attraction force between device 26A and 26B using electromagnets in device 26A and/or 26B). Configurations for system 28 may also be used in which finger-pulp-squeezing actuators are used in conjunction with components that create repulsive and/or attractive forces with finger 10 and/or devices 26A and/or 26B (e.g., based on electrostatic effects, ultrasonic effects, magnetic effects, and/or other effects).
If desired, actuators 46A along the sides of device 26A and/or in other portions of device 26A may be individually adjusted. As shown in
If desired, devices 26A and/or 26B may produce signals that create attraction and/or repulsion between device 26A (and finger 10) and device 26B. As shown in
With one illustrative configuration, components 52A and 52B may create attractive and/or repulsive forces using electrostatic attraction or repulsion. For example, components 52B may include electrodes that are supplied with electrostatic charge using paths 54. As finger 10 is approaching input surface 24, electrostatic repulsion of finger 10 may be increased to help soften the impact between finger 10 and surface 24. Electrostatic repulsion may also be used to create repulsion between components 52B and component 52A and thereby apply a repulsive force indirectly to finger 10. The electrostatic repulsion (and/or attraction) electrodes of components 52B may, if desired, be indium tin oxide electrodes or other transparent conductive electrodes that also serve as capacitive electrodes in a two-dimensional capacitive touch sensor array overlapping a display.
In another illustrative configuration, components 52A and/or 52B are ultrasonic transducers that creation ultrasonic sound and/or ultrasonic vibrations of device 26A and/or surface 24, thereby adjusting the sensation of contact between finger pad 16 and surface 24.
In some configurations, components 52A and/or 52B are electromagnets (e.g., coils) that produce direct-current magnetic fields. A direct-current magnetic field may, for example, repel a permanent magnet (e.g., when component 52A is a permanent magnet) or may attract a magnetic material such as iron (e.g., when component 52A is a magnetic material). Alternating-current electromagnetic fields may be produced by components 52B (e.g., when components 52B include coils and/or antennas) and may induce eddy currents in component 52A (e.g., when component 52A is a conductive metal plate). These eddy currents may interact with the applied electromagnetic fields and may create repulsive force between components 52B and 52A.
Other arrangements may rely on other forces (e.g., mechanical forces such as haptic output produced by actuators 46A and/or 46B that create sensations of attraction and/or repulsion between devices 26A and 26B, lateral squeezing forces from actuators 46A that extend finger pad 16 and thereby modify force F, etc.) may be used in modifying finger sensations as a user provides key press input with one or more fingers such as finger 10.
Control circuitry 40A and/or 40B may adjust these force-producing components based on sensor input from sensors 44A and/or 44B. For example, repulsive forces between devices 26A and 26B may be generated in response to detection with sensors 44A and/or 44B (e.g., a proximity sensor, etc.) that devices 26A and 26B are less than a predetermined threshold distance from each other. In response to detecting that device 26A has moved within a given distance of input surface 24, for example, device 26B may create an electromagnetic repulsive force, an ultrasonic force, an electrostatic force, etc. and/or device 26A may use one or more actuators 46A to squeeze finger 10 and thereby extend pad 16 away from nail 18. The sensor that detects proximity between device 26A (and finger 10) and device 26B may be located in device 26A and/or in device 26B. In situations in which the repulsive force is generated by a different device than the device containing the sensor, wireless communications can be used to signal the non-sensor-containing device to use its components to generate the repulsive force.
Finger sensations may also be modified during lateral movement of finger 10. Consider, as an example, the scenario of
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application is a continuation of U.S. patent application Ser. No. 17/965,689, filed Oct. 13, 2022, which is a continuation of U.S. patent application Ser. No. 16/883,876, filed May 26, 2020, which is a continuation of U.S. patent application Ser. No. 16/038,544, filed Jul. 18, 2018, now U.S. Pat. No. 10,712,931, which claims the benefit of provisional patent application No. 62/551,725, filed Aug. 29, 2017, which are hereby incorporated by reference herein in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
5631861 | Kramer | May 1997 | A |
6088017 | Tremblay et al. | Jul 2000 | A |
8570273 | Smith | Oct 2013 | B1 |
9104271 | Adams et al. | Aug 2015 | B1 |
9110505 | Mastandrea | Aug 2015 | B2 |
9342151 | Gu | May 2016 | B2 |
9612664 | Croisonnier | Apr 2017 | B2 |
9652038 | Osman | May 2017 | B2 |
10082875 | Kim et al. | Sep 2018 | B1 |
20060001646 | Hai | Jan 2006 | A1 |
20090096746 | Kruse et al. | Apr 2009 | A1 |
20090289893 | Drangel et al. | Nov 2009 | A1 |
20130135223 | Shai | May 2013 | A1 |
20130154813 | Gosline et al. | Jun 2013 | A1 |
20130158365 | Chey et al. | Jun 2013 | A1 |
20140139422 | Mistry et al. | May 2014 | A1 |
20140176452 | Aleksov et al. | Jun 2014 | A1 |
20140267167 | Ricks | Sep 2014 | A1 |
20140368455 | Croisonnier et al. | Dec 2014 | A1 |
20150153950 | Chang et al. | Jun 2015 | A1 |
20150205357 | Virtanen et al. | Jul 2015 | A1 |
20150277559 | Vescovi et al. | Oct 2015 | A1 |
20160171907 | Moore et al. | Jun 2016 | A1 |
20160224116 | Hagedorn | Aug 2016 | A1 |
20160246369 | Osman | Aug 2016 | A1 |
20160246370 | Osman | Aug 2016 | A1 |
20160278665 | Ferreira et al. | Sep 2016 | A1 |
20160306422 | Parham et al. | Oct 2016 | A1 |
20170168630 | Khoshkava et al. | Jun 2017 | A1 |
20170255265 | Dandamudi et al. | Sep 2017 | A1 |
20180120936 | Keller et al. | May 2018 | A1 |
20220187918 | Nieman | Jun 2022 | A1 |
Number | Date | Country |
---|---|---|
104679241 | Jun 2015 | CN |
H07113703 | May 1995 | JP |
2000501033 | Feb 2000 | JP |
2001104256 | Apr 2001 | JP |
2001166676 | Jun 2001 | JP |
2012503244 | Feb 2012 | JP |
2012194634 | Oct 2012 | JP |
2013003782 | Jan 2013 | JP |
2013541789 | Nov 2013 | JP |
7309117 | Jul 2023 | JP |
20100054944 | May 2010 | KR |
101917101 | Nov 2018 | KR |
2012176610 | Dec 2012 | WO |
2016134295 | Aug 2016 | WO |
2016134299 | Aug 2016 | WO |
Entry |
---|
Nakamura Taku, Finger-mounted Pad for Electrostatic Haptic Feedback to Realize Pinch Action on Visual Display, The 18th Annual Conference of The Virtual Reality Society of Japan, The Virtual Reality Society of Japan, Sep. 18, 2013, p. 79-82. |
Ando Hideyuki, The Illusion-based Haptic Display and Exhibition Method, Technical Report of IECIE, IEICE, Feb. 14, 2011, vol. 110, No. 422, p. 29-34. |
Number | Date | Country | |
---|---|---|---|
20230297227 A1 | Sep 2023 | US |
Number | Date | Country | |
---|---|---|---|
62551725 | Aug 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17965689 | Oct 2022 | US |
Child | 18156988 | US | |
Parent | 16883876 | May 2020 | US |
Child | 17965689 | US | |
Parent | 16038544 | Jul 2018 | US |
Child | 16883876 | US |