This relates generally to electronic equipment, and, more particularly, to electronic equipment that supplies haptic output.
Devices such as wearable devices sometimes incorporate haptic output components. Haptic output components may supply a user with haptic output while the user is interacting with software such as gaming software.
It can be challenging to design a haptic output device. If care is not taken, haptic output may too weak or may not provide a desired sensation for a user, haptic output may not be applied to an appropriate location on the body of a user, or a haptic output device may be overly bulky or difficult to use.
Haptic output devices may provide haptic output to a user. The haptic output devices may include foot-shaped structures such as socks and shoes with cavities configured to receive the feet of users. The haptic output devices may also include foot platforms with planar exterior surfaces on which a user may stand. In hybrid arrangements, haptic output devices include foot-shaped support structures with components such as magnets and foot-platform components with corresponding electromagnets.
Haptic output components may be arranged in an array on a haptic output device. The haptic output components may include piezoelectric components, electroactive polymer components, electromagnetic actuators, and other haptic output components.
During operation, shear forces and forces normal to the inner surfaces of a foot-shaped support surface and/or the exterior surface of a foot platform may be generated. These forces may provide a user with a sensation of resting or sliding across a tiled surface or other surface with surface irregularities. Friction effects (e.g., resistance to lateral motion) and other effects may also be produced using the haptic output devices.
Control circuitry may supply control signals to haptic output components in a haptic output device to produce haptic output. The haptic output may be generated based on sensor signals such as sensor signals associated with foot movement and/or based on information received from an external electronic device.
Electronic systems such as illustrative system 8 of
As illustrated by communications link 22, haptic output device 10 may communicate with one or more additional haptic output devices 10 and/or electronic devices such as electronic device 24. Links such as link 22 in system 8 may be wired or wireless communication links. Each device in system 8 such as haptic output device 10 may include communications circuitry such as communications circuitry 20 of device 10 for supporting communications over links such as link 22.
Communications circuitry 20 may include wired and wireless communications circuitry. Communications circuitry 20 in one device may be used to support communications over one or more wired or wireless communications links (e.g., link 22) with one or more additional devices (e.g., a peer device, a host, an accessory, etc.). Wireless circuitry in communications circuitry 20 may include one or more antennas and one or more radio-frequency transceiver circuits. Wireless communications circuitry may be used to support wireless communications over cellular telephone bands, wireless local area network bands, near field communications bands, etc.
As shown in
Input-output circuitry in device 10 such as input-output devices 16 may be used to allow data to be supplied to device 10 and to allow data to be provided from device 10 to external devices. Input-output devices 16 may include buttons, joysticks, scrolling wheels, touch pads, key pads, keyboards, microphones, speakers, tone generators, vibrators, cameras (e.g., cameras configured to visually monitor foot movements, etc.), displays and/or other light-emitting components, light-emitting diodes and other status indicators, data ports, components for generating heat and/or cooling such as Peltier effect devices, resistive coils for Ohmic heating, and/or other components that can generate heat in response to control signals from control circuitry 12, cooling fans, heaters that provide heated air (e.g., resistive coils and associated fans), systems that circulate heated and/or cooled liquids, components for adjusting moisture (e.g., components such as water reservoirs and pumps for dispensing water or other liquids through openings and thereby adjusting the humidity of the environment surrounding a user's foot), etc. If desired, input-output devices 16 may include electrically adjustable actuators such as pneumatic actuators, electromagnetic actuators (motors, linear actuators, etc.), and/or other positioning devices that can locally and/or globally adjust the height and/or orientation of one or more portions of some or all of device 10 (e.g., an actuator to selectively tilt a platform, etc.).
Input-output devices 16 may include sensors such as sensors 18. Sensors 18 may include force sensors, touch sensors, temperature sensors, air pressure sensors, moisture sensors, ambient light sensors and other light-based sensors, magnetic sensors, and/or other sensors. If desired, sensors 18 may include position and motion sensors such as inertial measurement units that include accelerometers, compasses, and/or gyroscopes. Control circuitry 12 may use sensors 18 to gather information such as information on movement of device 10. Haptic output components 14 in input-output devices 16 may be used to provide haptic output to a user (e.g., based on sensed movement, wirelessly received information, etc.). In some configurations (e.g., when a haptic output component 14 has a piezoelectric material), components can serve both as haptic output components 14 and as sensors 18. For example, a piezoelectric material may be driven with a signal to supply haptic output and, when not driven, may produce an output signal indicative of applied force.
In some configurations, device 10 may serve as a stand-alone device. A stand-alone haptic output device may be used independently and need not be used with external equipment. Battery power and/or power received wirelessly, via wired connection, or via an energy harvesting device in device 10 may be used in powering device 10. In some stand-alone arrangements, stand-alone devices may occasionally gather information from external equipment (e.g., settings, etc.) and/or may supply output to external equipment (e.g., usage history information, etc.). In other stand-alone arrangements, stand-alone devices are never coupled to external equipment.
In other configurations, device 10 serves as an accessory and is used exclusively or at least frequently in conjunction with another electronic device such as device 24. In this type of operating environment, device 24 may, as an example, be a computer or other device running a computer game or other software for a user and haptic output device 10 may communicate with the computer via a wired or wireless connection so that device 10 can provide a user with haptic output during the computer game.
Device 24 of
Device 10 may be a wearable device such as a sock or shoe or other device that is received on the foot of a user, may be a platform (pad) or other planar foot platform on which a user stands, and/or may be other equipment (e.g., a device such as device 24, etc.). In some configurations, the components of device 10 may be mounted in two or more mounting structures. For example, some of the components of device 10 may be enclosed in a structure that is worn on a user's foot and associated components may be mounted in a planar pad or other platform on which a user stands. System 8 may include a single haptic output device 10 (e.g., a device worn on a foot of a user) or may include multiple haptic output devices 10 (e.g., a first device to be worn on the left foot of a user and a second device to be worn on the right foot of a user). In a system with multiple haptic output devices, the haptic output devices may be operated in coordination with each other. For example, a computer game may direct devices worn on the left and right feet of a user to alternately supply a haptic output pulse, thereby creating a sensation in movement across the surfaces of the user's left and right feet. The operations associated with a single haptic output device 10 may sometimes be described herein as an example.
Illustrative haptic output component 14 of
Illustrative haptic output component 14 may have a deflectable beam such as beam 34 of
Illustrative haptic output component 14 of
If desired, haptic output component 14 may be formed using electromagnetic structures. With one illustrative arrangement, which is shown in
As shown in
As shown in
Support structure 70 may have housing walls (sometimes referred to as an enclosure or a body for device 10) and may have portions formed from metal, glass, ceramic, wood, polymer, or other materials. These structures may be breathable (e.g., to allow perspiration to evaporate), may be stretchable (e.g., to enhance fit and user comfort), and, if desired, may be lightweight (e.g., to reduce user fatigue). In some arrangements, fabric may be used in forming some or all of support structure 70. In the arrangement of
The feet of a user of device 10 such as foot 72 may be bare or a user may wear a sock, shoe, or other item in addition to wearing device 10 of
If desired, device 10 (e.g., the platform of
Device 10 (e.g., portion 10′) may also include electrically adjustable components for adjusting moisture in the vicinity of foot 72 such as a water reservoir and pumps to dispense water or other liquid to foot 72 through openings 75 or other suitable moisture dispensing structure (e.g., fabric, foam, mesh, and/or other materials with liquid passageways).
Haptic output can be provided along one or more directions relative to surface normal n of the skin of user's foot 72. For example, haptic output can be provided in a direction (e.g., the −Z direction of
In general, haptic output components 14 may be oriented to generate movement perpendicular to the surface of structure 70 that is in contact with the user's foot and the corresponding surface of a user's foot (e.g., perpendicular to the skin of the user in a normal output configuration) and/or parallel to the surface of structure 70 that is in contact with the user's foot and the corresponding surface of the user's foot (e.g., parallel to the skin of the user in a shearing output configuration). Arrangements in which a fold of skin is pinched between two opposing haptic output devices 14 may also be used (e.g., to pinch and grip a fold of skin on an upper surface of a user's foot, etc.).
As shown in the cross-sectional side view of
An illustrative drive signal of the type that may be applied to haptic output components 14 is shown in
With one illustrative configuration, haptic components 14A are permanent magnets and haptic components 14B are electromagnets. In other configurations, components 14A may include electromagnets and/or components 14B may include permanent magnets. Components 14A and 14B are configured to repel and/or attract each other by application of appropriate drive signals to the coils in the electromagnets. There may be a one-to-one correspondence between components 14A and 14B or there may be different numbers of components 14A and 14B in device 10.
In configurations in which components 14A and 14B attract each other, a user may be provided with a sensation of resistance to lateral foot movement. In configurations in which components 14A and 14B repel each other, components 14A and 14B may be configured to provide a user with a sensation of low friction (e.g., components 14A and 14B may provide a user with a sensation of assisted lateral foot translation as components 14A and 14B repel each other and bias structure 70A laterally across the surface of structure 70B). Combinations of local attraction and local repelling between components 14A and 14B may also be used (e.g., to attract these components towards each other locally to create a sensation of weight, to implement a desired attraction/repelling pattern to render a texture for a user, etc.). If desired, electromagnets such as components 14B may repel components 14A under the arch of user's foot 72 (e.g., to render terrain such as a rock).
As described in connection with
Although described in the context of haptic output devices that provide a user's feet with haptic output, haptic output devices such as haptic output device 10 may, if desired, be used to provide haptic output to other portions of a user's body (e.g., a user's head, hands, arms, legs, torso, etc.). Devices 10 may include components 14 that are supported directly on a user's foot (e.g., in a sock or shoe or other foot-wearable structure), components 14 that are supported within a foot platform on which a user stands, and/or components 14 that are formed in hybrid systems with both structures worn on the foot and platform structures. Haptic output provide by device 10 may include haptic output that is normal to the user's skin or other interaction surface and/or may include haptic output that is shear relative to the user's skin or other interaction surface.
Control circuitry 12 may supply global control signals to all of components 14 in synchronization (e.g., to provide global haptic output such as global vibrations) and/or may supply localized control signals to components 14 (e.g., to create corresponding localized haptic output such as localized vibrations). Configurations in which waves of displacement are created that travel across the surface of the foot or other body part may also be used.
During operation of device 10, slipping motion and other motions may be rendered using asymmetric drive signals such as the illustrative haptic output component drive signal of
Shear forces may be applied to create a sense of friction on the user's skin. Graded changes in displacement (e.g., from perpendicular haptic output) may be used to create the sensation of elevation and/or incline. Moisture and temperature effects may also be created by applying appropriate drive signals to an array of haptic output components 14 in device 10 (e.g., to create a sheer force, etc.) and/or by supplying drive signals to moisture generators, heating elements, etc. Haptic output may include slowly varying displacement (e.g., direct-current displacement that varies over seconds or minutes or that is constant) and/or may include more rapidly varying displacement (e.g., alternating current vibrations at frequencies of 50-2000 Hz, at least 20 Hz, at least 100 Hz, at least 500 Hz, less than 3000 Hz, less than 5000 Hz, etc.). Isolated pulses, pairs of pulses, other discrete numbers of pulses, and/or semicontinuous pulse trains may be used as drive signals. Arrangements in which other types of drive signals and displacement are provided by haptic output device 10 may also be used, if desired.
During a computer-game (e.g., when a user is wearing a head-mounted display coupled to device 24 and/or in a virtual reality or mixed reality environment provided with other equipment), control circuitry 12 in device 10 (and, if desired, control circuitry in a device coupled to device 10 such as device 24) may supply haptic output with device 10 that provides a user with a sensation of shear force on the user's feet (e.g., rendering friction, slipping sensations, etc.), that provides the user with a sensation of increased normal force on the foot of the user, and/or other haptic sensations. The haptic output that is provided may be provided based at least partly on feedback on user foot movement and/or other information that is gathered with motion sensors (e.g., inertial measurement units) and/or other sensors 18 in device(s) 10 and/or based on information received from device 24 (e.g., wirelessly received information such as haptic information associated with a game). Haptic output components 14 (e.g., a piezoelectric component or other component that bends or otherwise displaces in one direction more quickly than another) may be used to provide a user with sensations of continuous movement, continuous slipping, and/or other sensations during use of system 8.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application claims the benefit of provisional patent application No. 62/526,152, filed Jun. 28, 2017, which is hereby incorporated by reference herein in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5872438 | Roston | Feb 1999 | A |
5913727 | Ahdoot | Jun 1999 | A |
6102832 | Tani | Aug 2000 | A |
6769313 | Weiss | Aug 2004 | B2 |
6916273 | Couvillion, Jr. | Jul 2005 | B2 |
7219449 | Hoffberg et al. | May 2007 | B1 |
7381152 | Couvillion, Jr. | Jun 2008 | B2 |
7381153 | Couvillion, Jr. | Jun 2008 | B2 |
7387592 | Couvillion, Jr. | Jun 2008 | B2 |
7520836 | Couvillion, Jr. | Apr 2009 | B2 |
7588516 | Couvillion, Jr. | Sep 2009 | B2 |
7816632 | Bourke, III | Oct 2010 | B2 |
8123660 | Kruse | Feb 2012 | B2 |
8368641 | Tremblay et al. | Feb 2013 | B2 |
8474156 | Kim | Jul 2013 | B2 |
8523740 | Kruse | Sep 2013 | B2 |
8676541 | Schrock | Mar 2014 | B2 |
8981682 | Delson et al. | Mar 2015 | B2 |
9041521 | Cooperstock | May 2015 | B2 |
9089182 | Schrock | Jul 2015 | B2 |
9462844 | Schrock | Oct 2016 | B2 |
9549585 | Amos | Jan 2017 | B2 |
9622537 | Amos | Apr 2017 | B2 |
9763489 | Amos | Sep 2017 | B2 |
9955904 | Oddsson | May 2018 | B2 |
9971410 | Keller | May 2018 | B2 |
10024660 | Otis | Jul 2018 | B2 |
10070680 | Molyneux | Sep 2018 | B2 |
10136842 | Ashby | Nov 2018 | B2 |
10172409 | Andon | Jan 2019 | B1 |
10178890 | Andon | Jan 2019 | B1 |
10188170 | Bramani | Jan 2019 | B2 |
10228758 | Smoot | Mar 2019 | B2 |
10335341 | Shim | Jul 2019 | B2 |
10362830 | Campbell | Jul 2019 | B2 |
20030051561 | Weiss | Mar 2003 | A1 |
20070097073 | Takashima | May 2007 | A1 |
20070236450 | Colgate | Oct 2007 | A1 |
20080197126 | Bourke | Aug 2008 | A1 |
20090167677 | Kruse | Jul 2009 | A1 |
20100063778 | Schrock | Mar 2010 | A1 |
20100063779 | Schrock | Mar 2010 | A1 |
20100152619 | Kalpaxis et al. | Jun 2010 | A1 |
20100256537 | Menga | Oct 2010 | A1 |
20100308982 | Cooperstock | Dec 2010 | A1 |
20110047828 | Shuster | Mar 2011 | A1 |
20110193323 | Rivard | Aug 2011 | A1 |
20110242316 | Guerrero | Oct 2011 | A1 |
20120068957 | Puskarich | Mar 2012 | A1 |
20120169442 | Kim | Jul 2012 | A1 |
20120212340 | Kruse | Aug 2012 | A1 |
20120234111 | Molyneux | Sep 2012 | A1 |
20120286847 | Peshkin et al. | Nov 2012 | A1 |
20120291563 | Schrock | Nov 2012 | A1 |
20120291564 | Amos | Nov 2012 | A1 |
20130213146 | Amos | Aug 2013 | A1 |
20130312288 | Colthurst | Nov 2013 | A1 |
20140266570 | Sharma | Sep 2014 | A1 |
20160081418 | Amos | Mar 2016 | A1 |
20160143562 | Ashby | May 2016 | A1 |
20160206499 | Shim | Jul 2016 | A1 |
20160216764 | Morrell | Jul 2016 | A1 |
20160302509 | Amos | Oct 2016 | A1 |
20160320802 | McClure | Nov 2016 | A1 |
20170020224 | Amos | Jan 2017 | A1 |
20170071283 | James | Mar 2017 | A1 |
20170079368 | Amos | Mar 2017 | A1 |
20170186300 | Wang | Jun 2017 | A1 |
20170290390 | Bramani | Oct 2017 | A1 |
20170351333 | Keller | Dec 2017 | A1 |
20180132560 | Kim | May 2018 | A1 |
20180160766 | Zahrieh | Jun 2018 | A1 |
20180199656 | Doll | Jul 2018 | A1 |
20180213879 | Campbell | Aug 2018 | A1 |
20180338560 | Molyneux | Nov 2018 | A1 |
20180365941 | Levesque | Dec 2018 | A1 |
20190056837 | Datta | Feb 2019 | A1 |
20190174862 | Rakshit | Jun 2019 | A1 |
20190210065 | Rinner | Jul 2019 | A1 |
20190269352 | Brown | Sep 2019 | A1 |
20190291002 | Yokoyama | Sep 2019 | A1 |
20200113271 | Kramer | Apr 2020 | A1 |
Number | Date | Country |
---|---|---|
WO-2015047364 | Apr 2015 | WO |
Number | Date | Country | |
---|---|---|---|
62526152 | Jun 2017 | US |