User interface system

Information

  • Patent Grant
  • 8704790
  • Patent Number
    8,704,790
  • Date Filed
    Thursday, October 20, 2011
    14 years ago
  • Date Issued
    Tuesday, April 22, 2014
    11 years ago
Abstract
One embodiment of the user interface system comprises: a volume of fluid; a tactile layer; a retaining wall substantially impermeable to the fluid; a permeable layer; a displacement device; and a touch sensor. The tactile layer, with a back surface, defines a second region, operable between: a retracted state, wherein the second region is substantially flush with a first region; and an expanded state, wherein the second region is substantially proud of the first region. The permeable layer, joined to the back surface of the first region, includes a plurality of fluid ports that communicate a portion of the fluid through the permeable layer to the back surface of the second region. The displacement device directs the fluid through the fluid ports to the back surface to transition the second region from the retracted state to the expanded state. The touch sensor detects a user touch on the tactile layer.
Description
TECHNICAL FIELD

This invention relates generally to the user interface field, and more specifically to a new and useful user interface in the touch-based interface field.


BACKGROUND

Touch-sensitive displays (e.g., touch screens) allow users to input commands and data directly into a display, which may be particularly useful in a variety of applications. Common applications for touch screens include consumer products such as cellular telephones and user interfaces for industrial process control. Depending on the specific application, these touch-sensitive displays are commonly used in devices ranging from small handheld PDAs, to medium sized tablet computers, to large industrial implements. It is often convenient for a user to input and read data on the same display. Unlike a dedicated input device, such as a keypad with discrete well-defined keys, most touch-sensitive displays are generally flat. As a result, touch-sensitive screens do not provide significant tactile guidance for one or more control “buttons”. Instead, touch-sensitive displays rely on visual cues (e.g., displayed images) to guide user input.


Hence a serious drawback of touch-sensitive displays is the inherent difficulty a user faces when attempting to input data accurately because adjacent buttons are not distinguishable by feel. Improper keystrokes are common, which typically forces the user to focus both on the keypad (to properly input the next keystroke) and on the text input line (to check for errors); generally, the user is forced to keep his or her eyes on the display. The importance of tactile guidance is readily apparent in the competition between the Apple's iPhone and RIM's BlackBerry 8800. Touch-sensitive displays and physical hard buttons each have benefits and drawbacks, and digital devices generally incorporate one such component or the other.


Thus, there is a need in the touch-based interface field to create a new and useful interface, for a digital display, that incorporates tactile guidance for one or more control buttons.





BRIEF DESCRIPTION OF THE FIGURES


FIG. 1 is a schematic representation of a preferred embodiment of the user interface system with a proximal reservoir;



FIG. 2 is a schematic representation of an embodiment of the user interface system with in an expanded state;



FIG. 3 is a schematic representation of an embodiment of the user interface system with a permeable layer defining a support surface with a concave contour proximal to the second region;



FIGS. 4A and 4B are schematic representations of an embodiment of the user interface system with a porous permeable layer and without and with a reservoir, respectively;



FIG. 5 is a schematic representation of an embodiment of the user interface system with a with a proximal reservoir and a remote reservoir;



FIG. 6 is a schematic representation of an embodiment of the user interface system with a proximal reservoir and a displacement device that is an electrical pump;



FIG. 7 includes schematic representations of various operable states of the preferred embodiment of the user interface system;



FIG. 8 is a perspective view of the preferred embodiment, incorporated into an electronic device with a digital display, and a flowchart of the operation of the preferred embodiment therein; and



FIG. 9 is a perspective view of the preferred embodiment and a flowchart of the operation of the preferred embodiment therein.





DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description of the preferred embodiments of the invention is not intended to limit the invention to these preferred embodiments, but rather to enable any person skilled in the art to make and use this invention.


As shown in FIG. 1, the user interface system 100 of the preferred embodiment includes: a volume of fluid 110; a tactile layer 120; a retaining wall 130; a permeable layer 140; a displacement device 150; and a touch sensor 160. The tactile layer 120 defines an outer tactile surface 124 touchable by a user and a back surface 125 opposite the tactile surface 124; the tactile layer 120 further includes a first region 121 and a second region 122, wherein the second region 122 is operable between: a retracted state, wherein the second region 122 is substantially flush with the first region 121; and an expanded state, wherein the second region 122 is substantially proud of the first region 121. The retaining wall 130 is substantially impermeable to the fluid 110. The permeable layer 140, interposed between the tactile layer 120 and the retaining wall 130, is joined to the back surface 125 of the first region 121 and defines a support surface 142 below the second region 122; the permeable layer 140 further includes a plurality of fluid ports 144 that communicate a portion of the fluid 110 through the permeable layer 140 to the back surface 125 of the second region 122. The displacement device 150 cooperates with the retaining wall 130 to direct a portion of the fluid 110 through the fluid ports 144 to the back surface 125 to transition the second region 122 from the retracted state to the expanded state. The touch sensor 160 is coupled to the retaining wall 130 and detects a user touch on the tactile surface 124. The user interface system 100 may further comprise: a reservoir 170 that contains a portion of the volume of fluid 110; a digital display 190 that transmits an image to the user; an attachment point 180 that joins the tactile layer 120 to the permeable layer 140; and/or a pressure sensor that detects ambient air pressure proximal to the user interface system 100.


The user interface system 100 functions to deform the second region 122 of the tactile layer 120 to provide the user with tactile guidance when operating a device to which the user interface is coupled. The user interface system 100 is substantially similar to the user interface system described in U.S. patent application Ser. No. 12/319,334 titled “User Interface System” and/or U.S. patent application Ser. No. 12/497,622 titled “User Interface System,” which are incorporated in their entirety by this reference. The user interface system 100 preferably cooperates with a visual guide (e.g., an image output by the digital display 190 and transmitted though the tactile surface 124) to provide a message, a choice, or any other suitable type of communication to the user, but may alternatively operate independently of a visual guide. The user interface system 100 preferably provides tactile guidance that is substantially adapted to a use of the device. The user interface system 100 may deform additional regions of the tactile layer 120, independently and/or concurrently with the second region 122, to provide further adaptability to the use of the device. FIGS. 7B and 7C depict a second region 122 and a third region 123 that are independently deformed. The user interface system 100 is preferably applied over an image that is static (e.g., a label) or dynamic (e.g., from the digital display 190); the user interface is preferably substantially transparent to permit transmission of the image through the user interface system 100. However, any other suitable optical property of the user interface system 100 may suffice. As shown in FIG. 8, the user interface system 100 of the preferred embodiment may be incorporated into an electronic device that includes a digital display, such as a vehicle console, a desktop computer, a laptop computer, a tablet computer, a television, a radio, a desk phone, a mobile phone, a smartphone, a PDA, a personal navigation device, a personal media player, a camera, or a watch. The user interface system 100 of the preferred embodiment may also be incorporated into an electronic device without a digital display, for example, onto a steering wheel of a vehicle, a remote control, or a keypad. The user interface system 100 may, however, be incorporated in any suitable device that tactilely and/or visually interfaces with a user.


The volume of fluid 110 of the preferred embodiment functions to transmit fluid pressure to the back surface 125 of the second region 122 to motivate a deformation of the second region 122. The fluid 110 preferably also functions to support the deformed (i.e., expanded) second region 122 when a user applies a force to the deformed second region 122. The fluid 110 is preferably a substantially incompressible fluid, such as oil, water, alcohol, and/or liquid paraffin, but may alternatively be a compressible fluid, such as air. However, the fluid 110 may be any other suitable type of fluid. A portion of the fluid 110 is preferably contained within the permeable layer 140, such as within the fluid ports 144 of the permeable layer 140 or within a cavity (e.g., reservoir) defined by the permeable layer 140. As shown in FIGS. 1 and 5, the user interface system 100 may also include a proximal and/or remote reservoir, respectively, that stores a portion of the fluid 110. However, the fluid may be arranged within the user interface system 100 in any other suitable arrangement. The fluid 110 is preferably substantially chemically inert in the presence of the tactile layer 120, the permeable layer 140, the displacement device 150, the touch sensor 160, the reservoir 170, and/or any other element of the user interface system 100 in contact with the fluid 110; specifically, the fluid 110 preferably does not corrode and is not corroded by any component of the user interface system 100 in contact with the fluid 110. Properties of the fluid 110 preferably remain substantially unchanged under normal operating conditions of the user interface system 100 or the device to which the user interface system 100 is applied. For example, if the user interface system 100 is used in an airplane, the properties of the fluid 110 preferably remain substantially unchanged between sea level and higher altitudes. However, the fluid 110 may have any other suitable chemical property.


As shown in FIGS. 2 and 5, the tactile layer 120 of the preferred embodiment functions to provide a tactile surface 124 that is touchable by the user and interfaces with a user in a tactile manner. The tactile layer 120 is preferably continuous, such that a user, when swiping a finger across the tactile surface 124, does not perceive any interruptions or seams therein. The tactile layer 120 is also preferably planar (i.e. flat) in the retracted state, but may alternatively form a non-planar (e.g., curved) surface. The tactile layer 120 may be arranged on a single plane, but may alternatively be arranged along a first plane and a second plane. For example, a portion of the tactile layer 120 may be arranged on a first surface of a device and a second portion of the tactile layer 120 may be arranged on a second surface of the device that is adjacent but not tangent to the first surface.


As shown in FIG. 9, the tactile layer 120 further functions to define the second region 122 that outwardly deforms, from the retracted state to the expanded state, when fluid is displaced to the back surface 125 of the second region 122 (e.g., fluid pressure at the back surface 125 of the second region 122 increases above ambient air pressure); the second region 122 is preferably proud of the first region 121 in the expanded state and thus tactilely distinguishable, from the first deformable region 121, by the user. The tactile layer 120 also functions to define the first region 121 that remains substantially undeformed despite the state of the second region 122. The second region 122 preferably “relaxes” or “undeforms” back to the retracted state when the fluid 110 is drawn (or fluid pressure is released) from the back surface 125 of the second region 122; in the retracted state, the second region 122 is preferably flush with the first region 121 at the tactile surface 124. In a recessed state, the tactile layer 120 may also inwardly deform toward and/or conform to a concave contour defined by the permeable layer 140 (shown in FIG. 3); fluid drawn away from the back surface 125 of the second region 122 preferably pulls the second region 122 into the concave contour. The recessed state preferably provides the user with additional tactile feedback that is distinguishable from the retracted state and the expanded state. The second region 122 is preferably operable between the expanded and the retracted states but may also be operable solely between the expanded and recessed states or between all of the expanded, retracted, and recessed states; the second region 122 may, however, be operable in any other state.


The tactile layer 120 is preferably elastic to permit deformation of the second region 122 in the various states. In a first variation, the tactile layer 120 is relatively more elastic in specific areas (e.g., proximal to the second region 122) and relatively less elastic in other areas (e.g., proximal to the first region 121); the tactile layer 120 is therefore preferably more capable of deformation at the relatively more elastic areas. In a second variation, the tactile layer 120 is generally uniformly elastic. In a third variation, the tactile layer 120 includes or is comprised of a smart material, such as Nickel Titanium (commonly referred to as “Nitinol”). The tactile layer 120 is also preferably substantially optically transparent, but may alternatively be translucent or opaque. The tactile layer 120 preferably has the following properties: high light transmission; low haze; wide viewing angle; minimal back reflectance (e.g., in the variation in which the user interface system 100 is applied to a digital display 190 that emits light); scratch resistance; chemical resistance; stain resistance; gas and/or liquid impermeability; and smoothness (i.e. not tacky or rough to the touch). Also or alternatively, the surface may include coatings that provide any of these desired properties. The tactile layer 120 is preferably of a suitable elastic material, such as a polymer and/or silicon-based elastomer. Such suitable materials include: poly-dimethylsiloxane (PDMS); RTV silicone (e.g., RTV silicone 615); polyurethanes; thermoset plastics (e.g., polymethyl methacrylate (PMMA)); and photocurable solvent-resistant elastomers (e.g., perfluropolyethers). The tactile layer 120 may, however, be made of any suitable material. In one variation, the tactile layer 120 is a single homogeneous (e.g., of the same material throughout) layer less than 1 mm thick, and in a preferred variation, the tactile layer 120 is between 50 um and 200 um in thickness. In another version, the tactile layer 120 may be constructed using multiple layers and/or coatings of the same or different suitable materials and thicknesses.


The tactile layer 120 is preferably adjacent the permeable layer 140, and the first region 121 of the tactile layer 120 is preferably selectively attached, adhered or otherwise joined to the permeable layer 140 such that the first region 121 of the tactile layer 120 is retained against the permeable layer 140. However, the tactile layer 120 may be joined to the permeable layer 140 with a portion of the touch sensor 160 (e.g., an electrode) interposed between the permeable layer 140 and the tactile layer 120. The touch sensor 160 may be joined to the tactile layer 120 and thus deform with the tactile layer 120 such that the distance between the tactile sensor and the tactile surface 124, is substantially maintained. This may be particularly important in the variation of the touch sensor 160 that is a capacitive touch sensor 160.


The first region 121 preferably defines a border with the second region 122. As fluid is displaced through the fluid ports 144 toward the tactile layer 120, only fluid that is directed toward a portion of the tactile layer 120 not adhered to the permeable layer 140 (i.e. the second region 122) exits the permeable layer 140 and outwardly expands the free portion of the tactile layer 120 to produce a deformed region of the surface; the deformed region is preferably the second region 122 and preferably forms a button. The first region 121 (which is joined to the permeable layer 140) preferably restricts the fluid 110 from exiting the fluid ports 144 adjacent to the first region 121; the first region 121 (and other regions joined to the permeable layer 140) is therefore preferably not deformed by fluid drawn through the fluid ports 144. Thus, the perimeter of the second region 122 is preferably partially defined by a portion of the back surface 125 of the tactile layer 120 that is attached to the permeable layer 140 (e.g., the first region 121).


The first region 121 of the tactile layer 120 is preferably retained against the permeable layer 140 via an attachment point 180 (or plurality of attachment points); the attachment point 180 may be a series of continuous points, such as a line, a curve, or area, but may alternatively be a series of non-continuous points. The attachment point 180 may be formed via adhesive bonding, chemical bonding, welding, diffusion bonding, or by any other suitable attachment material and/or method. The attachment point 180 may comprise a volume of adhesive or other material arranged between the tactile layer 120 and the permeable layer 140; alternatively, the attachment point 180 may be formed by a chemical bond substantially between the back surface 125 of the tactile layer 120 and the permeable layer 140. Methods and/or materials that form the attachment point 180 preferably result in an attachment point with optical properties substantially similar to the optical properties of the tactile layer 120 and/or the permeable layer 140. The attachment point 180 preferably define a border between the first region 121 and the second region 122, wherein the first region 121 is retained against the permeable layer 140 and the second region 122 remains free to deform under changes in fluid pressure at the back surface 125 of the second region 122.


The permeable layer 140 of the preferred embodiment functions to define a support surface 142 that supports the second region 122 and to further define a plurality of fluid ports 144 that communicate a portion of the fluid 110 through the permeable layer 140 to the back surface 125 of the second region 122. A portion of the fluid 110, directed through any of the fluid ports 144 and toward the tactile surface 124, preferably outwardly deforms the second region 122.


The fluid ports 144 of the permeable layer 140 are preferably substantially sealed from the ambient environment, such as by the retaining wall 130, tactile layer 120, and/or perimeter wall; the fluid ports 144 are also preferably substantially filled with the fluid 110, which preferably prevents contamination and undesired mixing of the volume of fluid 110 with another fluid. In an example in which the fluid 110 is liquid paraffin, the fluid ports 144 are substantially filled with paraffin and the permeable layer 140 is substantially sealed from the environment, by the retaining wall 130 and the permeable layer 140, in order to prevent entry of air into the fluid ports 144; such contamination of the fluid 110 may cause bubbles within the liquid paraffin, leading to decreased transparency and/or increased obstruction to light transmission (i.e. the image) through the user interface system 100. In the variation that includes a digital display 190 that outputs a dynamic image to the user, such reduction of transparency and increased obstruction may be particularly deleterious to the operation of the user interface system 100.


The permeable layer 140 may be one of several variations. In a first variation, shown in FIG. 4, the permeable layer 140 is of a substantially porous material that defines a series of interconnected cavities that form the fluid ports 144; the cavities preferably contain a portion of the volume of fluid 110 and direct fluid through the permeable layer 140; the permeable layer 140 is therefore permeable to the fluid 110. In this variation of the permeable layer 140 that is porous, an electric field applied across a portion of the permeable layer 140 may effect a change in the porosity of the permeable layer 140; in this variation, the permeable layer 140 may thus perform the function of a valve in opening or closing flow of the fluid 110 toward or from the second region 122. However, a heating element may alternatively heat a portion of the permeable layer 140 to effect a change in the porosity of the portion of the permeable layer 140 and/or the viscosity of a portion of the fluid 110. In the variation that includes a reservoir 170 at least partially defined by the permeable layer 140, as shown in FIG. 4B, cavities open to the reservoir 170 may communicate the fluid 110 between the reservoir 170 and the tactile layer 120. The permeable layer 140 of this variation may be substantially sponge-like. The user interface system 100 is preferably substantially transparent such that an image may be transmitted through the user interface system 100; thus, the permeable layer 140 of this variation is preferably of a substantially transparent porous material, such as transparent silica aerogel, a transparent polymer, and/or a transparent ceramic. However, the permeable layer 140 of this first variation may be any other suitable type of porous material.


In a second variation, shown in FIG. 3, the permeable layer 140 defines a series of channels that form the fluid ports 144. The channels are preferably of a substantially cylindrical geometry; specifically the fluid ports 144 are preferably defined by channels that are substantially parallel bores of substantially circular cross-sections that pass fully through the permeable layer 140 substantially normal to the support surface 142. However, the channels (i.e. fluid ports 144) may be of any other geometry or cross-section. The channels are preferably substantially small enough to be substantially tactilely imperceptible to the user. The channel may also be optically invisible to the user, thus minimizing optical distortion of an image transmitted through the permeable layer 140, though the fluid 110 may have an index of refraction substantially similar to that of the permeable layer 140 to minimize such optical distortion. The channels may also be so small so as to be undetectable to the human eye, even when filled with the fluid (e.g., gas, air, liquid) of a different optical property (e.g, index of refraction) than that of the permeable layer 140. In the variation that includes substantially cylindrical channels, each channel if preferably of a diameter less than 500 um, through each channel preferably has a maximum diameter of 100 um, or less than the maximum feature size distinguishable to the touch or by unaided sight. The channels may be machined into the permeable layer 140, such as through laser ablation, bulk machining, conventional drilling, or etching. Alternatively, the channels may be formed during the manufacture of the permeable layer 140, such as by processing the permeable layer 140 with a mold that incorporates channel-forming features. Alternatively, the permeable layer 140 may comprise a series of individual channels (e.g., tubes) bundled together and retained by a holding material such as an adhesive. However, any other suitable method of forming the channels within the permeable layer 140 may be used. Because the user interface system 100 is preferably capable of transmitting an image to the user, the permeable layer 140 of the second variation preferably comprises a substantially transparent material, such as: glass; an elastomer; a silicon-based organic polymer, such as poly-dimethylsiloxane (PDMS), or other polymer; a thermoset plastic such as polymethyl methacrylate (PMMA); or a photocurable, solvent-resistant elastomer such as perfluropolyether. However, the permeable layer 140 may be of any other suitable material or geometry.


The permeable layer 140 of the preferred embodiment also functions to define a support surface 142 adjacent to the second region 122. The support surface 142 is preferably rigid, thus providing a ‘hard stop’ that limits inward deformation of the second region 122 due to a force applied to the tactile surface 124 by the user. The support surface 142 therefore prevents the user from “pressing too far” into the tactile surface 124. The support surface 142 may extend beyond the second region 122 to similarly support any other region or area of the tactile layer 120. In the variation in which the permeable layer 140 retains the first region 121 in a substantially planar form and the support surface 142 (below the second region 122) is also substantially planar, the support surface 142 may prevent inward deformation of the second region 122 beyond the plane of the first region 121 due to a force applied to the tactile surface 124 by the user. Furthermore, the permeable layer 140 preferably cooperates with the tactile layer 120 to substantially reduce the size and/or number of “divots” or interruptions felt by the user when swiping a finger across the tactile surface 124, particularly along the second region 122 in the retracted state. The divots are preferably defined by the fluid ports 144, and the tactile layer 120 is preferably of a thickness substantially greater than the cross-section of the fluid ports 144 such that the tactile layer 120 cannot noticeably deform into a opening of a fluid port; the fluid ports 144 may therefore be imperceptible by the user. However, any other suitable arrangement of the permeable layer 140 and tactile layer 120 may be used.


The retaining wall 130 of the preferred embodiment functions to support the permeable layer 140 and to prevent the fluid from escaping the user interface system 100 opposite the permeable layer 140. The retaining wall 130 of the preferred embodiment therefore preferably functions to cooperate with the displacement device 150 to direct a portion of the fluid 110 through the fluid ports 144 to the back surface 125 of the second region 122. Specifically the arrangement of the retaining wall 130 prevents the fluid 110, displaced into the permeable layer 140, from exiting the permeable layer 140 opposite the tactile layer; the retaining wall 130 therefore directs the fluid 110 closes a potential exit point for the fluid and directs the fluid 110 toward the tactile layer. The retaining wall 130 is substantially impermeable to the fluid 110 such that the fluid 110 may not pass through the retaining wall 130. In a first variation, the retaining wall 130 is joined directly to the permeable layer 140 opposite the support surface 142. In this variation, the retaining wall 130 closes the fluid ports 144 opposite the support surface 142 such that fluid may not escape the permeable layer 140 opposite the support surface 142 when the displacement device 150 increases the fluid pressure within the permeable layer 140; by closing the fluid ports 144 on this side of the permeable layer 140, an increase in fluid pressure within the permeable layer 140 directs the fluid 110 toward the support surface 142 and outwardly expands the second region 122. For example, in the second variation of the permeable layer 140, the fluid ports 144 defined by the permeable layer 140 do not function to substantially enclose a portion of the fluid 110; therefore, the retaining wall functions to provide a bottom wall to each of the fluid ports 144 defined by the permeable layer 140, thus preventing undesired flow of fluid out of the permeable layer 140 from the side opposite the support surface. The retaining wall 130 thus facilitates containment of a portion of the fluid 110 within the permeable layer 140. In a second variation, the retaining wall 130 is coupled to but offset from the permeable layer 140 opposite the support surface 142, thus cooperating with the permeable region to at least partially define a reservoir 170 between the permeable layer 140 and the retaining wall 130; the reservoir 170 may be further defined, in part, by the perimeter wall. In this second variation, the retaining wall 130 substantially resists deformation due to a fluid pressure increase within the reservoir 170 (generated by the displacement device 150) and prevents fluid from escaping past the retaining wall 130, thus directing fluid through the permeable layer 140 and toward the back surface 125 of the second region 122 to expand the second region 122. However, the retaining wall 130 may be of any other geometry and/or arrangement.


The retaining wall 130 may be a coating applied to the permeable layer 140 opposite the tactile layer 120, such as a substantially transparent sealant deposited thereon, but may alternatively be a separate layer of substantial thickness, such as a glass or polycarbonate substrate arranged over a digital display and adhered to the permeable layer 140. The retaining wall 130 may also include standoffs and/or pillars, joined to the permeable layer 140 and retaining the retaining wall 130 substantially offset from the permeable layer 140. However, the retaining wall 130 may be of any other geometry and coupled to the permeable layer 140 by any other method.


The displacement device 150 preferably functions to displace fluid within the fluid ports 144 and toward the back surface 125 of the second region 122 to outwardly deform the second region 122 in the expanded state. The displacement device 150 may be any of several variations, including a mechanical pump (e.g., a positive displacement, an impulse, or a velocity pump), an electrical (e.g., electroosmotic) pump, a clamp, a plunger-type displacement device (shown in FIG. 9), or any other suitable device capable of displacing fluid. To transition the second region 122 from the retracted state to the expanded state, the displacement device 150 preferably generates an area of relatively high pressure within the permeable layer 140 substantially remote from the support surface 142; this preferably induces fluid flow toward a relatively low-pressure area proximal to the back surface 125 of the second region 122 (i.e. across a pressure gradient), thus expanding the second region 122. To transition the second region 122 from the expanded state to the retraced state (or from the retracted state to the recessed state), the displacement device 150 preferably generates an area of relatively low pressure within the permeable layer 140 substantially remote from the support surface 142; this preferably induces fluid flow away from the back surface 125 of the second region 122, thus retracting the second region 122. Therefore, the displacement device 150 directs a portion of the fluid 110 through the fluid ports 144 to the back surface 125 to transition the second region 122 from the retracted state to the expanded state, and the displacement device 150 directs a portion of the fluid 110 from the fluid ports 144 to transition the second region 122 from the expanded state to the retracted state and/or from the retracted state to the recessed state.


In a variation of the displacement device 150 that creates a fluid pressure gradient to motivate the fluid 110, the pressure gradient preferably dissipates as the second region 122 deforms to absorb a pressure change. Fluid pressure within the user interface system 100 preferably reaches a steady and constant state once the second region 122 is in the desired state (e.g., expanded, retracted, or recessed state); the displacement device 150 preferably maintains this fluid pressure within the system to retain the second region 122 in the desired state. In the variation of the user interface system 100 that includes a reservoir 170, the displacement device 150 may create a pressure gradient across the reservoir 170 and the fluid ports 144 to motivate the fluid 110 from the reservoir 170 to the fluid ports 144, or vice versa.


The displacement device 150 is preferably a positive displacement micro-pump, such as pump #MDP2205 from ThinXXs Microtechnology AG of Zweibrucken, Germany or pump #mp5 from Bartels Mikrotechnik GmbH of Dortmund, Germany. However, the displacement device 150 may be of any other suitable type. Suitable types of positive displacement pumps include rotary, reciprocating, gear, screw, progressing cavity, roots-type, peristaltic, plunger, diaphragm, or rope pumps. Suitable types of impulse pumps include hydraulic ram pumps, and suitable types of velocity pumps include radial- and axial-flow centrifugal pumps and educator-jet pumps.


Alternatively, in the variation of the user interface system 100 that includes a reservoir 170 interposed between the permeable layer 140 and the retaining wall 130, the mechanical pump may comprise a clamp coupled to the permeable layer 140 and the support surface 142, as shown in FIGS. 1 and 4, wherein the clamp modifies the orientation of a portion of the retaining wall 130 relative to the permeable layer 140. This preferably decreases (or increases) the volume of the reservoir 170, thus increasing (or decreasing) fluid pressure within the reservoir 170 and motivating fluid toward (or from) the fluid ports 144 to expand (or retract) the second region 122.


Similarly, the displacement device 150 may deform the permeable layer 140 to displace a portion of the fluid 110. For example, the displacement device 150 may compress a portion of the permeable layer 140, thus decreasing the volume of the permeable layer 140 and motivating fluid through the fluid ports 144 to outwardly deform the second region 122; the displacement device 150 may thus “squeeze” the fluid 110 out of the permeable layer 140 and toward the tactile layer 120. The permeable layer 140 may be deformed uniformly; for example, the displacement device 150 may be a clamp arranged substantially across the permeable layer 140 opposite the support surface 142, wherein the clamp compresses the permeable layer 140 by motivating the retaining wall 130 toward the tactile layer 120. Alternatively, the displacement device 150 may compress only a portion of the permeable layer 140, such as the portion of the permeable layer 140 substantially proximal to the second region 122. In this variation, the displacement device 150 may compress the permeable layer 140 in substantially one direction, but may alternatively compress the permeable layer 140 in more than one direction, such as vertically and horizontally, or may deform the permeable layer 140 by twisting. However, other suitable deformations of the permeable layer 140 that displaces a portion of the fluid 110 from the permeable layer 140 to deform the second region 122 are also possible.


The displacement device 150 may also be an electrical pump that provides a voltage gradient across a portion of the permeable layer 140 to induce electroosmotic fluid flow through the fluid ports 144. Because viscous forces substantially hinder fluid flow through substantially small channels, electroosmotic-driven fluid flow may be advantageous in variations of the user interface system 100 in which the fluid ports 144 are substantially small in cross-section. As shown in FIG. 2, the displacement device 150 may generate a voltage gradient across the permeable layer 140 by generating a first voltage at a substantially transparent conductive trace 152 on the support surface 142 and a second (different) voltage on a transparent conductive trace on an opposite side of the permeable layer 140; the subsequent voltage gradient thus motivates fluid through the fluid ports 144. In the variation of the user interface system 100 in which the touch sensor 160 is a capacitive sensor arranged substantially between the permeable layer 140 and the tactile layer 120, within the permeable layer 140, or between the permeable layer 140 and the retaining wall 130, an electrode of the touch sensor 160 may also function as a portion of a conductive trace 152 of the electrical displacement device 150. However, the displacement device 150 may generate a voltage gradient across any other suitable portions or elements of the user interface system 100 to induce electroosmotic fluid flow.


Furthermore, the displacement device 150 may comprise a heating element that heats a portion of the fluid 110 (such as within the permeable layer 140) to expand the portion of the fluid no and thus expand the second region 122. In this example, a heat sink may also be included in the user interface system 100, wherein the heatsink draws heat out of the portion of the fluid 110 in order to cool the fluid and retract the second region 122.


The touch sensor 160 of the preferred embodiment functions to generate an output indicative of a user action proximal to the tactile surface 124. The output is preferably readable by a processor or other component within the device on which the user interface system 100 is arranged. The touch sensor 160 preferably recognizes a user action that is a finger touch on the tactile surface 124, but the touch sensor 160 may recognize contact by any other object, such as a stylus, a palm of the user, or multiple fingers of the user. Though the touch sensor 160 preferably detects a user action proximal to the tactile surface 124 at the second region 122 (e.g., wherein the user presses the expanded second region 122), the touch sensor 160 may also detect the user action proximal to any other region of the tactile layer 120.


The touch sensor 160 may detect the user action when the second region is solely in the retracted state, solely in the expanded state, solely in the recessed state. However, the touch sensor 160 preferably detects a user touch at the second region 122 regardless of the state of the second region 122, although the touch sensor 160 may also generate a unique output for a user touch proximate to the second region 122 in each of the retracted and expanded (and recessed) states. As explained above, the orientation of a portion of the touch sensor 160 may be manipulated in order to maintain the distance between the portion of the touch sensor 160 and the tactile layer 120 throughout the various states of the second region 122; this is preferably accomplished by joining a portion of the touch sensor 160 to the back surface 125 of the tactile layer 120, as shown in FIG. 7: FIG. 7A depicts the second region 122 in the retracted state with the portion of the touch sensor 160 adjacent to the support surface 142 of the permeable layer 140; FIG. 7B depicts the second region 122 in the expanded state with the portion of the touch sensor 160 joined to and deformed with the back surface of the second region 122.


The touch sensor 160 is preferably a capacitive touch sensor 160, as shown in FIGS. 8 and 9, wherein the touch sensor 160 may be a first conductive trace 152A that is a driving line and a second conductive trace 152B that is a sensing line; a user touch on the tactile surface 124 is thus preferably captured by the traces 152A, 152B by the touch sensor 160. However, the touch sensor 160 may sense the user touch via any other suitable technology, such as optical, resistive, surface acoustic wave, infrared, dispersive signal, or acoustic pulse recognition sensor technology.


The touch sensor 160 is preferably joined to the retaining wall 130 opposite the permeable layer 140, wherein the touch sensor 160 detects the user action through the retaining wall 130, the permeable layer 140, and the tactile layer 120. However, any portion of the touch sensor 160 may be interposed between, joined to, and/or physically coextensive with any other component of the user interface system 100; the touch sensor 160 may therefore be directly or indirectly coupled to the retaining wall 130. In the variation of the touch sensor 160 that is a capacitive touch sensor 160 comprising at least one layer of electrodes (e.g., a self capacitance touch sensor 160), a portion of the touch sensor 160 may be arranged within the permeable layer 140. In a first example, the permeable layer 140 is injection molded around an electrode layer of the touch sensor 160; in a second example, the permeable layer 140 comprises two permeable sheets adhered, one on each side, to the electrode layer of the touch sensor 160, thus forming a physically coextensive permeable layer 140 and touch sensor 160 portion. The touch sensor 160 may also comprise a layer bonded to the retaining wall 130 on one side and the permeable layer 140 on the opposite, or the touch sensor 160 may be a touch-sensitive display (i.e. the touch sensor 160 and display 190 are physically coextensive) coupled to the retaining wall 130. In the above example, the electrode layer is preferably permeable to the fluid, such as incorporating through-bores, -holes, or -slots. However, the touch sensor 160 may be of any other type, geometry, or arrangement, such as in the sensing systems as described in U.S. application Ser. No. 12/319,334 filed 5 Jan. 2009 and entitled “User Interface System,” and U.S. application Ser. No. 12/497,622 filed on 3 Jul. 2009 and entitled “User Interface System and Method,” which are incorporated in their entirety by this reference.


The user interface system 100 may further comprise a display 190, coupled to the retaining wall 130, that visually outputs an image to the user. To provide visual guidance to the user, the image is preferably of an input key substantially aligned with the second region 122. The display 190 is preferably a digital display, such as an LCD, LED, ELP, or other type of digital display commonly arranged within any of a vehicle console, a desktop computer, a laptop computer, a tablet computer, a television, a radio, a desk phone, a mobile phone, a smartphone, a PDA, a personal navigation device, a personal media player, a camera, or a watch. The digital display 190 is preferably joined to the retaining wall 130 opposite the permeable layer 140, but may alternatively be physically coextensive with the retaining wall 130, the touch sensor 160, and/or the permeable layer 140. The display 190 preferably generates the image, and the permeable layer 140 and the tactile layer 120 cooperatively communicate the image from the display 190 to the user; the retaining wall 130 and/or the touch sensor 160 may also cooperate to communicate the image to the user. The permeable layer 140 and the tactile layer 120 (and the retaining wall 130 and/or the touch sensor 160) therefore are substantially transparent, are substantially non-obstructive to light, and have substantially minimal internal reflectance.


The user interface system 100 may further comprise a perimeter wall, substantially encompassing the perimeter of the permeable layer 140, cooperating with the retaining wall 130 and the tactile layer 120 to retain the fluid 110 substantially within the permeable layer 140. The tactile layer 120 and the retaining wall 130 preferably substantially enclose the fluid no between the opposing broad surfaces of the permeable layer 140, and the perimeter wall preferably encircles the permeable layer 140 to prevent fluid from leaking from the perimeter sides of the permeable layer 140. This may be particularly important in the first variation of the permeable layer 140 (which comprises a substantially sponge-like material with interconnected cavities, as shown in FIG. 4): fluid directed toward an undeformable (first) region of the tactile layer 120 may be redirected substantially sideways through the interconnected cavities; though the fluid 110 is thus beneficially motivated toward a deformable (second) region of the tactile layer 120, the fluid 110 may also be directed out of the perimeter sides of the permeable layer 140, thus releasing fluid pressure within the permeable layer 140 and limiting outward deformation of the deformable region of the tactile layer 120. (Beneficially, however, in this variation and any other variation in which fluid ports 144 communicate a portion of the fluid 110 in a direction substantially perpendicular to the support surface 142, the displacement device 150 may increase fluid pressure within the permeable layer 140 proximal to both the first region 121 and the second region 122 but draw the fluid 110 only toward the second region 122 and thus deform only the second region 122.) The perimeter wall thus prevents such release of fluid pressure and is preferably incorporated in this variation (and potentially other variations) of the permeable layer 140. In another variation, the perimeter wall cooperates with any of the retaining wall 130, the permeable layer 140, and the electronic device to define the reservoir 170. The perimeter wall may be substantially independent of the permeable layer 140 but may also be integral with the permeable layer 140 or physically coextensive with the retaining wall 130. However, the perimeter wall may also be physically coextensive with the tactile layer 120, retaining wall 130, or any other element of the user interface system 100. In the variation in which the displacement device modifies the orientation of a portion of the retaining wall 130, the perimeter wall preferably deforms where necessary to accommodate the change in orientation.


As described above, the user interface system 100 may include a reservoir 170 that contains a portion of the fluid 110. The reservoir 170 is preferably a proximal reservoir that is substantially adjacent to the permeable layer 140, as shown in FIGS. 1 and 5, but may also be a remote reservoir, as shown in FIG. 5. As the fluid 110 is displaced toward the tactile layer 120, additional fluid is preferably provided to the permeable layer 140 by the reservoir 170; as the fluid no is displaced away from the tactile layer 120, the fluid 110 is preferably recollected by the reservoir 170. The reservoir 170 may also replenish fluid to the permeable layer 140, such as following a leak or other loss of the fluid 110, though the reservoir 170 may provide additional fluid for any other suitable function. The reservoir 170 is preferably coupled to the permeable layer 140 via the displacement device 150 (i.e. the displacement device 150 is arranged between the reservoir 170 and the permeable layer 140) such that the displacement device 150 draws fluid from the reservoir 170 and toward the permeable layer 140, and vice versa. Furthermore, the reservoir 170 may be substantially rigid such that the reservoir 170 does not substantially deform as the fluid 110 is drawn therefrom, but the reservoir 170 may alternatively be substantially deformable, such as in a variation of the reservoir 170 that is a pliable (e.g., plastic, silicone, or rubber) pouch that deforms as fluid is drawn from or into the reservoir 170. However, the reservoir 170 may be arranged in any other suitable fashion and take any other form.


The variation of the reservoir 170 that is a proximal reservoir 170 is preferably in direct fluid contact with the permeable layer 140, as shown in FIGS. 1 and 5. The proximal reservoir 170 may be coupled to (or partially defined by) the permeable layer 140 opposite the support surface 142, but may alternatively be a substantially large cavity within the permeable layer 140 and containing fluid accessible by any number of the fluid ports 144. The proximal reservoir 170 may also include support pillars 139 that support the proximal reservoir 170 and substantially maintain the shape of the reservoir 170, such as the support pillars 139 shown in FIG. 5. In the variation of the permeable layer 140 that is porous, the permeable layer 140 may accept fluid from any side; thus, the proximal reservoir 170 may be arranged in any suitable orientation to communicate the fluid 110 to any side of the permeable layer 140. The variation of the reservoir 170 that is a remote reservoir is preferably coupled to the permeable layer 140 (or an additional proximal reservoir) via a channel, but may be coupled using any other suitable element or method.


The reservoir 170 may also include a second displacement device 150 that displaces the fluid no within the user interface system 100. This preferably decreases the load on the displacement device 150 and may be particularly useful in the variation that includes a remote reservoir, wherein the fluid no must be displaced over a substantial distance. For example, the remote reservoir may be coupled to a second displacement device 150 that is a clamp, wherein the clamp may be manually operated to displace fluid toward the permeable layer 140. In this example, the clamp may be a hinge and/or slider on a mobile phone or any other suitable device such that, when actuated, fluid is drawn from the remote reservoir and motivated toward the permeable layer 140 (or vice versa). However, any other suitable type of second displacement device 150 may be used and may or may not be substantially similar to the displacement device 150. The second displacement device 150 may also be used in place of the displacement device 150.


The user interface system 100 may further comprise a pressure sensor that detects ambient air pressure (or barometric or atmospheric pressure) proximal to the user interface system 100. The pressure sensor may be of any type of pressure sensor, such as a piezoresistive, capacitive, electromagnetic, piezoelectric, optical, or potentiometric pressure sensor. In the retracted state, the displacement device 150 preferably adjusts the fluid pressure at the back surface 125 of the second region 122 to substantially match the ambient air pressure such that the second region 122 does not deform undesirably (i.e. deviate from flush with the first region 121). For example, in the retracted state, the displacement device 150 preferably reduces the fluid pressure at the back surface 125 of the second region 122, when the user interface system 100 is transferred from substantially sea level to a substantially high altitude, such that the second region 122 does not outwardly deform in the presence of reduced ambient air pressure at higher altitudes. The pressure sensor may also serve as a reference for the displacement device 150, wherein, in the expanded (or recessed) state, the displacement device 150 increases (or decreases) the pressure at the back surface 125 of the second region 122 by a pre-specified pressure above (or below) the ambient air pressure such that the second region 122 deforms substantially identically at various ambient air pressures. However, the pressure sensor may function and/or cooperate with the displacement device 150 in any other way.


As a person skilled in the art will recognize from the previous detailed description and from the figures and claims, modifications and changes can be made to the preferred embodiments of the invention without departing from the scope of this invention as defined in the following claims.

Claims
  • 1. A user interface system comprising: a tactile layer defining a tactile surface a first region, and a deformable region adjacent the first region;a permeable layer comprising an attachment area and a support surface adjacent the attachment area, the permeable layer defining a substantially uniform density of fluid ports across the attachment area and the support surface, the peripheral first region coupled to the attachment area and Mocking flow of a fluid through fluid ports within the attachment area, the deformable region arranged over and disconnected from the support surface;a retaining wall coupled to the permeable layer opposite the tactile layer and impermeable to the fluid;a displacement device configured to displace the fluid through fluid ports within the support surface by displacing a portion of the permeable layer relative to the retaining wall to transition the deformable region from a retracted setting to an expanded setting, the deformable region in contact with the support surface in the retracted setting, the first region elevated above the first region and lifted off of the support surface in the expanded setting; anda sensor configured to output a signal corresponding to an input on the tactile surface.
  • 2. The user interface system of claim 1, wherein the support surface defines a concave contour adjacent the deformable region, wherein the displacement device is configured to transition the deformable region into the expanded setting by displacing a portion of the retaining wall toward the portion of the permeable layer, and wherein the displacement device is configured to retract the deformable region into the concave contour in the retracted setting by displacing the portion of the retaining wall away from the permeable layer.
  • 3. The user interface system of claim 1, wherein the retaining wall is offset from and cooperates with the permeable layer to define a reservoir containing the fluid, and wherein the displacement device is configured to displace the fluid from the reservoir into fluid ports in the permeable layer by displacing the portion of the permeable layer toward a portion of the retaining wall.
  • 4. The user interface system of claim 3, wherein the displacement device is configured to modify an orientation of the portion of the retaining wall relative to the permeable layer to displace fluid from the reservoir.
  • 5. The user interface system of claim 1, further comprising a first conductive trace arranged over the support surface and a second conductive trace coupled to the permeable layer opposite the support surface, wherein the displacement device is configured to generate a voltage differential across the first conductive trace and the second conductive trace to induce electroosmotic fluid flow through fluid ports within the support surface.
  • 6. The user interface system of claim 1, wherein the permeable layer defines a substantially uniform density of fluid conduits throughout its thickness, the fluid conduits terminating in fluid ports at the attachment area and the support surface.
  • 7. The user interface system of claim 1, wherein the tactile surface is substantially continuous across the first region and the deformable region, and wherein the first region and the deformable region are planar and flush in the retracted setting.
  • 8. The user interface system of claim 1, wherein the sensor comprises a capacitive touch sensor.
  • 9. The user interface system of claim 1, further comprising a digital display coupled to the retaining wall and configured to visually output an image of an input key substantially aligned with the deformable region, wherein the retaining wall, the permeable layer, and the tactile layer are substantially transparent.
  • 10. The user interface system of claim 1, wherein the permeable layer defines a second support surface, wherein the tactile layer defines a second deformable region arranged over and disconnected from the second support surface, and wherein the displacement device is further configured to transition the second deformable region from a retracted setting to an expanded setting, independent of the deformable region, by displacing a second portion of the permeable layer relative to the retaining wall.
  • 11. The user interface system of claim 6, wherein the permeable layer comprises a substantially porous material defining interconnected cavities that form the fluid conduits.
  • 12. The user interface system of claim 6, wherein the fluid conduits comprise substantially parallel bores of substantially circular cross-sections passing fully through the permeable layer substantially normal to the attachment area and to the support surface.
  • 13. The user interface system of claim 1, further comprising a perimeter wall impermeable to the fluid, encompassing a perimeter of the permeable layer, and cooperating with the retaining wall and the tactile layer to retain fluid within the permeable layer.
  • 14. The user interface system of claim 13, wherein the perimeter wall and the permeable layer cooperate to define a reservoir containing the fluid.
  • 15. A user interface system comprising: a tactile layer defining a tactile surface, a first region, and a deformable region adjacent the first region;a permeable layer comprising an attachment surface area and a support surface adjacent the attachment area, the permeable layer defining a substantially uniform density of fluid ports across the attachment area and the support surface, the first region coupled to the attachment area and blocking flow of a fluid through fluid ports within the attachment surface area, the deformable region arranged over and disconnected from the support surface;a retaining wall coupled to the permeable layer opposite the tactile layer and impermeable to the fluid;a displacement device configured to displace the fluid through fluid ports within the support surface to transition the deformable region from a retracted setting to an expanded setting, the deformable region in contact with the support surface in the retracted setting, the first region elevated above the first region and lifted off of the support surface in the expanded setting; anda sensor configured to output a signal corresponding to an input on the tactile surface.
  • 16. The user interface system of claim 15, wherein the permeable layer comprises a porous material defining interconnected cavities terminating in fluid ports across the attachment surface area and the support surface.
  • 17. The user interface system of claim 16, wherein the interconnected cavities initiate at fluid inlets across the permeable layer opposite the attachment surface area and the support surface, wherein the retaining wall is offset from the permeable layer opposite the tactile layer and cooperates with the permeable layer to define a fluid reservoir, and wherein the displacement device is configured to pump fluid from the reservoir, into the fluid inlets, and out of fluid ports within the support surface to transition the deformable region from the retracted setting to the expanded setting.
  • 18. The user interface system of claim 17, further comprising a first conductive trace arranged over the support surface and a second conductive trace coupled to the retaining wall, wherein the displacement device is configured to generate a voltage differential across the first conductive trace and the second conductive trace to displace fluid into the fluid inlets.
  • 19. The user interface system of claim 15, wherein the permeable layer defines a substantially uniform density of bores passing through the permeable layer substantially normal to the support surface and to the attachment area, wherein the bores terminate at the fluid ports at the support surface and the attachment area.
  • 20. The user interface system of claim 19, wherein the bores are of substantially circular cross-sections, and wherein the first region obstructs fluid flow through bores terminating in fluid ports within the attachment surface area.
  • 21. The user interface system of claim 15, wherein the deformable region is flush with the first region in the retracted setting.
  • 22. The user interface system of claim 15, wherein the sensor comprises a capacitive touch sensor.
  • 23. A user interface system comprising: a tactile layer defining a tactile surface, a first region, and a deformable region adjacent the first region;a permeable layer comprising an attachment area and a support surface adjacent the attachment area, the permeable layer defining a substantially uniform density of fluid ports across the attachment area and the support surface, the first region coupled to the attachment area and blocking flow of a fluid through fluid ports within the attachment area, the deformable region arranged over and disconnected from the support surface;a retaining wall coupled to the permeable layer opposite the tactile layer and impermeable to the fluid;a first conductive trace arranged over the support face;a second conductive trace coupled to the permeable layer opposite the support face;a displacement device configured to transition the deformable region from a retracted setting to an expanded setting by generating a voltage differential across the first conductive trace and the second conductive trace to induce electroosmotic flow through the permeable layer, the deformable region in contact with the support surface in the retracted setting, the first region elevated above the first region and lifted off of the support surface in the expanded setting; anda sensor configured to output a signal corresponding to an input on the tactile surface.
  • 24. The user interface system of claim 23, further comprising a digital display coupled to the retaining wall and configured to visually output an image of an input key substantially aligned with the deformable region, wherein the retaining wall, the permeable layer, the tactile layer, the first conductive trace, and the second conductive trace are substantially transparent.
  • 25. The user interface system of claim 23, wherein the permeable layer comprises a porous material defining a substantially uniform density of interconnected cavities throughout its thickness, defines an interior surface opposite the attachment surface area and the support surface, and defines a substantially uniform density of fluid inlets across the interior surface, wherein the interconnected cavities are fluidly coupled to the fluid ports and the fluid inlets.
  • 26. The user interface system of claim 1, wherein the tactile surface is substantially continuous across the first region and the deformable region, and wherein the first region and the deformable region are planar and flush in the retracted setting.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of US Provisional Application No. 61/405,140, filed 20 Oct. 2010, which is incorporated in its entirety by this reference. This application is related to U.S. application Ser. No. 11/969,848 filed on 4 Jan. 2008 and entitled “System and Method for Raised Touch Screens”, U.S. application Ser. No. 12/319,334 filed on 5 Jan. 2009 and entitled “User Interface System”, and U.S. application Ser. No. 12/497,622 filed on 3 Jul. 2009 and entitled “User Interface System”, which are all incorporated in their entirety by this reference.

US Referenced Citations (358)
Number Name Date Kind
3659354 Sutherland May 1972 A
3759108 Borom et al. Sep 1973 A
3780236 Gross Dec 1973 A
3818487 Brody et al. Jun 1974 A
4109118 Kley Aug 1978 A
4209819 Seignemartin Jun 1980 A
4290343 Gram Sep 1981 A
4307268 Harper Dec 1981 A
4467321 Volnak Aug 1984 A
4477700 Balash et al. Oct 1984 A
4517421 Margolin May 1985 A
4700025 Hatayama et al. Oct 1987 A
4920343 Schwartz Apr 1990 A
5194852 More et al. Mar 1993 A
5195659 Eiskant Mar 1993 A
5212473 Louis May 1993 A
5222895 Fricke Jun 1993 A
5286199 Kipke Feb 1994 A
5412189 Cragun May 1995 A
5459461 Crowley et al. Oct 1995 A
5666112 Crowley et al. Sep 1997 A
5717423 Parker Feb 1998 A
5729222 Iggulden et al. Mar 1998 A
5742241 Crowley et al. Apr 1998 A
5754023 Roston et al. May 1998 A
5766013 Vuyk Jun 1998 A
5767839 Rosenberg Jun 1998 A
5835080 Beeteson et al. Nov 1998 A
5889236 Gillespie et al. Mar 1999 A
5943043 Furuhata et al. Aug 1999 A
5977867 Blouin Nov 1999 A
5982304 Selker et al. Nov 1999 A
6067116 Yamano et al. May 2000 A
6154198 Rosenberg Nov 2000 A
6154201 Levin et al. Nov 2000 A
6160540 Fishkin et al. Dec 2000 A
6169540 Rosenberg et al. Jan 2001 B1
6218966 Goodwin et al. Apr 2001 B1
6243074 Fishkin et al. Jun 2001 B1
6243078 Rosenberg Jun 2001 B1
6268857 Fishkin et al. Jul 2001 B1
6271828 Rosenberg et al. Aug 2001 B1
6300937 Rosenberg Oct 2001 B1
6354839 Schmidt et al. Mar 2002 B1
6356259 Maeda et al. Mar 2002 B1
6359572 Vale Mar 2002 B1
6366272 Rosenberg et al. Apr 2002 B1
6369803 Brisebois et al. Apr 2002 B2
6414671 Gillespie et al. Jul 2002 B1
6437771 Rosenberg et al. Aug 2002 B1
6462294 Davidson et al. Oct 2002 B2
6469692 Rosenberg Oct 2002 B2
6486872 Rosenberg et al. Nov 2002 B2
6498353 Nagle et al. Dec 2002 B2
6509892 Cooper et al. Jan 2003 B1
6573844 Venolia et al. Jun 2003 B1
6636202 Ishmael, Jr. et al. Oct 2003 B2
6639581 Moore et al. Oct 2003 B1
6655788 Freeman Dec 2003 B1
6657614 Ito et al. Dec 2003 B1
6681031 Cohen et al. Jan 2004 B2
6686911 Levin et al. Feb 2004 B1
6697086 Rosenberg et al. Feb 2004 B2
6703924 Tecu et al. Mar 2004 B2
6788295 Inkster Sep 2004 B1
6819316 Schulz et al. Nov 2004 B2
6850222 Rosenberg Feb 2005 B1
6861961 Sandbach et al. Mar 2005 B2
6877986 Fournier et al. Apr 2005 B2
6881063 Yang Apr 2005 B2
6930234 Davis Aug 2005 B2
6937225 Kehlstadt et al. Aug 2005 B1
6975305 Yamashita Dec 2005 B2
6979164 Kramer Dec 2005 B2
6982696 Shahoian Jan 2006 B1
6995745 Boon et al. Feb 2006 B2
7027032 Rosenberg et al. Apr 2006 B2
7056051 Fiffie Jun 2006 B2
7061467 Rosenberg Jun 2006 B2
7064655 Murray et al. Jun 2006 B2
7081888 Cok et al. Jul 2006 B2
7096852 Gregorio Aug 2006 B2
7102541 Rosenberg Sep 2006 B2
7104152 Levin et al. Sep 2006 B2
7106305 Rosenberg Sep 2006 B2
7106313 Schena et al. Sep 2006 B2
7109967 Hioki et al. Sep 2006 B2
7112737 Ramstein Sep 2006 B2
7113166 Rosenberg et al. Sep 2006 B1
7116317 Gregorio et al. Oct 2006 B2
7124425 Anderson, Jr. et al. Oct 2006 B1
7129854 Arneson et al. Oct 2006 B2
7131073 Rosenberg et al. Oct 2006 B2
7136045 Rosenberg et al. Nov 2006 B2
7138977 Kinerk et al. Nov 2006 B2
7138985 Nakajima Nov 2006 B2
7143785 Maerkl et al. Dec 2006 B2
7144616 Unger et al. Dec 2006 B1
7148875 Rosenberg et al. Dec 2006 B2
7151432 Tierling Dec 2006 B2
7151527 Culver Dec 2006 B2
7151528 Taylor et al. Dec 2006 B2
7154470 Tierling Dec 2006 B2
7158112 Rosenberg et al. Jan 2007 B2
7159008 Wies et al. Jan 2007 B1
7161276 Face Jan 2007 B2
7161580 Bailey et al. Jan 2007 B2
7168042 Braun et al. Jan 2007 B2
7176903 Katsuki et al. Feb 2007 B2
7182691 Schena Feb 2007 B1
7191191 Peurach et al. Mar 2007 B2
7193607 Moore et al. Mar 2007 B2
7195170 Matsumoto et al. Mar 2007 B2
7196688 Schena Mar 2007 B2
7198137 Olien Apr 2007 B2
7199790 Rosenberg et al. Apr 2007 B2
7202851 Cunningham et al. Apr 2007 B2
7205981 Cunningham Apr 2007 B2
7208671 Chu Apr 2007 B2
7209028 Boronkay et al. Apr 2007 B2
7209117 Rosenberg et al. Apr 2007 B2
7209118 Shahoian et al. Apr 2007 B2
7210160 Anderson, Jr. et al. Apr 2007 B2
7215326 Rosenberg May 2007 B2
7216671 Unger et al. May 2007 B2
7218310 Tierling et al. May 2007 B2
7218313 Marcus et al. May 2007 B2
7233313 Levin et al. Jun 2007 B2
7233315 Gregorio et al. Jun 2007 B2
7233476 Goldenberg et al. Jun 2007 B2
7236157 Schena et al. Jun 2007 B2
7245202 Levin Jul 2007 B2
7249951 Bevirt et al. Jul 2007 B2
7250128 Unger et al. Jul 2007 B2
7253803 Schena et al. Aug 2007 B2
7253807 Nakajima Aug 2007 B2
7265750 Rosenberg Sep 2007 B2
7280095 Grant Oct 2007 B2
7283120 Grant Oct 2007 B2
7283123 Braun et al. Oct 2007 B2
7289106 Bailey et al. Oct 2007 B2
7289111 Asbill Oct 2007 B2
7307619 Cunningham et al. Dec 2007 B2
7308831 Cunningham et al. Dec 2007 B2
7319374 Shahoian Jan 2008 B2
7336260 Martin et al. Feb 2008 B2
7336266 Hayward et al. Feb 2008 B2
7339572 Schena Mar 2008 B2
7339580 Westerman et al. Mar 2008 B2
7342573 Ryynanen Mar 2008 B2
7355595 Bathiche et al. Apr 2008 B2
7369115 Cruz-Hernandez et al. May 2008 B2
7390157 Kramer Jun 2008 B2
7391861 Levy Jun 2008 B2
7397466 Bourdelais et al. Jul 2008 B2
7403191 Sinclair Jul 2008 B2
7432910 Shahoian Oct 2008 B2
7432911 Skarine Oct 2008 B2
7433719 Dabov Oct 2008 B2
7489309 Levin et al. Feb 2009 B2
7511702 Hotelling Mar 2009 B2
7522152 Olien et al. Apr 2009 B2
7545289 Mackey et al. Jun 2009 B2
7548232 Shahoian et al. Jun 2009 B2
7551161 Mann Jun 2009 B2
7561142 Shahoian et al. Jul 2009 B2
7567232 Rosenberg Jul 2009 B2
7567243 Hayward Jul 2009 B2
7592999 Rosenberg et al. Sep 2009 B2
7605800 Rosenberg Oct 2009 B2
7609178 Son et al. Oct 2009 B2
7671837 Forsblad et al. Mar 2010 B2
7679611 Schena Mar 2010 B2
7679839 Polyakov et al. Mar 2010 B2
7688310 Rosenberg Mar 2010 B2
7701438 Chang et al. Apr 2010 B2
7728820 Rosenberg et al. Jun 2010 B2
7733575 Heim et al. Jun 2010 B2
7743348 Robbins et al. Jun 2010 B2
7755602 Tremblay et al. Jul 2010 B2
7808488 Martin et al. Oct 2010 B2
7834853 Finney et al. Nov 2010 B2
7843424 Rosenberg et al. Nov 2010 B2
7864164 Cunningham et al. Jan 2011 B2
7869589 Tuovinen Jan 2011 B2
7890257 Fyke et al. Feb 2011 B2
7890863 Grant et al. Feb 2011 B2
7920131 Westerman Apr 2011 B2
7924145 Yuk et al. Apr 2011 B2
7944435 Rosenberg et al. May 2011 B2
7956770 Klinghult et al. Jun 2011 B2
7973773 Pryor Jul 2011 B2
7978181 Westerman Jul 2011 B2
7978183 Rosenberg et al. Jul 2011 B2
7978186 Vassallo et al. Jul 2011 B2
7979797 Schena Jul 2011 B2
7982720 Rosenberg et al. Jul 2011 B2
7986303 Braun et al. Jul 2011 B2
7986306 Eich et al. Jul 2011 B2
7989181 Blattner et al. Aug 2011 B2
7999660 Cybart et al. Aug 2011 B2
8002089 Jasso et al. Aug 2011 B2
8004492 Kramer et al. Aug 2011 B2
8013843 Pryor Sep 2011 B2
8020095 Braun et al. Sep 2011 B2
8022933 Hardacker et al. Sep 2011 B2
8031181 Rosenberg et al. Oct 2011 B2
8044826 Yoo Oct 2011 B2
8047849 Ahn et al. Nov 2011 B2
8049734 Rosenberg et al. Nov 2011 B2
8059104 Shahoian et al. Nov 2011 B2
8059105 Rosenberg et al. Nov 2011 B2
8063892 Shahoian et al. Nov 2011 B2
8063893 Rosenberg et al. Nov 2011 B2
8068605 Holmberg Nov 2011 B2
8077154 Emig et al. Dec 2011 B2
8077440 Krabbenborg et al. Dec 2011 B2
8077941 Assmann Dec 2011 B2
8094121 Obermeyer et al. Jan 2012 B2
8094806 Levy Jan 2012 B2
8103472 Braun et al. Jan 2012 B2
8106787 Nurmi Jan 2012 B2
8115745 Gray Feb 2012 B2
8123660 Kruse et al. Feb 2012 B2
8125347 Fahn Feb 2012 B2
8125461 Weber et al. Feb 2012 B2
8130202 Levine et al. Mar 2012 B2
8144129 Hotelling et al. Mar 2012 B2
8144271 Han Mar 2012 B2
8154512 Olien et al. Apr 2012 B2
8154527 Ciesla et al. Apr 2012 B2
8159461 Martin et al. Apr 2012 B2
8162009 Chaffee Apr 2012 B2
8164573 Dacosta et al. Apr 2012 B2
8169306 Schmidt et al. May 2012 B2
8169402 Shahoian et al. May 2012 B2
8174372 Da Costa May 2012 B2
8174495 Takashima et al. May 2012 B2
8174508 Sinclair et al. May 2012 B2
8174511 Takenaka et al. May 2012 B2
8178808 Strittmatter May 2012 B2
8179375 Ciesla et al. May 2012 B2
8179377 Ciesla et al. May 2012 B2
8188989 Levin et al. May 2012 B2
8195243 Kim et al. Jun 2012 B2
8199107 Xu et al. Jun 2012 B2
8199124 Ciesla et al. Jun 2012 B2
8203094 Mittleman et al. Jun 2012 B2
8207950 Ciesla et al. Jun 2012 B2
8212772 Shahoian Jul 2012 B2
8217903 Ma et al. Jul 2012 B2
8217904 Kim Jul 2012 B2
8224392 Kim et al. Jul 2012 B2
8228305 Pryor Jul 2012 B2
8232976 Yun et al. Jul 2012 B2
8243038 Ciesla et al. Aug 2012 B2
8253052 Chen Aug 2012 B2
8253703 Eldering Aug 2012 B2
8279172 Braun et al. Oct 2012 B2
8279193 Birnbaum et al. Oct 2012 B1
8378797 Pance et al. Feb 2013 B2
20010008396 Komata Jul 2001 A1
20020106614 Prince et al. Aug 2002 A1
20020110237 Krishnan Aug 2002 A1
20030087698 Nishiumi et al. May 2003 A1
20030179190 Franzen Sep 2003 A1
20030206153 Murphy Nov 2003 A1
20040056876 Nakajima Mar 2004 A1
20040056877 Nakajima Mar 2004 A1
20040164968 Miyamoto Aug 2004 A1
20040178006 Cok Sep 2004 A1
20050007349 Vakil et al. Jan 2005 A1
20050231489 Ladouceur et al. Oct 2005 A1
20050253816 Himberg et al. Nov 2005 A1
20060087479 Sakurai et al. Apr 2006 A1
20060098148 Kobayashi et al. May 2006 A1
20060118610 Pihlaja et al. Jun 2006 A1
20060214923 Chiu et al. Sep 2006 A1
20060238495 Davis Oct 2006 A1
20060238510 Panotopoulos et al. Oct 2006 A1
20060256075 Anastas et al. Nov 2006 A1
20070013662 Fauth Jan 2007 A1
20070036492 Lee Feb 2007 A1
20070085837 Ricks et al. Apr 2007 A1
20070108032 Matsumoto et al. May 2007 A1
20070122314 Strand et al. May 2007 A1
20070165004 Seelhammer et al. Jul 2007 A1
20070171210 Chaudhri et al. Jul 2007 A1
20070229233 Dort Oct 2007 A1
20070236469 Woolley et al. Oct 2007 A1
20070247429 Westerman Oct 2007 A1
20070273561 Philipp Nov 2007 A1
20070296702 Strawn et al. Dec 2007 A1
20070296709 GuangHai Dec 2007 A1
20080010593 Uusitalo et al. Jan 2008 A1
20080024459 Poupyrev et al. Jan 2008 A1
20080136791 Nissar Jun 2008 A1
20080138774 Ahn et al. Jun 2008 A1
20080143693 Schena Jun 2008 A1
20080150911 Harrison Jun 2008 A1
20080165139 Hotelling et al. Jul 2008 A1
20080248836 Caine Oct 2008 A1
20080251368 Holmberg et al. Oct 2008 A1
20080286447 Alden et al. Nov 2008 A1
20080303796 Fyke Dec 2008 A1
20090002328 Ullrich et al. Jan 2009 A1
20090002337 Chang Jan 2009 A1
20090009480 Heringslack Jan 2009 A1
20090015547 Franz et al. Jan 2009 A1
20090033617 Lindberg et al. Feb 2009 A1
20090066672 Tanabe et al. Mar 2009 A1
20090085878 Heubel et al. Apr 2009 A1
20090106655 Grant et al. Apr 2009 A1
20090115733 Ma et al. May 2009 A1
20090115734 Fredriksson et al. May 2009 A1
20090128503 Grant et al. May 2009 A1
20090135145 Chen et al. May 2009 A1
20090140989 Ahlgren Jun 2009 A1
20090160813 Takashima et al. Jun 2009 A1
20090167508 Fadell et al. Jul 2009 A1
20090167509 Fadell et al. Jul 2009 A1
20090167677 Kruse et al. Jul 2009 A1
20090167704 Terlizzi et al. Jul 2009 A1
20090174687 Ciesla et al. Jul 2009 A1
20090181724 Pettersson Jul 2009 A1
20090182501 Fyke et al. Jul 2009 A1
20090195512 Pettersson Aug 2009 A1
20090207148 Sugimoto et al. Aug 2009 A1
20090243998 Wang Oct 2009 A1
20090250267 Heubel et al. Oct 2009 A1
20090303022 Griffin et al. Dec 2009 A1
20100043189 Fukano Feb 2010 A1
20100097323 Edwards et al. Apr 2010 A1
20100109486 Polyakov et al. May 2010 A1
20100177050 Heubel et al. Jul 2010 A1
20100182245 Edwards et al. Jul 2010 A1
20110001613 Ciesla et al. Jan 2011 A1
20110018813 Kruglick Jan 2011 A1
20110029862 Scott et al. Feb 2011 A1
20110074691 Causey et al. Mar 2011 A1
20110148807 Fryer Jun 2011 A1
20110175844 Berggren Jul 2011 A1
20110254709 Ciesla et al. Oct 2011 A1
20120032886 Ciesla et al. Feb 2012 A1
20120043191 Kessler et al. Feb 2012 A1
20120056846 Zaliva Mar 2012 A1
20120062483 Ciesla et al. Mar 2012 A1
20120105333 Maschmeyer et al. May 2012 A1
20120193211 Ciesla et al. Aug 2012 A1
20120200528 Ciesla et al. Aug 2012 A1
20120200529 Ciesla et al. Aug 2012 A1
20120206364 Ciesla et al. Aug 2012 A1
20120218213 Ciesla et al. Aug 2012 A1
20120218214 Ciesla et al. Aug 2012 A1
20120235935 Ciesla et al. Sep 2012 A1
20120242607 Ciesla et al. Sep 2012 A1
20120306787 Ciesla et al. Dec 2012 A1
20130019207 Rothkopf et al. Jan 2013 A1
Foreign Referenced Citations (15)
Number Date Country
10255106 Sep 1998 JP
2006268068 Oct 2006 JP
2006285785 Oct 2006 JP
2004028955 Apr 2004 WO
2008037275 Apr 2008 WO
2009088985 Jul 2009 WO
2010077382 Jul 2010 WO
2010078596 Jul 2010 WO
2010078597 Jul 2010 WO
2011003113 Jan 2011 WO
2011087816 Jul 2011 WO
2011087817 Jul 2011 WO
2011112984 Sep 2011 WO
2011133604 Oct 2011 WO
2011133605 Oct 2011 WO
Non-Patent Literature Citations (2)
Entry
Optical Society of America, Optics Express; vol. 12, No. 11. May 31, 2004, 7 Pages, Jeong, Ki-Hun , et al. “Tunable Microdoublet Lens Array”.
http://sharp-world.com/corporate/news/070831.html, Sharp Press Release, Aug. 31, 2007, 3 pages “Sharp Develops and Will Mass Produce New System LCD with Embedded Optical Sensors to Provide Input Capabilities Including Touch Screen and Scanner Functions”.
Related Publications (1)
Number Date Country
20120098789 A1 Apr 2012 US
Provisional Applications (1)
Number Date Country
61405140 Oct 2010 US