Multi-dimensional trackpad

Information

  • Patent Grant
  • 10817061
  • Patent Number
    10,817,061
  • Date Filed
    Friday, August 31, 2018
    5 years ago
  • Date Issued
    Tuesday, October 27, 2020
    3 years ago
Abstract
A multi-dimensional track pad is described that acts as human-machine interface (HMI). Inputs to the HMI can be made not only using the tradition two-dimensional (X-Y) inputs of a track pad, but also a third dimension, force, and even a fourth dimension, time. Tactile or audible feedback to the inputs can be provided. Methods of using the HMI to control a system are described as well as a track pad system that utilizes the HMI in communication with a processor.
Description
BACKGROUND

Conventional control systems present operators with a combination of controls such as switches, buttons, levers, knobs, dials, etc. The operators interact with these control systems by manipulating the presented controls in order to execute various control functions. Recently, control systems have become increasingly complex due to the growing number of controllable features. As control systems increase in complexity, control panels become cluttered with switches, buttons, levers, knobs and/or dials. Accordingly, the control systems become more difficult to operate. In addition, it becomes difficult for engineers to design control panels that are capable of accommodating all of the necessary controls within a confined space.


Track pad devices have been developed to address the problems in the related art. However, these devices are generally two-dimensional (X-Y). For example, some smart phone devices include optical track pads for navigating the graphical user interface (GUI) of the smart phone. The optical track pads have a pleasant tactile feel, provide an audible “tick” for each move and, unlike capacitive touch screens, can be used without direct skin contact. For example, capacitive touch screens do not work with gloves. Some optical track pads do work with gloves; however, because they use a mechanical contact that is separate from the track pad for accept or select functions. Furthermore, optical track pads generally have a fairly low resolution infrared camera susceptible to moisture (sweat) interferences and are limited to measurements in two (X-Y) dimensions.


SUMMARY

Embodiments of the present invention relate to force based track pads for human-machine interfaces (HMI) and in particular track pads capable of sensing forces as well as position and providing tactile and audible feedback.


Described herein is an embodiment of a method of controlling a system using a track pad. The exemplary method comprises a touch interface of a track pad receiving a touch force. The touch interface is positioned over an array of force sensors that are arranged to have a width and a length. The method further comprises passing at least a portion of the touch force through the touch interface to one or more force sensors of the array of force sensors. The one or more force sensors of the array of force sensors transmits the force information to a processor in communication with the array of force sensors The processor determines from the force information, a force position along the width and length and a corresponding force magnitude. The processor sends a control message to a system, wherein the control message is selected depending upon one or more of the force position along the width and length and the corresponding force magnitude. A feedback generator provides at least one of a tactile or audible feedback to the user of the track pad.


Also described herein is a track pad system that can be used to practice embodiments of the described method. In one aspect, the track pad system comprises a two-dimensional array of force sensors arranged to have a width and a length and a touch interface positioned over the array, wherein the touch interface passes touch forces through to one or more force sensors of the array of force sensors. A processor in communication with a memory executes computer-readable instructions stored on the memory, the instructions cause the processor to receive force information from the array of force sensors; and determine a force position along the width and length and a corresponding force magnitude. The track pad system is further comprised of a feedback generator that generates at least one of a tactile or audible feedback.


A track pad system integrated into a steering mechanism of a vehicle is also described herein. The system comprises a two-dimensional array of force sensors arranged to have a width and a length, the two dimensional array of force sensors embedded into a steering mechanism of a vehicle. The touch interface is positioned over the array, wherein the touch interface passes touch forces through to one or more force sensors of the array of force sensors. The system further comprises a processor in communication with a memory, wherein the processor executes computer-readable instructions stored on the memory, the instructions cause the processor to receive force information from the array of force sensors; determine a force position along the width and length and a corresponding force magnitude; and send a control message to a system, wherein the control message is selected from a plurality of control messages and the system is selected from a plurality of systems depending upon one or more of the force position along the width and length and the corresponding force magnitude.


It should be understood that the above-described subject matter may also be implemented as a computer-controlled apparatus (e.g., a human machine interface for a system), a computing system, or an article of manufacture, such as a computer-readable storage medium.


Other systems, methods, features and/or advantages will be or may become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features and/or advantages be included within this description and be protected by the accompanying claims.





BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The components in the drawings are not necessarily to scale relative to each other and like reference numerals designate corresponding parts throughout the several views:



FIG. 1 illustrates a plan view of an exemplary steering apparatus implementing a force-based track pad interface for vehicle control panels in accordance with the present disclosure;



FIG. 2 illustrates a block diagram of a force-based track pad sensor system according to an implementation of the invention;



FIGS. 3A and 3B illustrate a cross-sectional view and a plan view of an embodiment of a force-based track pad;



FIG. 3C illustrates another embodiment of a force-based track pad that further comprises a feedback generator that generates at least one of a tactile or audible feedback;



FIG. 3D is an illustration of a cross-sectional view of yet another embodiment of a force-based track pad;



FIG. 4 is an illustration of a table that provides examples of systems that can be selected and control messages that can be sent to the selected system by an application of an embodiment of the present invention; and



FIG. 5 is an exemplary flowchart that can be used to describe a method of controlling a system using a track pad.





DETAILED DESCRIPTION

Described herein are embodiments of an invention that include a track pad system for recording multi-dimensional data including an X-Y direction and a force magnitude.


The terminology used herein is for the purpose of describing particular implementations only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.


The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The implementation was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various implementations with various modifications as are suited to the particular use contemplated.


Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.


A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.


Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.


Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).


Aspects of the present invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to implementations of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.


These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.


The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.



FIG. 1 illustrates a plan view of an exemplary steering apparatus implementing a force-based track pad interface for vehicle control panels in accordance with the present disclosure. An example steering apparatus 100 can have a steering grip 102. A steering grip 102 can be shaped in such a way to facilitate a driver's control of a vehicle when holding the steering grip 102. For example, the steering grip 102 can include an annular ring shape with an outer contour that is essentially circular in shape. In an alternate implementation, the steering grip 102 can define any suitable shape including, for example, circular, elliptical, square, rectangular, or any other regular or irregular shape. In an exemplary implementation, the steering grip 102 can include a single continuous grip portion or any number of unique grip sections. Additionally the steering grip 102 can be mounted on a fixed component 104 such that it can be rotationally moved about a steering axis. An exemplary fixed component 104 can include, for example, a steering column, which receives a steering spindle that extends along the steering column and serves to transmit the rotational movement of the steering grip 102 to the wheels of the motor vehicle. Rotational movement of the steering grip 102 may be transmitted to the wheels by mechanical and/or electrical means. In an exemplary implementation, the steering apparatus 100 can also include a force-based track pad sensor 106, wherein the force-based track pad sensor 106 is operably coupled to the steering grip 102.


Coupling a force-based track pad sensor 106 to the steering grip 102 of a steering apparatus 100 provides a driver with a human-machine interface that can be configured to detect a touch or force provided by a user and determine if a switch function should or should not be activated. In one embodiment, the user can be provided with a tactile or audible feedback response.


A force-based track pad sensor 106 can be any sensor configured to change at least one electrical property in response to a touch or force applied to the sensor 106. A touch, also known as a touch event, can be for example a physical contact that occurs when a driver in a vehicle uses their hand (gloved or ungloved) to apply a force to force-based track pad sensor 106. A force-based track pad sensor 106, can be any suitable tactile sensor including, a mechanical sensor, a resistive sensor, a capacitive sensor, a magnetic sensor, an optical fiber sensor, a piezoelectric sensor, a silicon sensor, and/or a temperature sensor.


The force-based track pad sensor 106 can include a two-dimensional array of force sensors arranged to have a width and a length, where each force sensor includes conductors and electrodes and is in at least partial contact with a touch interface positioned over the array. In one embodiment the track pad sensor 106 can further comprise a base that is in at least partial contact with each of the force sensors. In one aspect, the base can comprise a printed circuit board. The touch interface passes touch forces to one or more force sensors of the array of force sensors. The touch interface can embody any touch-sensitive deformable member that can pass at least part of the forces from a user through the touch interface to one or more force sensors of the array of force sensors. In one embodiment, the touch interface can be used to provide haptic feedback to the user.


Referring to FIG. 2, a block diagram of a force-based track pad sensor system 200 according to an implementation of the invention is shown. The sensor system 200 is an example of a human machine interface for controlling a system as discussed in further detail below. The sensor system 200 may be used to sense a position and magnitude of force applied to the sensor system 200. In other words, the sensor system 200 may be configured to sense the position of the applied force in either one dimension (e.g., the X- or Y-direction) or two dimensions (e.g., the X- and Y-directions), as well of as the magnitude of the applied force (e.g., force in the Z-direction). The sensor system 200 can also be configured to sense the time that a force is applied at a particular location. The sensor system 200 may include a computing unit 206, a system clock 208, one or more force sensors 210 and communication hardware 212. In its most basic form, the computing unit 206 may include a processor 202 and a system memory 204. The processor 202 may be a standard programmable processor that performs arithmetic and logic operations necessary for operation of the sensor system 200. The processor 202 may be configured to execute program code encoded in tangible, computer-readable media. For example, the processor 202 may execute program code stored in the system memory 204, which may be volatile or non-volatile memory. The system memory 204 is only one example of tangible, computer-readable media. In one aspect, the computing unit 206 can be considered an integrated device such as firmware. Other examples of tangible, computer-readable media include floppy disks, CD-ROMs, DVDs, hard drives, flash memory, or any other machine-readable storage media, wherein when the program code is loaded into and executed by a machine, such as the processor 202, the machine becomes an apparatus for practicing the disclosed subject matter.


In addition, the sensor system 200 may include one or more force sensors 210 that can change at least one electrical property (e.g., resistance) in response to forces applied to the sensor system 200. The force sensor 210 is an example of a pressure sensitive input device as discussed in further detail below. Further, the sensor system 200 may include communication hardware 212 that interfaces with the force sensor 210 and receives/measures the sensed changes in the at least one electrical property of the force sensor 210. Additionally, the sensor system 200 may include a system clock 208. The processor 202 may be configured to associate the sensed changes in the at least one electrical property of the force sensor 210 with a time from the system clock 208 and store the sensed changes and corresponding time to the system memory 204. Optionally, the processor 202 may be configured to analyze the stored data and associate measured changes in the at least one electrical property of the force sensor 210 with various control messages for controlling system functions.



FIGS. 3A and 3B illustrate a cross-sectional view and a plan view of an embodiment of a force-based track pad 300. This embodiment of a force-based track pad 300 includes a two-dimensional array of force sensors 302 arranged to have a geometric shape having a width 304 and a length 306. For example, the array of force sensors 302 may have a width 304 or length 306 that is 8 mm or larger. In another example, the array of force sensors 302 may have a width 304 or length 306 that is less than 8 mm. In one embodiment, the track pad 300 can have a depth 314 that is 0.5 mm or less. In another example, the track pad 300 can have a depth 314 that is greater than 0.5 mm. While shown in FIGS. 3A and 3B as having a rectangular shape, it is to be appreciated that this is for illustrative purposes only and the two-dimensional array of force sensors 302 can have shapes such as circular, oval, square, rectangular, triangular and irregular shapes. Further comprising the embodiment of a force-based track pad 300 as shown in FIGS. 3A and 3B is a touch interface 308 positioned over the array of force sensors 302, wherein the touch interface 308 passes touch forces through to one or more force sensors 302 of the array of force sensors 302. As described herein, the touch interface 308 can embody any touch-sensitive deformable member that can pass at least part of the forces from a user through the touch interface 308 to one or more force sensors 302 of the array of force sensors 302. For example, the touch interface 308 can be comprised of rubber, plastics, flexible metals, leather, and the like including combinations thereof. Generally, the force sensors 302 are connected to or integrated with a base 310. For example, the base 310 can comprise a printed circuit board (PCB) used to electronically communicate information or power to and from the force sensors 302 in the form of electrical signals. In various embodiments, the base 310 can further comprise electronic circuit components such as resistors, capacitors, diodes, LEDs, transmitters, receivers, and the like. In one embodiment, the base 310 is used to electrically connect the force sensors 302 with a processor 202, as described herein.


The force sensors 302 are arranged such that the position of a force on the touch interface 308 can be detected by one or more of the force sensors 302 of the array of force sensors 302. In this manner, by the force sensors 302 affected by the force on the touch interface 308 and the magnitude of the force on each of the affected force sensors 302, the position (X, Y) of the force on the touch interface 308 can be determined. For example, force information from the array of force sensors can be transmitted to a processor such as the processor 202 shown in FIG. 2 and described herein. The processor 202 can be in communication with a memory 204, wherein the processor 202 executes computer-readable instructions stored on the memory 204. The instructions can cause the processor 202 to receive the force information from the array of force sensors 302 and determine a force position along the width 304 and length 306 and a corresponding force magnitude. The force information can be transmitted from the array of force sensors 302 to the processor 202 via a wired connection (including fiber optics, wirelessly (RF using protocols such as Bluetooth™, WiFi (IEEE 802.11n), etc.), or combinations thereof. For example, referring now to FIG. 3B, the processor can receive force information from force sensors c, d, g, and h. By having the location of these force sensors 302 programmed into its memory 204, the processor 202 can determine that a force is being applied to the upper right-hand quadrant of the force-based track pad 300. By determining the magnitude of the force being applied to the force sensors 302, the processor 202 can be programmed via instructions from the memory 204 to further refine the location of the force and to take specific actions based on any of the location of the force on the track pad 300, the magnitude of the force applied to the track pad 300, the time the force is applied to the track pad 300, the change of the location of the applied force to the track pad 300, the rate of the change of the location of the applied force to the track pad 300 (e.g., quickly swiping a thumb across the track pad 300 results in one action being taken while slowly swiping the thumb across the track pad 300 results in a different action being taken), the direction of the change of the location of the applied force to the track pad 300, the length from a first touch point to a second touch point on the track pad 300, the length or distance that a digit is moved across the track pad 300 after a first touch point, the direction that a digit is moved across the track pad 300 after a first touch point, changes in the magnitude of the force applied to the track pad 300, rate of change in the magnitude of the force applied to the track pad 300, combinations of any of the above, and the like.


Referring back to FIG. 3A, the force sensors 302 can be any device or structure that can transform force into a signal. The signal can be electrical, electronic (digital or analog), mechanical, or optical. For example, in one embodiment the force sensors are microelectromechanical systems (MEMS) sensors. In one embodiment, the MEMS sensors are structure-based piezo-resistive sensors.



FIG. 3C illustrates another embodiment of a force-based track pad 300 that further comprises a feedback generator 312 that generates at least one of a tactile or audible feedback. In one aspect, the tactile or audible feedback provided by the feedback generator 312 is proportional to at least one of the force position and the force magnitude. For example, the tactile or audible feedback can get stronger or louder as greater force is applied to the track pad 300. Similarly, the tactile or audible feedback can get stronger or louder depending upon the location on the track pad 300 where the force is applied. The feedback generator 312 may, in some embodiments, be controlled by the processor 202. For example, the processor 202 may determine the location or magnitude of the force applied to the track pad 300, as described herein, and then cause the feedback generator 312 to generate the tactile or audible feedback that is proportional to at least one of the force position and the force magnitude. Software stored in the memory 204 can cause the processor 202 to perform these functions. In one embodiment, the feedback generator 312 can be integrated into the structure that comprises the force-based track pad 300. For example, in one embodiment the feedback generator 312 can be integrated into the base 310. In another embodiment, the feedback generator 312 is a structural part of the structure-based piezo-resistive sensors, as described herein. In yet another embodiment, the feedback generator 312 is a haptic generator used to generate the tactile and audible feedback. In one embodiment, the haptic generator can be a coneless coil and magnet assembly such as that described in U.S. Pat. App. Pub. No. 2012/0039494 entitled “LOUDSPEAKERS” and filed on Feb. 16, 2010, which is fully incorporated herein by reference and made a part hereof.


The embodiments of a force-based track pad 300 described herein can be used to control one or more systems. For example, embodiments of a force-based track pad 300 described herein can be used to control the systems of a vehicle such as environmental (HVAC), audio, telephone, cruise control, windshield wipers, lighting, window and mirrors, and the like. For example, instructions stored in the memory 204 can further cause the processor 202 to send a control message to a system selected from a plurality of systems, wherein the control message is selected from a plurality of control messages by the processor 202. The selection of system and control message can be made depending upon one or more of the force position along the width and length and the corresponding force magnitude. For example, in one embodiment the system can be selected from the plurality of systems depending upon the force magnitude and the control message is selected from the plurality of control messages depending at least partially upon the force position along the width and length. Consider this example, the force-based track pad 300 can have a plurality of force thresholds that can be used to select the system from the plurality of systems. For example, the force-based track pad 300 can have at least three thresholds that correlate to a different system for each threshold. In one example, the force thresholds are in increments of one Newton (N) or one ounce, two N or two ounces, and the like. For example, the first threshold may be at a force of one Newton (N) or one ounce and correlate to the audio system of a vehicle. The second threshold can be at two N or two ounces of force that correlates to the HVAC system for the vehicle. The third threshold can be at three N or three ounces of force that correlates to the cruise control system for the vehicle. In other words, the track pad 300 can recognize force magnitude of at least three thresholds and the system is selected from the plurality of systems depending upon the force magnitude exceeding one or more of the thresholds.


In one embodiment, once the system is selected from the plurality of systems based on the force magnitude, a control message for sending to that selected system can be selected from a plurality of control messages based at least in part on the force position along the width and length of the track pad 300. For example, if the HVAC system is selected based on the force magnitude, then a control message such as turn on/off the heat, turn up/down the fan, adjust the temperature, etc., can be selected based at least in part on the force position along the width and length of the track pad 300. For example, control messages to send to the selected system can be selected based on one or more of the time the force is applied to the track pad 300 at a certain location, the change of the location of the applied force to the track pad 300, the rate of the change of the location of the applied force to the track pad 300 (e.g., quickly swiping a thumb across the track pad results in one action being taken while slowly swiping the thumb across the track pad 300 results in a different action being taken), the direction of the change of the location of the applied force to the track pad 300, the length from a first touch point to a second touch point on the track pad 300, the length or distance that a digit is moved across the track pad 300 after a first touch point, the direction that a digit is moved across the track pad 300 after a first touch point, changes in the magnitude of the force applied to the track pad 300, changes in the magnitude of the force applied to the track pad 300, rate of change in the magnitude of the force applied to the track pad 300, combinations of any of the above, and the like.


In one embodiment, the feedback generator 312 can provide an audible tick or other sound when the control message is selected from the plurality of control messages depending at least partially upon the force position along the width and length and provide the tactile feedback for each selection made depending on the force magnitude. Alternatively, the feedback generator 312 can provide an audible tick for each selection made depending on the force magnitude and provide tactile feedback when the control message is selected from the plurality of control messages depending at least partially upon the force position along the width and length of the track pad 300.



FIG. 3D is a cross-sectional view of yet another embodiment of a force-based track pad 300. This embodiment includes the two-dimensional array of force sensors 302 arranged to have a geometric shape having a width 304 and a length 306, a touch interface 308 positioned over the array of force sensors 302, wherein the touch interface 308 passes touch forces through to one or more force sensors 302 of the array of force sensors 302, a base 310, and a feedback generator 312 that generates at least one of a tactile or audible feedback. Further comprising the embodiment shown in FIG. 3D is an enclosure 316 that encloses the components of the track pad 300. The enclosure 316 can be comprised of any suitable material such as plastics, metals, and the like. It can be used to add structural integrity to the track pad 300 as well as to protect it from physical and/or environmental damage or contamination. The enclosure 316 may also facilitate manufacturing, installation or removal of the track pad 300. Further illustrated in FIG. 3D is an interchangeable overlay 320 so that different materials, colors, textures can be used for the track pad 300, which can be used for an aesthetic effect of a larger device, such as a vehicle, where the track pad 300 is installed. This can also allow replacement of the overlay 320 if it becomes damaged, dirty or worn. Also shown in FIG. 3D, but not required, is the trim 318 of a larger device, such as a vehicle, where the track pad 300 is installed. For example, the trim 318 can be a part of the steering apparatus 100 shown in FIG. 1.


As noted herein, the force-based track pad can be used to select and control a plurality of systems. The table 400 of FIG. 4 illustrates examples of systems that can be selected and control messages that can be sent to the selected system. For example, the force-based track pad 300 can have a plurality of thresholds that correlate to a different system for each threshold. In one example application of an embodiment of the invention, as shown in the table 400 of FIG. 4, the first threshold may correlate with the HVAC system for a vehicle. By selecting the first threshold by applying a defined amount of force (e.g., one N or one ounce) to the track pad 300 (either momentarily or for a defined period of time), the HVAC system can be selected and controlled using the track pad 300. Once selected by the force applied to the track pad 300, the track pad 300 can be used to select and send control messages to the HVAC system. Gestures or other actions using the track pad 300 that are at least partially dependent upon the position along the width and length of the track pad 300 can be used to send the control messages to the HVAC system. For example, control messages to send to the selected system can be selected based on one or more of the time the force is applied to the track pad 300 at a certain location, the change of the location of the applied force to the track pad 300, the rate of the change of the location of the applied force to the track pad 300 (e.g., quickly swiping a thumb across the track pad results in one action being taken while slowly swiping the thumb across the track pad 300 results in a different action being taken), the direction of the change of the location of the applied force to the track pad 300, the length from a first touch point to a second touch point on the track pad 300, the length or distance that a digit is moved across the track pad 300 after a first touch point, the direction that a digit is moved across the track pad 300 after a first touch point, changes in the magnitude of the force applied to the track pad 300, changes in the magnitude of the force applied to the track pad 300, rate of change in the magnitude of the force applied to the track pad 300, combinations of any of the above, and the like. For the exemplary HVAC system that has been selected, such control messages can include for example: Turn on/off; Adjust temperature; Adjust fan speed; Adjust mode (e.g., defrost, face and feet, just feet, etc.); Adjust seat heat/ventilation; and the like.


Similarly, a second force threshold can be correlated with a second system, such as an audio system of a vehicle. In one embodiment, the second threshold is at a force greater than the first threshold. In another embodiment, the second threshold can be at a force less than the first threshold. Similar to the above, once the audio system is selected using force on the track pad 300, control messages can be sent to the audio system using gestures or other actions using the track pad 300 that are at least partially dependent upon the position along the width and length of the track pad 300. For the audio system such messages can be, for example: Turn on/off; Adjust sound level; Adjust fade, balance, bass, treble, etc.; Adjust mode (e.g., radio, satellite radio, CD, auxiliary, etc.); and the like. Other systems, such as those shown in FIG. 4, can be selected and controlled in similar fashion.


The track pad system 300 disclosed herein may be particularly applicable to distracted environments, such as in automobile operation, wherein the human needs additional feedback to properly operate a machine. For example, the driver of an automobile is usually best visually focused on his or her surroundings during the driving task. The ability of the track pad system 300 to provide haptic and audible feedback makes for more sure and satisfying operation of various automobile systems. As described herein, the track pad system 300 may be used, for example, to operate stereo and/or climate controls. Each change of a station or degree could generate haptic and audible feedback. In addition, the provision of force sensitivity—and in particular thresholds—allows multiple layers of functionality from a single button. The advantage of this implementation is that the track pad 300 can replace a large number of controls and shrink the necessary reach range (and the amount of distraction) for the driver.



FIG. 5 is an exemplary flowchart 500 that can be used to describe a method of controlling a system using a track pad. Steps of the method comprise Step 502, receiving a touch force by a touch interface 308 positioned over an array of force sensors 302 that are arranged to have a width 304 and a length 306. At Step 504, passing at least a portion of the touch force through the touch interface 308 to one or more force sensors 302 of the array of force sensors 302. At Step 506, transmitting force information by the one or more force sensors 302 of the array of force sensors 302, to a processor 202 in communication with the array of force sensors 302. At Step 508, determining, by the processor, from the force information, a force position along the width 304 and length 306, and a corresponding force magnitude. At Step 510, the processor sends a control message to a system, wherein the control message is selected depending upon one or more of the force position along the width 304 and length 306 and the corresponding force magnitude. In one aspect, as described herein, sending the control message to the system, wherein the control message is selected depending upon one or more of the force position along the width and length and the corresponding force magnitude, further comprises selecting the system from a plurality of systems and selecting the control message from a plurality of control messages, the selections made depending upon one or more of the force position along the width and length and the corresponding force magnitude. In one embodiment, the system is selected from the plurality of systems depending upon the force magnitude and the control message is selected from the plurality of control messages depending at least partially upon the force position along the width and length. For example, the force magnitude can have at least three thresholds and the system is selected from the plurality of systems depending upon the force magnitude exceeding one or more of the thresholds. In one aspect, a different system is selected for each threshold. In another embodiment, the control message is selected depending upon the force magnitude exceeding a threshold, wherein the force magnitude has at least three thresholds and the control message is selected depending upon the force magnitude exceeding one or more of the thresholds. In one aspect, a different control message is selected for each threshold. At Step 512, a feedback generator provides at least one of a tactile or audible feedback. In one aspect, the feedback generator provides a tactile or audible feedback that is proportional to at least one of the force position and the force magnitude. For example, the feedback may get louder, more frequent, more powerful, quieter, less powerful, etc. depending upon the force applied to the track pad 300 or at least partially upon the force position. In one embodiment, the feedback generator can be configured to provide an audible tick or other sound when the control message is selected from the plurality of control messages depending at least partially upon the force position along the width and length and provide the tactile feedback for each selection made depending on the force magnitude.


The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.


The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The implementation was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various implementations with various modifications as are suited to the particular use contemplated.

Claims
  • 1. A method of selecting and controlling a system using a track pad, the method comprising: providing the track pad integrated into a steering mechanism of a vehicle, said track pad comprising at least a touch interface positioned over an array of force sensors that are arranged to have a width and a length, and wherein said track pad is not associated with a display;receiving, by the track pad, a touch force, wherein said touch force comprises a first touch with the touch interface of the track pad to control the system from among a plurality of systems of the vehicle;passing at least a portion of said touch force through the touch interface to one or more force sensors of the array of force sensors;transmitting, by the one or more force sensors of the array of force sensors, force information of the first touch to a processor in communication with the array of force sensors;determining, by the processor, from the force information of the first touch a force position of the first touch along the width and length and a force magnitude of the first touch;selecting, by the processor and based on the first touch, the vehicle system to control from among the plurality of systems of the vehicle, wherein each of the plurality of vehicle systems has a corresponding force threshold such that the vehicle system is selected from among the plurality of systems of the vehicle based on the force magnitude of the first touch and the force position of the first touch along the width and the length;selecting, by the processor, a control message from among a plurality of control messages to send to the selected system based on one or more of a time the touch force of the first touch is applied to the track pad at the force position, a change of the touch force from the first position to a second location on the track pad, a rate of change of the touch force from the first position to the second location on the track pad, a direction of the change of the touch force from the first position to the second location on the track pad, a length from the first position to the second location of the touch force, a change in the force magnitude of the touch force, and a rate of change of the force magnitude of the touch force; andsending, by the processor, the selected control message to the selected system.
  • 2. The method of claim 1, wherein the track pad has at least two thresholds and a first system is selected from the plurality of systems when the touch force has a force magnitude that exceeds a first threshold of the at least two thresholds and a second system is selected from the plurality of systems when the touch force has a force magnitude that exceeds a second threshold of the at least two thresholds.
  • 3. The method of claim 1, wherein the rate of change of the touch force from the first position to the second location on the track pad comprises a person swiping a digit across the track pad and a first rate of change results in selection of a first control message while a second rate of change results in selection of a second control message.
  • 4. The method of claim 3, wherein the first control message and the second control message are not a same control message.
  • 5. The method of claim 1, further comprising providing, by a feedback generator, at least one of a tactile or audible feedback.
  • 6. The method of claim 5, wherein providing, by the feedback generator, at least one of a tactile or audible feedback, comprises the feedback generator providing tactile or audible feedback that is selected based on the force position of the first touch along the width and length or the force magnitude of the first touch.
  • 7. The method of claim 1, further comprising installing an interchangeable overlay on the track pad, wherein the interchangeable overlay provides an aesthetic effect to the track pad.
  • 8. A system for selecting and controlling a vehicle system selected from a plurality of vehicle systems using a track pad, the system comprising: the track pad integrated into a steering mechanism of a vehicle and comprised of a two-dimensional array of force sensors arranged to have a width and a length and a touch interface positioned over the array, wherein the touch interface passes touch forces through to one or more force sensors of the array of force sensors and said track pad is not associated with a display;a processor in communication with the array of force sensors and with a memory, wherein the processor executes computer-readable instructions stored on the memory, said instructions cause the processor to: receive force information from the array of force sensors from a touch force, wherein said touch force is caused by a first touch with the touch interface of the track pad to control the vehicle system from among the plurality of systems of the vehicle;determine a force position of the first touch along the width and length and a force magnitude of the first touch;select, based on the first touch, the vehicle system to control from among the plurality of systems of the vehicle, wherein each of the plurality of vehicle systems has a corresponding force threshold such that the vehicle system is selected from among the plurality of systems of the vehicle based on the force magnitude of the first touch and the force position of the first touch along the width and the length;select a control message from among a plurality of control messages to send to the selected system based on one or more of a time the touch force of the first touch is applied to the track pad at the force position, a change of the touch force from the first position to a second location on the track pad, a rate of change of the touch force from the first position to the second location on the track pad, a direction of the change of the touch force from the first position to the second location on the track pad, a length from the first position to the second location of the touch force, a change in the force magnitude of the touch force, and a rate of change of the force magnitude of the touch force; andsend the selected control message to the selected system.
  • 9. The system of claim 8, wherein the track pad has at least two thresholds and a first system is selected from the plurality of systems when the touch force of the first touch has a force magnitude exceeds a first threshold of the at least two thresholds and a second system is selected from the plurality of systems when the touch force of the first touch has a force magnitude exceeds a second threshold of the at least two thresholds.
  • 10. The system of claim 8, wherein the rate of change of the force touch from the first position to the second location on the track pad comprises a person swiping a digit across the track pad and a first rate of change results in selection of a first control message while a second rate of change results in selection of a second control message.
  • 11. The system of claim 10, wherein the first control message and the second control message are not a same control message.
  • 12. The system of claim 8, further comprising a feedback generator, wherein the feedback generator provides at least one of a tactile or audible feedback.
  • 13. The system of claim 12, wherein providing, by the feedback generator, at least one of a tactile or audible feedback, comprises the feedback generator providing tactile or audible feedback that is selected based on the force position of the first touch along the width and length or proportional to the force magnitude of the first touch.
  • 14. The system of claim 8, wherein the track pad further comprises an interchangeable overlay on the track pad, wherein the interchangeable overlay provides an aesthetic effect to the track pad.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patent application Ser. No. 14/291,845 filed May 30, 2014, which will issue as U.S. Pat. No. 10,067,567 on Sep. 4, 2018, and which claimed priority to U.S. Provisional Patent Application No. 61/829,065 filed May 30, 2013 and entitled “Three Dimensional Trackpad,” the contents of each are herein incorporated by reference in their entireties.

US Referenced Citations (186)
Number Name Date Kind
4484026 Thornburg Nov 1984 A
4540979 Gerger et al. Sep 1985 A
4801771 Mizuguchi et al. Jan 1989 A
4929934 Ueda et al. May 1990 A
5398962 Kropp Mar 1995 A
5408873 Schmidt et al. Apr 1995 A
5423569 Reighard et al. Jun 1995 A
5453941 Yoshikawa Sep 1995 A
5463258 Filion et al. Oct 1995 A
5539259 Filion et al. Jul 1996 A
5793297 Takeuchi et al. Aug 1998 A
5871063 Young Feb 1999 A
5914658 Arakawa Jun 1999 A
5943044 Martinelli Aug 1999 A
5965952 Podoloff et al. Oct 1999 A
6067077 Martin May 2000 A
6333736 Sandbach Dec 2001 B1
6378384 Atkinson et al. Apr 2002 B1
6429846 Rosenberg et al. Aug 2002 B2
6501463 Dahley et al. Dec 2002 B1
6636197 Goldberg et al. Oct 2003 B1
6809462 Pelrine et al. Oct 2004 B2
6906700 Armstrong Jun 2005 B1
6933920 Lacroix et al. Aug 2005 B2
7126583 Breed Oct 2006 B1
7136051 Hein et al. Nov 2006 B2
7258026 Papakostas et al. Aug 2007 B2
7649278 Yoshida et al. Jan 2010 B2
8052293 Hurwitz Nov 2011 B2
8203454 Knight et al. Jun 2012 B2
8214105 Daly et al. Jul 2012 B2
8222799 Polyakov et al. Jul 2012 B2
8237324 Pei et al. Aug 2012 B2
8269731 Molne Sep 2012 B2
8633916 Bernstein et al. Jan 2014 B2
8698764 Karakotsis Apr 2014 B1
8730186 Tamura et al. May 2014 B2
8948944 Kawashima Feb 2015 B2
9007190 Bosch et al. Apr 2015 B2
9244562 Rosenberg Jan 2016 B1
9513707 Lisseman et al. Dec 2016 B2
9696223 Lisseman et al. Jul 2017 B2
9727031 Lisseman et al. Aug 2017 B2
9829980 Lisseman et al. Nov 2017 B2
20020041164 Kim Apr 2002 A1
20020054060 Schena May 2002 A1
20030043014 Nakazawa et al. Mar 2003 A1
20030076968 Rast Apr 2003 A1
20030083131 Armstrong May 2003 A1
20040195031 Nagasaka Oct 2004 A1
20040207605 Mackey et al. Oct 2004 A1
20050021190 Worrell et al. Jan 2005 A1
20050052426 Hagermoser et al. Mar 2005 A1
20050067889 Chernoff Mar 2005 A1
20050110769 Dacosta et al. May 2005 A1
20050156892 Grant et al. Jul 2005 A1
20050273218 Breed et al. Dec 2005 A1
20060025897 Shostak et al. Feb 2006 A1
20060054479 Iisaka Mar 2006 A1
20060076855 Eriksen et al. Apr 2006 A1
20060109256 Grant May 2006 A1
20060113880 Pei et al. Jun 2006 A1
20060177212 Lamborghini et al. Aug 2006 A1
20060248478 Liau Nov 2006 A1
20060262103 Hu Nov 2006 A1
20060284839 Breed Dec 2006 A1
20070062753 Yoshida et al. Mar 2007 A1
20070097073 Takashima et al. May 2007 A1
20070100523 Trachte May 2007 A1
20070120830 Kaemmerer Bernhard et al. May 2007 A1
20070287494 You et al. Dec 2007 A1
20080012837 Marriott et al. Jan 2008 A1
20080062145 Shahoian Mar 2008 A1
20080079604 Madonna et al. Apr 2008 A1
20080150911 Harrison Jun 2008 A1
20080202912 Boddie et al. Aug 2008 A1
20080230283 Yoon Sep 2008 A1
20080264183 Graham et al. Oct 2008 A1
20080289887 Flint et al. Nov 2008 A1
20090001855 Lipton et al. Jan 2009 A1
20090125811 Bethurum May 2009 A1
20090140994 Tanaka Jun 2009 A1
20090140996 Takashima et al. Jun 2009 A1
20090151447 Jin et al. Jun 2009 A1
20090153340 Pinder et al. Jun 2009 A1
20090160529 Lamborghini Jun 2009 A1
20090189749 Salada et al. Jul 2009 A1
20090228791 Kim et al. Sep 2009 A1
20090241378 Ellis Oct 2009 A1
20100001974 Su et al. Jan 2010 A1
20100045612 Molne Feb 2010 A1
20100053087 Dai et al. Mar 2010 A1
20100066512 Rank Mar 2010 A1
20100141606 Bae et al. Jun 2010 A1
20100168998 Matsunaga Jul 2010 A1
20100200375 Han et al. Aug 2010 A1
20100226075 Jahge Sep 2010 A1
20100236911 Kim et al. Sep 2010 A1
20100250066 Eckstein et al. Sep 2010 A1
20100250071 Pala Sep 2010 A1
20100268426 Pathak et al. Oct 2010 A1
20100302177 Kim et al. Dec 2010 A1
20100315267 Chung et al. Dec 2010 A1
20100321310 Kim et al. Dec 2010 A1
20100321335 Lim et al. Dec 2010 A1
20110037721 Cranfill et al. Feb 2011 A1
20110046788 Daly et al. Feb 2011 A1
20110054359 Sazonov et al. Mar 2011 A1
20110069021 Hill Mar 2011 A1
20110109552 Yasutak et al. May 2011 A1
20110141052 Bernstein et al. Jun 2011 A1
20110148608 Grant Jun 2011 A1
20110175844 Berggren Jul 2011 A1
20110205081 Chen et al. Aug 2011 A1
20110210926 Pasquero et al. Sep 2011 A1
20110216015 Edwards Sep 2011 A1
20110227872 Huska et al. Sep 2011 A1
20110241850 Bosch Oct 2011 A1
20110245992 Stahlin et al. Oct 2011 A1
20110248728 Maruyama et al. Oct 2011 A1
20110255023 Doyle et al. Oct 2011 A1
20110260983 Pertuit et al. Oct 2011 A1
20110267181 Kildal Nov 2011 A1
20110279380 Weber et al. Nov 2011 A1
20110290038 Hoshino et al. Dec 2011 A1
20120013573 Liu et al. Jan 2012 A1
20120038468 Provancher Feb 2012 A1
20120039494 Ellis Feb 2012 A1
20120062491 Coni et al. Mar 2012 A1
20120105367 Son et al. May 2012 A1
20120120009 Lussey et al. May 2012 A1
20120126959 Zarrabi et al. May 2012 A1
20120127115 Gannon et al. May 2012 A1
20120169663 Kim et al. Jul 2012 A1
20120223900 Jiyama et al. Sep 2012 A1
20120229424 Behles Sep 2012 A1
20120267221 Gohng et al. Oct 2012 A1
20120267222 Gohng et al. Oct 2012 A1
20120296528 Wellhoefer et al. Nov 2012 A1
20120299856 Hasui Nov 2012 A1
20130016053 Jung et al. Jan 2013 A1
20130032002 Kuntzel Feb 2013 A1
20130063380 Wang et al. Mar 2013 A1
20130063389 Moore et al. Mar 2013 A1
20130093679 Dickinson et al. Apr 2013 A1
20130096849 Campbell et al. Apr 2013 A1
20130100016 Onodera Apr 2013 A1
20130106691 Rank May 2013 A1
20130106700 Sugiura et al. May 2013 A1
20130113715 Grant et al. May 2013 A1
20130113717 Van Eerd et al. May 2013 A1
20130122857 Karaogu et al. May 2013 A1
20130128587 Lisseman et al. May 2013 A1
20130141396 Lapoe et al. Jun 2013 A1
20130147284 Chun Jun 2013 A1
20130154938 Arthur et al. Jun 2013 A1
20130181931 Kinoshita Jul 2013 A1
20130222287 Bae et al. Aug 2013 A1
20130222310 Birnbaum et al. Aug 2013 A1
20130228023 Drasnin et al. Sep 2013 A1
20130250213 Tomomasa Sep 2013 A1
20130250502 Tossavainen et al. Sep 2013 A1
20130250613 Kamada Sep 2013 A1
20130307788 Rao et al. Nov 2013 A1
20130338847 Lisseman Dec 2013 A1
20130342337 Kiefer et al. Dec 2013 A1
20140092025 Pala Apr 2014 A1
20140114624 Buchanan et al. Apr 2014 A1
20140191973 Zellers et al. Jul 2014 A1
20140267076 Birnbaum et al. Sep 2014 A1
20140267113 Lisseman et al. Sep 2014 A1
20140267114 Lisseman et al. Sep 2014 A1
20140347176 Phan et al. Nov 2014 A1
20150009168 Olien et al. Jan 2015 A1
20150046825 Li Feb 2015 A1
20150097791 Lisseman et al. Apr 2015 A1
20150097793 Lisseman et al. Apr 2015 A1
20150097794 Lisseman et al. Apr 2015 A1
20150116205 Westerman et al. Apr 2015 A1
20150212571 Kitada et al. Jul 2015 A1
20150309576 Tissot Oct 2015 A1
20160103541 Andrews et al. Apr 2016 A1
20160109949 Park Apr 2016 A1
20160216764 Kessler et al. Jul 2016 A1
20160342229 Andrews et al. Nov 2016 A1
20170075424 Bernstein et al. Mar 2017 A1
Foreign Referenced Citations (36)
Number Date Country
1607850 Dec 2005 EP
64-66522 Mar 1989 JP
06-037056 May 1994 JP
2005-175815 Jun 2005 JP
2006-129893 May 2006 JP
200071809 Mar 2007 JP
2007-535019 Nov 2007 JP
2008-181709 Aug 2008 JP
2009-008613 Jan 2009 JP
2009-521006 May 2009 JP
2009-186452 Aug 2009 JP
2009-244931 Oct 2009 JP
2010-511916 Apr 2010 JP
2011-008775 Jan 2011 JP
20113188 Jan 2011 JP
2011-528826 Nov 2011 JP
201273785 Apr 2012 JP
2012150833 Aug 2012 JP
2012176640 Sep 2012 JP
2013513865 Apr 2013 JP
2013-89117 May 2013 JP
2013-098826 May 2013 JP
2013-105192 May 2013 JP
10-2006-0047110 May 2006 KR
100826532 May 2008 KR
10-2010-0129424 Dec 2010 KR
10-2011-0042924 Apr 2011 KR
2006123616 Nov 2006 WO
20010088935 Aug 2008 WO
2010009552 Jan 2010 WO
20110008292 Jan 2011 WO
2011045929 Apr 2011 WO
2012052635 Apr 2012 WO
2012148010 Nov 2012 WO
20130082293 Jun 2013 WO
2016096700 Jun 2016 WO
Non-Patent Literature Citations (36)
Entry
Office Action dated Nov. 4, 2014, received in connection with JP Application No. 2011-075258. (English Translation Included).
International Search Report and Written Opinion issued in related International Application No. PCT/US2014/059652 dated Dec. 22, 2014.
International Search Report and Written Opinion issued in related International Application No. PCT/US2014/059673 dated Jan. 9, 2015.
International Search Report and Written Opinion issued in related International Application No. PCT/2014/059669 dated Jan. 23, 2015.
International Search Report and Written Opinion issued in related International Application No. PCT/US2014/059657 dated Feb. 16, 2015.
International Search Report and Written Opinion issued in related International Application No. PCT/US2014/059639 dated Feb. 24, 2015.
International Search Report and Written Opinion issued in related International Application No. PCT/US2014/040224 dated Sep. 24, 2014.
International Preliminary Report on Patentability, dated Dec. 10, 2015, received in connection with International Application No. PCT/US2014/040224.
International Preliminary Report on Patentability dated Apr. 12, 2016, received in connection with International Patent Application No. PCT/US2014/059639.
International Preliminary Report on Patentability dated Apr. 12, 2016, received in connection with International Patent Application No. PCT/US2014/059652.
International Preliminary Report on Patentability dated Apr. 12, 2016, received in connection with International Patent Application No. PCT/US2014/059657.
International Preliminary Report on Patentability dated Apr. 12, 2016, received in connection with International Patent Application No. PCT/US2014/059669.
International Preliminary Report on Patentability dated Apr. 12, 2016, received in connection with International Patent Application No. PCT/US2014/059673.
International Search Report and Written Opinion for International Patent Application No. PCT/US2013/030417, dated Jun. 21, 2013.
Notice of Allowance issued in related U.S. Appl. No. 14/291,845, dated Sep. 29, 2016.
Office Action issued in related U.S. Appl. No. 14/291,845, dated Sep. 24, 2015.
Office Action issued in related U.S. Appl. No. 14/291,845, dated Feb. 24, 2016.
Office Action issued in related U.S. Appl. No. 14/291,845, dated Feb. 3, 2017.
Office Action issued in related U.S. Appl. No. 13/673,463, dated Feb. 18, 2015.
Office Action issued in related U.S. Appl. No. 13/673,463, dated Aug. 20, 2015.
Office Action issued in related U.S. Appl. No. 13/673,463, dated Jan. 21, 2016.
Office Action issued in related U.S. Appl. No. 13/673,463, dated Aug. 24, 2016.
Office Action issued in U.S. Appl. No. 14/211,475, dated Dec. 17, 2015.
Co-pending U.S. Appl. No. 13/863,363, filed Apr. 15, 2013.
Office Action issued in U.S. Appl. No. 13/863,363, dated Nov. 10, 2015.
Office Action issued in U.S. Appl. No. 13/863,363, dated Jun. 3. 2016.
Office Action issued in U.S. Appl. No. 13/863,363, dated Nov. 3, 2016.
Notice of Allowance issued in U.S. Appl. No. 13/863,363, dated Apr. 7, 2017.
Office Action issued in U.S. Appl. No. 14/211,665, dated Dec. 15, 2015.
Non-Final Office Action issued in U.S. Appl. No. 14/291,845, dated Feb. 3, 2017.
Non-Final Office Action issued in U.S. Appl. No. 14/509,598, dated Jan. 6, 2017.
Office Action issued for Japanese Application No. 2016-517039, dated Mar. 5, 2019. Machine English Translation Included.
Office Action issued for Japanese Application No. 2016-517039, dated Jun. 26, 2018. Machine English Translation Included.
Office Action issued for Chinese Application No. 201480030786, dated Feb. 26, 2018. Machine English Translation Included.
Decision of Dismissal of Amendment issued for Japanese Patent Application No. 2016-517039, dated Oct. 29, 2019.
Office Action Issued for Japanese Application No. 2016-517039 dated May 19, 2020.
Related Publications (1)
Number Date Country
20190101989 A1 Apr 2019 US
Provisional Applications (1)
Number Date Country
61829065 May 2013 US
Continuations (1)
Number Date Country
Parent 14291845 May 2014 US
Child 16119033 US