Patent Application
20080007533
The invention may best be understood by reference to the following description taken in conjunction with the accompanying drawings in which:
The user interface is believed to be one or the more important features of an electronic device since it deals directly with the user experience. It typically provides the form, feel and functionality of the device. If the user thinks the user interface is low grade, the user typically thinks the quality of the electronic device as a whole is also low grade. In contrast, if the user thinks the user interface is high grade, the user typically thinks the quality of the electronic device as a whole is also high grade. As such, designers have been making great efforts to improve the design (form, feel and functionality) of the user interface.
There exist today many styles of input devices for use in the user interface. The operations generally correspond to moving objects and making selections and entering data. By way of example, the input devices may include buttons, keys, dials, wheels, mice, trackballs, touch pads, joy sticks, touch screens and the like.
Touch devices such as touch buttons, touch pads and touch screens are becoming increasingly popular in portable electronic devices because of their ease and versatility of operation, their declining price as well as their space saving ability (e.g., planarity). Touch devices allow a user to make selections and move objects by simply moving their finger (or stylus) relative to a touch sensing surface. In general, the touch device recognizes a touch and in some circumstances the characteristics of the touch and a host controller of the portable electronic device interprets the touch data and thereafter performs action based on the touch data.
There are several types of technologies for implementing a touch device including for example resistive, capacitive, infrared, surface acoustic wave, electromagnetic, near field imaging, etc. Capacitive touch sensing devices have been found to work particularly well in portable electronic devices.
Generally speaking, whenever two electrically conductive members come close to one another without actually touching, their electric field interact to form capacitance. In the case of a capacitive touch device, as an object such as a finger approaches the touch sensing surface, a tiny capacitance forms between the object and the sensing points in close proximity to the object. By detecting changes in capacitance at each of the sensing points and noting the position of the sensing points, the sensing circuit can recognize multiple objects and determine the location, pressure, direction, speed and acceleration of the object as it is moved across the touch surface. Examples of capacitive touch devices can be found in U.S. patent application Ser. Nos. 10/722,948, 10/722,948 and 10/840,862, all of which are herein incorporated by reference.
More recently, there has been a desire to provide more unique touch devices thereby enhancing the user interface of the portable electronic device. By way of example, U.S. patent application Ser. Nos. 10/643,256 and 11/057,050 describe techniques for creating one or more buttons, switches, etc. with a movable touch device such as a touch pad or touch screen. In addition, U.S. patent application Ser. Nos. 11/394,493 and 60/755,656 describe techniques for providing visual feedback at the touch surface of the touch device such as a touch pad. Moreover, U.S. patent application Ser. Nos. 11/115,539 describes techniques for incorporating a touch device within a housing wall of a portable electronic device. All of these applications are herein incorporated by reference.
Although these new touch devices work well, there is still a desire to improve their form, feel and functionality as well as to reduce their impact on the size of a portable electronic device. It is generally believed that this can be accomplished through integration. Integration provides many benefits for electronic devices and particularly handheld electronic devices with limited space. Some of the benefits include multiple functionality from the same location and a reduced number of communication lines, both of which save space.
The present invention relates generally to I/O devices with one or more multi-functional nodes including at least a touch or proximity sensor and one or more secondary functional mechanisms integrated with the touch sensor. The secondary functional mechanisms may be used to provide one or more additional input means and/or output means to the touch sensor. The input means may for example include a switch or a sensor, etc., and the output means may for example include an illumination or visual source, an auditory source, a haptics mechanism, etc.
One embodiment of the invention pertains to a touch/proximity sensor with an integrated illumination mechanism such as an LED. The illumination mechanism can be used to provide illumination thereby giving visual feedback at the node. Some arrangements where this type of system may be used can be found in U.S. patent application Ser. Nos. 11/394,493 and 60/755,656, both of which are herein incorporated by reference.
Another embodiment of the invention pertains to a touch sensor with an integrated switching mechanism. The switching mechanism can be used to provide additional inputs at the node. Some arrangements where this type of system may be used can be found in U.S. patent application Ser. Nos. 10/643,256 and 11/057,050, both of which are herein incorporated by reference.
Yet another embodiment of the invention pertains to a touch sensor with an integrated illumination mechanism and a switching mechanism. The node therefore provides visual feedback, and switching features along with touch sensing at the same node.
Although the touch sensors may be widely varied, in most embodiments, the touch sensor mentioned above corresponds to a capacitive sensing electrode.
These and other embodiments of the invention are discussed below with reference to
As the name implies, the multifunctional node 10 is capable of performing more than one function. For example, in addition to touch sensing (or near touch sensing), the node 10 may provide additional input functionality and/or output functionality. For example, besides touch sensing, the node may include additional sensing functionality, switch functionality, feedback functionality, etc.
As shown, the multifunctional node 10 includes a touch/proximity sensor 12 and one or more I/O mechanisms 14 that are integrated with the touch sensor 12. Integration is the process of merging or joining different devices so that multiple devices become one (incorporating disparate parts into a single defined unit). As a result of integration, the number of I/O contacts for each node 10 can be reduced. The touch sensor 12 enables touch sensing at the node 10 while the one or more I/O mechanisms 14 enable input and/or output functionality at the node 10. By way of example, and not by way of limitation, the touch sensor 12 may be an electrode of a capacitive sensing touch device. Further, the I/O mechanism(s) 14 may be selected from an illumination or visual source, an auditory source, a switch, a sensor, a haptics mechanism and/or the like.
Both the touch sensor 12 and the integrated I/O mechanisms 14 communicate with a controller 16 via the same communication channel 18. That is, they use the same communication lines for operation thereof (e.g., they share communication lines). Any number of shared lines may be used. The shared communication lines may be embodied as traces or other well-known routing technologies such as those associated with printed circuit boards, flex circuits and integrated chips. Furthermore, the controller 16 may be embodied as an application specific integrated circuit chip or it may represent a portion of a host controller.
As shown, the controller 16 includes a set of configurable I/O pins 20 for each multifunctional node 10 of the touch device 8. The number of pins typically corresponds to the number of shared communication lines (e.g., a pin for each line). Because they are configurable, the I/O pins 20 can be rearranged for operations associated with the touch sensor 12 or the I/O mechanism(s) 14 of the node 10. By way of example, the I/O pins functionality may be switched between ground, a voltage source, various digital inputs, sensing inputs, detection inputs, driving outputs, etc.
The controller 16 also includes a sense module 22 and an I/O module 24. The sense module 22 performs sensing operations associated with the touch sensor 12. By way of example, the sense module 22 may monitor touch data generated at each node 10. In the case of a capacitive electrode, the sense module 22 may for example include capacitive sensing circuitry that monitors changes in capacitance at each node 10. The I/O module 24, on the other hand, performs I/O operations associated with the I/O mechanism(s). By way of example, the I/O module 24 may monitor the state of an input mechanism (e.g., switch), and/or provide signals for driving an output mechanism (e.g., light source).
The controller 16 further includes a control module 26 that is operatively coupled to all the various components. During operation, the control module 26 selectively switches the operation between the sense and each of the I/O operations, and also reconfigures the functionality of the I/O pins 20 based on the mode of operation (I/O pins 20 are arranged according to which operation is being performed). In a touch sensing mode, the I/O contacts 20 are configured for monitoring the touch sensor 12 to determine if a touch has taken place at the node 10. In input mode, the I/O contacts 20 are configured for monitoring the input mechanism 14 to determine if an input has been made at the node 10. In the output mode, the I/O contacts 20 are configured to drive the output on the output mechanism 14 at the node 10.
In one embodiment, the control module 26 uses time multiplexing when switching between operations. Time multiplexing is the technique of operating several devices at one node or through the same communication channel by sequentially switching the control of the devices using a time interval delay. Although delayed, time multiplexing allows almost simultaneous transmission of multiple signals over a single channel. In most cases, the delay is so fast it cannot be seen by the user.
By way of example, the control module 26 may activate the sense module 22, and arrange the I/O pins 20 for touch sensing while deactivating the I/O module 24 in order to perform sense operations, and may activate the I/O module 24 and arrange the I/O pins 20 for I/O operations while deactivating the sense module 22 in order to perform I/O operations. This is repeated or cycled back and forth in order to perform each operation in an effective manner.
As mentioned above, the I/O mechanism(s) can be widely varied. Several examples will now be described. In one embodiment, the I/O mechanism is one or more switches. Examples of switches include dome switches, momentary switches, and the like. In another embodiment, the I/O mechanism is one or more separate sensors that are distinct from the touch sensor. Examples of sensors include touch, image, biometric, temperature, microphone, optical proximity detectors and the like. In another embodiment, the I/O mechanism is one or more light sources. Examples of light sources include LEDs, OLEDs, electroluminescent (EL), CCFL (cold second connection point fluorescent lamp), LCD (liquid crystal display and the like. In another embodiment, the I/O mechanism is a speaker. In another embodiment, the I/O mechanism is a vibrator or click mechanism. In another embodiment, the IO mechanism is a resistive heating element.
It should also be noted that various combinations of I/O mechanism can be used. Several examples will now be described. In one embodiment, the I/O mechanism includes one or more switches and one or more sensors. In another embodiment, the I/O mechanism includes one or more switches and one or more light sources. In another embodiment, the I/O mechanism includes one or more sensors and one or more light sources. In another embodiment, the I/O mechanism includes one or more switches and one or more speakers. In another embodiment, the I/O mechanism includes one or more sensors and one or more speakers. In another embodiment, the I/O mechanism includes one or more switches and one or more vibrators. In another embodiment, the I/O mechanism includes one or more sensors and one or more vibrators.
It should also be noted that more than two distinct I/O mechanism can be used. For example, a single node may include a switch, sensor, light source, or switch, light source, vibrator. In a nut shell, any combination of these elements can be created to generate the desired node.
The method 50 also includes block 54 where a touch sensing (or proximity sensing) operation is performed at the node via the shared communication channel and touch sensor. By way of example, in the case of capacitive touch or proximity sensing, the electrode may be charged and the capacitance at the charged electrode monitored.
The method 50 also includes block 56 where an I/O operation is performed at the node via the shared communication channel and the I/O mechanism. By way of example, in case of a light source, the light source may be charged or in the case of a switch, the electrical loop may be monitored for open or closed state.
The method 50 also includes block 58 where the touch sensing and I/O operations are selectively switched back and forth via time multiplexing so that touch sensing and I/O can take place at the same node over the same communication channel. By way of example, this may include reconfiguring the functionality of the I/O contacts operatively coupled to the shared communication channel, and then performing the desired operations. By way of example, touch sensing may be activated at T1 for a predetermined amount of time while deactivating I/O operations during that time, and thereafter the I/O mechanism may be activated at T2 for a predetermined amount of time while deactivating sensing operations during that time. These steps are then continuously repeated (e.g., T3=touch sensing, T4=I/O operations, and so on).
In the illustrated embodiment, the multifunctional I/O node 102 includes a capacitive sensing electrode 106 for detecting capacitive changes at the multifunctional I/O node 102. The capacitive changes can be used to determine touches or near touches (e.g., proximity) around the multifunctional I/O node 102. The electrode 106 may for example operate under the principal of self capacitance. In self capacitance, the electrode 106 is charged by a voltage source 108, and when an object such as a finger comes in close proximity to the electrode 106, the object steals charge thereby affecting the capacitance at the multifunctional I/O node 102. The capacitance at the multifunctional I/O node 102 is monitored by a capacitive sensing circuit 110 of the controller.
The electrode 106 may be formed from almost any shape and size. For example they may be formed as squares, rectangles, circles, semi-circles, ovals, triangles, trapezoids, other polygons and or more complicated shapes such as wedges, crescents, stars, lightning bolts, etc. The size may be smaller than a finger tip, larger than a finger tip, or just about the size of a finger tip. The size and shape generally depends on the desired needs of the I/O device.
The multifunctional I/O node 102 also includes a secondary I/O mechanism 112 that is integrated with the capacitive sensing electrode 106. That is, the electrode and I/O mechanism are incorporated into a single defined node. The I/O mechanism 112 can be an input mechanism such as a switch or a sensor, etc. and/or an output mechanism such as light source, display, auditory source, haptics mechanism, etc. During operation, the I/O mechanism 112 is driven by an I/O circuit 111, which is part of the controller 104.
The position of the second I/O mechanism 112 relative to the electrode 106 may be widely varied. It is generally preferred to place the I/O mechanism 112 in close proximity and more particularly entirely within the confines of the electrode 106 in order to save space as well as to provide multiple functions at the same location (overlaid functionality). For example, the I/O mechanism 112 may be placed completely within the edges of the electrode 106 (as shown in
To elaborate on integration, the I/O mechanism 112 generally includes a first connection point 114 (or contact, terminal, pad, etc.) and a second connection point 116 (or contact, terminal, pad, etc.). The first connection point 114 is electrically coupled to the electrode 106 while the second connection point 116 is electrically isolated from the electrode 106. Furthermore, a first communication line 120 is electrically coupled to the electrode 106 and a second communication line 122 is electrically isolated from the electrode 106 (and the other communication line) and electrically coupled to the second connection point 116 of the I/O mechanism 112. For example, the second connection point 116/second communication line 122 may be positioned in an open area found within the electrode (as shown in
The first communication line 120 is also connected to a first adjustable I/O 130 contact of the controller 104, and the second communication line 122 is connected to a second adjustable I/O contact 132 of the controller 104. The I/O contacts 130 and 132 can be adjusted between ground, voltage, digital inputs, sense circuit blocks, or other activation block such as amps, etc. depending on whether the node is being used for capacitive sensing or I/O operations. Any type of source, sense, block may be used.
As mentioned above the I/O mechanism can be widely varied. In accordance with one particular embodiment, the I/O mechanism is a switch such as a dome switch or momentary switch. For example, the switch may be connected via its terminals (connection points). By integrating a switch with an electrode, a separate switch circuit is avoided as well as saving space within an electronic device. In accordance with another embodiment, the I/O mechanism is a light source such as an LED. For example, the LED may be connected via its anode and cathode (connection points). By integrating an LED with an electrode, the need to cut a large hole in the electrode in order to provide illumination to the node, and having the LED on a separate circuit is avoided. As should be appreciated, in some cases, in order to illuminate a node, a hole is cut in the electrode and an LED, which is operated on a separate circuit is placed behind the hole. This is believed to degrade the ability to sense capacitively at the LED region. The step of integrating the LED and/or switch with the electrode as disclosed herein avoids this by allowing a smaller total solution that enables capacitive sensing in the same region as the LED and using the same circuit.
It should be appreciated, that the present invention is not limited to switches and LEDs and that other I/O mechanism can be used.
Generally speaking, and not by way of limitation, the capacitance sensing function may operate on both 132 and 130 together, or common mode. For example, force modulating voltage waveforms on both contacts, and measure current on both contacts, in order to detect capacitance. This common mode arrangement allows touch sensing capacitance to be detected for not only between the user and the electrode region, but also for the touch sensing capacitance between the user and the I/O element 112. In this way, the effective area of the touch sensing electrode may be extended to include the I/O element. The I/O function may operate on 132 and 130 using differential mode, as for example driving a voltage or current from 132 to 130 (or vice-versa), or sensing a voltage or current from 132 to 130. This allows differentiation between the capacitance sensing, which is done common mode, and driving or sensing the I/O element, which is done differentially.
In some cases, a capacitor 140 may be electrically positioned between the first and second communication lines 120 and 122 to increase the total electrode area. That is, the addition of the capacitor causes the I/O mechanism to be included in the total electrode area thereby improving the electrode's capacitive sensing. A resistor may be further employed when the I/O mechanism is embodied as a light source such as an LED. The resistor limits DC current to flow at a specific value. In one example, the capacitor is a 20 pF capacitor, and the resistor is a 10 K-ohm resistor. If the I/O mechanism is a switch, the resistor may be replaced with a 0 ohm jumper or just a circuit trace.
An alternative to the external capacitor and resistor is for the capacitive sensing mode, connecting 130 and 132 together internally with a switch, and then connecting both of these to the capacitive sensing circuit (on-IC chip), and for the LED light mode, connecting 130 to ground and connecting 132 to a current source (on-chip). In the later, the function of 130 and 132 may be reversed depending on the polarity the LED is inserted.
In order to perform sensing and I/O operations using the same communication lines, the controller uses time multiplexing to switch between sensing and the I/O operations. In one embodiment, during sensing operations, the first I/O contact is modulated and used for capacitive sensing and the second I/O contact is set to high impedance. Further, during I/O operations when the I/O mechanism is an LED, the first I/O contact is set to output high and the second I/O contact is set as output low. Further still, during I/O operations when the I/O mechanism is a switch, the first I/O contact is set for output low and the second I/O contact is set as a weak pull up resistor internal to the IC, and after waiting a short amount of time (for example, if internal pull up is 100K then with external capacitance of 20 pF time constant is 2 μs, so wait 10 μs for five time constants) then sample the digital state at the second I/O contact. If it is a logic high then the switch is open. If it is a logic low then the switch is closed.
Referring to
The position of the I/O mechanism(s) 112 relative to the electrode 106 may be widely varied. As shown in
The I/O mechanism may come in a variety of forms including mechanical structures, integrated circuit chips, surface mount devices, and the like. Furthermore, they can be connected using a variety of techniques. One example are separate solder pads disposed at the first connection point and second connection point.
In some cases, the various layers may further be embodied as transparent or semi transparent materials. For example, the conductive material of the electrodes may be formed from indium tin oxide (ITO), the dielectric material of the cover film may be formed as clear or partially transparent plastic or glass, and the substrate may be formed as clear or partially transparent plastic or glass (e.g., clear Mylar sheet). This may be done to allow visual feedback through the various layers of the I/O device. For example, in cases where the I/O mechanism is a display or light source
In one implementation, the electrodes are placed on one side of a printed circuit board (PCB), and the controller in the form a an integrated circuit chip is mounted on the back side of the PCB, with conventional PCB routing connecting the I/O contacts of the electrodes and I/O mechanism to the I/O contacts of the IC chip. The IC chip may for example be an ASIC. In another implementation, the electrodes are placed on one side of a printed circuit board (PCB) and the I/O contacts are coupled to the I/O contacts of a floating IC via a flex circuit with printed traces. For example, the PCB containing the electrodes is connected to one end of a flex circuit and the sensor IC is attached to the other end of the flex circuit. Alternatively, the electrodes may be applied directly to the flexible member of the flex circuit.
An alternate embodiment of 240 that goes along with no off chip resistors or capacitors is connect first and second line to each other using an on-chip switch, and then connecting both of them to capacitive sensing measurement circuit.
Although the invention has been primarily described as having one I/O mechanism, it should be appreciated that this is not a limitation. In some cases, it may be desirable to include multiple I/O mechanism at the same node thereby providing even more functionality from the same location while also limiting the number of communication lines.
The combination of the I/O mechanisms 112 may be widely varied. For example, the combination may include a pair of input mechanisms, a pair of output mechanisms, or an input mechanism and an output mechanism. The input and output mechanism can be selected from any of those previously described. In one particular embodiment, the first I/O mechanism is a switch for providing additional inputs at the node and the second I/O mechanism is a light source for providing visual feedback at the node.
In order to perform sensing and I/O operations using the same communication lines, the controller uses time multiplexing to switch between sensing and the multiple I/O operations. Each step can be accomplished as mentioned above.
In any of the previously described embodiments, the nodes may be positioned in a conventional 2D array of rows and columns or alternatively they may be positioned in a non 2D array thereby allowing a wide variety of user interfaces to be created. In fact, non 2D arrays may be beneficial in creating user interfaces that better fit portable electronic devices. For example, different orientations of nodes may be used to provide input functionality that is directed at the specific applications of the portable electronic device. The user interfaces may for example include scrolling regions or parameter control regions where nodes are set up in succession along a prescribed path, and/or button regions where individual nodes may represent distinct button functions. With regards to a scrolling or parameter control, the nodes may be placed in an open loop arrangement such as a line, or they may be placed in closed loop arrangement such as a circle. Generally speaking, the nodes can be placed to form any shape whether in a single plane or multiple planes. Examples include squares, rectangles, circles, semi-circles, ovals, triangles, trapezoids, other polygons, pill shapes, S shapes, U shapes, L shapes, star shapes, plus shape, etc.
Any number of nodes in any combination may be used. In one embodiment, only multifunctional nodes are used. In another embodiment, multifunctional nodes are mixed with conventional nodes. For example, capacitive sensing electrodes with integrated I/O mechanisms can be solely or in combination with standard non integrated capacitive sensing electrodes. The number of nodes is typically determined by the size of the touch device as well as the size of the electrodes and 24 used at the nodes. In many cases, it is desirable to increase the number of nodes so as to provide higher resolution (e.g., more information can be used for such things as acceleration). However, as the number increases, so does the number of I/Os. Therefore a careful balance between resolution and number of I/Os needs to be made when designing the touch device.
As shown, each node includes an electrode 106. The multifunctional node additionally includes one or more I/O mechanisms 112 integrated therewith while the single functional node does not include any integrated I/O mechanisms. The multifunctional nodes 352 communicates with the controller 104 over a pair of shared communication lines 120 and 122 (see for example
In one implementation, the multifunctional nodes 402A may only include an integrated LED. This arrangement may be configured to perform like the touch devices described in U.S. patent application Ser. Nos. 11/394,493 and 60/755,656.
In another implementation, the multifunctional nodes 402A may only include an integrated switch in order to provide additional inputs. This arrangement may be configured to perform like the touch devices described in U.S. patent application Ser. Nos. 10/643,256 and 11/057,050.
In another implementation, the multifunctional nodes 402A may include both an integrated switch and LED. By way of example, the LED may be used illuminate symbols associated with the functionality of the integrated switch.
In one implementation, the multifunctional nodes 402A may only include an integrated LED in order to illuminate symbols. The symbols may be used to indicate a function associated with that node or region of the touch device 400B. This arrangement may work particularly well with the mechanical switch/touch pad described in U.S. patent application Ser. Nos. 10/643,256. For example, the symbols may be used to indicate functionality associated with physical switches housed underneath and engaged by a movable touch pad (e.g., tilting). In the case of a music player for example the symbols and physical switches may correspond to menu, play/pause, forward, and reverse.
In another implementation, the multifunctional nodes 402A may only include an integrated switch in order to provide additional inputs. The switches may be used in addition to or in place of the physical switches described in U.S. patent application Ser. Nos. 10/643,256.
in another implementation, the multifunctional nodes 402A may include both an integrated switch and LED. The LED is used illuminate symbols associated with the functionality of the integrated switch.
It should be noted that the circular arrangements describe in
It should also be appreciated that the invention is not limited to circular arrangements, and that other arrangements can be used.
In most cases, the processor 556 together with an operating system operates to execute computer code and produce and use data. The operating system may correspond to well known operating systems such as OSX, DOS, Unix, Linux, and Palm OS, or alternatively to special purpose operating system, such as those used for limited purpose appliance-type devices (e.g., media players). The operating system, other computer code and data may reside within a memory block 558 that is operatively coupled to the processor 556. Memory block 558 generally provides a place to store computer code and data that are used by the electronic device 550. By way of example, the memory block 558 may include Read-Only Memory (ROM), Random-Access Memory (RAM), hard disk drive, flash memory and/or the like.
The electronic device 550 also includes a display 568 that is operatively coupled to the processor 556. The display 568 is generally configured to display a graphical user interface (GUI) that provides an easy to use interface between a user of the electronic device 550 and the operating system or application running thereon. The display 568 may for example be a liquid crystal display (LCD).
The electronic device 550 also includes one or more touch sensing devices 580 that utilize the multifunctional technology described herein. The one or more touch sensing devices are operatively coupled to the processor 556. The touch sensing devices 580 are configured to transfer data from the outside world into the electronic device 550. The touch sensing device 580 may for example be used to perform movements such as scrolling and to make selections with respect to the GUI on the display 568. The touch sensing device 580 may also be used to issue commands in the electronic device 550. The touch sensing devices may be selected from fixed and/or movable touch pads, touch screens and/or touch sensitive housings.
The touch sensing device 580 recognizes touches, as well as the position and magnitude of touches on a touch sensitive surface. The touch sensing device 580 reports the touches to the processor 556 and the processor 556 interprets the touches in accordance with its programming. For example, the processor 556 may initiate a task in accordance with a particular touch. Alternatively, a dedicated processor can be used to process touches locally at the touch sensing device and reduce demand for the main processor of the electronic device.
Because of the multifunctional nature of the touch sensing devices, the touch sensing device provides additional inputs and/or outputs. In the case of input, and more particularly switches, the touch sensing device reports that state of one or more switches integrated with the touch sensing device and the processor 556 interprets the touches in accordance with its programming. For example, the processor 556 may initiate a task in accordance with a particular state. In the case of an output, and more particularly a light source such as an LED, the touch sensing device may illuminate one or more regions thereof in accordance with instructions provided by the processor 556. For example, the processor may generate symbols over key nodes or provide feedback at the location of a touch.
In one particular embodiment of the present invention, the electronic devices described above correspond to hand-held electronic devices with small form factors. As used herein, the term “hand held” means that the electronic device is typically operated while being held in a hand and thus the device is sized and dimension for such use. Examples of hand held devices include PDAs, Cellular Phones, Media players (e.g., music players, video players, game players), Cameras, GPS receivers, Remote Controls, and the like.
As should be appreciated, the touch sensing device can reduce the number of input devices needed to support the device and in many cases completely eliminate input devices other than the touch sensing devices. The device is therefore more aesthetically pleasing (e.g., planar smooth surfaces with limited to no breaks gaps or lines), and in many cases can be made smaller without sacrificing screen size and input functionality, which is very beneficial for hand held electronic device especially those hand held electronic device that are operated using one hand (some hand held electronic device require two handed operation while others do not).
The touch sensing devices of the present invention are a perfect fit for small form factor devices such as hand held devices, which have limited space available for input interfaces, and which require adaptable placement of input interfaces to permit operation while being carried around. This is especially true when you consider that the functionality of handheld devices have begun to merge into a single hand held device. At some point, there is not enough real estate on the device for housing all the necessary buttons and switches without decreasing the size of the display or increasing the size of the device, both of which leave a negative impression on the user. In fact, increasing the size of the device may lead to devices, which are no longer considered “hand-held.”
In one particular implementation, the hand held device is a music player and the touch sensing devices are configured to generate control signals associated with a music player. For example, the touch sensing device may include list scrolling functionality, volume control functionality and button functionality including, Select, Play/Pause, Next, Previous and Menu.
In another particular implementation, the hand held device is a cell phone and the touch sensing devices are configured to generate control signals associated with a cell phone. For example, the touch sensing device may include number listing functionality.
In some cases, the handheld device may be a multifunctional handheld device as described in U.S. Patent Application No. 60/658,777, which is herein incorporated by reference.
Media players generally have connection capabilities that allow a user to upload and download data to and from a host device such as a general purpose computer (e.g., desktop computer, portable computer). For example, in the case of a camera, photo images may be downloaded to the general purpose computer for further processing (e.g., printing). With regards to music players, songs and play lists stored on the general purpose computer may be downloaded into the music player. In the illustrated embodiment, the media player 400 is a pocket sized hand held MP3 music player that allows a user to store a large collection of music. By way of example, the MP3 music player may correspond to any of those iPod music players manufactured by Apple Computer of Cupertino, Calif. (e.g., standard, mini, iShuffle, Nano, etc.).
As shown in
The media player 600 also includes a display screen 604. The display screen 404 is used to display a graphical user interface as well as other information to the user (e.g., text, objects, graphics). By way of example, the display screen 604 may be a liquid crystal display (LCD). As shown, the display screen 604 is visible to a user of the media player 600 through an opening 605 in the housing 602, and through a transparent wall 606 that is disposed in front of the opening 605. Although transparent, the transparent wall 606 may be considered part of the housing 602 since it helps to define the shape or form of the media player 600.
The media player 600 also includes a touch pad 610. The touch pad 610 is configured to provide one or more control functions for controlling various applications associated with the media player 600. For example, the touch initiated control function may be used to move an object or perform an action on the display screen 604 or to make selections or issue commands associated with operating the media player 600. In most cases, the touch pad 610 is arranged to receive input from a finger moving across the surface of the touch pad 610 in order to implement the touch initiated control function.
The manner in which the touch pad 610 receives input may be widely varied. In one embodiment, the touch pad 610 is configured receive input from a linear finger motion. In another embodiment, the touch pad 610 is configured receive input from a rotary or swirling finger motion. In yet another embodiment, the touch pad 610 is configured receive input from a radial finger motion. Additionally or alternatively, the touch pad 610 may be arranged to receive input from a finger tapping on the touch pad 600. By way of example, the tapping finger may initiate a control function for playing a song, opening a menu and the like.
In one embodiment, the control function corresponds to a scrolling feature. For example, in the case of an MP3 player, the moving finger may initiate a control function for scrolling through a song menu displayed on the display screen 604. The term “scrolling” as used herein generally pertains to moving displayed data or images (e.g., text or graphics) across a viewing area on a display screen 604 so that a new set of data (e.g., line of text or graphics) is brought into view in the viewing area. In most cases, once the viewing area is full, each new set of data appears at the edge of the viewing area and all other sets of data move over one position. That is, the new set of data appears for each set of data that moves out of the viewing area. In essence, the scrolling function allows a user to view consecutive sets of data currently outside of the viewing area. The viewing area may be the entire viewing area of the display screen 104 or it may only be a portion of the display screen 604 (e.g., a window frame).
The direction of scrolling may be widely varied. For example, scrolling may be implemented vertically (up or down) or horizontally (left or right). In the case of vertical scrolling, when a user scrolls down, each new set of data appears at the bottom of the viewing area and all other sets of data move up one position. If the viewing area is full, the top set of data moves out of the viewing area. Similarly, when a user scrolls up, each new set of data appears at the top of the viewing area and all other sets of data move down one position. If the viewing area is full, the bottom set of data moves out of the viewing area. In one implementation, the scrolling feature may be used to move a Graphical User Interface (GUI) vertically (up and down), or horizontally (left and right) in order to bring more data into view on a display screen. By way of example, in the case of an MP3 player, the scrolling feature may be used to help browse through songs stored in the MP3 player. The direction that the finger moves may be arranged to control the direction of scrolling. For example, the touch pad may be arranged to move the GUI vertically up when the finger is moved in a first direction and vertically down when the finger is moved in a second direction
To elaborate, the display screen 604, during operation, may display a list of media items (e.g., songs). A user of the media player 600 is able to linearly scroll through the list of media items by moving his or her finger across the touch pad 610. As the finger moves around the touch pad 610, the displayed items from the list of media items are varied such that the user is able to effectively scroll through the list of media items. However, since the list of media items can be rather lengthy, the invention provides the ability for the user to rapidly traverse (or scroll) through the list of media items. In effect, the user is able to accelerate their traversal of the list of media items by moving his or her finger at greater speeds.
In one embodiment, the media player 600 via the touch pad 610 is configured to transform a swirling or whirling motion of a finger into translational or linear motion, as in scrolling, on the display screen 604. In this embodiment, the touch pad 610 is configured to determine the angular location, direction, speed and acceleration of the finger when the finger is moved across the top planar surface of the touch pad 610 in a rotating manner, and to transform this information into signals that initiate linear scrolling on the display screen 604. In another embodiment, the media player 600 via the touch pad 610 is configured to transform radial motion of a finger into translational or linear motion, as in scrolling, on the display screen 604. In this embodiment, the touch pad 610 is configured to determine the radial location, direction, speed and acceleration of the finger when the finger is moved across the top planar surface of the touch pad 610 in a radial manner, and to transform this information into signals that initiate linear scrolling on the display screen 604. In another embodiment, the media player 600 via the touch pad 610 is configured to transform both angular and radial motion of a finger into translational or linear motion, as in scrolling, on the display screen 604.
The touch pad generally consists of a touchable outer surface 611 for receiving a finger for manipulation on the touch pad 610. Although not shown in
The position of the touch pad 610 relative to the housing 602 may be widely varied. For example, the touch pad 610 may be placed at any external surface (e.g., top, side, front, or back) of the housing 602 that is accessible to a user during manipulation of the media player 600. In most cases, the touch sensitive surface 611 of the touch pad 610 is completely exposed to the user. In the illustrated embodiment, the touch pad 610 is located in a lower, front area of the housing 602. Furthermore, the touch pad 610 may be recessed below, level with, or extend above the surface of the housing 602. In the illustrated embodiment, the touch sensitive surface 611 of the touch pad 610 is substantially flush with the external surface of the housing 602.
The shape of the touch pad 610 may also be widely varied. For example, the touch pad 610 may be circular, rectangular, triangular, and the like. In general, the outer perimeter of the shaped touch pad defines the working boundary of the touch pad. In the illustrated embodiment, the touch pad 610 is circular. Circular touch pads allow a user to continuously swirl a finger in a free manner, i.e., the finger can be rotated through 360 degrees of rotation without stopping. Furthermore, the user can rotate his or her finger tangentially from all sides thus giving it more range of finger positions. For example, when the media player is being held, a left handed user may choose to use one portion of the touch pad 610 while a right handed user may choose to use another portion of the touch pad 610. More particularly, the touch pad is annular, i.e., shaped like or forming a ring. When annular, the inner and outer perimeter of the shaped touch pad defines the working boundary of the touch pad.
In addition to above, the media player 600 may also include one or more buttons 612. The buttons 612 are configured to provide one or more dedicated control functions for making selections or issuing commands associated with operating the media player 600. By way of example, in the case of an MP3 music player, the button functions may be associated with opening a menu, playing a song, fast forwarding a song, seeking through a menu and the like. The button functions are implemented via a mechanical clicking action or alternatively via a sensor arrangement such as those described herein. The position of the buttons 612 relative to the touch pad 610 may be widely varied. For example, they may be adjacent one another or spaced apart. In the illustrated embodiment, the buttons 612 are separated from the touch pad 610. As shown, there are four buttons 612A in a side by side relationship above the touch pad 610 and one button 612B disposed in the center or middle of the touch pad 610. By way of example, the plurality of buttons 612 may consist of a menu button, play/stop button, forward seek button and a reverse seek button, select button (enter) and the like. Alternatively or additionally, the buttons may be implemented with a movable touch pad.
Moreover, the media player 600 may also include a hold switch 614, a headphone jack 616 and a data port 618. The hold switch 614 is configured to turn the input devices of the media device 600 on and off. The headphone jack 616 is capable of receiving a headphone connector associated with headphones configured for listening to sound being outputted by the media device 600. The data port 618 is capable of receiving a data connector/cable assembly configured for transmitting and receiving data to and from a host device such as a general purpose computer. By way of example, the data port 618 may be used to upload or down load songs to and from the media device 600. The data port 618 may be widely varied. For example, the data port may be a PS/2 port, a serial port, a parallel port, a USB port, a Firewire port and the like. In some cases, the data port 618 may be a radio frequency (RF) link or optical infrared (IR) link to eliminate the need for a cable. Although not shown in
In the embodiment of
If used, this visual feedback feature allows the display of pop-up buttons, characters, and indicators around the touch surface, which can disappear when not in use or required, or glowing special effects that trace or outline a users fingers in contact with the touch surface, or otherwise provide visual feedback for the users of the device. In one implementation, the handheld device is configured to sense one or more touches and provide visual feedback in the area of the touches. In another implementation, the handheld device is configured to provide visual feedback on the touch surface, detect a touch in the area of the visual feedback, and to perform an action that is associated with the visual feedback. An example of such an arrangement can be found in U.S. patent application Ser. No. ______, which is herein incorporated by reference 406 and 455.
Additionally or alternatively, the touch device may be configured to provide to provide additional inputs when particular regions of the touch pad are pressed. This may be accomplished with integrated switches that are capable of adjusting the visual stimuli of the touch surface.
While this invention has been described in terms of several preferred embodiments, there are alterations, permutations, and equivalents, which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and apparatuses of the present invention. t is therefore intended that the following appended claims be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.
This application is related to the following applications, all of which are herein incorporated by reference: U.S. patent application Ser. No. 10/188,182, titled “TOUCH PAD FOR HANDHELD DEVICE”, filed Jul. 1, 2002; U.S. patent application Ser. No. 10/722,948, titled “TOUCH PAD FOR HANDHELD DEVICE”, filed Nov. 25, 2003; U.S. patent application Ser. No. 10/643,256, titled “MOVABLE TOUCH PAD WITH ADDED FUNCTIONALITY”, filed Aug. 18, 2003; U.S. patent application Ser. No. 10/840,862, titled “MULTIPOINT TOUCHSCREEN”, filed May 6, 2004; U.S. patent application Ser. No. 11/057,050, titled “DISPLAY ACTUATOR”, filed Feb. 11, 2005; U.S. patent application Ser. No. 11/115,539, titled “HAND HELD ELECTRONIC DEVICE WITH MULTIPLE TOUCH SENSING DEVICES”, filed Apr. 26, 2005, U.S. patent application Ser. No. 11/394,493, titled “ILLUMINATED TOUCHPAD”, filed Mar. 31, 2006, and U.S. Patent Application No. 60/755,656, titled “TOUCH PAD WITH FEEDBACK”, filed Dec. 30, 2005.
