1. Field of the Invention
The invention is in the general area of touchpads and touch sensors for handheld computerized devices.
2. Description of the Related Art
Handheld computerized devices (i.e. handheld devices equipped with microprocessors and bit-mapped displays, often touch sensitive displays) such as cell phones, personal digital assistants (PDA), game devices, tablet PCs (such as iPad), etc., are playing a more and more important role in everyday life, and are becoming more and more indispensible. With the advance of technology, and improvements in the handheld computerized devices' processing power, both function, and memory space is increasing at an amazing pace. Meanwhile the size of the handheld computerized devices continues to get smaller and smaller.
To meet this challenge, the designers of handheld computerized devices typically use two approaches. One approach is to make the keyboard keys smaller and smaller, miniaturizing the keys. Additionally the keyboard keys may be given multiple functions—i.e. overloaded, and more complex function keyboard keys may be introduced as well.
The other approach is to make the display a touch sensitive display, and use touch screen keyboards, or so called “soft keys”. Here a user may use a stylus pen or finger to select the soft keys through a graphical user interface. Due to the optical illusions introduced by the display screen, however, the soft keys cannot be too small, because otherwise a single finger press will activate multiple keys. As a result, the designer may have to divide the keys into different groups and hierarchies, and only display a small number of keys on the screen.
Both current approaches have some severe drawbacks: the user input area can occupy a significant portion of the front panel, and the user input process, although requiring a large amount of user attention to operate, still is very error prone.
Often a user has to use one hand to hold the handheld computerized device, and use the other hand to input data, thus occupying both hands. A user will often have to go through a long sequence of key strokes, and switch back and forth among different user interface screens, in order to complete a fairly simple input. As a result, there is a significant learning curve for a user to learn the overloaded keys, function keys, key grouping, and key hierarchies in order to operate the handheld computerized devices efficiently.
To simplify the user interface, various alternative methods employing touch sensors, touchpads, touch screens and the like (also called touch sensitive input devices and trackpads) have been proposed.
Yoon et. al., in U.S. patent application Ser. No. 12/691,892, proposed a mobile terminal having a dual touch screen and method of controlling content therein. This patent application disclosed a handheld computerized device with two built-in touch sensors, one located on the device's front touch screen, and a second touchpad sensor located on the rear of the device.
Cholewin et. al. in U.S. patent application Ser. No. 12/505,755, as well as Gorsica et. al. in U.S. patent application Ser. No. 12/492,369, proposed various types of portable handheld computerized devices with either opposing built-in touch sensitive surfaces, or alternatively constructing handheld computerized devices with the touchpad on the rear surface.
Luo, in U.S. provisional patent application 61/327,102, and U.S. non-provisional patent application Ser. No. 12/773,075, both of which are incorporated herein by reference, introduced a method that utilized a back mounted touchpad. This method took touch input data from this back mounted touchpad, and used software models of the hand to in turn generate a virtual image of the most likely user rear hand position, often superimposed upon a virtual keyboard layout. The net effect was to attempt to make the handheld computerized device “transparent”, thus allowing the user to visualize the most likely position of his hands and fingers that were otherwise hidden because they were behind the device. Thus the method allowed the user to use a touchpad keypad on the back of the device to input keystrokes and mouse actions, and this touchpad data was reflected on the display screen on the front of the handheld computerized device as “virtual fingers” or equivalent.
The invention is based, in part, on the insight that the vast majority of handheld computerized devices do not incorporate touchpads on the back side of the device, and further on the insight that due to competitive cost pressures on the handheld computerized device industry, back side mounted touchpads are not likely to become a standard feature of such handheld computerized devices.
The invention is also based, in part, on the insight that the functionality of many popular handheld computerized devices can be extended by way of various types of software, either by running various software applications programs (apps) on top of the computerized device's basic operating system, or by modifying the operating system software itself. Further, many such popular handheld computerized devices have various data input mechanisms—input ports, short range wireless transceivers (e.g. Bluetooth™ transceivers), audio input/output jacks, and the like by which peripherals may be added to the handheld computerized device, thereby extending its functionality.
The invention is also based, in part, on the insight that it would be desirable to produce a touchpad peripheral configured to reversibly attach to the back surface of a handheld computerized device. Such a detachable back mounted touchpad could, in conjunction with appropriate applications software or appropriate modifications to the underlying operating system software, function to improve the user interface of the handheld computerized device in many ways. In some embodiments, the invention's back mounted touchpad peripheral could be used to bring the dual front-and back touching user interface concepts of Yoon to a handheld computerized device that otherwise would not be capable of implementing such a user interface. In other embodiments, the invention's back mounted touchpad peripheral could be used to bring the virtual fingers concepts of Luo to handheld computerized devices not otherwise capable of implementing such a user interface, and so on.
Thus in one embodiment, the invention may be a detachable touchpad device configured to reversibly attach to the back side of a handheld computerized device. Generally this handheld computerized device, which may be a smart phone, tablet computer, and the like will comprise at least a front side with a display screen, a back side without any touch input sensing devices, at least one processor, memory, and at least operating system software, such as Apple iOS, Android, Windows, Linux, and the like.
The invention's detachable touchpad device will generally comprise a cover configured to reversibly attach to part or all of the back side of the handheld computerized device. This cover will itself have a font side configured to face the back side of the handheld computerized device, and a back side opposite the cover front side that is configured to face away from the back side of the handheld computerized device. As a result, when the cover is attached to the handheld computerized device, the cover's back side can make contact with the hand of a user who is operating the computerized device from behind. The cover will generally have at least one touch sensing pad disposed to detect rear touch input from the user. To communicate touch data from the touch sensing pad, the detachable touchpad device will further have at least one data transfer device to communicate this touch input from the touch sensing pad to the handheld computerized device microprocessor(s) (processor). Thus when the detachable touchpad device is attached to the back side of the handheld computerized device, touch input from the user can be used to control the handheld computerized device.
As previously discussed, in one embodiment, the invention may be a detachable touchpad device configured to reversibly attach to the back side of a handheld computerized device.
As previously discussed, generally the handheld computerized device (100) may be a smart phone, tablet computer, and the like. In these illustrations, in order to better show the depth (102) of the handheld device, a relatively thick handheld device, modeled roughly after the Apple iPhone 4 is shown, but of course other thicknesses, screen sizes, and input and output port configurations may be used.
Such handheld computerized devices generally comprise at least a front side with a display screen (104), which is often a touch sensitive display screen (touch screen). These devices also usually comprise a back side generally disposed on the side of the device opposite to the front side. Typically such backsides, which are often configured to lie on support surfaces (e.g. tables), usually do not have any touch input sensing devices. As will be discussed in more detail in
In
The detachable touchpad device (110), (120) will generally comprise a cover configured to reversibly attach to at least part or all of the back side of the handheld computerized device (in these figures, the device is covering all of the handheld computerized device's backside). This cover will itself have a font side (110) configured to face the back side of the handheld computerized device, and a back side opposite the cover front side (120) that is configured to face away from the back side of the handheld computerized device. As a result, when the cover is attached to the handheld computerized device (130), the cover's back side can make contact with the hand of a user who is operating the computerized device. The back side of the cover (120) will generally have at least one touch sensing pad (122) disposed to detect touch input from the user. The outline showing the approximate location of this touch sensing pad is also shown on the front cover (110) as (112). In this embodiment, the detachable touchpad device clips (110), (120) on to the handheld computerized device (100) by way of clips (114), thus creating a handheld computerized device with a rear mounted touchpad (130).
To communicate touch data from the touch sensing pad, the detachable touchpad device will further have at least one data transfer device to communicate this touch input from the touch sensing pad to the handheld computerized device microprocessor(s) (processor).
The communications/power connector (320) must at least be a communications connector or data input connector to enable input from the touch sensing pad to be sent to the handheld computerized device processor. Here the connector (320) may be configured so as to readily plug into a socket or complementary connector (340) on the handheld computerized device (100). The resulting configuration where the detachable touchpad device (300) is attached to the handheld computerized device (100) is shown in (350).
In some embodiments, this connector (320) may also borrow electrical power from the handheld computerized device to operate the detachable touchpad device. In other embodiments, for example if the detachable touchpad device is configured with its own battery, then the connector (320) may optionally be used to charge the handheld computerized device (100).
As before, the communications/power connector (320) must at least be a communications connector or data input connector to enable input from the touch sensing pad to be sent to the handheld computerized device processor. Here again the connector (320) may be configured so as to readily plug into a socket or complementary connector (340) on the handheld computerized device (100). The resulting configuration where the detachable touchpad device (360/370) is attached to the handheld computerized device (100) is shown in (380).
As before in some embodiments, this connector (320) may again borrow electrical power from the handheld computerized device to operate the detachable touchpad device. In other embodiments, for example if the detachable touchpad device is configured with its own battery, then the connector (320) may optionally be used to charge the handheld computerized device (100).
Here one or more microprocessors (502) onboard the handheld computerized device (500) may accept data from the detachable touchpad device's built-in touchpad on the back surface (522) and with the appropriate software (504) (either application software and/or operating system software) residing in memory (506), and in some embodiments in conjunction with touch data from the handheld computerized device's own touch screen (508), control the operation and display (510) of the handheld computerized device.
In some embodiments, such as when wireless data communications is desired, or when the manufacturer and user wishes to take advantage of the ability of the detachable touchpad device to carry a supplemental battery to provide supplemental power to the handheld computerized device, the detachable touchpad device may additionally comprise at least one additional battery (524) that in some embodiments may either draw from and/or supply power to the handheld device's battery (512).
Thus when the detachable touchpad device is attached to the back side of the handheld computerized device, touch input from the user can be used to control the handheld computerized device.
In a preferred embodiment, the detachable touchpad device's touch sensing pad will act to create or comprise a multi-touch sensing surface capable of recognizing the presence and locations of at least two points of contact with the touchpad or touch sensor surface. Thus when the detachable touchpad device transmits the presence and locations to of these various points of contacts via the data transfer device/interface to the handheld computerized device, software (504) can interpret this multi-touch data and use it to control the handheld computerized device.
Hardware:
The touchpad or touch sensors used for this detachable touchpad device can include a variety of different type of touch sensing technologies, such as multi-touch capacitive technology, touch resistive technology, multi-touch optical technologies, or even more exotic touch sensing devices such as touch wave technologies or force based sensing or near field imaging technologies.
Examples of suitable multi-touch capacitive technology include surface capacitive, projected capacitive touch, or in-cell capacitive technologies. Examples of touch resistive technology include analog resistive or digital resistive or in-cell resistive technologies. Example of multi-touch optical technologies include optical or infrared imaging technology, rear diffused illumination, infrared grid technology, digital waveguide touch, or infrared optical waveguide technologies, as well as Kinect or in-cell optical technologies. Examples of touch wave technology include surface acoustic wave or bending wave touch technology.
This application is a continuation in part of U.S. patent application Ser. No. 12/773,075, “METHOD FOR USER INPUT FROM THE BACK PANEL OF A HANDHELD COMPUTERIZED DEVICE”, inventor Tong Luo, filed May 4, 2010; application Ser. No. 12/773,075 in turn claimed the priority benefit of U.S. Provisional Application No. 61/327,102 filed Apr. 23, 2010, entitled “METHOD, GRAPHICAL USER INTERFACE, AND APPARATUS FOR USER INPUT FROM THE BACK PANEL OF A HANDHELD ELECTRONIC DEVICE”, Tong Luo inventor; the contents of both of these applications are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5530234 | Loh et al. | Jun 1996 | A |
6239790 | Martinelli et al. | May 2001 | B1 |
6297752 | Ni | Oct 2001 | B1 |
6512511 | Willner et al. | Jan 2003 | B2 |
6628511 | Engstrom | Sep 2003 | B2 |
7667692 | Marcus et al. | Feb 2010 | B2 |
7705799 | Niwa | Apr 2010 | B2 |
7724157 | Gray | May 2010 | B1 |
7864164 | Cunningham et al. | Jan 2011 | B2 |
7881055 | Brandenberg et al. | Feb 2011 | B2 |
8289702 | Karwan | Oct 2012 | B2 |
8384683 | Luo | Feb 2013 | B2 |
8390573 | Trout | Mar 2013 | B2 |
20020118175 | Liebenow et al. | Aug 2002 | A1 |
20020180767 | Northway et al. | Dec 2002 | A1 |
20030048205 | He | Mar 2003 | A1 |
20040032398 | Ariel et al. | Feb 2004 | A1 |
20040046744 | Rafii et al. | Mar 2004 | A1 |
20040097256 | Kujawski | May 2004 | A1 |
20050176461 | Bozzone et al. | Aug 2005 | A1 |
20060007178 | Davis | Jan 2006 | A1 |
20060114233 | Radivojevic et al. | Jun 2006 | A1 |
20070247800 | Smith et al. | Oct 2007 | A1 |
20070262965 | Hirai et al. | Nov 2007 | A1 |
20070268261 | Lipson | Nov 2007 | A1 |
20080084397 | On et al. | Apr 2008 | A1 |
20080096620 | Lee et al. | Apr 2008 | A1 |
20080211766 | Westerman et al. | Sep 2008 | A1 |
20080285857 | Sharan et al. | Nov 2008 | A1 |
20090009951 | Sbaiti | Jan 2009 | A1 |
20090135142 | Fu et al. | May 2009 | A1 |
20090167682 | Yamashita et al. | Jul 2009 | A1 |
20090195372 | Aichi et al. | Aug 2009 | A1 |
20090322499 | Pryor | Dec 2009 | A1 |
20100052879 | Nanos | Mar 2010 | A1 |
20100093401 | Moran et al. | Apr 2010 | A1 |
20100177035 | Schowengerdt et al. | Jul 2010 | A1 |
20100182399 | Choi et al. | Jul 2010 | A1 |
20100214267 | Radivojevic et al. | Aug 2010 | A1 |
20100222110 | Kim et al. | Sep 2010 | A1 |
20100315266 | Gunawardana et al. | Dec 2010 | A1 |
20110018695 | Bells et al. | Jan 2011 | A1 |
20110029185 | Aoki et al. | Feb 2011 | A1 |
20110188176 | Kim | Aug 2011 | A1 |
20110306387 | Moon | Dec 2011 | A1 |
20130007653 | Stolyarov et al. | Jan 2013 | A1 |
20130149964 | Kreiner et al. | Jun 2013 | A1 |
20130155070 | Luo | Jun 2013 | A1 |
20130201155 | Wu et al. | Aug 2013 | A1 |
20130278552 | Kamin-Lyndgaard | Oct 2013 | A1 |
20140240267 | Luo | Aug 2014 | A1 |
Entry |
---|
Office Action for Chinese Patent Application No. 201110113001.3 mailed Jan. 6, 2014 (English translation). |
Jania, “Cypress CapSense Successive Approximation Algorithm,” Cypress White Paper CSA RJO, pp. 1-6 (2007). |
Onno et al., “A Natural Human Hand Model,” The Visual Computer 24(1): 31-44 (2008). |
Westerman, “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface,” dissertation submitted to the Faculty of the University of Delaware for a Ph.D. in electrical engineering, pp. xxix-xxx (1999). |
Non-Final Office Action for U.S. Appl. No. 12/773,075 mailed Mar. 2, 2012. |
Final Office Action for U.S. Appl. No. 12/773,075 mailed Jul. 19, 2012. |
Interview Summary for U.S. Appl. No. 12/773,075 mailed Aug. 29, 2012. |
Non-Final Office Action for U.S. Appl. No. 12/773,075 mailed Sep. 24, 2012. |
Interview Summary for U.S. Appl. No. 12/773,075 mailed Oct. 19, 2012. |
Notice of Allowance for U.S. Appl. No. 12/773,075 mailed Jan. 18, 2013. |
Office Action for CN Application No. 201110113001.3 mailed Jan. 6, 2014. |
International Application No. PCT/US2014/48273, International Search Report Nov. 25, 2014, 13 pages. |
European PatentApplication No. EP11772858.4, Extended Search Report Nov. 12, 2014, 7 pages. |
China Intellectual Property Office office action for application CN201110113001 dated Sep. 5, 2014. |
International Application No. PCT/US2011/036654, International Search Report and Written Opinion Sep. 1, 2011, 9 pages. |
European PatentApplication No. EP14155627.4, Extended Search Report Aug. 21, 2014, 7 pages. |
International Application No. PCT/US2014/036679, International Search Report Sep. 25, 2014, 19 pages. |
International Application No. PCT/US2014/038779, International Search Report Oct. 7, 2014, 14 pages. |
International Search Report for patent application No. PCT/US2014/056625 (Dec. 30, 2014) 14 pages. |
Non-Final Office Action for U.S. Appl. No. 13/770,791 mailed Mar. 13, 2015, 20 pages. |
Number | Date | Country | |
---|---|---|---|
20120007822 A1 | Jan 2012 | US |
Number | Date | Country | |
---|---|---|---|
61327102 | Apr 2010 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12773075 | May 2010 | US |
Child | 13223836 | US |