The present disclosure relates to portable electronic devices that include touch screen displays for user interaction.
Electronic devices, including portable electronic devices, have gained widespread use and can provide a variety of functions including, for example, telephonic, electronic messaging and other personal information manager (PIM) application functions. Portable electronic devices can include several types of devices including mobile stations such as simple cellular telephones, smart telephones, wireless PDAs, and laptop computers with wireless 802.11 or Bluetooth capabilities. These devices run on a wide variety of networks from data-only networks such as Mobitex and DataTAC to complex voice and data networks such as GSM/GPRS, CDMA, EDGE, UMTS and CDMA2000 networks.
Devices such as PDAs or smart telephones are generally intended for handheld use and ease of portability. Smaller devices are generally desirable for portability. Touch screen devices constructed of a display, such as a liquid crystal display, with a touch-sensitive overlay are useful on such handheld devices as such handheld devices are small and are therefore limited in space available for user input and output devices. Further, the screen content on the touch screen devices can be modified depending on the functions and operations being performed.
These devices suffer from disadvantages, however. For example, with decreasing size of electronic devices, user-selectable features such as buttons displayed on the touch screen display of the portable electronic device are limited in size. When displaying a number of user-selectable features such as buttons of a virtual keyboard, user selection becomes difficult as the buttons are small and the placement of the user's finger can be inexact. Thus, selection errors may be made as a result of target inaccuracy and a lack of a touch feedback.
Improvements in portable electronic devices having touch screen displays are therefore desirable.
Embodiments of the present disclosure will now be described, by way of example only, with reference to the attached Figures, wherein:
It will be appreciated that for simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the embodiments described herein. Also, the description is not to be considered as limited to the scope of the embodiments described herein.
The disclosure generally relates to an electronic device, which in the embodiments described herein is a portable electronic device. Examples of portable electronic devices include mobile, or handheld, wireless communication devices such as pagers, cellular phones, cellular smart-phones, wireless organizers, personal digital assistants, wirelessly enabled notebook computers and the like.
The portable electronic device may be a two-way communication device with advanced data communication capabilities including the capability to communicate with other portable electronic devices or computer systems through a network of transceiver stations. The portable electronic device may also have the capability to allow voice communication. Depending on the functionality provided by the portable electronic device, it may be referred to as a data messaging device, a two-way pager, a cellular telephone with data messaging capabilities, a wireless Internet appliance, or a data communication device (with or without telephony capabilities). The portable electronic device may also be a portable device without wireless communication capabilities as a handheld electronic game device, digital photograph album, digital camera and the like.
Reference is first made to the Figures to describe an embodiment of a portable electronic device including a touch screen display and a method of controlling the portable electronic device. The method includes rendering a graphical user interface including a plurality of user-selectable features on the touch screen display; and in response to detecting a touch event on the touch screen display proximal one of the user-selectable features, rendering an indicator for the one of the user-selectable features corresponding to a location of the touch event prior to selection of any of the user-selectable features. The indicator is rendered intermediate ones of the user-selectable features for identifying the one of the user-selectable features absent obstruction of other ones of the user-selectable features.
Referring to
Although the wireless network 1000 associated with the portable electronic device 20 is a GSM/GPRS wireless network in one exemplary implementation, other wireless networks may also be associated with the portable electronic device 20 in variant implementations. The different types of wireless networks that may be employed include, for example, data-centric wireless networks, voice-centric wireless networks, and dual-mode networks that can support both voice and data communications over the same physical base stations. Combined dual-mode networks include, but are not limited to, Code Division Multiple Access (CDMA) or CDMA2000 networks, GSM/GPRS networks (as mentioned above), and future third-generation (3G) networks like EDGE and UMTS. Some other examples of data-centric networks include WiFi 802.11, Mobitex™ and DataTAC™ network communication systems. Examples of other voice-centric data networks include Personal Communication Systems (PCS) networks like GSM and Time Division Multiple Access (TDMA) systems.
The processor 22 also interacts with additional subsystems such as a Random Access Memory (RAM) 28, a flash memory 30, a display 32 with a touch-sensitive overlay 34 connected to an electronic controller 36 that together make up a touch screen display 38, a switch 39, an accelerometer 40, an auxiliary input/output (I/O) subsystem 41, a data port 42, a speaker 44, a microphone 46, short-range communications 48 and other device subsystems 50. The touch-sensitive overlay 34 and the electronic controller 36 provide a touch-sensitive input device and the processor 22 interacts with the touch-sensitive overlay 34 via the electronic controller 36.
Some of the subsystems of the portable electronic device 20 perform communication-related functions, whereas other subsystems may provide “resident” or on-device functions. By way of example, the display 32 and the touch-sensitive overlay 34 may be used for both communication-related functions, such as entering a text message for transmission over the network 1000, and device-resident functions such as a calculator or task list.
The accelerometer 40 includes a cantilever beam with a proof mass and suitable deflection sensing circuitry. The accelerometer 40 is used for detecting direction of gravitational forces (or gravity-induced reaction forces). Movement of the portable electronic device 20 to alternate orientations can be detected and the orientation of the accelerometer 40 and therefore of the portable electronic device 20 can be determined.
The portable electronic device 20 can send and receive communication signals over the wireless network 1000 after network registration or activation procedures have been completed. Network access is associated with a subscriber or user of the portable electronic device 20. To identify a subscriber according to the present embodiment, the portable electronic device 20 uses a SIM/RUIM card 52 (i.e. Subscriber Identity Module or a Removable User Identity Module) inserted into a SIM/RUIM interface 54 for communication with a network such as the network 1000. The SIM/RUIM card 52 is one type of a conventional “smart card” that can be used to identify a subscriber of the portable electronic device 20 and to personalize the portable electronic device 20, among other things. In the present embodiment the portable electronic device 20 is not fully operational for communication with the wireless network 1000 without the SIM/RUIM card 52. By inserting the SIM/RUIM card 52 into the SIM/RUIM interface 54, a subscriber can access all subscribed services. Services may include: web browsing and messaging such as e-mail, voice mail, Short Message Service (SMS), and Multimedia Messaging Services (MMS). More advanced services may include: point of sale, field service and sales force automation. The SIM/RUIM card 52 includes a processor and memory for storing information. Once the SIM/RUIM card 52 is inserted into the SIM/RUIM interface 54, it is coupled to the processor 22. In order to identify the subscriber, the SIM/RUIM card 52 can include some user parameters such as an International Mobile Subscriber Identity (IMSI). An advantage of using the SIM/RUIM card 52 is that a subscriber is not necessarily bound by any single physical portable electronic device. The SIM/RUIM card 52 may store additional subscriber information for a portable electronic device as well, including datebook (or calendar) information and recent call information. Alternatively, user identification information can also be programmed into the flash memory 30.
The portable electronic device 20 is a battery-powered device and includes a battery interface 56 for receiving one or more rechargeable batteries 58. In at least some embodiments, the battery 58 can be a smart battery with an embedded microprocessor. The battery interface 56 is coupled to a regulator (not shown), which assists the battery 58 in providing power V+ to the portable electronic device 20. Although current technology makes use of a battery, future technologies such as micro fuel cells may provide the power to the portable electronic device 20.
The portable electronic device 20 also includes an operating system 60 and software components 62 which are described in more detail below. The operating system 60 and the software components 62 that are executed by the processor 22 are typically stored in a persistent store such as the flash memory 30, which may alternatively be a read-only memory (ROM) or similar storage element (not shown). Those skilled in the art will appreciate that portions of the operating system 60 and the software components 62, such as specific software applications 64, 66, 68, 70 and 72, or parts thereof, may be temporarily loaded into a volatile store such as the RAM 28. Other software components can also be included, as is well known to those skilled in the art.
The subset of software components 62 that control basic device operations, including data and voice communication applications, will normally be installed on the portable electronic device 20 during its manufacture. Other software applications include a message application 64 that can be any suitable software program that allows a user of the portable electronic device 20 to send and receive electronic messages. Various alternatives exist for the message application 64 as is well known to those skilled in the art. Messages that have been sent or received by the user are typically stored in the flash memory 30 of the portable electronic device 20 or some other suitable storage element in the portable electronic device 20. In at least some embodiments, some of the sent and received messages may be stored remotely from the device 20 such as in a data store of an associated host system that the portable electronic device 20 communicates with.
The software components 62 can further include a device state module 66, a Personal Information Manager (PIM) 68, and other suitable modules (not shown). The device state module 66 provides persistence, i.e. the device state module 66 ensures that important device data is stored in persistent memory, such as the flash memory 30, so that the data is not lost when the portable electronic device 20 is turned off or loses power.
The PIM 68 includes functionality for organizing and managing data items of interest to the user, such as, but not limited to, e-mail, contacts, calendar events, voice mails, appointments, and task items. The PIM 68 has the ability to send and receive data items via the wireless network 1000. PIM data items may be seamlessly integrated, synchronized, and updated via the wireless network 1000 with the portable electronic device subscriber's corresponding data items stored and/or associated with a host computer system. This functionality creates a mirrored host computer on the portable electronic device 20 with respect to such items. This can be particularly advantageous when the host computer system is the portable electronic device subscriber's office computer system.
The software components 62 also includes a connect module 70, and an information technology (IT) policy module 72. The connect module 70 implements the communication protocols that are required for the portable electronic device 20 to communicate with the wireless infrastructure and any host system, such as an enterprise system, that the portable electronic device 20 is authorized to interface with.
The connect module 70 includes a set of APIs that can be integrated with the portable electronic device 20 to allow the portable electronic device 20 to use any number of services associated with the enterprise system. The connect module 70 allows the portable electronic device 20 to establish an end-to-end secure, authenticated communication pipe with the host system. A subset of applications for which access is provided by the connect module 70 can be used to pass IT policy commands from the host system to the portable electronic device 20. This can be done in a wireless or wired manner. These instructions can then be passed to the IT policy module 72 to modify the configuration of the device 20. Alternatively, in some cases, the IT policy update can also be done over a wired connection.
Other types of software applications can also be installed on the portable electronic device 20. These software applications can be third party applications, which are added after the manufacture of the portable electronic device 20. Examples of third party applications include games, calculators, utilities, etc.
The additional applications can be loaded onto the portable electronic device 20 through at least one of the wireless network 1000, the auxiliary I/O subsystem 41, the data port 42, the short-range communications subsystem 48, or any other suitable device subsystem 50. This flexibility in application installation increases the functionality of the portable electronic device 20 and may provide enhanced on-device functions, communication-related functions, or both. For example, secure communication applications may enable electronic commerce functions and other such financial transactions to be performed using the portable electronic device 20.
The data port 42 enables a subscriber to set preferences through an external device or software application and extends the capabilities of the portable electronic device 20 by providing for information or software downloads to the portable electronic device 20 other than through a wireless communication network. The alternate download path may, for example, be used to load an encryption key onto the portable electronic device 20 through a direct and thus reliable and trusted connection to provide secure device communication.
The data port 42 can be any suitable port that enables data communication between the portable electronic device 20 and another computing device. The data port 42 can be a serial or a parallel port. In some instances, the data port 42 can be a USB port that includes data lines for data transfer and a supply line that can provide a charging current to charge the battery 58 of the portable electronic device 20.
The short-range communications subsystem 48 provides for communication between the portable electronic device 20 and different systems or devices, without the use of the wireless network 1000. For example, the short-range communications subsystem 48 may include an infrared device and associated circuits and components for short-range communication. Examples of short-range communication standards include standards developed by the Infrared Data Association (IrDA), Bluetooth, and the 802.11 family of standards developed by IEEE.
In use, a received signal such as a text message, an e-mail message, or web page download is processed by the communication subsystem 24 and input to the processor 22. The processor 22 then processes the received signal for output to the display 32 or alternatively to the auxiliary I/O subsystem 41. A subscriber may also compose data items, such as e-mail messages, for example, using the touch-sensitive overlay 34 on the display 32 that are part of the touch screen display 38, and possibly the auxiliary I/O subsystem 41. The auxiliary I/O subsystem 41 may include devices such as: a mouse, track ball, infrared fingerprint detector, or a roller wheel with dynamic button pressing capability. A composed item may be transmitted over the wireless network 1000 through the communication subsystem 24.
For voice communications, the overall operation of the portable electronic device 20 is substantially similar, except that the received signals are output to the speaker 44, and signals for transmission are generated by the microphone 46. Alternative voice or audio I/O subsystems, such as a voice message recording subsystem, can also be implemented on the portable electronic device 20. Although voice or audio signal output is accomplished primarily through the speaker 44, the display 32 can also be used to provide additional information such as the identity of a calling party, duration of a voice call, or other voice call related information.
Reference is now made to
The housing can be any suitable housing for the internal components shown in
The display 32 and the touch-sensitive overlay 34 can be supported on a support tray 84 of suitable material such as magnesium for providing mechanical support to the display 32 and touch-sensitive overlay 34. The display 32 and touch-sensitive overlay 34 are biased away from the base 82, toward the frame 78 by biasing elements 86 such as gel pads between the support tray 84 and the base 82. Compliant spacers 88, which can also be in the form of gel pads for example, are located between an upper portion of the support tray 84 and the frame 78. The touch screen display 38 is moveable within the housing 74 as the touch screen display 38 can be moved toward the base 82, thereby compressing the biasing elements 86. The touch screen display 38 can also be pivoted within the housing 74 with one side of the touch screen display 38 moving toward the base 82, thereby compressing the biasing elements 86 on the same side of the touch screen display 38 that moves toward the base 82.
In the present example, the switch 39 is supported on one side of the base 82 which can be printed circuit board while the opposing side provides mechanical support and electrical connection for other components (not shown) of the portable electronic device 20. The switch 39 can be located between the base 82 and the support tray 84. The switch 39, which can be a mechanical dome-type switch, for example, can be located in any suitable position such that displacement of the touch screen display 38 resulting from a user pressing the touch screen display 38 with sufficient force to overcome the bias and to overcome the actuation force for the switch 39, depresses and actuates the switch 39. In the present embodiment the switch 39 is in contact with the support tray 84. Thus, depression of the touch screen display 38 by user application of a force thereto causes actuation of the switch 39 and thereby provides the user with a positive tactile feedback during user interaction with the user interface of the portable electronic device 20. The switch 39 is not actuated in the rest position shown in
The touch screen display 38 can be any suitable touch screen display such as a capacitive touch screen display, a resistive touch screen display or any other suitable touch screen display. In one example the touch screen display is a capacitive touch screen display 38. A capacitive touch screen display 38 includes the display 32 and the touch-sensitive overlay 34, in the form of a capacitive touch-sensitive overlay 34. It will be appreciated that the capacitive touch-sensitive overlay 34 includes a number of layers in a stack and is fixed to the display 32 via a suitable optically clear adhesive. The layers can include, for example a substrate fixed to the display 32 by a suitable adhesive, a ground shield layer, a barrier layer, a pair of capacitive touch sensor layers separated by a substrate or other barrier layer, and a cover layer fixed to the second capacitive touch sensor layer by a suitable adhesive. The capacitive touch sensor layers can be any suitable material such as patterned indium tin oxide (ITO).
In the present example, the X and Y location of a touch event are both determined with the X location determined by a signal generated as a result of capacitive coupling with one of the touch sensor layers and the Y location determined by the signal generated as a result of capacitive coupling with the other of the touch sensor layers. Each of the touch-sensor layers provides a signal to the controller 36 as a result of capacitive coupling with a suitable object such as a finger of a user or a conductive object held in a bare hand of a user resulting in a change in the electric field of each of the touch sensor layers. The signals represent the respective X and Y touch location values. It will be appreciated that other attributes of the user's touch on the touch screen display 38 can be determined. For example, the size and the shape of the touch on the touch screen display 38 can be determined in addition to the location (X and Y values) based on the signals received at the controller 36 from the touch sensor layers.
Referring again to
In the present example, the portable electronic device includes four physical buttons 96, 98, 100, 102 in the housing 74 for user-selection for performing functions or operations including an “off-hook” button 96 for placing an outgoing cellular telephone call or receiving an incoming cellular telephone call, a Menu button 98 for displaying a context-sensitive menu or submenu, an escape button 100 for returning to a previous screen or exiting an application, and an “on-hook” button 102 for ending a cellular telephone call. The remainder of the buttons shown on the face of the exemplary portable electronic device of
Reference is now made to
A graphical user interface (GUI) is rendered on the touch screen display 38 and includes a plurality of user-selectable features (step 200). In response to detecting a touch event on the touch screen display (step 202) a nearest one of the user selectable features is determined (step 204) and an indicator for the one of the user-selectable features is rendered (step 206). The indicator is rendered intermediate ones of the user-selectable features for identifying the one of the user-selectable features without obstructing the other user-selectable features.
The user is therefore provided with an indicator as to which user-selectable feature is closest to the object prior to selection without obscuring any of the other user-selectable features so that the position of the touch event (the user's touch) can be adjusted to ensure the desired user-selectable feature is indicated prior to selection.
It will be appreciated that the method shown and described with reference to
Continued reference is made to
According to the present example, a GUI is rendered in an application, such as an Internet browser application for browsing the Internet (step 200). User-selectable features in the form of the virtual buttons 92 of the virtual keyboard 90 are rendered (step 202). The virtual keyboard 90 in the present example is a full QWERTY keyboard on the touch screen display 38 of the portable electronic device 20 in which each alphabetical letter is associated with a respective one of the plurality of virtual buttons 92 that together make up virtual keyboard 90. The virtual keyboard 90 is rendered along with the display area 94
Data entry in the form of characters in the Internet browser application can be carried out in the GUI shown in
Continuing with the present example, if the user wishes to select the letter “D”, the user can slide his or her finger in the direction of the letter “D” and the change in the location of the touch event to the new location, indicated by the numeral 114, is detected by the change in the X and Y location values (step 208). With movement of the touch location to the button associated with letter “D”, the target feature is determined to be the button associated with the letter “D (step 204). The indicator 112 is then rendered on the touch screen display 38 such that the grid pattern in the form of the pound sign is centered around the button associated with the letter “D” as shown in
If there is no further change in the X and Y location of the touch event as determined at step 208, it is determined if selection of the indicated user-selectable feature is received. In the present example, there is no further change in the X and Y location of the touch event and selection of the virtual button associated with the letter “D” is received (step 210). In the present embodiment, selection is received when a signal is received from the switch 39 resulting from depression of the touch screen display 38 with sufficient force to cause movement of the touch screen display 39 in the form of pivoting, against the bias of the touch screen display 38 and against the actuation force of the switch 39, to thereby actuate the switch 39.
Absent actuation of the switch 39 caused by depression of the touch screen display 38, the method proceeds to step 214 where a further change in the location of touch can be detected. If the switch 39 is actuated, however, the process proceeds to step 212 where a function associated with the location of the navigation indicator at the time of release of the switch 39 and therefore at the time the signal is sent from the switch 39 to the processor 22, is performed. The function performed is therefore dependent on the location of the navigation indicator at the time the switch 39 is released and on the application and GUI in which the navigation indicator is provided. In the present example, the letter “D” is added in a URL field 116 in the display area 94.
Reference is now made to
A touch event at or closest to any one of the icons 120 can be detected and the X and Y location of the touch event is determined (step 202). In the example shown in
The electronic address book icon 124 is located at the center of the grid pattern. Thus, the address book icon 124 is indicated even with the user's finger located over the icon. Further, the remainder of the icons 120 are not obscured by the indicator 112 as the indicator 112 is rendered intermediate the virtual buttons 92. The remainder of the steps of the method are similar to those previously described and therefore are not further described herein.
Reference is now made to
A touch event at or closest to any one of the thumbnail pictures 128 can be detected and the X and Y location of the touch event is determined (step 202). In the example shown in
In other embodiments, selection can be determined to be received when the touch event ends when the user lifts his or her finger, for example. Thus, if selection is not received at step 210 (in other words, the user does not lift the finger or suitable object from the display and thereby end the touch event), the method returns to step 208, for example. In still other embodiments, some of the lines of the indicator may not extend past the periphery in both directions for example, to avoid obscuring a button or other user-selectable feature that is adjacent and is larger or offset from the identified one of the user-selectable features. In still further embodiments, the indicator can be rendered in an alternate color or in a white or light line, for example, if the user-selectable features are dark or black.
As indicated above, the method shown and described with reference to
According to one aspect, there is provided a method of controlling a portable electronic device having a touch screen display. The method includes rendering a graphical user interface including a plurality of user-selectable features on the touch screen display and, in response to detecting a touch event on the touch screen display proximal one of the user-selectable features, rendering an indicator for one of the user-selectable features corresponding to a location of the touch event prior to selection of any of the user-selectable features. The indicator is rendered intermediate ones of the user-selectable features for identifying the one of the user-selectable features absent obstruction of other ones of the user-selectable features.
According to another aspect, there is provided a portable electronic device. The portable electronic device includes a housing, a touch screen display connected to the housing and including a display and touch-sensitive overlay exposed for user-interaction therewith, and functional components in the housing including a memory device and a processor operably connected to the touch screen display and the memory device for executing a program stored in the memory device to cause the portable electronic device to render a graphical user interface including a plurality of user-selectable features on the touch screen display and, in response to detecting a touch event on the touch screen display proximal one of the user-selectable features, render an indicator for one of the user-selectable features corresponding to a location of the touch event prior to selection of any of the user-selectable features. The indicator is rendered intermediate ones of the user-selectable features for identifying the one of the user-selectable features absent obstruction of other ones of the user-selectable features
According to yet another aspect, there is provided a computer-readable medium having computer-readable code embodied therein for execution by a processor in a portable electronic device comprising a touch screen display, for rendering a graphical user interface including a plurality of user-selectable features on the touch screen display and, in response to detecting a touch event on the touch screen display proximal one of the user-selectable features, rendering an indicator for one of the user-selectable features corresponding to a location of the touch event prior to selection of any of the user-selectable features. The indicator is rendered intermediate ones of the user-selectable features for identifying the one of the user-selectable features absent obstruction of other ones of the user-selectable features.
Advantageously, an indicator is rendered on the touch screen display for identification of the user-selectable feature, such as a virtual button or key of a virtual keyboard. The indicator is rendered prior to selection of the user-selectable feature for identification of the feature at which the touch event is located and is rendered intermediate the user-selectable features so as to avoid obscuring the remaining features. For example, the indicator can be a grid pattern located between spaced-apart user-selectable features and centered around the one of the user-selectable features that corresponds to the touch location. Thus, the user-selectable features remain rendered in the same position and are not obscured or obstructed by the indicator so that the user can readily view and select an alternative feature, for example, by sliding the finger to the alternative feature prior to selection. Rendering of a new screen or window for identifying the feature prior to selection is unnecessary. This reduces time for entry and user-selection errors, decreasing device use time and therefore decreasing power consumption and battery use while increasing user-satisfaction. Furthermore, the user can learn from each selection and improve touch accuracy as a result of the indicator that shows the selection in a grid pattern without obscuring remaining features. Thus, targeting accuracy can be improved as the grid pattern represents the vertical and horizontal location of the selection.
Selection can be carried out by depression of the touch screen display to cause movement of the display toward the base resulting in actuation of a switch disposed between the base and the touch screen display. The switch provides positive tactile feedback to the user confirming selection.
While the embodiments described herein are directed to particular implementations of the portable electronic device and the method of controlling the portable electronic device, it will be understood that modifications and variations may occur to those skilled in the art. All such modifications and variations are believed to be within the sphere and scope of the present disclosure.
Number | Name | Date | Kind |
---|---|---|---|
20060022955 | Kennedy | Feb 2006 | A1 |
20080098331 | Novick et al. | Apr 2008 | A1 |
20090193361 | Lee et al. | Jul 2009 | A1 |
20100085303 | Kwok et al. | Apr 2010 | A1 |
20100156814 | Weber et al. | Jun 2010 | A1 |
20100265197 | Purdy et al. | Oct 2010 | A1 |
Number | Date | Country |
---|---|---|
03077108 | Sep 2003 | WO |
Number | Date | Country | |
---|---|---|---|
20100159996 A1 | Jun 2010 | US |