Patent Application
20150149948
This application claims priority under 35 U.S.C. §119(a) to a Korean Patent Application filed on Nov. 22, 2013 in the Korean Intellectual Property Office and assigned Serial No. 10-2013-0143178, the entire content of which is incorporated herein by reference.
1. Field of the Invention
The present invention generally relates to a portable electronic device and screen control method therefor that enable screen movement for easy function execution.
2. Description of the Related Art
A portable electronic device having a large screen may display many application icons associated with various functions on the screen. When a user manipulates a portable electronic device with one hand, for example, while being on a bus or subway train, the user may grip the portable electronic device with one hand and execute a desired function associated with an icon displayed on the screen using a finger of the gripping hand. However, when the screen size is large, the user may have difficulty in reaching a far region of the screen and manipulating icons displayed in the far region with a finger of the hand gripping the portable electronic device. An excessive attempt to reach and manipulate a function icon displayed in the far region of the screen with a finger of the hand gripping the portable electronic device may cause the grip to be unstable, so that the portable electronic device may be dropped and damaged. Otherwise, the user may have to use the other hand to manipulate the portable electronic device.
To solve this problem, the screen may be resized to fit within a region that can be reached by a finger of the hand gripping the portable electronic device, or icons being displayed may be moved to the region.
However, as the screen is resized (or reduced), objects such as application icons displayed on the screen are also reduced. Hence, the user may have difficulty in selecting and executing a desired function. In addition, moving icons displayed on the screen may be not intuitive, and it may be difficult to arrange icons at desired positions with a single operation.
The present invention has been made to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a portable electronic device and screen control method therefore, in which a full screen output by the portable electronic device may be moved to a desired position so that a function can be readily executed.
In accordance with an aspect of the present invention, a screen control method for a portable electronic device is provided. The screen control method includes receiving a touch event; moving a foreground screen according to the received touch event; and outputting a virtual or soft button corresponding to a hardware button of the portable electronic device at a position close to the moved foreground screen in a display area.
In accordance with another aspect of the present invention, a portable electronic device is provided. The portable electronic device includes a touchscreen configured to receive a touch event and output a foreground screen; and a control unit configured to control the touchscreen so as to move the foreground screen upon reception of the touch event and output a virtual button corresponding to a hardware button of the portable electronic device at a position close to the moved foreground screen in a display area.
The above and other aspects, features, and advantages of certain embodiments of the present invention will be more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which:
Hereinafter, embodiments of the present invention are described in detail with reference to the accompanying drawings. The same reference symbols are used throughout the drawings to refer to the same or like parts. Detailed descriptions of well-known functions and structures incorporated herein may be omitted to avoid obscuring the subject matter of the present invention. The following description includes various specific details only to assist understanding of present invention.
In the present invention, the portable electronic device and screen control method therefor may move a full screen to a desired position so that a function can be readily executed. Hence, usability of the portable electronic device may be significantly enhanced.
In an embodiment of the present invention, the portable electronic device is a device having computing resources, such as a smartphone, tablet computer, digital camera, computer monitor, Personal Digital Assistant (PDA), electronic organizer, desktop computer, Portable Multimedia Player (PMP), a media player such as a Moving Picture Experts Group Audio Layer 3 (MP3) player, audio equipment, wrist watch, or game console.
Referring to
The wireless communication unit 110 establishes a communication channel to a mobile communication network under control of the control unit 170 to send and receive signals in relation to calls (voice call, video call and data call), messages (text message and multimedia message), and Internet services. The wireless communication unit 110 may include a transceiver for upconverting the frequency of a signal to be transmitted and amplifying the signal, and for low-noise amplifying a received signal and downconverting the frequency of the received signal. The wireless communication unit 110 may include a mobile communication module (based on 3G, 3.5G or 4G mobile communication), a digital broadcast reception module (such as a DMB module), and a local area communication module (such as a Wi-Fi module, Bluetooth module or Near Field Communication (NFC) module). The wireless communication unit 110 receives advertisement information for a product, information on an application currently being executed, and information on a widget application from a web server, and forwards the received information to the control unit 170. After moving a foreground screen, the control unit 170 controls the touchscreen 120 to output an advertisement, an application icon, or a widget icon corresponding to the received information in a region of a background screen not overlapped with the foreground screen.
The touchscreen 120 outputs various screens needed for operations of the portable electronic device 100. For example, the touchscreen 120 outputs an idle screen, menu screen, and the like, in the course of operating the portable electronic device 100. The touchscreen 120 includes a touch panel 121 and a display panel 123. The touch panel 121 may be of an add-on type (placed on the display panel 123) or an on-cell or in-cell type (inserted in the display panel 123.
The touch panel 121 generates an analog signal (for example, a touch event) corresponding to a user gesture, converts the analog signal into a digital signal (A/D conversion), and sends the digital signal to the control unit 170. The control unit 170 selects a representative one of multiple touch points on the basis of received information on touch events. The coordinates of touch points may be given in units of pixels. For example, when the screen resolution is 640*480 (the number of horizontal pixels*the number of vertical pixels), x-axis coordinates range from 0 to 640 and y-axis coordinates range from 0 to 480. The control unit 170 determines that a touch input means such as a finger or pen is touched on the touch panel 121 when a touch event is received from the touch panel 121, and determines that the touch input means is released when coordinate information is not received. The control unit 170 determines that the touch input means is moved when the touch point coordinates are changed from (x0, y0) to (x1, y2) and the amount of change (e.g. distance D where D2=(x0−x1)2+(y0−y1)2) is greater than a preset threshold (e.g. 1 mm). Upon detection of a movement of the touch input means, the control unit 170 computes the amount of change in position (dx, dy) and the movement speed of the touch input means. The control unit 170 classifies user gestures on the screen into touch, multi-touch, tap, double tap, long tap, tap and touch, drag, flick, press, pinch in, and pinch out on the basis of touch point coordinates, and release, movement, amount of change in position and movement speed of the touch input means.
In particular, the touch panel 121 detects a user gesture for activating a screen movement function and sends information thereof to the control unit 170. For example, the touch panel 121 generates a touch event corresponding to a touch gesture, such as a double tap or a long tap, made by the user and forwards the touch event to the control unit 170. Here, the double tap or the long tap is used as an example of a user gesture for activating a screen movement function, and is not limited thereto. Upon reception of the touch event from the touch panel 121, the control unit 170 moves the current foreground screen. More specifically, the touch panel 121 generates a touch event for screen movement and sends the touch event to the control unit 170. For example, the touch panel 121 generates a touch event corresponding to a user gesture involving touch and movement, such as a drag or flick, and sends the touch event to the control unit 170. In response to the touch event, the control unit 170 moves the current foreground screen. For example, when the user makes a drag gesture for screen movement, the control unit 170 receives a touch event corresponding to the drag gesture from the touch panel 121 and analyzes changes in touch points. The control unit 170 controls the touchscreen 120 to move the foreground screen according to the changes in touch points. After movement of the foreground screen, when the user makes a touch gesture for restoring the previous position of the foreground screen, the touch panel 121 generates a corresponding touch event and sends the touch event to the control unit 170. Upon reception of the touch event from the touch panel 121, the control unit 170 controls the touchscreen 120 to move the foreground screen to the previous position. For example, in response to a touch gesture like a double tap on the foreground screen having been moved, the control unit 170 controls the touchscreen 120 to move the foreground screen to the previous position. Here, in addition to the double tap, other touch gestures such as a long tap may be used to restore the previous position of the foreground screen.
The touch panel 121 may be a composite one of a hand touch panel sensing a hand gesture and a pen touch panel sensing a pen gesture. The hand touch panel may be realized using capacitive, resistive, infrared, or surface acoustic wave technology. The hand touch panel generates a touch event according to not only a hand gesture of the user but also a different object (e.g. an object made of a conductive material capable of causing a capacitance change). The pen touch panel may be realized using electromagnetic induction technology. The pen touch panel generates a touch event according to interaction with a stylus touch pen specially designed to form a magnetic field.
The display panel 123 displays data on the screen under control of the control unit 170. That is, when the control unit 170 stores processed (e.g. decoded) data in a buffer, the display panel 123 converts the data stored in the buffer into an analog signal and displays the analog signal on the screen. In particular, under control of the control unit 170, the display panel 123 displays a foreground screen that can be moved according to a touch event for screen movement received from the touch panel 121. When the foreground screen is moved, the display panel 123 outputs a virtual button corresponding to a hardware button of the portable electronic device 100 at a position close to the moved foreground screen in a display area. For example, when the foreground screen is moved by the user to a desired position, under control of the control unit 170, the display panel 123 outputs a visible region of the foreground screen and outputs a virtual or soft button for the foreground screen so that the position of the virtual button relative to the foreground screen corresponds to the position of a hardware button relative to the touchscreen 120. In other words, when the foreground screen is moved, the touchscreen 120 outputs a virtual button at a position close to the foreground screen in a display area after movement so that the position of the virtual button corresponds to the change in position of the foreground screen. Here, the function mapped to the virtual button is identical to that mapped to the corresponding hardware button. For example, when the hardware button is a volume adjustment button, the virtual button to be output close to the moved foreground screen in a display area is also a volume adjustment button. When the hardware button is a menu button, the virtual button to be output close to the moved foreground screen in a display area is also a menu button. In addition, under control of the control unit 170, the display panel 123 outputs an advertisement, an application icon, or a widget icon in a region of a background screen not overlapping the moved foreground screen.
The display panel 123 may be realized using one of display technologies based on Liquid Crystal Display (LCD) devices, Active Matrix Organic Light Emitting Diodes (AMOLEDs), Passive Matrix Organic Light Emitting Diodes (PMOLEDs), flexible display, and transparent display.
The input unit 130 may include a plurality of buttons for entering alphanumeric information and for setting various functions. Such buttons includes a menu invoking button, screen on/off button, power on/off button, cancel button, and volume adjustment button. The input unit 130 generates button events for user's settings and controlling functions of the portable electronic device 100 and sends the button events to the control unit 170. The control unit 170 controls the above components according to button events. A button of the input unit 130 is referred to as a hardware button, and a virtual button displayed on the display panel 123 is referred to as a soft button.
The audio processing unit 140 may include a coder/decoder (codec). The codec has a data codec for processing packet data and the like, and an audio codec for processing an audio signal such as a voice signal. The audio processing unit 140 converts a digital audio signal into an analog audio signal through the audio codec to output the analog audio signal to a receiver or speaker, and converts an analog audio signal from a microphone into a digital audio signal through the audio codec.
The sensor unit 150 senses a physical quantity (such as amount of light, speed, acceleration, altitude, or gravity) or a change therein and sends sensed information to the control unit 170. The sensor unit 150 may include an acceleration sensor, geomagnetic sensor, pressure sensor, and infrared sensor. In particular, the sensor unit 150 senses motion of the portable electronic device 100 such as shaking or tilting and sends the sensed information to the control unit 170, which then activates the screen movement function or moves the foreground screen being output. For example, the portable electronic device 100 is pre-configured to activate the screen movement function when shaken in a preset pattern. As another example, the portable electronic device 100 is pre-configured to move the foreground screen in the direction of tilt, when tilted in a direction while the screen movement function is activated.
The storage unit 160 may include a disk, Random Access Memory (RAM), and flash memory as a secondary memory for the control unit 170. Under control of the control unit 170, the storage unit 160 stores data generated by the portable electronic device 100 or data received from a server or desktop computer through the wireless communication unit 110 or an external interface. In particular, the storage unit 160 stores advertisement information for a product received from a web server through the wireless communication unit 110, information on an application currently being executed, and information on a widget application. When the foreground screen is moved in response to a touch event for screen movement, the control unit 170 receives at least one of advertisement information, application information, and widget information from the storage unit 160, and outputs the received information in a region of the background screen not overlapping the moved foreground screen.
The storage unit 160 stores an operating system (OS) for operating the portable electronic device 100, application programs to support optional functions such as sound reproduction, playback of still and moving images, and broadcast reception, user data, and data sent and received through communication. In particular, the storage unit 160 stores a screen movement support program. The screen movement support program may be composed of a routine to move the foreground screen according to received information on a touch event (i.e. information on the touch point, direction and distance of movement of a touch gesture), a routine to output a virtual button corresponding to a hardware button of the portable electronic device 100 at a position close to the moved foreground screen in a display area, and a routine to output an advertisement, an application icon and a widget icon in a region of the background screen not overlapping the foreground screen.
The control unit 170 controls the overall operation of the portable electronic device 100, control signal exchange between internal components thereof, and performs data processing. The control unit 170 controls supply of power from a battery to the internal components. In particular, the control unit 170 activates a screen movement function in response to a touch event received from the touch panel 121 or the sensor unit 150. The control unit 170 moves the current foreground screen in a specific manner. For example, when a touch event corresponding to a drag is received from the touch panel 121, the control unit 170 moves the foreground screen in accordance with the direction and distance of the drag. The control unit 170 divides the display area into multiple subregions according to a preset rule, and moves the foreground screen on the basis of the arrangement of the subregions. For example, it is assumed that the display area is evenly divided into 9 rectangular subregions (3 rows and 3 columns). Then, in response to a touch gesture like a drag or flick, the control unit 170 moves the foreground screen and adjusts the position of the foreground screen so that, when one vertex of the foreground screen is placed within one of the subregions, the vertex of the foreground screen becomes coincident with one of the vertices of the subregion that is nearest to the vertex of the foreground screen. When the foreground screen is moved in response to a touch event, the control unit 170 controls the touchscreen 120 to output advertisements, application icons, and widget icons stored in the storage unit 160 in a region of the background screen not overlapping the foreground screen.
Referring to
In step S203, the control unit 170 receives a touch event for screen movement. For example, the control unit 170 receives a touch event corresponding to a drag or flick on the foreground screen. As another example, the control unit 170 receives a motion event corresponding to tilting of the portable electronic device 100 from the sensor unit 150.
In step S205, the control unit 170 moves the current foreground screen according to the received touch event for screen movement. In one embodiment of the present invention, the control unit 170 performs screen movement in accordance with a received touch event. For example, when the user makes a drag gesture using a finger on the screen, the control unit 170 identifies the touch point, direction, distance and release point of the drag and moves the whole foreground screen according to the identified touch and release points. To move the foreground screen, the control unit 170 may translate the coordinate system of the foreground screen on the basis of touch and release points of the drag. As another example, when a motion event such as shaking is detected by the sensor unit 150, the control unit 170 moves the current foreground screen. In addition, when the portable electronic device 100 is tilted in a particular direction, the sensor unit 150 having an acceleration sensor, gyroscope and/or geomagnetic sensor may send information on the tilting direction to the control unit 170, which may then move the foreground screen in accordance with the tilting direction.
In another embodiment of the present invention, the control unit 170 analyzes a received touch event and moves the current foreground screen to a preset position according to the touch event. For example, the control unit 170 evenly divides the display area into nine rectangular subregions (e.g., 3 rows and 3 columns) according to a preset rule. Then, in response to release of the drag on the touchscreen 120, the control unit 170 moves the foreground screen and adjusts the position of the foreground screen so that, when a visible vertex of the foreground screen is placed within one of the subregions, the visible vertex of the foreground screen becomes coincident with one of the four vertices of the subregion nearest to the visible vertex of the foreground screen. In other words, when the display area is divided into rectangular subregions, the foreground screen is moved so that the visible vertex (among the four vertices) of the foreground screen coincides with one of the four vertices of a subregion that is nearest to the visible vertex of the foreground screen. The number of subregions in the display area may be determined according to user's or designer's settings.
In addition, while a touch event is being received (for example, from the start of a drag action to the end thereof), the control unit 170 may output the foreground screen as a moving entity. When the foreground screen is scheduled to move to a designated region according to a drag event, the control unit 170 may control the touchscreen 120 to adjust the shade, brightness, and chroma of the designated region so that the designated region is readily distinguished from other regions.
In step S207, the control unit 170 outputs a virtual button corresponding to a hardware button of the portable electronic device 100 at a position close to the moved foreground screen in a display area on the touchscreen 120. For example, the control unit 170 outputs a virtual button corresponding to a hardware button such as the menu button, screen on/off button, power on/off button, or volume adjustment button in accordance with the position of the foreground screen. The control unit 170 outputs a virtual button for the foreground screen so that the position of the virtual button relative to the foreground screen corresponds to the position of a hardware button relative to the touchscreen 120. In other words, when the screen is moved by ΔX along the x-axis and ΔY along the y-axis, the virtual button may be output at a position computed by changing the position of the corresponding hardware button by ΔX along the x-axis and ΔY along the y-axis.
After moving the foreground screen, the control unit 170 may control the touchscreen 120 to output advertisements, application icons, and widget icons in a region of the background screen not overlapping the foreground screen. For example, the control unit 170 receives advertisement information through the wireless communication unit 110, and retrieves information on applications currently being executed and information on widget applications from the storage unit 160. The control unit 170 controls the touchscreen 120 to output advertisements, application icons and widget icons in a region of the background screen not overlapping the foreground screen on the basis of the received or retrieved information.
Referring to
Referring to 301 of
Referring to 303 of
Referring to 401 of
Referring to 403 of
Referring to 405 of
As shown in
As shown in
As shown in
In
As described above, the portable electronic device and screen control method therefor of the present invention enable the user to move the full screen in a desired direction. As the user can easily execute functions or applications, usability of the portable electronic device can be significantly enhanced.
Hereinabove, various embodiments of the present invention has been shown and described for the purpose of illustration without limiting the subject matter of the present invention. It should be understood by those skilled in the art that many variations and modifications of the method and apparatus described herein will still fall within the spirit and scope of the present invention as defined in the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2013-0143178 | Nov 2013 | KR | national |
