Patent Application
20130085743
This application claims the benefit under 35 U.S.C. §119(a) of a Korean patent application filed on Sep. 29, 2011 in the Korean Intellectual Property Office and assigned Serial No. 10-2011-0098782, the entire disclosure of which is hereby incorporated by reference.
1. Field of the Invention
The present invention relates to a user interface of a portable terminal More particularly, the present invention relates to a method and apparatus for providing a user interface of a portable terminal in which a handwriting message inputted through a touch screen is converted into a text message, and in which the user can easily edit the converted text message.
2. Description of the Related Art
Recently, with the rapid development of information communication technologies and semiconductor technologies, portable terminals are being widely used. In particular, portable terminals are reaching a mobile convergence phase of providing services, such as multimedia services, previously provided by other terminals, in addition to portable terminal services. As a representative example, a mobile communication terminal, which is a portable terminal, may provide various functions such as a TeleVision (TV) viewing function, a mobile broadcasting function, such as a digital multimedia broadcasting and a digital video broadcasting, a music replay function, such as a Motion Picture Experts Group (MPEG) Audio Layer 3 (MP3) function, a video and still camera function, a data communication function, an Internet connection function, a Near Field Communication (NFC) function, and other similar functions, in addition to general communication functions such as a voice call and a message transmission and reception.
Furthermore, as availability and use of portable terminals including a touch screen increase, due to convenience of input on the touch screen, portable terminals may provide a handwriting input function using the touch screen. The handwriting input function stores a message inputted by a user if the user inputs a message on a touch screen using a finger or a stylus. In addition, portable terminals may provide a handwriting message recognition function that converts a stored handwriting message into a text message. However, the handwriting message recognition function is not technologically mature. Hence, when checking a converted text message, in a case where there is an incorrectly recognized letter, the user may need to re-input the handwriting message in order to be re-recognized correctly, or may need to correct the converted text message using a letter input device.
Furthermore, the handwriting message recognition function may recognize a handwriting message using only a preset system language. In other words, the existing handwriting message recognition function does not provide a function that can re-recognize or reprocess a handwriting message after converting the language from the preset system language to another language. Hence, in a case where a handwriting message is written in a language other than the system language and is then incorrectly recognized, the user may need to return to a main screen, change the preset system language and re-recognize the handwriting message. Therefore, there is a need for a user interface in which a text message may be easily corrected in a text message display screen.
The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present invention.
Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a method and apparatus for providing a user interface of a portable terminal capable of easily editing a converted text message after converting a handwriting message into the text message.
In accordance with an aspect of the present invention, a method for providing a user interface of a portable terminal is provided. The method includes converting a handwriting message inputted on a touch screen into a text message, and outputting the text message on a display panel of the touch screen, outputting a candidate letter list when editing of the converted text message is requested, and correcting the text message using a candidate letter selected from the candidate letter list
In accordance with another aspect of the present invention, an apparatus for providing a user interface of a portable terminal is provided. The apparatus includes a touch screen for inputting a handwriting message when a handwriting input mode is activated, and a controller for converting the handwriting message to a text message, for controlling the touch screen to output a candidate letter list when editing of the converted text message is requested, and for correcting the text message using a candidate letter selected from the candidate letter list
Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
The above and other aspects, features, and advantages of certain exemplary embodiment of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
The terms and words used in the following description and claims are not limited to the bibliographical meanings, but, are merely used by the inventor to enable a clear and consistent understanding of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention is provided for illustration purpose only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.
A portable terminal according to an exemplary embodiment of the present invention is an electronic device having a touch screen, and some examples thereof are a mobile communication terminal, a Personal Digital Assistant (PDA), a smart phone, a tablet personal computer, and a Portable Multimedia Player (PMP), or other similar portable electronic devices.
Referring to
The wireless communication unit 150 forms a communication channel for a call, such as a voice call and a video call, with a base station, and may form a data communication channel for data transmission, and may form other Radio Frequency (RF) channels as well. To this end, although not shown, the wireless communication unit 150 may include a wireless frequency transmission unit that frequency-up-converts and amplifies a transmitted signal, a wireless frequency receiving unit that low-noise-amplifies and frequency-down-converts a received signal, and a transmission and reception separation unit that separates a received signal from a transmitted signal. In particular, the wireless communication unit 150 may transmit a text message, which is generated by converting a handwriting message, to another portable terminal.
The input unit 140 may include input keys and function keys for receiving an input of numbers, letters, or various characters and information, setting various functions and controlling the function of the portable terminal 100. In particular, the input unit 140 may input a signal that requests a handwriting mode execution, a signal that requests a text conversion of a handwriting message, a signal corresponding to editing of the text message, and other similar signals, in the controller 110. The input unit 140 may be a singular or a combination of input units, apparatuses or input devices, such as a button-type key pad, a ball joystick, an optical joystick, a wheel key, a touch key, a touch pad, a touch screen 130, and other suitable input devices.
The touch screen 130 may perform an input function and an output function. To this end, the touch screen 130 may include a display panel 131 that performs an output function and a touch panel 132 that performs an input function.
The touch panel 132 is mounted on a front side of the display panel 131, and may generate a touch event according to a contact of a touch input device, e.g., a user's finger or stylus, or other similar touch input devices, and transmits the generated touch event to the controller 110. The touch panel 132 may recognize a touch through a change of a physical quantity, such as capacitance and resistance, according to a contact of the touch input unit, and may transmit touch types (such as a tap, a drag, a flick, a double-touch, a long-touch and a multi-touch, or other similar touch types) and touched position information to the controller 110. The touch panel 132 may be any suitable touch panel type, and is known to those skilled in the art, and thus a detailed description thereof will be omitted herein for brevity.
The display panel 131 displays information inputted by a user or information provided to a user, as well as various menus and other information that is displayable. That is, the display panel 131 may provide various screens according to the use of the portable terminal 100, such as a standby screen, a home screen, a menu screen, a message writing screen, a call screen, a schedule writing screen, and an address screen, or any other similar screen. In particular, the display panel 131 may output a screen for inputting a handwriting message, a screen for displaying the text message, a screen for correcting the text message, a language list screen for selecting a language for re-recognizing the text message or the handwriting message. The details thereof will be explained later with reference to
The storage unit 120 may store user data, data transmitted and received during communication, as well as an operating system of the portable terminal 100 and an application program for other optional functions, such as a sound replay function, an image or video replay function, and a broadcast replay function, or other similar optional functions. For example, the storage unit 120 may store a key map or a menu map for operation of a touch screen 130. Here, the key map and the menu map may be constituted in various forms, respectively. For example, the key map can be a keyboard map, a 3*4 key map and a QWERTY key map, etc., or may be a control key map for controlling operation of a currently activated application program. Furthermore, the menu map may be a menu map for controlling operation of a currently activated application program. The storage unit 120 may store a text message, a game file, a music file, a movie file and a contact number, or other similar information. In particular, the storage unit 120 may include a handwriting recognition routine that converts a handwriting message inputted by a user on the touch screen 130 into a text message, a candidate letter providing a routine that provides a candidate letter when correction of a converted text message is requested, and a text message correction routine that substitutes at least part of the converted text message to a candidate letter, adds the candidate letter, or performs other similar functions with the candidate letter.
The handwriting recognition routine may analyze a handwriting message, compare the message with pre-stored letters, and recognize that the most similar letter has been inputted. At this time, non-selected similar letters may be provided as candidate letters when a correction is requested. For example, as a result of analyzing the handwriting message, in the state where a word “Good” has been considered most similar to the handwriting letters, from among words such as “Good” and “Mood”, then the word “Good” is displayed in the text message display screen. If correction of the word “Good” is requested, then the candidate letter providing routine may provide the word “Mood” as a candidate word. Furthermore, in a case where correction of the converted text message “Good” is requested, the candidate letter providing routine may provide candidate words that are expected based on the recognized text, such as “good”, “Goods”, “goodness”, “goodwill”, and other similar words. To this end, the storage unit 120 may store a dictionary for extracting expected candidate letters provided when correction of a text message is requested. The storage unit 120 may store any number of dictionaries for various languages and subjects.
The controller 110 may control overall operation of the portable terminal 100 and a signal flow between internal blocks, units or elements of the portable terminal 100, and a data processing function that processes data. In particular, the controller 110 may control a process of converting a handwriting message inputted by a user into a text message through a touch screen 130, and edit, correct and re-recognize the converted text message. To this end, the controller 110 may include a handwriting recognition unit 111. The handwriting recognition unit 111 may analyze a handwriting message, compare the message with pre-stored letters, and recognize that a most similar letter has been inputted. Further description and details of the controller 110 will be explained later with reference to
Furthermore, though not illustrated in
Referring to
If the handwriting mode is not activated, the controller 110 may perform a corresponding function at step 205. For example, the controller 110 may perform a music replay function, a video replay function, an Internet connection function, or other similar functions, or maintain the idle state according to the user's request. On the other hand, if the handwriting mode is activated, the controller 110 may output the handwriting input screen at step 207, and may sense the user's message, hereinafter referred to as a “handwriting message”, that is input at step 209. If the handwriting message input is sensed, then the controller 110 may store the handwriting message by storing touch location data changed according to the movement of the touch input device. The details of the handwriting input screen will be explained later with reference to
Next, the controller 110 may determine whether a text conversion of the handwriting message is requested at step 211. If the text conversion is not requested at step 211, then the controller 110 may determine whether a handwriting mode termination signal is inputted at step 212. If the handwriting mode termination signal is inputted, then the controller 110 may terminate the handwriting mode. On the other hand, if the handwriting mode is not terminated, the controller 110 may return to step 209.
Furthermore, in a case where a text conversion is requested at step 211, the controller 110 may convert the handwriting message into a text message at step 213. To this end, the controller 110 may include the handwriting recognition unit 111. If the conversion of the handwriting message is completed, then the controller 110 may control the touch screen 130 to output a text message screen indicating the text message at step 215. The details of the text message screen will be explained later with reference to
Next, the controller 110 may determine whether the editing of a text message is requested at step 217. If the editing is not requested, then the controller 110 may move to step 221. On the other hand, if the editing is requested, the controller 110 may provide editing of the text message according to the editing request at step 219. That is, the controller 110 may correct the text message or re-recognize at least part of the text message in another language. The details of such a method of editing the text message will be explained later with reference to
Next, the controller 110 may determine whether a return to the handwriting input screen has been requested at step 221. The return request may be inputted through a preset key, such as a cancel key, a user input or a menu. In the case where the return to the handwriting input screen is requested, then the controller 110 may return to step 207 and perform the above explained process. On the other hand, in a case where the return to the handwriting input screen is not requested, the controller 110 may determine whether a handwriting mode termination signal is inputted at step 223. If the handwriting mode termination signal is not inputted, then the controller 110 may return to step 217. On the other hand, if the handwriting mode termination signal is inputted, the controller 110 may terminate the handwriting mode.
Furthermore, though not illustrated in
Referring to
After the handwriting message is inputted, if the user executes a conversion menu, then the touch screen 130 may convert the handwriting message into text of a text message 20 and display the text message 20. For example, the touch screen 130 may output a first text message display screen including only a text message 20 as illustrated in the screen example 320 under the control of the controller 110. The first text message screen is scrollable. Furthermore, the touch screen 130 may display a second text message display screen which is divided into a text area 31 for displaying the text message 20 and a handwriting area 32 that displays a handwriting message 10, as illustrated in a screen example 330, under the control of the controller 110. The text area 31 and the handwriting area 32 are scrollable.
Referring to
The candidate letter list window 40 is scrollable. For example, the user may scroll a candidate letter list in a certain direction by touching a scroll menu 41 positioned at both ends of the candidate letter list window 40. However, the present invention is not limited thereto, and any suitable manner of displaying the scroll menu 41 may be used. For example, user may scroll a candidate letter list through a touch movement, such as a drag and a flick, within the candidate letter list window 40.
If a certain candidate letter is selected from the candidate letter list window 40, then the controller 110 may change a message “Tomonow” positioned at the touched point, as illustrated in the screen example 410, to a selected candidate letter “Tomorrow”, as illustrated in a screen example 430. However, the present invention is not limited thereto, and the candidate letter list may be output in the form of a pop-up window when a text message is touched, and incorrectly recognized part of the text message may be easily corrected by selecting one candidate from the candidate letter list, or any other suitable manner of displaying or outputting the candidate letter list may be used.
Referring to
In the state shown in the screen example 510, the user may select one of the letters included in the candidate letter display area 52. At this time, the controller 110 may additionally input a selected candidate letter in the area where the cursor 55 is located, as illustrated in the screen example 520. Furthermore, in the state illustrated in the screen example 510, in a case where there is no desired candidate letter in the candidate letter display area 52, the user may make more candidate letters outputted by extending the candidate letter display area 52 by touching an extension menu 53. Additionally, the user may correct the text message through the key area 51.
As discussed with reference to
Referring to
In such a state, in a case where the whole of the handwriting message is to be recognized, the user may input a preset menu key (not shown). If the preset menu key is inputted, then the controller 110 may output a re-recognition menu 63 at the bottom of the touch screen 130. If the re-recognition menu 63 is activated (e.g., touched), then the controller 110 may output a language list window 64 which can select a language to be used when re-recognizing a handwriting message, as illustrated in the screen example 620. If a language is selected from the language list window 64, then the controller 110 may re-recognize the incorrectly recognized message 62 in the selected language, and may change the incorrectly recognized message 62 to a re-recognized message 65 and may display the changed message. For example, in a case where a user selects Korean from the language list window 64, then the controller 110 may change the incorrectly recognized message 62 in English to a re-recognized message 65 in the selected language of Korean. Likewise, in a case where the handwriting message is written in a language other than the system language and is then incorrectly recognized, the present exemplary embodiment allows for the portable terminal 100 to easily re-recognize the incorrectly recognized message in another language without changing the system language. As such, the present invention may improve a user's convenience.
Referring to
If the setting of the re-cognition area is completed, then the controller 110 may output a menu window 70, as illustrated in the screen example 710. For example, the menu window 70 may include a copy menu 73 that copies a message of the selected area, a cut menu 74 that cuts a message of the selected area, and a re-recognition menu 75. However, the present exemplary embodiments are not limited thereto, and the menu included in the menu window 70 may include only a re-recognition menu 75 or may further include an additional menu according to designer's intention. Furthermore, the menu window 70 may be outputted when a preset signal is inputted after the setting of the re-recognition area is completed. For example, after the re-recognition area is set using a start mark 71 and a termination mark 72, in a case where a long touch signal of the start mark 71 or the termination mark 72 is inputted, the controller 110 may output a menu window 70.
If a re-recognition menu 75 is touched in the menu window 70, then the controller 110 may output a language list window 76 for selecting a language for re-recognizing a message included in the re-recognition area, as illustrated in a screen example 720. If a certain language is selected from the language list window 76, then the controller 110 may re-recognize a message included in the re-recognition area as the selected language, change the message included in the re-recognition area to a re-recognized message, and then output the changed message. For example, the controller 110 may change an incorrectly recognized message 77 to a corrected message 78 that is re-recognized in Korean, as illustrated in a screen example 730. Likewise, according to the present exemplary embodiments, the portable terminal 100 may select and re-recognize part of the text message. Hence, according to the present exemplary embodiments, in a case where only a portion of the text message is incorrectly recognized as a handwriting message mixed with multiple languages that is converted, only the incorrectly recognized portion may be re-recognized, thereby improving a user's convenience.
Referring to
After completing the setting of the area to be re-recognized through the area setting window 80, if the user touches the change menu window 82, the controller 110 may output the language list window 85, as illustrated in a screen example 820. If any one of the languages is selected from the language list window 85, the controller 110 may re-recognize the handwriting message of the selected area in the selected language, and may then output at least one re-recognized candidate letter in the candidate letter list window 82, as illustrated in a screen example 830. At this time, the controller 110 may change the conversion menu window 82 to the candidate letter list window 86, and output the candidate letter list. The candidate letter list window 86 is scrollable. If at least one the candidate letters outputted in the candidate letter list window 86 is selected, then the controller 110 may additionally input the selected candidate letter at a point where the cursor 84 of the text area 31 is positioned, as illustrated in a screen example 840. If the candidate letter is additionally inputted, then the controller 110 may change the candidate letter list window 86 to a conversion menu window 82.
Furthermore, in the state shown in the screen example 810, when the conversion menu window 82 is touched, the controller 110 omits a step of outputting the language list window 85, and proceeds with moving to the state shown in the screen example 830. In such a case, the controller 110 may re-recognize a handwriting message of the selected area in a preset system language through the area setting window 80, and output the candidate letter in the candidate letter list window 86.
Furthermore, as discussed above, a re-recognized text message is added at the touched point, such as the position of the cursor 84, but the present exemplary embodiments are not limited thereto. For example, as illustrated in
The foregoing method for providing a user interface of a portable terminal according to the exemplary embodiments of the present invention may be implemented in an executable program command form by various computer means and may be recorded in a non-transitory computer readable recording medium. In this case, the computer readable recording medium may include a program command, a data file, and a data structure individually or a combination thereof. In the meantime, the program command recorded in the non-transitory recording medium may be specially designed or configured for the present exemplary embodiments or be known to a person having ordinary skill in a computer software field to be used. The non-transitory computer readable recording medium includes magnetic media, such as a hard disk, a floppy disk, a magnetic tape, or other similar magnetic medias, Optical Media such as Compact Disc Read Only Memory (CD-ROM) or Digital Versatile Disc (DVD), Magneto-Optical Media such as floptical disk, and a hardware device such as a Read Only Memory (ROM), a Random Access Memory (RAM), a flash memory storing and executing program commands, or any other suitable non-transitory computer readable recording medium. Furthermore, the program command may include a machine language code created by a complier and a high-level language code executable by a computer using an interpreter. The foregoing hardware device may be configured to be operated as at least one software module to perform operations of the present exemplary embodiments.
As considered above, according to a method and apparatus for providing a user interface of a portable terminal according to exemplary embodiments of the present invention, a handwriting message is converted into a text message, and the converted text message may be easily edited. That is, at least part of the converted text message may be easily corrected, and at least part of a text message that is converted into a certain language may be easily re-recognized in another language, thus, improving user convenience.
While the invention has been shown described with reference to certain exemplary embodiments thereof, it will be understood by those skilled that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2011-0098782 | Sep 2011 | KR | national |
