Patent Application
20090201256
The present invention is directed to a portable terminal, more specifically to a portable terminal having inputting means using an image sensor and its input method.
Recently, a variety of communication terminals, such as mobile communication terminals, personal digital assistants, and notebook computers, have been developed. These communication terminals allow a user to utilize the device while in transit, and hence are becoming smaller for better portability. It is typical that the exterior of communication terminals consists of a display with an LCD, a key input with a plurality of key buttons, and an interface for linking with an external device. Among these components, the display is getting bigger in order to show more information more realistically. Considering that communication terminals are becoming smaller, it is necessary to reduce the size of the key input, or restructure the display and key input as in sliding phones.
The structure of the key input of a portable terminal is as follows: Portable terminals are equipped with an area of key input, such as keyboard or keypad, to allow a user to input commands into the terminal. Arranged with a certain pattern within the key input are function keys and alphanumeric keys. For instance, the key input of a mobile communication terminal has function keys for accessing the Internet wirelessly, another function keys for connecting and disconnecting a phone call, and alphanumeric keys for inputting numbers and letters, arranged in the upper, middle, and lower part, respectively.
The size of key buttons arranged in the key input of a portable terminal is designed to accommodate the finger size of the user, and pressing a key button depresses the key itself to turn on the electrical switch connected to the key button.
This structure causes a problem of inadvertently pressing a wrong key button, for example an adjacent button, if a compact design of the portable terminal were desired by shrinking the size of key buttons below a certain level.
Moreover, the difficulty of designing the key button size below a certain level, in effect, becomes a hindrance to compacting the size of portable terminals below a certain level.
In order to solve aforementioned problem, the present invention aims to provide a portable terminal having inputting means using an image sensor and its input method that enable compacting of portable terminals owing to eliminating the need to design key buttons to match the size of human fingers by realizing the key input of a portable terminal using an image sensor.
Another objective of this invention is to provide a portable terminal having inputting means using an image sensor and its input method that enable a correct operation corresponding to the intended key stroke despite the erroneous recognition by the terminal that a multiple number of key buttons are simultaneously pressed due to compact-sized key buttons.
Another objective of the present invention is to provide a portable terminal having inputting means using an image sensor and its input method that can solve the problem of key button malfunctions due to a variety of causes (e.g., foreign objects inserted between key buttons) from extended use of the portable terminal.
In order to achieve aforementioned objectives, an aspect of the present invention provides a portable terminal comprising a transparent solid plate mounted in a keypad area; an image sensor having unit cells of lattice type outputting an electrical signal corresponding to the light irradiated through the transparent solid plate; and a key selection recognizer generating and outputting a key button selection signal corresponding to the location of a unit cell that outputted the least electrical signal value by making reference to the size of the value of the electrical signal inputted from the unit cells.
A keypad image, on which a plurality of key buttons are arranged, is printed on one side of the transparent solid plate; or a transparent sticker, on which the keypad image is printed, is adhered to one side of the transparent solid plate; and each key button included in the keypad image is corresponded to at least one unit cell.
The portable terminal can further comprise an A/D converter converting an analog electrical signal outputted from the unit cell to a digital electrical signal and delivering to the key selection recognizer.
The image sensor of the portable terminal comprises a control switch for turning each unit cell on/off individually, and the control switch is controlled by the key selection recognizer.
The key selection recognizer determines if the value of the minimum electrical signal is smaller than a predetermined critical value and generates the key button selection signal only if the value of the minimum electrical signal is smaller than the critical value.
Another aspect of the present invention provides a recording medium recording a program organizing commands that are executable by a portable terminal (here, the portable terminal has a transparent solid plate in a keypad area and comprises an image sensor having unit cells of lattice type outputting an electrical signal corresponding to the light irradiated through the transparent solid plate, and a keypad image, on which a plurality of key buttons are arranged, is printed on one side of the transparent solid plate, or a transparent sticker, on which the keypad image is printed, is adhered to one side of the transparent solid plate, and each key button included in the keypad image is corresponded to at least one unit cell), for executing a method for recognizing a key button selected by a user, comprising the acts of receiving an input of electrical signal from at least one unit cell; determining whether the value of the electrical signal became smaller than the value of the immediately previous inputted electrical signal; recognizing, if it became smaller, a key button corresponding to a unit cell that outputted the electrical signal; and generating and outputting a key button selection signal corresponding to the recognized key button.
The program further receives an electrical signal input outputted by activating a unit cell of the latter sequence if the value of the electrical signal did not become smaller than the value of the immediately previous inputted electrical signal.
The steps of recognizing a key button corresponding to a unit cell that outputted the electrical signal comprise determining whether the value of the electrical signal is smaller than a predetermined critical value, if the value of the electrical signal became smaller than the value of the immediately previous inputted electrical signal; and recognizing, if it is smaller than a predetermined critical value, a key button corresponding to the location of a unit cell that outputted the electrical signal.
These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims, and accompanying drawings where:
The present invention, operative advantages of the present invention, and objectives achieved by embodying the present invention shall be apparent with reference to the accompanying drawings and the description therein.
Hereinafter, preferred embodiments of the present invention shall be described in detail with reference to the accompanying drawings. To aid overall understanding of the present invention, the same reference numbers shall be assigned to the same means, regardless of the figure number.
Referring to
A key input 110 is the means for receiving key selection signals corresponding to the function setting data and call command (e.g., selection of a phone number or call button) on a receiver from the user.
A key input 110 comprises an image sensor 140, A/D converter 145, and key selection recognizer 150.
The image sensor 140 consists of a plurality of unit cells in a lattice shape (Refer to
In general, an image sensor refers to an apparatus forming an image on an arrangement of MOS transistor or CCD memory to convert to an electrical signal.
For example, a unit cell (unit pixel) of a CMOS image sensor consists of a photodiode (PD) and 4 NMOS transistors (i.e., transfer transistor (Tx), reset transistor (Rx), drive transistor (Dx), and select transistor (Sx)). A unit cell uses a native transistor to sense the light of visible ray wavelength band in a photodiode (PD) region and accumulates the photogenerated charge, which is transported to a floating diffusion (FD) region to, in effect, output the photogenerated charge, delivered to the gate of Dx, as an electrical signal through Vout.
The A/D converter 145 converts analog electrical signals, received from the image sensor 140, to digital output signals and sends to the key selection recognizer 150.
The key selection recognizer 150 uses output signals outputted from the unit cells of lattice type and converted to digital signals to determine which key areas are selected, and delivers the corresponding key button information to the control unit 130. The key selection recognizer can analyze the image captured by the image sensor 140 to identify the selected key area. This can be done because the area on which an image is captured is displayed dark if the size of the output signal of a certain unit cell is reduced.
In other words, the key selection recognizer 150 can either recognize that a key area corresponding to one or more unit cells showing the smallest (or relatively small) value is selected among the output signals outputted sequentially from each unit cell or use the output signal of each unit cell to recognize that a key area corresponding to the darkest (or relatively dark) area is selected in the generated image. Although the description will be limited to the first method hereinafter, those of ordinary skill in the art shall be able to easily embody the second method.
Although unillustrated, the key input 110 can further comprise a separate power unit to turn on the power on a portable terminal 100. This is because the image sensor 140 and key selection recognizer 150 may not operate while the power is off on the portable terminal 100. The power button can be located on one side or the back of the portable terminal 100.
Although a power button is not prepared on the key input 110, the power-on command can be automatically recognized when the battery, which was separated from the portable terminal 100, is installed on the portable terminal 100.
As shown in
As shown with 210, the surface of the solid plate can be printed with an arrangement of key buttons that are similar to the keypad pattern of a typical portable terminal or can be adhered with a transparent sticker, on which a key button arrangement is printed. Furthermore, the key area corresponding to each key button is set to correspond to one or more unit cells of the image sensor 140 located underneath,
That is, when the user places a finger in a key area, the unit cells corresponding to the key area will get relatively smaller amount of light irradiated, and as a result outputs an output signal of a smaller size. The key selection recognizer 150 compares the values of output signals inputted sequentially from the unit cells of the image sensor 140 (or analyzes the image captured by the image sensor 140) to determine which key area the placement of the user's finger corresponds, and recognizes the key button the user selected.
Each unit cell is equipped with a control switch (to turn off the operation of the unit cell) that can be controlled externally, and the key selection recognizer 150 can receive the output signal of each unit cell sequentially by controlling the switch equipped in each unit cell. The method of recognizing the selected key button by the key selection recognizer 150 will be described later in detail with reference to a relative drawing.
Referring back to
The communication unit 120 carries out the function of receiving a voice signal from a mobile communication service system, or transmitting a voice signal to a mobile communication service system. In case the user tries to use a wireless Internet service, it receives the corresponding data from a mobile communication service system. Of course, the communication unit 120 can be a plurality, depending on the usage.
The sound outputting unit 125 serves the means for outputting the received voice signals or ring tones for incoming calls.
The control unit 130 controls the key input 110, display 115, communication unit 120, and sound outputting unit 125 for the control of a portable terminal 100.
Although not illustrated in
Referring to
Step 310 is carried out when the user instructs the portable terminal 100 to operate (e.g., when the user flips the folder-type portable phone open), and steps between 310 and 370 can be repeated at predetermined intervals.
In step 315, the key selection recognizer 150 determines if the value of an inputted output signal became relatively smaller than the value of a previously inputted output signal from another unit cell. Relative reduction in the value of output signal from a unit cell means a relatively smaller amount of light irradiated to the photodiode of the unit cell. It also means that an object is present in a key area corresponding to the unit cell in the plurality of key button images printed on the solid plate. Relative reduction in the value of output signal can also be determined by the brightness of a generated image.
If the value of the current output signal inputted from a unit cell is relatively smaller, the data on the reduced cell (e.g., location, output signal value, corresponding key, etc.) are temporarily stored in a storage in step 320, and step 330 is carried out. If, however, the value of the output signal currently inputted from a unit cell is not relatively smaller, step 330 is immediately carried out.
In step 330, the key selection recognizer 150 determines if output signals from all unit cells included in the image sensor 140 are read. The key selection recognizer 150 controls a control switch corresponding to (or operating in relation with) each unit cell not only to sequentially receive the output signal from each unit cell but also to determine by which unit cell the output signal is currently received. If output signals from all unit cells are not read, step 340 is carried out to control the control switch corresponding to the next unit cell and receive the output signal. If, however, output signals from all unit cells are read, step 350 is carried out.
In step 350, the key selection recognizer 150 extracts the data on a cell having the least output signal value, using at least one cell data stored in the storage. Of course, as described earlier, one or more areas that are the darkest (or relatively dark) can be selected from the generated image, using output signals of all cells.
The key selection recognizer 150 recognizes, in step 360, a key button on which the user's finger is placed, using the cell data having the least output signal value, and in step 370 sends the recognized key button data to the control unit 130. In step 360, the methods for recognizing a key button can include reading the relevant data if a key button data corresponding to a cell data stored through step 320 is included and identifying a key area corresponding to the relevant location data if only the location data is included in the relevant cell data.
Referring to
In step 315, the key selection recognizer 150 determines if the value of an inputted output signal became relatively smaller than the value of a previously inputted output signal from another unit cell.
If the value of the current output signal inputted from a unit cell is relatively smaller, the data on the reduced cell (e.g., location, output signal value, corresponding key, etc.) are temporarily stored in a storage in step 320, and step 330 is carried out. If, however, the value of the output signal currently inputted from a unit cell is not relatively smaller, step 330 is immediately carried out.
In step 330, the key selection recognizer 150 determines if output signals from all unit cells included in the image sensor 140 are read. If output signals from all unit cells are not read, step 340 is carried out to control the control switch corresponding to the next unit cell and receive the output signal. If, however, output signals from all unit cells are read, step 510 is carried out.
In step 510, the key selection recognizer 150 extracts an output signal value that is smaller than a predetermined threshold value, using at least one cell data stored in the storage. This is to prevent any erroneous operation by objects other than human fingers, by considering that a key button is not pressed if an output signal value is smaller than the threshold value. For setting the key button to be operable by operation tools, such as a stylus, the output signal value when a key button is selected using the operation tool can be set as the threshold value.
If an output signal value smaller than the predetermined threshold value is extracted, the key selection recognizer 150 recognizes the location of a unit cell corresponding to the extracted output signal value in step 520, and step 530 is carried out to recognize a key button corresponding to the cell location. As described earlier, steps 520 and 530 can be combined in one step if a key button data corresponding to the cell data stored through step 320 is included. Thereafter, the key selection recognizer 150 sends the recognized key button data to the control unit 130.
A portable terminal 100 may have to select a plurality of key buttons simultaneously, for example the shift key+“a.” The key button recognition method, illustrated in
Of course, portable terminals 100, such as mobile communication terminals, that are conventionally manufactured and marketed, are operated by sequentially selecting a key button at a time. Hence, the key selection recognizer 150 may treat a simultaneous selection of a plurality of key buttons by a user as an error. In this case, if the key selection recognizer 150 extracts, in step 510, an output signal value having the least value, and determines whether the extracted output signal value is smaller than the threshold value, occurrence of error or erroneous operation can be minimized.
Referring to
In step 315, the key selection recognizer 150 determines if the value of an inputted output signal became relatively smaller than the value of a previously inputted output signal from another unit cell.
If the value of the current output signal inputted from a unit cell became relatively smaller, step 610 is carried out, and the key selection recognizer 150 determines whether the inputted output signal value is smaller than the predetermined threshold value.
If the output signal value is smaller than the threshold value, the key selection recognizer 150 recognizes the cell location, in step 620, corresponding to the current inputted output signal value, and step 630 is carried out to recognize a key button corresponding to the recognized cell location. Thereafter, the key selection recognizer 150 sends the recognized key button data to the control unit 130.
If, however, the value of the output signal currently inputted from a unit cell did not become relatively smaller, step 330 is immediately carried out.
In step 330, the key selection recognizer 150 determines if output signals from all unit cells included in the image sensor 140 are read. If output signals from all unit cells are not read, step 340 is carried out to control the control switch corresponding to the next unit cell and receive the output signal. If, however, output signals from all unit cells are read, the process is stopped.
Earlier, a key input 110 using an image sensor was described with reference to
The accompanying drawings and detailed description are only an example of the present invention, serve only for describing the present invention, and by no means limit or restrict the spirit and scope of the present invention. Thus, any person of ordinary skill in the art shall understand that a large number of permutations and other embodiments are possible. The true scope of the present invention must be defined only by the spirit of the appended claims.
As described above, the portable terminal having inputting means using an image sensor and its input method, based on the present invention, realizes the key input of a portable terminal using an image sensor, eliminating the need to design the size of key button to fit the size of human fingers and enabling portable terminals to be designed smaller.
Moreover, the present invention allows a normal operation by the key button the user intended although a plurality of key buttons are recognized to have been pressed by the user's finger due to the compact size of key buttons.
Furthermore, the present invention can solve the problem of key button malfunctions due to a variety of causes (e.g., foreign objects inserted between key buttons) from extended use of the portable terminal.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1020040084743 | Oct 2004 | KR | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/KR2005/003449 | 10/14/2005 | WO | 00 | 4/20/2007 |
