The present invention relates to a pointing device and, more particularly, to a pointing device to operate a handheld terminal using a finger.
Pointing devices generally include XY tablets, trackballs and mouse that are used for stationary devices such as desktop computers, and touch screen panels (hereinafter referred to as “TSPs”) and touch pads that are used for portable electronic devices such as notebook computers.
The XY tablet is a means for calculating position variation of the magnetic field, which is generated by the flow of electric current, with a separate magnetic field sensor. In detail, electric currents are successively applied to a lattice consisting of two-dimensional conductors toward X or Y direction to generate a magnetic field. The XY tablet comprises a magnetic field sensor connected with an XY tablet body.
The trackball includes an appropriate fixing member to prevent a rolling spherical ball from getting derailed, and at least two rotation speed detectors that detect the rotation of the ball. The trackball represents the rotation of the ball as two-dimensional movement using the rotation speed detectors.
The ball mouse is a device applying the principle of the trackball by contraries. In the ball mouse, instead of a ball, the trackball device itself moves to rotate the ball relatively. Therefore, the ball mouse represents the two-dimensional movement using the movement of the trackball device itself.
The TSP includes two flat resistance films positioned adjacently each other. If a user presses the panel with a sharp-end means such as a ball-point-pen, the resistance films in the pressed point contact each other to form a resistance circuit. Through an appropriate combination of these circuits, the position of contact between the resistance films can be calculated two-dimensionally.
Such an optical mouse device calculates the movement distance of the optical mouse using an appropriate operation means (25) and a motion detector (30) based on the coordinate change. Particularly, in order to determine the movement distance, the motion detector (30) adopts a motion estimation method. The conventional optical mouse sends light through a hole (40) formed through the bottom of its casing (35) toward the surface (20) of an object on which the optical mouse is positioned. The light emitting means is generally a light emitting diode (LED). In addition, the conventional optical mouse device adopts a structure to minimize errors caused by specular light directly reflected from the surface (20).
However, these conventional pointing devices have several disadvantages. For example, the TSP can activate a desired icon by pressing the icon with a sharp-end tool to operate a machine. However, the TSP requires users to use both hands, holding the TSP by one hand and using the sharp-end tool by the other hand. In addition, users are disabled to use the TSP whenever the sharp-end tool is mislocated or not available. The ball mouse and optical mouse are difficult to be applied to portable electronic devices of small size because of the intrinsic limitations of their movement structure.
However, in the conventional portable electronic devices, a considerable part in the top area has to be assigned to the touch pad. As an alternative, the mouse device can be coupled to a connection port of the portable electronic device, but, in this case, the user has to carry separately the mouse with the portable electronic device.
Korean Patent Publication No. 2002-14430 discloses a portable wireless information terminal having a pointing device to effectively utilize application programs under the GUI environment. In the above-mentioned portable wireless information terminal, the pointing device, which includes a ball and a sensor for sensing rotational position, is mounted on the lower side of the information terminal to freely move a cursor on an LCD (liquid crystal display).
However, the above-mentioned prior art has a problem that it is restricted to a ball mouse because the pointing device employs a ball installed in a concave groove of a housing. In addition, the ball is protruded outside from the lower side of the portable terminal, thereby causing inconvenience in use.
The present invention provides a pointing device comprising a light emitting means for illuminating a subject; a hole through which light from the light emitting means is transmitted; an image-acquisition area for taking an image of the subject from the transmitted light; an image-formation means for forming an image by focusing the light reflected from the image-acquisition area; a conversion means for converting the image formed by the image-formation means into an electric signal; and an operation means for detecting the change of the image and calculating the amount of the change using the electric signal output from the conversion means. Here, the subject is preferably the surface of a finger, a lattice, or any perceivable pattern.
In a second embodiment, the present invention provides a pointing device comprising a light emitting means; a light guide structure for guiding light from the light emitting means to a subject; an image-acquisition area for taking an image of the subject from the guided light; an image-formation means for forming an image by focusing the light reflected from the image-acquisition area; a conversion means for converting the image formed by the image-formation means into an electric signal; and an operation means for detecting the change of the image and calculating the amount of the change using the electric signal output from the conversion means. Here, the subject is preferably the surface of a finger, a lattice, or any perceivable pattern.
As a third embodiment, the present invention provides a pointing device comprising a light emitting means; a light guide structure for guiding light from the light emitting means to a subject; an image-acquisition area for taking an image of the subject from the guided light; an image-formation means for forming an image by focusing the light reflected from the image-acquisition area; a housing coupled to the image-formation means; a conversion means for converting the image formed by the image-formation means into an electric signal; a printed circuit board on which the conversion means is fixed; a cover for protecting the light emitting means, the image-formation means, the housing, the conversion means, and the printed circuit board; and an operation means for detecting the change of the image and calculating the amount of the change using the electric signal output from the conversion means.
Further objects and advantages of the invention can be more fully understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
Such a pointing device is mounted on a portable electronic device and acquires changing images. In other words, a user can conveniently control a pointer on the screen of portable electronic device using the surface of his/her finger. The movement of a finger causes the change of image in the image-acquisition area. The distance and direction for the pointer to be moved can be calculated through the analysis of the change of image due to the movement of a finger.
The pointing device according to the present invention comprises a light emitting means (100), an image-acquisition area (not shown), an image-formation means (120), a conversion means (130), a motion detector (140), and an operation means (150). These component parts are described in detail.
The light emitting means (100) emits light to illuminate a contact subject (110) controlling a pointer. The contact subject (110) is preferably the surface of a user's finger, a lattice, or any perceivable pattern. The light emitting means (100) is preferably an LED, a laser diode, or an organic electroluminescence.
The image-acquisition area (not shown) acquires movement data using the light illuminated from the light emitting means (100). The image-acquisition area is positioned at a predetermined distance from the image-formation means (120). The image-acquisition area is preferably a housing with a transparent member whose surface in contact with the contact subject (110) is flat and made of transparent material. The housing is preferably coated to prevent the surface of the image-acquisition area from damage or contamination. Additionally, the image-acquisition area may be a virtual plane positioned at a predetermined distance from the image-formation means (120).
The image-formation means (120) forms an image on the opposite side by focusing the light reflected from the image-acquisition area. The image-formation means (120) may be an optical lens, preferably a spherical or non-spherical lens or a mirror.
The conversion means (130) detects the analog image formed by the image-formation means (120) and converts it into a digital image. The conversion means (130) is preferably an optical sensor array in which a plurality of CMOS image sensors or CCD (charge coupled device) image sensors are arranged in two-dimensional form.
The motion detector (140) perceives the extent of movement through the digital image received from the conversion means (130) using a motion estimation method. The motion detector (140) uses a motion estimator.
The operation means (150) receives the extent of movement, e.g., shift data from the motion detector (140) and calculates the distance and direction for the pointer to be moved. The operation means (150) is coupled to the pointing device or the processor of a machine on which the pointing device is mounted. Accordingly, the processor can control the pointer on the screen of a display device so that it can be freely moved toward a desired direction by a desired distance.
In
For example, the light from a light emitting diode is illuminated onto the finger surface and reflected according to a pattern of the finger surface. The light reflected from the finger surface forms an image on the surface of the CMOS image sensor or CCD image sensor array through the lens. The formed image is converted into an electric signal by the CMOS image sensor or the CCD image sensor array and entered into a signal processing part to be changed into a digital image.
The above-mentioned image acquisition is performed very rapidly on a real-time base. The motion estimator detects the extent of change between images by comparing the images formed in two adjacent time sequences. The detected movement implies movement of a finger in the adjacent time sequences. Thus, the present invention can embody the pointing device such as a mouse device of a computer using the finger movement.
A conventional mouse device needs a large flat area on which the mouse device is moved, but the present invention can embody the pointing device within a small space by minimizing the size of the image-acquisition area.
In general, the change of distance between the finger surface and the image-acquisition area causes images to be unclear, thereby making the movement analysis difficult. However, by using the transparent plate (180) to shorten the focal length of lens, the pointing device of the present invention can avoid this problem. In detail, in order to maintain uniformly the distance between the contact subject and the image-acquisition area, the present invention employs the transparent plate (180) so that the finger moves on the flat area.
In addition, when the finger surface (110) moves, the dimension and position of the shadow of the finger may change to cause error because of an outside three-dimension lighting. This problem can be solved with two LEDs (102, 104).
Referring to
Preferably, the portable electronic device (300) additionally comprises at least a selection button (330) connected to the pointing device (310). The selection button (330) is used to select a target with the pointer moved by the pointing device (310) or to enter a command. Here, the portable electronic device (300) uses a secondary battery as a main power source.
The contact sensor (350) may be internally connected with on-off terminals of the conversion means and the light emitting means so as to control the on or the off state of the conversion means and the light emitting means according to the “contact” or “non-contact” status with the subject using hardware. The output of the contact sensor (350) may be connected with the control part (210) so as to control the on or the off state of the conversion means and the light emitting means using software.
In addition, the contact sensor (350) is preferably placed around the image acquisition area within a radius of about 3 cm from the center of the image acquisition area and can be embodied by both contact and non-contact fashion.
When a user employs a portable electronic device equipped with the pointing device, he or she may use a program that does not require the pointing device. In that case, he or she may push the contact sensor instead of a desired button by mistake. To avoid the accidental operation of the pointing device due to such a mistake, the portable electronic device with the pointing device may be programmed so that the contact sensor operates the pointing device in case of a program requiring the pointing device and the pointing device is turned off in case of a program requiring no pointing device.
For example, where a game using only arrow keys does not need the pointing device, the pointing device is automatically turned off by means of an appropriate programming while the game is displayed on a screen.
A printed circuit board (420) is installed into the housing (410). The light emitting means (440), the conversion means (450), and parts containing circuits for operation are mounted on the printed circuit board (420). A cover (430) is used to maintain constantly the shape of the finger surface in contact with the area in the top of the pointing device. In addition, the cover (430) can protect the light emitting means (440), the image-formation means (400), the housing (410), the conversion means (450), and the printed circuit board (420) from contamination such as dust.
As shown in
On the other hand, the pointing device of the present invention may employ the surface of a palm, the surface of the back of a hand, and all types of objects with a surface similar to a finger surface as well as the finger surface as a means to control the pointer.
The foregoing embodiments are merely exemplary and are not to be construed as limiting the present invention. The present teachings can be readily applied to other types of apparatuses. The description of the present invention is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art.
Thus, the pointing device in accordance with the present invention can be embodied in a small space through the minimization of the image-acquisition area. In addition, the pointing device needs not a mouse pad or a flat surface. The pointing device can be embodied on portable electronic devices such as cellular phones and PDAs because it is small in size.
Number | Date | Country | Kind |
---|---|---|---|
R10-2003-0022936 | Apr 2003 | KP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/KR04/00840 | 4/12/2004 | WO | 2/17/2005 |