Patent Application
20120319977
The present invention relates to a display device equipped with a touch panel, to a method for controlling the same, and also to a control program and a recording medium for the same. More particularly, the present invention relates to a display device equipped with a touch panel that can easily and accurately be operated, to a method of controlling the same, and also to a control program and a recording medium for operating the same.
Conventionally, display devices that can display sub-images such as on-screen menus over the main image have been known. Such display devices, when combined with a touch panel, can be configured as input operation type display devices (display devices equipped with a touch panel).
Normally, images displayed on the input operation type display device can be shifted by touching the image with a finger, and then moving the finger in a desired direction.
The touch panel of the input operation type display device normally has a function for removing operation errors caused by touch operations performed at two locations within a prescribed time period.
A known example of the technology for removing the operation error of the touch panel does not just determine the coordinates (location) of a touch on a resistive touch panel based on the resistance voltage division ratio, but also distinguishes a one-point touch from a two-point touch based on the current that flows as a result of the touch operation.
Another known technology aims at using the two-point touch operation on the touch panel to change a variety of image display styles (see Patent Document 1, for example).
Specifically, as shown in
Further, the display device 200 disclosed in Patent Document 1 is controlled as shown in the flowchart in
According to the flowchart shown in
If the direction of the line segment is determined to be vertical or horizontal in step S114, (step S114: vertical/horizontal), in step S118, the control unit 100 determines whether an on-screen menu for defining individual regions for a plurality of soft keys 132 is being shown on the display of the image display unit 120 or not. If the on-screen menu is being displayed (step S118: Y), the control unit 100 further determines in step S119 whether the coordinates of the two points calculated by the line segment calculation section 101 are both located on the on-screen menu. Based on the result, the control unit 100 determines whether the two-point touch operation on the touch panel 111 has been performed on the on-screen menu or not. If the two-point touch operation on the touch panel 111 is determined to have been performed on the on-screen menu in step S119 (step S119: Y), the display change section 102 of the control unit 100 displays another on-screen menu defined as shortcuts of the above-mentioned on-screen menu in step S120, and ends this process in the display control method in the navigation independent mode. On the other hand, if, in step S119, the two-point touch operation is determined not to have been performed on the on-screen menu (step S119: N), the display change section 102 displays a vertical on-screen menu, which is different from the previous horizontal on-screen menu, on the display shown in step S121, and ends this process in the display control method. If the on-screen menu is determined not being displayed in step S118 (step S118: N), the display change section 102 also displays the vertical or horizontal on-screen menu in step S121.
Patent Document 1: Japanese Patent Application Laid-Open Publication No. 2007-241410 (published on Sep. 20, 2007)
However, in the conventional display device equipped with a touch panel described above, a finger must be moved to shift a displayed image, because a desired image is displayed based on how the coordinates (location) of a touch change over time.
Also, when two points are touched, the display device equipped with a touch panel disclosed in Patent Document 1 above controls the displayed image based on the coordinates and the slope and length of the line connecting the two points. Therefore, an unintentional touch on the second point after the first point is touched can cause an operation error.
The present invention was devised in consideration of the problems with conventional technology described above, and is aiming at providing a display device equipped with a touch panel that allows the displayed image to be shifted without moving a finger and is not likely to cause operation error, i.e., the display device allowing easy and accurate operation, and a control method for such a display device.
In order to solve the problems described above, a display device equipped with a touch panel of the present invention includes a touch panel that accepts a touch operation by a plurality of fingers of a user and outputs information indicating the nature of the touch operation, and a display panel that displays images based on the above-mentioned information, wherein the above-mentioned touch panel includes a touch input section, a finger location detecting section, a fingertip orientation detecting section, and an information output section, and wherein the touch input section receives a touch operation performed by fingers of a user, the finger location detecting section detects the locations of the fingers used to perform the touch operation, the fingertip orientation detecting section detects the fingertip orientations of the fingers used to perform the touch operation, and the information output section outputs information on the locations of the fingers detected by the finger location detecting section and the fingertip orientation detected by the fingertip orientation detecting section.
According to the configuration described above, because the locations of the fingers can be detected by the finger location detecting section, the starting point of the operation can be determined. Further, because the orientation of the fingertip can be detected by the fingertip orientation detecting section, the direction of the operation can be determined. Thus, a displayed image can be modified based on the starting point of the operation and the direction of the operation.
As a result, a display device equipped with a touch panel according to the present invention does not require a user to move his/her finger to shift a displayed image and also it does not easily cause operation errors. Consequently, the display device can easily and accurately be operated.
In order to solve the problems described above, a method for controlling a display device equipped with a touch panel of the present invention includes: a touch input step of receiving a touch operation performed by a user using a plurality of fingers; a finger location detection step of detecting the locations of fingers used to perform the above-mentioned touch operation; a fingertip orientation detection step of detecting fingertip orientations of the fingers used to perform the above-mentioned touch operation; an information output step of outputting information on the finger locations detected in the finger location detection step and the fingertip orientations detected in the fingertip orientation detection step; and an image display step of displaying images based on the information outputted in the information output step.
According to the configuration described above, the starting point of operation can be determined, because a finger location can be determined in the finger location detection step. Further, direction of operation can be determined, because the fingertip orientation can be detected by the fingertip orientation detection step. Consequently, a display image can be modified based on the starting point of the operation and the direction of the operation.
As a result, in a method for controlling the display device equipped with a touch panel of the present invention, a user does not have to move his/her finger to shift a displayed image, and operation errors are not likely to occur. Therefore, an easy and accurate control of the display device becomes possible.
As described above, a display devise equipped with a touch panel of the present invention includes a touch panel that receives a touch operation by a plurality of fingers of a user, and outputs information indicating the nature of the touch operation; and a display panel that displays images based on the above-mentioned information, wherein the touch panel includes a touch input section, a finger location detecting section, a fingertip orientation detecting section, and an information output section, and wherein the touch input section receives a touch operation performed by fingers of a user, the finger location detecting section detects locations of the fingers used to perform the touch operation, the fingertip orientation detecting section detects fingertip orientations of the fingers used to perform the touch operation, and the information output section outputs information on the locations of the fingers detected by the finger location detecting section and on the fingertip orientation detected by the fingertip orientation detecting section.
As a result, a display device equipped with a touch panel of the present invention can be operated easily and accurately.
As described above, a method for controlling the display device equipped with a touch panel of the present invention includes: a touch input step of receiving a touch operation performed by a user using a plurality of fingers; a finger location detection step of detecting the location of the fingers used to perform the above-mentioned touch operation; a fingertip orientation detection step of detecting fingertip orientations of the fingers used to perform the above-mentioned touch operation; an information output step of outputting information on the finger location detected in the finger location detection step and on the fingertip orientation detected in the fingertip orientation detection step; and an image display step of displaying images based on the information outputted in the information output step.
Therefore, in the method of controlling the display device equipped with a touch panel of the present invention, an easy and accurate control becomes possible.
An embodiment of the present invention is described in detail below. However, the scope of the present invention is not limited to the descriptions. Embodiments other than described below as an example can also be appropriately modified within the spirit of the present invention. Specifically, the present invention is not limited to embodiments described below. Various changes can be made within the scope of the appended claims. That is, embodiments obtained by combining technological means modified within the scope of appended claims are also included in the technological scope of the present invention.
A display device equipped with a touch panel according to the present invention includes a touch panel that receives a touch operation by a plurality of fingers of a user and outputs information on the nature of the touch operation, and a display panel that displays images based on the above-mentioned information. The touch panel includes a touch input section, a finger location detecting section, a fingertip orientation detecting section, and an information output section. The touch input section receives a touch operation performed by fingers of a user, the finger location detecting section detects the position of the fingers used to perform the touch operation, the fingertip orientation detecting section detects the fingertip orientations of the fingers used to perform the touch operation, and the information output section outputs information on the position of the finger detected by the finger location detecting section and on the fingertip orientation detected by the fingertip orientation detecting section.
In the present invention, no particular finger is specified as any of the plurality of fingers. For example, when two fingers are used, the two fingers may be neighboring fingers of one hand, such as the index finger and the middle finger, or the middle finger and the ring finger. Alternatively, two non-neighboring fingers of one hand, such as the index finger and the ring finger, or the index finger and the little finger, may be used. Further, one finger from one hand and another finger from the other hand, such as a right index finger and a left index finger, or a right index finger and a left middle finger, may also be used. However, to obtain equal fingertip orientations from two fingers, preferably two fingers of one hand are used for the touch operation. The statement above about the use of two fingers also applies to the use of three or more fingers.
In a display device equipped with a touch panel according to the present invention, preferably the information output section outputs the above-mentioned information when the fingertip orientations of the fingers used to perform the touch operation are identical.
In the present invention, when fingertip orientations are identical, it does not mean that the fingertip orientations of the plurality of fingers are exactly the same, but means that angles of the lines extending straight from the respective plurality of fingers are within a range considered identical for the content of the process.
In a display device equipped with a touch panel according to the present invention, preferably, the information output section outputs the above-mentioned information when the shortest distance of the distances between the plurality of fingers used to perform the touch operation is at least equal to the shorter radius, longer radius, or the radius of the smallest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation, and is no greater than the shorter radius, the longer radius, or the radius of the largest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation.
Here, the above-mentioned shortest distance is determined in the following manner. When the contact surface formed between the finger and the touch panel is observed with the fingertips on the top side, if the contact surface forms a vertically long oval shape, the shortest distance is evaluated by referring to the shorter radius and the shorter diameter. If the contact surface forms a horizontally long oval shape, the shortest distance is evaluated by referring to the longer radius and the longer diameter. If the contract surface is a circle, the shortest distance is evaluated by referring to the radius and the diameter of the circle.
In the present invention, the shortest distance of the distances between the plurality of fingers means the distance between any most closely located two points of points each representing the location of one of the plurality of fingers.
Here, the panel driver circuit 31, the liquid crystal panel with built-in sensors 32, the backlight 33, the backlight power supply circuit 34, the A/D converter 36, and the illuminance sensor 27 are included in the display panel of the display device equipped with a touch panel 50. On the other hand, the MPU 38 may be included as an external device, separate from the display panel or the touch panel, or may be built in the display panel.
The liquid crystal panel with built-in sensors 32 (hereinafter also referred to as “liquid crystal panel 32”) includes a plurality of pixel circuits and a plurality of optical sensors, which are arranged two-dimensionally. The liquid crystal panel 32 is described in detail below.
To the display panel, a display data Din, which is outputted from the display processing section 35, is inputted. The inputted display data Din is supplied to the panel driver circuit 31. The panel driver circuit 31 writes a voltage corresponding to the display data Din to the pixel circuit of the liquid crystal panel 32. Thus, on the liquid crystal panel 32, an image based on the display data Din is displayed by the pixels.
The backlight 33 includes a plurality of LEDs (Light Emitting Diode), and projects the light (light from the backlight) to the back surface (the surface on the side opposite from the user) of the liquid crystal panel 32. The backlight power supply circuit 34 switches between sending and not sending the power supply voltage to the backlight 33 in accordance with the backlight control signal BC outputted from MPU 38, which is based on the ambient environmental illumination level LX of the output from of the illuminance sensor 27. Hereinafter, it is assumed that the backlight power supply circuit 34 supplies the power supply voltage when the backlight control signal BC is at a high level, and does not supply the power supply voltage when the backlight control signal BC is at a low level. The backlight 33 turns ON when the backlight control signal BC is at the high level, and turns OFF when the backlight control signal BC is at the low level.
The liquid crystal panel 32 outputs the output signal of the optical sensor as a sensor output signal SS. The A/D converter 36 converts the sensor output signal SS, which is analog, to a digital signal. The output signal of the A/D converter 36 represents the information received by the touch input section (not shown) of the touch panel. Then, the D/S converter 37 converts this digital signal to a scan image as necessary.
Based on the sensor output signal SS (digital signal), MPU 38 performs a process for identifying the finger location and the fingertip orientation of a touch from the information detected by the finger location detecting section 28 and the fingertip orientation detecting section 29 of the touch panel and outputted by the information output section (not shown), and determines the coordinates (location) and the direction of the touch. Specifically, based on the sensor output signal SS (digital signal) from the liquid crystal panel 32 and/or the scan image, MPU 38 calculates whether any coordinates are touched (pressed), and further, if any coordinates are determined to be touched (pressed), calculates the fingertip orientation of the finger that is touching (pressing). Then, MPU 38 outputs data such as coordinates. Next, MPU 38 conducts an event judgment process based on the outputted coordinates data. Specifically, based on the coordinates data outputted after the coordinates determination process, MPU 38 determines whether the touch was a multi-touch (multi-point pressing), a single touch (one point pressing), a coordinates process, or a gesture for drawing a straight line, a circle, or the like. After that, based on the event judgment, MPU 38 runs an application. Specifically, based on the event judgment, MPU 38 runs a program that performs input and output, and calculation.
After that, based on the information outputted from the program that was run, the display processing section (information output section) 35 conducts a display process. Then, based on the information processed by the display process, the display processing section 35 outputs the display data Din to the panel driver circuit 31 in the display panel.
In the present invention, no gesture (operation involving finger movements) is necessary to shift the displayed image. However, gestures are not intended to be prohibited. Cases in which gestures are used to shift displayed images may be within the scope of the present invention.
A method for controlling a display device equipped with a touch panel of the present invention includes: a touch input step of receiving a touch operation performed by a plurality of fingers of a user; a finger location detection step of detecting the locations of the fingers used to perform the touch operation; a fingertip orientation detection step of detecting the fingertip orientation of the fingers used to perform the touch operation; an information output step of outputting information on the locations of the fingers detected in the finger location detection step and on the fingertip orientation detected in the fingertip orientation detection step; and an image display step of displaying an image based on the information outputted in the information output step.
Preferably, a method for controlling the display device equipped with a touch panel of the present invention further includes a fingerprint detection step of generating a detection signal in accordance with the fingerprints (especially the fingerprint pattern) of the fingers used to perform the touch operation.
Specifically, a method for controlling the display device equipped with a touch panel of the present invention is controlled as shown in the function block diagram of the display device equipped with a touch panel 50 shown in
In a display device equipped with a touch panel of the present invention, the fingertip orientation detecting section detects the fingertip orientation according to the edge strength of the sensor image obtained, for example. This is described in detail with reference to
a) is a side view showing a touch panel of the present invention when a touch operation by a user finger is received.
When the touch operation by a user finger is received, the sensor output signal SS indicates that the edge becomes stronger at the fingertip, and becomes weaker towards the root of the finger. Therefore, fingertip orientation can be detected by identifying the side with a stronger edge.
Preferably, the display device equipped with a touch panel of the present invention also includes a fingerprint detecting section that, besides detecting the orientation of the fingertip as described above, generates a detection signal in accordance with the fingerprint (especially the fingerprint pattern) of the finger used to perform the touch operation. Also, preferably, the fingertip orientation detecting section recognizes the fingerprint based on the detection signal, and detects the fingertip orientation based on the recognized fingerprint.
The fingerprint detecting section may generate a detection signal by detecting recesses and protrusions of the fingerprint. The recesses and protrusions may be detected by a relatively simple system, such as the electrostatic capacitance system. Also, the fingerprint detecting section may generate the detection signal by detecting the curving shape of the fingerprint. This is because most fingerprints have a U-shaped pattern having an opening facing the root of the finger.
Preferably, a display device equipped with a touch panel of the present invention shifts the image displayed on the display panel to the direction opposite from the fingertip orientation.
Here, the direction opposite from the fingertip orientation means the direction opposite from the fingertip orientation of one finger, or the direction opposite from the fingertip orientation of any one of the plurality of fingers.
The touch panel of a display device equipped with a touch panel of the present invention includes: a touch input section, a finger location detecting section, a fingertip orientation detecting section, and an information output section. The touch input section receives a touch operation performed by a plurality of fingers of a user. The finger location detecting section detects the locations of the fingers used to perform the touch operation. The fingertip orientation detecting section detects the fingertip orientation of the fingers used to perform the touch operation. The information output section outputs information on the locations of fingers detected by the finger location detecting section and on the fingertip orientation detected by the fingertip orientation detecting section.
Here, the touch panel in the present invention refers to a touch panel type input device (location input device such as a touch pad). Specifically, it refers to an input device that let users operate an instrument (display device) by touching or approaching the items displayed on the screen. The touch panel according to the present invention is also called touch screen, touch display, or the like.
The touch panel in a display device equipped with a touch panel of the present invention includes the configuration and functions of touch panels known to the public, in addition to the configuration and functions mentioned in the description of the function block diagram.
In other pixels, which are not shown in
a) schematically shows an example of the arrangement of optical sensors 30 in this case. In this figure, “R”, “G”, and “B” denote the red picture element, green picture element, and blue picture element, respectively. “S” denotes an optical sensor. In pixels 4a and 4c, the optical sensor “S” is disposed with the blue picture element “B”, and in pixels 4b and 4d, the optical sensor “S” is disposed with the red picture element 4b.
In
Here, if the optical sensor “S” is disposed with the green picture element 4g, in
Described below is an example in which the optical sensor 30b, which is disposed such that the photodiode 39b is located on the back surface of the blue filter in the same column with the blue picture element 40b, outputs the sensor output signal.
As shown in
The scan signal lines G1 to Gm are arranged in parallel to each other. The data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn are arranged in parallel to each other such that they intersect with the scan signal lines G1 to Gm at a right angle. The sensor read-out lines RW1 to RWm and the sensor reset lines RS1 to RSm are disposed in parallel to the scan signal lines G1 to Gm.
One of the pixel circuits 40 (40r, 40g, and 40b) is disposed near respective one of the intersections of the scan signal lines G1 to Gm and the data signal lines SR1 to SRn, SG1 to SGn, SB1 to SBn. The pixel circuits 40 are, as a whole, arranged two-dimensionally, with m circuits disposed in the column direction (vertical direction in
The pixel circuits 40 can be categorized by the color of the color filter provided: red (R) pixel circuit 40r, green (G) pixel circuit 40g, and blue (B) pixel circuit 40b. The three types of pixel circuits 40r, 40g, and 40b (hereinafter also individually referred to as “picture element (sub-pixel)”) are arranged in the row direction, and three of them jointly form one pixel.
The pixel circuit 40 includes a TFT (Thin Film Transistor) 32a and a liquid crystal capacitance 32b. The gate terminal of TFT 32a is connected to the scan signal line Gi (i is an integer of at least 1 and no greater than m), the source terminal is connected to one of the data signal lines SRj, SGj, and SBj (j is an integer of at least 1 and no greater than n), and the drain terminal is connected to one of the electrodes of the liquid crystal capacitance 32b. The common electrode voltage is applied to the other electrode of the liquid crystal capacitance 32b. Hereinafter, data signal lines SG1 to SGn connected to the green (G) pixel circuit 40g are called G data signal lines, and data signal lines SB1 to SBn connected to the blue (B) pixel circuit 40b are called B data signal lines. The pixel circuit 40 may include an auxiliary capacitance.
The transmittance (luminance of the picture element) of the pixel circuit 40 is determined by the voltage written to the pixel circuit 40. To write a voltage to the pixel circuit 40 connected to the scan signal line Gi and to the data signal line SXj (X is R, G, or B), a high level voltage (voltage that turns TFT 32a ON) can be applied to the scan signal line Gi, and a voltage to be written can be applied to the data signal line SXj. The luminance of the picture element can be set to a desired level by writing a voltage corresponding to the display data Din to the pixel circuit 40.
The optical sensor 30 includes a capacitor 39a, a photodiode 39b, and a sensor preamplifier 39c, and is disposed at least for each blue picture element 40b (blue (B) pixel circuit 40b).
One electrode of the capacitor 39a is connected to the cathode terminal of the photodiode 39b (hereinafter, this connecting point is referred to as “contact A”). The other electrode of the capacitor 39a is connected to the sensor read-out line RWi, and the anode terminal of the photodiode 39b is connected to the sensor reset line RSi. The sensor preamplifier 39c is constituted of a TFT whose gate terminal is connected to contact A, the drain terminal is connected to B data signal line SBj, and the source terminal is connected to G data signal line SGj.
To detect the light amount at the optical sensor 30 connected to the sensor read-out line RWi, the B data signal line SBj, and the like, a prescribed voltage can be applied to the sensor read-out line RWi and to the sensor reset line RSi, and a power supply voltage VDD can be applied to the B data signal line SBj at the timings shown in the timing chart of
In the periphery of the liquid crystal panel 32, a scan signal line driver circuit 41, a data signal line driver circuit 42, a sensor row driver circuit 43, p (p is an integer of at least 1 and no greater than n) sensor output amplifiers 44, and a plurality of switches 45 to 48 are provided. The scan signal line driver circuit 41, the data signal line driver circuit 42, and the sensor row driver circuit 43 are equivalent to the panel driver circuit 31 in
The data signal line driver circuit 42 has 3 n output terminals corresponding to 3 n data signal lines. One switch 45 is provided between each of G data signal lines SG1 to SGn and the corresponding one of n output terminals, and one switch 46 is provided between each of B data signal lines SB1 to SBn and the corresponding one of n output terminals. G data signal lines SG1 to SGn are divided into groups of p lines. Within each of the groups, one switch 47 is provided between the kth (k is an integer of at least 1 and no greater than p) G data signal line and the input terminal of the kth sensor output amplifier 44. B data signal lines SB1 to SBn are all connected to one end of the switch 48, and to the other end of the switch 48, the power supply voltage VDD is applied. The number of the switches 45 to 47 included in
Circuits shown in
During the display period shown in
More specifically, the data signal line driver circuit 42 stores the display data DR, DG, and DB at least one line at a time, and for each line time, applies a voltage corresponding to the one line of display data to the data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn. The data signal line driver circuit 42 may drive the data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn in a dot sequential manner.
During the sensing period shown in
In
The optical sensor 30 is disposed near the pixel electrode 56 with, for example, the blue color filter 53b. In this case, preferably, at least the photodiode 39b of the optical sensor 30 is disposed at the center of the color filter 53 on the back surface so that the light transmitted by the color filter 53 is reliably received by the photodiode 39b.
On each of the surfaces of the glass substrates 51a and 51b, which surfaces are facing each other, an alignment film 58 is provided, and on each of the other surfaces, a polarizing plate 59 is provided. Of the two surfaces of the liquid crystal panel 32, the surface on the side of the glass substrate 51a is the front surface, and the surface on the side of the glass substrate 51b is the back surface. The backlight 33 is disposed facing the back surface of the liquid crystal panel 32.
The A/D converter 36 (see
MPU 38 obtains this digital signal as a scan image (step S74). Further, the MPU 38 performs a process on the scan image obtained for identifying a pixel location (step S75).
For example,
On the other hand,
Once the pixel location is identified, MPU 38 conducts a process that determines the coordinates (location) within the image corresponding to the identified pixel (step S76). For example, as shown in
As shown in
Once the coordinates (location) are determined, MPU 38 outputs the coordinates data at the determined coordinates to the panel driver circuit 31 in the display panel (step S77).
In the display device equipped with a touch panel 50 of the present invention, the process in which the orientation of the touching fingertip is identified is conducted as follows. This process is conducted by MPU 38 shown in
The A/D converter 36 (see
Here, when a touch operation performed by user fingers is received, the sensor output signal SS indicates that the edge becomes stronger at the fingertip, and becomes weaker towards the root of the finger. Therefore, fingertip orientation can be detected by identifying the side with stronger edge.
Thus, from the sensor image obtained, MPU 38 can conduct a process for identifying the edge extraction image.
When the edge extraction image is identified, MPU 38 conducts a process for determining the shifting direction for the identified edge extraction image. When the shifting direction is determined, MPU 38 outputs the data present towards the determined shifting direction to the panel driver circuit 31 in the display panel.
Data on the finger locations and the fingertip orientation are sent to a camera, a music player, and the like. Then, processes according to the operation of the application software such as those shown below are conducted.
The display device equipped with a touch panel of the present invention is operated by touching the touch panel with a finger, a pen, and the like. By the touch operation, on the display device equipped with a touch panel, an activity such as a change in the image or a change in the audio volume occurs.
a) is an image displayed on the display device equipped with a touch panel of the present invention before the touch, and
As shown in
In the application, if the coordinates detection at the second point was conducted within a predetermined time period after the coordinates detection at the first point, if the coordinates of the first point and the coordinates of the second points are close to each other, and if the fingertip orientation at the first point and the fingertip orientation of the second point are identical, a process involving parameter increase/decrease is conducted. The parameter increase/decrease operation can be controlled by an application. This is described using examples such as (A) and (B) below.
(A) Camera
a) and
(B) Music Player
The audio volume is adjusted by notifying the application at MPU 38 of the fingertip angle. Based on the notified fingertip angle data, the application determines the movement.
(C) Mobile Terminal Menu Display
a) shows a finger and characters displayed when the fingertip orientation is upward.
(D) Navigation Map Display
A point in the map indicated by the fingertip orientation with an absolute angle is scrolled to the center.
As shown in
Each block (configuration) of a display device equipped with a touch panel of the present invention may be configured with a hardware logic, or may be realized with software using a CPU as described below.
That is, a display device equipped with a touch panel of the present invention includes: a CPU (central processing unit) that executes the instructions of a control program for realizing individual functions; a ROM (read only memory) that stores the program; a RAM (random access memory) that decompresses the program; and a storage device (recording medium) such as a memory that stores the program and various data. The objectives of the present invention can also be realized by providing the above-mentioned display device equipped with a touch panel with a recording medium that stores the program code (executable program, intermediate code program, source program) of the control program, i.e., a software for realizing the above-mentioned functions, in a format readable by a computer, and by having the computer (or CPU or MPU) retrieve the program codes stored in the recording medium and execute them.
The recording medium can be, for example, a tape such as a magnetic tape or a cassette tape; a disk including a magnetic disk such as a floppy (registered trademark) disk or a hard disk, an optical disk such as a CD-ROM, MO, MD, DVD, or CD-R; a card such as an IC card (including a memory card) or optical card; or a semiconductor memory such as a mask ROM, EPROM, EEPROM, or flash ROM.
The display device equipped with a touch panel may be configured to be connectable to a communication network, and the above-mentioned program code may be supplied via the communication network. The communication network is not particularly limited. As the communication network, the internet, intranet, extranet, LAN, ISDN, VAN, CATV communication net, virtual private network, telephone network, mobile communication network, satellite communication network, and the like, for example, can be used. Also, the transmission medium constituting the communication network is not particularly limited. As the transmission medium constituting the communication network, wires such as IEEE1394, USB, power line carrier, cable TV network, telephone line, ADSL network, or radio such as infrared (ex. IrDA or remote control), Bluetooth (registered trademark), 802.11 radio, HDR, mobile telephone network, satellite network, digital terrestrial network, for example, can be used. The present invention can also be realized using computer data signals embedded in a carrier wave, in which the above-mentioned program code is presented in the form of electronic transmission.
Preferably, in a display device equipped with a touch panel of the present invention, the information output section outputs the information when orientations of a plurality of fingers used to perform the touch operation are identical.
This makes it easier for the display device equipped with a touch panel of the present invention to determine the direction of the operation, and therefore the display device can be operated even more easily and more accurately.
In a display device equipped with a touch panel of the present invention, preferably, the information output section outputs the above-mentioned information when the shortest distance of the distances between the plurality of fingers used to perform the touch operation is at least equal to the shorter radius, longer radius, or the radius of the smallest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation, and is no greater than the shorter radius, the longer radius, or the radius of the largest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation.
This way, operation error does not occur in the display device equipped with a touch panel of the present invention as a result of an unintended touch in a multiple-point touch operation. Consequently, the display device equipped with a touch panel of the present invention can be operated with higher accuracy.
Preferably, the display device equipped with a touch panel of the present invention further includes a fingerprint detecting section that generates a detection signal corresponding to the fingerprint of the finger used in the touch operation, and the fingertip orientation detecting section recognizes the fingerprint based on this detection signal, and detects the fingertip orientation based on the fingerprint recognized.
This way, in the display device equipped with a touch panel of the present invention, it becomes easier to detect the fingertip orientation, and the display device can be operated with even higher accuracy.
Preferably, a display device equipped with a touch panel of the present invention shifts the image displayed on the display panel to the direction opposite from the fingertip orientation.
This way, displayed images shift to a particular direction, and therefore the display device equipped with a touch panel of the present invention can be operated more reliably.
In a method for controlling the display device equipped with a touch panel of the present invention, preferably the information output step outputs the above-mentioned information when the fingertip orientation of the plurality of fingers used to perform the touch operation are identical.
This way, direction of operation is easy to determine, and therefore, in the method for controlling the display device equipped with a touch panel of the present invention, the display device can be controlled even more easily and with higher accuracy.
In the method for controlling the display device equipped with a touch panel of the present invention, preferably, in the information output step, the above-mentioned information is outputted when the shortest distance of the distances between the plurality of fingers used to perform the touch operation is at least equal to the shorter radius, longer radius, or the radius of the smallest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation, and is no greater than the shorter radius, the longer radius, or the radius of the largest contact surface formed between the touch panel and a finger of the plurality of fingers used to perform the touch operation.
This way, in the method for controlling the display device equipped with a touch panel of the present invention, operation error is not caused by an unintended touch when multiple points are touched. Consequently, in the method for controlling a display device equipped with a touch panel of the present invention, the display device can be controlled with even higher accuracy.
A method for controlling the display device equipped with a touch panel of the present invention preferably further includes a fingerprint detection step of generating a detection signal corresponding to the fingerprint of the finger used to perform the touch operation. In the fingertip orientation detection step, preferably the fingerprints are recognized based on the detection signal, and the fingertip orientations are detected based on the recognized fingerprint.
This way, in the method for controlling the display device equipped with a touch panel of the present invention, it becomes easier to detect the fingertip orientation, and also the display device can be controlled more accurately.
Preferably, a method for controlling the display device equipped with a touch panel of the present invention shifts a displayed image to the direction opposite to the fingertip orientation.
This way, in the method for controlling the display device equipped with a touch panel of the present invention, display images shift to a particular direction, which provides a more reliable control.
The control program of the present invention operates a display device equipped with a touch panel, and is designed to make a computer operate as individual sections described above. Also, a recording medium of the present invention can be read by a computer storing the control program described above.
Thus, a display device equipped with a touch panel according to the present invention can be realized by a computer.
The specific embodiments described above are merely for illustration of the technical contents of the present invention. The present invention shall not be narrowly interpreted by being limited to such specific examples. Various changes can be made within the spirit of the present invention and the scope as defined by the appended claims.
A display device equipped with a touch panel of the present invention can also be used for car navigation devices, mobile phones, mobile type information terminals, ATM (automatic teller machine), ticket vending machines, various types of automatic vending machines, game machines, digital audio players, copiers, facsimiles, and the like. Also, the display device equipped with a touch panel of the present invention may be used for electronic blackboards and the like that have functions of the personal computer, television, and display devices.
27 illuminance sensor
28 finger location detecting section
29 fingertip orientation detecting section
30 optical sensor
31 panel driver circuit
32 liquid crystal panel with built-in sensors
33 backlight
34 backlight power supply circuit
35 display processing section
36 A/D converter
37 D/S converter
38 microprocessor unit (MPU)
41 scan signal line driver circuit
42 data signal line driver circuit
43 sensor row driver circuit
44 sensor output amplifier
45 switch
46 switch
47 switch
48 switch
50 display device equipped with a touch panel
| Number | Date | Country | Kind |
|---|---|---|---|
| 2010-031635 | Feb 2010 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2010/070923 | 11/24/2010 | WO | 00 | 8/13/2012 |
