This application is a continuation of U.S. application Ser. No. 14/183,957 filed Feb. 19, 2014, and is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-073869, filed Mar. 29, 2013, the entire contents of each of which are incorporated herein by reference.
Embodiments described herein relate generally to an electronic device and a method for controlling the electronic device.
Mobile phones, tablets, personal digital assistants (PDA), small-sized portable personal computers and the like are popularized. These electronic devices have a display panel and an operation input panel that is formed integrally with the display panel as one piece.
The operation input panel can detect a touch position on its surface where a user touches, and generates a sensing signal as a change of capacitance, for example. The sensing signal is supplied to a touch signal processing integrated circuit (IC) which is designed to exclusive use for the operation input panel. The touch signal processing IC processes the sensing signal using a computational algorithm prepared in advance, and converts the user's touched position into coordinate data then output it.
As manufacturing technology is developed, the display panel is increased in resolution and size. Accordingly, the operation input panel is required to sense a position with high resolution. The operation input panel is also required to process data input thereto at high speed depending on applications. Furthermore, a device capable of easily changing an application is desired.
Various embodiments will be described hereinafter with reference to the accompanying drawings.
In general, according to one embodiment, there are provided an electronic device which is flexibly adaptable to a variety of applications and which can receive a number of input information for the applications, and a method for controlling the electronic device.
According to an embodiment of the present disclosure, a sensor-integrated display panel including an operation surface for performing an input operation and an image display surface which are formed integrally with a sensor as one piece. A data transfer device supplies the sensor-integrated display panel with a drive signal for driving the sensor and outputs sensing data corresponding to a potential of a sensor signal output from the sensor. A contact electrode is provided in a frame formed around the sensor-integrated display panel to vary the potential of the sensor signal based on whether a conductor touches the frame or the conductor does not touch the frame. An application executing device receives and analyzes the sensing data and generates a signal to select an operating function in accordance with an analysis result.
According to the embodiment, a number of usage types of input information for, e.g., an input operation and a number of determination functions can be set by the application executing device, and the device can easily be used in different and various ways. Moreover, the device can be increased in function by associating the frame with touch data.
An embodiment will further be described with reference to the drawings.
The sensor-integrated display device 100 is supplied with a display signal (or a pixel signal) from a driver 210, which will be described later. When the device 100 receives a gate signal from the driver 210, a pixel signal is input to a pixel of the display device component 110. A voltage between a pixel electrode and a common electrode depends upon the pixel signal. This voltage displaces liquid crystal molecules between the electrodes to achieve brightness corresponding to the displacement of the liquid crystal molecules.
The sensor-integrated display device 100 may be called an input sensor-integrated display unit, a user interface or the like.
The display device component 110 may employ a liquid crystal display panel, a light-emitting element such as an LED, or organic EL. The display device component 110 can be simply called a display. The sensor component 150 is of a capacitance change sensing type. The sensor component 150 can be called a panel for sensing a touch input, a gesture and the like.
The sensor-integrated display device 100 is connected to an application executing device 300 via a data transfer device 200.
The data transfer device 200 includes a driver 210 and a sensor signal detector 250. Basically, the driver 210 supplies the display device component 110 with graphics data that is transferred from the application executing device 300. The sensor signal detector 250 detects a sensor signal output from the sensor component 150.
The driver 210 and sensor signal detector 250 are synchronized with each other, and this synchronization is controlled by the application executing device 300.
The application executing device 300 is, for example, a semiconductor integrated circuit (LSI), which is incorporated into an electronic device, such as a mobile phone. The device 300 complexly performs a plurality of functions, such as Web browsing and multimedia processing, using software with an OS.
These application processors perform a high-speed operation and can be configured as a dual core or a quad core. Favorably, the operation speed is, for example, 500 MHz and, more favorably, it is 1 GHz.
The driver 210 supplies a display signal (a signal into which the graphics data is converted to an analog signal) to the display device component 110 on the basis of an application. In response to a timing signal from the sensor signal detector 250, the driver 210 outputs a drive signal Tx for scanning the sensor component 150. In synchronization with the drive signal Tx, the sensor component 150 outputs a sensor signal Rx and supplies it to the sensor signal detector 250.
The sensor signal detector 250 detects the sensor signal, eliminates noise therefrom, and supplies the noise-eliminated signal to the application executing device 300 as raw reading image data (which may be called as three-dimensional image data).
When the sensor component 150 is of a capacity sensing type, the image data is not only two-dimensional data simply representing a coordinate but have a plurality of bits (e.g., three to seven bits) which vary with the capacitance. Thus, the image data can be called three-dimensional data including a physical quantity and a coordinate. The capacitance varies with the distance between a target (e.g., a user's finger) and a touch panel, the variation can be captured as a change in physical quantity.
Below is the reason that the sensor signal detector 250 of the data transfer device 200 directly supplies image data to the application executing device 300, as described above.
The application executing device 300 is able to perform its high-speed operating function to use the image data for various purposes.
New different applications are applied to the application executing device 300 according to user's various desires. The new applications may require a change or a selection of image data processing method, reading (or detection) timing, reading (or detection) format, reading (or detection) area, and reading (or detection) density depending on the data processing type.
If only the coordinate information is acquired as in the prior art device, the amount of acquired information is restricted. In the device of the present embodiment, however, if the raw three-dimensional image data is analyzed, for example, distance information as well as the coordinate information can be acquired.
It is desired that the data transfer device 200 should easily follow different operations under the control of applications in order to expand the functions by the applications. Thus, the device 200 is configured to select sensor signal reading timing, a reading area, a reading density or the like arbitrarily under the control of applications as a simple function. This point will be described later.
The application executing device 300 may include a graphics data generation unit, a radio interface, a camera-facility interface and the like.
An array substrate 10 in which a common electrode 13 is formed on a thin-film transistor (TFT) substrate 11 and a pixel electrode 12 is formed above the common electrode 13 with an insulation film between them. A counter substrate 20 is arranged opposite to and parallel with the array substrate 10 with a liquid crystal layer 30 between them. In the counter substrate 20, a color filter 22, a glass substrate 23, a sensor detecting electrode 24 and a polarizing plate 25 are formed in order from the liquid crystal layer 30.
The common electrode 13 is served as a drive electrode for a sensor (or a common drive electrode for a sensor) as well as a common electrode for display.
The data transfer device 200 mainly includes the driver 210 and the sensor signal detector 250. The driver 210 and the sensor signal detector 250 can be called an indicator driver IC and a touch IC, respectively. Though they are separated from each other, they can be formed integrally as one chip.
The driver 210 receives display data from the application executing device 300. The display data is time-divided and has a blanking period. The display data is supplied to a timing circuit and digital-to-analog converter 212 through a video random access memory (VRAM) 211 serving as a buffer. In mobile terminal 1, the VRAM 211 may have a capacity of one frame or smaller.
A display signal SigX indicative of an analog quantity is amplified by an output amplifier 213 and supplied to the sensor-integrated display device 100 for writing it to a display element. The timing circuit and digital-to-analog converter 212 detects a blanking signal or a blanking period and supplies a detected signal to a timing controller 251 of the sensor signal detector 250. The timing controller 251 may be provided in the driver 210 and called a synchronization circuit.
The timing controller 251 generates a drive signal to drive the sensor during a given period of the display signal (which may be a blanking period of the display signal, for example). The drive signal is amplified by an output amplifier 214 and supplied to the sensor-integrated display device 100.
The drive signal Tx drives the sensor detecting electrode to output the sensor signal Rx from the sensor-integrated display device 100. The sensor signal Rx is input to an integrating circuit 252 in the sensor signal detector 250. The sensor signal Rx is compared with a reference voltage (threshold value) Vref by the integrating circuit 252. If the level of the sensor signal Rx is the reference voltage or higher, the integrated circuit 252 integrates the sensor signal Rx in a capacitor and outputs an integral signal. Then, the sensor signal Rx is reset by a switch for each detection unit time period, and an analog signal can be output based on the sensor signal Rx. The analog signal from the integrating circuit 252 is supplied to a sample hold and analog-to-digital converter 253 and converted to digital data. The digital data is supplied as raw data to the application executing device 300 through a digital filter 254.
The digital data is three-dimensional data (multivalued data) including both the detected data and non-detected data of an input operation. A presence detector 255 operates when the application executing device 300 is in a sleep mode and no coordinates of a touched position on the operating surface are detected. If there is any object close to the operating surface, the presence detector 255 is able to sense the object and release the sleep mode.
The application executing device 300 receives and analyzes the digital data. In accordance with a result of the analysis, the device 300 is able to output the display data or select an operating function of the mobile terminal.
The application executing device 300 is able to expand different applications and set an operating procedure of the device, select a function, generate and select a display signal, select a display signal, and the like. Using a sensor signal output from the sensor signal detector 250, the device 300 is able to analyze an operating position through coordinate processing. The sensor signal is processed as image data and thus three-dimensional image data can be formed by an application. The device 300 is also able to, for example, register, erase and confirm the three-dimensional image data. Furthermore, the device 300 is able to compare the registered image data with the acquired image data to lock or unlock an operating function.
Upon acquiring the sensor signal, the application executing device 300 is able to change the frequency of a drive signal from the timing controller 251 to the sensor detecting electrode and control the output timing of the drive signal. Accordingly, the device 300 is able to select a driving area of the sensor component 150 and set the driving speed thereof.
Furthermore, the application executing device 300 is also able to detect the density of the sensor signal and add data to the sensor signal.
The display data SigX and the sensor drive signal Tx may be supplied from the application executing device 300 to the driver 210 by time division via the same bus. Furthermore, the display data SigX and the sensor drive signal Tx can be separated from each other by the timing circuit and digital-to-analog converter 212. The sensor drive signal Tx is supplied to the common electrode 13, described above, via the timing controller 251 and the amplifier 214. For example, the timing at which the timing controller 251 outputs the sensor drive signal Tx and the frequency of the sensor drive signal TX can be varied according to an instruction of the application executing device 300. The timing controller 251 is able to supply a reset timing signal to the the integrating circuit 252 of the sensor signal detector 250 and also supply a clock to the sample hold and analog-to-digital converter 253 and the digital filter 254.
On the display and operation surface 52, different images are displayed according to applications. In the examples of
In the example of
In the example of
As described above, the mobile terminal 1 includes the selection buttons. The selection buttons allow a user to select an operating mode or an operating function by one hand. Thus, the user can select an operating mode or an operating function by the left hand and perform an input operation by the right hand.
When the user touches another selection button with his or her left thumb, a stylus input operation performed by the right hand work as a rubber eraser.
The mobile terminal 1 is not limited to the above embodiment. The mobile terminal 1 can be so configured that the user can touch, for example, a coloring selection button by one hand. When the user colors a drawn figure as shown in
In the mobile terminal 1, the capacity for image data varies according to the distance between a target (e.g., a user's fingertip) and the touch panel and thus the image data can be processed as not only coordinate information but also three-dimensional data that indicates the variation captured as a variation in physical quantity.
Thus, an application for recognizing a three-dimensional shape as well as a coordinate, an application for recognizing movement characteristics of the object when an object moves on the operating surface, or the like can be used. If these applications are used, a threshold value can be set or varied to capture the three-dimensional image data. More specifically, in the mobile terminal 1, three-dimensional image data is transferred to the application executing device, and the three-dimensional image data can be modified into different forms, adjusted, changed or the like to use, thereby bringing about a number of advantages of recognition of three-dimensional distance, recognition of three-dimensional shape and the like.
In the mobile terminal 1 described above, a function can be selected, some of the functions can be started or stopped, or a method for capturing three-dimensional image data can be changed according to a position on which a user touches. Setting or switching in usage types of the three-dimensional image data described above may be set depending on the combination with a detection signal of a touch (contact) to the frame, which will be described as follows.
In the embodiment shown in
When the user touches the conductor contact electrodes P (or the user holds the mobile terminal by the left hand, for example) and touches the operation surface of the mobile terminal with the right hand, the level of a sensor output signal decreases from V0 to V2 and at this time a difference potential vd becomes relatively high. This is because the reference potential of the mobile terminal in the normal mode is further lowered (becomes zero) due to the contact of the human body.
If an application determines the above sensing (the contact of the human body), it turns off a switch between the conductor contact electrodes P and the reference potential conductor, then cuts off the frame contact sensing function. Moreover, the application is able to start an operation input determination function, and to set a proper status of use of the mobile terminal. In the subsequent normal operation, when an input operation is detected, the sensor output signal corresponds to output voltage V1 that is decreased from V0, as described with reference to
The frame electrode control signal Fv is output from, for example, the driver 210, as shown in
The application executing device 300 includes an electrode control signal instruction unit (or a frame potential scanning instruction) for outputting the frame electrode control signal Fv, a contact position analysis unit for analyzing the sensor output signal, and a function selection unit for selecting a function in accordance with a result of the analysis. In order to fulfill the functions of these units, the application executing device 300 outputs an instruction on the basis of the operating procedure of an application.
In the mobile terminal, an operating function can be selected in accordance with a user's holding position by making use of the above functions. For example, it can be determined whether the user is a right-handed person or a left-handed person in accordance with the holding position. An operating mode can be selected according to whether the user is a right-handed person or a left-handed person. Furthermore, it can be determined whether the user holds the mobile terminal by both hands.
When it is determined whether the user is a right-handed person or a left-handed person, a selection button can be displayed for the right-handed person or the left-handed person. When the user holds the mobile terminal by both hands, the operating mode may be changed to a camera shooting mode. When an operating mode is selected in accordance with the user's holding position, it may be displayed by a message or notified by voice.
According to the above-described mobile terminal, a time period during which an input operation on the operation surface is detected and a time period during which a user touches the frame can be set on time-division basis. For example, while detecting an input operation, the mobile terminal is able to determine a position of the frame which the user touches. If the user touches another position thereof, an application for selecting an operating function of the mobile terminal can be employed.
In the foregoing description, the sensor-integrated display device is configured to include a liquid crystal display device as a display device; however, it can be configured to include another display device such as an organic electroluminescence display device. In the example shown in
The names of the blocks and components are not limited to those described above, nor are the units thereof. The blocks and components can be shown in a combined manner or in smaller units. Even though the term “unit” is replaced with “device,” “section,” “block” and “module,” they naturally fall within the scope of the present disclosure. Even though the structural elements in the claims are each expressed in a divided manner or they are expressed in a combined manner, they fall within the scope of the present disclosure. The method claim corresponds to the device claim.
The above embodiments of the present disclosure are each described as an example and do not aim at limiting the scope of the present disclosure. The embodiments can be reduced to practice in different ways, and their structural elements can be omitted, replaced and modified in different ways without departing from the spirit of the disclosure. Even though the structural elements are each expressed in a divided manner or they are expressed in a combined manner, they fall within the scope of the present disclosure. Even though the claims are recited as step claims or program claims, these claims correspond to the device claims. The embodiments and their modifications fall within the scope and spirit of the disclosure and also fall within the scope of the disclosure recited in the claims and its equivalents.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2013-073869 | Mar 2013 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
20100090948 | Oba et al. | Apr 2010 | A1 |
20100220066 | Murphy | Sep 2010 | A1 |
20110038114 | Pance et al. | Feb 2011 | A1 |
20120022066 | Kennedy et al. | Jan 2012 | A1 |
20120050217 | Noguchi et al. | Mar 2012 | A1 |
20120254408 | Kimura et al. | Oct 2012 | A1 |
20120254808 | Gildfind | Oct 2012 | A1 |
20140292679 | Kida et al. | Oct 2014 | A1 |
Number | Date | Country |
---|---|---|
9-91039 | Apr 1997 | JP |
2010-62420 | Mar 2010 | JP |
2010-191692 | Sep 2010 | JP |
2012-48295 | Mar 2012 | JP |
Entry |
---|
Office Action issued Aug. 18, 2015 in Japanese Patent Application No. 2013-073869 (with English translation). |
Number | Date | Country | |
---|---|---|---|
20160026300 A1 | Jan 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14183957 | Feb 2014 | US |
Child | 14878755 | US |