This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2007-224369, filed Aug. 30, 2007, the entire contents of which are incorporated herein by reference.
1. Field
One embodiment of the present invention generally relates to an information processing apparatus, a program, and an information processing method, and more particularly, to an information processing apparatus, a program, and an information processing method which can recognize a user's gesture, and can perform control based on the recognized gesture.
2. Description of the Related Art
Heretofore, a method of operating an information processing apparatus such as a television receiver or personal computer by giving the apparatus an instruction from a user by means of his or her gesture is proposed. According to such a method, it is possible to remotely control an information processing apparatus without using an input device such as a mouse, keyboard, and a remote controller.
As a method of capturing movements of a gesture or the like, for example, a technique for distinguishing an action or a state of a movement of a subject is proposed (see Jpn. Pat. Appln. KOKAI Publication No. 2003-323604).
The method described in Jpn. Pat. Appln. KOKAI Publication No. 2003-323604 is only a method for detecting that a subject has moved. However, if a cursor is left displayed at the detected position, the cursor is not able to follow the movement of a hand in some cases, which is rather an obstacle to the operation by gesture than a help.
A general architecture that implements the various feature of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments of the invention and not to limit the scope of the invention.
Various embodiments according to the invention will be described hereinafter with reference to the accompanying drawings. In general, according to one embodiment of the invention, an information processing apparatus is provided with a display section, and can be instructed to be operated by a pointer displayed on the display section, and includes a detection section for detecting, from an input image of a hand, a position of the hand in the image, an operation section for obtaining a probability that the hand exists in the image by using the latest detection result detected by the detection section, and a value of a probability distribution function having a peak at a position which has been evaluated last time as a position at which a probability that the hand exists is high, and a pointer display section for moving the pointer, on the basis of an evaluation value obtained from the probability, to a position at which the probability that the hand exists is the highest and displaying the pointer at the position.
An embodiment of the present invention will be described below with reference to the accompanying drawings.
Incidentally, in the embodiment of the present invention, a position of a hand of a user is detected from an image taken by a camera 126, and an operation is performed by moving a pointer such as a cursor to a position corresponding to the position of the hand in the image. A method of controlling a pointer which realizes high operability even when the accuracy in detecting the position of the hand is low, or even when noise causing a misjudgment is present is provided.
Further, the detected position of the hand contains noise information from which it is judged that the detected position of the hand differs from the actual position of the hand, and hence if a pointer is displayed at the detected position of the hand as it is, the position indicated by the pointer includes an error. Then, the instruction of the user is not recognized, and consequently the operability is deteriorated in some cases. When the noise is removed by using a low-pass filter or the like, the larger the noise removal amount becomes, the more difficult it becomes for a change in the display position of the pointer to follow a change in the position of the hand, thereby similarly deteriorating the operability in some cases.
Accordingly, in the present invention, there is provided a control method by which it is possible to reduce an error of the position at which the pointer is displayed when a change in the position of the hand is small, and cause the position at which the pointer is displayed to follow the movements of the hand when a change in the position of the hand is large.
First, an information processing apparatus according to a first embodiment of the present invention will be described below by referring to
As shown in
The CPU 111 is a processor for controlling an operation of the personal computer 100. The CPU 111 executes an operating system (OS) and various application programs loaded from the HDD 117 into the main memory 112. Further, the CPU 111 also executes a basic input/output system (BIOS) stored in the BIOS-ROM 119. The BIOS is a program for controlling peripheral devices. The BIOS is first executed at the time of turning-on of the power to the personal computer 100.
The northbridge 113 is a bridge device for connecting a local bus of the CPU 111 and the southbridge 116 to each other. The northbridge 113 has a function of executing communication with the graphics controller 114 through an accelerated graphics port (AGP) bus and the like.
The graphics controller 114 is a display controller for controlling the display 115 of the personal computer 100. The graphics controller 114 generates a display signal to be output to the display 115 from display data written to a VRAM (not shown) by the OS or the application program. The display 115 is, for example, a liquid crystal display (LCD).
The HDD 117, support processor 118, BIOS-ROM 119, camera 126, and EC/KBC 120 are connected to the southbridge. Further, the southbridge 116 is provided with an integrated drive electronics (IDE) controller for controlling the HDD 117 and the support processor 118.
The EC/KBC 120 is a one-chip microcomputer in which an embedded controller (EC) for power management and a keyboard controller (KBC) for controlling the touch pad 124 and the keyboard (KB) 125 are integrated with each other. For example, when the power button 21 is operated, the EC/KBC 120 turns on the power of the personal computer 100 in cooperation with the power supply circuit 121. When external power is supplied to the personal computer 100 through the AC adapter 123, the personal computer 100 is driven by the external power. When the external power is not supplied to the personal computer 100, the personal computer 100 is driven by the battery 122.
The camera 126 is, for example, a USB camera. A USB connector of the camera 126 is connected to a USB port (not shown) provided on the main body of the personal computer 100. An image (a position of the hand or the like) taken by the camera 126 is stored in the HDD 117 or the like as frame data. Further, the image can be displayed on the display 115 of the personal computer 100. A frame rate of the image to be supplied by the camera 126 is, for example, 15 frames/sec. The camera 126 may be an external camera or a built-in camera of the personal computer 100.
The support processor 118 performs processing and the like of an animation acquired from the camera 26.
As shown in
Further, positional information of the hand recognized by the recognition engine 201 is subjected to an operation and correction by a filter 202, thereby improving the accuracy such that the positional information approaches the actual position of the hand. When the position of the hand is calculated by the filter 202, a mouse pointer 203 or the like on the display 115 is moved to the calculated position.
Further,
Next, the processing for bringing the detected position of the hand closer to the actual position of the hand will be described below in detail with reference to
Assuming that the detected position of the hand follows a normal distribution having the true position of the hand as the center, the pointer is moved in such a manner that the pointer becomes closer to a position at which a probability that the true (actual) position of the hand exists is high.
First, image frame data acquired by the camera 126 is stored in the storage section 12. Past image frame data can be taken out of the storage section 12 to be utilized.
At this time, as shown in
P(n,x)=f(x,h(n),σ)
where f(x,μ,σ) is a probability density function of the normal distribution, and is expressed by the following formula (2).
where μ is a mean value, and σ is the standard deviation.
A numerical value Q(n,x) expressing the level of the probability that the point x is the true position of the hand is defined by the following formula (3) (S101: see
Q(n,x)=W(n,x)×Q(n−1,x)×(1−α)+P(n,x)×α (1)
where α is an attenuation coefficient satisfying the condition 0<α≦1.
W(n,x) is a weight of the past history, and is defined by the following formula (4) (S102: see
Incidentally, Q(n−1,x) is past image frame data stored in the storage section 12. Further, α is used as a value of an amount to be caused to reflect the past image frame data.
This formula is obtained by correcting
f(x,h(x), σ) such that the formula becomes 1 when x=h(x). (f(h(n),h(n), σ) is P(n,x) peak value).
When W(n,x) is not present, Q(n,x) becomes the existing probability of the hand caused to reflect the past history by the attenuation coefficient α. Further, by introducing W(n,x) (a function made such that h(n) becomes the peak), it is possible to obtain a characteristic that at a point close to h(n), the current value is moderately approached, and at a point distant from h(n), the value abruptly decreases (S104: see
Then, at the frame n, the resultant data of the last time is made to be p(n−1) (S201:
The current maximum probability point and the pointer position of the last time are averaged by using the current probability of each point as the weight.
When M(n) is close to the pointer position of the last time, Q(n,p(n−1)) also becomes a value close to Q(n,M(n)), and hence the pointer displayed on the display 115 moves slowly (see
On the other hand, when M(n) largely differs from the pointer position of the last time, Q(n,p(n−1)), which is the value of the last time, quickly becomes a small value from the formula (1), and hence p(n) rapidly gets closer to M(n) while hardly being reflected (see
Further, by introducing a parameter β for controlling the speed of changing the pointer position as shown by the following formula (6), it is also possible to adjust the moving speed of the pointer.
Thus, an object of the present invention is to provide an information processing apparatus, a program, and an information processing method capable of detecting a position of a hand of a user by a simple configuration, and accurately operating a cursor on the basis of the detected position.
By virtue of this embodiment, when the position of the hand is not moved, it is possible to suppress the shake of the pointer by sharply removing noise at the detection position. Further, when the position of the hand is largely moved (see
Incidentally, the present invention is not limited to the above-mentioned embodiment as it is. The present invention can be concretized in the implementation stage by changing the constituent elements thereof within the scope not deviating from the gist of the invention.
Further, by appropriately combining a plurality of constituent elements disclosed in the above-mentioned embodiment with each other, various inventions can be formed. For example, some constituent elements may be deleted from the entire constituent elements shown in the embodiment. Further, constituent elements of different embodiments may be appropriately combined with each other.
While certain embodiments of the inventions have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2007-224369 | Aug 2007 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5594469 | Freeman et al. | Jan 1997 | A |
6226409 | Cham et al. | May 2001 | B1 |
7565295 | Hernandez-Rebollar | Jul 2009 | B1 |
20020064382 | Hildreth et al. | May 2002 | A1 |
20020151992 | Hoffberg et al. | Oct 2002 | A1 |
20030103647 | Rui et al. | Jun 2003 | A1 |
20030146901 | Ryan | Aug 2003 | A1 |
20040052418 | DeLean | Mar 2004 | A1 |
20060010400 | Dehlin et al. | Jan 2006 | A1 |
20060132435 | Machida | Jun 2006 | A1 |
20060284837 | Stenger et al. | Dec 2006 | A1 |
20070211022 | Boillot | Sep 2007 | A1 |
20070268269 | Chang et al. | Nov 2007 | A1 |
20090030865 | Sawada | Jan 2009 | A1 |
20090144668 | Yeh | Jun 2009 | A1 |
Number | Date | Country |
---|---|---|
11-025260 | Jan 1999 | JP |
2000-222117 | Aug 2000 | JP |
2002-504722 | Feb 2002 | JP |
2003-323604 | Nov 2003 | JP |
Number | Date | Country | |
---|---|---|---|
20090064054 A1 | Mar 2009 | US |