The present invention is related to an input device comprising a reflective portion as an object which is captured by a stroboscope, and the related techniques thereof.
A golf game system of the present applicant is described in Jpn. unexamined patent publication No. 2004-85524. The golf game system includes a game apparatus and a golf club type input device, and an imaging unit including an image sensor and infrared emitting diodes is provided within a housing of the game apparatus. The infrared emitting diodes intermittently emit infrared light to a prescribed area above the imaging unit. Therefore, the image sensor intermittently picks up an image of a reflective portion attached to the golf club type input device which moves within the prescribed area. The speed of the golf club type input device which is an input to the game apparatus is calculated by processing images of the reflective portion captured by the stroboscope. In this way, input is given to a computer or a game apparatus in real time by means of the stroboscope.
It is an object of the present invention to provide an input device which comprises a reflective portion as an object captured by a stroboscope, can give input to an information processing apparatus in real time, and can be easily controlled to input or un-input, and the related techniques thereof.
In accordance with a first embodiment of the present invention, an input device as an object being captured by strobing, is operable to input to an information processing apparatus which performs processing in accordance with a program, and comprises: a retroreflective member; a unit where said retroreflective member is attached; and a supporting body where said unit is attached rotatably, and wherein said retroreflective member is attached on a predetermined face of said unit and a direction which the predetermined face faces is different in response to rotating of said unit.
In accordance with this configuration, an operator can easily control input/un-input to the information processing apparatus since it is possible to control the direction which the retroreflective member faces only by rotating the unit where the retroreflective member is attached.
In accordance with a second embodiment of the present invention, an input device as an object being captured by strobing, is operable to input to an information processing apparatus which performs processing in accordance with a program, and comprises: a retroreflective member; a unit where said retroreflective member is attached; and a supporting body where said unit is attached so as to be opened and closed, and wherein said retroreflective member is attached to said unit in a manner that said retroreflective member is located between said unit and said supporting body when said unit is either closed or opened.
In accordance with this configuration, an operator can easily control input/un-input to the information processing apparatus since it is possible to control exposure of the retroreflective member only by opening/closing the unit where the retroreflective member is attached.
In accordance with a third embodiment of the present invention, an input device as an object being captured by strobing, is operable to input to an information processing apparatus which performs processing in accordance with a program, and comprises: a retroreflective member; a shutter which exposes said retroreflective member when said shutter is opened and does not expose said retroreflective member when said shutter is closed.
In accordance with this configuration, an operator can easily control input/un-input to the information processing apparatus since it is possible to control exposure of the retroreflective member only by opening/closing the shutter.
The aforementioned and other features and objects of the present invention and the manner of attaining them will become more apparent and the invention itself will be best understood by reference to the following description of a preferred embodiment taken in conjunction with the accompanying drawings, wherein:
In what follows, an embodiment of the present invention will be explained in conjunction with the accompanying drawings. Meanwhile, like references indicate the same or functionally similar elements throughout the respective drawings, and therefore redundant explanation is not repeated.
The information processing apparatus 1 is connected to the television monitor 5 with an AV cable 7. A DC power voltage is supplied to the information processing apparatus 1 through an AC adapter or a battery (not shown). A power switch 13 is provided on the upper surface of the information processing apparatus 1.
The information processing apparatus 1 is also provided with an infrared filter 9 which transmits only infrared light, and four infrared emitting diodes 11 which emit infrared light are positioned around the infrared filter 9 and exposed. An image sensor 15 to be explained later is positioned behind the infrared filter 9.
The four infrared emitting diodes 11 intermittently emit infrared light. Then, the infrared light emitted from the infrared emitting diodes 11 is reflected by the retroreflective sheet 17 (to be explained later) attached on the input device 3, and input to the image sensor 15 located behind the infrared filter 9. In this way, the input device 3 is captured by the image sensor 15. Even though infrared light is emitted intermittently, the image sensor 15 also performs imaging process during non-lighted period of infrared light. The information processing apparatus 1 obtains a differential signal between image signals of the input device 3 moved by an operator with and without lighted, and calculates position of the input device 3 (i.e., the retroreflective sheet 17) on the basis of the differential signal.
As illustrated in these figures, the input device 3 includes the open-close portion 19 and the supporting portion 21. The upper half of the supporting portion 21 is referred as a head, and the lower half is referred as a grip. The open-close portion 19 is attached to the head of the supporting portion 21 so as to be freely opened and closed.
As illustrated in
In addition, as illustrated in
Then, the salient portions 23 of the open-close portion 19 are inserted to the respective axial holes formed on the both end of the inner wall of the concave portions 27, and the input device 3 is finally completed. In this way, the open-close portion 19 is attached to the supporting portion 21 so as to be freely rotated by using the salient portions 23 as the rotary shaft.
When an operator, for example, holds the input device 3 with a right hand and rotates the lever portion 25 of the open-close portion 19 which is closed (refer to
When the operator turns the retroreflective sheet 17 of the open-close portion 19 which is opened toward the infrared filter 9 (i.e., the image sensor 15) of the information processing apparatus 1, the image sensor 15 picks up an image of the retroreflective sheet 17 subjected to the infrared light emitted from the infrared emitting diodes 11 so that the information processing apparatus 1 can detect the input device. On the other hand, even if the operator turns the input device 3 with the open-close portion 19 being closed toward the infrared filter 9 of the information processing apparatus 1, the retroreflective sheet 17 is not captured since the reflective sheet 17 is hidden in the concave portion 27 of the supporting portion 21 so it can not be subjected to the infrared light. Therefore, the information processing apparatus 1 determines the input device does not exist.
As has been discussed above, it is possible to control easily to input or un-input to the information processing apparatus 1 by controlling open/close operation of the input device 3. Incidentally, the information processing apparatus 1 determines that there is input when the input device 3 is detected; the information processing apparatus 1 determines that there is not an input when the input device 3 is not detected; and vice versa.
The input device 3 with the open-close portion 19 opened is irradiated by infrared light emitted from the infrared emitting diodes 11 and reflects the infrared light with the retroreflective sheet 17. The infrared light reflected by the retroreflective sheet 17 is captured by the image sensor 15. Therefore, an image signal of the retroreflective sheet 17 is output from the image sensor 15. The analog image signal from the image sensor 15 is converted to a digital data by an A/D converter (not shown) of the high speed processor 31. Incidentally, the high speed processor 31 makes the infrared emitting diodes 11 flash intermittently to perform strobing.
The high speed processor 31, even though not shown in figures, also includes various function blocks such as a CPU (central processing unit), a graphics processor, a sound processor and a DMA controller; the A/D converter which is used when an analog signal is input; and an input/output control circuit which receives input signals such as a key operation signal and an infrared signal and transmits output signals to external devices. Input signals are transmitted to the CPU. The CPU performs necessary calculations in response to the input signals and gives the results to the graphics processor and the sound processor. Therefore, the graphics processor and the sound processor perform image processing and sound processing in accordance with the results of the calculation.
In addition, the high speed processor 31 includes an internal memory (not shown) which, for example, consists of a RAM (random access memory). The internal memory is utilized as a working area, a counter area, a temporary area and/or a flag area.
The high speed processor 31 can access the ROM 33 through the bus 35. Therefore, the high speed processor 31 can execute a program stored in the ROM 33, and read and process data stored in the ROM 33. A program, image data, sound data and so on are stored in the ROM 33 in advance.
The high speed processor 31 processes digital image signals input from the image sensor 15 via the A/D converter, and detects whether or not there is input from the input device 3 and position of the input device 3. Then, the high speed processor 31 performs calculation, graphic processing, and sound processing, and then outputs a video signal and an audio signal. The video signal and the audio signal are given to the television monitor 5 via the AV cable 7. Consequently, an image is displayed on the television monitor 5 and a sound is output from a speaker (not shown).
In step S3, the high speed processor 31 performs extracting process of a target area of the input device 3. In step S4, the high speed processor 31 extracts a target point of the input device 3. In step S5, the high speed processor 31 performs information processing using the results of the processing of step S3 and S4.
In step S6, the high speed processor 31 judges whether or not a variable “M” is smaller than a predetermined value “K”. If the variable “M” is equal to or larger than the predetermined value “K”, the high speed processor 31 proceeds to step S7, assigns “0” to the variable “M”, and then proceeds to step S8. On the other hand, if the variable “M” is smaller than the predetermined value “K”, the high speed processor 31 proceeds from step S6 to step S8.
If it is “Yes” in step S8, i.e., the high speed processor 31 waits for the video system synchronous interrupt (i.e., as long as the video system synchronous interrupt is not issued), the high speed processor 31 returns to the same step S8. On the other hand, if it is “No” in step S8, i.e., the high speed processor 31 gets out of the state of waiting for the video system synchronous interrupt (i.e., if the high speed processor 31 is given the video system synchronous interrupt), the high speed processor 31 proceeds to step S9. In step S9, the high speed processor 31 performs update processing of the screen image displayed on the television monitor 5 and then proceeds to step S2.
The sound processing in step S10 is performed when there is a sound interrupt, and consequently music and sound effects are output.
In this embodiment, the CMOS image sensor which consists of 32 pixels×32 pixels is used as an example of the image sensor 43. The horizontal direction is a direction of X axis and the vertical direction is a direction of Y axis. Therefore, 32 pixels×32 pixels of pixel data (luminance data for each pixel) is output as an image data from the image sensor 15. This pixel data is converted to digital data by the A/D converter, and stored in an array P1[X][Y] in the internal memory.
In step S22, the high speed processor 31 makes the infrared diodes 11 un-flash. In step S23, the high speed processor 31 obtains, from the image sensor 15, image data without lighted (32 pixels×32 pixels of pixel data (luminance data for each pixel)), and stores it in the internal memory. In this case, the image data without lighted is stored in an array P2[X][Y] in the internal memory.
Incidentally, since 32×32 pixel image sensor 15 is used in this embodiment, X=0 to 31, Y=0 to 31, and a corner on upper left is defined as an origin.
In this way, it is possible to eliminate light (or noise) except return light from the retroreflective sheet 17 as much as possible by obtaining the difference data so that it is possible to detect the retroreflective sheet 17 with high accuracy.
In step S32, the high speed processor 31 compares an element of the array Dif[X][Y] with a predetermined threshold “Th”. In step S33, if the the element of the array Dif[X][Y] is larger than the predetermined threshold “Th”, the high speed processor 31 proceeds to step S34, otherwise proceeds to step S35.
In step S34, the high speed processor 31 increments the count value “C” by one to count the number of the difference data (the elements of the array Dif[X][Y]) exceeding the predetermined threshold value “Th”. The high speed processor 31 repeats the process from step S32 to S34 until the high speed processor 31 finishes comparing all elements of the array Dif[X][Y] with the predetermined threshold value “Th” (in step S35). The final count value “C” is the size of the target area of the input device 3.
Incidentally, if the count value “C” is “0”, it means the retroreflective sheet 17 of the input device 3 is not detected, i.e., the open-close portion 19 of the input device 3 is closed (for example, there is no input). If the count value “C” is not “0”, it means the retroreflective sheet 17 of the input device 3 is detected, i.e., the open-close portion 19 of the input device 3 is opened (for example, there is input).
In step S47, the high speed processor 31 turns off a detection flag which indicates whether or not the input device 3 is detected. On the other hand, the high speed processor 31 turns the detection flag on in step S41.
In step S42, the high speed processor 31 scans all elements of the array Dif[X][Y] and detects a maximum value. The X coordinate and the Y coordinate of the maximum value is defined as the coordinate (Xc, Yc) of the target point. In step S43, the high speed processor 31 increments the variable “M” by one.
In step S44, the high speed processor 31 assigns the coordinates “Xc” and “Yc” to an array PX[M] and PY[M]. In step S45, the high speed processor 31 calculates a moving average (AX, AY) of the target point (Xc, Yc) of the input device 3. In step S46, the high speed processor 31 converts the average coordinate (AX, AY) of the target point on the image sensor 15 into a coordinate (xc, yc) on the television monitor 5.
Returning to
As illustrated in these drawings, the input device 3 includes a head portion 50 and a body portion 51. The head portion 50 is attached on the front side of upper part of the body portion 51. Incidentally, the lower part of the body portion 51 is a grip where an operator holds.
As illustrated in
When a button 54 of the body portion 51 is not pressed, a plurality of slats 52 are closed. Therefore the retroreflective sheet 17 is not exposed since the aperture 56 is covered with the slats 52 (refer to
When an operator turns the retroreflective sheet 17 with the slats 52 opened toward the infrared filter 9 (i.e., the image sensor 15) of the information processing apparatus 1, the retroreflective sheet 17 subjected to the infrared light from the infrared emitting diodes 11 is captured by the image sensor 15 so that the information processing apparatus 1 can detect the input device 3. On the other hand, when an operator turns the input device 3 with the slats 52 closed toward the infrared filter 9 of the information processing apparatus 1, the retroreflective sheet 17 is not captured since the retroreflective sheet 17 is covered with the slats 52 and not exposed to infrared light. Therefore, the information processing apparatus 1 determines the input device does not exist.
As has been discussed above, it is possible to control exposure of the retroreflective sheet 17 by opening/closing the shutter which is made of a plurality of the slats 52. Therefore, to control input/un-input to the information processing apparatus 1, the operator simply opens and closes the slats 52. Incidentally, if the input device 3 is detected, it is considered to be there is input in the same way as the input device 3 of
Incidentally, the present invention is not limited to the above embodiment, and a variety of variations and modifications maybe effected without departing from the spirit and scope thereof, as described in the following exemplary modifications.
(1) The open-close portion 19 is rotated around the vertical shaft in
(2) In
(3) For the method of controlling exposure of the retroreflective sheet 17, a lens shutter mechanism used in a compact camera or a focal plane shutter mechanism used in a single-lens reflex camera can be employed. Also, an aperture mechanism of camera using aperture blades can be employed. Furthermore, a liquid-crystal shutter can be used as the method of controlling exposure of the retroreflective sheet 17.
(4) In above explanation, if a difference data corresponding to at least one pixel is larger than the threshold value “Th”, the high speed processor 31 determines that the input device 3 is detected (refer to step S41 of
(5) In the input device 3 of
The foregoing description of the embodiments has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form described, and obviously many modifications and variations are possible in light of the above teaching. The embodiment was chosen in order to explain most clearly the principles of the invention and its practical application thereby to enable others in the art to utilize most effectively the invention in various embodiments and with various modifications as are suited to the particular use contemplated.
Number | Date | Country | Kind |
---|---|---|---|
2004-243076 | Aug 2004 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2005/015600 | 8/23/2005 | WO | 00 | 2/15/2007 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2006/022402 | 3/2/2006 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5231539 | McMillen | Jul 1993 | A |
6111563 | Hines | Aug 2000 | A |
6254485 | Kanagawa et al. | Jul 2001 | B1 |
6324024 | Shirai et al. | Nov 2001 | B1 |
20030147651 | Roes et al. | Aug 2003 | A1 |
Number | Date | Country |
---|---|---|
1516654 | Mar 2005 | EP |
2000-61134 | Feb 2000 | JP |
2002-264651 | Sep 2002 | JP |
2004-85524 | Mar 2004 | JP |
WO 2004002593 | Jan 2004 | WO |
Number | Date | Country | |
---|---|---|---|
20080094681 A1 | Apr 2008 | US |