This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2013-265827, filed on Dec. 24, 2013, the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a wearable information input device, an information input system, and an information input method.
As a device that is attached to a body part and is used to input information, there has been a wristwatch-type input device that detects impact or acceleration accompanying tapping actions of fingertips on a desired supporting object, and constructs a command or characters based on the correlation among the timings to tap respective fingers obtained as a result of the detection. To input a command or characters with such an input device, a user has to store the timings to tap the respective fingers and the correlation among the timings into the input device in advance.
Embodiments will now be explained with reference to the accompanying drawings. The present invention is not limited to the embodiments.
A wearable information input device according to an embodiment is worn on an upper limb of a user. The wearable information input device includes a contact detecting unit, a position detecting unit, and a trajectory generating unit. The contact detecting unit detects contact with the upper limb by an input unit. The input unit is used by the user to input information. The position detecting unit detects a position of the input unit while the input unit is in contact with the upper limb. The trajectory generating unit generates a trajectory of motion of the input unit based on information about the position detected by the position detecting unit.
The following is a description of embodiments of wearable information input devices, with reference to the accompanying drawings. In the description below, a wearable information input device is attached to a wrist of a user, and a finger of the hand on the opposite side from the wrist having the wearable information input device attached thereto is used as the input unit. However, a wearable information input device of any of the embodiments described below can be attached to any part of an upper limb of a user. Also, any part of the upper limb on the opposite side from the wrist having a wearable information input device attached thereto can be used as the input unit. The input unit may be a stylus pen, for example.
Referring to
The preparatory posture detecting unit 11 detects a preparatory posture. A preparatory posture is the posture of the upper limb having the wearable information input device 10 attached thereto when the user inputs information. As the wearable information input device 10 is attached to the wrist of the user, the posture of the upper limb having the wearable information input device 10 attached thereto is substantially the same as the posture of the wearable information input device 10. Accordingly, the preparatory posture detecting unit 11 can detect a preparatory posture by detecting the posture (tilt) of the wearable information input device 10.
So as to detect the posture (tilt) of the wearable information input device 10, the preparatory posture detecting unit 11 includes an acceleration sensor, a geomagnetic sensor, an angular velocity sensor, or the like. In a case where the preparatory posture detecting unit 11 detects a preparatory posture with an acceleration sensor, the acceleration sensor is preferably a triaxial acceleration sensor. The preparatory posture detecting unit 11 may detect a preparatory posture by monitoring acceleration in the direction of gravitational acceleration, for example.
The preparatory posture detecting unit 11 may also analyze changes in posture prior to a preparatory posture by using a technique such as DP (Dynamic Programming) matching or machine learning, to detect a preparatory operation the user has performed before taking the preparatory posture. Alternatively, the wearable information input device 10 may not include the preparatory posture detecting unit 11.
The finger contact detecting unit 12 detects contact of a finger with the skin in the vicinity of the wrist to which the wearable information input device 10 is attached. The finger contact detecting unit 12 may detect finger contact by any appropriate conventional method.
For example, the finger contact detecting unit 12 can detect finger contact by detecting a change in capacitance when a finger contacts with the skin in the vicinity of the wrist. In this case, so as to detect capacitance, the finger contact detecting unit 12 is preferably designed to include an electrode that is located on the wrist side of the wearable information input device 10.
The finger contact detecting unit 12 can also detect finger contact by detecting a change in light intensity when a finger contacts with the skin in the vicinity of the wrist, for example. In this case, the finger contact detecting unit 12 is preferably designed to include a light emitting device such as an LED, and a light receiving device such as a photodiode that receives light that is emitted from the light emitting device and is then reflected.
Also, the finger contact detecting unit 12 may include an imaging unit, and detect finger contact by analyzing an image of an area in the vicinity of the wrist, the image being captured by the imaging unit.
When a preparatory posture is detected by the preparatory posture detecting unit 11, the finger contact detecting unit 12 detects finger contact. With this structure, information is not input in a case where an input unit such as a finger contacts with the skin in the vicinity of the wrist when a posture other than a preparatory posture is detected. Accordingly, inadvertent input due to inadvertent contact of the input unit with the skin in the vicinity of the wrist can be prevented. As the finger contact detecting unit 12 does not operate before a preparatory posture is detected, power consumption by the wearable information input device 10 can be reduced.
In a case where the wearable information input device 10 does not include the preparatory posture detecting unit 11, the finger contact detecting unit 12 detects finger contact constantly or at predetermined time intervals. In this case, the user can input information even in a posture other than a preparatory posture.
The finger position detecting unit 13 detects a position of the finger while finger contact is detected by the finger contact detecting unit 12. The position of the finger detected by the finger position detecting unit 13 is the position of the finger on a plane that is substantially parallel to the portion of the skin with which the finger contacts so as to input information. The finger position detecting unit 13 can detect the position of the finger by any appropriate conventional method.
For example, the finger position detecting unit 13 may be designed to include at least two light emitting devices arranged at a predetermined interval, and a light receiving device that receives light emitted from the light emitting devices.
In the finger position detecting unit 13 having such a structure, the LEDs 131 and 133 alternately emit light at predetermined time intervals (time-sharing light emission), and, at predetermined sampling intervals, the photodiode 132 detects the intensities of light beams that are emitted from the LEDs 131 and 133 and are then reflected. The sampling intervals are preferably synchronized with the time-sharing light emission. Accordingly, the photodiode 132 can detect the intensity of reflected light of the LED 131 and the intensity of reflected light of the LED 133 at the predetermined sampling intervals.
The intensities of light beams that are emitted from the respective LEDs and are then reflected vary with the distances from the respective LEDs to the finger, and accordingly, the distances from the respective LEDs to the finger can be modeled in accordance with the intensities of reflected light beams. Accordingly, the finger position detecting unit 13 can detect the position of the finger by comparing the intensity of reflected light of each LED detected by the photodiode 132 with the modeled distance from each corresponding LED.
The finger position detection method implemented by the finger position detecting unit 13 is not limited to the above described method. For example, the finger position detecting unit 13 can detect the position of a finger by analyzing an image of the finger captured by an imaging unit such as a camera.
The input posture detecting unit 14 detects an input posture. An input posture is the posture (tilt) of the upper limb having the wearable information input device 10 attached thereto while the user is inputting information or while finger contact is detected by the finger contact detecting unit 12. As the wearable information input device 10 is attached to the wrist of the user, the posture of the upper limb having the wearable information input device 10 attached thereto is substantially the same as the posture of the wearable information input device 10. Accordingly, the input posture detecting unit 14 can detect an input posture by detecting the posture (tilt) of the wearable information input device 10. While finger contact is detected by the finger contact detecting unit 12, the input posture detecting unit 14 detects the posture of the wearable information input device 10 constantly or at predetermined sampling intervals.
So as to detect the posture (tilt) of the wearable information input device 10, the input posture detecting unit 14 includes an acceleration sensor, a geomagnetic sensor, an angular velocity sensor, or the like. In a case where the input posture detecting unit 14 detects a posture with an acceleration sensor, the acceleration sensor is preferably a triaxial acceleration sensor. The input posture detecting unit 14 may share the means to detect the posture of the wearable information input device 10 with the preparatory posture detecting unit 11. Alternatively, the wearable information input device 10 may not include the input posture detecting unit 14.
The trajectory generating unit 15 generates a trajectory of motion of a finger based on information about the position of the finger detected by the finger position detecting unit 13. The trajectory generating unit 15 acquires information about successive finger positions detected between the start and the end of finger position detection by the finger position detecting unit 13, and generates a trajectory of the finger by arranging the acquired position information in chronological order.
Based on information about the trajectory of the finger generated by the trajectory generating unit 15, the input recognizing unit 16 recognizes input contents that have been input by the user. The input contents include a handwritten character, a cursor operation (a cursor movement or a click), a gesture such as a flicking action, or the like.
For example, in a case where the input contents include a character, the input recognizing unit 16 performs character recognition, and recognizes the input character. In a case where the input character has one stroke, the input recognizing unit 16 can recognize the input character at the same time as the acquisition of the trajectory information from the trajectory generating unit 15. In a case where a character with two or more strokes is input, the input recognizing unit 16 is unable to correctly recognize the input contents from a single piece of trajectory information. Therefore, the input recognizing unit 16 temporarily stores trajectory information acquired from the trajectory generating unit 15, and recognizes the input contents based on more than one piece of stored trajectory information. For example, the input recognizing unit 16 temporarily stores trajectory information acquired since the start of an input of a character, and determines that the input of one character has been completed when the duration of a finger non-contact state detected by the finger contact detecting unit 12 becomes equal to or longer than a predetermined value. The input recognizing unit 16 then recognizes the input contents based on the trajectory information acquired so far. Such a method for correctly recognizing input contents from a handwritten input can be selected from appropriate conventional methods.
In a case where the input contents include a cursor operation, the input recognizing unit 16 performs pointing recognition, to recognize the input cursor operation. In a case where finger contact in the vicinity of a finger position detected immediately before a finger non-contact state is detected is detected within a predetermined period of time after the finger contact detecting unit 12 detects the finger non-contact state, the input recognizing unit 16 may recognize a click. A double click can be recognized in the same manner as above.
In a case where the input contents include a gesture, the input recognizing unit 16 performs gesture recognition, to recognize the input gesture. The gesture may be a flicking action.
The method of recognition to be performed by the input recognizing unit 16, such as character recognition, gesture recognition, or pointing recognition, may be the same as a conventional method using a touch pad, a mouse, or a pointing device, or may be a uniquely developed method. The type of input contents (a character, a gesture, a cursor operation, or the like) may be determined by the input recognizing unit 16 based on trajectory information or the like, or may be designated by a user operation.
The input recognizing unit 16 also recognizes input contents based on an input posture detected by the input posture detecting unit 14. For example, the input recognizing unit 16 sets the downward direction (or upward direction) in a finger trajectory based on input posture information acquired from the input posture detecting unit 14.
By setting the downward direction (or the upward direction) of a trajectory and recognizing input contents, the input recognizing unit 16 can recognize the input contents that the user has intended. The input recognizing unit 16 may also have a mode for fixing the downward direction of a finger trajectory to a predetermined direction or a direction designated by the user while recognizing input contents. By using this mode, the input recognizing unit 16 can recognize input contents that the user has intended, even if the user has input the information while lying down.
In a case where the wearable information input device 10 does not include the input posture detecting unit 14, the input recognizing unit 16 recognizes input contents from trajectory information, with a predetermined direction being set as the downward direction (or the upward direction).
The storage unit 17 stores input contents recognized by the input recognizing unit 16. The input contents stored in the storage unit 17 can be output by any appropriate conventional method. For example, the wearable information input device 10 may be connected to an external device in a wired or wireless manner, and input contents may be output to the external device.
Referring now to
First, the preparatory posture detecting unit 11 starts a preparatory posture detection process to detect a preparatory posture when the user wearing the wearable information input device 10 inputs information to the palm (step S100). The preparatory posture detection process is started when the power supply to the wearable information input device 10 is switched on, for example. Alternatively, in a case where the wearable information input device 10 has a switch that controls switching on and off of the preparatory posture detection process, the preparatory posture detecting unit 11 starts the preparatory posture detection process when the switch is turned on. The preparatory posture detecting unit 11 ends the preparatory posture detection process when the power supply to the wearable information input device 10 is switched off, or when the switch is turned off.
After starting the preparatory posture detection process, the preparatory posture detecting unit 11 detects the posture of the wearable information input device 10 constantly or at predetermined time intervals until the preparatory posture detection process comes to an end, and performs a preparatory posture detection determination by comparing the detected posture of the wearable information input device 10 with a predetermined preparatory posture (step S101). The preparatory posture detecting unit 11 detects the posture of the wearable information input device 10 by monitoring acceleration in the direction of gravitational acceleration, for example. When the posture of the wearable information input device 10 matches the predetermined preparatory posture, the preparatory posture detecting unit 11 determines that the user is in a preparatory posture.
When the preparatory posture detecting unit 11 determines that the user is in a preparatory posture, or when the preparatory posture detecting unit 11 detects a preparatory posture (Yes in step S101), the finger contact detecting unit 12 starts a finger contact detection process to detect contact of a finger of the user with the palm (step S102). As the finger contact detection process is performed when a preparatory posture is detected by the preparatory posture detecting unit 11, inadvertent input is prevented, and power consumption can be reduced.
After starting the finger contact detection process, the finger contact detecting unit 12 detects capacitance with the capacitance sensor constantly or at predetermined sampling intervals until the finger contact detection process comes to an end, and performs a finger contact detection determination based on the detected capacitance (step S103). The finger contact detection determination can be performed by comparing the detected capacitance with a predetermined capacitance or detecting a change in the detected capacitance.
In a case where the wearable information input device 10 does not include the preparatory posture detecting unit 11, the finger contact detecting unit 12 starts the finger contact detection process when the power supply to the wearable information input device 10 is switched on. Alternatively, in a case where the wearable information input device 10 has a switch that controls switching on and off of the finger contact detection process, the finger contact detecting unit 12 starts the finger contact detection process when the switch is turned on.
When the finger contact detecting unit 12 detects finger contact (Yes in step S103), the finger position detecting unit 13 starts a finger position detection process to detect the position of the finger of the user, and the input posture detecting unit 14 starts an input posture detection process to detect an input posture (step S104). After starting the finger position detection process, the finger position detecting unit 13 detects a position of the finger of the user constantly or at predetermined sampling intervals until the finger position detection process comes to an end, and transmits information about detected finger positions to the trajectory generating unit 15. Likewise, after starting the input posture detection process, the input posture detecting unit 14 detects an input posture constantly or at predetermined sampling intervals until the input posture detection process comes to an end, and transmits information about the detected input posture to the trajectory generating unit 15. The input posture detecting unit 14 may also transmit the input posture information to the input recognizing unit 16.
If the finger contact detecting unit 12 detects a finger non-contact state or an event that the finger comes off the palm after detecting the finger contact (Yes in step S105), the finger position detecting unit 13 ends the finger position detection process, and the input posture detecting unit 14 ends the input posture detection process (step S106). Based on the information about the series of finger positions received from the finger position detecting unit 13 while the finger contact detecting unit 12 detects finger contact, the trajectory generating unit 15 generates a trajectory of motion of the finger in contact with the palm (step S107). The trajectory generating unit 15 transmits the generated trajectory information and the input posture information received from the input posture detecting unit 14, to the input recognizing unit 16.
Based on the trajectory information and the input posture information received from the trajectory generating unit 15, the input recognizing unit 16 recognizes input contents that have been input by the user (step S108). For example, the input recognizing unit 16 can recognize a gesture such as a flicking action through gesture recognition. The input recognizing unit 16 can also recognize an input character through character recognition. The input recognizing unit 16 can also recognize a cursor operation through pointing recognition. The input recognizing unit 16 transmits the recognized input contents to the storage unit 17.
The storage unit 17 stores the input contents transmitted from the input recognizing unit 16 (step S109). The input contents stored in the storage unit 17 can be output to an external device by using a wired or wireless communication or a USB (Universal Serial Bus).
If the user remains in a preparatory posture even or a preparatory posture is still detected by the preparatory posture detecting unit 11 after the user removes the finger from the palm (Yes in step S110), it is considered that the input by the user has not ended. Therefore, the finger contact detecting unit 12 continues the finger contact detection process (step S103).
If the user is not in a preparatory posture or a preparatory posture is not detected by the preparatory posture detecting unit 11 after the user removes the finger from the palm (No in step S110), it is considered that the input by the user has ended. Therefore, the finger contact detecting unit 12 ends the finger contact detection process (step S111). After the finger contact detecting unit 12 ends the finger contact detection process, the preparatory posture detecting unit 11 continues the preparatory posture detection process (step S101) until the power supply to the wearable information input device 10 is switched off, for example.
As described above, with the wearable information input device 10 according to this embodiment, a user can input a character by writing the character on a palm, and can input a gesture or a cursor operation by moving a finger on a palm.
Accordingly, the user can input information through these intuitive actions. Also, the user does not need to store timings to tap respective fingers for inputting information and the correlation among the timings in advance. Thus, the user can readily input information.
Referring now to
The control unit 18 generates a control signal for the wearable information input device 10 in accordance with input contents recognized by the input recognizing unit 16. In a case where a character is input, the control unit 18 generates a control signal for causing the output unit 19 to output the input character. In a case where a cursor operation is input, the control unit 18 generates a control signal for operating the cursor displayed on the output unit 19 in accordance with the input cursor operation. In a case where a gesture is input, the control unit 18 generates a control signal for changing the output from the output unit 19 in accordance with the input gesture.
The output unit 19 outputs a result of control in accordance with a control signal generated by the control unit 18. In a case where the control unit 18 generates a control signal for displaying input contents, the input contents are displayed on the output unit 19. Any appropriate conventional output device can be used as the output unit 19. For example, the output unit 19 may be a display that outputs information as an image, or may be a speaker that outputs information as sound. The output unit 19 may be a vibration motor that outputs information as vibration.
For example, when a horizontal/vertical flicking action is input, the control unit 18 generates a control signal for sliding and switching displayed screens of the output unit 19. In the wearable information input device 10 having the output unit 19 as a display, the output unit 19 may display the time. In this case, the user can also use the wearable information input device 10 as a wristwatch. Alternatively, the functional structure of the wearable information input device 10 may be incorporated into a wristwatch.
In the wearable information input device 10 having the output unit 19 as a display as shown in
As described above, with the wearable information input device 10 according to this embodiment, a user can cause the output unit 19 to output information that has been input to or stored into the wearable information input device 10, and check the information without the use of any external device.
Referring now to
The control unit 18 generates a control signal for operating an external device in accordance with input contents recognized by the input recognizing unit 16. In a case where a character is input, the control unit 18 generates a control signal for causing an external device to output the input character. In a case where a cursor operation is input, the control unit 18 generates a control signal for operating the cursor displayed on an external device in accordance with the input cursor operation. In a case where a gesture is input, the control unit 18 generates a control signal for changing the output from an external device in accordance with the input gesture. It should be noted that the control unit 18 may generate a control signal for the wearable information input device 10 in accordance with input contents recognized by the input recognizing unit 16, as in the second embodiment.
The communication unit 20 communicates with an external device having a communication function, and transmits a control signal generated by the control unit 18 to the external device. The communication unit 20 may be a wireless communication means such as Bluetooth™, Wi-Fi™, ZigBee™, or infrared rays, or may be a cable communication means. Via the communication unit 20, the wearable information input device 10 can communicate with an external device having a communication function and an output function, such as a PC, a television receiver, a smartphone, a tablet PC, an eyeglass-type wearable device, a digital signage device, a projector connected to a screen, or an audio device. The wearable information input device 10 is associated (paired) with one or more external devices, and a control signal is transmitted to an associated external device.
As shown in
As shown in
As shown in
As described above, a user can operate an external device 100 by using the wearable information input device 10 according to this embodiment. Accordingly, the user can operate an external device 100 without the use of a special input unit (such as a remote controller of a television receiver, or a mouse of a PC) of the external device 100.
Referring now to
The wearable information input device 10 includes a preparatory posture detecting unit 11, a finger contact detecting unit 12, a finger position detecting unit 13, an input posture detecting unit 14, and a communication unit 20. The above components are the same as those of the foregoing embodiments.
The external device 100 has a communication function, and is associated with the wearable information input device 10 via the communication unit 20. The external device 100 is a PC, a television receiver, a smartphone, a tablet PC, an eyeglass-type wearable device, a digital signage device, a projector connected to a screen, or an audio device, for example. In this embodiment, the external device 100 includes a trajectory generating unit 15 and an input recognizing unit 16. The structures of the trajectory generating unit 15 and the input recognizing unit 16 are the same as those of the foregoing embodiments.
In this embodiment, when a user inputs information by using the wearable information input device 10, the finger position detecting unit 13 detects a finger position, and the input posture detecting unit 14 detects an input posture. The communication unit 20 transmits finger position information and input posture information to the trajectory generating unit 15 of the external device 100 at sampling intervals or when a finger non-contact state is detected by the finger contact detecting unit 12. When the external device 100 receives the finger position information and the input posture information, the trajectory generating unit 15 generates trajectory information based on the finger position information, and the input recognizing unit 16 recognizes input contents based on the trajectory information and the input posture information.
The external device 100 can store recognized input contents. In a case where the external device 100 includes an output means, input contents may be output form the output means. Further, the external device 100 may transmit input contents and a control signal generated in accordance with the input contents to the wearable information input device 10 or another external device.
As shown in
As described above, the wearable information input device 10 according to this embodiment does not include the input recognizing unit 16, but the external device 100 includes the input recognizing unit 16. Accordingly, the input contents recognition method of a user can be updated by updating the input recognizing unit 16 included in the external device 100, without any change being made to the wearable information input device 10. For example, when the recognition method in the input recognizing unit 16 is updated to enable new gesture recognition, the user can use a new gesture operation, without making any change to the wearable information input device 10.
Referring now to
The wearable information input device 10 includes a preparatory posture detecting unit 11, a finger contact detecting unit 12, a finger position detecting unit 13, an input posture detecting unit 14, a trajectory generating unit 15, a control unit 18, an output unit 19, and a communication unit 20. The above components are the same as those of the foregoing embodiments.
The server 100 is an external device that is provided on the Internet, and is associated with the wearable information input device 10 via the communication unit 20. The server 100 includes an input recognizing unit 16. The structure of the input recognizing unit 16 is the same as that of the foregoing embodiments.
In this embodiment, when a user inputs information by using the wearable information input device 10, the finger position detecting unit 13 detects a finger position, and the input posture detecting unit 14 detects an input posture. The trajectory generating unit 15 generates trajectory information based on the finger position information. The communication unit 20 is connected to the Internet through a cellular phone network or via a Wi-Fi router, and transmits the trajectory information and the input posture information to the server 100.
The communication unit 20 transmits the trajectory information when the finger contact detecting unit 12 detects a finger non-contact state of the user, for example. Also, the communication unit 20 may transmit the input posture information at sampling intervals, or may collectively transmit the input posture information of a predetermined period stored in the input posture detecting unit 14 when transmitting the trajectory information. When the server 100 receives the trajectory information and the input posture information, the input recognizing unit 16 recognizes input contents.
In the information input system 200, the wearable information input device 10 may not include the trajectory generating unit 15, and the server 100 may include the trajectory generating unit 15, as in the fourth embodiment illustrated in
As described above, the wearable information input device 10 according to this embodiment does not include the input recognizing unit 16, but the server 100 on the Internet includes the input recognizing unit 16. Accordingly, more than one user can use the input recognizing unit 16 at the same time, and the input contents recognition methods of the users can be collectively updated by updating the input recognizing unit 16 included in the server 100, without any change being made to the wearable information input device 10.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2013-265827 | Dec 2013 | JP | national |