This application claims priority under 35 U.S.C. §119 to an application entitled “System and Method for Manipulating Portable Equipment Using Foot Motion” filed in the Korean Intellectual Property Office on Dec. 2, 2005 and assigned Serial No. 2005-116902, the contents of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates generally to a system and method for manipulating portable equipment, and in particular, to a system and method for manipulating portable equipment in response to a human foot motion.
2. Description of the Related Art
Portable equipment supporting a variety of functions in addition to a call function, such as TV and music functions, is rapidly becoming more popular in place of the traditional indoor electronic appliances that provide such functions.
As this popularization occurs, consumers are requiring an ease of manipulation of these functions, creating a substantial amount of research in methods for manipulation of such portable equipment.
For example, button pressing was predominately used to activate functions in previous generation portable equipment, but touch screen or voice recognition is increasingly popular in current-generation portable equipment, to reduce button space or increase manipulations. Also, a method for manipulating portable equipment by motion recognition of an installed geomagnetic sensor or acceleration sensor is currently being used.
However, in the conventional button or touch screen methods, it is impossible to manipulate the portable equipment when a user cannot use his/her hands or is not carrying the portable equipment. Furthermore, multiple button presses can be troublesome.
In the conventional voice recognition method, when ambient noise is present, it can be difficult for voice to be recognized. This causes inconvenience of portable equipment manipulation. In the motion manipulation method, the portable equipment itself should be in motion, which is inconvenient when a user attempts to manipulate the portable equipment while viewing a display state of the in-motion portable equipment.
In view of the foregoing, there is a need for an improved manipulation method for portable equipment.
It is, therefore, an object of the present invention to provide a system and method for manipulating portable equipment in response to an external foot motion even when a user cannot use his/her hands or does not carry the portable equipment.
It is another object of the present invention to provide a system and method for manipulating portable equipment in response to an external foot motion to provide a more interesting and enjoyable method for manipulating portable equipment.
It is a further object of the present invention to provide a system and method for manipulating portable equipment in response to an external foot motion so that music can be variously expressed when a user uses an entertainment function such as a music playing function using the portable equipment.
To achieve the above and other objects, there is provided a system for manipulating portable equipment using a foot motion. The system includes a foot motion sense module for sensing a user's foot motion, and collecting sensor data based on the user's foot motion, and the portable equipment for receiving the sensor data based on the user's foot motion, recognizing the foot motion, and performing a portable equipment function depending on the foot motion recognition result.
According to the present invention, there is provided a method for manipulating portable equipment using a foot motion. The method includes sensing a user' foot motion, and collecting sensor data based on the user's foot motion, recognizing the foot motion using the sensor data based on the user's foot motion, and performing a portable equipment function in response to the foot motion recognition result.
The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings in which:
Preferred embodiments of the present invention will now be described in detail with reference to the annexed drawings. In the drawings, the same or similar elements are denoted by the same reference numerals even though they are depicted in different drawings. In the following description, a detailed description of known functions and configurations incorporated herein has been omitted for the sake of clarity and conciseness.
The foot motion sense module 100 senses the user's foot motion. The foot motion sense module 100 can be of any type that is capable of sensing the user's foot motion. When a user's foot is in motion, the foot motion sense module 100 collects sensor data based on the user's foot motion, and transmits the collected sensor data to the portable equipment 200.
The portable equipment 200 refers to equipment for supporting not only a call function but also a variety of functions such as a tap dance function, a melody musical instrument playing function, and a music player function. The portable equipment 200 receives the sensor data based on the foot motion from the foot motion sense module 100, recognizes the foot motion, and is manipulated depending on the foot motion recognition result.
After recognizing the foot motion using the sensor data based on the foot motion, the foot motion sense module 100 can provide the foot motion recognition result to the portable equipment 200. The portable equipment 200 can be also manipulated, receiving the foot motion recognition result.
Constructions of the foot motion sense module 100 and the portable equipment 200 of the system for manipulating the portable equipment using the foot motion according to the present invention will be described below in detail.
The driver 110 drives the foot motion sense module 100 in response to a user's request for sensing the foot motion. The request for sensing the foot motion is made by the user to request that the foot motion sense module 100 sense the foot motion, so as to manipulate the portable equipment using the foot motion. The request for sensing the foot motion can be received from the portable equipment 200, or can be recognized by the foot motion sense module 100 itself.
For example, when the portable equipment 200 generates the request for sensing the foot motion, it transmits a foot motion sense request signal to the foot motion sense module 100, and the driver 110 drives the foot motion sense module 100 in response to the foot motion sense request signal. Also, the foot motion sense module 100 itself is provided with the driver 110 comprised of a contact and/or magnetic sensor or switch, such that, the foot motion sense module 100 can be driven when there is sufficient contact therewith by the user.
For example, referring to
The sensing unit 120 includes a pressure sensor 121, an impact sensor 122, a gyro sensor 123 and an acceleration sensor 124. As the foot motion sense module 100 is driven, each of the sensors outputs a sensor value based on the foot motion.
The pressure sensor 121 senses a pressure caused by the foot motion, and outputs a sensor value associated with the pressure sense result based on the foot motion. The impact sensor 122 senses an impact caused by the foot motion, and outputs a sensor value associated with the impact sense result based on the foot motion. The gyro sensor 123 senses a foot motion direction, and outputs a sensor value associated with the direction sense result based on the foot motion. The acceleration sensor 124 senses a foot motion speed, and outputs a sensor value associated with the speed sense result based on the foot motion.
As the foot motion sense module 100 is driven, the controller 130 receives each of the sensor values of the sensing unit 120, and collects and transmits the sensor data based on the foot motion to the portable equipment 200 through the local area radio communication unit 150. After recognizing the foot motion using the respective sensor values of the sensing unit 120, the controller 130 can also transmit the foot motion recognition result to the portable equipment 200.
The memory 140 temporarily stores the sensor data based on the foot motion, or stores program for transmitting the sensor data based on the foot motion to the portable equipment 200. When the controller 130 recognizes the foot motion, the memory 140 can also store information for foot motion recognition provided from the respective sensor data.
The local area radio communication unit 150 can include an infrared communication module, a ZigBee™ communication module, and a Bluetooth® communication module, and performs a local area radio communication with the portable equipment 200. Under the control of the controller 130, the local area radio communication unit 150 transmits the sensor data based on the foot motion to the portable equipment 200, or transmits the foot motion recognition result provided from the foot motion sensor data, to the portable equipment 200.
According to the present invention, the foot motion sense module 100 can be of a special shoe type, and can be built in the shoe or can be installed as a separate device in the shoe.
Referring to
Referring to
The local area radio communication unit 204 may include any one of an infrared communication module, a ZigBee™ communication module and a Bluetooth® communication module, and performs a local area radio communication with the foot motion sense module 100. The local area radio communication unit 204 receives the sensor data based on the foot motion, or receives the foot motion recognition result from the foot motion sense module 100.
The foot motion recognition unit 206 recognizes the foot motion, using the sensor data based on the foot motion that is received using the local area radio communication unit 204, and outputs the foot motion recognition result to the controller 208. The foot motion recognition unit 206 can recognize single or plural foot motions. The single foot motion literally refers to one foot motion, while the plural foot motion refers to two or more foot motions.
Referring back to
The controller 208 receives the foot motion recognition result using the local area radio communication unit 204 or the foot motion recognition unit 206, and performs a portable equipment function in response to the foot motion recognition result. The controller 208 performs a portable equipment manipulation command or function corresponding to the recognized foot motion, using previously stored portable equipment manipulation command or function information corresponding to each foot motion.
In other words, if any one of the single foot motions of
The memory 210 temporarily stores the sensor data based on the foot motion received from the foot motion sense module 100, or stores the information for foot motion recognition provided from each sensor data. The memory 210 stores a plurality of programs and data for performing a variety of functions such as the tap dance, the melody musical instrument playing and the music player functions. Herein, the tap dance function refers to creating tap dance music using the user's foot motion. The melody musical instrument playing function refers to creating melody music using the user's foot motion. The music player function refers to enabling a music player using the user's foot motion.
The memory 210 stores a portable equipment manipulation command or function execution command corresponding to each foot motion. The portable equipment manipulation command or function information corresponding to each foot motion can be designated and stored by the user, or can be designated and stored by a manufacturer when the system for manipulating the portable equipment is manufactured.
The display unit 212 can include a liquid crystal display (LCD). The display unit 212 displays display data that is generated in execution of the function using the foot motion recognition according to the present invention.
The radio unit 214 communicates a radio signal with a mobile communication base station, provides the received radio signal to the controller 208, and transmits the radio signal from the controller 208 to the mobile communication base station, thereby enabling a mobile communication function.
The audio unit 216 connects with a microphone and a speaker. Under the control of the controller 208, the audio unit 216 converts an analog audio signal received from the microphone into digital audio data, and outputs the converted audio data to the controller 208. The audio unit 216 converts digital audio data received from the controller 208 into an analog audio signal, and outputs the converted audio signal through the speaker.
Referring to
When the portable equipment 200 generates the request for sensing the foot motion, it transmits the foot motion sense request signal to the foot motion sense module 100. The foot motion sense module 100 is provided with the driver 110 including the contact and/or magnetic sensor or switch, and when there is sufficient contact by the user, the foot motion sense module 100 recognizes it as the foot motion sense request. Upon the receipt of the user's foot motion sense request, in Step 704, the foot motion sense module 100 drives its sensing unit 120 and controller 130 using the driver 110.
When the sensor unit 120 and the controller 130 are driven as above, in Step 706, the foot motion sense module 100 collects the sensor data based on the foot motion using the sensing unit 120. For example, the foot motion sense module 100 collects pressure sensor data, impact sensor data, geomagnetic sensor data and acceleration sensor data based on the foot motion, using the sensing unit 120.
In Step 708, the foot motion sense module 100 transmits the respective collected sensor data to the portable equipment 200 using the local area radio communication. The foot motion sense module 100 can use the local area radio communication such as infrared communication, ZigBee™ communication and Bluetooth® communication.
The portable equipment 200 receives the sensor data from the foot motion sense module 100, and recognizes the foot motion corresponding to the sensor data in Step 710. For example, the portable equipment 200 stores the sensor critical value for the previously designated foot motion, and recognizes the previously designated foot motion when the received sensor data corresponds to the previously stored sensor critical value. The previously designated foot motion can be the single foot motion or the plural foot motion.
A process of recognizing the foot motion corresponding to the sensor data can be also performed in the foot motion sense module 100. When the foot motion sense module 100 recognizes the foot motion corresponding to the sensor data, it recognizes the foot motion from the sensor data and then transmits the foot motion recognition result to the portable equipment 200, without transmitting the sensor data to the portable equipment 100.
Recognizing the foot motion, in Step 712, the portable equipment 200 performs the portable equipment function depending on the foot motion recognition result. In other words, the portable equipment 200 performs the portable equipment function using the previously designated portable equipment manipulation command or function information in response to each recognized foot motion. For example, the portable equipment 200 can perform the tap dance, the melody musical instrument playing and the music player functions, depending on the previously designated portable equipment manipulation command or function information, in response to each foot motion.
Referring to
The foot motion sense module 100 collects the sensor data based on the foot motion using the sensing unit 120 in Step 808. For example, the foot motion sense module 100 collects the pressure sensor data, the impact sensor data, the geomagnetic sensor data and the acceleration sensor data based on the foot motion, using the sensing unit 120.
In Step 810, the foot motion sense module 100 transmits the respective collected sensor data to the portable equipment 200 using the local area radio communication. The foot motion sense module 100 can use the local area radio communication such as infrared communication, ZigBee™ communication and Bluetooth® communication.
Upon receipt of the sensor data from the foot motion sense module 100, in Step 812, the portable equipment 200 recognizes a stomping motion corresponding to a tap dance, from the sensor data. For example, the portable equipment 200 previously stores a sensor critical value for determining the stomping motion corresponding to the tap dance, and recognizes the foot motion as the stomping motion corresponding to the tap dance when the collected sensor data corresponds to the previously stored sensor critical value.
A process of recognizing the stomping motion corresponding to the tap dance can be also performed in the foot motion sense module 100. When the foot motion sense module 100 recognizes the stomping motion corresponding to the tap dance, it recognizes it from the sensor data and then transmits the recognition result to the portable equipment 200, without transmitting the sensor data to the portable equipment 100.
In Step 814, the portable equipment 200 determines a strength and a length of the recognized stomping motion. In other words, the portable equipment 200 determines with how much force the stomping motion is made and for how long the stomping motion persists.
In Step 816, the portable equipment 200 creates the tap dance music depending on the strength and the length of each stomping motion. The portable equipment 200 previously stores a tap dance sound source corresponding to each strength and length of the stomping motion, and combines the tap dance sound sources corresponding to the strengths and the lengths of the stomping motions with each other, to create the tap dance music.
In Step 818, the portable equipment 200 outputs the tap dance music by the speaker using the audio unit 216. The portable equipment 200 can also store the tap dance music in the memory 210, and output the stored tap dance music upon user's request.
Referring to
Upon the receipt of the foot motion sense request for the melody musical instrument playing function, the foot motion sense module 100 is driven using the driver 110 in Step 906. The foot motion sense module 100 collects the sensor data based on the foot motion using the sensing unit 120 in Step 908. For example, the foot motion sense module 100 collects the pressure sensor data, the impact sensor data, the geomagnetic sensor data and the acceleration sensor data based on the foot motion, using the sensing unit 120.
In Step 910, the foot motion sense module 100 transmits the respective collected sensor data to the portable equipment 200 using the local area radio communication. The foot motion sense module 100 can use the local area radio communication such as infrared communication, ZigBee™ communication and Bluetooth® communication.
Upon the receipt of the sensor data from the foot motion sense module 100, in Step 912, the portable equipment 200 recognizes a foot motion direction corresponding to the melody musical instrument playing function from the sensor data. For example, the portable equipment 200 previously stores a sensor critical value for determining the foot motion direction corresponding to the melody musical instrument playing function, and recognizes the foot motion as the foot motion direction corresponding to the melody musical instrument playing function when the collected sensor data corresponds to the previously stored sensor critical value.
A process of recognizing the foot motion direction corresponding to the melody musical instrument playing function can be also performed in the foot motion sense module 100. When the foot motion sense module 100 recognizes the foot motion direction corresponding to the melody musical instrument playing function, it recognizes the foot motion direction corresponding to the melody musical instrument playing function from the sensor data and then transmits the recognition result to the portable equipment 200, without transmitting the sensor data to the portable equipment 100.
In Step 914, the portable equipment 200 determines musical scales corresponding to the respective recognized foot motion directions, using previously stored musical scales.
For example, the portable equipment 200 stores eight-scale, such as Do, Re, Mi, Fa, Sol, La, Ti, Do, associated with four forth and back, left and right directions and four diagonal directions between those four directions, and determines the scales corresponding to the respective foot motion directions.
After that, in Step 916, the portable equipment 200 creates a melody depending on the scale corresponding to the foot motion direction.
In Step 918, the portable equipment 200 outputs the created melody by the speaker, using the audio unit 216. The portable equipment 200 can also store the created melody in the memory 210, and output the stored melody upon a user's request.
Referring to
The foot motion sense module 100 collects the sensor data based on the foot motion using the sensing unit 120 in Step 18. For example, the foot motion sense module 100 collects the pressure sensor data, the impact sensor data, the geomagnetic sensor data and the acceleration sensor data based on the foot motion, using the sensing unit 120.
In Step 20, the foot motion sense module 100 transmits the respective collected sensor data to the portable equipment 200 using the local area radio communication. The foot motion sense module 100 can use the local area radio communication such as infrared communication, ZigBee™ communication and Bluetooth® communication.
Upon the receipt of the sensor data from the foot motion sense module 100, in Step 22, the portable equipment 200 recognizes foot motion direction and pressure corresponding to the music player function from the sensor data. For example, the portable equipment 200 previously stores a sensor critical value for determining the foot motion direction and pressure corresponding to the music player function, and recognizes the foot motion as the foot motion direction and pressure corresponding to the music player function when the collected sensor data corresponds to the previously stored sensor critical value.
A process of recognizing the foot motion direction and pressure corresponding to the music player function can be also performed in the foot motion sense module 100. The foot motion sense module 100 recognizes the foot motion direction and pressure corresponding to the music player function from the sensor data and then transmits the recognition result to the portable equipment 200, without transmitting the sensor data to the portable equipment 100.
In Step 24, the portable equipment 200 determines a music player control command corresponding to each recognized foot motion direction and pressure, using a previously stored music player control command corresponding to the foot motion direction and pressure.
For example, the portable equipment 200 stores the music player control commands such as fast forward (FF), rewind (REW), PLAY, and STOP, associated with four directions forth and back, left and right, and pressures caused by the foot motions based on those four directions, and determines the music player control command corresponding to each foot motion direction and pressure. In Step 26, the portable equipment 200 performs the music player function in response to the music player control command.
As described above, in the present invention, even when the user does not use his or her hands to manipulate the portable equipment, the manipulation is performed in response to the foot motion. In the present invention, the foot motion is recognized to manipulate the portable equipment, thereby increasing freedom of manipulation of the respective functions of the portable equipment and operating the respective functions with fun. In the present invention, the entertainment function of the portable equipment is controlled using the foot motion, thereby allowing the user to more enjoyably use the entertainment function. The present invention can be utilized as a utensil for user's music creation, by creating the tap dance music or creating the melody depending on the foot motion. In the present invention, the strength, length and melody of sound can be expressed using the foot motion, thereby allowing the user to create and play the music, controlling desired time, rhythm, tempo and accent by foot.
While the invention has been shown and described with reference to a certain preferred embodiment thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. For example, in the present invention, several single foot motions and plural foot motions are described as one example, but several other single foot motions and plural foot motions than the above described foot motions can be used.
In the present invention, the methods for controlling the tap dance function, the melody musical instrument playing function, and the music player function, and manipulating the portable equipment using the foot motion are described, but are also applicable to all functions that can be performed by the portable equipment, such as a call function, a scheduling function, a TV viewing function and an alarming function, other than the above functions.
Number | Date | Country | Kind |
---|---|---|---|
10-2005-0116902 | Dec 2005 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
4578769 | Frederick | Mar 1986 | A |
4660305 | Medler et al. | Apr 1987 | A |
4703445 | Dassler | Oct 1987 | A |
5139261 | Openiano | Aug 1992 | A |
5461188 | Drago et al. | Oct 1995 | A |
5467652 | Richards | Nov 1995 | A |
5615111 | Raskas et al. | Mar 1997 | A |
5714706 | Nakada et al. | Feb 1998 | A |
5855080 | Van Staden | Jan 1999 | A |
6315571 | Lee | Nov 2001 | B1 |
6326539 | Mishima | Dec 2001 | B1 |
6356856 | Damen et al. | Mar 2002 | B1 |
6358187 | Smith | Mar 2002 | B1 |
6428449 | Apseloff | Aug 2002 | B1 |
6430843 | Potter et al. | Aug 2002 | B1 |
6585622 | Shum et al. | Jul 2003 | B1 |
7188439 | DiBenedetto et al. | Mar 2007 | B2 |
7225565 | DiBenedetto et al. | Jun 2007 | B2 |
7373820 | James | May 2008 | B1 |
7544880 | Takai et al. | Jun 2009 | B2 |
20020183655 | Zhang | Dec 2002 | A1 |
20060286972 | Kates | Dec 2006 | A1 |
20070006489 | Case et al. | Jan 2007 | A1 |
Number | Date | Country |
---|---|---|
01-167889 | Jul 1989 | JP |
09-068973 | Mar 1997 | JP |
20-0362439 | Sep 2004 | KR |
1020050049345 | May 2005 | KR |
1020060037642 | May 2006 | KR |
Number | Date | Country | |
---|---|---|---|
20070149361 A1 | Jun 2007 | US |