The present invention relates to a tone signal generation system, apparatus and method for generating tone signals in response to actions or motions of a human operator or user.
Tone generation apparatus, such as audio equipment, can generate a desired tone, once four major performance parameters, i.e. tone color, tone pitch, tone volume and effect, have been determined. In the case of CD (Compact Disk) players or similar tone generation apparatus, a performance of a music piece is reproduced on the basis of music piece data recorded on a CD, and it has been conventional for users to adjust parameters, such as tone volume, by manipulating a corresponding knob, button and/or other manual operator.
Namely, in the conventional CD players, the users adjust, as appropriate, the corresponding knob, button and/or other manual operator to obtain a desired tone volume and/or the like. Although the performance parameter adjustment via the manual operators is effective in cases where the users listen to the performance, reproduced by the tone generation apparatus, with the desired tone volume and/or the like, new ways of enjoying music could be provided if the tone generation apparatus allow the users to positively take part in a music piece performance rather than being limited to the function of only faithfully reproducing a performance of a designated music piece. Of course, using various types of existing (conventionally-known) acoustic and musical instruments may permit a variety of music pieces to be performed as desired; however, new forms of musical entertainment could be provided if arrangements are made for generating tones reflecting user's motions such as gestures.
In view of the foregoing, it is an object of the present invention to provide a tone signal generation system, apparatus and method for generating a tone signal reflecting a user's motion.
In order to accomplish the above-mentioned object, the present invention provides a tone signal generation system which comprises: an operation terminal that is capable of being carried by a human operator and that generates and transmits motion information corresponding to a motion of the human operator carrying the operation terminal; and a tone signal generation apparatus that receives the motion information from the operation terminal and detects a movement trajectory of the operation terminal corresponding to the motion of the human operator on the basis of the received motion information. The tone signal generation apparatus generates a tone signal on the basis of the detected movement trajectory of the operation terminal.
In one embodiment of the present invention, the tone signal generation apparatus includes a table storing at least one possible movement trajectory of the operation terminal and at least one tone signal in association with each other, so that the tone signal generation apparatus generates a tone signal by referring to stored contents of the table.
The stored contents of the table are rewritable.
In one embodiment, the tone signal generation apparatus determines a first parameter for generating a tone signal in accordance with a shape of the movement trajectory of the operation terminal, a second parameter for generating a tone signal in accordance with a size of the movement trajectory, and a third parameter for generating a tone signal in accordance with a moving speed or acceleration of the movement trajectory.
According to another aspect of the present invention, there is provided a tone signal generation system which comprises: an operation terminal that is capable of being carried by a human operator and that detects a mechanical amount of the operation terminal corresponding to a motion of the human operator carrying the operation terminal, such as an amount of displacement of a predetermined portion of the operation terminal or pressure applied to the predetermined portion, and transmits information indicative of the detected mechanical amount; and a tone signal generation apparatus that receives the information indicative of the detected mechanical amount from the operation terminal and generates a tone signal on the basis of the received information indicative of the detected mechanical amount.
As one example, the operation terminal is in the form of a shoe wearable by the human operator, and the predetermined portion is a bottom of the shoe.
As another example, the operation terminal is in the form of a stick, and the predetermined portion is a tip portion of the stick.
According to still another aspect of the present invention, there is provided a tone signal generation apparatus capable of being carried by a human operator, which comprises: a sensor section that generates motion information corresponding to a motion of the human operator carrying the tone signal generation apparatus; a processing section that detects a movement trajectory of the tone signal generation apparatus corresponding to the motion of the human operator on the basis of the motion information generated by the sensor section; and a tone signal generation section that generates a tone signal on the basis of the movement trajectory detected by the processing section.
According to still another aspect of the present invention, there is provided a tone signal generation apparatus capable of being carried by a human operator, which comprises: a detection section that detects a mechanical amount of the tone signal generation apparatus corresponding to a motion of the human operator carrying the tone signal generation apparatus, such as an amount of displacement of a predetermined portion of the tone signal generation apparatus or pressure applied to the predetermined portion; and a tone signal generation section that generates a tone signal on the basis of information indicative of the mechanical amount detected by the detection section.
The present invention may be constructed and implemented not only as the system or apparatus invention as discussed above but also as a method invention. Also, the present invention may be arranged and implemented as a software program for execution by a processor such as a computer or DSP, as well as a storage medium storing such a program. Further, the processor used in the present invention may comprise a dedicated processor with dedicated logic built in hardware, not to mention a computer or other general-purpose type processor capable of running a desired software program.
While the embodiments to be described herein represent the preferred form of the present invention, it is to be understood that various modifications will occur to those skilled in the art without departing from the spirit of the invention. The scope of the present invention is therefore to be determined solely by the appended claims.
For better understanding of the object and other features of the present invention, its embodiments will be described in greater detail hereinbelow with reference to the accompanying drawings, in which:
A. First Embodiment:
A-1. Construction:
In the instant embodiment, the operation terminal 11 has a bar-like trajectory in external appearance; more specifically, the operation terminal 11 is generally in a “dual frustum-of-cone” trajectory and has a diameter progressively decreasing from it opposite ends toward its middle. In use, the human operator grasps a smaller-diameter middle portion of the operation terminal 11 to move the operation terminal 11. In the tone signal generation system 100, the personal computer system 10 is arranged to generate tones signals corresponding to movements of the operation terminal 11 grasped by the human operator, i.e. motions of a hand of the human operator grasping the operation terminal 11. The operation terminal 11 employed in the instant embodiment is not limited to the aforementioned type that has the diameter progressively decreasing from the opposite ends toward the middle and that is grasped by the human operator. For example, the operation terminal 11 may be attached to an arm, foot or leg using a fastening band or the like and may have any other trajectory; that is, the operation terminal 11 may have any desired trajectory and may be attached to the human operator at any desired portion of the human operator's body and in any desired manner.
When the operation terminal 11 is in use, i.e. when tone signals are to be generated via the tone signal generation system 100, the motion sensor MS detects motions of the human operator carrying the operation terminal 11 (e.g., movements of the human operator's hand in the case where the operation terminal 11 is grasped with the hand of the human operator as illustrated in FIG. 1), to generate motion information. As such a motion sensor MS, there may be used a three-dimensional acceleration sensor, three-dimensional speed sensor, two-dimensional acceleration sensor, two-dimensional speed sensor or the like. In the illustrated example, the motion sensor MS comprises a two-dimensional acceleration sensor, which includes an x-axis detection section MSx and a y-axis detection section MSy. These x-axis and y-axis detection sections MSx and MSy detect acceleration in the x-axis (horizontal) and y-axis (vertical) directions, respectively.
The transmitter CPU T0 controls the above-mentioned motion sensor MS, high-frequency transmitter T2 and display unit T3 on the basis of a transmitter operating program stored in the memory T1. Each detection signal output from the motion sensor MS is fed to the transmitter CPU T0, by which the signal is subjected to predetermined processes such as an ID-number imparting process. The thus-processed detection signal is delivered to the high-frequency transmitter T2, amplified via the transmitting power amplifier T5, and then wirelessly transmitted via the transmitting antenna TA to the personal computer system 10.
The display unit T3 includes seven-segment LEDs or LCD (Liquid Crystal Display) and one or more LEDs, which displays various information such as a sensor number, message “In Operation” and power alarm. The operation switches T6 are used for turning on/off the power to the operation terminal 11 and making various settings such as a mode setting. Driving power is supplied to the individual components of the operation terminal 11 from a battery (not shown) that may be either a primary battery or a rechargeable secondary battery
The personal computer system 10 comprises an ordinary-type personal computer that has a function of receiving the radio signals from the above-described operation terminal 11, a tone generating function and other functions.
The personal computer system 10 is arranged to perform a tone generation process in response to motion information transmitted from the operation terminal 11 by the CPU 30 executing tone generation processing programs stored in the ROM 32 and hard disk 33 in accordance with a user instruction entered via the operation section 36 while the power is on. The following paragraphs describe various functions and construction of the personal computer system 10 focusing on the tone generation process, with primary reference to FIG. 4.
As seen in
The antenna distribution circuit 38 receives detection signals of the x-axis and y-axis detection sections MSx and MSy, i.e. acceleration x in the x-axis direction and acceleration y in the y-axis direction, transmitted wirelessly from the operation terminal 11 moved by the human operator, and then supplies the received signals to the received-signal processing circuit 39.
The received-signal processing circuit 39 of
The movement trajectory detection section 45 detects a movement trajectory (path of movement) of the operation terminal 11 on the basis of the acceleration x in the x-axis direction and acceleration y in the x-axis direction supplied from the received-signal processing circuit 39. More specifically, at a time point when the supplied acceleration values x and y have become greater than a predetermined small threshold value corresponding to a virtually stationary state of the operation terminal 11, the movement trajectory detection section 45 judges that the movement of the operation terminal 11 has been started by the human operator, and starts detecting the movement trajectory of the operation terminal 11 on the basis of the supplied acceleration values x and y from this time point onward. Then, when the supplied acceleration values x and y have become smaller than the predetermined small threshold value during the course of the movement trajectory detection, the movement trajectory detection section 45 judges that the operation terminal 11 has been placed in the virtually stationary state, and then terminates the movement trajectory detection. In this way, the movement trajectory detection section 45 can detect any movement trajectory drawn by a succession of movements of the operation terminal 11 manipulated by the human operator. Although the time period for detecting the movement trajectory may be set on the basis of the supplied acceleration values x and y as noted above, there may be provided a separate switch or the like on or in association with the operation terminal 11 for designating a desired movement-trajectory detecting time period so that the movement trajectory detection section 45 detects a movement trajectory on the basis of the acceleration values x and y supplied while the switch is in a depressed or activated state. In this case, the human operator makes desired motions while depressing that switch only for a time period when the movement trajectory of the operation terminal 11 is to be detected.
Namely, the movement trajectory detection section 45 provides information pertaining to a movement trajectory of the operation terminal 11 (i.e., movement trajectory information) on the basis of the acceleration values x and y supplied from the received-signal processing circuit 39 during the above-mentioned time period. Here, the “movement trajectory information” include items of information that are indicative of an approximate overall trajectory, size, moving direction, moving speed, etc. of the movement trajectory of the operation terminal in question. For example, when the human operator has moved the operation terminal 11 in a clockwise direction at a speed of “V” in such a manner to draw a circular trajectory shape representative of one revolution as shown in
Here, for detection of a movement trajectory shape of the operation terminal 11 on the basis of acceleration values x and y supplied from the operation terminal 11, there may be employed a detection scheme in accordance with which a movement trajectory is detected for an entire section from the start to end of the movement on the basis of the supplied acceleration values x and y and then the movement trajectory shape is identified by determining which one of already-known shapes the detected movement trajectory corresponds to or matches. Other detection schemes may of course be employed; for example, a movement trajectory shape may be detected on the basis of the acceleration values x and y supplied from the operation terminal 11 in accordance with a procedure or step sequence flowcharted in
Now, a description will be made about a movement trajectory detection process based on the procedure flowcharted in
As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, a recognition-point count NP is set to “1” at step Sa2. Here, the recognition-point count NP is a count indicative of the number of recognition points designated for identifying a moving direction of the operation terminal 11 to thereby identify or recognize a movement trajectory shape of the operation terminal 11. The recognition-point count NP of “1” (NP=1) indicates a first recognition point NP1 from the movement start point SP, and the recognition-point count NP of “2” (NP=2) indicates a second recognition point NP2.
After that, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a clockwise circular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is “right downward” as illustrated in FIG. 10. Then, as the operation terminal 11 continues moving after the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 has been detected in this way, the movement trajectory detection section 45 goes to step Sa4, where the recognition-point count NP is set to 2. Then, the movement trajectory detection section 45 determines, at step Sa6, a moving direction in which the operation terminal 11 has moved from the first recognition point NP1 to the second recognition point NP2.
In the case where the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 has been identified, at step Sa3, as “right downward” as above and if the moving direction from the first recognition point NP1 to the second recognition point NP2 has been identified as “left downward”, the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “clockwise circular shape” and then sets a corresponding “clockwise circular” trajectory shape flag at step Sa8.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a clockwise circular trajectory shape and has set the corresponding trajectory shape flag, the detection section 45 refers to a trajectory shape recognizing table of
Before going to a detailed description of such ascertaining operations, specific stored contents of the trajectory shape recognizing table of
Further, in the trajectory shape recognizing table, the “predetermined count” is indicative of the total number of the recognition points to be passed by the operation terminal 11 required for the movement trajectory shape recognition. Regarding the trajectory shape “clockwise circle”, “4” is stored as the predetermined count, which indicates that it has to be ascertained whether or not the operation terminal 11 has passed four recognition points in total before completion of the process for recognizing the “clockwise circular” movement trajectory. Thus, for this “clockwise circular” movement trajectory shape, moving directions corresponding to the four recognition points NP1-NP4 are stored in the trajectory shape recognizing table. Similarly, a numerical value “8” is stored as the predetermined count corresponding to the trajectory shape “clockwise 8”, which indicates that it has to be ascertained whether or not the operation terminal 11 has passed eight recognition points in total before completion of the process for identifying the “clockwise 8” movement trajectory.
With reference to the shape recognizing table of
First, when the “clockwise circular” trajectory shape flag has been set at step Sa8 in the above-described manner, the movement trajectory detection section 45 subtracts the current recognition point count NP from the predetermined count corresponding to the set trajectory shape flag, and sets a value obtained, by incrementing the subtraction result by one, as a next recognition point count NP at step Sa12. Specifically, in this case, the recognition point count NP is “2” and the predetermined count corresponding to the “clockwise circular” trajectory shape is “4”, so that the movement trajectory detection section 45 sets “3” as the next recognition point count NP (i.e., 4−2+1=3). After that, the movement trajectory detection section 45 determines, at step Sa13, whether the moving direction of the operation terminal 11 from the recognition point NP2 to the next recognition point count NP3 matches the “left upward” direction corresponding to “NP3” for the “clockwise circle” stored in the recognizing table. If the two directions match as determined at step Sa13, it is ascertained that the operation terminal 11 is actually moving in the trajectory shape “clockwise circle” indicated by the set trajectory shape flag. In case the two directions fail to match, it is determined that the operation terminal 11 is not moving in the trajectory shape “clockwise circle”.
After having determined that the operation terminal 11 is not moving in the trajectory shape “clockwise circle” (NO determination at step Sa13), the movement trajectory detection section 45 judges that the trajectory shape is unrecognizable at step Sa14, and resets the set trajectory shape flag.
If, on the other hand, it is ascertained that the operation terminal 11 is actually moving in the trajectory shape “clockwise circle” (YES determination at step Sa13), the movement trajectory detection section 45 further determines, at step Sa15, whether the current recognition point count NP (at this point, NP3) has coincided with the predetermined count (=4) stored in the trajectory shape recognizing table, i.e. whether the moving direction has been checked at the necessary number of the recognition points for recognizing the shape indicated by the set trajectory shape flag. If the current recognition point count NP (at this point, NP3) has not coincided with the predetermined count, i.e. if the moving direction has not yet been checked at all of the necessary number of the recognition points, the recognition point count NP is incremented by one at step Sa16; namely, in this case, the recognition point count NP is set to “4”. Then, the movement trajectory detection section 45 reverts to step Sa13 in order to check the moving direction for the fourth recognition point 4 corresponding to the newly-set recognition point count NP. Specifically, the movement trajectory detection section 45 determines, at step Sa13, whether the moving direction of the operation terminal 11 from the recognition point NP3 to the next recognition point count NP4 matches the “right upward” direction corresponding to “NP4” stored in the recognizing table. If the two directions match as determined at step Sa13, it is ascertained that the operation terminal 11 is actually moving in the trajectory shape “clockwise circle” indicated by the set trajectory shape flat. In case the two directions fail to match, it is determined that the operation terminal 11 is not moving in the trajectory shape “clockwise circle”.
After having determined that the operation terminal 11 is not moving in the trajectory shape “clockwise circle” (NO determination at step Sa13), the movement trajectory detection section 45 judges that the trajectory shape is unrecognizable at step Sa14, and resets the set trajectory shape flag. If, on the other hand, it is ascertained that the operation terminal 11 is actually moving in the trajectory shape “clockwise circle” (YES determination at step Sa13), the movement trajectory detection section 45 further determines, at step Sa15, whether the current recognition point count NP (at this point, NP4) has coincided with the predetermined count (=4) stored in the recognizing table. Because an YES determination is made at step Sa15 at this stage, the movement trajectory detection section 45 reverts to step Sa17, where the detection section 45 judges that the operation terminal 11 has fully moved in the trajectory shape “clockwise circle” indicated by the set trajectory shape flag and then terminates the movement-trajectory-shape recognition process. Upon completion of the movement-trajectory-shape recognition process, tone control and the like are performed, in accordance with the thus-recognized movement trajectory shape, in a later-described manner.
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a counterclockwise circular shape as illustrated in FIG. 11. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
After that, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a counterclockwise circular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is “left downward” as illustrated in FIG. 11. Thus, the movement trajectory detection section 45 goes to step Sa5, where the recognition-point count NP is set to “2”. Then, the movement trajectory detection section 45 determines, at step Sa7, a moving direction in which the operation terminal 11 has moved from the first recognition point NP1 to the second recognition point NP2.
In the case where the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 has been identified, at step Sa3, as “left downward” and if the moving direction from the first recognition point NP1 to the second recognition point NP2 has been identified as “right downward”, the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “counterclockwise circular shape” and then sets a corresponding “counterclockwise circular” trajectory shape flag at step Sa10.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a counterclockwise circular trajectory shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a clockwise triangular shape as illustrated in FIG. 12. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
After that, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a clockwise triangular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is “right downward” as illustrated in FIG. 12. Thus, the movement trajectory detection section 45 goes to step Sa4, where the recognition-point count NP is set to “2”. Then, the movement trajectory detection section 45 determines, at step Sa6, a moving direction in which the operation terminal 11 has moved from the first recognition point NP1 to the second recognition point NP2.
In the case where the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 has been identified, at step Sa3, as “right downward” and if the moving direction from the first recognition point NP1 to the second recognition point NP2 has been identified as “leftward”, then the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “clockwise triangular shape” and then sets a corresponding “clockwise triangular” trajectory shape flag at step Sa9.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a clockwise triangular shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a counterclockwise triangular shape as illustrated in FIG. 13. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
Then, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a counterclockwise triangular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is “left downward” as illustrated in FIG. 13. Thus, the movement trajectory detection section 45 goes to step Sa5, where the recognition-point count NP is set to “2”. Then, the movement trajectory detection section 45 determines, at step Sa6, a moving direction in which the operation terminal 11 has moved from the first recognition point NP1 to the second recognition point NP2.
In the case where the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 has been identified, at step Sa3, as “left downward” and if the moving direction from the first recognition point NP1 to the second recognition point NP2 has been identified as “rightward”, the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “counterclockwise triangular shape” and then sets a corresponding “counterclockwise triangular” trajectory shape flag at step Sa9.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a counterclockwise triangular shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a clockwise rectangular shape as illustrated in FIG. 14. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
Then, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a clockwise rectangular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is “rightward” as illustrated in FIG. 14. Thus, the movement trajectory detection section 45 goes to step Sa18, where the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “clockwise rectangular shape” and then sets a corresponding “clockwise rectangular” trajectory shape flag.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a clockwise rectangular shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a counterclockwise rectangular shape as illustrated in FIG. 15. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
Then, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a counterclockwise rectangular shape, the moving direction of the operation terminal 11 from the movement start point SP to the first recognition point NP1 is substantially “straight downward” as illustrated in FIG. 15. Thus, the movement trajectory detection section 45 goes to step Sa19, where the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “counterclockwise rectangular shape” and then sets a corresponding “counterclockwise rectangular” trajectory shape flag.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a counterclockwise rectangular shape and has set the corresponding trajectory shape flag as above, the detection section 45 refers to the trajectory shape recognizing table of
Next, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a “clockwise 8” shape as illustrated in FIG. 16. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
Then, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a clockwise 8 shape, the moving direction of the operation terminal 11 from the detected movement start point SP to the first recognition point NP1 is “right upward” as illustrated in FIG. 16. Thus, the movement trajectory detection section 45 goes to step Sa20, where the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “clockwise 8 shape” and then sets a corresponding “clockwise 8” trajectory shape flag.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a clockwise 8 shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
Finally, the movement trajectory detection process is described in relation to the case where the human operator moves the operation terminal 11 in a “counterclockwise 8” shape as illustrated in FIG. 17. As the human operator moves the operation terminal 11, the movement trajectory detection section 45 detects, on the basis of acceleration values x and y supplied from the operation terminal 11, that the operation terminal 11 has started moving, i.e. a movement start point SP, at step Sa1. Also, the recognition-point count NP is set to “1” at step Sa2.
Then, the movement trajectory detection section 45 determines, at step Sa3, a moving direction in which the operation terminal 11 has moved from the movement start point SP to the first recognition point NP1. If the human operator has moved the operation terminal 11 in a counterclockwise 8 shape, the moving direction of the operation terminal 11 from the detected movement start point SP to the first recognition point NP1 is “straight downward” as illustrated in FIG. 17. Thus, the movement trajectory detection section 45 goes to step Sa21, where the movement trajectory detection section 45 determines that the operation terminal 11 is moving in a “counterclockwise 8 shape” and then sets a “counterclockwise 8” trajectory shape flag.
Once the movement trajectory detection section 45 has determined that the operation terminal 11 is moving in a counterclockwise 8 shape and has set the corresponding trajectory shape flag as above, the section 45 refers to the trajectory shape recognizing table of
The foregoing paragraphs have described various examples of procedures by which the movement trajectory detection section 45 detects various movement trajectories of the operation terminal 11. It should, however, be appreciated that the movement trajectory detection section 45 is capable of identifying movement trajectories of other shapes, such as a wave shape and mountain shape, by prestoring, in the shape recognizing table of
Namely, the movement trajectory detection section 45 generates information pertaining to a movement trajectory drawn by a succession of movements of the operation terminal 11 and outputs the thus-generated movement trajectory information to the tone signal generation section 46. In addition, the movement trajectory detection section 45 sequentially calculates coordinates (x and y coordinates) information of the movement trajectory on the basis of the acceleration values x and y sequentially supplied from the received-signal processing circuit 39, and then outputs the thus-calculated coordinates information to the display interface 35. This way, the sequentially-changing movement trajectory of the operation terminal 11 (see
Further, by referring to the tone generation table 47, the tone signal generation section 46 generates tone signals on the basis of the various items of the movement trajectory information having been generated by the movement trajectory detection section 45 in the above-described manner. In the tone generation table 47, there are registered tone generating parameters for each of a plurality of items such as “Shape of Movement Trajectory (Moving Direction Included)”, “Size of Movement Trajectory” and “Moving Speed”, as seen in FIG. 18. In
The tone signal generation section 46 generates tone signals on the basis of the various items of the movement trajectory information supplied by the movement trajectory detection section 45, by referring to the above-described tone signal table 47. More specifically, when the operation terminal 11 is moved by the human operator in a circular trajectory of one clockwise revolution, and if the trajectory size is “medium” and the moving speed is in “speed range C”, various items of movement trajectory information corresponding to the movement of the operation terminal 11 are generated by the movement trajectory detection section 45 and then supplied to the tone signal generation section 46. In turn, the tone signal generation section 46 selects the “piano” tone color parameter registered in association with the “circular trajectory shape of one clockwise revolution”, the “medium” tone volume parameter registered in association with the “medium” trajectory size, and the “E” scale note parameter registered in association with the “C” moving speed range. Thus, the tone signal generation section 46 generates a tone signal for audibly sounding a tone corresponding to the “E” note with the piano tone color and “medium” tone volume.
Each of the tone signals thus generated by the tone signal generation section 46 is fed to the sound speaker system 42, which audibly sounds a tone corresponding to the tone signal.
A-2. Tone Generation Method:
Now, a description will be made about a method by which the human operator uses the above-described tone signal generation system 100 to generate tones. First, the human operator powers up (turns on the power to) the personal computer system 10 and operation terminal 11 constituting the tone signal generation system 100, so that the personal computer system 10 is caused to execute the tone generation processing programs.
Then, the human operator makes motions, such as swings of his or her hand grasping the operation terminal 11, in such a manner that the operation terminal 11 is moved in a desired movement trajectory. As the human operator moves the operation terminal 11 like this, the acceleration of the operation terminal 11 in the x- and y-axis directions is detected by the motion sensor MS of the operation terminal 11, and then delivered to the personal computer system 10. Thus, the personal computer system 10 generates movement trajectory information of the operation terminal 11 moved by the human operator, on the basis of the acceleration in the x- and y-axis directions supplied from the operation terminal 11. Then, a tone signal is generated on the basis of the thus-generated movement trajectory information, so that a tone is audibly sounded.
Because the correspondency between the various items of the movement trajectory information and the tone generating parameters is registered in the tone signal table 47 as noted above, the instant embodiment permits generation of a desired tone if the human operator moves the operation terminal 11 intentionally along a given movement trajectory taking the registered contents of the table 47 into account. For example, in the case where the settings illustratively shown in
Further, the tone generation method using the tone signal generation system 100 can provide a novel form of musical entertainment as follows. While the conventional acoustic and electronic musical instruments are constructed to generate a desired tone in response to player's operation of a selected one of performance operators (e.g., keys of a piano or strings of a guitar), the tone signal generation system 100 can generate a desired tone in response to motions of the human operator moving the operation terminal 11 in a predetermined movement trajectory, rather than in response to operation of a selected performance operator. Namely, with the conventional acoustic and electronic musical instruments, etc. better performing operability, such as in selective manipulation, by fingers, of the performance operators, is pursued for a better performance. By contrast to the conventional tone signal generation systems (musical instruments) pursing the performing operability as above, the instant embodiment can implement a novel musical entertainment system which, by associating the tone generation with relatively big movements of the operation terminal 11 carried by the human operator, is capable of not only performing the tone generating function but also allowing the user or human operator to take part in control of the tones through his or her body motions.
Further, when a desired music piece or the like is to be performed by the tone generation scheme using the above-described tone signal generation system 100, the human operator can perform the music piece by referring to a novel form of musical score (hereinafter “movement-trajectory-descriptive” musical score) where shapes, sizes, speeds, etc. of movement trajectories of the operation terminal are described in a time series, in place of the musical score, such as the staff notation, commonly used in conventional musical instrument performances; the movement-trajectory-descriptive musical score used in the present invention may describe individual motions, constituting the movement trajectory, in graphics representative, for example, of dancing motions. The movement-trajectory-descriptive musical score corresponds in contents to settings registered in the above-described tone signal table 47, and thus as the registered contents of the tone signal table 47 are varied, the motions of the human operator moving the operation terminal 11 are varied in conformity with the varied tone signal 47 even when the same music piece is to be performed. That is, if the registered settings in the tone signal table 47 are varied, the music piece performance using the tone signal generation system 100 requires the human operator to make different motions even for the same music piece. Therefore, by varying the settings of the tone signal table 47 as appropriate, the user of the personal computer system 10 can independently create original movement trajectories to be drawn or followed by the operation terminal 11 for performing a given music piece, i.e. original motions of the human operator carrying the operation terminal 11. If the original motions of the human operator are created like this, stored contents or settings of the tone signal table 47 for executing the original motions, movement-trajectory-descriptive musical score corresponding to the settings, etc. can be supplied to some other person such as a friend. If the settings of the tone signal table 47, movement-trajectory-descriptive musical score corresponding to the settings and the like are supplied to some other person as above and if the supplied settings are registered into the tone signal table 47 and motions are made exactly to the movement-trajectory-descriptive musical score, the other person too can perform the music piece in just a similar manner to the user who created the movement trajectories or original motions.
Further, by the use of the tone signal generation system 100, it is also possible to construct a novel business model in accordance with which a service provider supplies a user with settings of the tone signal table 47, movement-trajectory-descriptive musical score indicative of motions of a human operator, etc. that can be created as noted above. More specifically, data describing the registered contents of the tone signal table 47 can be supplied from the service provider to the user or human operator by means of a CD-ROM (Compact Disk-Read-Only Memory) or via the Internet, and if the registered contents described by the data are set, the movement-trajectory-descriptive musical score for performing a given music piece can be supplied in a written sheet or book or in a storage medium having the data recorded thereon.
A-3-1. First Modification of the First Embodiment:
Whereas the first embodiment has been described above as allocating the shapes of the movement trajectory to the control of the tone color parameters, the sizes of the movement trajectory to the control of the tone volume parameters and the speeds of the movement trajectory to the control of the scale note parameters, the present invention is not necessarily limited to such allocation of the items of the movement trajectory information to the parameters to be controlled, and the allocation may be made in any other desired manner. For example, the scale note parameter may be controlled in accordance with the trajectory shape; as an example, the “circular trajectory shape of one clockwise revolution” may be allocated to scale note “C”, the “circular trajectory shape of one counterclockwise revolution” may be allocated to scale note “D”, and so on.
A-3-2. Second Modification of the First Embodiment:
According to the above-described first embodiment of the present invention, the operation terminal 11 is constructed to detect acceleration in the x- and y-axis directions by means of the motion sensor MS and transmits the thus-detected acceleration to the personal computer system 10, so that the personal computer system 10 generates a tone signal. The present invention is not so limited, and a single apparatus capable of being carried by the human operator may include built-in construction for implementing functions similar to the function of the operation terminal 11 and the tone generating function of the personal computer system 10. For example, in the arrangement of
B. Second Embodiment:
The shoe-type operation terminals 211 are generally in the form of shoes, and for tone generation using the tone signal generation system 200, the human operator wears the shoe-type operation terminals 211. In this tone signal generation system 200, the human operator wearing the shoe-type operation terminals 211 tap-dances so that the personal computer system 210 generates tone signals in response to tap-dancing motions of the human operator.
Each of the shoe-type operation terminals 211 is constructed in a generally similar manner to the operation terminals 11 employed in the above-described first embodiment (see FIG. 2). However, the motion sensor MS of this operation terminal 211 comprises a strain sensor while the motion sensor MS of the operation terminal 11 in the first embodiment comprises the two-dimensional acceleration sensor. Note that the motion sensor MS of the operation terminal 211 in the second embodiment may comprise any other suitable sensor than the strain sensor, such as a pressure sensor.
As shown in
The personal computer system 210 in the second embodiment has a hardware setup similar to that of the personal computer system 10 in the first embodiment (see FIG. 3). However, the personal computer system 210 in the second embodiment is arranged to perform a tone generation process corresponding to the displacement amount information transmitted from the above-described shoe-type operation terminals 11, by executing the tone generation processing programs. The following paragraphs describe functions and construction of the personal computer system 210 focusing on the tone generation process, with primary reference to FIG. 21.
As shown, for the tone generation purposes, the personal computer system 210 includes an antenna distribution circuit 38, a received-signal processing circuit 39, a displacement amount detection section 248, a tone signal generation section 246, a tone signal table 247, a display device 34, a display interface (I/F) 35 and a sound speaker system 42.
In the second embodiment, the antenna distribution circuit 38 receives signals indicative displacement amounts of the left and right feet transmitted from the two shoe-type operation terminals 211 disposed on the left and right feet of the human operator and passes the received displacement amount signals to the received-signal processing circuit 39.
The received-signal processing circuit 39 passes the signals indicative the displacement amounts of the left and right feet, supplied from the antenna distribution circuit 38, through a predetermined band-pass filter section to thereby remove unnecessary frequency components. The signals indicative the displacement amounts of the left and right feet having the unnecessary frequency components removed therefrom are delivered from the received-signal processing circuit 39 to the displacement amount detection section 248.
From the signals indicative the displacement amounts of the left and right feet delivered from the processing circuit 39, the displacement amount detection section 248 obtains displacement amount information HL indicative of the displacement amount of the left foot and displacement amount information HR indicative of the displacement amount of the right foot, and outputs the thus-obtained displacement amount information HL and HR to the tone signal generation section 246 and display interface 35. The tone signal generation section 246 generates tone signals corresponding to the left and right feet, by reference to the tone signal table 247 and on the basis of the displacement amount information HL and HR of the left and right feet supplied from the received-signal processing circuit 39. In the tone signal table 247, there are prestored different pieces of tone waveform information in association with various possible displacement values indicated by the displacement amount information. More specifically, tones generated as ordinary tap-dancing shoes tapped on the floor with various different intensities of force were recorded in advance, and then different pieces of tone waveform information were prestored in the tone signal table 247 in association with various possible displacement values on the basis of the thus-recorded tones.
For each of the left and right feet, the tone signal generation section 246 selects one of the prestored pieces of tone waveform information which corresponds to the displacement value indicated by the displacement amount information supplied by the displacement amount detection section 248, and generates a tone waveform signal on the basis of the selected tone waveform information. The tone signal generation section 246 outputs the thus-generated tone waveform signal to the sound speaker system 42, so as to permit tap sound generation corresponding to the force applied to the heel portions 211a of the shoe-type operation terminals 211. Further, the displacement amount information HL and HR of the left and right feet is supplied from the displacement amount detection section 248 to the display interface 35, and thus the displacement amounts of the left and right feet are visually displayed on the display device 34. Here, the displacement amounts may be displayed in any desired manner, such as in numerical values representing the displacement amounts. Alternatively, the left and right shoes may be displayed in graphics with display color varied in accordance with the displacement amounts. The human operator can use the displayed contents on the display device 34 as reference information in judging with which intensity he or she should tap on the floor.
Even in a situation where there is provided no suitable floor surface for the tap-dancing motions and thus the human operator has to tap-dance on an ordinary floor surface (such as a surface of a Japanese “tatami” mat or carpet) in an ordinary house, the tone signal generation system 200 in accordance with the second embodiment can simulatively generate tap sounds corresponding to the tap-dancing motions.
Note that in the second embodiment, a plurality of tone signal tables 247 of different contents may be provided previously in corresponding relation to various floor surface materials, such as a carpet, tatami and wood) so as to permit the above-described simulative tone generation on floor surfaces made of various materials. In this case, once the human operator selects a desired one of the floor surface materials and inputs the selected material into the personal computer system 210, any one of the tone signal tables 247 is selectively used in accordance with the input floor surface material.
Further, although the second embodiment has been described as generating tap sounds corresponding to the displacement amount information supplied from the shoe-type operation terminals 211, the present invention is not so limited, and any other desired types of sounds or tones than the tap sounds may be generated.
Furthermore, a music piece performance may be controlled, in accordance with the displacement amounts supplied from the shoe-type operation terminals 211, in addition to the tap sound generation. For example, where the human operator tap-dances to a music piece performance, progression of reproduction, by the personal computer system 210, of the music piece performance may be controlled in accordance with the displacement amounts supplied from the shoe-type operation terminals 211. In this case, impacts applied to the shoe-type operation terminals 211 attached to the left and right feet are prestored in the tone signal table 246 in association with positions of a music piece data set to be performed in response to the applied impact. The illustrated example may be arranged such that when a first impact applied to the right foot is detected, the personal computer 210 may reproduce a portion of the music piece data set at performance position “A”, and when a first impact applied to the left foot is detected, the personal computer 210 may reproduce a portion of the music piece data set at performance position “B”. Here, the impact may be detected when the displacement amount indicated by the displacement amount information supplied from the shoe-type operation terminal 211 has exceeded a predetermined value.
Further, whereas the second embodiment has been described as the system using the shoe-type operation terminals 211 to generate tone signals in response to tap-dancing motions, the present invention may be implemented as a tone signal generation system 300 using a stick-shaped operation terminal 311 as shown in FIG. 23.
As illustrated in
In the tone signal table 247 of the personal computer system 210, there are prestored various different pieces of tone waveform information for generating drum sounds, in place of the above-mentioned tap sounds, in association with various possible displacement amounts of the tip portion 311a. Thus, when the human operator hits a wall or the like with the tip end portion 311a of the operation terminal 311, a drum sound corresponding to the hitting intensity is generated by the personal computer system 210. Namely, a drum sound can be generated by the human operator hitting the tip end portion 311a of the operation terminal 311 against a suitable object.
In each of the second embodiment and its modification, the shoe-type operation terminal 211 or stick-shaped operation terminal 311 is provided separately from the personal computer system 210. In an alternative, the shoe-type operation terminal 211 and/or stick-shaped operation terminal 311 may include built-in hardware capable of performing a tone generation process similar to that performed by the personal computer system 210, so as to dispense with the personal computer system 210 and provide an integrated (tone generator-operation terminal) apparatus that can be carried by the human operator.
In summary, the present invention arranged in the above-described manner can generate tone signals reflecting human operator's motions.
Number | Date | Country | Kind |
---|---|---|---|
2000-269160 | Sep 2000 | JP | national |
2001-269131 | Sep 2001 | JP | national |
The present application is a continuation-in-part application of U.S. patent application Ser. No. 09/948,065 filed Sep. 5, 2001 now abandoned.
Number | Name | Date | Kind |
---|---|---|---|
4753146 | Seiler | Jun 1988 | A |
4905560 | Suzuki et al. | Mar 1990 | A |
5027688 | Suzuki et al. | Jul 1991 | A |
5046394 | Suzuki et al. | Sep 1991 | A |
5058480 | Suzuki et al. | Oct 1991 | A |
5062341 | Reiling | Nov 1991 | A |
5117730 | Yamauchi | Jun 1992 | A |
5125313 | Hiyoshi et al. | Jun 1992 | A |
5147969 | Hiyoshi et al. | Sep 1992 | A |
5170002 | Suzuki et al. | Dec 1992 | A |
5177311 | Suzuki et al. | Jan 1993 | A |
5218159 | McClish | Jun 1993 | A |
5290964 | Hiyoshi et al. | Mar 1994 | A |
5313010 | Matsushima et al. | May 1994 | A |
RE34700 | Suzuki et al. | Aug 1994 | E |
5350881 | Kashio et al. | Sep 1994 | A |
5512703 | Usa | Apr 1996 | A |
5714706 | Nakada | Feb 1998 | A |
5736665 | Fukumoto et al. | Apr 1998 | A |
5920024 | Moore | Jul 1999 | A |
6297438 | Por Paul | Oct 2001 | B1 |
6326539 | Mishima | Dec 2001 | B1 |
Number | Date | Country |
---|---|---|
401277293 | Apr 1988 | JP |
04093997 | Mar 1992 | JP |
Number | Date | Country | |
---|---|---|---|
20020088335 A1 | Jul 2002 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09948065 | Sep 2001 | US |
Child | 10092405 | US |