Patent Grant
6967276
The present invention generally relates to a sounding control apparatus, and a portable terminal apparatus and a system that use this sounding control apparatus. More particularly, the present invention relates to sounding control apparatus built in a portable terminal apparatus such as a portable telephone terminal, and a base station having a database system for providing various pieces of information such as music information to this sounding control apparatus.
Recently developed portable telephone terminals have a capability of sounding a melodious ringing tone to notify call termination on them. This ringing melody is a sequence of monotones based on buzzer sound. The sound information for use in creating the melodious ringing tone can be downloaded from a base station for example.
However, melodious tone reproducing devices such as mentioned as for use in conventional portable telephone terminals can neither reproduce music that sounds two or more tones at a time nor allow various settings such as timbre and effect. Namely, the conventional melody tone reproducing devices cannot reproduce various kinds of music for user enjoyment.
It is therefore a main object of the present invention to provide a sounding control apparatus that facilitates the setting, editing, and creating of music tone information such as timbre and effect for producing a melody sound at call termination or background music (BGM) during talking by sounding two or more tones at a time by use of an FM tone generator for example in a portable terminal device. So constituted, the sounding control apparatus according to the invention can realize the reproduction of rich and various sounds adapted to the processing capacity of portable terminals and user preferences.
It is another object of the present invention to provide a portable terminal apparatus that provides various operating modes in which audio and video signals are used along with reproduced tones for user enjoyment.
It is a further object of the present invention to provide a portable terminal apparatus that can provide a Karaoke play by synchronously treating music performance and words display.
It is a still further object of the present invention to provide a potable terminal apparatus, a music tone information service system and a base station, in which the potable terminal apparatus is capable of mounting a detachable recording medium that can realize various kinds of music data processing capabilities such as a change in tempo, automatic composition, voice-pitch detection, chord detection, style reproduction, format conversion of music information, and trial listening of music information.
In carrying out the invention and according to a first aspect thereof, there is provided a sounding control apparatus for use in a portable terminal apparatus capable of sounding a music tone, comprising: an information acquiring means or section for acquiring performance information and timbre-associated configuration information and effect-associated configuration information; given a timbre set on the basis of the timbre-associated configuration information, a tone generating means or section for generating a tone signal corresponding to the performance information; an effect imparting means or effector section for imparting an effect set on the basis of the effect-associated configuration information to the generated tone signal, and an output means or section for outputting the tone signal imparted with the effect.
In carrying out the invention and according to a second aspect thereof, there is provided a sounding control apparatus for use in a portable terminal apparatus capable of sounding a tone, comprising: a storage means or memory section for storing music tone information; a tone generating means for generating, on the basis of the music tone information stored in the storage means, a tone signal having a predetermined timbre and imparted with a predetermined effect; and a control means for controlling the storage means and the tone generating means independently of the portable terminal apparatus.
In carrying out the invention and according to a third aspect thereof, there is provided a portable terminal apparatus comprising: a storage means for storing music tone information, audio information, and video information; a sounding control apparatus for generating, on the basis of the music tone information stored in the storage means, a tone signal given with a predetermined timbre and/or a predetermined effect corresponding to configuration information included in the music tone information; and a means for generating, on the basis of the audio information and the video information stored in the storage means, an audio signal and a video signal. The music tone information stored in the storage means is presented in a format which is downsized as compared with a general-purpose music tone information format in correspondence with a storage size of the storage means.
In carrying out the invention and according to a fourth aspect thereof, there is provided a music tone information service system composed of a portable terminal apparatus capable of sounding a tone and a base station having a music tone information source, comprising: an information selecting means or section for selecting, according to selecting information sent from the portable terminal apparatus, corresponding music tone information from the music tone information source; configuration information attaching means or section for attaching, to the selected music tone information, configuration information indicative of a timbre and an effect to be given to the tone sounded in the portable terminal apparatus; and a sounding control apparatus for generating, on the basis of the music tone information attached with the configuration information, a tone signal given with a predetermined timbre and/or a predetermined effect. This music tone information service system further comprising: a charging means or section for executing a charging operation on the portable terminal apparatus which sent the selecting information.
In carrying out the invention and according to a fifth aspect thereof, there is provided a music tone information service system composed of a portable terminal apparatus capable of sounding a tone and a music tone information processing apparatus capable of creating or editing music tone information, comprising: an information compressing means or section for compressing the created or edited music tone information; and a sounding control apparatus for generating, on the basis of the compressed music tone information, a tone signal given with a predetermined timbre and/or a predetermined effect.
In carrying out the invention and according to a sixth aspect thereof, there is provided a music tone information service system composed of a portable terminal apparatus capable of sounding a tone and a music tone information source which stores music tone information, comprising: an information acquiring or capturing means or section for acquiring or capturing the music tone information stored in the music tone information source into the portable terminal apparatus; an information editing means or section for editing the captured music tone information; and a sounding control apparatus for generating, on the basis of the edited music tone information, a tone signal given with a predetermined timbre and/or a predetermined effect.
In a seventh aspect of the invention, there is provided a portable terminal apparatus comprising a memory means for memorizing performance information and words information corresponding to progression of a performance, a tone generation control device operative based on the memorized performance information for sequentially generating a music tone signal, and a display means operative based on the memorized words information for generating a words display signal corresponding to the generated music tone signal. Further, there is provided a portable terminal apparatus comprising a memory means for memorizing first performance information, second performance information, and words information corresponding to performance progression of the second performance information, a tone generation control device operative based on the first performance information and the second performance information for generating a first music tone signal and a second music tone signal, respectively, a display means operative based on the words information for generating a words display signal corresponding to the second music tone signal, and a control means for controlling the tone generation control device to generate the first music tone signal in precedence to generation of the second music tone signal.
According to the first aspect of the invention, a portable terminal apparatus capable of sounding tones has a sounding control apparatus that is given a timbre to be set on the basis of timbre-associated configuration information to generate a tone signal corresponding to performance information and to impart an effect to be set on the basis of effect-associated configuration information to the generated tone signal. Consequently, two or more tones can be sounded at a time by use of an FM tone generator for example, thereby providing rich and various ringing melodies, BGM during talking, and music at any time desired.
According to the second aspect of the invention, the control means (CPU), which operates independently of the portable terminal apparatus, is used to generate a tone signal having a predetermined timbre and imparted with a predetermined effect. Consequently, tone signal generation processing can be executed with relatively high degree of freedom without being restricted by the control of the portable terminal apparatus main.
According to the third aspect of the invention, a tone signal imparted with a predetermined timbre and/or effect corresponding to configuration information included in music tone information is generated on the basis of the music tone information and, at the same time, an audio signal and a video signal are generated on the basis of audio information and video information. Consequently, the user can enjoy the reproduced tone in various modes supported by the audio and video signals. In addition, according to the storage size of the storage means used, tone signals are generated by use of music tone information presented in a format which is downsized as compared with a general-purpose music tone information format. Consequently, quality tones can be reproduced within the maximum allowable range of the data processing and storage capacities of the portable terminal apparatus without weighing upon the memory of the apparatus.
According to the fourth aspect of the invention, a music tone information service system is formed by portable terminal apparatuses and the base station (server), having a music tone information source. According to the selection information sent from any of the portable terminal apparatus, the base station selects corresponding music tone information from the music tone information. source. The base station creates configuration information indicative of a timbre and/or an effect to be imparted to a tone which is sounded in the portable terminal apparatus. On the basis of the music tone information attached with the created configuration information, the portable terminal apparatus generates a tone signal imparted with the predetermined timbre and/or effect. Consequently, rich and divergent tones can be provided by effective use of the server database. In addition, the charging processing is executed to the portable terminal apparatus that sent the selection information, thereby providing appropriate services to the users of particular portable terminal apparatus.
According to the fifth aspect of the invention, music tone information is shared by a music tone information processing apparatus based on a personal computer or an intelligent electronic musical instrument. Music tone information of a desired format is created or edited in the music tone information processing apparatus to compress the created or edited music tone information into a size suitable for the portable terminal apparatus. Therefore, the novel constitution facilitates the setting, editing, and creation of timbres and effect of the music tone information suitable for the capacity of the portable terminal apparatus.
According to the sixth aspect of the invention, music tone information stored in music tone information sources such as external recording media and telephone terminals is captured in the portable terminal apparatus for editing. Consequently, music tone information of various forms can be processed into the music tone information suitable for the capacity of the portable terminal apparatus or user preferences.
To sum up, according to the present invention, a tone generator capable of sounding two or more tones at a time is arranged in a sounding control apparatus in a portable terminal apparatus to impart a timbre and an effect for example to a generated tone on the basis of configuration information associated with tone sounding. This novel constitution reproduces music, which is various in kind and rich in musicality as ringing melodies, BGM sounded during talking, and music, which entertains the user as desired. In the present invention, each piece of information including music tone information can be captured any time from external information sources such as base station, personal computer, other telephone terminals, and small-size or compact storage media, which enhances system extensibility, thereby reproducing a wide range of a variety of music as ringing melodies and BGM for example.
In addition, according to the present invention, the music information to be captured in the portable terminal apparatus is attached with configuration information associated with tone sounding, compressed by deleting unnecessary information so as to fit the storage size of the terminal apparatus, and format-converted so as to match in the own model of the terminal apparatus concerned, thereby enhancing system extensibility still further. Besides, use of an editing means facilitates the acquisition of the music tone information attached with configuration information while downsizing the amount of the information.
According to the seventh feature of the invention, the performance information and the words information corresponding to progression of the music performance are memorized. The music tone signal is sequentially generated according to the performance information, while the words display signal corresponding to the generated music tone signal is generated according to the words information. Thus, the portable terminal apparatus such as a portable telephone can provide a Karaoke play. The inventive apparatus can be efficiently used for Karaoke training by displaying and memorizing Karaoke words in a spare time. According to this feature, there are treated first performance information, second performance information and words information corresponding to the performance progression of the second performance information. A second music tone signal is generated according to the second performance information, and a words display signal corresponding to the second music tone signal is generated according to the words information, thereby enabling Karaoke play. Further, the first music tone signal is generated according to the first performance information in precedence to the Karaoke play, thereby enabling automatic switch from the Karaoke play to the reproduction of a ringing melody according to the first music tone signal, while the words display may not disturb telephone conversation.
In addition, according to a specific aspect of the invention, being associated with editing performance information, there is provided a potable terminal apparatus that comprises a storage means for storing performance information, a means for displaying parameters in the performance information stored in the storage means, and a means for editing the parameters displayed. The portable terminal apparatus can display one of parameters in the stored performance information which the user wishes to edit, so that the user can operate ten keys for telephone number entry to input a parameter value, thus editing the performance information.
In carrying out the invention and according to an aspect of changing the tempo of music information, there is provided a portable terminal apparatus that comprises a storage means for storing music information, a tempo specifying means or section for specifying a tempo, and a control means for controlling, according to the tempo specified by the tempo specifying means, the tempo of a tone to be. sounded on the basis of the music information stored in the storage means. The portable terminal apparatus allows the user to specify a tempo by use of at least one of parameters. The parameters include an absolute value of the tempo (a numerical value), a word indicative of the tempo (such as “allegro” and “moderato”), a rate of change from a reference tempo (% or ±), and an intuitive word (“quick”, “slow” or “moderate”). Thus, the user can use an operator of the portable terminal apparatus (main unit) to specify a tempo so as to control the performance tempo of sounding music such as a ringing melody or BGM.
In carrying out the invention and according to an aspect of automatic composition, there are provided a potable terminal apparatus that comprises a means for setting an atmosphere of music, and a means for automatically creating music information according to the set atmosphere, and another portable terminal apparatus that comprises a means for inputting a part of music data, and a means for automatically creating a whole of music information for a complete piece of music from the part of music data. The former terminal apparatus allows the user to use an operator to selectively set an atmosphere of music so as to automatically create music information. The latter terminal apparatus allows the user to input the part of music data so as to automatically create music information for a piece of music from the partial data.
In carrying out the invention and according to an aspect of pitch detection, there are provided a portable terminal apparatus that comprises a means for selectively acquiring either tone signals input from a microphone or tone signals received at a transmitting/receiving circuit, a means for extracting a pitch sequence from the acquired tone signals, and a means for creating music information on the basis of the pitch sequence extracted, and another portable terminal apparatus that comprises a means for acquiring a tone signal, and a means for extracting a pitch sequence from the acquired tone signals, a means for transposing the pitch sequence extracted, and a means for creating music information on the basis of the pitch sequence transposed. In these portable terminal apparatuses, when a pitch sequence is extracted from an input tone, the former terminal apparatus can arbitrarily select either a tone input from a microphone or a tone input during talking, while the latter terminal apparatus can transpose the detected pitch sequence as required.
In carrying out the invention and according to an aspect of chord detection, there is provided a portable terminal apparatus that comprises a storage means for storing music information, a music analyzing means for analyzing the music information stored in the storage means, and a means for automatically creating, on the basis of the analysis result by the music analyzing means, performance information associated with a chord fitting the music information. The portable terminal apparatus can automatically create performance information associated with the chord fitting the music information.
In carrying out the invention and according to an aspect of style reproduction, there is provided a portable terminal apparatus that comprises a storage means for storing plural kinds of style information, and a means for joining the style information stored in the storage means to create music information. The portable terminal apparatus can store plural kinds of style information and performance information and join them to reproduce a piece of music.
In carrying out the invention and according to an aspect of format conversion, there are provided a music information service system, composed of a potable terminal apparatus that performs a tone process using music information of a first format and a base station having a music tone information source, wherein the base station comprises a format converting means for converting music information of a format different from the first format into music information of the first format, and a base station capable of distributing music information from a music information source to a potable terminal apparatus that performs the tone process using music information of a first format, which comprises a format converting means for converting music information of a format different from the first format into music information of the first format. The music information service system and the base station can convert music information for other models or general-purpose music information incompatible with the first format into music information of the first format for its own model.
In carrying out the invention and according to another aspect of format conversion, there is provided a music tone information service system, composed of a potable terminal apparatus that performs a tone process using music information of predetermined format and a base station having a music tone information source, wherein the base station comprises a means for receiving identification information associated with the terminal apparatus from the potable terminal apparatus, and a means for creating, on the basis of the identification information received, the predetermined format of music information from the music tone information source, and a base station, capable of distributing music information from a music tone information source to a potable terminal apparatus that performs the tone process using music information of a predetermined format, which comprises a means for receiving identification information associated with the terminal apparatus from the potable terminal apparatus, and a means for creating music information of the predetermined format from the music tone information source on the basis of the received identification information. Upon transmission of the information associated with the terminal (identification information) from the terminal to the base station (server), the music tone information service system and the base station can perform format conversion at the base station on the basis of the information concerned.
In carrying out the invention and according to still another aspect of format conversion, there is provided a potable terminal apparatus that performs a tone process using music information of a predetermined format, the potable terminal apparatus comprising a format converting means for converting music information of a format into music information of a first format different from that before conversion. The portable terminal apparatus can perform format conversion in its own terminal apparatus from music information for other models or general-purpose music information incompatible with the first format into music information of the first format for its own model.
In carrying out the invention and according to an aspect of trial listening, there are provided a music tone information service system, composed of a potable terminal apparatus capable of sounding a tone and a base station having a music tone information source, wherein the base station comprises a means for transmitting information from the music tone information source as streaming data, and the potable terminal apparatus comprises a means for performing real-time reproduction of the music information on the basis of the streaming data from the base station, and a base station, capable of distributing music tone information from a music tone information source to a potable terminal apparatus capable of sounding a tone, which comprises a means for transmitting information from the music tone information source to the potable terminal apparatus as streaming data. The music tone information service system and the base station can perform streaming transmission of information from the base station (server) to realize real-time trial listening on the portable terminal apparatus side.
In carrying out the invention and according to an aspect thereof related to a detachable recording medium, there are provided a potable terminal apparatus, capable of mounting a detachable small-size or compact recording medium, which comprises a means for retrieving music information stored in the detachable small-size recording medium, and a means for processing the retrieved music information, and another potable terminal apparatus, capable of mounting a detachable small-size recording medium, which comprises a means for processing music information, and a means for writing the processed music information into the detachable small-size recording medium. Of these portable terminal apparatuses capable of mounting a detachable small-size recording medium, the former terminal apparatus can retrieve or load music information from the recording medium into the terminal system, while the latter terminal apparatus can write music information from various information sources into the recording medium.
The portable terminal apparatuses according to the invention may have sound sources of an FM type, a waveform memory type, or a physical model type. The sound source circuit may be composed by DPS including a microprogram or composed by a CPU including software. It should be noted that “music tone information” and “performance information” may be interchangeably used in the specification if there is no need to discriminate therebetween. Further, “music information” may be used to cover both of “music tone information” and “performance information” as in the specification and the pending claims.
This invention will be described in further detail by way of example with reference to the accompanying drawings. It should be noted that the following embodiments are for illustrative purpose only and therefore variations and modifications may be made within the scope of the invention.
Terminal System Overview:
Referring to
In the above-mentioned mentioned terminal system TS, the main CPU 1 for controlling the terminal system in its entirety executes various control operations such as talk control, screen control, and sounding control according to predetermined computer programs. The main ROM 2 holds predetermined control programs and control data necessary for executing these control operations. For example, as for music, the main ROM 2 holds music information, performance information, configuration information, tables for information format conversion, and tables for information compression, each in plurality, for sounding call termination notice melodies and background music (BGM) to be played during talking. As for non-music information, the main body ROM 2 holds predetermined audio and video information as configuration information. The configuration information herein denotes information which is set as conditions for executing the processing associated with acoustic sounding or image display during talking or at other times. This configuration information includes audio information, video information, and audio and video control information in addition to the music-associated configuration information such as tone timbre and effect (including DSP).
The main RAM 3 holds data and parameters necessary for executing the above-mentioned talk control, screen control, and sounding control. To be specific, this memory stores plural pieces of music information, performance information, and configuration information which are additionally installed or newly created in the terminal system TS.
The detector 4 has an operator section 12 composed of controls such as push-button switches arranged on the surface of the body of the portable telephone terminal and detects the operation performed by the user on these controls. These controls include a talk switch for talking, a request switch for requesting the downloading of call termination melodies, a setting switch for setting the sounding controller 8 (tone generator/effector), and switches for creating and editing various pieces of information. The display circuit 5 is connected to a display 13 on LED screen of which various pieces of talk information, various pieces of melody information associated with sounding control, and various pieces of visual check information are shown.
The receiver/transmitter 6 has a communication antenna and communicates with other telephone terminals via a base station (or a server station or a repeater station) for talking. This circuit is also used for requesting and receiving music information and configuration information. The audio controller 7 controls voice signals at talking and tone input/output signals. This controller has a voice transmitting capability for transmitting an input voice from a microphone (MIC) 17 to the receiver/transmitter 6, a voice reproducing capability for sending a talk voice signal received at the receiver/transmitter 6 to a talk speaker 15 and an external output terminal 16, and BGM reproducing capability for sending a tone signal received from the sounding controller 8 to the talk speaker 15 and the output terminal 16.
The sounding controller 8 uniquely executes a sequence of processing operations for controlling tone signals such as melodious ringing tone and BGM tone and can sound two or more tones at a time. Namely, the sounding controller 8 has a capability of synthesizing a tone signal and sending it to the sound speaker 17 or the audio controller 7, thereby sounding tones such as melodious ringing tone and BGM. In addition, the sounding controller 8 has a digital output terminal 18 for sending a digital tone signal to other devices that use digital tone signals. It should be noted that the sound speaker 17 may be configured to function as the talk speaker 15.
The connecting circuit 9 allows a portable detachable small-size recording medium 19 to be loaded on this terminal system TS. The connecting circuit 9 captures various pieces of information including music information from the loaded small-size recording medium 19 into the terminal system and writes these pieces of information to the loaded small-sized recording medium 19. The communication I/F 10 has a cable connection terminal for connection with external equipment and communicates with other telephone terminals and personal computer (PC) terminals through a communication cable 20 connected to this terminal, capturing various pieces of information including music information from these devices into the terminal system TS and providing these pieces of information from the terminal system TS to these devices.
The small-size recording medium 19 can store music information and configuration information received from another telephone terminal or personal computer terminal through the communication cable 20 and the communication I/F 10, or from a server (BS) through the receiver/transmitter 6. It can also store music information automatically composed or edited by use of its own potable terminal apparatus TS. The music information and configuration information stored are then read out and sounded as ringing melodies or BGM. The removable compact recording medium 19 may be used for storing program instructions executable by CPU to perform the inventive process.
Sounding Controller (1)
Referring to
A controller 21 executes bi-directional communication with the terminal system TS main through the above-mentioned bus connection path. The performance information and configuration information prepared on the main side or supplied from the outside are stored in the main ROM 2 or the main RAM 3. The controller 21 stores the performance information in a first-in first-out (FIFO) memory 22 and the configuration information about timbre and effect in a timbre/effect RAM 23. In such a case, the performance information and the configuration information memorized in the FIFO 22 and RAM 23 covers a whole or part of one music song.
The controller 21 reads the timbre configuration information and effect configuration information (including DSP program) from the timbre/effect RAM 23 on the basis of the timbre and effect specified by the main side to set the timbre and the effect in a tone generator 24 and an effector 25 respectively. Further, the controller 21 sends information about the limits of storage capacities of the FIFO 22 and the timbre/effect RAM 23 to the main side, thereby requesting the main side to pause the information communication from the main side.
The FIFO 22 and a read circuit 26 function as performance information supply controller that sequentially sends the performance information received from the main ROM 2 or the main RAM 3 to a resource circuit. To be more specific, the FIFO 22 temporarily stores the received performance information in the order of reception. The read circuit 26 accesses the FIFO 22 at predetermined time intervals to sequentially read information if any and output it to the tone generator 24.
The tone generator 24 is an FM tone generator for example and can sound two or more tones at a time. The tone generator 24 sets a timbre to be sounded on the basis of timbre-associated configuration information received from the timbre/effect RAM 23 and, on the basis of the performance information received from the read circuit 26, sequentially synthesizes tone signals corresponding to the specified timbre to send them to a mixer (MIX) 27.
The effector 25 sets effects such as reverberation to be imparted on the basis of the effect-associated configuration information received from the timbre/effect RAM 23. The effector 25 imparts the specified effect to a signal inputted from the MIX 27 according to the DSP program and outputs the effected signal to the MIX 27.
A talk voice is inputted in the MIX 27 in the form of a digital signal through the connection path with the audio controller 7 of the terminal system TS main. The MIX 27 adds up the signals supplied from the tone generator 24, the effector 25, and the audio controller. To be more specific, the following signals are inputted in the MIX 27:
The input signals SM and ST are selectively outputted from the MIX 7 to the effector 25 to be imparted with an effect. Which signal is to be effected may be selected by operating a predetermined switch on the operator section 12 of the terminal system TS. Then, the MIX 27 outputs all synthesized signals to a digital-to-analog converter (DAC) 28 and, at the same time, outputs these signals in the form of digital signals to the digital output terminal 18.
The DAC 28, an amplitude controller (VOL) 29, and an amplifier (AMP) 30 form an analog output unit. An analog music signal outputted from the DAC 28 is adjusted in volume by the VOL 29 to be outputted to the audio controller 7 of the terminal system TS main or sent to the sound speaker 17 through the AMP 30 for sounding as a tone. Namely, all the synthesized signals are outputted from the VOL 29 to the audio controller 7 in the form of analog signals and also from the AMP 30 to the speaker 17 in the form of analog signals for sounding.
Sounding Controller (2)
Referring
The communication circuit 32 has the following two communication capabilities:
(1) Bi-directional communication with the main unit bus 11. The communication circuit 32 records the music information, performance information, and configuration information received from the outside of the terminal system TS through the main unit bus 11 into the sounding control RAM 35 (it should be noted that the sounding control ROM 34 holds various tables for sounding control). The communication circuit 32 also various pieces of information (about the operations done on the operator section of the TS main) associated with the selection of timbre and effect, parameter change, and selection of music information for reproduction. The received information is interpreted by the operation of the sounding control CPU 31. Processing according to the interpreted information, for example, the setting of a selected timbre, is executed on the tone generator 35. The configuration information corresponding to the selected timbre is read out from ROM 34 or RAM 35.
Further, when controls of the main body is operated to command editing of music information or configuration information stored in the tone generation control ROM 34 or tone generation control RAM 35 in the tone generation control circuit, selected information corresponding to the operation is read out from the ROM 34 or RAM 35, and is sent to the RAM 3 of the main unit. The edit process is executed by use of the main RAM 3. Upon completion of the edit process, the information is again overwritten into the RAM 35 of the tone generation control circuit.
(2) Bi-directional communication with the audio controller 7. The communication circuit 32 sends a tone signal for example synthesized inside the sounding controller 8 to the audio controller 7, manipulates, inside the sounding controller 8, a talk signal for example received from the audio controller 7, and sends the manipulated signal to the audio controller 7. The manipulation includes effect imparting to a talk voice and pitch/timbre conversion of talking voice for example.
The sounding control CPU 31 controls the operations inside the sounding controller 8 independently of the terminal system TS main and, on the basis of a signal generated by the timer 33, sequentially reads the performance information stored in the sounding control ROM 34 and the sounding control RAM 35, thereby reproducing melodious ringing tone and BGM. In addition, the sounding control CPU 31 sends the configuration information from the sounding control ROM 34 and the sounding control RAM 35 to the tone generator 36 and the effector 37 through the sounding control bus 40 for reproduction and controls tone timbre settings and effect impartment settings. It should be noted that such a start and stop process of the music performance is commenced in response to command operations utilizing controls 12 of the main unit.
The timer 33 generates a signal at predetermined time intervals. On the basis of the signal generated by the timer 33, the timing of sounding of melodious ringing tone and BGM is controlled to determine the performance tempo of each generated tone. This tempo may be controlled by the user.
Control of the tempo may be carried out by any technique. The following techniques are considered effective:
When specifying a tempo, the user may specify an absolute value of the tempo (“120”, “150” or the like), a word indicative of the tempo (such as “allegro” and “moderato”), a rate of change from a reference tempo (percent (%) or increases/decreases (±)), or an intuitive word (“quick”, “slow” or “moderate”). These specifications are made via the operator section 12 of the main unit.
The sounding control ROM 34 stores predetermined information about melodious ringing tone and BGM, performance information, configuration information, conversion tables for information format conversion, and compression tables for information compression, each of these pieces of information being stored in plurality. The sounding control RAM 35 stores plural pieces of added or newly created music information, performance information, and configuration information.
The tone generator 36, in this example, is an FM tone generator and capable of sounding plural tones at a time. The tone generator 36 sets a sounding timbre on the basis of the timbre-associated configuration information supplied from the sounding control ROM 34 and the sounding control RAM 35. In addition, the tone generator 36, under the control of the sounding control CPU 31 and the timer 33, sequentially synthesizes tone signals corresponding to the set timbres on the basis of the performance information supplied from the sounding control ROM 34 and the sounding control RAM 35, outputting the synthesized tone signals to the MIX 38.
The effector 37 sets an effect to be imparted to a tone on the basis of the effect-associated configuration information supplied from the sounding control ROM 34 and the sounding control RAM 35 through the sounding control bus 40. The effector 37 also imparts an effect to the signal inputted from the MIX 38 and the talk voice signal ST for example inputted from the communication circuit 32 and outputs the effected signals SE to the MIX 38.
The MIX 38 adds up the inputted signals and outputs the added signals to the digital-to-analog converter (DAC) 41 and the digital output terminal 18. The signals to be inputted in the MIX 38 include:
The amplitude controller (VOL) 39 and the amplifier (AMP) 42 form an analog output unit. The volume of an analog tone signal outputted from the DAC 41 is adjusted in volume by the VOL 39. The adjusted analog tone signal is outputted to the audio controller 7 through the headphone terminal and to the sound speaker 17 through the AMP 42.
Usage Environment of the Terminal System:
Referring to
In a second environment, the terminal system TS receives the music information created in the personal computer terminal PC through the communication cable 20 connected to the communication I/F 10 and uses the received information as melodious ringing tone and BGM.
In a third environment, the terminal system TS captures music information from the small-size external recording medium 19 loaded in the connecting circuit 9. In a fourth environment, the terminal system TS receives music information from the OS of another telephone terminal through a telephone line and the receiver/transmitter 6 via the base station BS or via the communication cable 20 and the communication I/F and uses the received music information for music sounding.
The music information captured in the terminal system TS from such music information sources as the base station BS, the personal computer terminal PC, the external recording medium 19, and the OS of another telephone terminal is edited, compressed, and format-converted in the information source BS, PC, and TS to be downsized into a form usable in the terminal system TS.
For example, the music information (including performance information and configuration information) to be captured from the above-mentioned information sources into the terminal system TS may have a format suitable for the own model or have another format. In the case of the suitable format, the music information has been created in the suitable format from the beginning or converted from another format into the suitable format (this is referred to as format conversion). This format conversion is executed in the base station BS or the personal computer terminal PC. If the music information having another format is captured in the terminal system TS, that format is converted into the suitable format inside the terminal system TS.
Information Formats:
Referring to
As for timbre, the configuration information SA includes:
Algorithm data AA determines a combination or an algorithm of plural operators in the FM tone generator (sine wave memory+output level computing unit+envelope (EG) waveform synthesizer). The F parameter FA determines the frequency of read sine wave for each operator. The EG parameter EA sets plural level values and rate values for synthesizing an envelope waveform (an EG waveform).
The configuration information SA includes information for effect parameter setting, an effect program (a DSP program) for determining the contents of the effector 25, audio information, and video information, in addition to the above-mentioned timbre-configuration information NA and DA.
The performance information MA includes performance information such as timing data TM, key number KN, and gate time GT in the order of performance that can sound two or more tones at a time.
Referring to
To be more specific, the performance information IB of another model is a string of symbols (#, 1, 2, 3, and so on) inputted by a ten-key provided in the portable terminal apparatus, and is arranged in the order of performance according to a predetermined rule. For example, numeral “1” represents pitch “do”, numeral “2” represents “re”, and so on. According to the number of continuous numerals, the length of sounding is specified. Consequently, if symbol string a, b, c, and so on represents “1-1-2-1-1- . . . ”, then this symbol string represents a tone denoting that “do” is sounded for a quarter, “re” is sounded for an eighth, and then “do” is sounded for a quarter again.
Referring to
Of the configuration information SC, the information for timbre setting includes:
Unlike the timbre parameters DA for the terminal system TS, the timbre-setting detail information DC of (2) above has many pieces of information as shown in
The performance information MC is of “duration DR+event IV” format. Key-on and key-off events are stored along with the duration data DR, so that the amount of the performance information MC is relatively large. In addition, velocity data are stored for each key-on event. The velocity data are also compressed (or deleted) in the format conversion into the own model format A.
In this embodiment, the music information IC of
[Transfer of Information with Base Station]
Referring to
First, the terminal system TS starts a request information send module (S1) and calls the base station (server station) BS through the receiver/transmitter 6, requesting the server station BS according to a predetermined instruction for downloading information from a database DB of the server station BS. To be more specific, during talking with the server station BS, the music information, performance information, and timbre information for example stored in the database DB are sequentially displayed on the display 13 of the own terminal system TS. The user operates corresponding keys on the operator section 12 to enter numbers indicative of these pieces of information and then executes a request decision operation. The selection information indicative of the information to be downloaded and the identification information indicative of the model and serial number of the own terminal system TS and the type of the tone generator installed in the tone generator 24 of the terminal system TS are sent to the server station BS.
In response to the request information received from the terminal system TS, the server station BS starts a selective reading module (B1) to selectively read the music information and so on corresponding to the request information from the database DB. A judgement module (not shown) determines a format type of the read performance information. In detail, the judgement module may check contents of format type information (indicative of format type of the information) attached the read information so as to recognize the format type. Otherwise, in case that the format type information is not attached, the judgement module may determine the format type from contents of the read information. As a consequence of the determination, in the case of own model format A, the read performance information and so on need not be format-converted, so that they are passed directly to a charging module (B2). If the format of the read performance information and so on differs from own model format as with the case of conventional-model format B, the read performance information and so on are passed to the charging module (B2) through a configuration information attaching module (B3) and a format converting module (B4).
If the performance information having a format other than the own model format has no configuration information as with conventional-model format B for example, the configuration information attaching module (B3) attaches configuration information to that performance information. This configuration information attachment allows the performance information for another model having no configuration information to be effectively reproduced with timbre/effect imparted by making the most of the tone generator capabilities in the terminal system TS. The configuration information is attached in one of the following manners:
The performance information attached with configuration information is passed to the format converting module (B4). The format conversion module converts the performance information to own model format A by use of a conversion table TB prepared before. This conversion table TB is prepared for each combination of formats before and after format conversion. For example, this table describes a conversion rule for conversion from conventional-model format B into own model format A, thereby converting the format of the performance information from the format of another model (B) into own model format A.
The format of another model includes SMF format C not shown in
In case of a conversion from SMF format to the own format A, it is possible to carry out information compression in similar manner by an information compression module (P4) of
Then, the charging module (B2) executes a charging operation on the downloaded information. This charging operation may be adapted to discount billing amount when the terminal is recognized as a particular model or having a particular tone generator under a particular contract with the server station for example by referencing the identification information (including the model and serial number of the terminal and the type of tone generator) received from the terminal system TS.
When the charging operation has been completed, the server station BS starts an information transmission module (B5) to send the music information and configuration information having own model format A corresponding to the select information to the terminal system TS.
When these music information and configuration information have been supplied from the server station BS, the terminal system TS starts an information receive module (S2) to receive and download the music information and the configuration information through the receiver/transmitter 6. The downloaded information is stored in the main RAM 3. It should be noted that, during a period from requesting the information by the request information send module (S1) to the completion of supply of the requested information from the base station BS, the terminal system TS may be in a talking state. Alternatively, talking may be cleared once after sending of the request information and the requested information may be received by subsequent talk processing (by electronic mail or return talk from the base station BS).
Then, a setting module (S3) executes, as specified by the user, settings such that the melodious ringing tone can be sounded on the basis of the received music information. The setting module may also execute settings such that the received information is reproduced as BGM during talk or music to be played any time.
It may be expedient that the received music information or configuration information may be automatically set to the ringing melody or BGM sound immediately after the receipt of the information. Otherwise, at the time of the receipt, a music corresponding to the received information may be reproduced to confirm contents of the received information.
In the above-described system, the base station BS conducts attachment of configuration information, format conversion and information compression for the music information, performance information and configuration information. Alternatively, the terminal system TS may conduct these configuration information attachment, format type conversion and information compression as will be described later in conjunction with
Information Transfer with Personal Computer:
Referring to
In the personal computer terminal PC, a selective reading module (P1) selects, by use of installed predetermined software, the music information and configuration information to be used as melodious ringing tone or BGM from the database DB in the computer terminal PC in which the information is recorded in SMF format C or own model format A. An information edit module (P2) can edit the selected music information and configuration information. In editing, timbre and effect parameters in the configuration information are changed or added, portions for use as melodious ringing tone or BGM are selectively extracted from the performance information in the music information, and “trial sounding” is executed in a timbre and effect setting condition in which the selected music information is sounded in the same setting as the terminal system TS, namely on the basis of compressed configuration information.
Further, the database DP of the personal computer terminal PC may store the conventional format B of
As for newly creating music information on the personal computer terminal PC, new music information manually inputted by the user is created by a newly creating module (P3) by use of sequencer software (music information creating software) having conventional SMF format installed in the computer terminal PC for example. The new music information created here is music information compliant with SMF format C for example.
The newly creating module (P3) can also create new music information automatically by use of automatic composing software (or device). In this case, a conventional automatic composing program or device may be applied to execute jobs such as extracting only a part of music (a bridge for example) in a desired section from the music information for one piece of music created by conventional automatic composing software and/or automatic composing device, extracting only the information of minimum necessary tracks (melody track, harmony track, and so on) from the music information made up of plural tracks, and correcting joints (start and end positions of a section) so as to properly join the pieces of the extracted information when it is repeatedly reproduced. It should be noted that the newly creating module (P3) may also create the music information equivalent to melodious ringing tone and BGM in own model format A directly.
Of the information read and/or edited by the information edit module (P2) and the information newly created by the newly creating module (P3), the information having a format (for example SMF format C) other than own module format A is compressed by an information compressing module (P4) and format-converted by a format converting module (P5). On the other hand, the information having own model format A is directly passed to an information sending module (P6).
The information having a format other than own model format A is first compressed by the information compressing module (P4) by use of a predetermined compression table TE so as to be stored in the terminal system TS. This compression table TE is prepared for each combination of formats before and after compression and describes a predetermined compression rule. Specific processing based on this compression rule includes deletion of the above-mentioned unnecessary information such as the excess information in the rate scale RS and the EG parameter EC of SMF format C (refer to
The compressed information is format-converted from SMF format C for example into own model format A by the format converting module (P5) by use of a conversion table TC as by the format converting module (B4) in the embodiment (the first system) shown in
The music information and/or configuration information supplied from the modules (P2 and P3) originally having own model format A and those supplied from the module (P5) compressed and converted into own model format A are sent to the terminal system TS through the information sending module (P6) to be captured in the terminal system TS through the communication cable 20 and the communication I/F 10.
In the terminal system TS, an information receiving module (T1) receives the music information and the configuration information supplied from the personal computer terminal PC and stores them into the main RAM 3. Then, a setting module (T2) makes a setting, as specified by a user operation, so as to sound melodious ringing tone and BGM on the basis of the received music information.
The processing by this information receiving module (T1) and the setting module (T2) may be similar to that executed by the information receiving module (S2) and the setting module (S3) of
In the above-described construction, the personal computer terminal PC conducts editing of the music information, performance information and configuration information. Otherwise, the terminal system Ts may perform editing of information received from the personal computer terminal PS in similar manner by means of information record/edit module (U5) of
Further, it will be expedient that the information stored in the terminal system TS is transmitted to the personal computer terminal through a communication cable 20, and the personal computer terminal may edit the transmitted information based on the above-described manner.
Information Transfer between Recording Medium and another Terminal:
Referring to
Processes such as information compression, format conversion and information edit may be carried out by other telephone terminals (Usa, Usb) to form information of the own format A instead of the terminal system as will be described net in detail. Thereafter, the formed information may be received by the terminal system TS.
Music information, performance information, and configuration information are recorded beforehand on the detachable small-size recording medium 19 in own model format A or another format (for example, format B or C). The recording medium 18 is then loaded on the own terminal system TS and desired information (attached with information indicative of a format of the information) is read through the connecting circuit 9. Each information is attached with formant type information indicating the format type of each information. The user can read desired information by operating a predetermined switch arranged on the operator section 12 of the own terminal system TS.
Information supplied from another telephone terminal OSa is captured in the own terminal system TS via the base station BS over the telephone line through the receiver/transmitter 6. Information supplied from still another telephone terminal OSb is captured in the own terminal system TS over the communication cable 20 through the communication I/F 10. These telephone terminals OSa and OSb may use the information of the same format, namely own model format A, or of a different format such as conventional-model format B or SMF format C.
With regard to the transmission from other telephone terminals (Osa, Osb), there are available two methods. In one method, command operation is carried out in the own terminal system TS to request transmission of desired information to other telephone terminals (Osa, Osb). In another method, command/operation is carried out in other telephone terminals (Osam Osb) to request receipt of desired information to the own terminal system TS.
When sending information from the telephone terminal OSa or OSb, information indicative of the format of the information to be sent (formant type information) is attached thereto. It should be noted that the telephone terminal OSa or OSb may be adapted to request the receiving terminal or the own terminal system TS to set and use the received information real-time (namely, the received information is immediately set and used in the own terminal system TS). When sending information through the base station BS, the base station may be adapted to compress and format-convert the information to be sent to the receiving terminal (the own terminal) in manner similar to the case of
An information receiving/reading module (U1) reads music information, performance information, and configuration information from the external recording medium 19 or captures these pieces of information from the telephone terminals OSa and OSb as described above. The judgement module (not shown in the figure) determines the format type of the read or taken information in manner similar to the process described in conjunction with select/read module (B1) of
Basically, the configuration information attaching module (U2), the information compressing module (U3), and the format converting module (U4) execute the same processing as executed by the configuration information attaching module (B3), the information compressing module (P4), and the format converting modules (B4 and P5) in the embodiment (the first system) shown in
The information passed to the information record/edit module (U5) is stored in the main RAM 3 of the own terminal system. Thereafter, the information can be edited by means of various switches of the operation controls 12. The editing jobs include addition, deletion, and changing of various parameters contained in the configuration information SA. Further, this module (U5) allows to newly create music information. Then, the setting module (U6) makes a setting by a controller 12, as specified by a user operation, so as to sound melodious ringing tone and BGM on the basis of the received music information.
[Own Terminal Processing in the Own Terminal System]
Referring to
Step TR2 is a send processing routine in which various pieces of information involved in a normal talking operation are sent and, in the case of the embodiment (the first system) shown in
Step TR4 is a select/set processing routine in which the user operates a predetermined switch in the operator section 12 to select the information for use as melodious ringing tone or BGM from the information stored beforehand in the main ROM 2 of the own terminal system TS or the received information stored in the main RAM 3. In this case, if the selected information includes performance information, it is read and set so that it becomes available as melodious ringing music tone information or BGM information. If the selected information includes configuration information, various settings are executed accordingly. For example, timbre parameter PT is set in the tone generators 24 and 36, effect parameter PE is set in the effectors 25 and 37, effector programs are changed by an effect program (DSP program) for determining the contents of the effectors 25 and 37, and settings associated with audio information and video information are made.
In the case of the embodiment (the first system) shown in
Step TR5 is an edit processing routine in which, in the case of the embodiment (the third system) shown in
This terminal system TS may be provided with an automatic composing capabilities. In this case, automatic composing operations are executed as another processing operation by another processing routine in step TR6. The automatic composing capabilities include:
This terminal system TS may also be provided with a style reproducing capability for recording plural pieces of style information and performance information beforehand and joining them to reproduce as a piece of music. In this case, the style reproducing operation is executed by another processing routine in step TR6. In addition, step TR6 may be provided with a music game capability for executing a music game to be played only on the own model or in communication with another model.
The processing routines of steps TR2 through TR6 are repeated unless a power-off sequence is detected in step TR7 (namely, unless the terminal system TS is powered off). Upon detection of the power-off sequence, this own terminal processing is ended.
Server Processing in the Base Station:
Referring to
In a receive processing routine of step BR2, the following processing operations (1) through (4) are executed in the case of the embodiment (the first system) shown in
In the case of the embodiment (the third system) shown in
In the case of the embodiment (the first system) shown in
The processing routine of step BR4 can also send only part of music information, performance information, and configuration information to answer a request from the terminal system TS. For example, this routine can send only the information associated with timbre in the configuration information without sending the effect-associated information. This routine also allows trial listening of music information for example by streaming transmission (real-time reproduction) of information.
In streaming transmission, music information is so reproduced that each reproduced event is packeted in real time, or that plural events close in time to one another are packeted in a batch together with time difference information among the events. These packets are then sent from the server BS to the terminal system TS by streaming transmission. The terminal system TS receives the transmitted packets, temporarily stores them in the main RAM 3 or FIFO 22, and reproduces music based on the music information stored.
The processing routines of steps BR2 through BR4 are repeated unless a power-off sequence of the server station BS is detected in step BR5. Upon detection of the power-off sequence, this server processing is ended.
PC Terminal Processing in Personal Computer:
Referring to
The select processing routine of step PR2 selects music information and configuration information to be used for melodious ringing tone or BGM from a database PD in the personal computer terminal PC in which the information is recorded in SMF format C or own model format A (the selective reading module P1).
The new creation processing routine of step PR3 newly creates music information compliant with SMF format C or own model format A by use of conventional sequencer software, music information creating software, and automatic composing software (device) for example (the newly creating module P3).
The edit processing routine of step PR4 edits the selected music information and configuration information (the editing module P2). The send processing routine of step PR 5 executes information compression, format conversion, and information sending (the information compressing module, the format converting module, and the information sending module P4 through P6).
Further, the other processing routine of step PR6 attaches other information to the configuration information SA. The information to be attached here includes an effect program (DSP program) for determining the contents of the effector, audio information, and video information.
The processing routines of steps PR2 through PR6 are repeated unless a power-off sequence of the personal computer terminal PC is detected in step PR7. Upon detection of the power-off sequence, this PC terminal processing is ended.
[Exemplary Uses of Audio Information and Video Information]
As described, the present invention uses audio information and video information as the configuration information other than music-associated information. For example, audio information is of WAVE, AIFF, SOUND VQ, or MP3 for example depending on how the audio information is compressed. The present invention allows common formatting to capture the audio information having these formats and, along with the creation of tone signals based on music information, create audio signals for guidance.
Video information may be used to display an icon representative of the other party at call termination therefrom and synchronize the icon with the reproduction of the melodious ringing tone or sequentially display musical notes corresponding to tone signals, for example.
[Karaoke Capabilities]
In the portable terminal apparatus practiced as one embodiment of the invention, the system may be put in a so-called “karaoke” mode to realize a karaoke capability by which words of a song are sequentially displayed in synchronization with the performance of that song, the user signing to the reproduced music by following the words running on the display. To make the portable telephone terminal (the terminal system) TS execute the karaoke capability, the controls of the operator section 12 (refer to
In the karaoke mode, the music information for karaoke is preferably used. The karaoke music information has performance data and words data in performance information, which are recorded in the main ROM (the internal memory) along with other music information beforehand. Alternatively, the karaoke music information may be received from the detachable small-size recording medium 19, the personal computer terminal PC, other telephone terminals, the base station BS, or other external devices to be stored in the main RAM (the internal memory). In the karaoke mode, the music information thus recorded is processed by the karaoke processing capability of the main CPU 1, the configuration information and the performance data included in the processed music information being supplied to the sounding controller 8. The resultant music performance output is sounded from the speaker 17 or a headphone while the karaoke words are displayed on the display 13 of the terminal system TS on the basis of the words information included in the music information.
Example of Music Information Format:
Referring to
The performance data PK indicative of music progression are equivalent in content to the above-described performance information MA, which is the information recording timing data PT and performance event PE in the order of performance and ending with end data EP. The performance event PE is a collection of key numbers and gate times. The words data WK indicate the words for the performance data (a song) included in the performance information IK and record, in the sequence of music progression, timing data WT indicative of display timing and text event data WE indicative of the words to be displayed, ending with end data EW. The timing data WT included in the words data WK are synchronized with the timing data PT included in the performance data PK so that each text event WE is displayed in synchronization with music performance.
Like the above-described music information IA, IB, and IC, the music information involving words data may be one received from the outside. When receiving the music information from the outside, not only the performance data (the music progression data) but also the words data are compressed and format-converted into the words data WK for own model as with the above-mentioned embodiments. Consequently, the received music information is stored in block KB3 along with a control command. In doing so, on the basis of the timing data PT of the performance data PK, the performance event PE is sent to a route to the tone generator 24 or 36 (refer to
The controller block KB3 controls the sending of the information passed from the information separation block KB2 in accordance with the control command. To be more specific, if the control command specifies the reproduction of a melodious ringing tone, only the performance event PE is sent to a tone generator block KB4; if the control command specifies the display of words (the karaoke capability), the performance event PE and the text event WE (or only the text event WE) are sent to the tone generator block KB4 and a display circuit block KB5 respectively. Then, the tone generator block KB4 and the display circuit block KB5 are driven by the received performance event PE and the received text event WE respectively, executing music performance and words display.
Receive Processing 1:
Referring to
In step KR11, which corresponds to talk request acknowledge processing in the normal portable telephony, the main CPU 1 determines whether there is a request to talk from another terminal. If the request to talk is found, the CPU 1 displays information thereof in step KR12 and goes to step KR13. If there is no request to talk, the CPU 1 ends this receive processing 1. The displaying of the information indicative that there is a request to talk in step KR12 is made by displaying a request-to-talk icon on the display 13 or flashing the already displayed request-to-talk icon. This prevents a melodious ringing tone from sounding while the user is looking at karaoke words for example.
In step KR13, the CPU 1 sets a RUN flag indicative of a ringing melody music reproduced state to “1” and, in step KR14, resets the current data read operation to forcibly pause the current mode before entering the talk mode, setting the reading of ringing melody music. For example, if the current mode is the karaoke mode, the CPU 1 resets the reading of the performance data PK and the words data WK and, before entering the talk mode, erases the currently displayed words and muting the currently reproduced music, forcibly pausing the current mode. It should be noted that the current mode may be forcibly ended before entering the talk mode. On the other hand, as for the ringing melody music, the CPU 1 executes necessary settings on the basis of the configuration information in the music information selected as the melodious ringing tone and sets the data read position to the beginning of the performance data.
Other Processing 1:
Referring to
Selection/Setting Processing 1:
Referring to
In step KR31, the CPU 1 determines whether the karaoke mode has been set by the operation of the karaoke mode select switch. If the karaoke mode is found set by the karaoke select switch, the CPU 1 goes to step KR32; otherwise the CPU 1 ends the selection/setting processing 1 immediately. In step KR32, the use selects a song to be reproduced from the internal ROM. In this case, if the words data for the selected song are not found in its music information, information thereof is displayed. If no song selection is executed, the CPU 1 sets the music information currently set as a melodious ringing tone as the selected music.
In step KR33, the CPU 1 resets the reading of the currently used data to pause the current mode. In step KR34, the CPU 1 inverts a KARAOKE flag indicative of the karaoke mode, thereby ending this selection/setting processing 1. When the KARAOKE flag is set to “1”, it data of the music information selected as the melodious ringing tone, at the time of a request to talk or sounding a request-to-talk voice. In this case, the progression timing of the music is counted by another interrupt processing operation. It should be noted that, during sounding of the melodious ringing tone, the setting of the karaoke mode (the KARAOKE flag=“1”) is ignored and the words display by the display circuit 5 (refer to
On the other hand, if the RUN flag is found “0” in step KR41, the CPU 1 goes to step KR43 to determine whether the KARAOKE flag is “1”. If the KARAOKE flag is found “1”, the CPU 1 goes to step KR44; otherwise, the CPU 1 ends this interrupt processing 1.
In step KR44, the CPU 1 sequentially sends text events to the display circuit 5 (refer to KB5) on the basis of the words data to sound a corresponding tone and goes to step KR42. To be more specific, when the RUN flag is “0” (the melodious ringing tone not reproduced) and the KARAOKE flag is “1”, it indicates that the karaoke mode is on. In step KR44, the CPU 1 displays words in accordance with the words data WK of the selected karaoke song. In step KR45, the CPU 1 reproduces the song in accordance with the performance data PK of the selected karaoke song. Therefore, when the RUN flag is “0” and the KARAOKE flag is “1”, the processing operations in both steps KR44 and KR45 allow the CPU 1 to synchronously execute music reproduction and words display in accordance with the performance data PK and words data WK of the selected karaoke song.
Namely, as for the performance data PK, the timing data PT and the performance event PE recorded in the order of performance are sequentially read to reproduce music. As for the words data WK, the timing data WT and the text event data WE recorded in the order of display are sequentially read to display words. At this moment, the timing data WT indicative of display timing are synchronized with the timing data PT, so that the display of words may be varied in synchronization with music performance. Preferably, the highlighting of words display in this terminal system is easier than the color wiping of character display in ordinary karaoke machines. For example, such highlighting techniques are preferably used as making brighter, as hatching, or as inverting the words to be pronounced or already pronounced of the words of a song currently displayed.
Various Karaoke Modes:
Another karaoke mode may be provided in which only words are displayed without reproducing music. In this case, preferably, the progression of words display may be controlled by the user.
Still another karaoke mode may be provided in which not only the words data and performance data for a part of a song but also those for an entire song may be recorded as performance information. In this case, when reproducing a melodious ringing tone, only a predetermined part (for example, the part of bridge) of a song may be reproduced. At the time of karaoke reproduction, an entire song may be reproduced.
Yet another karaoke mode may be provided in which only the words data may be recorded for an entire song. In this case, in the karaoke reproduction mode (“performance on” mode), only the words corresponding to the performance data may be sequentially displayed. In the words-display-only mode, the words for the entire song may be displayed on the display in accordance with the user operation.
Edit Capabilities:
The terminal system practiced as one embodiment of the invention allows the user to execute various information editing operations by use of the switches on the operator section 12 as described with reference to the information recording/editing module (U5) shown in
An edit mode select switch and various edit switches are included in the operator section 12 (refer to
Selection/Setting Processing 2:
Referring to
The edit mode select switch is operated to instruct the start and end of the edit mode. Every time this switch is operated, the settings of an EDIT flag alternate. When the EDIT flag is “1”, it indicates that the edit mode is on; when the EDIT flag is “0”, it indicates that the edit mode is off (a non-edit mode is on). Only one mode can be set at a time. For example, if the karaoke mode is on (the KARAOKE flag=“1”) when the edit mode select switch is operated, the karaoke mode is forcibly ended.
In step ER12, the CPU 1 inverts the EDIT flag and goes to step ER13. In step ER13, the CPU 1 determines whether the EDIT flag is “0”. If the EDIT flag is found “0” (a non-edit mode is on), the CPU 1 goes to step ER14 to write the edited contents over the selected information, ending the selection/setting processing 2. If the EDIT flag is found “1” (the edit mode is on), the CPU 1 goes to step ER15. When ending the edit mode by the processing of step ER14, the edit contents stored in a temporary storage area in the main RAM 3 can be overwritten for storage.
In step ER15, the CPU 1 switches the input mode of the numeric keys on the operator section 12 of the terminal system TS to “information selection” side. When the user specifies, by operating the numeric keys, the information to be edited from among timbre information, effect information, performance data, and words data for example, the specified information is selected. If the user specifies no information, the CPU 1 sets as the edit information the timbre information or performance data of a song set as a melodious ringing tone. In next step ER16, the CPU 1 displays a part (for example, the start of the song) of the selected (or set) information on the display 13, ending the selection/setting processing 2.
Edit Processing 1:
Referring to
In step ER22, the user operates the data select switch and so on of the operator section 12 to sequentially change the contents displayed on the display 13, displaying such data values to be edited as parameters, musical notes, and timings. In next step ER23, the user starts a specific edit operation, in which the user switches the input mode of the numeric keys for inputting telephone numbers on the operator section 12 from “information selection” to “parameter setting”. Here, the user inputs new parameter values, add new data, delete existing data, or executes other parameter setting operations.
In step ER24, the CPU 1 stores the edited contents in the temporary area of the main RAM 3 and goes to step ER25. It should be noted that the temporary stored edited contents are written over the actual data at the end of the edit mode. However, this overwriting may be executed during the edit mode.
In step ER25, the CPU 1 determines whether the RUN flag is “1”. If the RUN flag is found “1” (the melodious ringing tone being reproduced), then the CPU 1 sets the EDIT flag to “0” in step ER26 and goes to step ER27; otherwise (the RUN flag=“0”, the melodious ringing tone not being reproduced), the CPU 1 ends the edit processing 1. In step ER27, the CPU 1 determines whether to overwrite the edited contents. If the edit contents are to be overwritten, the CPU goes to step ER28 to execute the overwriting and then ends the edit processing 1. Otherwise, the CPU 1 immediately ends the edit processing 1.
If a request to talk comes during the edit mode, the edit mode is forcibly ended. Whether the edited contents made so far are to be preserved or not is left to the discretion of the user in step ER28. For example, the display 13 shows a prompt for overwriting or preservation. In this case, a YES/NO operating switch on the operator section 12 may be used for the selection between overwriting and preservation. Preferably, while this prompt is displayed, the CPU 1 does not start the melodious ringing tone sounding processing.
As described with the receive processing 1 (refer to
It should be noted that the edit mode not only can edit already stored information but also can newly create and store information such as timbre information, effect information, and words data.
Voice Composing Capability:
In the terminal system according to one embodiment of the invention, music information can be created from the voice inputted in the terminal system as mentioned as the first example of the automatic composing capability in the other processing (refer to
An input module CA1 comprises a microphone input block CA11 for capturing a voice (or a singing voice) inputted from the microphone 14 (refer to
An input selector module CA2 selects between the microphone input voice and the talk input voice as the data source when the user operates the numeric key for input telephone numbers on the operator section 12. An A/D converting module CA3 converts the format of a data source input voice from analog to digital.
A noise level setting module CA4 sets the level of a noise included in the data source voice supplied from the input module CA1 by means of the following processing:
When the above-mentioned processing has been completed, the noise level setting module CA4 shows a prompt for input on the display 13 for example, asking the user for inputting his or her voice through the microphone or inputting the talk voice. A noise canceling module CA5 deletes the voice information below the maximum noise level set by the noise level setting module CA4 from the data source input voice converted into digital format by the A/D converting module CA3.
A pitch detecting module CA6 extracts a pitch sequence from the noise-deleted data source input. The pitch sequence is extracted by frequency analysis for example. In addition, in order to reduce the size of information to be recorded, if generation of plural sounds within a predetermined time is recognized, the sounds following the beginning sound are all deleted. To be more specific, a shortest sound provides a predetermined duration (for example, an eighth note) and the sounds shorter than this predetermined duration are all deleted. If the pitch sequence is found not reaching a predetermined interval, it is preferable to arrange a transposing capability for totally transposing the detected pitch sequence up to the predetermined interval. Such a transposing capability can automatically convert a low-interval input sound into an interval at which the input sounds becomes available as a melodious ringing tone.
A data creating module CA7 converts the pitch sequence detected by the pitch detecting module CA6 into the information corresponding to own model format A and stores the resultant information in the main RAM 4 or the sound control RAM 35.
Automatic Composing Capability 1:
In the system according to one embodiment of the invention, an automatic composing capability can be realized as described with reference to the newly creating module (P3 shown in
A manual input module CB1 allows the user to input (or create) music information in the following manner by use of a conventional sequencer (or a personal computer having a sequencer) for example:
On the other hand, in an automatic composing module CD2, the user inputs partial data for a piece of music to be composed. This input is made by actually playing the electronic musical instrument or by use of the display screen of the personal computer terminal PC. Plural pieces of partial music data (pattern data) may be prepared in the personal computer terminal PC for selecting the data for composing music. After inputting the partial music data as described above, the music information for one piece of music is automatically created by use of a known automatic music creating technique.
The music information created by the manual input module CB1 or the automatic composing module CB2 or the music information stored in the personal computer terminal PC is inputted in a music analysis module CB3. The music analysis module CB3 analyzes the inputted music information in order to divide the music information for one piece of music into musical sections such as an introduction part, a fill-in part, a main part, and an ending part for example.
A sectioning module CB4 divides the music information into plural pieces of sectional information on the basis of the analysis result provided by the music analysis module CB3. A section selecting module CB5 automatically selects one of the plural pieces of sectional information for use as a melodious ringing tone or BGM. For this selection, the plural pieces of sectional information may be displayed on the screen to allow the user to listen to each piece on a trial basis.
In a track selecting module CB6, if a selection piece of sectional information is made up of plural tracks (or parts), the number of these tracks is narrowed down to a minimum. For example, if there are plural parts which are played in a similar timbre, only one of them is used, the information about the other being deleted.
In a repetition correcting module CB7, if a certain piece of sectional information completed with the processing operations up to and including the track selecting processing (CB6) is reproduced repeatedly, a tone at the start of that section or a tone at the end of the section (or a tone in proximity) is corrected so that the tone at the start of the section and the tone at the end of the section are linked smoothly. Lastly, an information recording module CB8 stores the created sectional information into the storage area (RAM) of the personal computer terminal PC and outputs it to the information compressing module P4 shown in
Automatic Creation of Music Data (Automatic Composing Processing):
In a system practiced as one embodiment of the invention, the terminal system TS or personal computer terminal PC can automatically create music data. This allows automatic composing capabilities to be realized as described in other processing in its own TS terminal (
In the method, shown in
According to the automatic creation processing of music data, a pair of melody creating data and chord progress data is selected (for example at random) from the plural kinds of melody creating data and chord progress data for the feeling selected by the user. On the basis of these data, and according to user preferences, music data are so modified that a melody is automatically created. The process to automatically create a piece of music such as a melody is disclosed in detail in a patent application (Japanese patent application No. 11-019625) filed by the same applicant as that of this application, so the following gives only an outline of the process.
Expressions of feelings of music can include “fresh,” “soft,” “lonely,” “sexy,” and so on. Each feeling corresponds to plural kinds of melody creating data and chord progress data. From among the plural kinds of these data corresponding to the feeling selected, a piece of melody creating data and a piece of chord progress data are selected at random, respectively. It should be noted that a specific pair of melody creating data and chord progress data may correspond to each feeling. The melody creating data consist of rhythm creating data and pitch creating data. The rhythm creating data include data pieces indicative of the number of notes (high, moderate, low in number), types of time, the presence of syncopation, the number of bars and a period configuration. The pitch creating data include data pieces indicative of an absolute range of audio frequencies, and pitch variations at a predetermined interval. The chord progress data store therein data indicative of the progression of chords for a piece of music (for example, for 32 bars).
Upon automatic creation of music, melody creating data and chord progress data are read out in the first step CC1 of the processing flow shown in
When there are two or more rhythm patterns adapted to the rhythm creating data, any one can be selected at random, or a rhythm pattern may be selected in consideration of the above-mentioned feelings or genres specified separately. Further, the motif rhythm data are not necessarily created automatically. For example, the user may directly enter rhythm data on the operator section 12, or edit the rhythm data automatically created. Alternatively, as discussed above, a note sequence extracted from a voice input from the microphone or a voice input during talking may be used as rhythm data.
Then, in step CC3, significant striking points are detected from all the striking points of the rhythm data created. The term “significant striking point” means musically important striking points in all striking points of a melody. As an example, on-beats, that is, the first and third beats in each bar, or striking points near the first and third beats are detected as significant striking points. The other striking points are detected as insignificant striking points. However, the significant striking points are not limited to the on-beats or the neighborhood striking points, and they may be detected according to other conditions.
On the other hand, in step CC4, skeletal tones of the motif composed of a few bars are created on the basis of the melody creating data and chord progress data. Then, skeletal tones for a piece of music are created by referring to the skeletal tones of the motif and the music configuration data. The skeletal tones of the motif are selected at random as being chord component tones having pitches that meet requirements for the above-mentioned range of audio frequencies and pitch variations. However, this selection is not necessarily carried out at random; it may follow a predetermined rule.
In step CC5, the skeletal tones created in step CC4 are assigned to the significant striking points detected in step CC3. Then, in step CC6, a pitch is assigned to the insignificant striking point between the significant striking points. To be more specific, a pitch on a scale of available notes for a corresponding chord tone is assigned at random to the insignificant striking point. However, this assignment is not necessarily carried out at random; it may follow a predetermined rule. Upon formation of the skeletal tones for a piece of music and the pitch of the insignificant striking point, period marks are reflected in the same manner as in the process of the above-mentioned rhythm creation. In other words, periods bearing the same mark are made identical in pitch to corresponding periods, while periods with similar marks are made identical in pitch in part (for example, in the fist half) to corresponding periods. selected by the user on the operator section 12, or made correspondent to a music style selected at random are read out and modified on the basis of the chord progress data so that pitch data included in the accompaniment data match the chord progress data. The above-mentioned operations are repeated for a piece of music (for example, for 32 bars) to crate the accompaniment parts. Expressions of musical styles include “urbane,” “rural,” “tropical,” “danceable,” and so on (see the right column in
Chord Detection and Accompaniment Part Assignment:
In one embodiment of the invention, as described as one of automatic composing capabilities (
In the chord detection processing of
In step CD2, a harmony tone is detected in each melody section divided. The detection of the harmony tone is carried out by analyzing the arrangement and order of the melody data to detect a tone that is considered to be a harmony tone in each section. Then, in step CD3, the melody is analyzed to detect a key. For example, matching is made between the number of appearances of each tone name in the melody (which may be simply the number of tone names, or the value of each tone name plus its tone length) and a scale tone of each key. As a result, a key the matching degree of which is the highest is detected as the key of the melody.
Then, in step CD4, on the basis of the detected harmony tone and the detected key, matching is made with chords or the progression of chords for every two or more consecutive sections of the melody, or for every section. To be more specific, the progression of chords typically found in consecutive sections (for example, four, three or two sections) is stored for each key in a database. Then, the harmony tones detected in the consecutive sections are compared with component tones in the progression of chords in the detected key. At first, the chords in progress over four sections are compared with the harmony tones in the four sections. If a chord matches a harmony tone, the matching is decided. If there is no cord matched, the number of sections is reduced to three sections, and chords in progress over three sections are compared with harmony tones in the three sections. If there is no chord matched in the three sections, matching is made for two sections. If no chord matched yet, individual harmony component tones are compared with chords in a section, a chord the matching degree of which is the highest is decided.
In step CD5, as a result of the matching processing, a progression of chords or a chord the matching degree of which is the highest is decided to be the cord in the section or sections concerned, and then, the chord detection processing is ended. Each key, however, does not always have the progression of chords. If only a specific key has the progression of chords, tone names of component tones in the progression of chords may be shifted according to keynotes of the key so that the progression of chords will be held substantially in the whole key.
In the accompaniment assigning processing of
In the accompaniment assigning processing, the user selects any one of a number of accompaniment data stored. Each piece of accompaniment style data bears a corresponding term (for example, a term indicative of a musical genre such as pop or classical music, or an atmosphere such as “bright” or “dark”). A list of these terms are displayed on the display 13 of the portable terminal apparatus TS so that any term can be selected on the operator section 12 to select corresponding accompaniment style data. Alternatively, a number assigned to each accompaniment style data may be selected by use of numerical switches on the operator section 12.
In step CE2, the selected accompaniment style data are read out from the database. In the following step CE3, a progression of chords is acquired. Further, in step CE4, the pitch of performance data included in the accompaniment style data read out is modified according to the progression of chords acquired in step CE3 to create performance data for the accompaniment parts. The pitch of the performance data is modified by use of a pitch conversion table provided for each type of chord. The pitch conversion table is a table that defines how much the pitch of the performance data should be modified according to the type of chord. The pitch of the performance data is shifted by an amount of modification defined in the table so that a pitch matching the specified type of chord can be obtained.
Then, in step CE5, the performance data for the accompaniment parts created in step CE4 are assigned to the melody data to create a melody composed of two or more parts. After that, the accompaniment assigning processing is ended.
The accompaniment style data may be composed of two or more sections so that the progression of sections can be specified. For example, the sections for the accompaniment data can include an introductory section, a main section, a fill-in section, and an ending section. The arrangement and order of the sections, or the number of repetitions the main section is reproduced can be specified by the user according to the progression of the melody data. Alternatively, section progress data in which the arrangement and order of the sections or the number of repetitions the main section is reproduced are programmed may be prestored. In this case, the section progress data are read out along the progression of the melody data to specify the progression of sections. Thus, performance of accompaniment parts rich in variation can be obtained.
[Various other Embodiments]
The format of the music tone information usable on the portable terminal apparatus is not limited to own model format A. For example, the sounding controller as shown in
In the above-mentioned embodiments, FM is used for the tone synthesizing in the tone generator. It will be apparent that the tone synthesizing is not limited to FM. For example, any of wavetable, physical model, harmonics synthesis, formant synthesis, and “VCO+VCF+VGA” analog synthesis are also applicable. Namely, various types of information associated with timbres recorded as configuration information depend on the tone synthesizing scheme used in the tone generator. Basically, however, various types of parameter information corresponding to the tone synthesizing schemes conventionally used in electronic musical instruments may be employed.
The tone generator itself may be constituted by not only dedicated hardware but also “DSP+microprogram” or “CPU+software” combination.
Further, plural sounding channels may be formed by using one circuit in a time-division manner or one channel may form one circuit.
As mentioned above and according to the invention, a portable terminal apparatus capable of sounding tones has a sounding control apparatus that is given a timbre to be set on the basis of timbre-associated configuration information to generate a tone signal corresponding to performance information and impart an effect to be set on the basis of effect-associated configuration information to the generated tone signal. Consequently, two or more tones can be sounded at a time by use of an FM tone generator for example, providing rich and various ringing melodies, BGM during talking,. and music at any time desired.
Control means (CPU), which operates independently of the portable terminal apparatus, is used to generate a tone signal having a predetermined timbre and imparted with a predetermined effect. Consequently, tone signal generation processing can be executed with relatively high degree of freedom without being restricted by the control of the portable terminal apparatus main.
A tone signal imparted with a predetermined timbre and/or effect corresponding to configuration information included in music tone information is generated on the basis of the music tone information and, at the same time, an audio signal and a video signal are generated on the basis of audio information and video information. Consequently, the user can enjoy the reproduced tone in various modes supported by the audio and video signals. In addition, according to the storage size of the storage means used, tone signals are generated by use of music tone information described in a format which is downsized as compared with a general-purpose music tone information format. Consequently, quality tones can be reproduced within the maximum allowable range of the data processing and storage capacities of the portable terminal apparatus without weighing upon the memory of the apparatus.
A music tone information service system is formed by portable terminal apparatus and the base station (server) having a music tone information source. According to the selection information sent from any of the portable terminal apparatus, the base station selects corresponding music tone information from the music tone information source. The base station imparts configuration information indicative of a timbre and/or an effect to be imparted to a tone which is sounded in the portable terminal apparatus. On the basis of the music tone information imparted with the configuration information, the portable terminal apparatus generates a tone signal imparted with the predetermined timbre and/or effect. Consequently, rich and various tones can be provided by effective use of the server database. In addition, this system charging processing is executed to the portable terminal apparatus that sent the selection information, thereby providing appropriate services to the users of particular portable terminal apparatus.
Music tone information is shared by a music tone information processing apparatus based on a personal computer or an intelligent electronic musical instrument. Music tone information of a desired format is created or edited in the music tone information processing apparatus to compress the created or edited music tone information into a size suitable for the portable terminal apparatus. Therefore, the novel constitution facilitates the setting, editing, and creation of timbres and effect of the music tone information suitable for the capacity of the portable terminal apparatus.
Music tone information stored in music tone information sources such as external recording media and telephone terminals is captured in the portable terminal apparatus for editing. Consequently, music tone information of various forms can be processed into the music tone information suitable for the capacity of the portable terminal apparatus or user preferences.
Further, as described and according to the invention, performance information and words information corresponding to the progression of performance are stored beforehand. Tone signals are sequentially generated on the basis of the stored performance information. Words indicative signals corresponding to the generated tone signals are generated on the basis of the words information. Consequently, portable terminal apparatuses such as a portable telephone can provide a karaoke capability. The user can not only sing to the portable telephone functioning as a karaoke machine but also remember karaoke song words by displaying them on the portable telephone for singing practice if desired. In addition, the first performance information, the second performance information, and the words information corresponding to the second performance information may be stored beforehand. On the basis of the second performance information, a second tone signal is generated and, on the basis of the words information, a words indicative signal corresponding to the second tone signal is generated for karaoke reproduction. A first tone signal based on the first performance information is generated before karaoke reproduction. Consequently, karaoke reproduction may be automatically switched to ringing melody reproduction based on the first tone signal and without making the display of the karaoke song words intervene this automatic switching.
As described above, according to the invention associated with changing a tempo, the potable terminal apparatus allows the user to specify a tempo on the operator section of the portable terminal apparatus (main unit) by use of at least one of parameters associated with changing a tempo. The parameters include an absolute value of the tempo, a word indicative of the tempo, a rate of change from a reference tempo, and an intuitive word. Thus, the user can control the performance tempo of sounding music such as a ringing melody or BGM.
Still further, according to the invention associated with automatic composition, the portable terminal apparatus can selectively set an atmosphere of music to automatically create music information, or it allows the user to input part of music data so as to automatically create music information for a piece of music from the partial data.
According to the invention associated with pitch detection, when a pitch sequence is extracted from an input tone to crate music information, the portable terminal apparatus can arbitrarily select either a tone input from a microphone or a tone input during talking, or transpose the detected pitch sequence as required.
According to the invention associated with chord detection, the portable terminal apparatus can automatically create performance information associated with the chord fitting the music information.
According to the invention associated with style reproduction, the portable terminal apparatus can store plural kinds of style information and performance information and join them to reproduce a piece of music.
According to the invention associated with format conversion, the music tone information service system and the base station can convert at the base station (server) music information for other models or general-purpose music information incompatible with the first format into music information of the first format for its own model. Also, upon transmission of information associated with the terminal (identification information) from the terminal to the base station server, format conversion can be performed at the server on the basis of the information concerned. Further, the portable terminal apparatus can perform format conversion in its own terminal apparatus from music information for other models or general-purpose music information incompatible with the first format into music information of the first format for its own model.
According to the invention associated with trial listening, the music tone information service system and the base station can perform streaming transmission of information from the server to realize real-time trial listening on the portable terminal apparatus side.
According to the invention, the portable terminal apparatus is capable of mounting a detachable small-size recording medium; it can take in music information from the recording medium into the terminal system, or write music information from various information sources into the recording medium.
| Number | Date | Country | Kind |
|---|---|---|---|
| 11-214083 | Jul 1999 | JP | national |
| 11-310750 | Nov 1999 | JP | national |
| 11-314396 | Nov 1999 | JP | national |
| 2000-179962 | Jun 2000 | JP | national |
This application is a division of application Ser. No. 09/626,304, filed on Jul. 26, 2000 now U.S. Pat. No. 6,911,592.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5563359 | Okamura | Oct 1996 | A |
| 5768127 | Murata | Jun 1998 | A |
| 5808224 | Kato | Sep 1998 | A |
| 5831192 | Watari et al. | Nov 1998 | A |
| 5892171 | Ide | Apr 1999 | A |
| 5914941 | Janky | Jun 1999 | A |
| 6018654 | Valentine et al. | Jan 2000 | A |
| 6025553 | Lee | Feb 2000 | A |
| 6034314 | Koike | Mar 2000 | A |
| 6083009 | Kim et al. | Jul 2000 | A |
| 6094587 | Armanto et al. | Jul 2000 | A |
| 6167253 | Farris et al. | Dec 2000 | A |
| 6184454 | Imai et al. | Feb 2001 | B1 |
| 6236832 | Ito | May 2001 | B1 |
| 6272575 | Rajchel | Aug 2001 | B1 |
| 6308086 | Yoshino | Oct 2001 | B1 |
| 6366791 | Lin et al. | Apr 2002 | B1 |
| 6501967 | Makela et al. | Dec 2002 | B1 |
| Number | Date | Country |
|---|---|---|
| 0 675 666 | Oct 1995 | EP |
| 0 806 758 | Nov 1997 | EP |
| 57188150 | Nov 1982 | JP |
| 04-3353 | Feb 1992 | JP |
| 4168493 | Jun 1992 | JP |
| 5232948 | Sep 1993 | JP |
| A 7-016481 | Mar 1995 | JP |
| 10124046 | May 1998 | JP |
| 10271245 | Sep 1998 | JP |
| 11-112615 | Apr 1999 | JP |
| 11103332 | Apr 1999 | JP |
| 11-164058 | Jun 1999 | JP |
| 11164058 | Jun 1999 | JP |
| A 11-164058 | Jun 1999 | JP |
| 11225189 | Aug 1999 | JP |
| A 11-242490 | Sep 1999 | JP |
| A 11-252651 | Sep 1999 | JP |
| 2000-81881 | Mar 2000 | JP |
| WO 0116931 | Mar 2001 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20040007120 A1 | Jan 2004 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 09626304 | Jul 2000 | US |
| Child | 10410796 | US |
