Patent Grant
7080016
The present disclosure relates to the subject matter contained in Japanese Patent Application No. 2001-303026 filed on Sep. 28, 2001, which is incorporated here by reference in its entirely.
The present invention relates to a technical field of a reproduction device for reproducing audio information from a recording medium containing audio information corresponding to a musical piece. More particularly, the invention relates to an audio information reproduction device which enables a called disk jockey to successively reproduce musical pieces from a plurality of recording media.
Recently, in a place or facility, called a club, a music editor, called a disk jockey, selects and reproduces dance musical pieces, people enjoy dancing to those edited musical pieces. Usually, many musical pieces reproduced for dance music have each a length of several minutes. The disk jockey skillfully connects a plurality of musical pieces in an uninterrupted fashion, and reproduces them. Accordingly, people can enjoy dancing while being little aware of the connections of musical pieces.
To uninterruptedly reproduce a plurality of musical pieces, when the reproducing operation of one musical piece ends, the reproduced sound volume is gradually decreased, while at the same time the reproducing operation of the next musical piece is started and the sound volume is gradually increased. In this way, two pieces of music are connected uninterruptedly. In a case where the audio recording medium of the disk type is utilized, at least two disk players are prepared, and a musical piece is first reproduced from one sheet of music disk. When the reproducing operation of the musical piece draws to an end, the disk jockey operates the other disk player and starts the reproducing operation of another musical piece from another music disk. If the two musical pieces to be connected are not harmonious in rhythm, the listener feels clumsy at the connection of the two musical pieces.
In connection with this, there is known an audio information reproduction device which detects BPMs (beat per minute; corresponds to a speed of a music) from the audio data of the two musical pieces, and controls a reproducing rate of the disk player so that those BPMs are equal to each other. A method of detecting the BPMs from the audio data of the musical pieces is disclosed in the Unexamined Japanese Patent Application Publication No. Hei 8-201542, for example.
Even in a case where the BPMs are detected and the rates of reproducing the two musical pieces to be connected are made to be equal to each other, if the beat of one musical piece is shifted in position from that of the other musical piece, the listener feels something unnatural again.
Accordingly, an object of the present invention is to provide an audio information reproduction device which when a disk jockey, for example, connects two musical pieces and uninterruptedly reproduces them, it can reproduce the musical pieces in a state that those musical pieces are coincident with each other in reproducing rates and beat positions.
According to one aspect of the present invention, there is provided an audio information reproduction device comprising: reading member for reading audio information constituting a musical piece from a recording medium; beat detecting member for detecting a beat position in the musical piece on the basis of the audio information; and reproducing member for reproducing the audio information in accordance with the detected beat position.
According to a similar aspect of the invention, there is provided a computer program causing a computer to operate as an audio information reproduction device which includes reading member for reading audio information constituting a musical piece from a recording medium, beat detecting member for detecting a beat position in the musical piece on the basis of the audio information, and reproducing member for reproducing the audio information in accordance with the detected beat position.
In the audio information reproduction device, audio information is read out from a recording medium, such as an optical disk, which contains music pieces recorded thereon as audio information. The audio information as read out is appropriately processed to detect positions of beats in the music piece. The audio information is reproduced based on the detected beat positions, whereby the music piece is reproduced from the recording medium.
The beat indicates a strength of the sound which repeatedly appears in each music piece. Therefore, when the audio information is reproduced based on the detected beat positions, the music piece is reproduced at correct beats while giving no unnatural feeling to the listener.
In one preferred embodiment of the audio information reproduction device, the reproduction device further includes tempo detecting member for detecting a speed value of the musical piece in accordance with audio information. In the audio information reproduction device, the beat detecting member detects the beat position by using the speed value.
In the embodiment, a speed value of the music piece is detected from the audio information read out from the recording medium. The speed value may be a BPM (beat per minute) value indicating the number of beats per unit time (minute), and indicates a speed or tempo of music. In the musical piece, beats appear at fixed time intervals, which depend on a tempo of the musical piece. Therefore, if the beat positions are detected based on the detected speed value, the beat positions can be detected accurately.
In another embodiment, the beat detecting member includes level detecting member for detecting peak levels of the audio information, and judging member for judging if the peak level corresponds to a beat.
In the embodiment, levels of audio information as read out from the recording medium are detected and the peaks of those levels are detected. A plurality of peaks are detected on the basis of the strength of a musical sound in a musical piece. Judgement is made as to whether or not the detected peaks correspond to beats. The beat corresponds to the strength of a sound in the musical sound, particularly a strong part of the sound. Therefore, the beat may correctly be detected by selectively judging the plurality of detected peaks.
In yet another embodiment of the audio information reproduction device, the judging member includes first judging member for judging as to if a peak being evaluated of the audio information satisfies a first condition that a time interval between the peak being evaluated and a peak preceding the peak being evaluated is integer time as long as a beat-to-beat time interval determined on the basis of the speed value, second judging member for judging as to if the peak being evaluated satisfies a second condition that a time interval between the peak being evaluated and a peak which is located preceding the peak being evaluated and is judged to be a beat, is integer time as long as a beat-to-beat time interval determined on the basis of the speed value, and member for judging the peak being evaluated to be a beat if the peak being evaluated satisfies the first and second conditions.
In the embodiment, judgement is made as to if a plurality of peaks detected from the audio information are beats, on the basis of two conditions. The first condition is that a time interval between the peak being evaluated and a peak preceding the peak being evaluated is integer time as long as a beat-to-beat time interval determined on the basis of the speed value. The second condition is that a time interval between the peak being evaluated and a peak which is located preceding the peak being evaluated and is judged to be a beat, is integer time as long as a beat-to-beat time interval determined on the basis of the speed value.
Beats in a musical piece repeatedly appear at fixed periods in accordance with the tempo of the musical piece. Theoretically, the beats must appear at a time interval integer time as long as a beat-to-beat time which is determined on the basis of the speed value, e.g., BPM. The beat-to-beat time is a time distance between one beat and the subsequent beat, and takes one value determined by the speed value. Therefore, a peak corresponding to a beat must appear at a position on the time axis after a time integer time as long as the beat-to-beat time elapses from a peak corresponding to a beat preceding the former. The second condition checks this presumption, and only the peaks which satisfy the second condition are beat candidates.
The beat judgement based on only the second condition leads to the following misjudgement: When the peak which is judged to be corresponding to the preceding beat actually does not correspond to the beat in the musical piece (viz., it is misjudged to be the beat), the subsequent beats will be misjudged at the period of the misjudged beats. When the peaks recurring at a period of time are misjudged to be beats, peaks corresponding to actual beats must appear at time positions located out of the period of those peaks. If only the peaks defined such that the time interval between successively appearing peaks is integer time as long as the beat-to-beat time are determined to be the beats, then correct beats will be detected on the basis of the peaks appearing at the positions of the correct beats.
Thus, if only the peaks which satisfy both the first and second conditions are judged to be beats, an exact beat detection is performed.
In an additional audio information reproduction device, aid judging member further includes decision member operating such that when a time interval between the peak being evaluated and a peak which is located preceding the peak being evaluated and is judged to be a beat, is longer than a time interval corresponding to a predetermined number of times as long as the beat-to-beat time interval determined on the basis of the speed value, the decision member decides that a beat is present at a position on a time axis spaced from the peak located preceding the peak being evaluated by a distance corresponding to the predetermined number of times as long as the beat-to-beat time interval.
In the embodiment, when such a peak as being evaluated as a beat does not appear for a predetermined time or longer, the subsequent beat detection does not work well. To avoid this, the beats are forcibly determined. In this case, even if the beat that is forcibly determined is not correct, correct beat detection will be performed since the beat detection is made taking the first condition into account. Thus, the beat detection process will smoothly proceed when the beat is forcibly determined.
In a further embodiment, the judging member further includes member which judges a peak that the level detecting member first detects after the reading of the audio information corresponding to one piece of music starts, to be a beat.
In this embodiment, the judgement of the condition 2 cannot be made unless the peak that was judged as the beat is present. For this reason, the peak first detected in the musical piece is forcibly judged as a beat, and the subsequent beat detection is made smooth. Even if the beat that is forcibly judged is not correct, the judgement involving the condition 1 is made, and hence correct beats will be detected with proceeding with the subsequent beat detection.
Another embodiment of the audio information reproduction device further comprises member for interpolating the detected beat position on the basis of the speed value and a beat position detected by the beat detecting member.
Of those detected beats, scarce beats are replenished with the interpolation. The beats detection is based on the peaks of the audio information levels. Even in a case where the peak corresponds to the beat position, if the audio information level is low, it is not detected as a beat. Accordingly, all the beats in the musical piece are not always detected. To cope with this, necessary interpolation is carried out on the basis of the detected beats, periodical beat positions are set by the interpolation, and the musical piece is reproduced in accordance with the resultant.
In a still another embodiment, the audio information reproduction device further comprises member for predicting a beat position on the basis of the speed value and a beat position detected by the beat detecting member.
In the embodiment, in the reproduction device of the type in which the musical piece is reproduced prior to the beat detecting process. Future beat positions are predicted on the basis of the already detected beat positions, and the musical piece is reproduced on the basis of the predicted beat positions.
In a further embodiment of the invention, the level detecting member includes member for dividing the audio information into plural pieces of information of a plurality of frequency bands, and member for detecting the peak by adding together the audio information of the frequency bands which are close to each other in time space.
The audio information is divided into plural pieces of information of a plurality of frequency bands. The levels of the information of those frequency bands are added together to detect peaks of the audio information. Therefore, where noise is contained in the audio information read out of the recording medium, noise influence is lessened and exact peak detection is secured.
In another embodiment, the level detecting member further includes member for setting a peak at a position on a time axis after a predetermined time elapses from a position of the peak lastly detected when the peak is not detected for a predetermined time or longer.
In the embodiment, when the peak is not detected from the audio information for a long time, the peak is forcibly set. In some musical piece, even at the position of the beat, the audio information level is low. A peak as a candidate for a beat is set forcibly to some extent, the beat judgement is made, and smooth execution of the beat detecting process is secured.
According to another aspect of the invention, there is provided an audio information reproduction system comprising: first and second audio information reproduction devices constructed described above; and control member for controlling the first and second audio information reproduction devices so that the speed values and beat positions of first reproduced audio information output from the first audio information reproduction device are coincident with those of second reproduced audio information output from the second audio information reproduction device.
In the audio information reproduction system, the reproducing operations of musical pieces from two audio information reproduction devices are performed in synchronism with each other. The process of synchronizing the two audio information reproduction devices is carried out such that the speed value and the beat position of the audio information reproduced from one audio information reproduction device are coincident in value and position with those of the audio information reproduced from the other audio information reproduction device. With the synchronizing reproducing operations, when a disk jockey or the like changes from one or first musical piece to another or second musical piece, the first musical piece is switched to the second musical piece in a state that the tempo and beat position of the first musical piece are coincident with those of the second musical piece. There is less chance that the listener has the unnatural feeling.
In a preferred embodiment of the audio information reproduction system, the control member includes member for controlling the second audio information reproduction device so that a tempo value of the second reproduced audio information is coincident with that of the first reproduced audio information, and member for controlling the second audio information reproduction device so that a beat position of the second reproduced audio information is coincident with that of the first reproduced audio information in a state that a tempo value of the first reproduced audio information is coincident with that of the second reproduced audio information.
In the embodiment, in reproduced audio information from the two audio information reproduction devices, the reproducing rates of the devices are controlled so that the speed values such as BPM values are equal to each other, and the reproduction positions of the audio information reproduction devices are controlled so that in a state that the reproducing speeds are equal to each other, the beat positions are also coincident with each other.
In a further embodiment of the audio information reproduction system, the first audio information reproduction device includes first top beat detecting member for detecting a position of a top beat in the first reproduced audio information, the second audio information reproduction device includes second top beat detecting member for detecting a position of a top beat in the second reproduced audio information, and the control member controls the second audio information reproduction device so that the top beat of the second reproduced audio information is coincident in position with that of the first reproduced audio information.
In this embodiment, the top beat is detected from each audio information. Here, the top beat is a downbeat located at the top of a bar partially constituting a musical piece. Therefore, if the audio information reproduction devices are operated for reproducing so that the top beats of the audio information reproduced from the two audio information reproduction devices are coincident in position with each other, the reproduction positions of the two musical pieces may be made coincident with each other every bar. And the listener is given no unnatural feeling.
In an additional embodiment of the audio information reproduction device, the first and second top beat detecting member detect each the timing at which an operator operates an input device as the position of the top beat.
In the embodiment, the operator listens to the reproduced musical piece and manually inputs the top beat position to the device. Therefore, the beat position may easily be detected with a simple construction.
In a further embodiment of the invention, the first and second top beat detecting member detect a position of each top beat on the basis of time management information stored for each musical piece on the recording medium.
In the embodiment, each position of the top beat is automatically detected on the basis of time management information stored for each musical piece on the recording medium. In the case of the disk type recording medium, such as a CD, information (time code, address, etc.) representing a time elapsing from the top of a musical piece stored is stored in the recording medium for each musical piece recorded. Usually, it infrequently happens that the tempo (i.e., BPM value) varies in one musical piece. Therefore, a time corresponding to a bar of the musical piece may be calculated by using the BPM value. For this reason, the position of the top of the bar in the musical piece may be detected by referring to the time management information.
According to a further aspect of the present invention, there is provided an audio information reproduction device comprising: reading member for reading audio information constituting a musical piece from a recording medium; tempo detecting member for detecting a speed value in the musical piece on the basis of the audio information; beat detecting member for detecting a position of a beat in the musical piece from audio information by using the speed value; top beat detecting member for detecting a position of a top beat in the reproduced audio information; and reproducing member for reproducing the audio information in accordance with the speed value, the beat position, and the top beat position.
In the audio information reproduction device thus constructed, audio information corresponding to a musical piece is read out from a recording medium. A speed value and a beat position of the musical piece are detected from the readout information, and a position of the top beat in the audio information is detected. The reproducing member reproduces the audio information on the basis of the speed value, beat position and the top beat position. As a result, the musical piece is reproduced at the correct tempo and time.
In an embodiment of the audio information reproduction system, the top beat detecting member detects the position of the top beat on the basis of time management information stored for each musical piece on the recording medium.
In the embodiment, the top beat of each musical piece is automatically detected on the basis of time management information stored for each musical piece on the recording medium. In the case of the disk type recording medium, such as a CD, information (time code, address, etc.) representing a time elapsing from the top beat of a musical piece stored is stored in the recording medium. Usually, it in frequently happens that the tempo (i.e., BPM value) varies in one musical piece. Therefore, the top, or top beat, of a bar in the musical piece may be detected by referring to the time management information.
[Prerequisite Knowledge]
Before proceeding with detailed description of the embodiments, a concept of the beat will briefly be described.
A beat is a basic unit in a time continuity of music, and indicates a strength of a musical sound which repeatedly appears in each musical piece. The beat consists of a downbeat and an upbeat, and a combination of those downbeats and upbeats forms each bar of a musical piece. In a duple time, one bar consists of a downbeat and an upbeat. In a triple time, one bar consists of a downbeat, an upbeat and an upbeat. In a quadruple time, one bar consists of a downbeat, an upbeat, medium beat, and upbeat. In the specification, the downbeat located at the top of one bar, viz., at the first position of one bar, is called “top beat”.
[Audio Information Reproduction Device]
The preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the embodiments to be described hereunder, the present invention is applied to an audio information reproduction device which is used for playing musical pieces in the club, and includes a mixer for generating musical pieces to be played by mixing musical pieces output from a plurality of players.
An overall arrangement of the audio information reproduction device and operation of it will first be described with reference to
As shown in
Actually, the mixer 1 and the players 2 and 3 are integrally installed in an audio rack or the like.
Arrangements and operations of the respective portions of the embodiment will be described.
To start, each of the players 2 and 3 reproduces an optical disk, generates a musical piece signal containing a plurality of musical pieces, and outputs the resultant signal to the mixer 1. The mixer 1 mixes the generated musical piece signals through the operation of the disk jockey, to thereby generate a mixer signal Smx, and outputs the resultant signal to the amplifier 4.
The amplifier 4 amplifies each musical piece information contained in the mixer signal Smx, and generates a left signal Sol containing audio information (including both sound information by musical instruments and the like and voice information by singing and the like: The same shall apply hereinafter.) to be included in a left channel and a right signal Sor containing audio information to be included in a right channel. Then, the amplifier 4 outputs the left signal Sol and the right signal Sor to the speaker 5 for the left channel and the speaker 6 for the right channel, respectively. With this, the speakers 5 and 6 output the audio information as sounds, which are correspondingly contained in the left signal Sol and the right signal Sor.
The detailed arrangement including the mixer 1 and the players 2 and 3, which is constructed according to the invention will be described with reference to
The player 2 reproduces an optical disk DA on which musical pieces to be reproduced are stored as digital audio information. As shown in
The player 3 reproduces an optical disk DB on which musical pieces to be reproduced are stored. The player 3 has a configuration similar to that of the player 2. Specifically, the player 3 includes a pickup 20, decoder 21, DSP 22, memory 23, D/A converter 24, sub CPU 25 and a VCO 26.
The mixer 1 includes a CPU 30, operation part 31, display part 32 and an adder 33.
Operations of the respective portions of the embodiment will be described. In the description to follow, the players 2 and 3 operate in a similar manner, and hence, the operation of one of the players will typically be described.
In a case where the player 2 (3) reproduces a dance musical piece from the optical disk DA (DB) on which the musical piece is stored, the pickup 10 (20) first drives a light source (not shown) formed with a semiconductor laser or the like to thereby emit a light beam B1 (B2) for reproducing. The pickup receives a reflected light from the optical disk DA (DB), generates a reproducing signal Spa (Spb) as an RF (Radio Frequency) signal which corresponds to the musical piece stored on the optical disk DA (DB), and then outputs the generated signal to the decoder 11 (21).
Upon receipt of the signal, the decoder 11 (21) carries out a waveform shaping process, a decoding process and an amplifying process on the reproducing signal Spa (Spb) as input, then digitizes it to thereby generate a digital decode signal Sda (Sdb), and outputs the resultant signal to the DSP 12 (22).
The generation of the reproducing signal Spa (Spb) in the pickup 10 (20) and the generation of the digital decode signal Sda (Sdb) in the decoder 11 (21) are executed at high speed, e.g., quadruple-speed. The generated digital decode signal Sda (Sdb) is output to the DSP 12 (22) at the quadruple-speed.
The DSP 12 (22) detects a BPM (Beat Per Minute) value of the musical piece to be reproduced, which is contained in the digital decode signal Sda (Sdb) as input, and detects a beat position contained in the musical piece to be reproduced. Then, the DSP 12 (22) outputs a synchronous control signal Sbpa (Sbpb) containing information of the BPM value and the beat position to the sub CPU 15 (25). The DSP 12 (22) caries out various processes to be described later on the digital decode signal Sda (Sdb) in accordance with a control signal Scda (Scdb) to be described later coming from the sub CPU 15 (25), and generates and outputs a musical piece signal Sra (Srb) to the D/A converter 14 (24).
At this time, the DSP 12 (22) temporarily stores data, which is necessary to carry out the process, as a memory signal Smoa (Smob) on to the memory 13 (23), and then executes the process while reading the stored data as a memory signal Smia (Smib) from the memory 13 (23). A series of processes ranging from the process of detecting the reproducing signal Spa (Spb) from the optical disk DA (DB) to the process of storing the memory signal Smoa (Smob) to the memory 13 (23), is executed at high speed, e.g., the quadruple-speed. The process of reading the memory signal Smia (Smib) from the memory 13 (23) and subsequent ones are executed at a normal speed (one time as high as the original speed).
The D/A converter 14 (24) converts the processed musical piece signal Sra (Srb) into an analog signal to thereby generate an analog musical piece signal Saa (Sab), and outputs the generated signal to the adder 33.
At this time, a reading rate of the musical piece signal Sra (Srb) from the DSP 12 (22) and a digital/analog conversion frequency (conversion rate) in the D/A converter 14 (24), are controlled in accordance with rate control signals Sfva and Sfda (Sfvb and Sfdb) coming from the VCO 16 (26). More specifically, even if the inputting rate of the digital decode signal Sda (Sdb) to the DSP 12 (22) corresponds to the quadruple-speed, the inputting rate is treated as the normal speed.
The adder 33 adds the analog musical piece signals Saa and Sab thereby generating the mixer signal Smx as an output of the mixer 1, and outputs the generated signal to the amplifier 4.
In the processes of the above-mentioned portions, the sub CPU 15 (25) operates in accordance with a control signal Sca (Scb) from the CPU 30 and the synchronous control signal Sbpa (Sbpb) from the DSP 12 (22), and transfers and receives a control signal Scc to and from the CPU 30 and the DSP 12 (22). In this state, the sub CPU 15 (25) generates the control signal Scda (Scdb), and outputs the generated signal to the DSP 12 (22).
Concurrent with this, the sub CPU 15 (25) generates a control signal Scva (Scvb) for controlling the operation of the VCO 16 (26) and outputs the generated signal to the VCO 16 (26). To control the output rate of the musical piece signal Sra (Srb) output from the DSP 12 (22) and the digital/analog conversion frequency in the D/A converter 14 (24), as described above, the VCO 16 (26) generates the rate control signals Sfva and Sfda (Sfvb and Sfdb), and outputs the generated signals to the DSP 12 (22) and the D/A converter 14 (24), respectively.
Further, the CPU 30 generates the control signal Sca (Scb), and outputs the generated signal to the sub CPU 15 (25) to cause the sub CPU 15 (25) to execute the reproducing control as mentioned above.
At this time, operation for designating the operations of the mixer 1 and players 2 and 3, is performed by the operation part 31 by way of the CPU 30. Responding to this, an operation signal Sin corresponding to the operation is output to the CPU 30. The CPU 30 executes the control on the basis of the operation signal Sin.
The information (specifically, the detected BPM value and the like) on the operation of the mixer 1 and the players 2 and 3, which are controlled by the CPU 30, is output as a display signal Sdp from the CPU 30, and is displayed on the display part 32 for a disk jockey and the like.
[DSP Configuration and Operation]
The DSPs 12 and 22 will be described. The configuration of the DSP 12 is the same as that of the DSP 22, and hence the DSP 12 will typically be described.
The digital decode signal Sda output from the decoder 11, is input to the reproduction control part 36. The digital decode signal Sda is read out at the quadruple-speed, and is supplied as the memory signal Smoa to the memory 13 by the reproduction control part 36. The reproduction control part 36 reads out the audio reproducing signal, which is temporarily stored in the memory 13, as the memory signal Smia at the normal speed, and supplies it as the reproducing signal Sra to the D/A converter 14. In this way, the audio signal is reproduced from the optical disk DA.
The digital decode signal Sda output from the decoder 11 is also input to the level detecting part 35. The level detecting part 35 detects a level of audio data contained in the digital decode signal Sda read out from the optical disk DA, and supplies a level detect signal Sdet to the BPM detecting part 37 and the beat detecting part 38.
In the embodiment, the level detecting part 35 divides the digital decode signal Sda into signals of three frequency bands, i.e., low, medium and high frequency bands, and detects a signal level of each frequency band to thereby generate a level detect signal (digital data value) representing a level of the audio signal contained in the audio signal. And, the level detecting part 35 supplies level detect signals of the frequency bands as the level detect signals Sdet to the BPM detecting part 37 and beat detecting part 38.
The BPM detecting part 37 computes a BPM on the basis of the level detect signals of the frequency bands, adds it to the synchronous control signal Sbpa, and then supplies the resultant signal to the sub CPU 15. To be more specific, as shown in
The beat detecting part 38 detects beat positions in the audio reproducing signal on the basis of the level detect signal Sdet of each frequency band output from the level detecting part 38, adds a signal representing the beat positions to the synchronous control signal Sbpa, and then supplies the resultant signal to the sub CPU 15.
In this way, the DSP 12 generates the reproducing control signal Sbpa containing information of the BPM value and the beat positions of the reproduced audio information on the basis of the digital decode signal Sda output from the decoder 11, and supplies the resultant signal to the sub CPU 15.
On the other hand, the DSP 22 in the player 3 executes a similar process to that of the DSP 12.
And, the DSP 22 supplies the reproducing control signal Sbpb containing information of the BPM value and the beat positions of the reproduced audio information to the sub CPU 25, on the basis of the digital decode signal Sdb output from the decoder 21.
As will be described later, the CPU 30 causes the two players 2 and 3 to synchronously reproduce the two players 2 and 3 in accordance with the reproducing control signals Sbpa and Sbpb.
[Detection of Beat Position]
A method of detecting a beat position will be described in detail. A beat position is detected on the basis of a level detect signal for each frequency band output from the level detecting part 35. In the embodiment, the level detecting part 35 detects a reproduced audio signal level for each of three frequency bands, i.e., low, medium and high frequency bands.
The beat detection process detects (1) peaks of reproduced audio signal levels of all the frequency bands on the basis of the reproduced audio signal levels of those three frequency bands. (2) The beat detection process judges as to whether or not those detected peaks correspond to the beats in the reproduced audio signal, on the basis of two conditions, and detects the beat positions based on the judgement result.
The peak detection of the reproduced audio signals of all the frequency bands will be described with reference to
As shown in
In the graph of
The added values are computed as shown in
The peaks are thus selected. In the graph shown in FIG.
In this way, the peaks contained in the reproduced audio signal are detected. Those peaks are high level parts in the reproduced audio signal. Accordingly, it may be considered that those peaks are candidates for the beats in the musical piece.
Then, judgement is made as to whether or not those peaks obtained as beat candidates are beats. If a peak satisfies both the following two conditions, the peak is judged to be a beat.
(Condition 1):
A time interval between a peak being evaluated and a peak located preceding the former peak corresponds to integer time (integer=1 to 4) as long as the beat-to-beat time interval computed based on the BPM (containing a predetermined error)
(Condition 2):
A time interval between a peak being evaluated and a beat position (a position of a peak judged to be a beat) located preceding the former peak corresponds to integer time as long as the beat-to-beat time interval computed based on the BPM (containing a predetermined error).
With regard to the condition 2, if a peak already judged to be a beat is present, the next beat position may be predicted, to some extent, on the basis of the BPM. Accordingly, a peak which is present at a position at which the next beat will appear is judged as a beat, and its near position.
The condition 1 is for preventing the following disadvantage. If a peak which actually does not correspond to a beat is mistakenly judged to be a beat, the subsequent beat detection will continue while being based on the erroneous beat position and remaining not corrected.
Errors in the conditions 1 and 2 may each be about ± 1/16 of 1 to 4 integer time as long as the beat-to-beat interval.
Next, a beat detection process utilizing the conditions 1 and 2 will be described in detail with reference to
An exemplary judgement on the condition 1 will be described with reference to
If the time interval between the present peak and the preceding peak is integer (1 to 4) times as long as the beat-to-beat time, which is computed from the BPM, its peak is judged to be a beat. In this instance, ± 1/16 of the beat-to-beat time as is computed form the BPM is treated as a tolerable error. As seen from
An exemplary judgement on the condition 2 will be described with reference to
In this instance, ± 1/16 of the beat-to-beat time computed from the BPM is treated as a tolerable error. After the reproduction of the musical piece starts, the peak that first appears is treated as a beat since no beat preceding the first peak is present. As seen from
From the judgement results of the conditions 1 and 2, only peaks satisfying both the conditions are judged to be beats. The results of the judgement are shown in
The peak p1 is forcibly determined to be a beat since it is the peak that is first detected after the music reproduction starts. A case that the determination is erroneous, viz., the peak p1 is not the beat is present, as a matter of course. In the beat detection process of the invention, the final beat detection is based on the condition 1 as well as the condition 2. Accordingly, a correct beat will be detected with time.
Specifically, in the condition 1, only those peaks are detected: a time interval between each of those peaks and a peak preceding the peak is integer times as long as a beat-to-beat time interval determined on the basis of the BPM. If the decision that the peak p1 is a beat is erroneous, a peak corresponding to a position of a correct beat must be detected with proceeding with the beat detection based on the above-mentioned method (The reason for this is that a reproduced audio signal having a definite peak must appear at a correct beat position in the musical piece under reproduction.). Accordingly, after a peak corresponding to such a correct beat position is detected, only a peak located at a position defined by an integer time as long as the beat-to-beat time based on the BPM is judged to be a beat on the basis of the condition 1. As a result, correct beat positions will be detected subsequently. Thus, the beat is detected taking the condition 1 into account. Accordingly, an erroneous judgement, which maybe made if only the condition 2 is used, may be corrected.
Such an erroneous judgement is likely to occur in a musical piece which is relatively quiet at first (a musical piece that starts in low level). In a first part of the musical piece, a reproduced audio signal which is clearly large in level is not detected even at correct beat positions. Accordingly, it happens that by the judgement based on the condition 2, a peak that first appears is forcibly treated as a beat, and actually, the peak position is not the correct beat position. However, if the judgement based on the combination of the conditions 1 and 2 is continued, reproduced data of which the level is clearly large at a correct beat position of the musical piece will appear. Subsequently, correct beat positions will be detected.
In the condition 2, if a time interval between a peak being evaluated and a beat located preceding the judged peak is 4 beats or longer, the peak is forcibly determined to be a beat. The reason for this is that if the beat is not judged for a too long time, the process is instable. To avoid this, the beat is forcibly determined. Even when the determination is not correct, the judgement is also made based on the condition 1, hence, correct beat positions will be detected subsequently.
A flow of the beat detection process will be described with reference to
This process is carried out concurrently with a reading operation of a reproduced audio signal from the optical disk. A reproduced audio signal that is read out of the optical disk at a high speed (e.g., quadruple-speed) is temporarily stored into the memory 13 or 23. Then it is read out of the memory 13 or 23, and reproduced in the form of music at a normal speed. The beat detecting part 38 processes level detect data Sdet, which is successively supplied from the level detecting part 35, in the following manner.
The beat detecting part 38 receives a level detect signal for each frequency band from the level detecting part 35 (step S1). The level detect signal is arranged into a time sequential signal as shown in
Next, the beat detecting part successively executes the judgement of the condition 1 on the peaks successively determined in the step S3, peak by peak (step S4). If the peak being evaluated satisfies the condition 1, the process returns to the step S4, and judges the next peak. If the peak being evaluated does not satisfy the condition 1 (step S4; yes), the process judges as to if the peak satisfies the condition 2 (step S5).
If it satisfies the condition 2, the process decides that the peak is a beat (step S7). If the peak does not satisfy the condition 2 (step S5; No), the process judges if the peak is located at a time position having elapsed by 4 beats or more from the preceding beat (step S6). If the peak has elapsed by 4 beats or more, the process advances to a step S7, and treats it as a beat. If the peak has not elapsed by 4 beats or more, the process returns to the step S4, and judges the next peak.
In this way, beats are detected from the reproduced audio signal readout of the optical disk. A position of the detected beat is incorporated into a reproduction control signals Scda and Scdb, and the resultant is sent to the sub CPUs 15 and 25.
In the embodiment, the reproduced audio signal read out from the optical disk is divided into the signals of three frequency bands, low, medium and high frequency bands. The reproduced audio signal may be divided into signals of two frequency bands or four or more number of frequency bands. Where the number of frequency bands is increased, the audio signal is little influenced by noise having specific frequencies, and hence detection accuracy is frequently increased.
[Synchronous Reproduction of Two Players]
Next description is given about a synchronous reproduction process which causes two players to synchronously operate by utilizing the thus detected beat positions and the BPM value and to play back music.
Firstly, under control of the sub CPU 15, the player 2 starts to read an audio signal from the optical disk DA, and under control of the sub CPU 25 the player 3 starts to read an audio signal from the optical disk DB (step S11).
Then, in the players 2 and 3, the program detects beats from the audio signals by the method as described referring to
The program checks if the next beat is detected in the audio signal to be reproduced in each of the players 2 and 3 (step S13). Specifically, the program judges as to if a beat detection process of the step S12 has detected a beat at a position or its vicinity at which the next beat will arrive, on the basis of the BPM value detected by the BPM detecting part 37 in the DSP 12 or 22.
In the beat detection process, generally, beats are not always detected at all the reproduction positions of a musical piece. Actually, beat positions are periodically present in the musical piece. In a case where a sound volume (level of recorded data) is small at a beat position in an actual musical piece, the beat position is not detected. Accordingly, when the next beat position is not detected by the beat detection process, the scarce beat position is determined, by use of an interpolation, on the basis of the beat positions detected by the beat detection process and the BPM value detected by the BPM detecting part 37 (step S14). Specifically, the beat-to-beat time can be computed from the BPM value. Therefore, the interpolation may be made in a manner that for the detected beat positions, a beat is set at a position or time position on the time axis after the beat-to-beat time has elapsed.
Thus, the beat position is determined, and then a process to synchronizing the players 2 and 3 is executed (step S15). The detail of the synchronizing process is flow charted in
In
The CPU 30 executes a process to determine a reproduction position so that the beat positions of the players 2 and 3 are made coincident with each other. The result of the comparison in the step S21 shows that a difference between the next beat positions in the two players is larger than the BPM/2 (step S22; yes). Then, the sub CPU 25 is controlled so as to lower the reproducing speed of the player 3 (step S23). When the difference between the next beat positions in the two players is smaller than the BPM/2 (step S22; No), the CPU 30 controls the sub CPU 25 so that the reproducing speed of the player 3 is increased (step S24).
In this way, the synchronizing process is completed, and the reproduction positions of the players are determined so that the beat positions of the players 2 and 3 are coincident with each other.
The process returns to the synchronous reproduction process of
The above process is continuously executed after the musical piece reproducing starts. While the players 2 and 3 are reproducing the musical pieces, the process of
The case having been described is that in each player, audio information that is read out from the optical disk is temporarily stored into the memory, the next beat position is detected or determined by the interpolation, and the audio information corresponding to the beat position is read out from the memory and reproduced. In some internal construction of the player, there is a case where before the beat position is determined based on the beat detection or the interpolation, the audio information must be reproduced. In such a case, the synchronous reproduction process of
[Detection of Top Beat and Synchronizing Process]
In the synchronous reproduction process, the BPM and the beat position are detected on the basis of the audio information read out of each optical disk, and the two players are controlled so that the reproducing speeds are made equal to each other based on the BPM, and the beat positions are coincident with each other, and under this condition, the musical pieces are reproduced. Where the reproducing speeds are equal to each other and the beat positions are coincident with each other, an unnatural feeling that the listener has when he listens the reproduced musical pieces is small. More strictly, the position coincidence of the top beat (first beat in each bar) of one musical piece with that of the other musical piece, if possible, is more desirable, since the reproduction positions of the musical pieces to be reproduced from the two players are coincident with each other every bar.
To realize this, it is necessary to specify the top beat of those beats detected in the beat detection process (and beats which are replenished with the interpolation or prediction since those are scarce beats). If the top beat is specified, then what one has to do is to control the reproduction positions of the two players so that the top beats are coincident with each other in the synchronizing process of the step S15. Some methods of detecting the top beat will be described.
One top-beat detecting method is that such an operator as a disk jockey manually inputs the position of the top beat to the audio information reproduction device. Specifically, after the music is reproduced and when the synchronous reproduction process is under execution, the operator, while listening the reproduced music, inputs a position of the top beat to the audio information reproduction device, by use of an operation part 31 of the mixer 1. This may be achieved in a manner that the operator presses a specific button provided on the mixer 1 at the timing of the top beat.
Another top-beat detection method is to extract time management information, such as time code, from each musical piece data, and to specify a position of the top beat position by computation. The time management information counted from the top of each musical piece are recorded in such an optical disk as a CD. The time management information takes various forms, such as time code and address, depending on the type of the recording medium. When the operation of reproducing music starts, the BPM of the music is detected by the DSP. Usually, in one musical piece, the BPM value is not varied. Therefore, at a reproduction position in a musical piece, the current position can be computed using the BPM value. Computation can be made of what number of bars counted from the top of the musical piece is the bar in which the reproduction position is contained, and which of the beats contained in that bar is the beat at which the reproduction position is located. If the musical piece is quadruple time and its BPM is 120, 120 beats appear for 60 seconds. Accordingly, one bar (=four beats) corresponds to 2 seconds. Therefore, the top of one bar, viz., top beat, arrives every time 2 seconds elapse from the top of one musical piece. In this way, the top beat of each bar can be detected from the time management information stored in the optical disk.
If the top beat is thus detected, then the musical piece reproduced from the two players can be synchronized every bar by utilizing the BPM and beat positions detected by the DSP and the top beat positions.
[Modifications]
The audio information reproduction device shown in
In the embodiment mentioned above, the players 2 and 3, which form the audio information reproduction device, are disk players, such as CD players. The dedicated disk players as the players 2 and 3 may be substituted by a personal computer containing a music reproducing software (program).
The function of detecting the beat positions and the function of controlling the reproducing operation of a plurality of musical pieces so that the detected beat positions of the musical pieces are coincident with each other, both of which are based on the invention, may be realized in the form of a software (program). In this case, the musical pieces may be reproduced as in the above-mentioned embodiment which uses the mixer and the players exclusively used, when that program is executed by a personal computer provided with a reproduction drive, such as CD and DVD.
As seen from the foregoing description, the beat positions of a musical piece can be detected from music data recorded in the recording medium, such as an optical disk. Accordingly, the reproducing operations of the musical pieces from two recording media may be synchronized by controlling the two players so that the reproducing speeds of them are equal to each other, and the beat positions are coincident with each other.
| Number | Date | Country | Kind |
|---|---|---|---|
| P 2001-303026 | Sep 2001 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5256832 | Miyake | Oct 1993 | A |
| Number | Date | Country |
|---|---|---|
| 0 944 034 | Sep 1999 | EP |
| 0 977 171 | Feb 2000 | EP |
| 1 073 055 | Jan 2001 | EP |
| 1 073 056 | Jan 2001 | EP |
| 8-201542 | Aug 1996 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20030065517 A1 | Apr 2003 | US |
