This is a U.S. national phase application under 35 U.S.C. §371 of International Patent Application No. PCT/JP2007/062793, filed Jun. 26, 2007, which claims the benefit of Japanese Patent Application No. 2006-182148, filed Jun. 30, 2006. The International Patent Application was published in Japanese on Jan. 3, 2008 as International Publication No. WO 2008/001765 A1 under PCT Article 21(2). The afore-mentioned applications are hereby incorporated by reference in their entirety.
The present invention relates to an apparatus and the like which takes in music reproduction signal of music reproduced by a music reproduction device and judges a genre of the music.
The music reproduction signal outputted from a line-out terminal of a music reproduction device like a portable audio player is an analog signal generated under an assumption of audio conversion by an audio output device such as headphones. No information for judging a genre of music is added to the music reproduction signal. Conventionally, an advanced frequency analyzing processing such as FFT is used as means for analyzing such a music reproduction signal and judging a genre of music. A music genre judging device available for an ordinary user in combination with a music reproduction device is not provided so far. Additionally, a device is provided in a field of game machine, in which audio signal inputted from a microphone is analyzed and the result of analysis is reflected to a figure of a character (for example, please refer to the patent document 1).
[Patent document 1] JP 2001-A-29649
Problems to be Solved by the Invention
Thus, it is an object of the present invention to provide a music genre judging device able to judge a genre of music in a relatively simple structure and a game machine to which the same applied.
Means for Solving Problem
The music genre judging device of the present invention includes a signal input part which takes in music reproduction signal outputted from a music reproduction device; a signal processing part which outputs an integration value and a differential value of a low frequency component and a differential value of a high frequency component of the music reproduction signal taken in by the signal input part; a data generating part which takes in the integration value and the differential values outputted from the signal processing part for each prescribed sampling unit time, judges whether the integration value and the differential value of the low frequency component and the differential value of the high frequency component exceed respective prescribed levels within the sampling unit time, and generates analysis data obtained by totalizing numbers of times of judgment when a value exceeding the respective prescribed level is detected for each prescribed sampling cycle and for each of the integration value and the differential values; and a data analysis part which calculates respective average values of the totalized values, which are described in the analysis data, and respective coefficients of variation of the totalized values, which are described with respect to the differential values of the low frequency component and the high frequency component in the analysis data, and judges a genre of music outputted from the music reproduction device based on the calculation result. Thus, the above problem is solved.
According to the investigation of the inventors of the present invention, the music reproduction signal outputted to the audio output device includes a common or similar feature corresponding to a genre of music, and the feature is correlated with the degree of dispersion of the integration value and the differential value of the low frequency component and that of the differential value of the high frequency component contained in the music reproduction signal. In the music genre judging device of the present invention, the data generating part generates analysis data, which is generated by taking the integration value and the differential values outputted from the signal processing part in the data generating part for each sampling unit time, judging whether the integration value and the differential values exceed respective prescribed levels within the sampling unit time, and totalizing numbers of times of judgment when a value extending the prescribed level for each prescribed sampling cycle and for each of the integration value and the differential values. Then, the data analysis part obtains the respective average values and the respective coefficients of variation of the totalized values described in the analysis data. The obtained average values and coefficients of variation reflect the dispersions of the integration value and the differential value of the low frequency component and that of the differential value of the high frequency component contained in the music reproduction signal for each sampling cycle. Therefore, a genre of music reproduced from the music reproduction signal can be judged by figuring out the feature corresponding to the genre of music from the average values and coefficients of variation thereof. The integration processing and the differentiation processing of the music reproduction signal can be performed with relative ease, and the processing of the integration value and the differential values thereof is also only to judge the magnitude relation between the integration value, the differential values and the prescribed levels for each sampling unit time and to totalize the results of judgments, and can be processed speedily with relative ease. Moreover, the calculation processing of the average values and the coefficients of variation of these integration value and differential values can also be performed with relatively simple calculations by using generally-known relational expressions. Therefore, according to the music genre judging device of the present invention, these processing can be well realized by a consumer good or the like equipped with a small-scale micro processing unit (MPU) with a limited processing performance.
In an aspect of the music genre judging device of the present invention, possible ranges of the average values and the coefficients of variation are segmented into a prescribed number of stages, and each stage is represented by an identification value, and the average values and the coefficients of variation are associated with the identification value in advance in calculation result identification data, and the data analysis part obtains the identification values, which respectively corresponds to the calculated average values and coefficients of variation, with reference to the calculation result identification data, and judges a genre of music based on the obtained identification values. By using the identification value, a genre of music can be judged without complexifying the music genre judging device more than necessary.
In an aspect of the music genre judging device of the present invention, each of judgment values obtained by arranging the identification values, each of which corresponds to the average values and the coefficients of variation, in a prescribed sequence are associated with a genre of music in advance in judgment reference data, and the data analysis part may judge a genre corresponding to the obtained identification value as a genre of music, which should be reproduced from music reproduction signal taken in by the signal input part, with reference to the judgment reference data. According to this aspect, a judgment value is obtained by arranging the identification values, each of which corresponds to the average values and the coefficients of variation obtained by the data analysis part in a prescribed sequence, and the correlation relation between the judgment value and the genre of music is investigated in advance and is described in the judgment reference data. Thus, it can be easily identified which genre the judgment value obtained by analyzing the music reproduction signal taken in from the signal input part represents the feature of.
In an aspect of the music genre judging device of the present invention, it may further include history data, where the genre of music is associated with a number of times when genre is judged by the data analysis part, and the data analysis part may update the history data in accordance with the judgment result of genre. According to this aspect, a user's tendency, for example, what genre of music is frequently reproduced by the music reproduction device can be analyzed by storing the number of times of judgment by the music genre judging device for each genre. Moreover, by using the history data, various processes, manipulations, services, or the like can be provided to a user in accordance with the preference of the user.
The music genre judging device of the present invention can be used in various forms. As one form, the music genre judging device maybe disposed between a line-out terminal of a music reproduction device and an audio output device for audio-converting music reproduction signal outputted from the line-out terminal, and the music genre judging device may include a bypass route which lets the music reproduction signal outputted from the line-out terminal to pass through to the audio output device; and a route which takes the music reproduction signal in the signal processing part. According to this aspect, while letting the music reproduction signal outputted from the line-out terminal of a specific music reproduction device to pass through to an audio output device and thus reproducing music, a genre of the music can be judged.
The present invention may be configured as a game machine having the above-mentioned music genre judging device and a game control part which reflects the judgment result of genre to game content. According to such a game machine, music reproduction signal outputted from the music reproduction device can be taken in, and the genre of the music which should be reproduced from the music reproduction signal can be reflected to game content. Thus, an innovative tool, which fuses music reproduction with a music reproduction device and game together, can be provided.
As described above, according to the present invention, the average values of the integration value and the differential value of the low frequency component and the differential value of the high frequency component and the coefficients of variation of the differential values of the low frequency component and the high frequency component of the music reproduction signal are obtained, and the genre of music is judged based on the identification values associated with these average values and coefficients of variation. Thus, a music genre judging device able to judge a genre of music with a relatively simple structure and a game machine which the same applied to can be realized.
The game machine 1 functions as a repeater which allows the music reproduction signal outputted from the line-in terminal 4 of the music player 100 to pass therethrough to the earphone 103, and concurrently functions as a game machine which analyses the music reproduction signal outputted from the music player 100 and provides a game to a user in accordance with the results of analysis.
The signal processing part 10 includes a pair of low pass filters (LPF) 12A, 12B for allowing only a low frequency component of the music reproduction signal taken in from the line-in terminal 4 to pass through, a high pass filter (HPF) 13A for allowing only a high frequency component of the music reproduction signal to pass through, an integration circuit 14 for integrating the output signal of LPF12A, a differentiation circuit 15 for differentiating the output signal of LPF12B, a differentiation circuit 16 for differentiating the output signal of HPF13A, and A/D converters 17A to 17C for converting the output signal of the circuits 14 to 16 to digital signals and outputting them to the control unit 11. For example, the frequency range where LPF12A, 12B allow to pass through are set equal to or lower than 1000 Hz. For example, the frequency range where HPF13A allows passing through is set equal to or higher than 1000 Hz. Additionally, the set values of the frequency ranges are not limited to those in the above example. For example, the frequency range where LPF12A, 12B allow to pass through may be set equal to or lower than 500 Hz, the frequency range where HPF13A allows to pass through may be set equal to or higher than 1000 Hz. Furthermore, the frequency ranges where LPF12A, 12B allow to pass through may be set equal to each other, or may differ from each other. When both pass-through frequency ranges are equal to each other, a single LPF may be disposed in place of LPF12A, 12B, and the output signal of the single LPF may be branched to the integration circuit 14 and the differentiation circuit 15.
The control unit 11 is configured as a computer unit where a micro processing unit (MPU) is combined with peripheral devices required to the operation of the MPU, for example storage devices such as a RAM and a ROM. The control unit 11 is connected with the above-mentioned LCD3 as a target of control, and also connected with an input device 20 for providing instructions in a game or the like and a speaker unit (SP) 21 for outputting audio, sound effect, and the like. Furthermore, the phone terminal 5 is also connected in the route connecting to the speaker unit 21.
The control unit 11 provides various game functions to a user by executing a process of displaying a game image on LCD3 and the like. As a function added to the game, the control unit 11 has a function of analyzing the output signal of the signal processing part 10 and judging a genre of music.
Next, the process relating to the genre judgment by the game machine 1 will be described with reference to
The data generating part 30 of the control unit 11 takes in the integration value and the differential values for each sampling unit time Tn, and judges whether the integration value and the differential values exceed their prescribed level within the sampling unit time Tn. Then, the data generating part 30 totalizes the number of times of judgment when the value exceeding the prescribed level is detected for each sampling cycle Tm and individually for the integration value and the differential values, and generates analysis data D1. For example, when the integration value of the low frequency component is varied as shown in
The data generating part 30 of the control unit 11 executes the above process individually for the integration value and the differential values, sequentially totalizes the measured number of times for each sampling cycle Tm, and generates analysis data D1 as shown in
The data analysis part 31 of the control unit 11 calculates average values M0 to M2 of the totalized values described in the analysis data D1 for each channel, namely, coefficients of variation CV1, CV2 of the totalized values described in the analysis data D1 for the integration value and the differential value of the low frequency component and the differential value of the high frequency component (cf.
The data analysis part 31 obtains a five-digit numerical value characterizing the waveform of the music reproduction signal as a judgment value by arranging the obtained identification values dM0 to dCV2 in the order of the identification values dM0, dM1, dM2, dCV1, dCV2. For example, when the identification value dM0 is 1, dM1 is 0, dM2 is 0, dCV1 is 0, and dCV is 1, the value 10001 is obtained as the judgment value. 144 ways of judgment values will be obtained in this example. Additionally, the ordered sequence of the identification values dM0 to dM2 and dCV1 , dCV2 for obtaining the judgment value is not limited to that of this embodiment, and may be arbitrarily designated.
Furthermore, the data analysis part 31 judges the genre of music which should be reproduced from the music reproduction signal based on the above-mentioned five-digit judgment value. In this genre judgment, the judgment reference data D3 is referred. As illustrated in
When it is determined at the step S1 that music reproduction signal is inputted, the control unit 11 advances to the step S5, and determines whether a power management timer for measuring a power supply cycle Tp is turned on, namely, it is in measuring time. When it is not on, the control unit 11 turns on the power management timer at the step S6, and advances to the step S7. When the power management timer is on at the step S5, the control unit 11 skips the step S6 and advances to the step S7. At the step S7, the control unit 11 determines whether the measured time T of the power management timer is in a range from the measurement start time point, namely that is equal to or longer than 0 and that is equal t or shorter than the power-on time Tq. When it is not in the range, the control unit 11 advances to the step S8, and determines whether the measured time T is in a range that is longer than the power-on time Tq and that is equal to or shorter than the power supply cycle Tp. When the measured time T is not in the range of the step S8, the control unit 11 advances to the step S9, resets the power management timer to the initial value of 0, and resumes the time measurement operation. Then, the control unit 11 advances to the step S11, instructs the power control circuit 19 to turn on the power supply for the signal processing part 10, and thereafter ends the power managing process routine. When the measured time T is in the range of the step S8, the control unit 11 advances to the step S10, and instructs the power control circuit 19 to turn off the power supply for the signal processing part 10, and thereafter ends the power managing process routine. When the measured time T is in the range of the step S7, the control unit 11 advances to the step S11 and instructs the power control circuit 19 to turn on the power supply for the signal processing part 10, and thereafter ends the power managing process routine.
In the above processes, when the input of an audio reproduction signal is detected, it is affirmed at the step S1, and the power management timer is turned on at the step S6. In the following, as long as the audio reproduction signal is not discontinued continuingly over 2 seconds, the time measurement by the power management timer is repeated for each power supply cycle Tp. Then, it is affirmed at the step S7 only the time period from the measurement start time point to the power-on time Tq, and the power supply for the signal processing part 10 is turned on at the step S11. In this way, on and off of the power supply for the signal processing part 10 are controlled as shown in
Next, the procedure of the process executed by the control unit 11 for executing the above-mentioned genre judgment will be described with reference to
In the analysis data generating process routine, the control unit 11 sets the variable n to the initial value of 0 at the first step S21, the variable n assigning the number for the channel ch which is a target of the data processing. At the subsequent step S22, the control unit 11 takes in the output signal (the integration value or the differential value) of the channel chn for the sampling unit time from the internal buffer. At the next step S23, the control unit 11 judges whether the taken-in output signal exceeds the prescribed level. When it exceeds the prescribed level, the control unit 11 advances to the step S24, adds the internal counter for the channel chn by 1, and thereafter advances to the step S25. On the other hand, when it does not exceed the prescribed level at the step S23, the control unit 11 skips the step S24 and advances to the step S25.
At the step S25, the control unit 11 determines whether 2 is set to the variable n. When it is not 2, the control unit 11 adds the variable n by 1 at the step S26, and returns the step S2. On the other hand, when the variable n is 2 at the step S25, the control unit 11 advances to the step S27. By repeating the processes of steps S22 to S26, three channels ch0 to ch2, namely, the respective outputs of the integration circuit 14 and the differentiation circuit 15 for the low frequency component, and the differentiation circuit 16 for the high frequency component are checked up for the length of the sampling unit time.
At the step S27, the control unit 11 judges whether the process for one sampling cycle Tm is finished. For example, when the number of times of affirmative determination at the step S25 is equal to the value obtained by dividing the sampling cycle Tm by the sampling unit time Tn, it can be determined that the process for the sampling cycle Tm is finished. When it is disaffirmatively determined at the step S27, the control unit 11 returns to the step S21, and advances to the processing of the signal stored in the internal buffer for the next sampling unit time. On the other hand, when it is affirmatively judged at the step S27, the control unit 11 advances to the step S28, and makes the values stored in the internal counter to the analysis data D1 stored in the storage device 25 as the totalized values sum0X, sum1X, sum2X (cf.
At the subsequent step S29, the control unit 11 resets the value of the internal counter to the initial value of 0, and further determines at the next step S30 whether the generating process of the analysis data D1 is finished. For example, when so-called no sound condition, in which the outputs of all the channels ch0 to ch2 are close to 0, continues for over prescribed seconds, it can be determined that the process is finished. Then, when the process is not finished, the control unit 11 returns to the step S21. When it is determined that the process is finished, the control unit 11 ends the analysis data generating process routine. In the above process, the analysis data D1 as shown in
At the step S47, the control unit 11 obtains the identification values dM0, dM1, dM2, dCV1, dCV2, each of which corresponds to the obtained average values M0 to M2 and the coefficients of variation CV1, CV2, with reference to the calculation result identification data D4. At the next step S48, the control unit 11 judges the genre of music by selecting the genre corresponding to the five-digit judgment value, where the identification values dM0, dM1, dM2, dCV1, dCV2 are ordered in this sequence, with reference to the judgment reference data D3 stored in the storage device 25. Furthermore, the control unit 11 updates the history data D2 at the next step S49 in such a manner the number of times for the judged genre is added by 1, and thereafter ends the data analyzing process routine.
In the game machine 1 of this embodiment, since the number of times of judgment for each genre is stored in the history data D2, the repetition, a user's genre preference, or the like for each of the genre of the music listened by the user via the game machine 1 can be analyzed with reference to the history data D2, and the results of judgment of the genre can be reflected to the content of game executed by the game control part 32. For example, when the game control part 32 executes a game for bringing up a character, the character's attribute such as a mode or a personality can be changed by the operation of the game control part 32 in accordance with the distribution of number of times of judgment for each genre described in the history data D2.
The present invention is not limited to the above embodiment, and can be embodied in various forms. For example, in the above embodiment, the number of times when the integration value and the differential value of the low frequency component and the differential value of the high frequency component exceed the prescribed levels within the sampling unit time are totalized respectively. The degree of dispersion of the waveform of the music reproduction signal is judged by calculating the average values and the coefficients of variation for the totalized values. However, the present invention is not limited to the one using only the average values and the coefficients of variation. For example, a genre of music can be judged with further reference to various statistical values such as a standard deviation, a variance, or a summation of the totalized values. Any multiple types of statistical values may be used. Moreover, only the coefficients of variation for the differential values of the low frequency component and the high frequency component are computed. However, the present invention is not limited to those computations, and the coefficients of variation for each of the totalized value of all the differential values and the integration value may be computed and used for the genre judgment. The five-digit judgment value characterizing the waveform of the music reproduction signal is used for the data analysis. However, the number of digits may be set in accordance with various statistical values to be calculated. For example, when the average values and the coefficients of variation for each of the integration value and the differential value of the low frequency component and the differential value of the high frequency component is calculated, the judgment value characterizing the waveform of the music reproduction signal becomes a six-digit long.
The signal processing part may be configured as a hardware device where circuit elements such as IC, LSI are combined with each other, or may be configured as a logical device where MPU is combined with software. The data generating part and the data analysis part may be respectively configured as a hardware device. The signal input part is not limited to the line-in terminal. For example, a device of receiving the reproduction signal, which is transmitted from the music reproduction device by using a radio transmission such as FM radio wave, and of converting to the music reproduction signal may be used as the signal input part.
In the above embodiment, a music genre judging device is configured by combining the line-in terminal 4, the signal processing part 10, and the control unit 11. However, the music genre judging device of the present invention is not limited to a device mounted on to the game machine. The music genre judging device of the present invention can be applied to various devices for judging a genre of music from the music reproduction signal outputted to the audio output device such as earphones, headphones, or speakers from the music reproduction device.
Number | Date | Country | Kind |
---|---|---|---|
2006 182148 | Jun 2006 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2007/062793 | 6/26/2007 | WO | 00 | 12/19/2008 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2008/001765 | 1/3/2008 | WO | A |
Number | Date | Country |
---|---|---|
11-73726 | Jul 1989 | JP |
03-284800 | Dec 1991 | JP |
9-146967 | Jun 1997 | JP |
2001-029649 | Feb 2001 | JP |
2003-302988 | Oct 2003 | JP |
2004-163767 | Jun 2004 | JP |
2006-163264 | Jun 2006 | JP |
20-0400895 | Nov 2005 | KR |
Number | Date | Country | |
---|---|---|---|
20100234108 A1 | Sep 2010 | US |