Patent Application
20100049074
The invention relates to a system for and a method of categorizing songs on a physiological effect of the song on a user.
The invention further relates to a computer program product implementing such a method.
US 2003/0060728 describes that music can control how a person acts or feels. A person's mood or state of mind can frequently be inferred from readily measurable physiological conditions, such as pulse, blood pressure, temperature and brain wave activity. Sensors are used to detect the physiological condition. The system operates in two modes: a training mode and a playback mode. In the training mode, the user listens to a piece of music. The physiological condition of the user is measured. At the end of playing of the piece, the user is requested to specify the physiological state he is in. Both the measured state and the user-specified state are stored. This is in principle repeated for each piece of music. In the playback mode, music is selected according to information entered by the user or the measured physiological state. Examples of categories a user may specify are: sleepy, energized or peaceful.
A disadvantage of the known system is that each song needs to be trained. Although this in theory could provide an accurate system, particularly for critical physiological states, such as a transition from awake to asleep, the perception of the user of the effect of the song may not be accurate. Moreover, the training is time consuming.
It is an object of the invention to provide an improved system and method of the kind set forth suitable for automatic operation.
To meet the object of the invention, the system for categorizing songs on a physiological effect of the song on a user includes:
a storage medium for storing a plurality of songs;
a memory for storing for at least one predetermined physiological state of a user an associated predetermined first selection criterion;
a rendering system for rendering songs retrieved from the storage;
a sensor for determining a biological parameter of the user representative of a physiological state of the user;
a processor for, under control of a program, testing a selected song for a physiological effect on the user, by:
In the system according to the invention, two criteria are used. The first criterion is used to determine whether rendering of a song has a positive effect. The criterion is specific for the physiological state. The system may support more than one physiological state, each having a respective first criterion. Applying the criterion results in an indicator indicating whether playing of the song has a positive effect on the physiological state. Using physiological state-specific criteria makes the system suitable for automatic detection. The inventor has realized that once playing a song may not give a reliable outcome on the effect. For example, if a song is being rendered that in principle would aid in bringing the user into sleep, but actually during the rendering somebody slams a door in the vicinity, that may not be the case in that instance. This is overcome by using a second criterion that based on the effect determined for a plurality of times of rendering the song comes to a final decision on the effect of the song. In this way, spurious effects can be automatically eliminated. It will be appreciated that with song is meant any piece of music/audio reproducible by an audio system. This typically covers songs with lyrics as well as music. It also covers artificial sounds.
According to a measure as defined in the dependent claim 2, the effect of rendering a song once is based on at least two time-sequential measurements, where the measured change in the physiological state is the decisive criterion. For example, if a person at the start of the song is awake but at the end is half asleep this is used as an indicator that the song is suitable for the physiological state ‘asleep’, whereas actually both the start and the end condition differ from the ‘asleep’ state. In an embodiment, the state is measured at the start and at the end of the song. Comparing these two measurements will in most situations provide a reliable indication of the effect of the song. Preferably, the state is measured frequently during the rendering. In this way also undesirable peaks in the state can be detected, for example a song may overall have a positive effect but also has a negative effect e.g. a short period with loud music in an overall relaxing song. Such a peak may be an indicator that the song is less suitable.
According to a measure as defined in the dependent claim 3, the sensor is a brain-wave sensor for determining a frequency of brainwaves of the user. Such a sensor is highly suitable for determining whether or not a person is asleep or alert. It can thus be useful for selecting relaxing music (e.g. to help a user to relax or fall asleep) or music intended to keep a user alert (e.g. when driving car) or awakening a user (e.g. after the alarm has gone off).
According to a measure as defined in the dependent claim 4, the sensor is of a contact-free type. Using such a sensor is unobtrusive. The sensor may be embedded in the sleeping cushion or head-rest of a seat, such as a car seat.
According to a measure as defined in the dependent claim 5, the predetermined physiological state is sleep and the first criterion includes whether a brainwave frequency has decreased during rendering of the song. A decrease of frequency is a good indicator of the user relaxing.
According to a measure as defined in the dependent claim 6, the predetermined physiological state is alert and the first criterion includes whether a brainwave frequency has increased during rendering of the song. An increase of frequency is a good indicator of the user becoming more alert.
According to a measure as defined in the dependent claim 7, the first criterion is dependent on an actual physiological state at that moment, possibly in addition to the change of the state measured during the rendering. An example of this is given in the dependent claim 8, where, if the desired physiological state has already been reached (as indicated by the actual physiological state, the fact that no substantial change is detected in the measurements during the rendering of the song is regarded as a positive indicator.
According to a measure as defined in the dependent claim 9, the second criterion includes that a predetermined successive number of times during the rendering a same song the first indicator has indicated that rendering of the song has a positive effect on bringing the user closer to the predetermined physiological state.
According to a measure as defined in the dependent claim 10, the memory is arranged to store for the predetermined physiological state an associated playlist of songs for bringing the user closer to the predetermined physiological state.
According to a measure as defined in the dependent claim 11, the processor is programmed to, based on the determined suitability, determining whether the song should be added to and/or maintained on the playlist. In this way automatically a playlist can be created. Subsequent rendering of songs on the playlist aids in reaching the desired physiological state.
According to a measure as defined in the dependent claim 12, the memory includes for songs on the playlist an associated suitability indicator and the processor is programmed to determine a relative rate of rendering of a song on the playlist in dependence on the associated suitability factor. In this way, the playlist is more varied and can include more songs making it more attractive for a user.
According to a measure as defined in the dependent claim 13, the memory includes a candidate playlist of songs being tested for acceptance on the playlist; the candidate play-list including for songs on the candidate playlist associated information including at least the indicator indicating whether rendering of the song has a positive effect on relaxing the user. A new song may first be entered on a candidate list. It will be appreciated that the list of candidate songs may be incorporated in the playlist itself, where the candidates songs are marked as not yet (fully) accepted. In this way, the song may be played automatically without any further active selection or involvement of the user.
According to a measure as defined in the dependent claim 14, the processor is programmed to use the brain-wave sensor to determine at least one of the following physiological states:
the user is falling asleep,
the user is asleep,
the user is awakening,
the user is alert;
and, in response to determining so, stop rendering of songs or start rendering of songs.
According to a measure as defined in the dependent claim 15, the system includes a user interface for enabling a user to select the song for testing. The user may directly select individual songs, may select the songs by specifying an existing playlist, or by providing selection criteria (e.g. genre, artist, etc.).
According to a measure as defined in the dependent claim 16, the rendering system includes speakers for generating spatially localized sound, such as an earphone, headphone or sound-beamer. In this way, the effect of the system can be limited to a single user. This is particularly advantageous if the song may not have the same effect for each user.
These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter.
In the drawings:
Clearly, the system can play (=render) songs. In the embodiment, the songs are stored in a storage medium 120. This may be any suitable storage medium, like optical storage (e.g. a CD, DVD, Blu-Ray disc), magnetic storage (e.g. hard disc), solid state (e.g. flash memory). This storage may be of a removable type or fixed built-in. In the latter case it is preferred that new songs can be loaded into the system, e.g. via an I/O interface (e.g. USB, or memory card interface, wired or wireless network connection, etc.). In
The system includes a memory 140 for storing for at least one predetermined physiological state of a user an associated predetermined first selection criterion. If the system supports more than one physiological state it stores for each of those states a respective first selection criterion. The memory 140 may be of any suitable type, preferably including at least partly a non-volatile memory for storing parameters also during periods of no power. Suitable memory includes rewriteable optical disc, hard disk, flash memory, etc. A processor 110 is used to test a selected song for a physiological effect on the user. Any suitable type of processor may be used, such as a conventional microprocessor used in PCS, or digital signal processors (DSPs) frequently used in consumer electronics audio/video equipment. The processor 110 is operated under control of a program. The program is typically loaded from a storage (e.g. storage 120 or memory 140).
The program executes two main steps:
The following steps illustrate the second criterion. In step 230 it is checked whether the song has been tested enough. According to the invention, each song is tested at least twice. It will be appreciated that if a song is tested always exactly twice, that then step 230 can be implemented in a simple way, without an explicit test.
In a preferred embodiment, the processor is programmed to use the sensor at least twice during the rendering of the song to obtain at least two time-sequential measurements of the biological parameter. It will be appreciated that also many more measurements may be taken, e.g. at fixed intervals of a couple of seconds or substantially continuous. The second criterion is then based on whether or not the rendering of the song has a positive effect on bringing the user closer to the predetermined physiological state in dependence on a change of the measurements. For example, if two measurements are taken (e.g. one at the beginning of the song and one at the end of the song) the criterion can be that an improvement has occurred.
Taking as an example the brainwave frequency of a user as biological measurement, then it is known that the following relationship exists between the brainwave frequency and the state of mind of the user:
If the user now wants songs selected that are suitable for that person to fall asleep (desired physiological state is ‘asleep’), a suitable first indicator is that the brainwave frequency has lowered during the playing of the song. If the desired physiological state is ‘highly alert’ (e.g. the user wants to select songs to be played while driving a car), a suitable first indicator is that the brainwave frequency has increased during the playing of the song. The latter physiological state also illustrates that an alternative or additional first criterion is that the desired physiological state has already been achieved and that no negative change (e.g. no substantial change at all or even a small improvement) has been measured during the rendering session of the song. A person skilled in the art can easily decide for which physiological states a stable situation is a good indicator. It will be appreciated that for most persons in deep sleep a stable measurement is not providing any useful information.
A suitable second criterion for above examples is that the first criterion has been met for three successive renderings of the same song. It will be appreciated that a positive effect can also be that no negative effect has been detected (e.g. frequency has not changed substantially).
The reliability of the system can be improved by frequently monitoring the effect during the rendering. In this way also short negative effects can be detected. For example, somewhere in the middle of a song a relatively loud sound occurs, which could slightly wake-up the user and thus would make the song less suitable for falling asleep, even if the entire song might still have a positive effect. So, the outcome of the first criterion may be a suitable or not suitable ranking, but may also offers a more varied assessment like moderately suitable (e.g. overall positive but with a negative intermediate effect). All these aspects may be take into account for the second criterion. The outcome of the second criterion may thus also be “black or white” (i.e. not suitable or suitable) but may also be more varied.
It is desired that the system determines the real correlation between rendering of the song and the effect on the physiological state and tries to eliminate disturbances that may influence that. For example, if songs are selected for falling asleep (i.e. the person lies already in bed and listens to the songs), then a negative effect may first be measured if the user is awakened by something else than the music. This could be any external trigger, such as a loud sound generated in the street, or a push from the partner. Some of such triggers (e.g. loud sounds) the system may be able to detect (e.g. by using a microphone and comparing the received sound to the rendered sound). If the system detects such a trigger it preferably decides to ignore this rendering session. Some triggers may be difficult to detect automatically. It is thus preferred that the system takes the final decision (second decision) only based on several rendering sessions of the same song. A negative first indicator is then just a negative indicator and in itself will not result in a final rejection. Three successive negative indicators may, for example, be taken as a final negative indicator. The system may cope with such accidental negative indicator by, for example, on detecting a positive indicator that follows a previous negative indicator resetting the counter to one (i.e. one positive indicator). A negative first indicator followed by a second negative indicator would not result in resetting the counter. This enables the system to detect three successive negative first indicators and filters out an isolated negative first indicators. Persons skilled in the art will be able to design more advanced filtering schemes as the second criterion.
In a preferred embodiment, the memory 140 is arranged to store for the predetermined physiological state an associated playlist of songs for bringing the user closer to the predetermined physiological state. The playlist may take any suitable form, for example as a fully separate playlist or additional attributes or attribute values on an existing playlist. The user can then select songs for bringing him to the desired state simply by selecting the playlist (or equally, by selecting the desired state and filtering a larger playlist for that attribute). The second criterion can then be used for determining whether the song should be added to and/or maintained on the playlist. It will be appreciated that once a song has been ‘finally’ accepted on the playlist, that the system actually may keep on monitoring and in that way improve the selection process. A preferred way of doing this is to use a separate counter for the number of times Npos a first positive indicator has been given and the number of times Nneg a negative first indicator has been given. The total rating is then Npos/(Npos+Nneg).
In the embodiment where the outcome of the second criterion is more varied then just suitable/not suitable, preferably the processor is programmed to determine a relative rate of rendering of a song on the playlist in dependence on the associated suitability factor. A more suitable song is rendered more frequently than a less suitable song. Preferable a threshold is used for ensuring that a song with a suitability factor below the threshold is not rendered for this physiological state. The more songs have been tested, the stricter the selection criteria may become. For example, the threshold is raised. The embodiment of
In an embodiment of the system, the memory includes a candidate playlist of songs being tested for acceptance on the playlist associated with the physiological state. The candidate play-list includes for songs on this candidate playlist associated information, such as the indicator indicating whether rendering of the song has a positive effect on relaxing the user. If the song is tested four times, the list may store for the song all four indicators. Alternatively, whenever a new indicator has been determined a new value to be stored is determined based on the stored indicator and the newly determined indicator. For example, one positive indicator may add 25% to the stored value. So, after four positive tests the outcome is 100% suitable. In this way, a four-valued ranking can be achieved in a simple way.
In an embodiment, the processor is programmed to use the brain-wave sensor to determine at least one of the following physiological states:
the user is falling asleep,
the user is asleep,
the user is awakening,
the user is alert;
and, in response to determining so, stop rendering of songs or start rendering of songs. For example, if the desired physiological state is ‘asleep’ and based on the measurement done during the rendering of the song it is determined that the user has by now fallen asleep, rendering of the songs may be stopped. If on the other hand, for the same desired state, it is detected that the user is awakening, rendering may be re-started.
The user interface 160 may be used for allowing the user to select the desired physiological state (if the particular system supports more than one state). Preferably, the system is also programmed to determine the desired physiological state automatically. For example, by receiving a trigger from an alarm set by the user, the system can automatically set the desired physiological state to alert. It can also do this if it detects that the user is moving (e.g. using movement sensors or GPS). It may also choose the desired physiological state in dependence on the time (e.g. late in the evening: asleep) and/or date (e.g. day of the week). Preferably, the system learns the desired physiological state from the user. For example, if the user during working days regularly around 18.00 o'clock activates the system and sets the desired state to ‘relaxed’ the system can perform this action automatically based on a signal from a clock.
It will be appreciated that the invention also extends to computer programs, particularly computer programs on or in a carrier, adapted for putting the invention into practice. The program may be in the form of source code, object code, a code intermediate source and object code such as partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention. The carrier be any entity or device capable of carrying the program. For example, the carrier may include a storage medium, such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk. Further the carrier may be a transmissible carrier such as an electrical or optical signal, which may be conveyed via electrical or optical cable or by radio or other means. When the program is embodied in such a signal, the carrier may be constituted by such cable or other device or means. Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted for performing, or for use in the performance of, the relevant method.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb “comprise” and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article “a” or “an” preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
| Number | Date | Country | Kind |
|---|---|---|---|
| 05100610.4 | Jan 2005 | EP | regional |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IB2006/050257 | 1/24/2006 | WO | 00 | 7/31/2007 |
