The invention relates to a method and an apparatus regarding recording, transmission, or reproduction of data which are applied to record, transmit, or reproduce data of at least either audio information or video information.
It has empirically been known that when listening to a performance of, for example, an orchestra in a concert hall, the listener observes a baton of a conductor and predicts start timing of a music piece which is played in accordance with his baton. Therefore, the listener can catch his own breath and listen to the played music piece without a sense of discomfort.
Hitherto, a performance control apparatus for changing music into music to be comfortable to the ear by adding a fluctuation of 1/f as a human organic rhythm to the original music has been proposed. For example, a technique in which considering that a human organic state, its physical condition, and the like change minute by minute, a fluctuation control signal according to a daily organic state of the listener is formed and a performing tempo of an audio program is edited on the basis of the fluctuation control signal has been described in Patent Document 1 (JP-A-10-79130).
If the timing of a start point of the music piece and that of organic information of the listener, for example, breath or the like do not coincide, the breaths of the performers such as a conductor and the like and that of the listener do not coincide either, and information given by the performers is not conveyed to the listener enough, so that there is a fear that the listener does not feel the presence enough or he can feel uncomfortable in certain cases. According to the above Patent Document 1, the performing tempo of the music is controlled by using the organic information regarding the health of the listener, but nothing is disclosed about synchronization between the timing of the music piece to be reproduced and the breath of the listener, thereby enabling him to feel the music more lively.
It is, therefore, an object of the invention to provide a method and an apparatus regarding recording, transmission, or reproduction of data which can realize reproduction full of liveliness by synchronizing timing of a music piece with organic information of the listener, for example, breath.
To accomplish the above object, according to the invention of Claim 1, there is provided a data reproduction instructing apparatus comprising:
reproducing means for reproducing data;
detecting means for detecting organic information; and
instructing means for instructing timing to start the reproduction of the data on the basis of the detected organic information.
According to the invention of Claim 7, there is provided a data reproducing apparatus comprising:
reproducing means for reproducing data;
detecting means for detecting organic information; and
control means for controlling timing to start the reproduction of the data on the basis of the detected organic information.
According to the invention of Claim 16, there is provided a data transmission instructing apparatus comprising:
transmitting means for transmitting data;
detecting means for detecting organic information; and
instructing means for instructing timing to transmit the data on the basis of the detected organic information.
According to the invention of Claim 17, there is provided a data transmitting apparatus comprising:
transmitting means for transmitting data;
detecting means for detecting organic information; and
control means for controlling transmission timing to transmit the data on the basis of the detected organic information.
According to the invention of Claim 18, there is provided a data recording instructing apparatus comprising:
recording means for recording data onto a recording medium;
detecting means for detecting organic information; and
instructing means for instructing timing to record the data on the basis of the detected organic information.
According to the invention of Claim 19, there is provided a data recording apparatus comprising:
recording means for recording data onto a recording medium;
detecting means for detecting organic information; and
control means for controlling timing to record the data on the basis of the detected organic information.
According to the invention of Claim 21, there is provided a data reproduction instructing method comprising the steps of:
detecting organic information when data is reproduced; and
instructing timing to reproduce the data on the basis of the detected organic information.
According to the invention of Claim 22, there is provided a data reproducing method comprising the steps of:
detecting organic information when data is reproduced; and
controlling reproduction timing to reproduce the data on the basis of the detected organic information.
According to the invention of Claim 23, there is provided a data recording instructing method comprising the steps of:
detecting organic information; and
instructing timing to record data on the basis of the detected organic information.
According to the invention of Claim 24, there is provided a data recording method comprising the steps of:
detecting organic information;
controlling timing to record data on the basis of the detected organic information; and
recording the data onto a recording medium on the basis of the timing.
An embodiment of the invention will be described hereinbelow.
The organic information of the viewer is at least one of a body motion, breath, heartbeat, and a pulsation.
In
A detection signal whose amplitude changes in accordance with the respiratory movement is generated from the sensor 1. The detection signal is supplied to a low pass filter 2 and unnecessary signal components such as noises and the like are removed. It is preferable that the signal from the sensor 1 is transmitted to the low pass filter 12 in a wireless manner so that a cable does not become an obstacle to the movement of the viewer. An output signal of the low pass filter 2 is supplied to a peak detecting circuit 3 and a level detecting circuit 4. In the peak detecting circuit 3, a peak value of the positive side and the negative side are detected, respectively. As shown in
The detection signal from the peak detecting circuit 3 is supplied to the level detecting circuit 4. The level detecting circuit 4 detects a level of the detection signal of the timing of the peak value. A signal showing the detected level is taken out to an output terminal 7a. The signal derived from the output terminal 7a is a signal showing a depth of breath. The detection output of the peak detecting circuit 3 is taken out to an output terminal 7b. For example, a pulse signal which is generated at the timing of the positive peak value and a pulse signal which is generated at the timing of the negative peak value are taken out as a detection output to the output terminal 7b. The detection output derived from the output terminal 7b is used as a timing signal.
Further, the output signal of the peak detecting circuit 3 is supplied as a start signal to a timer 5 and inputted to a counter 6. An output of the counter 6 is supplied as a stop signal to the timer 5. When the counter 6 counts (n) peak signals, it generates the stop signal to the timer 5. Therefore, a detection signal is generated from the timer 5 every (n) peak values. The detection signal which is outputted from the timer 5 is extracted as a breath interval signal to an output terminal 7c. As mentioned above, the breath depth signal, the breath timing signal, and the breath interval signal are outputted from the output terminals 7a, 7b, and 7c, respectively.
An output signal of the low pass filter 12 is supplied to a differentiating amplifier 13. A signal in which the detection signal has been primary-differentiated is obtained by the differentiating amplifier 13. The differentiation signal is supplied to a maximum value detecting circuit 14 and a level detecting circuit 15. The maximum value detecting circuit 14 generates a pulse signal which is generated at the timing of the maximum value. The pulse signal is supplied to the level detecting circuit 15. The level detecting circuit 15 detects a level of the differentiation signal of the timing of the pulse signal and outputs it to an output terminal 18a. An output signal obtained at the output terminal 18a is a detection signal showing an intensity of the heartbeat.
An output of the maximum value detecting circuit 14 is supplied as a start signal of a timer 16. The output of the maximum value detecting circuit 14 is counted by a counter 17. A signal which is outputted from the counter 17 when the (n) maximum values are detected is supplied as a stop signal to the timer 16. An output signal of the timer 16 is taken out to an output terminal 18b. A detection signal taken out to the output terminal 18b is a signal indicative of a heartbeat period.
Other organic information, for example, a pulsation can be measured by using an ultrasonic wave. A body motion can be used as organic information. Light-emitting devices (for example, light-emitting diodes which flicker at a predetermined period) are attached to one or a plurality of portions of the body to be measured. By photographing the light-emitting devices and detecting the positions of the light-emitting devices on a two-dimensional photographing plane, the body motion can be measured and the timing of the maximum value of the body motion is measured. The timing is controlled so that the timing of the maximum value of the body motion coincides with the start timing of reproduction.
The AV signal obtained from the error correcting circuit 23 is written into a RAM (Random Access Memory) 24. A read output of the RAM 24 is taken out to an output terminal 26 through a switch 25. The switch 25 is turned on at the start of the reading of the RAM 24 which is instructed by a reproduction start signal. Actually, the reproduction start signal is inputted to a control circuit of the RAM 24. The switch 25 is shown as a schematic construction. The RAM 24 stores the whole portion of one music piece. In the case of a storage having a large capacity, a plurality of music pieces can be stored, or a RAM having a capacity for deviation correction of a length smaller than one music piece can be also used.
An organism signal of the viewer, for example, a breath signal is supplied from an input terminal 31 and supplied to a data collecting unit 32. The data collecting unit 32 collects the data of the organism signal, thereby enabling various processing data such as average value of a predetermined interval, maximum value, statistic data, and the like to be obtained in a data analyzing unit 33 at the next stage. For example, the organism signal of a time of a duration of a certain degree of one viewer is collected and analyzed. The data analyzing unit 33 has, for example, a construction as described with reference to
Data of an analysis result (breath depth output, breath timing output, breath interval output, and the like) of the data analyzing unit 33 is inputted to a start discriminating unit 34. The start discriminating unit 34 decides the timing to start the reproduction and outputs a signal to control a start instructing unit 35.
The start instructing unit 35 outputs a start instructing signal to a display and/or a speaker. As a simple display, there is a light-emitting device such as a light-emitting diode or the like. As another display, a display which displays characters on a display screen can be used. The light-emitting device is lit on every start timing or characters showing the start are displayed. By watching the display, the viewer operates a keyboard or a button and allows the start instructing unit 35 to generate the reproduction start signal. The switch unit 25 is turned on by the reproduction start signal and the reading of the AV data stored in the RAM 24 is started. The speaker reproduces audio information, a buzzer, or the like indicative of the reproduction start timing. The viewer listens to the audio information, the buzzer, or the like and presses the keyboard or button, so that the reproduction is started.
A part or all of the data analyzing unit 33, start discriminating unit 34, and start instructing unit 35 can be also automatically executed by hardware processes or software processes without executing the artificial operation.
An embodiment of a data reproducing apparatus according to the invention will now be described with reference to
On the basis of a focusing error signal, a tracking error signal, and an operating instruction from a controller (not shown), the servo unit 43 forms various servo drive signals of focusing, tracking, sled, and spindle and outputs them to the spindle motor 42 and an optical pickup 44. Although not shown, the controller is used to control the whole reproducing apparatus. The display, operation switches, and the like are connected to the controller. While converging a light beam of a semiconductor laser onto a signal surface of the optical disc 41, the optical pickup 44 traces tracks formed concentrically or spirally on the optical disc 41. The whole optical pickup 44 is moved by a sled mechanism.
An output of the optical pickup 44 is supplied to a sync detector 46 through an RF amplifier 45. An output of the sync detector 46 is supplied to an address detecting circuit 47. A servo signal from the RF amplifier 45, a detection signal from the sync detecting circuit 46, and an address signal from the address detecting circuit 47 are supplied to the servo unit 43.
An output signal of the address detecting circuit 47 is supplied to a demodulator 48 of, for example, EFM. An output of the demodulator 48 is supplied to an error correcting circuit 49. The error correcting circuit 49 corrects errors and interpolates the uncorrectable errors as necessary. The AV data from the error correcting circuit 49 is stored in a RAM 50. The AV signal whose reproduction start timing has been controlled is taken out to an output terminal 51 from the RAM 50. The output AV signal is supplied to a reproducing apparatus such as amplifier, speaker, display, or the like and the AV signal is reproduced.
Reference numeral 61 denotes a sensor for measuring the breath of the viewer who monitors the AV information reproduced from the optical disc 41. A detection signal is supplied to a low pass filter 62 from the sensor 61 in a wired or wireless manner. An output signal of the low pass filter 62 is supplied to a peak detecting circuit 63. The timing of the positive peak value and the timing of the negative peak value are detected by the peak detecting circuit 63. The detected signal is supplied to a change point detecting circuit 64.
The change point detecting circuit 64 detects a change point from the inspiratory period to the expiratory period of the breath of the viewer and forms the reproduction start signal having the timing of the change point. The reproduction start signal is supplied to the RAM 50. The reading timing of the AV signal from the RAM 50 is controlled to the timing synchronized with the reproduction start signal. The control of the reproduction start is not limited to the start timing of the music piece but reproduction start timing of each movement, start timing of the portion having high importance (highlight portion) in the music piece, or the like can be also synchronized with the organic information.
In the case of audio, the silence interval detecting circuit 52 detects a silence interval from the start timing to a sound interval, a silence interval between the music pieces, and a silence interval between the movements. For example, the silence interval of one second or more is detected. In the case of video, an interval without an image instead of the sound is detected. The silence interval detecting circuit 52 is provided for detecting the interval from the start timing to the start timing of the sound interval and delaying the start timing by the time corresponding to a duration of the detected silence interval, thereby preventing the start timing from being a synchronized with the organism signal due to the existence of the silence interval.
The read signal from the RAM 50 is taken out to the output terminal 51 through a switch 53. The switch 53 changes from OFF to ON at the start of the reproduction. The on/off operations of the switch 53 are controlled by a switch control signal from an AV signal start/stop unit 54.
The breath signal from which the noises have been removed by the low pass filter 62 is inputted to an input terminal 62a. The positive and negative peak values and the maximum and minimum values of the peak values are detected by the peak detecting circuit 63. The breath signal from the input terminal 62a is supplied to a zero-cross point detecting circuit 65 and a zero-cross point is detected.
Detection outputs of the peak detecting circuit 63 and the zero-cross point detecting circuit 65 are supplied to a start trigger forming circuit 66. The start trigger forming circuit 66 generates a reproduction start trigger. The start trigger is supplied to the AV signal start/stop unit 54. When the AV signal start/stop unit 54 receives the start trigger, it outputs a start signal for turning on the switch 53 at the timing when the silence interval which is inputted from the silence interval detecting circuit 52 changes to the sound interval. In the case of video, when the start trigger is received, the start signal to turn on the switch 53 is outputted at the timing when the image changes from the interval without the image to the interval with-the image.
As mentioned above, the start signal is generated at the timing when the breath changes from the inspiratory period to the expiratory period, that is, the timing of the peak of the inspiratory period (the negative peak value in the waveform of
For example, there can be a case where the viewer feels better when starting the reproduction at the timing of the peak of the expiratory period or the timing of the zero-cross point. In consideration of such a point, in the constructional example of
The recording/transmission/performance AV signal is inputted to an input terminal shown at reference numeral 71 and stored into a RAM 72. A read output from the RAM 72 is outputted as an AV signal through a switch 73 and supplied to an encoder 74 for error correction. The output AV signal is an AV signal which is supplied to a speaker through an amplifier (not shown) and directly generated in a concert hall. An output signal of the encoder 74 is supplied to a modulating circuit 75. The signal modulated by the modulating circuit 75 is supplied to a recording/transmitting circuit 76. The recording signal from the recording/transmitting circuit 76 is recorded onto a media 77 such as an optical disc or the like. The transmission signal is transmitted to a network 78.
The organism signal, for example, the breath signal of the viewer who monitors the AV signal outputted through the switch 73 is inputted to an input terminal shown at reference numeral 81. The organism signal is supplied to a data collecting unit 82. Data of an analysis result (breath depth output, breath timing output, breath interval output, and the like) of a data analyzing unit 83 is inputted to a start discriminating unit 84. The start discriminating unit 84 decides the timing to start the recording/transmission/performance and outputs a signal to control a start instructing unit 85.
The start instructing unit 85 outputs the start instructing signal to the display and/or the speaker. As a simple display, the light-emitting device such as a light-emitting diode or the like can be given. As another display, the display which displays characters on the display screen can be used. The light-emitting device is lit on every start timing or characters showing the start are displayed. By watching the display, the performer or the person who administrates the recording/transmission operates the keyboard or button and allows the start instructing unit 85 to generate the recording/transmission/performance start signal. The switch unit 73 is turned on by the recording/transmission/performance start signal and the reading of the AV data stored in the RAM 72 is started. The speaker reproduces audio information, buzzer, or the like indicative of the recording/transmission/performance start timing. The performer or the person who administrates the recording/transmission observes the display or listens to the audio information, the buzzer, or the like and presses the keyboard or button, so that the recording/transmission/performance is started.
A part or all of the data analyzing unit 83, start discriminating unit 84, and start instructing unit 85 can be also automatically executed by hardware processes or software processes without executing the artificial operation.
Although it is assumed that the viewer exists on the transmission/recording/performance place side in the construction of
The invention is not limited to the embodiment of the invention mentioned above but many various modifications and applications are possible without departing from the scope of the spirit of the invention. For example, it is also possible to construct the system in such a manner that the better start timing is determined on the basis of the results of the viewing of several times in consideration of the relation with the organism signals of a plurality of viewers and registered as individual profile information of each viewer. It is also possible to store the profile information of a plurality of viewers into a non-volatile memory and enable the viewers to be switched.
As will be obviously understood from the above description, according to the invention, by controlling the start timing of the music piece, movement, or the like of the AV information in accordance with the organic information of the viewer, a situation synchronized with the actual performance or the breath, excitement degree, or the like upon acting can be reconstructed, and the AV system having the fairly larger liveliness than that in the conventional AV system can be constructed.
Number | Date | Country | Kind |
---|---|---|---|
200312508 | Jan 2003 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP03/16729 | 12/25/2003 | WO | 7/13/2005 |