Patent Grant
10277977
This application claims the benefit of foreign priority to Japanese Patent Application No. 2017-209662 filed on Oct. 30, 2017, which is assigned to the assignee of the present application.
The present disclosure generally relates to a sound reproduction system, a mobile object, and a sound reproduction method, and more particularly relates to a sound reproduction system, mobile object, and sound reproduction method for reproducing a sound from a sound source.
WO 2013/099093 A1 (hereinafter referred to as D1) discloses a sound field control device configured to reproduce a desired sound in a listening area and mitigate that sound in an area surrounding the listening area. The sound field control device disclosed in D1 includes a control filter and a listening correction filter.
The listening correction filter performs signal processing on an input signal from a sound source in accordance with a preset control characteristic, thus generating a second output signal and outputting the signal to a second speaker. The control filter performs signal processing on the second output signal supplied from the listening correction filter in accordance with the preset control characteristic, thus generating a first output signal and outputting the signal to a first speaker.
The control filter has a control characteristic in which, by means of a sound played back from the first speaker, a sound played back from the second speaker is reduced in an area surrounding the listening area. The listening correction filter has a control characteristic in which, by means of the sounds played back from the first and second speakers, a sound having a specified target acoustic characteristic emerges in the listening area.
The sound field control device (sound reproduction system) disclosed in D1, however, could make the desired sound (corresponding to the “first sound”) audible to not only a person in the listening area (corresponding to the “first region”) but also a person in an area surrounding the listening area (corresponding to the “second region”) as well.
The present disclosure provides a sound reproduction system, mobile object, and sound reproduction method, all of which are able to make a component of the first sound clearly audible in the first region and another component of the first sound less clearly audible in the second region.
A sound reproduction system according to an aspect of the present disclosure is configured to emit a first sound and a second sound from a loudspeaker at a time. The first sound is intended to reach the ears of an object person's. The second sound is intended to reach the ears of a non-object person's and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker toward a first region occupied by the object person and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker toward a second region occupied by the non-object person and has a sound pressure equal to the predetermined value.
A mobile object according to another aspect of the present disclosure includes: the sound reproduction system described above; and a mobile object body equipped with the loudspeaker.
A sound reproduction method according to still another aspect of the present disclosure is designed to emit a first sound and a second sound from a loudspeaker at a time. The first sound is intended to reach the ears of an object person's. The second sound is intended to reach the ears of a non-object person's and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker toward a first region occupied by the object person and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker toward a second region occupied by the non-object person and has a sound pressure equal to the predetermined value.
(1) Overview
An overview of a sound reproduction system 1 and mobile object 10 according to an exemplary embodiment will be described with reference to
A sound reproduction system 1 according to this exemplary embodiment may be provided for a mobile object 10, for example, and is configured to make a component of a first sound clearly audible to an object person P1 present in the mobile object 10 and another component of the first sound less clearly audible to non-object persons P2-P4 present in the same mobile object 10. According to this embodiment, the mobile object 10 is supposed to be a passenger car, for example. Therefore, in this specific example, the object person P1 may be a driver seated in the driver's seat of the passenger car, and the non-object persons P2-P4 may be persons seated in the assistant driver's seat and passenger seats of the same passenger car (see
To overcome such a problem, the sound field control device disclosed in D1 cited above makes the sound played back from a second speaker less clearly audible around the listening area with the sound played back from a first speaker. Still, according to this configuration, there are chances of the desired sound (first sound) being audible clearly enough even around the listening area. That is to say, the sound field control device disclosed in D1 could allow not only the person present in the listening area but also other persons present around the listening area to listen to the phone call voice through a hands-free system.
Thus, the sound reproduction system 1 according to this exemplary embodiment has the following configuration to make a component of the first sound clearly audible to the object person P1 and another component of the first sound less clearly audible to the non-object persons P2-P4.
The sound reproduction system 1 according to this exemplary embodiment is configured to emit a first sound and a second sound at a time from a loudspeaker 3. The first sound is intended to reach ears of an object person's P1. The second sound is intended to reach ears of a non-object person's P2-P4 and compliant with a control characteristic (second control characteristic). The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker 3 toward a first region Re1 and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker 3 toward a second region Re2-Re4 and has a sound pressure equal to the predetermined value. The first region Re1 is a region occupied by the object person P1. The second region Re2-Re4 is a region occupied by any of the non-object persons P2-P4. As used herein, the “second sound” is intended to reach the ears of the non-object persons' P2-P4, and may be pink noise, road noise, or any other types of sound in this embodiment. However, this is only an example and should not be construed as limiting. Alternatively, the second sound does not have to be any of these noises but may also be, for example, music to reach the ears of the non-object persons' P2-P4. In this case, the second sound may be emitted either intermittently only while the first sound is being emitted or continuously. Emitting the second sound continuously is less likely to make the non-object persons P2-P4 find the second sound unnatural, which is beneficial.
Also, the mobile object 10 according to this exemplary embodiment includes the sound reproduction system 1 described above and a mobile object body 100 equipped with the loudspeaker 3. In this exemplary embodiment, the mobile object 10 may be a passenger car and the mobile object body 100 may be a car body, for example. Also, in the sound reproduction system 1 according to this embodiment, an object space SP10 includes a first space SP1 and second spaces SP2-SP4 as shown in
In the sound reproduction system 1 according to this embodiment, a component, emitted from the loudspeaker 3 toward the first region Re1, of the second sound has a sound pressure lower than a predetermined value, and another component, emitted from the loudspeaker 3 toward the second regions Re2-Re4, of the second sound has a sound pressure equal to the predetermined value, as described above. That is why even if a component of the first sound emitted from the loudspeaker 3 toward the first region Re1 has the same sound pressure as another component of the first sound emitted from the loudspeaker 3 toward the second region Re2-Re4, this configuration is still able to make the former component of the first sound clearly audible in the first region Re1 and the latter component of the first sound less clearly audible in the second region Re2-Re4.
(2) Details
Next, a sound reproduction system 1 and mobile object 10 according to this embodiment will be described in further detail with reference to
(2.1) Sound Reproduction System
As shown in
The main computer 2 includes at least one first control filter 211-21n (where n=1, 2, and so on), at least one second control filter 221-22n (where n=1, 2, and so on), and at least one adder 231-23n (where n=1, 2, and so on). In this embodiment, the main computer 2 is a computer system including, as primary hardware components, a processor and a memory. In this main computer 2, the functions of the at least one first control filter 211-21n, the at least one second control filter 221-22n, and the at least one adder 231-23n may be performed by the processor executing a program stored in the memory. The program may be stored in advance in the memory of the main computer 2, downloaded via a telecommunications line such as the Internet, or distributed after having been stored in a non-transitory computer-readable storage medium such as an optical disc or a hard disk drive.
The main computer 2 is connected to not only the at least one loudspeaker 3 but also a first sound source 5 and a second sound source 6 as well. The first sound source 5 is a sound source for emitting the first sound (target sound) that should be audible to the object person P1. Examples of the first sound source 5 include various types of storage media and recording media such as compact discs (CDs), vinyl records, and hard disks, and telecommunications devices such as cellphones and smartphones. The first sound emitted from the first sound source 5 may be voice, music, or alarm sounds, for example, and is a sound to be made audible only at a particular spatial position. The second sound source 6 is a sound source for emitting the second sound (such as a masker) to make a component of the first sound less clearly audible to the non-object persons P2-P4. Just like the first sound source 5, the second sound source 6 may also be any of various types of storage media and recording media such as compact discs (CDs), vinyl records, and hard disks. The second sound emitted from the second sound source 6 is an environmental sound such as a pink noise or a road noise, and is a masker that makes the component of the first sound less clearly audible at every position other than the particular spatial position. Note that the first sound source 5 and the second sound source 6 do not have to be such storage media but may also be a server provided outside of the sound reproduction system 1, for example. In that case, the sound reproduction system 1 may be configured to acquire the first and second sounds from the server via a telecommunications line such as the Internet, for example.
In the following description, when a plurality of first control filters 211-21n are provided, the plurality of first control filters 211-21n will be hereinafter collectively referred to as “first control filters 21” if there is no need to distinguish them from each other. Likewise, in the following description, when a plurality of second control filters 221-22n are provided, the plurality of second control filters 221-22n will be hereinafter collectively referred to as “second control filters 22” if there is no need to distinguish them from each other. Furthermore, in the following description, when a plurality of adders 231-23n are provided, the plurality of adders 231-23n will be hereinafter collectively referred to as “adders 23” if there is no need to distinguish them from each other.
The first control filters 21 are each configured to perform signal processing on the first sound emitted from the first sound source 5 based on the propagation characteristic of the sound from an associated one of the loudspeakers 3 to the respective spaces SP1-SP4. The first control filters 21 perform signal processing on the first sound in accordance with a first control characteristic. The first control characteristic is defined such that the first sound includes components, one of which is emitted from the loudspeaker 3 toward the first region Re1 and the other of which is emitted from the loudspeaker 3 toward the second regions Re2-Re4 and has a lower sound pressure than the former component. In this embodiment, the first region Re1 is a region where the head of the object person P1 is located, while each of the second regions Re2-Re4 is a region where the head of an associated one of the non-object persons P2-P4 is located (see
The second control filters 22 are each configured to perform signal processing on the second sound emitted from the second sound source 6 based on the propagation characteristic of the sound from an associated one of the loudspeakers 3 to the respective spaces SP1-SP4. The second control filters 22 perform signal processing on the second sound in accordance with a second control characteristic. The second control characteristic is defined such that a component, emitted from each of the loudspeakers 3 toward the first region Re1, of the second sound has a sound pressure lower than a predetermined value and that another component, emitted from the loudspeaker 3 toward the second regions Re2-Re4, of the second sound has a sound pressure equal to the predetermined value. The second sound subjected to the signal processing by the second control filters 22 includes a component which has become fainter in the first region Re1 and another component which has become louder in the second regions Re2-Re4. In other words, in the first region Re1, a Null point is formed with respect to the second sound. The second control filters 22 will be described in further detail later in “(2.4) Second control filters.”
Each of the adders 23 adds together the first sound emitted from the first sound source 5 and subjected to the signal processing by an associated one of the first control filters 21 and the second sound emitted from the second sound source 6 and subjected to the signal processing by an associated one of the second control filters 22, and outputs an audio signal representing the sum to an associated one of the loudspeakers 3.
Each of the loudspeakers 3 emits (or reproduces) the first sound and the second sound in accordance with the audio signal from an associated one of the adders 23.
Note that the sound propagation characteristic may be either measured in advance or presumed by the main computer 2.
(2.2) Mobile Object
A mobile object 10 according to this embodiment may be, for example, a passenger car with a mobile object body (car body) 100 as shown in
(2.3) First Control Filters
The plurality of first control filters 211-21n are each configured to increase the sound pressure of a component of the first sound at a desired position (e.g., the first region Re1 in this embodiment) and decrease the sound pressure of another component of the first sound at every position other than the desired position (e.g., the second regions Re2-Re4 in this embodiment) as described above. Examples of the methods employed by the plurality of first control filters 21 to calculate filter coefficients include the truncated singular value decomposition, the least squares method, and the weighted least squares method. As used herein, the truncated singular value decomposition is a technique for calculating an inverse filter at a point of measurement using a matrix obtained by performing singular value decomposition on a propagation characteristic matrix. The truncated singular value decomposition or the least squares method is a technique for focusing the sound pressure at a desired position by realizing inverse filtering, which cancels the reverberation, at the desired position. Therefore, in a space that causes deep reverberation, it is difficult to perform inverse filtering, and the difference in sound pressure between a suppressed position where the reproduced sound is suppressed and the desired position tends to be less significant compared to a space that causes shallow reverberation. That is why the weighted least squares method is suitably employed as a method for calculating the filter coefficients for the plurality of first control filters 211-21n. In other words, the first control characteristic is suitably determined by the weighted least squares method. The weighted least squares method allows a significant difference in sound pressure to be created, even in a space that causes deep reverberation, between the desired position and the suppressed position by broadening the width of a tolerance range for the inverse filtering at the desired position and by narrowing the width of a tolerance range for the suppression characteristic at the suppressed position. The weighted least squares method is represented by the following Equation (1):
H(ω)=(G(ω)HWG(ω)+λI)−1G(ω)HWd (1)
where H(ω) is a filter coefficient vector, G(ω) is an H complex conjugate transpose of a transfer function matrix between the loudspeaker 3 and a control position (which may be either the desired position or the suppressed position), W is a weight matrix, which is a diagonal matrix for determining the weight for the control position, λ is a regularization parameter, I is a unitary matrix, and d is a desired characteristic vector at a control point. For example, setting, by adjusting this desired characteristic vector d for a desired position, a propagation characteristic between the loudspeaker 3 and the desired position and setting the desired characteristic vector d at zero for the suppressed position allows the sound pressure to be increased at the desired position and decreased at the suppressed position.
Also, the weight value is adaptively changeable according to the (absolute) magnitude of the Null space generated by the second control filters 22. Furthermore, the magnitude of the sound pressure of the first sound focused at the desired position by the first control filters 21 is also changeable by weighting. For example, the weight value may be changed so that the greater the Null space is, the greater the magnitude of the sound pressure of the first sound focused at the desired position is. As can be seen, this combination of the weighted least squares method and the Null-space based sound field control (NBSFC) allows the magnitude of the sound pressure of the first sound focused at the desired position to be set based on the magnitude of the Null space.
To design the first control filters 21, the weight matrix W, the regularization parameter 2, and the desired characteristic vector d are suitably set based on the propagation characteristic measured in advance by a microphone, for example.
(2.4) Second Control Filters
The plurality of second control filters 221-22n are configured to create the Null space at the desired position (e.g., in the first region Re1 in this embodiment). Examples of methods for calculating filter coefficients for the plurality of second control filters 221-22n include phase control and NBSFC. The phase control, however, does not allow the Null space to be created in a space with reflection, and therefore, imposes some constraints on the arrangement of the loudspeakers 3 and the location of the first region Re1, for example. That is why NBSFC is suitably adopted as a method for calculating filter coefficients for the plurality of second control filters 221-22n. In other words, the second control characteristic is suitably determined by NBSFC, which is represented by the following Equation (2):
where H′(ω) is a filter coefficient vector for the second sound (masker), C is a gain coefficient, and W(ω) is a matrix consisting of a column vector extracted from a right-side unitary matrix corresponding to a zero singular value in a singular value matrix. The singular value matrix is obtained by performing a singular value decomposition on the transfer function matrix G(ω). Also, l(ω) in Equation (2) is represented by the following Equation (3):
l(ω)=ejω[1, . . . ,1]T (3)
For example, if the number of the loudspeakers 3 is M and the number of the first regions (control positions) Re1 is K, then the number of elements of l(ω) becomes M.
Also, according to NBSFC, if the number K of the first regions Re1 is greater than the number M of the loudspeakers 3, then no column vectors can be extracted from the right-side unitary matrix corresponding to a zero singular value in the singular value matrix, and therefore, the filter coefficient vector H′(ω) cannot be calculated. In that case, the filter coefficient vector H′(ω) is calculated by NBSFC under an underdetermined condition.
(3) Operation
Next, the basic operation of this sound reproduction system 1 will be described with reference to
First of all, the main computer 2 of the sound reproduction system 1 accepts the input of a first sound emitted from the first sound source 5 and a second sound emitted from the second sound source 6 (in Step S1). The main computer 2 has data about the accepted first and second sounds temporarily stored in a buffer. As for the first sound (target sound), the main computer 2 may accept the input of the first sound sequentially or may have the first sound stored in advance in the buffer.
The main computer 2 reads the data about the first and second sounds from the buffer, and subjects the data about the first sound to signal processing by the first control filters 21 and also subjects the data about the second sound to signal processing by the second control filters 22 (in Step S2). That is to say, the main computer 2 performs filter processing on the data about the first and second sounds. Each of the plurality of first control filters 211-21n performs filter processing (signal processing) on the data about the first sound such that the first sound includes a component which becomes louder in the first region Re1 and another component which becomes fainter in the second regions Re2-Re4. Then, each of the plurality of first control filters 211-21n outputs the filter processed data to an associated one of the plurality of adders 231-23n. Each of the plurality of second control filters 221-22n performs filter processing on the data about the second sound such that the sound pressure of a component of the second sound decreases (i.e., a Null space is created) in the first region Re1 and the sound pressure of another component of the second sound increases in the second regions Re2-Re4. Then, each of the plurality of second control filters 221-22n outputs the filter processed data to an associated one of the plurality of adders 231-23n. Note that each of the first control filters 21 and second control filters 22 may perform the filter processing with data about the first and second sounds read from the buffer either sequentially or collectively at a time.
Each of the plurality of adders 231-23n adds together the data about the first sound provided by an associated one of the plurality of first control filters 211-21n and the data about the second sound provided by an associated one of the plurality of second control filters 221-22n. Then, each of the plurality of adders 231-23n outputs the sum of the audio data to an associated one of the plurality of loudspeakers 31-3n (in Step S3).
In response, each of the plurality of loudspeakers 31-3n emits the first sound and second sound, the data of which has been added together by the associated adder 23, based on the audio data provided (as an electrical signal) by the associated adder 23.
Next, the main computer 2 determines whether or not any first sound to reach the ears of the object person P1 is left in the buffer (in Step S5). If any such first sound is left in the buffer (i.e., if the answer is YES in Step S5), the main computer 2 performs the same series of steps S1-S4 all over again. On the other hand, if no first sound is left in the buffer (i.e., if the answer is NO in Step S5), then the main computer 2 ends the process.
(4) Simulations
Next, the simulations that the present inventors carried out to confirm the effectiveness of the sound reproduction system 1 will be described.
(4.1) Measurement of Propagation Characteristic
In this embodiment, the object space SP10 of the mobile object 10 is supposed to be the vehicle cabin of a passenger car (see
Also, in this embodiment, the four spaces, namely, the first space SP1 and second spaces SP2-SP4, included in the object space SP10 of the mobile object 10 are also measurement ranges (hereinafter referred to as “measurement ranges SP1-SP4”). Specifically, in this embodiment, measurement is carried out at 64 points in each of the measurement ranges SP1-SP4, and the interval between each pair of adjacent measurement points is 8 centimeters [cm].
(4.2) First Control Filters
The results of simulations of the first control filters 21 will be described. In this embodiment, the simulations are carried out within a frequency range of 125 Hz to 2,000 Hz.
(4.2.1) Weighted Least Squares Method
In
(4.2.2) Truncated Singular Value Decomposition
In
(4.2.3) Least Squares Method
In
(4.2.4) Results
As can be seen from
(4.3) Second Control Filters
The results of simulations of the second control filters 22 will be described. In this embodiment, the simulations are carried out within a frequency range of 125 Hz to 2,000 Hz.
In
In
As can be seen from
(5) Advantage
The sound reproduction system 1 according to this embodiment performs signal processing on the first sound (target sound) emitted from the first sound source 5 in accordance with the first control characteristic and also performs signal processing on the second sound (masker) emitted from the second sound source 6 in accordance with the second control characteristic. This allows the sound pressure of a component of the first sound to be increased, and the sound pressure of a component of the second sound to be decreased, with respect to the first region Re1 occupied by the object person P1. This also allows the sound pressure of another component of the first sound to be decreased, and the sound pressure of another component of the second sound to be increased, with respect to the second regions Re2-Re4 occupied by the non-object persons P2-P4, respectively. This makes the former component of the first sound clearly audible in the first region Re1 and the latter component of the first sound less clearly audible in the second regions Re2-Re4.
(6) Variations
Note that the first embodiment described above is only one of numerous embodiments of the present disclosure. The first embodiment is readily modified, replaced, or combined with any of various other embodiments depending on the design choice or any other factor, as long as an object of the present disclosure is achievable. Also, functions similar to those of this sound reproduction system 1 are implementable as a sound reproduction method, a (computer) program, or a non-transitory computer readable storage medium having stored the program thereon. A sound reproduction method according to an aspect is designed to emit a first sound and a second sound from a loudspeaker 3 at a time. The first sound is intended to reach the ears of an object person's P1. The second sound is intended to reach the ears of non-object persons' P2-P4 and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker 3 toward a first region Re1 and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker 3 toward second regions Re2-Re4 and has a sound pressure equal to the predetermined value. The first region Re1 is a region occupied by the object person P1. The second regions Re2-Re4 are regions occupied by the non-object persons P2-P4.
A first variation of the first embodiment will be described. Note that the variations to be described below may be combined as appropriate.
(6.1) First Variation
In the first embodiment described above, the sound reproduction system 1 is supposed to include both of the first control filters 21 and the second control filters 22 as shown in
(6.2) Other Variations
Next, other variations will be enumerated.
The sound reproduction system 1 according to the present disclosure includes a computer system as the main computer 2, for example. The computer system includes, as its major constituent elements, hardware components such as a processor and a memory. The processor's executing a program stored in the memory of the computer system allows the function of the sound reproduction system 1 according to the present disclosure to be performed. The program may be stored in advance in the memory of the computer system, downloaded via a telecommunications line such as the Internet, or distributed after having been stored in a non-transitory computer-readable storage medium such as a memory card, an optical disc or a hard disk drive. The processor of the computer system is configured as a single or plurality of electronic circuits including a semiconductor integrated circuit (IC) or a largescale integrated circuit (LSI). The plurality of electronic circuits may be either integrated together in a single chip or distributed in multiple chips. Those chips may be assembled together in a single device or distributed in multiple devices.
Also, the plurality of functions of the sound reproduction system 1 does not have to be aggregated together in a single housing. Rather, the respective constituent elements of the sound reproduction system 1 may be distributed in multiple housings. Optionally, at least some of the functions of the sound reproduction system 1 may be performed by a server and cloud computing system, for example.
Furthermore, in the first embodiment described above, the loudspeakers 3 form part of the sound reproduction system 1. However, this is only an example and should not be construed as limiting. Alternatively, the loudspeakers 3 may also be installed in advance in the mobile object 10.
Furthermore, the mobile object 10 does not have to be a passenger car but may also be an airplane, a train, or any other type of vehicle as long as the mobile object 10 is configured to move with a passenger in it. Furthermore, the ambient sound does not have to be a pink noise or a road noise, but may also be an engine sound, a wind noise, or any other ambient sound.
A sound reproduction system 1B according to a second embodiment is designed to readily change, on a frequency basis, the output level of a second sound emitted from the second sound source 6, which is a major difference from the sound reproduction system 1 according to the first embodiment. In the other respects, however, the sound reproduction system 1B has the same configuration as the counterpart of the first embodiment. Thus, in the following description, any constituent member of this second embodiment, having the same function as the counterpart of the first embodiment described above, will be designated by the same reference numeral as that counterpart's, and a detailed description thereof will be omitted herein.
A sound reproduction system 1B according to the second embodiment includes a main computer 2B and at least one loudspeaker 31-3n (where n=1, 2, and so on) as shown in
The characteristic changing units 24 may be each implemented as an equalizer with the ability to change the output level of a sound on a frequency basis, for example. Specifically, each of the characteristic changing units 24 changes, on a frequency basis, the gain of an audio signal (data) representing the second sound and supplied from an associated one of the second control filters 22. According to this embodiment, the frequency characteristics of ambient sounds (including a road noise and a wind noise) for a traveling passenger car (which is an exemplary mobile object 10) are stored in advance in the characteristic changing units 24. As used herein, the “frequency characteristics” refer to the gains for respective frequency bands of signals representing the ambient sounds. The characteristic changing units 24 change the frequency characteristics of the second sound adaptively to the frequency characteristics of the ambient sounds. Specifically, the characteristic changing units 24 change, on a frequency basis, the gain of an audio signal representing the second sound such that the gains of the ambient sounds for a given frequency band match the gain of the second sound for that frequency band. As used herein, if some value “matches” another value, these two values may naturally perfectly match each other, but may also match each other only imperfectly.
The sound reproduction system 1B according to this embodiment allows the second sound to more closely simulate the ambient sounds by changing, on a frequency basis, the output level of the second sound adaptively to the ambient sounds. This prevents the non-object persons P2-P4 from finding the second sound unnatural, while making a component of the first sound less clearly audible to the non-object persons P2-P4.
In the embodiment described above, the output level of the second sound is changed on a frequency basis as an exemplary frequency characteristic of the second sound. However, this is only an example and should not be construed as limiting. For example, in a situation where the frequency of the road noise varies as the velocity of the mobile object 10 changes, the frequency of the second sound itself may be changed. In other words, the frequency of the second sound may be changed as an exemplary frequency characteristic of the second sound.
In this embodiment, the characteristic changing units 24 form part of the sound reproduction system 1B. However, this is only an example and should not be construed as limiting. Alternatively, the characteristic changing units 24 may also be provided outside of the sound reproduction system 1B.
Optionally, any of the configurations just described for this second embodiment (including variations thereof) may be combined as appropriate with any of the configurations described above for the first embodiment (including variations thereof).
A sound reproduction system 1C according to a third embodiment includes an information acquisition unit 25 configured to acquire information about the velocity of the mobile object 10, which is a major difference from the sound reproduction system 1B according to the second embodiment. In the other respects, however, the sound reproduction system 1C has the same configuration as the counterpart of the second embodiment. Thus, in the following description, any constituent member of this third embodiment, having the same function as the counterpart of the second embodiment described above, will be designated by the same reference numeral as that counterpart's, and a detailed description thereof will be omitted herein.
A sound reproduction system 1C according to this embodiment includes a main computer 2C and at least one loudspeaker 31-3n (where n=1, 2, and so on) as shown in
The information acquisition unit 25 may acquire information about the velocity of the mobile object 10 from a main computer of the mobile object 10, for example.
The characteristic changing units 24 changes, on a frequency basis, the output level of the second sound in accordance with the information, provided by the information acquisition unit 25, about the velocity of the mobile object 10. In other words, the characteristic changing units 24 change the frequency characteristic of the second sound in accordance with external information.
The sound reproduction system 1C according to this embodiment is allowed to change the frequency characteristic of the second sound adaptively to the velocity of the mobile object 10. This prevents the non-object persons P2-P4 from finding the second sound unnatural, while making a component of the first sound less clearly audible to the non-object persons P2-P4.
Optionally, any of the configurations just described for this third embodiment (including variations thereof) may be combined as appropriate with any of the configurations described above for the first and second embodiments (including variations thereof).
A sound reproduction system 1D according to a fourth embodiment includes an analysis unit 26 configured to analyze, on a frequency basis, the output level of an ambient sound picked up by a microphone 4, which is a major difference from the sound reproduction system 1B according to the second embodiment. In the other respects, however, the sound reproduction system 1D has the same configuration as the counterpart of the second embodiment. Thus, in the following description, any constituent member of this fourth embodiment, having the same function as the counterpart of the second embodiment described above, will be designated by the same reference numeral as that counterpart's, and a detailed description thereof will be omitted herein.
A sound reproduction system 1D according to this embodiment includes a main computer 2D and at least one loudspeaker 31-3n (where n=1, 2, and so on) as shown in
The microphone 4 is attached to the mobile object 10 to pick up ambient sounds (such as a road noise and a wind noise) from around the mobile object 10. The microphone 4 converts the ambient sounds thus picked up into an electrical signal and output the electrical signal to the analysis unit 26.
The analysis unit 26 analyzes, on a frequency basis, the output levels of the ambient sounds in accordance with the electrical signal supplied from the microphone 4.
The characteristic changing units 24 change, on a frequency basis, the output level of the second sound based on the result of analysis by the analysis unit 26. Specifically, the characteristic changing units 24 change, on a frequency basis, the gain of an audio signal representing the second sound such that the output levels (gains) of the ambient sounds for a given frequency band match the output level (gain) of the second sound for that frequency band. As used herein, if some value “matches” another value, these two values may naturally perfectly match each other, but may also match each other only imperfectly.
The sound reproduction system 1D according to this embodiment changes the frequency characteristic of the second sound based on actual ambient sounds picked up by the microphone 4, and therefore, allows the second sound to even more closely simulate the ambient sounds than the sound reproduction system 1B according to the second embodiment does.
In the fourth embodiment, a single microphone 4 and a single analysis unit 26 are provided. However, this is only an example and should not be construed as limiting. Alternatively, a plurality of microphones 4 and a plurality of analysis units 26 may be provided. Also, the number of the microphones 4 provided may be either the same as, or different from, that of the analysis units 26 provided.
Optionally, the information acquisition unit 25 described for the third embodiment and the microphone 4 and analysis unit 26 described for this embodiment may be used in combination.
Furthermore, any of the configurations just described for this fourth embodiment (including variations thereof) may be combined as appropriate with any of the configurations described above for the first, second, and third embodiments (including variations thereof).
(Resume)
As can be seen from the foregoing description of embodiments, a sound reproduction system (1, 1A-1D) according to a first aspect of the present disclosure is configured to emit a first sound and a second sound from a loudspeaker (3) at a time. The first sound is intended to reach ears of an object person's (P1). The second sound is intended to reach ears of a non-object person's (P2-P4) and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker (3) toward a first region (Re1) occupied by the object person (P1) and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker (3) toward a second region (Re2-Re4) occupied by the non-object person (P2-P4) and has a sound pressure equal to the predetermined value.
According to this configuration, the sound pressure of a component, emitted toward the first region (Re1), of the second sound is set at a relatively low pressure, and the sound pressure of another component, emitted toward the second region (Re2-Re4), of the second sound is set at a relatively high pressure. This makes a component of the first sound clearly audible in the first region (Re1) and another component of the first sound less clearly audible in the second region (Re2-Re4).
In a sound reproduction system (1, 1A-1D) according to a second aspect, which may be implemented in conjunction with the first aspect, the first sound compliant with a first control characteristic and the second sound compliant with a second control characteristic different from the first control characteristic are emitted from the loudspeaker (3) at a time. The first control characteristic is defined such that the first sound includes two components, one of which is emitted from the loudspeaker (3) toward the first region (Re1) and the other of which is emitted from the loudspeaker (3) toward the second region (Re2-Re4) and has a lower sound pressure than the former component. The second control characteristic is defined by the control characteristic.
According to this configuration, the sound pressure of the other component, emitted toward the second region (Re2-Re4), of the first sound is also set at a relatively low pressure. This makes the other component of the first sound even less clearly audible in the second region (Re2-Re4).
In a sound reproduction system (1, 1A-1D) according to a third aspect, which may be implemented in conjunction with the first or second aspect, the first region (Re1) is included in a first space (SP1) provided to accommodate the object person (P1). The second region (Re2-Re4) is included in a second space (SP2-SP4) provided to accommodate the non-object person (P2-P4). The first space (SP1) and the second space (SP2) are included in an object space (SP10).
This configuration makes a component of the first sound clearly audible to the object person (P1), and another component of the first sound less clearly audible to the non-object person (P2-P4), in the object space (SP10).
In a sound reproduction system (1, 1A-1D) according to a fourth aspect, which may be implemented in conjunction with the third aspect, the object space (SP10) includes a plurality of the first spaces (SP1).
This configuration allows a plurality of object persons (P1) to catch the first sound.
In a sound reproduction system (1, 1A-1D) according to a fifth aspect, which may be implemented in conjunction with any one of the second to fourth aspects, the second control characteristic is determined by Null-space based sound field control (NBSFC).
This configuration makes the sound pressure of a component, emitted toward the first region (Re1), of the second sound lower than the predetermined pressure, and also makes the sound pressure of another component, emitted toward the second region (Re2-Re4), of the second sound equal to the predetermined pressure.
In a sound reproduction system (1, 1A-1D) according to a sixth aspect, which may be implemented in conjunction with any one of the second to fifth aspects, the first control characteristic is determined by a weighted least squares method.
This configuration makes the sound pressure of a component, emitted toward the second region (Re2-Re4), of the first sound lower than the sound pressure of another component, emitted toward the first region (Re1), of the first sound.
In a sound reproduction system (1B-1D) according to a seventh aspect, which may be implemented in conjunction with any one of the first to sixth aspects, a characteristic changing unit (24) is configured to change a frequency characteristic of a given sound. The sound reproduction system (1B-1D) allows the characteristic changing unit (24) to change a frequency characteristic of the second sound adaptively to an ambient sound.
This configuration allows the second sound, emitted from the loudspeaker (3), to closely simulate an ambient sound, thus preventing the non-object person (P2-P4) from finding the second sound unnatural.
A sound reproduction system (1C) according to an eighth aspect, which may be implemented in conjunction with the seventh aspect, allows the characteristic changing unit (24) to change the frequency characteristic of the second sound in accordance with external information.
This configuration allows the second sound to even more closely simulate the ambient sound in accordance with the external information.
A sound reproduction system (1D) according to a ninth aspect, which may be implemented in conjunction with the seventh or eighth aspect, further includes an analysis unit (26) configured to analyze, on a frequency basis, an output level of the ambient sound picked up by a microphone (4). The sound reproduction system (1D) allows the characteristic changing unit (24) to change, based on a result of analysis by the analysis unit (26), the output level of the second sound on a frequency basis.
This configuration allows the second sound to even more closely simulate the ambient sound based on a result of analysis by the analysis unit (26).
A mobile object (10) according to a tenth aspect includes the sound reproduction system (1, 1A-1D) according to any one of the first to ninth aspects, and a mobile object body (100) equipped with the loudspeaker (3).
This configuration makes a component of the first sound clearly audible to the object person (P1) and another component of the first sound less clearly audible to the non-object person (P2-P4) in the mobile object (10).
A sound reproduction method according to an eleventh aspect is designed to emit a first sound and a second sound from a loudspeaker (3) at a time. The first sound is intended to reach ears of an object person's. The second sound is intended to reach ears of a non-object person's and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker (3) toward a first region (Re1) occupied by the object person (P1) and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker (3) toward a second region (Re2-Re4) occupied by the non-object person (P2-P4) and has a sound pressure equal to the predetermined value.
According to this configuration, the sound pressure of a component, emitted toward the first region (Re1), of the second sound is set at a relatively low pressure and the sound pressure of another component, emitted toward the second region (Re2-Re4), of the second sound is set at a relatively high pressure. This makes a component of the first sound clearly audible in the first region (Re1) and another component of the first sound less clearly audible in the second region (Re2-Re4).
In a sound reproduction system (1B, 1C) according to a twelfth aspect, which may be implemented in conjunction with the seventh aspect, the characteristic changing unit (24) changes a frequency of the second sound as the frequency characteristic of the second sound.
According to this configuration, changing the frequency of the second sound in a situation where the frequency of a road noise is variable with the velocity of the mobile object (10), for example, allows the second sound to more closely simulate the road noise.
A program according to a thirteenth aspect is designed to make a computer system perform processing of emitting a first sound and a second sound from a loudspeaker (3) at a time. The first sound is intended to reach the ears of an object person's (P1). The second sound is intended to reach the ears of a non-object person's (P2-P4) and compliant with a control characteristic. The control characteristic is defined such that the second sound includes a component which is emitted from the loudspeaker (3) toward a first region (Re1) occupied by the object person (P1) and has a sound pressure lower than a predetermined value, and another component which is emitted from the loudspeaker (3) toward a second region (Re2-Re4) occupied by the non-object person (P2-P4) and has a sound pressure equal to the predetermined value.
According to this configuration, the sound pressure of a component, emitted toward the first region (Re1), of the second sound is set at a relatively low pressure and the sound pressure of another component, emitted toward the second region (Re2-Re4), of the second sound is set at a relatively high pressure. This makes a component of the first sound clearly audible in the first region (Re1) and another component of the first sound less clearly audible in the second region (Re2-Re4).
Note that the configurations according to the second to ninth aspects and the twelfth aspect are not essential constituent elements of the sound reproduction system (1, 1A-1D) but may be omitted as appropriate.
While various embodiments have been described herein above, it is to be appreciated that various changes in form and detail may be made without departing from the spirit and scope of the present disclosure presently or hereafter claimed.
The entire contents of Japanese Patent Application No. 2017-209662 mentioned above are incorporated by reference for all purposes.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-209662 | Oct 2017 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20140056431 | Kano | Feb 2014 | A1 |
| 20150189438 | Hampiholi | Jul 2015 | A1 |
| 20150256933 | Vautin | Sep 2015 | A1 |
| 20170048606 | Fan | Feb 2017 | A1 |
| 20170085990 | Sladeczek | Mar 2017 | A1 |
| 20170193976 | Mohammad | Jul 2017 | A1 |
| 20180190282 | Mohammad | Jul 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 2013099093 | Jul 2013 | WO |
