This application relates to methods and apparatus for operating digital microphones, and in particular to digital microphones operable to detect higher band acoustic and/or ultrasonic frequencies, especially for machine-to-machine communication.
Digital microphones are known and are increasingly being used in some applications, such as for portable electronic devices.
The conversion block comprises an analogue-to-digital converter 106 to convert the amplified microphone signal output from the amplifier 103 into a digital signal. In some instances the output of the ADC 106 may be used directly as the output DATA of the digital microphone 101, but in some instances the digital signal produced by the ADC 106 may be re-coded or modulated by a coder 107 into a particular data format, such as an oversampled PDM data stream. In some instances the function of the ADC 106 and coder 107 may be combined so that the conversion block 104 is a 1 bit PDM ADC.
In use the digital microphone will be coupled to an audio circuit 108, such as an audio codec. The audio codec 108 is part of a host electronic device (not illustrated) such as a mobile telephone or the like. The digital microphone 101 may also be part of the host device and thus the digital microphone may be connected to the codec via some suitable internal connective path. In general it is also known that a peripheral apparatus such as a headset or the like, which may be coupled to the host via some suitable connector such as a jack plug and socket or a USB connector, may comprise a digital microphone that, in use, communicates with the audio codec 108.
The audio codec 108 receives the data signal, DATA, output from digital microphone 101. The data signal DATA may comprise data bits output from the conversion block 107. Conventionally there may be limited signal processing in the digital microphone itself and, as mentioned the output DATA from the digital microphone may typically be an oversampled PDM data stream, although in some instances the modulator 107 may modulate the data to a PCM format.
The audio codec 108 may also control operation of the digital microphone 101. The audio codec 108 may provide a supply or bias voltage VDD to the digital microphone 101. Typically the digital microphone 101 may be controlled to be in a powered-up or powered-down state by the supply voltage VDD. The digital microphone 101 may also have a sleep mode where it is powered by the supply voltage VDD but is effectively inactive.
In use in an active state the audio codec 108 may provide the digital microphone 101 with a clock signal CLK which is used for clocking the conversion block 104, e.g. ADC 106 and coder 107. The clock signal CLK provided by the audio codec 108 thus defines the bit rate of the output DATA signal in use.
As noted above the output (DATA) from the digital microphone 101 may be an oversampled PDM data stream. In some instances an oversampling ratio of around 64, for example, may be used. For a bandwidth of 24 kHz, comparable to a 48 kHz PCM signal, the sample rate for the PDM stream may be about 3.1 MHz. Thus the audio codec 108 may supply the clock signal CLK at around 3.1 MHz in use. Such a frequency of clock signal may be suitable for good quality audio.
In some instances however ultrasonic or near ultrasonic frequencies may be of interest. Ultrasonic detection has been proposed for uses such as proximity detection or gesture recognition where the host device may transmit ultrasonic waves and monitor for any reflection from a nearby object using a digital microphone. It has also been proposed to use ultrasonic or near ultrasonic frequencies as part of device-to-device communications.
In order that such ultrasonic and near-ultrasonic frequencies can be adequately recovered from the data signal DATA outputted by the digital microphone 101, the clock frequency required may be relatively high. For instance in some ultrasonic use cases a clock frequency of 5 MHz or so may be required for a conventional digital microphone.
Generally the higher the clock frequency the more power is consumed by the digital microphone 101 and also the downstream processing and the power required to transmit the digital signal DATA down a physical link. A high clock rate is thus undesirable, especially if the requirement to detect ultrasonic activity may be required for long periods of time even when there may be no activity to detect, e.g. a type of always on functionality listening for any activity.
Thus according to an aspect of the invention there is provided a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
The third frequency band may be different to and higher than the first frequency band. In some embodiments the third frequency band may be adjacent to the first frequency band.
The first frequency band may comprise a frequency range corresponding to voice audio and the second frequency band comprises a frequency range corresponding to ultrasonic frequencies.
The second signal path may comprise a mixer for mixing the signals in the second signal path with an oscillator signal. The second signal path may also comprise a band-pass filter downstream of the mixer with a pass-band corresponding to the third frequency band. The frequency of the oscillator signal may be offset from the centre frequency of the second frequency band by an amount defined by the third frequency band. A band-pass filter may be located upstream of the mixer with a pass-band corresponding to the second frequency band. In some embodiments the frequency of the oscillation signal may be variable, e.g. the modulation block may comprise an oscillator for generating the oscillation signal wherein the oscillator is configured such that the frequency of the oscillation signal is variable. At least one of the band splitter and the modulation block may be configured such the second frequency band is variable.
The modulation block may comprise a band controller for varying the second frequency band and detecting whether the second frequency band corresponds to any significant activity in the microphone signal. The band controller may detect whether the second frequency band corresponds to any significant activity in the microphone signal by detecting any significant signal component in the output of the band-pass filter. Alternatively the band controller may detect whether the second frequency band corresponds to any significant activity in the microphone signal by detecting any significant signal component in the down-converted signals in the third frequency band.
The microphone signal may be a digital microphone signal. The digital microphone signal may have a lower quantisation noise in the second band of frequencies than the digital output signal. The apparatus may include an analogue-to-digital converter for receiving an analogue microphone signal and producing the digital microphone signal.
The apparatus may comprise a coder block for receiving signals from the first and second signal paths and encoding the signals to provide said digital output signal. The coder block may be operable so that the digital output signal is encoded in a 1 bit oversampled PDM format.
The apparatus may comprise a microphone transducer, the microphone signal being derived from microphone transducer. The microphone transducer may be a MEMS capacitive microphone.
Embodiments relate to an electronic device comprising a digital microphone apparatus as described in any of the variants above and further comprising an audio codec, the audio codec being configured to, in use, receive the digital output signal. Embodiments also relate to an electronic device comprising a digital microphone apparatus as described in any of the variants above. The electronic device may be at least one of: a portable device, a battery powered device, a mobile telephone, an audio player, a video player, a computing device, a laptop, tablet or notebook computer, a games device, a wearable device and a voice activated device.
In another aspect there is provided a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
a first signal path for frequencies in a first band; and
a second signal path for frequencies in a second band, the frequencies of the second band being higher than the frequencies in the first band;
wherein the second signal path comprises a modulation block configured to down-convert signals to a third frequency band, wherein the third frequency band extends across a frequency range that is lower than the second frequency band.
In another aspect there is provided a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
a band splitter configured to receive a microphone signal indicative of an output of a microphone transducer and split said microphone signal into first signal path for frequencies in a first band and a second signal path for frequencies in a second band, the frequencies of the second band being higher than the frequencies in the first band; and
a modulation block configured to apply a selective gain modulation to signals in the second signal path.
The modulation block may comprise a gain element in the second signal path and a gain controller for controlling a gain setting of the gain element. The modulation block may comprise a detector for detecting the power of any signal component in the second frequency band, wherein the gain controller is responsive to said power detector to control the gain setting. The controller may be configured to control the gain setting according to a predetermined transfer function of gain setting versus an output signal of said power detector.
The controller may be configured to control the gain setting based on the detected power of any signal component in the second frequency band so as to achieve a predetermined signal-to-noise ratio for such signal component in the digital output signal. The controller may be configured such that, for any signal components in the second frequency band where the detected power is above the threshold the gain setting is controlled to maintain a constant power output of the gain modulated signals in the second signal path.
The second signal path may comprise a band-pass filter upstream of the gain element with a pass-band corresponding to the second frequency band. The band-pass filter in the second signal path may be configured so that its pass-band is variable. The modulation block may comprise a band controller for varying the pass band of the band-pass filter and detecting any significant activity in the signal output from the band-pass filter.
The digital microphone apparatus of this aspect may comprise a coder block for receiving signals from said first and second signal paths and encoding the signals to provide said digital output signal. The coder block may be operable so that the digital output signal is encoded in a 1 bit oversampled PDM format.
The microphone signal may be a digital microphone signal. There may be analogue-to-digital converter for receiving an analogue microphone signal and producing the digital microphone signal.
The apparatus may include a microphone transducer, the microphone signal being derived from the microphone transducer. The microphone transducer may be a MEMS capacitive microphone.
An electronic device may comprise a digital microphone apparatus according to this aspect and an audio codec, the audio codec being configured to, in use, receive the digital output signal. An electronic device including a digital microphone apparatus according to this aspect may comprise at least one of: a portable device, a battery powered device, a mobile telephone, an audio player, a video player, a computing device, a laptop, tablet or notebook computer, a games device, a wearable device and a voice activated device.
In a further aspect there is provided a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
In another aspect there is provided a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
a band splitter configured to receive a microphone signal indicative of an output of a microphone transducer and split said microphone signal into first signal path for frequencies in a first band and a second signal path for frequencies in a second band, the frequencies of the second band being higher than the frequencies in the first band;
a coder configured to coder block for receiving signals from said first and second signal paths and encoding said signals to provide said digital output signal and a modulation block configured to control an encoding scheme used by said coder based on the signals in the second signal path.
Also provided is a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal, the apparatus comprising:
The invention will now be described by way of non-limiting example only, with reference to the accompanying drawings, of which:
As noted above a conventional digital microphone 101 such as illustrated in
In the audio codec 108, in order to recover the audio signals, the received DATA signal will typically be low-pass filtered and decimated to a higher-bit, lower sample rate format such as PCM (pulse-code-modulation) for example. A first signal band of interest may therefore be defined by the sample rate of the filtered and recoded PCM data. For standard telephony applications the sample rate may be around 8 kHz, allowing a signal band up to 4 kHz.
Provided the sample rate of the PDM data stream is set to be high enough most of the quantisation noise in the received PDM data stream DATA is outside of this audio band of interest and is removed by the subsequent low-pass filtering in the audio codec 108. For example
This noise will thus be present in the PDM data stream DATA output from the digital microphone making it difficult for the audio codec to recover information regarding any frequency components in this range—without relatively long term averaging to average out the random noise components, which may not be appropriate in many instances.
Conventionally to avoid significant noise in this ultrasonic frequency band the sample rate of the PDM data stream DATA may be increased, by increasing the frequency of the clock signal CLK, so that the noise is shaped to even higher frequencies.
Operating at very high clock frequencies, such as 5 MHz or higher, does however have an impact on power and requires use of high speed components.
Embodiments of the disclosure thus relate to methods and apparatus for digital microphones that encode a microphone signal indicative of incident pressure waves on a microphone transducer. The digital microphone encodes the output data in such a way so as to provide an acceptable signal-to-noise ratio (SNR) for relatively high frequencies in the microphone signal, e.g. ultrasonic and near ultrasonic frequencies, without having to use a very fast sample rate, e.g. a sample rate that shapes quantisation noise substantially to frequencies higher than the high frequency band of interest. The embodiments described thus improve the SNR for signals of interest in the high frequency band of the microphone signal, effectively improving the contrast of such signals, i.e. making the signals of interest distinct from the noise.
Various embodiments of the disclose use different techniques to improve the SNR for the high frequency signals of interest in the microphone signal. In some embodiments the high frequency signals of interest may be down-converted to a lower frequency. The down-converted signals may be down-converted to a frequency range that suffers from less quantisation noise when coded and output from the digital microphone. In some embodiments a gain may be selectively applied to the high frequencies of interest to emphasise such signals.
Some embodiments of the disclosure relate to a digital microphone apparatus for outputting a digital output signal at a sample rate defined by a received clock signal. The apparatus includes a band splitter which receives a microphone signal indicative of an output of a microphone transducer and splits the microphone signal into first signal path for frequencies in a first band and a second signal path for frequencies in a second band, the frequencies of the second band being higher than the frequencies in the first band. A modulation block is configured to operate on the second signal path such that any component of the microphone signal in the second frequency band has an acceptable SNR in the digital output signal without requiring an unduly high clock rate.
A band-splitter 302 receives the digital microphone signal SMD and outputs band-split signals in first and second signal paths. The first signal path is for signal components having frequencies in a first band, which may be an audio band of interest. The first signal path may for instance be for frequencies below a first cut-off frequency and the signal SP1, in the first signal path may be low-pass filtered by the band-splitter 302. The second signal path is for signal components having frequencies in a different, higher frequency band which may be a frequency band for ultrasonic and/or near-ultrasonic frequencies of interest, for instance frequencies of around 18 kHz or above. The second signal path may for instance be for frequencies above a second cut-off frequency and the signal SP2 in the second signal path may be high-pass filtered by the band-splitter 302. The second cut-off frequency may be the same or different to the first cut-off frequency.
The signals in the first signal path may be provided to a coder block 303. The signals in the second signal path however are input to a modulation block 304 before being passed to the coder block. The modulation block 304 modulates the signal in the second signal path and/or the operation of the coder 303 to effectively improve the contrast or SNR of signals of interest in the second frequency band.
The coder 303 receives the signals SP1 and SP2 from the first and second signal paths and recodes the data into a desired format which is outputted as a digital output signal DATA. The coder 303 may be operable in a PDM output mode where the digital output signal DATA is a PDM data stream with a sample rate defined by the received clock signal CLK. In PDM output mode the coder block 303 may recombine the signals from the first and second signal paths and re-code the combined signal into PDM format.
In some embodiments the modulation block 304 operates to down-convert signals in the second frequency band to lower frequencies. The modulation block may down-convert signals in the second frequency band to a third frequency band. The third frequency band may be a frequency band which extends across a frequency range that is lower than the second frequency band but which is different to and higher than the first frequency band.
For example consider a voice band of interest extends from 0 to 4 kHz. Signals in a second frequency band of 18-22 kHz for example may be down-converted to signals in the third frequency band 403, which may for instance extend from 4-8 KHz. The signals of interest (i.e. any signals in the audio band together with any ultrasonic/near-ultrasonic signals) are thus encoded in a combined frequency band up to 8 kHz, corresponding to a Nyquist PCM sampling rate of 16 kHz. For an oversampled PDM data stream with an oversampling ratio of about 64 a sample rate of 1.024 MHz would thus allow the signals of interest to be encoded satisfactorily with good SNR.
It will of course be appreciated that any practical filter used for band splitting will transition from the passband to the non-passband over a range of frequencies and there is not a precise cut-off frequency or boundary at one particular frequency where the signal attenuation transitions from 0% to 100%. For the present disclosure the boundary of a frequency band defined by a filter or band-splitter may be taken to be the frequency at which a certain level of attenuation of signal components is achieved, say the −40 dB point for example. Thus in the example above the 4 kHz upper boundary of the first frequency band may correspond, for example, to the −40 dB point of a relevant low-pass filter.
The audio codec receiving the digital output signal DATA can then band-split the signal into the first and third frequency bands and convert to appropriately coded signals, e.g. PCM coded. If required the received signals in the third frequency band can be up-converted back to their native frequency, although in some embodiments it may be preferable to process the signals in that frequency band or convert to some other intermediate frequency.
A signal component in the second frequency band, say at 19 kHz for example, will thus be mixed with the oscillator signal and will generate a component in the mixed signal within the third frequency band, e.g. at 5 kHz in this example. This will be passed by the second band-pass filter as a 5 kHz signal. In this way the 19 kHz signal in the microphone signal is down-converted to a 5 kHz signal. It will of course be appreciated that the frequency of the oscillation signal could be offset to be higher than the centre frequency of the second frequency band of interest in the microphone signal, e.g. the oscillation signal OSC frequency could be set to be at a frequency 26 kHz. In some embodiments, especially if the oscillation signal is set to be offset higher than the centre frequency of the second frequency band of interest, a first band-pass filter 501 may be omitted.
This down-converted signal may then be recombined with the signal SP1 from the first signal path and input to a PDM modulator 503 to produce the digital output signal DATA.
It will of course be appreciated that
The second frequency band of interest may be a defined band which is relatively narrow. For instance a frequency band of around 18 to 20 kHz has been proposed for machine-to-machine communication. In some applications tones in this frequency band, which are generally inaudible, may be broadcast by one device to enable functionality or initiate a mode of operation of a portable electronic device, such as a smart phone or the like. Were this the only ultrasonic or near-ultrasonic band of interest then the first pass-band and frequency of the oscillation signal OSC may be pre-defined and may be substantially fixed in use. In some instances however there may be various different high frequency bands of interest. For example a frequency band around 20 kHz may be used for machine-to-machine communication and a frequency band around say 40 kHz may be of interest for object detection, e.g. for gesture recognition or proximity detection or the like.
Down-converting the entirety of such a frequency range, e.g. 18 to 45 kHz, may not be practical in a single down-conversion path and in any case even the down-converted signals would require significant bandwidth.
In practice it may be unlikely that a device needs to detect signals in different ones of such ultrasonic frequency bands simultaneously. In some embodiments therefore the second frequency band of interest in the second signal path may be variable. In some embodiments a relatively narrow second frequency band of interest may be scanned over a wider frequency range and the modulation block 304 may detect if there is any significant energy content in the microphone signal in that second frequency band. Thus for example the modulation block may comprise a band controller 504. The band-controller may vary the frequency of the oscillation signal in a controlled manner over time, for instance by varying the frequency in a defined sequence or performing a frequency sweep. If a first band-pass filter 501 is present and relatively narrow band the pass-band of the first band-pass filter 501 may be adjusted appropriately for the variation in oscillation frequency. The band controller 504 may detect any significant activity in the output of second band-pass filter 502. If a significant signal component in the output of the second band-pass filter is detected, indicating significant activity in the microphone signal in the band of interest, then the relevant oscillation signal frequency may be maintained for as long as there is significant activity in that band. Additionally or alternatively where the pass band of the first band-pass filter 501 is varied over time the output of the first band-pass filter 501 may be monitored for any significant activity.
As illustrated in
In some instances however the coder block 303 may additionally or alternatively be operable to provide other data output formats. For example in some embodiments the coder 303 may be operable in a multi-channel data format where separate data channels may be transmitted in a time division manner and/or according to some frame format. For instance the coder 303 may be operable in a mode using the known Soundwire™ data format or other similar formats. In such an embodiment where multiple channels of data can be transmitted it would be possible to send data from the first and second signals paths as separate channels. Thus the data from the first signal path could be transmitted as a first channel of data. In order to encode signals in the voice audio band of 0 Hz to 4 kHz a sample rate of 8 kHz for that data channel would be required. The data from the second signal path could be transmitted as a second channel of data. As the second channel is transmitted separately from the first channel there is no need to combine the signals from the first and second signal paths. As such the third frequency band to which the relevant ultrasonic or near ultrasonic signals are down-converted in the second signal path may at least partly overlap with the first frequency band. Thus in this embodiment the third frequency band also extend from 0 Hz to 4 kHz say, again thus requiring a sample rate for data in the second channel of 8 kHz. To send both channels of data thus requires a combined sample rate of 16 kHz.
As an alternative to down-converting signals in the second signal band a gain may applied to signals in the second frequency band of interest, if present, to increase the contribution of such signals. Increasing the gain of the signal in the second signal band increases the signal component in that band, helping detection in that band. An increased gain is only applied in the relevant band and thus does not overload the coder or distort the audio band signal.
As described above in some instances the second frequency band of interest may be a known relatively narrow band in which case the band-splitter may pass only frequencies in the second frequency band to the second signal path or there may be a band-pass filter 604 in the second signal path to define the second frequency band. As also described above in some instances there may be a relatively wide range of frequencies of interest or separate bands in the near ultrasonic or ultrasonic range. In some embodiments there the controller may also be configured to vary the pass-band of a band-pass filter 604 in a similar fashion to that described previously until the power of a signal component in that frequency band is detected to above a threshold level by detector 603, at which point an appropriate gain setting may be applied as necessary.
In this way even though there may be noise in the relevant frequency band in the digital output signal DATA any significant signal components are emphasised as necessary to provide a reasonable SNR. Thus the audio codec can recover data regarding such signal components without requiring long time averaging. This may at least allow the audio codec or some other module receiving the data, to identify the presence of signals of interest in the higher frequency band, at which point it may be configured to increase the frequency of the clock signal to the digital microphone. In this way a relatively low frequency may be used for the clock signal supplied to the digital microphone until any ultrasonic activity is detected at which point the frequency of the clock signal may be increased. The higher frequency clock signal results in lower noise in the frequency band of interest but consumes more power but is only used once ultrasonic activity is detected.
As an alternative or addition to the methods described above in some embodiments the digital microphone apparatus may operate to vary the noise transfer function (NTF) of the digital microphone so as provide a first pass-band for signals in a first frequency band, e.g. an audio band, and a second pass-band for signals in a second frequency band, e.g. an ultrasonic and/or near ultrasonic band. This principle is illustrated in
If the only second frequency band of interest were a predefined relatively narrow band of interest it may be possible to operate in a mode where a predetermined coding scheme is used to provide a predetermined NTF with effectively a notch or stop-band at the defined second frequency band. As discussed above however in practice there may be a range of ultrasonic and/or near-ultrasonic frequencies of possible interest and it may not be possible to provide low noise across the entirety of such a range. As also discussed above however in practice it may be unlikely that a device needs to detect signals in different ultrasonic frequency bands simultaneously. In some embodiments therefore the modulation block 304 may identify any activity in a relatively narrow second frequency band within the general range of interest and then control the coding scheme used to implement an appropriate NTF as illustrated in
For all of the embodiments discussed above the digital microphone apparatus 300 may be operable in an ultrasonic contrast enhancement mode such as described to improve the SNR and/or contrast of any signals in an ultrasonic or near ultrasonic band of interest. In some embodiments the digital microphone apparatus may also be operable in a non-ultrasonic contrast enhancement mode of operation where the signal may not be split into separate signal bands. In other words the ability to provide the ultrasonic emphasis, whether through down-conversion, selective gain application and/or vary the NTF of the coding scheme may be able to be selectively disabled. The mode of operation may be signalled to the digital microphone and may, for example by controlled by the audio codec, for instance by varying the frequency of the clock signal or via some other signalling method.
In the embodiments described above the band-splitter 302 acts on the digital microphone signal SMD that is output from the ADC 301. This is a convenient and practical arrangement but it would be possible to apply band splitting to the analogue microphone signal SMA and convert separately to digital in each of the first and second signal paths.
Embodiments of the invention therefore relate to digital microphones that are operable to provide a digital data output that allows information regarding relatively high frequencies of interest, e.g. ultrasonic and near-ultrasonic frequencies, to be readily recoverable but without requiring very high clock rates. Such frequencies may correspond to frequency bands used for machine-to-machine communication. In general embodiments operate by splitting a relatively high quality microphone signal, indicative of the output of the microphone transducer, into high and low frequency paths and processes the high frequency path separately from the low frequency path so as to improve the ability to recover signals in (at least part of) the high frequency band from the output of the digital microphone (compared to the absence of such processing).
The digital microphone in use will be connected to suitable audio circuitry such as an audio codec of a host device. Such a digital microphone may be implemented in an electronic apparatus or host device, especially a portable and/or battery powered host device such as a mobile telephone, an audio player, a video player, a PDA, a mobile computing platform such as a laptop computer or tablet and/or a games device for example. This host device comprises an audio codec which may be connected to one or more on-board digital microphones according to embodiments of the invention. The audio codec may receive the digital data output signal output from the digital microphone and convert it to another format, such as PCM coding.
The audio codec may vary the clock signal CLK supplied to the digital microphone(s) to vary the operation of the digital microphone. The mode of operation may in some instances be specified by an applications processor. Data received from the digital microphone(s) in use may be communicated to the applications processor and/or stored in a memory and/or relayed to a communication module, e.g. for wireless transmission.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. The word “comprising” does not exclude the presence of elements or steps other than those listed in a claim, “a” or “an” does not exclude a plurality, and a single feature or other unit may fulfil the functions of several units recited in the claims. Any reference numerals or labels in the claims shall not be construed so as to limit their scope. Terms such as amplify or gain include possibly applying a scaling factor of less than unity to a signal.
Number | Date | Country | Kind |
---|---|---|---|
1611401.9 | Jun 2016 | GB | national |
Number | Date | Country | |
---|---|---|---|
62300599 | Feb 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15439401 | Feb 2017 | US |
Child | 16289885 | US |