Electronic device with a wake up module distinct from a core domain

Abstract

An electronic device includes an appended module coupled to a core having a standby state comprising a first power supply circuit, a first clock and a circuit that recognizes multiple vocal commands timed by the first clock. The appended module includes a second power supply circuit independent of the first power supply circuit, a second clock independent of the first clock and having a frequency lower than that of the first clock, digital unit timed by the second clock including a sound capture circuit that delivers a processed sound signal, and a processing unit configured in order, in the presence of a parameter of the processed sound signal greater than a threshold, to analyze the content of the processed sound signal and to deliver, when the content of the sound signal comprises a reference pattern, an activating signal to the core that can take it out of its standby state.

Description

TECHNICAL FIELD

Embodiments of the present invention relate to an electronic device comprising a wake up module distinct from a core domain.

BACKGROUND

Electronic apparatuses, notably mobile cellular telephones, smart watches and smart glasses, increasingly comprise modules making it possible to carry out a voice recognition function. This function notably makes it possible to control the electronic apparatus vocally.

In order that the apparatus can detect vocal commands at any time, it is desirable to monitor and detect the signals in the environment of the apparatus and notably in its sound environment.

Electronic apparatuses operating on battery power such as mobile cellular telephones are confronted with a problem related to the optimizing of energy consumption during continuous monitoring of the sound environment searching for possible vocal commands.

In order to economize the battery of an electronic apparatus, the latter generally comprises a standby mode in which the electrical power supply is maintained at the minimum in order to keep a minimum of electronic elements operating.

However, when the electronic apparatus is on standby, the latter must come out of its standby state before being able to carry out the process related to the vocal command. A user generally wishes to be able to access the functionalities of the apparatus quickly. It is the therefore necessary to be able to come out of the standby state quickly in order to respond to a vocal command by the user. One possibility is to provide a reactivating button.

Similarly, when the electronic apparatus is not on standby but in an active state, the electronic apparatus does not itself distinguish a vocal command intended for it from a vocal command intended for another apparatus. It is the therefore necessary to provide a method for distinguishing at what time a vocal command is intended for the apparatus.

An example of a known method for detecting the surrounding sound environment is the continuous audio process, or “continuous audio processing”, for waking a telephone. This type of method is known by the expression “Always ON Audio” or “AON Audio”, because the audio voice recognition circuit is kept powered and in continuous operation.

The major disadvantage of such a system is the high energy consumption, given the continuous power supply of the voice recognition circuit.

SUMMARY

The present invention relates generally to a system and method, and, in particular embodiments, to a system and method for embodiments of the invention relate to electronic devices comprising a processing core and a separate module intended to wake the electronic apparatus in which the device is installed, for example a mobile cellular telephone, by a vocal command.

According to one embodiment, an electronic device is proposed whose architecture makes it possible to minimize the energy consumption of an electronic apparatus in which is it fitted, the apparatus furthermore comprising a system for recognition of vocal commands.

According to one aspect, an electronic device is proposed comprising a processing core and an appended module coupled to the core and separate from the said core, the core comprising a first power supply circuit, a first clock and a recognition circuit to recognize multiple vocal commands timed by the first clock.

According to a general feature of this aspect, the core has a standby state and the appended module comprises a second power supply circuit independent of the first power supply circuit, a second clock independent of the first clock and having a frequency lower than that of the first clock, a digital processing unit timed by the second clock comprising at least a first means of capturing a first sound signal, and configured to deliver a processed sound signal, and a processing unit configured in order, in the presence of a parameter of the processed sound signal greater than a threshold, to analyze the content of the processed sound signal and to deliver, when the content of the sound signal comprises a reference pattern, an activating signal to the core that can take it out of its standby state.

As the second power supply circuit provided for powering the appended module is independent of the first power supply circuit provided for powering the core or even the rest of the electronic elements of the apparatus, the second power supply circuit can be sized and configured to power only the appended module. Thus, the energy consumption is minimized due to the adaptation of the second power supply circuit to the appended module.

By providing a second clock solely for the appended module with a frequency lower than the frequency of the first clock intended for timing the core and/or the other electronic elements of an electronic apparatus comprising the device, the energy consumption of the module is low.

In fact, the lower the frequency of a clock, the lower is the energy consumption. Thus, by timing the appended module using a low frequency clock, the electrical energy necessary for powering the appended module is low notably with respect to the core whose elements are timed by a clock of higher frequency. As the necessary electrical power supply is low, the second power supply circuit can be reduced even more in comparison with the power supply circuit of the core.

The parameter of the processed sound signal can for example be the average level of the sound signal, or its peak factor, or again the level of this signal at different frequencies, without these examples being limiting.

The first means of capture can be a digital or analog microphone.

As the appended module is designed for the exiting from the standby mode of the electronic apparatus in which the electronic device is installed, the processing unit can be configured to wake the electronic apparatus, notably the core of the device, solely in response to the detection of a reference pattern such as a keyword.

The second clock can advantageously be less precise than the first clock. In fact, a clock requiring less precision consumes less current.

Advantageously, the processing unit can have a standby state and can be configured to exit from its standby state in the presence of the processed sound signal level higher than the threshold.

By putting the processing unit of the appended module on standby, the energy consumption of the appended module can be low for as long as a processed sound signal does not exceed a detection threshold corresponding for example to a sound level threshold of the processed signal.

Thus, for example, when the processing unit is on standby, the only items powered and timed by the second clock are the digital processing unit and a comparator configured to compare the sound level of the processed signal with a sound level threshold notably expressed in decibels. The processing unit is therefore taken out of its standby state solely in the case where a sufficiently loud sound has been captured by the digital processing unit.

In this embodiment, the appended module preferably comprises a local interconnection circuit able to couple the processing unit to the said second clock in order to take it out of its standby state.

When the processing unit is on standby, it is coupled to the second power supply circuit, which powers it, and decoupled from the second clock in order to reduce its electrical consumption to the minimum.

Advantageously, the digital unit can comprise a single means of capture, the processed sound signal corresponding to the sound signal captured by the single digital means of capture.

The capture means is preferably a digital microphone positioned on the electronic apparatus in such a way as to pick up the vocal commands coming from the user's mouth.

As a variant, the digital unit can comprise a first capture means and at least one supplementary capture means disposed at a location separate from that of the first capture means and configured to capture a supplementary sound signal, and processing unit configured to reduce the ambient noise on the basis of the first sound signal and the supplementary sound signal in order to deliver the processed sound signal.

The first capture means can be a digital microphone disposed for example on the front face of a telephonic apparatus, facing the mouth of a user for example, in order to capture the user's commands.

The supplementary capture means can be digital microphones mounted on the rear face of the mobile cellular telephone in such a way as not to face the user's mouth. This arrangement makes it possible for the supplementary microphones to capture the environmental sounds that can pollute the sound signal coming from the mouth of the speaker and which can hamper the detection of the vocal command in the signal.

In the case where several supplementary capture means are used, the supplementary sound signals are advantageously combined with weighting coefficients in order to obtain an equivalent supplementary sound signal which is then notably subtracted from the first sound signal.

According to another aspect, an electronic apparatus is provided comprising an electronic device such as defined above.

The electronic apparatus preferably forms a mobile cellular telephone.

BRIEF DESCRIPTION OF THE DRAWINGS

Other advantages and features of the invention will become apparent on examination of the detailed description of an embodiment and of an implementation of the invention, that are in no way limiting, and of the appended drawings in which:

FIG. 1 is a block diagram of an electronic apparatus comprising an electronic device according to an embodiment of the invention; and

FIG. 2 is a flowchart of a method for controlling the electronic device shown in FIG. 1 according to an implementation of the invention.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

FIG. 1 shows the block diagram of an electronic apparatus comprising an electronic device according to an embodiment of the invention.

In the embodiment shown, the electronic apparatus 1 is a mobile cellular telephone comprising a transceiver able to connect to or comprise an antenna 1.

The electronic apparatus 1 comprises a battery 2, a first general power supply circuit 3 coupled to the battery 2 and to the electronic elements of the apparatus 1, and notably to an electronic device 4.

The electronic device 4 comprises an electronic processing core 5 and an appended electronic module 6 separate from the core 5.

The core 5 comprises a first power supply circuit 7 connected at its input to the general power supply circuit 3, a first clock 8 having a first timing frequency and a circuit 9 to recognize multiple vocal commands timed by the signal of the first clock 8 and powered by the first power supply circuit 7. The circuit 9 of recognition of multiple vocal commands notably comprises a microprocessor configured to recognize a plurality of different vocal commands and to deliver these commands to a microprocessor of the apparatus 1 in order to control the functions related to the commands.

The appended module 6 comprises a second power supply circuit 10 connected at its input to the general power supply circuit 3. The second power supply circuit 10 is independent from the first power supply circuit 7 of the core 5.

The appended module 6 also comprises a second clock 11 that is independent from the first clock 8 and has a second timing frequency lower than the first timing frequency of the first clock 8 of the core 5. The lower the frequency of a clock, the less energy this clock consumes. In fact, the second clock 11, and therefore the appended module 6, consumes less electrical energy than the core 5 when operating.

The appended module 6 furthermore comprises a digital processing unit 12 powered by the second power supply circuit 10 and timed by the second clock 11. The digital processing unit 12 comprises a first digital microphone 13 fixed on a front face of the apparatus 1 in such a way as to face the mouth of a user and to receive the user's vocal commands. The digital processing unit 12 also comprises a second digital microphone 14 fixed on a rear face of the apparatus 1 in such a way as not to face the mouth of the user and to capture the environmental noise.

The microphones 13 and 14 can also be analog microphones, each coupled at its output to an analog-to-digital converter.

The digital processing unit 12 comprises processing unit 15 that is able to receive the sound signal captured by each of the two digital microphones 13 and 14 and to deliver a processed sound signal free from the ambient noise as much as possible.

In the case of a digital processing unit 12 comprising only a single digital microphone, the processed signal delivered by the digital processing unit corresponds to the sound signal captured by the single digital microphone.

In the embodiment shown, the processing unit 15 is configured to deliver a processed sound signal whose ambient noise has been reduced or even eliminated, from the sound signal captured by the first digital microphone 13 placed on the front face of the apparatus 1 and from the sound signal captured by the second digital microphone 14 placed on the rear face of the apparatus 1 for capturing the ambient noise. The processing unit 15, notably comprising a subtractor, thus delivers a processed sound signal cleansed of the ambient noise and in which there essentially remains the vocal command of the user if there is one.

The digital processing unit 12 thus continuously records low frequency sound via the two digital microphones 12 and 13. The processing unit 15 of the digital processing unit 12 comprises an input stage for decimation of the sound signals received from the digital microphones 13 and 14 in order to create samples of sound signals to process and possibly to analyze.

The appended module 6 furthermore comprises a comparator 16 and a processing unit 17, for example a microcontroller, configured to analyze the content of the processed sound signal.

The input of the comparator 16 is connected to the output of the digital processing unit 12 in order to receive the processed sound signal, and the output of the comparator 16 is connected to a control input of the processing unit 17. The comparator 16 compares for example the sound level of the processed sound signal with a detection threshold corresponding to a sound level in decibels.

The processing unit 17 has a standby state in which its clock input is blocked so that the processing unit is no longer timed by the signal of the second clock and does not operate. The processing unit 17 nevertheless remains powered by the second power supply circuit 10 during its standby state.

When the processed sound signal is greater than the threshold, the comparator 16 delivers an activation signal to the processing unit 17. The activation signal commands the unblocking of the clock input of the processing unit 17. The exit from standby of the processing unit 17 is therefore characterized by a resumption of its timing by the signal of the second clock 11.

At the same time as the activation signal of the processing unit 17, the comparator also transmits the processed sound signal for analysis by the processing unit 17.

As a variant, the digital processing unit 12 could deliver the processed sound signal simultaneously to the comparator 16 and to the processing unit 17, the comparator 16 then only delivering the activation signal of the processing unit 17 when the sound level of the processed sound signal is greater than the detection threshold. If the processed sound signal has a sound level lower than the threshold, the activation signal is not delivered, which results in the processing unit not exiting from its standby state and the processed sound signal is not analyzed by the processing unit 17.

In another variant, the comparator 16 can deliver the activation signal to a local interconnection circuit comprised in the appended module 6 only, the processing unit 17 and the second clock 11 being connected via the interconnection circuit.

When the processing unit 17 has exited from its standby state, it analyzes the received processed sound signal. The analysis comprises a search for a reference pattern corresponding for example to the sound signal of a keyword for waking the apparatus 1. The search is carried out conventionally for example by frequency comparison of the sound signal with the frequency signature of the reference pattern.

If the reference pattern is detected, the processing unit 17 delivers a signal for reactivation of the electronic apparatus 1 and notably of the core 5.

The electronic device 4 comprises an interconnection circuit 18 making it possible to connect the output of the processing unit 17 of the appended module 6 to the processing unit 9 of the core 5 to command the activation of the core 5.

FIG. 2 shows a flowchart of a method for controlling the electronic device 4 shown in FIG. 1 according to an implementation of the invention.

In a first step 100, sound is captured continuously by means of the two digital microphones 13 and 14.

In a next step 102, the captured sound signals are decimated in order to obtain successive samples of constant size.

Then, in a step 104, a processing of the sound signal is carried out in order to reduce the ambient noise on the basis of the sample of the sound signal captured by the second digital microphone 14 and the corresponding sample of the sound signal captured by the first digital microphone 13. The processed sound signal is thus cleansed of the ambient noise and essentially comprises the vocal command of the user it there is one.

In a next step 106, the processed sound signal is then compared with a threshold for activation of the processing unit 17. If the sound level of the processed sound signal is below the activation threshold, there is a return to the initial step 110 in order to analyze the next sample.

On the other hand, if the sound level of the processed sound signal is above the activation threshold, the processing unit 17 is woken in a step 108. The waking, that is to say the reactivation, of the processing unit 17 is carried out by a resumption of the timing of the processing unit 17 by the signal of the second clock 11.

In a next step 110, the processing unit 17 searches for the presence of the reference pattern in the processed sound signal.

If the reference pattern is not detected in the processed sound signal, the processing unit 17 is switched back into its standby state and stops being timed by the second clock 11, and there is a return to the initial step 100.

On the other hand, if the reference pattern is detected in the processed sound signal, the processing unit 17 delivers, in a step 114, a signal for the activation of the core 5. The core 5 is then activated as well as the recognition circuit.

This device makes it possible to have an electronic apparatus configured to receive a vocal command to wake the apparatus before receiving vocal commands to request the apparatus to carry out certain specific functions. Thus, to request the apparatus, whilst on standby, to carry out a function, it suffices to give a unique vocal command followed by a vocal command to carry out the desired function. This can be done for example on the basis of a waking keyword and a request phrase for the function to be carried out.

The architecture of the electronic device furthermore makes it possible to carry out these functions whilst minimizing the energy consumption of the apparatus, by allowing a reduced operation on standby nevertheless authorizing the reception of a vocal wake command and thus increasing the service life of the electronic apparatus between two recharges.

Claims

1. A method, comprising: powering an appended circuit from a first power supply circuit sized and configured to power the appended circuit;capturing a sound signal;processing the sound signal to produce a processed sound signal;comparing the processed sound signal with a threshold for activation to determine that a signal level of the processed sound signal exceeds the threshold for activation;waking up a processing unit from a standby state;using the processing unit to determine that a reference pattern is detected in the processed sound signal; anddelivering a signal from the processing unit to activate a core that is separate from the processing unit, wherein the core receives power from a second power supply circuit that is independent of the first power supply circuit.

2. The method according to claim 1, wherein the sound signal comprises a key word followed by a function request;wherein the reference pattern is related to the key word; andwherein the method further comprises the core performing a function indicated by the function request.

3. The method according to claim 1, wherein the processing unit receives power from the first power supply circuit.

4. The method according to claim 1, wherein the processing unit is clocked with a first clock signal at a first clock frequency and wherein the core is clocked with a second clock signal at a second frequency that is higher than the first clock frequency.

5. The method according to claim 4, wherein waking up the processing unit comprises providing the first clock signal to the processing unit.

6. The method according to claim 1, wherein capturing the sound signal comprises continuously capturing sound signals using first and second digital microphones.

7. The method according to claim 6, wherein processing the sound signal comprises decimating the captured sound signals to obtain successive samples and processing the decimated sound signals in order to reduce ambient noise based on samples of the sound signals captured by the first digital microphone and corresponding samples of the sound signals captured by the second digital microphone.

8. The method according to claim 1, wherein capturing the sound signal comprises capturing the sound signal that includes a key word and a function request;wherein processing the sound signal to produce the processed sound signal comprises processing the sound signal to remove noise from the sound signal;wherein comparing the processed sound signal with the threshold for activation comprises determining that the signal level of the processed sound signal exceeds the threshold;wherein waking up the processing unit comprises waking up the processing unit from the standby state in response to determining that the signal level of the processed sound signal exceeds the threshold for activation;wherein using the processing unit to determine that the reference pattern is detected in the processed sound signal comprises using the processing unit to determine that the key word is present in the processed sound signal; andwherein delivering the signal from the processing unit comprises activating the core in response to determining that the key word is present in the processed sound signal, and using the core to perform a function based on the function request.

9. A method, comprising: continuously capturing sound signals using first and second digital microphones;decimating the captured sound signals to obtain successive samples of constant sizeprocessing the decimated sound signals in order to reduce ambient noise based on samples of the sound signals captured by the first digital microphone and corresponding samples of the sound signals captured by the second digital microphone;comparing the processed sound signals with a threshold for activation to determine whether or not a signal level of the processed sound signals exceeds the threshold;if the signal level does not exceed the threshold, returning to the step of continuously capturing sound signals;if the signal level exceeds the threshold, waking up a processing unit from a standby state;using the processing unit to determine whether or not a reference pattern is detected in the processed sound signals;if the reference pattern is not detected in the processed sound signals, switching the processing unit back into standby state; andif the reference pattern is detected in the processed sound signals, delivering a signal from the processing unit to activate a core that is separate from the processing unit.

10. The method according to claim 9, wherein the processed sound signals comprises a voice command.

11. The method according to claim 10, wherein the voice command comprises a keyword followed by a request phrase for a function be carried out.

12. The method according to claim 9, wherein waking up the processing unit comprises providing a clock signal to the processing unit and wherein switching the processing unit back into the standby state comprises ceasing to provide the clock signal to the processing unit.

13. A method of operating a mobile communication device, the method comprising: powering an appended circuit from a first power supply circuit sized and configured to power the appended circuit;capturing a sound signal that includes a key word and a function request;processing the sound signal to remove noise from the sound signal to produce a processed sound signal;determining a signal level of the processed sound signal exceeds a threshold;waking up a processing unit of the appended circuit from a standby state in response to determining that the signal level of the processed sound signal exceeds the threshold for activation;using the processing unit to determine the key word is present in the processed sound signal;activating a core in response to determining that the key word is present in the processed sound signal, wherein the core receives power from a second power supply circuit that is independent of the first power supply circuit; andusing the core to perform a function based on the function request.

14. The method according to claim 13, wherein capturing the sound signal comprises continuously capturing sound signals using first and second digital microphones.

15. The method according to claim 14, wherein processing the sound signal comprises decimating the sound signal to produce a decimated sound signal and processing the decimated sound signal in order to reduce ambient noise based on samples of the sound signals captured by the first digital microphone and corresponding samples of the sound signals captured by the second digital microphone.

16. The method according to claim 13, wherein the processing unit is clocked with a first clock signal at a first frequency and wherein the core is clocked with a second clock signal at a second frequency that is higher than the first frequency.

17. The method according to claim 16, wherein waking up the processing unit comprises providing the first clock signal to the processing unit.

18. The method according to claim 13, wherein the sound signal comprises a voice command.

19. The method according to claim 18, wherein the voice command comprises the key word followed by the function request comprising a request phrase for the function be carried out.

20. A device, comprising: a processing core having a processing core active state and a processing core standby state, wherein the processing core comprises a first power supply circuit, wherein the processing core receives power from the first power supply circuit when the processing core is in the processing core active state;an appended circuit coupled to the processing core and being a different type of circuit than the processing core, the appended circuit having an appended circuit active state and an appended circuit standby state, wherein the appended circuit comprises: a second power supply circuit independent from the first power supply circuit wherein the second power supply circuit is sized and configured to power the appended circuit;a digital processing unit configured to capture a first sound signal comprising a key word and a function request, the digital processing unit being configured to produce a processed sound signal; anda processing unit configured to analyze content of the processed sound signal when the appended circuit is in the appended circuit active state and to activate the processing core to the processing core active state when the processing unit determines that the key word is present in the processed sound signal; andwherein the processing core is configured to perform a function based on the function request.

21. The device of claim 20, wherein the processed sound signal comprises the first sound signal cleansed of ambient noise.

22. The device of claim 20, wherein the appended circuit further comprises: a comparator coupled between the digital processing unit and the processing unit, the comparator being configured to modulate coupling of a clock input of the processing unit to a clock of the appended circuit in response to a comparison of a parameter of the processed sound signal to a threshold.

23. The device of claim 22, wherein the comparator is configured to cause the clock input of the processing unit to be coupled to the clock of the appended circuit in response to the parameter of the processed sound signal being greater than the threshold.

24. The device of claim 22, wherein the comparator is configured to compare the parameter of the processed sound signal to the threshold when the appended circuit is in the appended circuit standby state.

25. The device of claim 20, wherein the digital processing unit comprises a microphone, the digital processing unit being configured to capture the first sound signal using the microphone.

26. The device of claim 25, wherein the digital processing unit further comprises a second microphone spaced apart from the microphone, wherein the second microphone is configured to capture ambient noise.

27. The device of claim 20, wherein the processing unit is configured to be powered by the second power supply circuit when the appended circuit is in the appended circuit active state and when the appended circuit is in the appended circuit standby state.

28. The device of claim 20, wherein the processing core further comprises a first clock and a sound recognition circuit configured to recognize multiple vocal commands timed by the first clock.

29. The device of claim 28, wherein the appended circuit further comprises a second clock that does not draw a clock signal from or supply the clock signal to the first clock, the second clock having a frequency lower than that of the first clock and wherein the digital processing unit is timed by the second clock.

30. The device of claim 20, wherein a clock input of the processing unit is configured to receive a clock signal when the appended circuit is in the appended circuit active state, and wherein the clock input of the processing unit is configured to be blocked from receiving the clock signal when the appended circuit is in the appended circuit standby state.