Patent Application
20240388833
The present disclosure relates to the field of head-mounted device, and particularly to a head-mounted device and a far-field muffling method, apparatus and system.
Currently, more and more VR or AR products on the market are focusing on far-field muffling performance. In other words, reducing sound leakage through the design of a structure and Digital Signal Process (DSP), thereby protecting privacy of a user. Wherein, the dual-speaker solution has gradually become the technology development trend due to the good symmetry of the structural design and the convenience for switching the muffling mode. However, although there is desirable symmetry in the theoretical design, due to impacts such as the design tolerances, assembly errors of structural parts, etc., they will still cause the frequency response and phase difference between the two loudspeakers to some extent, which will have a certain impact on the muffling performance and affect the user's experience.
In view of the above, how to provide a head-mounted device and a far-field muffling method, apparatus and system for solving the above technical problem has become a problem that needs to be solved by those skilled in the art.
An objective of embodiments of the present disclosure is to provide a head-mounted device, and a far-field muffling method, apparatus and system, which is beneficial in improving the far-field muffling effect during use, thereby enhancing the user's experience.
To solve the above technical problem, the present disclosure provides a far-field muffling method for a head-mounted device, the method applied to the head-mounted device, the head-mounted device comprising a first speaker, a second speaker, and characterized by further comprising a monitoring microphone, the method comprises:
Optionally, a process of the “determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals” is:
Optionally, a process of the “determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals” is:
Optionally, further comprising a first calibration microphone provided at a sound hole of the first speaker, and a second calibration microphone provided at a sound hole of the second speaker:
Optionally, a difference value of every two adjacent amplitude compensation values is a preset amplitude value, and a difference value of every two adjacent phase compensation values is a preset phase value.
Optionally, a process of the “judging whether the monitoring sound signal satisfies a preset requirement” is:
Optionally, the monitoring microphone is located in a mid-vertical plane where the first speaker and the second speaker are connected.
An embodiment of the present disclosure further provides a far-field muffling apparatus for a head-mounted device, the apparatus applied to the head-mounted device, the head-mounted device comprising a first speaker, a second speaker, and further comprising a monitoring microphone, the apparatus comprises:
An embodiment of the present disclosure further provides a far-field muffling system for a head-mounted device, the system applied to the head-mounted device, the head-mounted device comprising a first speaker, a second speaker, and further comprising a monitoring microphone, the device comprising a processor and a memory, wherein:
An embodiment of the present disclosure further provides a head-mounted device comprising a first speaker, a second speaker, a monitoring microphone and the above far-field muffling system for a head-mounted device.
An embodiment of the present disclosure provides a far-field muffling method for a head-mounted device, apparatus and system, which is applied to the head-mounted device. The head-mounted device comprises a first speaker, a second speaker, and further comprises a monitoring microphone. The method comprises: receiving a monitoring sound signal picked up by the monitoring microphone during operations of the first speaker and the second speaker: judging whether the monitoring sound signal satisfies a preset requirement, and if yes, ending: if not, determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals: compensating the first speaker by using the first target compensation signal, compensating the second speaker by using the second target compensation signal, and returning to a step of the “receiving a monitoring sound signal picked up by the monitoring microphone”.
It can be seen that the head-mounted device of the present disclosure comprises the first speaker, the second speaker and the monitoring microphone. During operations of the first speaker and the second speaker, picking up the monitoring sound signal by the monitoring microphone, judging whether the monitoring sound signal satisfies a preset requirement, and if not, determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals, then compensating the first speaker by using the first target compensation signal, compensating the second speaker by using the second target compensation signal, again picking up the monitoring sound signal by the monitoring microphone and conducting a new round of judgment, and performing compensation again when it is not satisfied, until the picked up monitoring sound signal satisfies the preset requirement. The present disclosure is beneficial in improving the far-field muffling effect during use, thereby enhancing the user's experience. In addition, the present disclosure further provides a head-mounted device, which has the same beneficial effects as mentioned above.
In order to clearly illustrate embodiments of the present disclosure or technical solutions in the prior art, accompanying drawings that need to be used in description of the embodiments or the prior art will be briefly introduced as follows. Obviously, drawings in following description are only a part of the drawings of the present disclosure. For those skilled in the art, other drawings can also be obtained according to the disclosed drawings without creative efforts.
Embodiments of the present disclosure provide a head-mounted device, and a far-field muffling method, apparatus and system, which is beneficial in improving the far-field muffling effect during use, thereby enhancing the user's experience.
The technical solutions in the embodiments of the present disclosure are described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a few embodiments of the present disclosure, not all embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person skilled in the art without creative work shall fall within the scope of protection of the present disclosure.
Please refer to
S110: receiving a monitoring sound signal picked up by the monitoring microphone during operations of the first speaker and the second speaker:
It should be noted that during operations of the first speaker and the second speaker in the embodiment of the present disclosure, the monitoring microphone picks up the monitoring sound signal, which may reflect the far-field muffling effect of the first speaker and the second speaker.
S120: judging whether the monitoring sound signal satisfies a preset requirement, and if yes, ending: if not, then proceeding to S130:
Specifically, after receiving the monitoring sound signal, it is possible to judge whether the monitoring sound signal satisfies a preset requirement, wherein the preset requirement may be specifically a preset frequency bandwidth range. That is, judging whether the frequency of the monitoring sound signal is in the preset frequency bandwidth range, which may be 50 hz˜10 Khz and may be specifically determined according to the actual situation, which is not specifically limited by the embodiments of the present disclosure. If the monitoring sound signal satisfies the preset requirement, the operation will be ended directly, and when the monitoring sound signal does not satisfy the preset requirement, the operation will proceed to the next step.
S130: determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals:
Specifically, the embodiment of the present disclosure may pre-set a plurality of compensation signals, and when it is determined that the monitoring sound signal does not satisfy the preset requirement, the current first target compensation signal and the current second target compensation signal are determined from the preset various compensation signals.
S140: compensating the first speaker by using the first target compensation signal, compensating the second speaker by using the second target compensation signal, and returning to a step of the “receiving a monitoring sound signal picked up by the monitoring microphone”.
Specifically, after the current first target compensation signal and the current second target compensation signal are obtained, the first speaker is compensated by using the first target compensation signal, and specifically, the amplitude and the phase corresponding to the first speaker are compensated: the second speaker is compensated by using the second target compensation signal, and specifically, the amplitude and the phase corresponding to the second speaker are compensated: after the compensation is completed, receiving the monitoring sound signal picked up by the monitoring microphone again, then judging a new monitoring sound signal to determine whether the monitoring sound signal of the signal satisfies the preset requirement, and if not, re-selecting a new first target compensation signal and a new second target compensation signal, then compensating the first speaker and the second speaker by respectively using the new first target compensation signal and the new second target compensation signal, until the picked up monitoring sound signal satisfies the preset requirement, so as to better perform far-field muffling and improves the user's experience.
Further, a process of the “determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals” in the above S130 may specifically be:
It should be noted that the embodiment of the present disclosure may pre-set a plurality of amplitude compensation values and a plurality of various phase compensation values, and then when it is determined that the monitoring sound signal does not satisfy the preset requirement, it is possible to randomly select the first target amplitude compensation value and the second target amplitude compensation value from the various amplitude compensation values, and to randomly select the first target phase value and the second target phase value from the preset various phase compensation values, wherein the first target amplitude compensation value and the second target amplitude compensation value may be the same or different, and the first target phase value and the second target phase value may be the same or different. Then, the first target amplitude compensation value and the first target phase compensation value are taken as the first target compensation signal, and the second target amplitude compensation value and the second target phase compensation value are taken as the second target compensation signal: the random selection method used in the embodiments of the present disclosure is simple and easy to implement.
Further, a process of the “determining a current first target compensation signal and a current second target compensation signal from preset various compensation signals” in the above S130 may specifically be:
It should be noted that in the embodiment of the present disclosure, each compensation may be carried out according to the order, that is, the amplitude compensation value of the next order and the phase compensation value of the next order are used as the determined target compensation signal during each compensation, which may better compensate the speakers, so that the first speaker and the second speaker after compensation may better realize far-field muffling when working.
Specifically, the first speaker may determine, according to amplitude and phase compensation values in the first target compensation signal determined during the previous compensation, the first target amplitude compensation value of the next order from the preset various amplitude compensation values and the first target phase compensation value of the next order from the preset various phase compensation values, and then take the first target amplitude compensation value and the first target phase compensation value selected this time as the current determined first target compensation signal, so as to use the first target compensation signal to compensate the amplitude and phase of the first speaker, respectively.
Similarly, the second speaker may determine, according to amplitude and phase compensation values in the second target compensation signal determined during the previous compensation, the second target amplitude compensation value of the next order from the preset various amplitude compensation values and the second target phase compensation value of the next order from the preset various phase compensation values, and then take the second target amplitude compensation value and the second target phase compensation value selected this time as the current determined second target compensation signal, so as to use the second target compensation signal to compensate the amplitude and phase of the second speaker, respectively.
Specifically, in the embodiment of the present disclosure, a difference value of every two adjacent amplitude compensation values is a preset amplitude value, and a phase difference value of every two adjacent phase compensation values is a preset phase value.
It should be noted that in a practical application, an amplitude range, for example, (−10˜10) dB, and a phase range, for example, (−60° ˜60°, may be set in advance: then a preset amplitude value, e.g., 0.5 dB, i.e., every 0.5 dB is an order, and a preset phase value, e.g., 5°, i.e., every 5° is an order, are determined, such that a plurality of amplitude compensation values may be obtained, for example, S1 (−10 dB), S2 (−9.5 dB), S3 (−9 dB) . . . . Sn respectively: a plurality of phase compensation values may be obtained, for example, P1 (−60°), P2 (−55°), P3 (−50°) . . . Pn respectively, so as to obtain a plurality of compensation signals (Sn, Pn, wherein n is the total number of the compensation signals): the first target compensation signal and the second target compensation signal may be selected from the various compensation signals by using a random selection method, or the first target compensation signal and the second target compensation signal may also be determined by using the above order-by-order selection method.
Further, as shown in
Specifically, after the head-mounted device is activated, that is, when the first speaker and the second speaker begin to operate after the first round of compensation, the first microphone signal at the sound hole of the first speaker may be picked up by the first calibration microphone, and the second microphone signal at the sound hole of the second speaker may be picked up by the second calibration microphone: then a first transfer function corresponding to the first speaker in the first round of compensation may be determined based on the first microphone signal, and a second transfer function corresponding to the second speaker may be obtained based on the second microphone signal.
Then, a process of the “compensating the first speaker by using the target compensation signal, compensating the second speaker by using the second target compensation signal” in the above corresponding S140 may specifically be:
Specifically, in the embodiment of the present disclosure, after the first target compensation signal and the second target compensation signal are determined, compensating the amplitude and the phase of a current first transfer function of the first speaker respectively by using the first target compensation signal, and obtaining the updated first transfer function;
For example, taking the first transfer function of the first speaker as an example:
At present, the first transfer function is E1, the first target compensation signal is (Sn, Pn) for a certain channel that does not satisfy the preset requirement, and then the updated first transfer function after compensation is E+b (Sn, Pn). If there are multiple frequency points that do not satisfy the preset requirement, then the corresponding first target compensation signal can only be determined randomly for each frequency point, and then compensation is performed, for example, the first transfer function after compensation is: E+b1 (Sn, Pn)+b2 (Sn, Pn) . . . +bN (Sn, Pn), wherein the first target compensation signal corresponding to the Nth frequency point not requiring the preset requirement is randomly selected from the various compensation signals, and the above is only an example and is not limited to this case. In addition, for the compensation of the second transmission signal of the second speaker, please refer to the above description, which will not be repeated herein.
It can be seen that the head-mounted device of the present disclosure comprises the first speaker, the second speaker and the monitoring microphone. During operations of the first speaker and the second speaker, picking up the monitoring sound signal by the monitoring microphone, judging whether the monitoring sound signal satisfies a preset requirement, and if not, determining the first target compensation signal and the second target compensation signal from preset various compensation signals, then compensating the first speaker by using the first target compensation signal, compensating the second speaker by using the second target compensation signal, again picking up the monitoring sound signal by the monitoring microphone and conducting a new round of judgment, and performing compensation again when it is not satisfied, until the picked up monitoring sound signal satisfies the preset requirement. The present disclosure is beneficial in improving the far-field muffling effect during use, thereby enhancing the user's experience.
On the basis of the above embodiments, the embodiment of the present disclosure further provides a far-field muffling apparatus for a head-mounted device, the apparatus applied to the head-mounted device, the head-mounted device comprising a first speaker, a second speaker, and further comprising a monitoring microphone, the apparatus comprises:
Optionally, further comprising a first calibration microphone provided at a sound hole of the first speaker, and a second calibration microphone provided at a sound hole of the second speaker: the compensation signal comprises the amplitude compensation value and the phase compensation value:
Then, the determining module 24 is specifically configured for randomly selecting the first target compensation signal and the second target compensation signal from various compensation signals.
It should be noted that the far-field muffling apparatus for a head-mounted device provided by the embodiment of the present disclosure has the same advantageous effect as that of the far-field muffling method for a head-mounted device involved in the above embodiment, and for the specific introduction of the far-field muffling method for a head-mounted device involved in the embodiment of the present disclosure, please refer to the above embodiment, which will not be repeated herein.
On the basis of the above embodiments, the embodiment of the present disclosure further provides a far-field muffling system for a head-mounted device, the system applied to the head-mounted device, the head-mounted device comprising a first speaker, a second speaker, and further comprising a monitoring microphone, the device comprising a processor and a memory, wherein:
For example, the processor in the embodiment of the present disclosure may specifically be configured for implementing: receiving a monitoring sound signal picked up by the monitoring microphone during operations of the first speaker and the second speaker; judging whether the monitoring sound signal satisfies a preset requirement, and if yes, ending; if not, determining the first target compensation signal and the second target compensation signal from preset various compensation signals: compensating the first speaker by using the target compensation signal, compensating the second speaker by using the second target compensation signal, and returning to a step of the “receiving a monitoring sound signal picked up by the monitoring microphone”.
On the basis of the above embodiments, the embodiment of the present disclosure further provides a head-mounted device comprising a first speaker, a second speaker, a monitoring microphone and the above far-field muffling system for a head-mounted device.
Wherein, the head-mounted device in the embodiment of the present disclosure further comprises a first microphone provided at a sound hole of the first speaker, and a second microphone provided at a sound hole of the second speaker. Please refer to
Specifically, the head-mounted device provided in the embodiment of the present disclosure has the same advantageous effect as above.
The embodiments in the present specification are described in parallel or in progression, and each embodiment focuses on its differences from other embodiments, and the same or similar parts of each embodiment can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part.
It is also understood by ordinary skilled in the art that the units and algorithmic steps of the various examples described with reference to the embodiments of the present disclosure can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been generally described in terms of their functions in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered as exceeding the scope of this disclosure.
The steps of the methods or algorithms described in the embodiments disclosed in this document can be implemented directly by hardware, software modules executed by a processor, or a combination of both. The software modules can be placed in random access memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or any other form of storage medium known in the technical field.
It should also be noted that in this article, relational terms such as first and second, etc., are used solely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or sequence between those entities or operations. Further, the term “comprise”, “include” or any other variation thereof is intended to cover non-exclusive comprising so that a process, method, article or apparatus that comprises a series of elements includes not only those elements, but also other elements that are not expressly listed, or also comprises elements inherent in such process, method, article or apparatus. Without further limitation, the elements defined by the phrase “comprising a . . . ” do not preclude the existence of other identical elements in the process, method, article or apparatus that includes the elements.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202111447208.4 | Nov 2021 | CN | national |
The present disclosure is a National Stage of International Application No. PCT/CN2022/119791, filed on Sep. 20, 2022, which claims priority to a Chinese patent application No. 202111447208.4 filed with the CNIPA on Nov. 30, 2021 and entitled “HEAD-MOUNTED DEVICE, AND FAR-FIELD MUFFLING METHOD, APPARATUS AND SYSTEM THEREFOR”, both of which are hereby incorporated by reference in their entireties.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2022/119791 | 9/20/2022 | WO |
