Patent Grant
11375312
This application claims priority under 35 U.S.C. § 119(a) to a Chinese Patent Application filed in the Chinese Patent Office on Aug. 26, 2019 and assigned Serial No. 2019107887184, the disclosure of which is incorporated herein in its entirety by reference.
The present invention relates to the field of audio processing, in particular to an audio synchronous playing method and device, speaker equipment and wireless headset.
At present, one implementation method of true wireless headsets is that intelligent devices and left and right headsets respectively carry out data transmission (which can be music, voice or data packets, etc.) through Bluetooth connection. For example, when playing stereo music, the intelligent device transmits the music to the left and right headsets respectively. However, the left and right headsets belong to two subsystems, which are implemented in two different chips and have separate clock systems.
Therefore, in the existing true wireless headset system, it is often difficult to achieve better synchronization between the left ear and the right ear. For example, when playing music or voice calls, the music or voice of the left and right ears cannot be accurately played at the same time, which greatly affects the playing quality.
The present invention discloses a method and a device for synchronously playing audio signals, a wireless loudspeaker device and a wireless headset, so as to solve the problem that the existing synchronization method is not accurate enough.
In order to achieve the above purpose, the embodiment of the present invention provides an audio synchronous playing method, which is used for realizing synchronous playing of audio data from the same audio source by two or more wireless loudspeakers. For any one of the two or more wireless loudspeakers, the method comprises the following steps: receiving a first audio data packet sent by an audio source, and determining a first time point of receiving the first audio data packet; processing the first audio data packet to generate a second audio data packet, wherein the second audio data packet comprises the audio data to be played with a fixed data length; setting a delayed play time, obtaining the playing time point of the second audio data packet according to the first time point and the delayed play time, and playing the audio data to be played in the second audio data packet at the playing time point.
Further, in an embodiment, receiving the first audio data packet sent by the audio source includes: receiving the first audio data packet within a fixed time interval, and setting the maximum retransmission times within the fixed time interval which the first audio data packet is in. Further, in an embodiment, receiving the first audio data packet sent by the audio source, including: setting a fixed time point within the fixed time interval, and receiving the first audio data packet transmitted for the first time or retransmitted.
Further, in an embodiment, determining a first time point of receiving the first audio data packet includes: for any one of the two or more wireless speakers, taking the fixed time point where it receives the first audio data packet for the first time in the fixed time interval as the first time point.
Further, in an embodiment, processing the first audio data packet to generate the second audio data packet includes: performing data decompression processing on the first audio data packet, to generate the second audio data packet of the fixed length audio data to be played.
Further, in an embodiment, the data length of the to-be-played audio data in the second audio data packet after the decompression process is set corresponding to the set time length of the fixed time interval. The length of the audio data played during the fixed time interval is equal to the data length of the to-be-played audio data in the second audio data packet.
Further, in an embodiment, setting the delayed play time includes: set the length of the delayed play time to be not less than the length of time between the time point of the last retransmission of the first audio packet in the fixed time interval and the first time point.
Further, in an embodiment, the playing time point of the second audio data packet is obtained according to the first time point and the delayed play time, including: delay the delayed play time from the first time point, giving the playing time point of the second audio data packet.
Further, in an embodiment, before the two or more wireless speakers receive the first audio data packet sent by the audio source also includes: synchronizing the transceiver clocks of the two or more wireless speakers.
Further, in an embodiment, for any one of the two or more wireless speakers, playing the to-be-played audio data in the second audio data packet at the playing time point includes: Synchronizing the audio clock thereof with the transceiver clock; playing the audio data to be played in the second audio data packet according to the audio clock.
Further, in an embodiment, the two or more wireless speakers establish a wireless connection with the audio source; the wireless connection includes one or several of the means such as ordinary Bluetooth, Bluetooth low energy, physical layer improved Bluetooth, WIFI, and near field communication.
Further, in an embodiment, the two or more wireless speakers include a main wireless speaker and a subordinate wireless speaker; thereof: the main wireless speaker establishes a first Bluetooth connection with the audio source, the main wireless speaker establishes a second Bluetooth connection with the subordinate wireless speaker; the main wireless speaker transmits relevant parameters of the first Bluetooth connection to the subordinate wireless speaker to enable the subordinate wireless speaker to intercept and receive audio data packets from the said audio source.
In order to achieve the above purposes, an embodiment of the present invention also provides an audio synchronization playing device, configured to realize the synchronous play of audio data from the same audio source by two or more wireless speakers, the audio synchronization playing device includes: a receiving time point determining module for receiving the first audio data packet sent by the audio source, and determining the first time point of receiving the first audio data packet; an audio data processing module configured to process the first audio data packet to generate a second audio data packet, wherein the second audio data packet includes the fixed length audio data to be played; a playing time point generating module configured to set a delayed play time, the playing time point of the second audio data packet is obtained according to the first time point and the delayed play time, then play the audio data to be played in the second audio data packet at the obtained playing time point.
In order to achieve the above purposes, an embodiment of the present invention also provides a wireless speaker device, including a play device and a processor; the processor implements an audio synchronization play method as described in the foregoing embodiment; after the playing time point of the second audio data packet is obtained by the processor, the play device plays the audio data to be played in the second audio data packet at the playing time point.
In order to achieve the above purposes, an embodiment of the present invention further provides a wireless headset, including a main headset and a subordinate headset, both of which include the wireless speaker device as described in the above embodiments.
The audio synchronization playing method disclosed in the embodiments of the present invention can be separately performed in each wireless speaker connected to the audio source, that is, each wireless speaker is synchronized with the transceiver clocks of other wireless speakers, when the audio data sent by the audio source is received, the audio synchronous playing method of the embodiment of the present application is used for synchronous audio play, and the data interaction between each wireless speaker is not required, so it can reduce the amount of data transmission between wireless speaker devices and power consumption of wireless speaker equipment. In addition, due to the unreliability of wireless transmission (main-subordinate transmission), the data transmission between the wireless devices is reduced, and the reliability of the system synchronous playback is also improved. Moreover, the audio playing time point obtained by each wireless speaker is based on the time point at which the audio data packet (air signal) is received on the basis of the transceiver clock synchronization, and thus the synchronization precision is high.
The specific embodiment of the present invention is disclosed in detail with reference to the following description and attached drawings, indicating the method in which the principles of the present invention can be adopted. It should be understood that the embodiments of the present invention are not limited therefore in scope. The embodiments of the present invention include many variations, modifications, and equivalents within the scope of the appended claims.
Features described and/or illustrated with respect to one embodiment may be used in one or more other embodiments in the same or similar manner, in combination with, or in place of, features in other embodiments.
It should be emphasized that the term “comprising” or “including”, when used in this article, refers to the existence of features, whole parts, steps or components, but does not exclude the existence or addition of one or more other features, whole parts, steps or components.
In order to more clearly illustrate the technical solutions in the embodiments of the present invention or in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only certain embodiments of the present invention, and those technical people in the field can obtain other drawings from these drawings without any inventive labor.
The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying figures appended in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of protection of the present invention.
Those skilled in the art will know that embodiments of the present invention can be implemented as a system, apparatus, device, method, or computer program product. Accordingly, the disclosure may be embodied in the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining of software and hardware.
The principles and spirit of the present invention are explained in detail below with reference to a few representative embodiments of the present invention.
The audio synchronization playing method disclosed in the embodiment of the present invention is configured to implement synchronous play of audio data from the same audio source by two or more wireless speakers. In the present, the audio source may include any one of a cellular phone, a mobile PC, a tablet computer, a portable smart assistant, and a smart wearable device, and the audio signal from the audio source may be a voice signal of the cellular phone, or may be other audio signals played by smart terminal devices, such as music and video sounds. The wireless speaker device can be a wireless headset or a wireless loudspeaker, and any or several of the ordinary Bluetooth, Bluetooth low energy, physical layer improved Bluetooth, WIFI, near field communication (NFC) and low-band radios can be used for the wireless connection between the wireless speaker and the audio source or between every two wireless speakers.
Step S101, receiving the first audio data packet sent by an audio source, and determining the first time point of receiving the first audio data packet; Step S102, processing the first audio data packet to generate the second audio data packet, wherein the second audio data packet includes the audio data to be broadcast with a fixed data length; Step S103, setting a delayed play time, and obtaining a playing time point of the second audio data packet according to the first time point and the delayed play time; Step S104, playing the audio data to be played in the second audio data packet at the playing time point.
It should be understood that the audio synchronous playing method of the embodiment of the present application is technically improved on the basis that the existing wireless speakers are independent subsystems respectively, so that the audio data from the same audio source can be synchronously played with two or more wireless speakers. That is to say, the audio synchronous playing method of this embodiment is executed separately in each wireless speaker, that is, when each wireless speaker receives the audio data sent by the audio source, it uses the audio synchronous playing method of this embodiment to perform synchronous playing of audio without data interaction between wireless speakers.
Specifically, in Step S101, the first audio data packet sent by the audio source is received for any one of the two or more wireless speakers, and the manner in which each wireless speaker receives the audio data packet from the audio source is related to the connection manner with the audio source.
As shown in
As shown in
However, regardless of the embodiment shown in
In some embodiments, as shown in
In this embodiment, the audio signal sent by the audio source to the main Bluetooth headset and/or the subordinate Bluetooth headset may be a multi-slot packet or a single slot packet, but whether a multi-slot packet or a single slot packet is used, the audio signal sent by the audio source is always at the start time of a certain slot, and the duration of each slot is fixed (for example, the duration of each slot is 625 μs).
The main Bluetooth headset and the subordinate Bluetooth headset respectively convert the received radio frequency signals (radio frequency signals in the audio signal transmission process) to obtain timing synchronization signals, timing synchronization errors and carrier synchronization errors. Specifically, as shown in
The timing synchronization error 206 and/or the carrier synchronization error 208 adjust the crystal oscillation frequency via the phase locked loop 207, and the demodulated signal after adjusting the crystal oscillation frequency via the phase locked loop 207 is fed back to the RF front end 203 and the frequency divider. After the above-mentioned signal synchronization processing, the main Bluetooth headset and the subordinate Bluetooth headset can be synchronized with the clock of the audio source respectively, thus indirectly realizing the synchronization of the Bluetooth clock (bt clk) of the main Bluetooth headset and the subordinate Bluetooth headset.
As mentioned above, after the synchronization of the transceiver clocks between the main and subordinate Bluetooth headsets is realized, the accurate synchronous reception of the same audio data sent by the audio source can be realized.
In step S101 of the embodiment of the present application, receiving the first audio data packet sent by the audio source may be to receive the first audio data packet within a fixed time interval and set the maximum retransmission times of the first audio data packet within the fixed time interval.
Generally, wireless communication can be performed for a predetermined length of time period, and corresponding information is transmitted and received within each predetermined time period. In some embodiments, each predetermined time period may occupy one time slot or several time slots. In this application, Bluetooth transmission is taken as an example for explanation. According to Bluetooth protocol, the time of one slot is 625 μs. When using Advanced Audio Distribution Framework Profile (A2DP), a Bluetooth frame can often occupy multiple time slots; However, when using the Hands-free Framework Profile (HFP), it usually takes up one time slot. In some embodiments, as shown in
In some embodiments, because the audio data is interfered by other factors in the transmission process, there is a possibility of data loss or receiving errors, so the audio source will resend the audio data when the wireless speaker does not receive the data or receives the erroneous data. As described above, the maximum retransmission times of an audio data packet within a fixed time interval can be set. If the audio data packet is not correctly received within the set maximum retransmission times, the audio data packet is not retransmitted and is considered lost. For example, an audio packet can be set to be sent up to three times in a fixed time interval. In some embodiments, the audio source can actively transmit the audio data N times according to the set maximum retransmission number N, that is, the audio data will be retransmitted within a fixed time interval regardless of whether the wireless Bluetooth device correctly receives the audio data; In other embodiments, the audio source can decide whether to retransmit according to the feedback of the wireless Bluetooth device. If a wireless Bluetooth device does not receive the audio data correctly, it sends a NACK signal to the audio source for retransmission. If it receives the audio data correctly, it sends an ACK signal to inform the audio source and the audio source will not retransmit. In this embodiment, for the embodiment shown in
In some embodiments of the present invention, in order to better realize synchronous reception of audio data packets by main and subordinate wireless devices, a fixed time point for receiving audio data packets within the fixed time interval may be set. In the embodiment shown in
In Step S101 of this embodiment, for any one of the two or more wireless speakers, the fixed time point at which the first audio data packet is first received within the fixed time interval is taken as the first time point. According to the above records, there is a possibility that the first audio data packet needs to be retransmitted multiple times within a fixed time interval due to the possibility of partial loss or partial error of the data packet in the data transmission process. In the embodiment of the present application, the time point when the first audio data packet is received is taken as the first time point for each wireless speaker device regardless of the number of times it needs to be retransmitted or whether the data it receives for the first time is correct. For example, referring to the embodiment shown in
In the embodiment of the application, since the transceiver clocks of all wireless loudspeaker devices have been synchronized and are synchronized with the audio source clock, the first time point when all wireless loudspeaker devices receive the audio data packet is the same for the same audio data packet sent by the same audio source. After the first time point is obtained, in one embodiment, the time point information can be stored as a variable separately and the corresponding relation between the time point information and the audio data packet can be established. In this embodiment, the format of the audio data packet cannot be changed; In another embodiment, the time point information may also be added to the corresponding audio data packet (e.g., added to a blank field of the audio data packet), so that there is no need to separately establish the corresponding relationship between the time point information and the audio data packet. In the embodiment of the present application, the corresponding relation between the time point information and the audio data packet is established in order to keep the synchronization of audio data processing and playing with other wireless loudspeaker devices in the subsequent calculation and audio playing.
In some embodiments, the first audio data packet is processed in Step S102 to generate a second audio data packet. Specific operations include, but are not limited to, encoding operations, decoding operations, digital-to-analog conversion operations, buffering operations, decompression processing, and the like.
Wherein, the data decompression process for the first audio data packet decompresses the audio data to be played contained in the first audio data packet into a fixed data length. In this embodiment, the audio data to be played with a fixed data length can make the audio playing synchronization more accurate. More specifically, the data length of the audio data to be played in the decompressed second audio data packet may be set corresponding to the fixed time interval. The term of “set corresponding to” herein means that the length of the audio data played during the fixed time interval is equal to the data length of the audio data to-be-played in the second audio data packet.
In some embodiments, in Step S103, the delayed play time is set. The length of the delayed play time may be dynamically determined according to actual conditions, but in a preferred embodiment, the time length of the delayed play time is set to be not less than the length of time between the time point of the last retransmission of the first audio packet in the fixed time interval and the first time point. This implementation prevents one wireless speaker device from receiving audio data on the last retransmission while other wireless speaker devices are already playing audio data. And, from the first time point, the time point when the delayed play time is achieved is the playing time point of the to-be-played audio data in the second audio data packet. In this application embodiment, it is also necessary to establish the corresponding relationship between the playing time point and the second audio data packet, so as to accurately find and play the audio data to-be-played in the second audio data packet when the playing time point comes, so as to realize the synchronous play of the main and subordinate wireless speakers.
Through the synchronization method described in the above embodiments, the synchronization of transceiver clocks of all wireless speakers and the audio source can be realized, and the playing time point t of the audio data to-be-played can be obtained on the basis of the transceiver clock synchronization. In some embodiments, the time length Δt of the delayed play time of the wireless speaker may be set based on the transceiver clock or may be set based on the audio clock. Preferably, since the transceiver clock of the wireless speaker has been synchronized, the time length Δt of the delayed play time set based on the transceiver clock is more accurate.
In step S104 of the embodiment of the present invention, for any of the two or more wireless speakers, after obtaining the playing time point t of the audio data to be played in step S103, according to the respective audio clock (audio clk) the audio data to-be-played is read and played at the playing time point t.
Taking wireless speaker devices including main and subordinate Bluetooth devices as examples, it illustrates several implementations of main and subordinate Bluetooth devices synchronizing audio data according to their respective audio clocks.
(1) In the first embodiment, the audio clocks of the main Bluetooth device and the subordinate Bluetooth device can be synchronized with the respective Bluetooth clocks by an audio phase-locked loop (audio PLL) adjustment. Since the main and subordinate Bluetooth devices have implemented Bluetooth clock synchronization, the audio clocks of the main and subordinate Bluetooth devices adjusted by the audio phase-locked loop are also synchronized. Therefore, the main and subordinate Bluetooth devices can read and play the audio data to-be-played at the playing time point t according to the synchronized audio clock;
(2) In the second implementation, the main and subordinate Bluetooth devices use the size of the respective data cache as the input of the phase locked loop, and adjust the audio clocks of the main and subordinate Bluetooth devices according to the cache size, so as to synchronize the audio clocks of the main and subordinate devices. Therefore, the main and subordinate Bluetooth devices can read and play the audio data to-be-played at the playing time point t according to the synchronized audio clock;
(3) In the third embodiment, the synchronization of the audio data of the main and subordinate Bluetooth devices is not required, and simultaneous play of the audio data at the playing time point t can also be realized. Specifically, in these embodiments, the main and subordinate Bluetooth devices can adjust the data sampling rate through the respective resampling modules, so that the length of the data cache is consistent and the access speed is fixed, that is, the audio data is adjusted by adjusting the sampling rate. The length of the access time in the data cache is fixed. In this case, it is not necessary to adjust the audio clock synchronization, and the main and subordinate Bluetooth devices can read and play the audio data to-be-played at the playback time point t.
In this embodiment, the following situations exist in the audio synchronous play mode between the main and subordinate Bluetooth devices:
Therefore, in combination with the above four implementation manners, since both the main and subordinate Bluetooth devices have the possible need of retransmitting data packets, as described in the third embodiment, the main Bluetooth device may receive correctly the audio data packet in the first audio transmission, and the subordinate Bluetooth device may correctly receive the audio data packet in the last retransmission. As described in the fourth embodiment, the main Bluetooth device and the subordinate Bluetooth device may both receive correctly the audio data pocket in the last retransmission. In order to avoid the time point when the audio data packet is correctly received is behind the set playing time point, one embodiment is to set the time length Δt of the delayed play time to be not less than the length of the Bluetooth time slot before the last retransmission, for example, the last retransmission in
In summary, the audio synchronization playing method disclosed in the above embodiments of the present invention can be separately performed in each wireless speaker connected to the audio source, that is, each wireless speaker is synchronized with the clocks of other wireless speakers, when the audio data sent by the audio source is received, the audio synchronous playback method of the embodiment of the present application is used for synchronous audio playback, and the data interaction between each wireless speaker is not required, so it can reduce the amount of data transmission between wireless speaker devices and power consumption of wireless speaker equipment, in addition, due to the unreliability of wireless transmission (main-subordinate transmission), the data transmission between the wireless devices is reduced, and the reliability of the system synchronous play is also improved. Moreover, the audio playing time point obtained by each wireless speaker is based on the time point at which the audio data packet (air signal) is received on the basis of the transceiver clock synchronization, and thus the synchronization precision is high.
It should be noted that although the operations of the method of the present invention are described in a particular order in the drawings, this is not required or implied that such operations must be performed in that particular order, or that all illustrated operations must be performed to achieve the desired results. Additionally, or alternatively, some steps may be omitted, multiple steps may be consolidated into one step, and/or a step may be decomposed into multiple steps.
Having described the methods of the exemplary embodiments of the present invention, an audio synchronization playing device according to an exemplary embodiment of the present invention will be described with reference to
The receiving time point determining module 101, which is used to receive the first audio packet sent by the audio source and to determine the first time point of receiving the described first audio packet; Audio data processing module 102, which is used to process the first audio packet and generate the second audio packet, wherein the second audio data packet comprises audio data to be broadcast with a fixed data length; The playing time point generating module 103, which is used to set the delayed play time, obtain the playing time point of the second audio packet according to the first time point and the delayed play time, and play the audio data to-be-played in the second audio packet at the playing time point.
In some embodiments, the receiving time point determining module 101 receives the first audio data packet sent by the audio source, including: receiving the first audio data packet within a fixed time interval, and setting the maximum retransmission times of the first audio data within the fixed time interval.
In some embodiments, the receiving time point determining module 101 receives the first audio data packet sent by the audio source, including: setting the fixed time point within the fixed time interval, and receiving the described first audio data packet that is first transmitted or retransmitted.
In some embodiments, the receiving time point determining module 101 determines the first time point of receiving the first audio data packet, including: for any one of the two or more wireless speakers, setting the fixed time point of receiving the first audio data packet for the first time within the said fixed time interval as the first time point.
In some embodiments, the audio data processing module 102 processes the mentioned first audio data packet to generate a second audio data packet, including: performing data decompression processing on the first audio data packet, and generating a second audio data packet containing audio data to be broadcast with a fixed data length.
In some embodiments, the audio data processing module 102 sets a data length of the audio data to be played in the second audio data packet after the decompression to correspond with a time length of the described fixed time interval has been set; The length of the audio data played during the fixed time interval is equal to the data length of the audio data to be played in the second audio data packet.
In some embodiments, the playing time point generating module 103 sets the time delayed play time, including: set the time length of the time delayed play time to be not less than the length of time between the time point of the last retransmission of the first audio packet in the fixed time interval and the first time point.
In some embodiments, the playing time point generating module 103 obtains the playing time point of the second audio data packet according to the first time point and the delayed play time, including: from the first time point, delay the described delayed play time to obtain the playing time point of the second audio data packet.
In some embodiments, the audio synchronization playing device further include a transceiver clock synchronization module which is used to synchronize the transceiver clock of the wireless speaker with the audio source clock before receiving the first audio data packet sent by the audio source, thereby the clocks of all wireless speakers are indirectly synchronized.
In some embodiments, the playing time point generating module 103 includes:
An audio clock synchronization module used for synchronizing an audio clock with a transceiver clock;
And an audio data playing module used to play the audio data to be played according to the audio clock.
In some embodiments, there are two or more wireless speakers that establish a wireless connection with the audio source; the wireless connection includes ordinary Bluetooth, Bluetooth low energy, physical layer improved Bluetooth, WIFI and any of one or several forms of the near field communication.
In some embodiments, the described two or more wireless speakers include a main wireless speaker and a subordinate wireless speaker; wherein, the main wireless speaker not only establishes the first Bluetooth connection with the audio source, but also establishes a second Bluetooth connection with the subordinate wireless speaker; the main wireless speaker transmits the relevant parameters of the first Bluetooth connection to the subordinate wireless speaker to cause the subordinate wireless speaker to intercept and receive the audio source data packet from the audio source.
Moreover, although several units of the audio synchronization playing device are mentioned in the above detailed description, such division is merely not mandatory. Indeed, in accordance with embodiments of the present invention, the features and functions of two or more units described above may be embodied in one unit. Also, the features and functions of one unit described above may be further subdivided into multiple units to externalize.
In one embodiment, the functionality of the audio synchronization playing device shown in
In another embodiment, the audio synchronization playing device shown in
In addition, as shown in
The audio synchronization playing method disclosed in the embodiments of the present invention can be separately performed in each wireless speaker connected to the audio source, that is, each wireless speaker is synchronized with the clocks of other wireless speakers, when the audio data sent by the audio source is received, the audio synchronous playing method of the embodiment of the present application is used for synchronous audio play, and the data interaction between each wireless speaker is not required, so it can reduce the amount of data transmission between wireless speaker devices and power consumption of wireless speaker equipment, in addition, due to the unreliability of wireless transmission (main-subordinate transmission), the data transmission between the wireless devices is reduced, and the reliability of the system synchronous playback is also improved. Moreover, the audio playing time point obtained by each wireless speaker is based on the time point at which the audio data packet (air signal) is received on the basis of the transceiver clock synchronization, and thus the synchronization precision is high.
The technical personnel in the field shall be aware that embodiments of the present invention can be provided as methods, systems or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining of software and hardware. Moreover, the present invention can adopt the form of a computer program product which includes one or more computer usable program code and can be embodied on computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.).
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present invention. It shall be understood that the combination of each flow and/or box in the flowchart and/or block diagram and the flow and/or box in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to form a machine, so that the execution of instructions sent by a processor of a computer or other programmable data processing device to use for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. Thus, instructions executed on a computer or other programmable device provide steps for the implementation of functions specified in a flow or flows of a flowchart and/or a box or boxes of a block diagram.
The principles and mode of execution of the present invention have been described in connection with the specific embodiments that the description of the above embodiments is only used for understanding of the method of the present invention and the core idea thereof. At the same time, for those technical personnel in the field, according to the idea of the present invention, there will be changes in the specific implementation mode and application scope. To sum up, the contents of the specification should not be interpreted as restrictions on the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201910788718.4 | Aug 2019 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20060215664 | Iwase | Sep 2006 | A1 |
| 20090298420 | Haartsen | Dec 2009 | A1 |
| 20140064513 | Behringer | Mar 2014 | A1 |
| 20170098466 | Elliot | Apr 2017 | A1 |
| 20180165056 | Lay | Jun 2018 | A1 |
| 20180167757 | Yu | Jun 2018 | A1 |
| 20180359719 | Tanaka | Dec 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 101202608 | Jun 2008 | CN |
| 108337074 | Jul 2018 | CN |
| Number | Date | Country | |
|---|---|---|---|
| 20210067874 A1 | Mar 2021 | US |
