Patent Application
20250138775
The present invention relates to a method and apparatus for control and transfer of audio between analog and computer in digital audio processing. It is particularly related to time correction in analog and digital audio processing.
The invention has been developed primarily for use in/with USB connection and will be described hereinafter with reference to this application. However, it will be appreciated that the invention is not limited to this particular field of use.
Audio processed with analog circuitry sounds amazing, but using analog equipment in your workflow is, and has always been difficult. Most music produced now-days uses digital processing of mathematical equations to generate and process audio. This can make the audio sound ‘flat’ and ‘dull’.
Analog is a hassle with problems such as setting up analogue cabling and figuring out how to configure the software and audio interface can take hours. This is a major deterrent to the use of analog. Further If you want to come back and use your analog kit again later it is likely the knobs and setup will be different—this makes it very difficult to replicate the same sound again.
Music Plugin Sales are up 151% over last 10 years. The popularity of EDM and other electronic music genres has contributed to the demand for this broad product portfolio, particularly analog instruments. Professional Studios often want analog sound but can't afford time and effort setting up an maintaining a full analog studio.
It can be seen that known prior art of combined audio processing of Digital and Analog audio processing has the problems of:
The present invention seeks to provide Method and Apparatus for control and transfer of audio between analog and computer in digital audio processing. It particularly includes Time Correction in Analog and digital audio processing. The invention aims to overcome or substantially ameliorate at least one or more of the deficiencies of the prior art, or to at least provide an alternative.
It is to be understood that, if any prior art information is referred to herein, such reference does not constitute an admission that the information forms part of the common general knowledge in the art, in Australia or any other country.
According to a first aspect of the invention there is provided a method for control and transfer of audio between analog and computer in digital audio processing including one or a combination of controlling data by converting to- and-from analog to control the analog circuit and time correction in analogue and digital audio processing wherein a communication line using USB connection between analog processor and digital computer processor.
Adding the capability of digital control of the analog circuit from the Host computer it is highly desirable. This is highly desirable because it enables functionality such as recall of analog settings initiated from the host, and automating the control of the analog circuitry from within the host software. Each time the host software, or plugin is used after saving the settings then the settings can be recalled, or automated thereafter.
In one preferred form the invention provides a method of controlling data by converting to- and-from analog to control the analog circuit includes audio sent from host and is eventually converted by DAC to analog audio. This audio is processed using analog processing hardware (i.e analog circuit such as analog filters, reverb hardware, tape processing, vacuum tubes, analog delay circuit, optical processing of audio, transformers, etc.,), and this hardware is controlled by communicated signals.
The analog block processes audio using any form of analog processing or circuitry, and this circuit is controlled by control signals that are outputs and inputs of analog voltage or current to control the analog processing block that in turn changes the analog processing.
According to form of the present invention, there is provided a method for time correction in analogue and digital audio processing with USB connection between digital processor having original audio and processing audio hardware including the steps of:
The host computer can be Desktop Computer, Laptop, Mobile device, Tablet or cloud computing hardware.
The source audio can be any audio for processing in the computer and therefore can be recorded audio or direct from virtual instrument.
The method can include
The invention achieves synchronisation without a global clock by the time correction to enable clock synchronisation includes the steps of:
It can be seen that the invention of method and apparatus for time correction provides the benefit of easy combination of synchronised digital and analogue processing.
Method of the clock synchronisation steps includes:
Simple Compensation steps include:
The processing audio hardware includes analogue audio processing and requires control data to be sent from within the digital software to the end analogue device, converted from digital to analogue, processed in the analogue domain by that device then converted back to digital and sent back the host software wherein the endpoint processing of processing audio hardware is synchronised without a universal clock all while maintaining accurate and glitch free clock synchronisation at low latency.
It can be seen that the invention of method and apparatus for time correction in analogue and digital audio processing provides the benefit of combining the very best of analogue sound with ease of digital workflow to facilitate the creation of a warmer sound, more enjoyable and tactile experience that musicians, and music producers require.
It can be seen that in one form the invention achieves an aim of:
The invention allows products which are analogue hardware processors to be connected simply by USB. The platform enables analogue equipment to be used as software plugins and instruments inside music software or as standalone software. This creates a brand-new category of products for musicians, producers and audio lovers.
Other aspects of the invention are also disclosed.
Notwithstanding any other forms which may fall within the scope of the present invention, a preferred embodiment/preferred embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:
It should be noted in the following description that like or the same reference numerals in different embodiments denote the same or similar features.
Referring to the drawings there is shown in
Therefore the system can be applied to any audio analogue device and improve connection, versatility and accuracy through the combination of one or more of:
There is provided a method for time correction in analogue and digital audio processing with USB connection between digital processor, computer or host having original audio and processing audio hardware.
As per
The host computer 120 has software 130 containing audio function block (A) that provides the audio source (x) etc., The host computer 120 has audio function (A) that provides bidirectional audio source (x), which is connected to USB audio driver (d) for connection over channel (u) to and from the and connected ancillary analogue processing audio 140. The audio function (A) provides bidirectional audio source (x) which can send and receive back the analogue processed audio from the analogue processing audio hardware 140 is also connected to input output audio for sending to or receiving from external audio components such as mixers, soundcards such as on virtual instruments or speakers.
The audio and ancillary processing 140 has Analogue to Digital Convertor (ADC) and Digital to Analogue Convertor (DAC) so that the audio can be processed in analogue at the endpoint analogue audio circuit (y).
(m) of the ancillary processor takes control data sent from A by the USB audio driver (d) over (u) to Processor (z) then translates into analogue signals to control circuit (y).
There is also (w) which is the glitch-less adjustable clock that generates Audio clk used for hardware audio. (w) is controlled through (z) by the ADJUSTMENT MESSAGE directly, or by PLL methods.
Software running in either block A, B, C or D contains a software algorithm that measures audio clock from computer (c) and compares measured timing with audio timing of USB audio driver (d). Using the algorithm the difference in timing is calculated and sends an ADJUSTMENT MESSAGE to processor (z). Processor (z) responds to ADJUSTMENT MESSAGE and changes the clock frequency of w to match the computer. The result is that Audio Clk (in block 141) matches the Audio I/O Audio Clk in block (c).
The analog block (y) processes audio using any form of analog processing or circuitry, and this circuit is controlled by control signals that are output from block (m). The control block (m) outputs and inputs analog voltage or current to control the analog processing block that in turn changes the analog processing in some way (example; change an analog audio filter cut-off, analog biasing of vacuum tube, change analog delay timing, level of saturation into an audio transformer etc.).
Furthermore the processor z (or any path within block 141) may also contain DSP audio processing. In the case of DSP processing the control signals for such processing shall be carried over USB and may be in the same form as control signals that originate (or are destined) from block m.
The control function block has digital control inputs and outputs inside software on host computer (A) are collected and sent as control data over USB over paths P1 and P2 to the analog hardware via the USB driver (D), and optionally via the aggregator application (C). The control data sent over may be sent over either P1 or P2 as either custom data packets, or as a MIDI representation of the control data. Adding the capability of digital control of the analog circuit from the Host computer it is highly desirable. This is highly desirable because it enables functionality such as recall of analog settings initiated from the host, and automating the control of the analog circuitry from within the host software. Each time the host software, or plugin is used after saving the settings then the settings can be recalled, or automated thereafter.
The USB audio and control paths are related by the following:
Audio sent from host as (x) is eventually converted by DAC to analog audio in block y. Then this audio is processed within block y using analog processing hardware (i.e analog circuit such as analog filters, reverb hardware, tape processing, vacuum tubes, analog delay circuit, optical processing of audio, transformers, etc.), and this hardware is controlled by signals from block m.
Block 140 may also contain generation of analog control signals that are converted from analog to digital control signals in block m, then forwarded to the host (through blocks d to A or B).
Audio that is processed within block y analog processing hardware is then output to ADC and then into processor z then sent to host over USB and into d and A or B.
Control signals are controls for the analog processing hardware. Control signals are sent over the USB connection as digital control messages between blocks m, z, u, d and A or B (optionally via block C), and then converted to and from analog voltages (and/or currents) in block m by using a control-DAC (for control outputs) and control-ADC (for control inputs). When describing the control-ADC or control-DAC its important to note that these are contained within block m and this is not the same path where ADC and DAC are connected to processor z and used for the analog audio hardware processing. Processor z receives and sends the control signals in their digital form to and from the host (block d and also block A (or B) through to block m. Block m converts the control signals to and from analog voltage (or currents) that in turn control the analog circuit in block y. Block 140 may also contain generation of analog control signals that are converted to control signals in block m then forwarded to the host (through blocks d).
Any of the blocks m, y, z may or may not be internal to the product.
A further example could be that we do not include ADC or DAC blocks and sell product with only z and m. Any combination of these inclusions or exclusion of each block should apply.
Referring to
However in other forms there is a bulk transfer mode that can be used to transfer the audio data at a rate related to the Audio I/O clock.
Referring to
The primary application to playout processed audio runs on the host computer as either:
Block A represents audio that is sent or received within computer software (examples are; audio to and from an AU, VST, AAX plugin hosted within a digital audio workstation (DAW)). Multiple instances of this audio can be present in the host. Multiple instances are represented by separate audio streams between A to and/or from the USB audio driver D. Streams may pass directly from an instance A to the audio USB driver D, or through aggregator block C. (block C is also called an applet or Hub).
Block A there can be any number of instances (1,2 . . . ).
Block C is aggregation block that combines and splits audio streams from D into separate streams. Block C may be bypassed and instead audio sent or received directly to block D.
Block B represents some application, driver or process on the Host that directly process the audio stream in a self-contained way. This is differentiated by Block B so that it processes audio as plugins with a DAW.
Audio and ancillary data is sent between the host software and hardware through USB audio driver D with intermediate processing performed by aggregation block (.C). The Applet or Hub (C) aggregates all x channels to send to USB audio driver via y and calculates the ADJUSTMENT MESSAGE. Functions performed in (.C) may also be integrated within driver application (D), or within (A) or (B).
The time correction to enable clock synchronisation includes the steps of:
The clock synchronisation steps include:
The Simple Compensation steps include:
It can be seen that this is done by:
In operation with reference to
Operating Analogue equipment inside host digital software (without changing the user's workflow) requires audio and control data to be sent from within the digital software to the end analogue device y, converted from digital to analog, processed in the analog domain by that device then converted back to digital and sent back the host software all while maintaining accurate and glitch free clock synchronisation at low latency.
The analogue device may also have multiple audio processing circuits and audio channels, these need to be processed in a multi-instance method and maintain synchronization between each channel.
In this setup there is audio software A, B, C, or D with algorithm and with main audio output to mixer or soundcard or speakers selected in the audio software. The USB audio driver is connected to the audio software. (either through intermediate applet (C) or directly to (A) or (B)).
The software algorithm measures audio clock from computer (c) and compares measured timing with audio timing of USB audio driver (d). The algorithm calculates the difference in timing and sends an ADJUSTMENT MESSAGE (using USB data) to processor z in the processing audio hardware 140.
The processor z responds to the ADJUSTMENT MESSAGE and changes the clock frequency of w in the processing hardware 140 so as to match.
Software that runs inside host software (plugin, virtual instrument or applet or standalone application). This applet routes the audio to and back from the end point analog processing device. Importantly the audio at the end point is synchronised from timing measured in this applet.
It can be seen therefore that audio at point (x) is synchronized with audio at point (z) and (w) without a universal clock but by measuring offset and sending an adjustment over USB connection. It allows keeping host audio clock synchronised with endpoint analog processing device at low latency without a universal clock or external clock.
A first product as an embodiment of the invention has 4 independent tube channels, two tube types, parallel and primary analog processing paths for each channel. Perfect for warming up any digital sound, mastering, or production use.
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment, but may. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner, as would be apparent to one of ordinary skill in the art from this disclosure, in one or more embodiments.
Similarly it should be appreciated that in the above description of example embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description of Specific Embodiments are hereby expressly incorporated into this Detailed Description of Specific Embodiments, with each claim standing on its own as a separate embodiment of this invention.
Furthermore, while some embodiments described herein include some but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention, and form different embodiments, as would be understood by those in the art. For example, in the following claims, any of the claimed embodiments can be used in any combination.
As used herein, unless otherwise specified the use of the ordinal adjectives “first”, “second”, “third”, etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
In describing the preferred embodiment of the invention illustrated in the drawings, specific terminology will be resorted to for the sake of clarity. However, the invention is not intended to be limited to the specific terms so selected, and it is to be understood that each specific term includes all technical equivalents which operate in a similar manner to accomplish a similar technical purpose. Terms such as “forward”, “rearward”, “radially”, “peripherally”, “upwardly”, “downwardly”, and the like are used as words of convenience to provide reference points and are not to be construed as limiting terms.
In the claims which follow and in the preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, the word “comprise” or variations such as “comprises” or “comprising” are used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention.
Any one of the terms: including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
Thus, while there has been described what are believed to be the preferred embodiments of the invention, those skilled in the art will recognize that other and further modifications may be made thereto without departing from the spirit of the invention, and it is intended to claim all such changes and modifications as fall within the scope of the invention. For example, any formulas given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present invention.
Although the invention has been described with reference to specific examples, it will be appreciated by those skilled in the art that the invention may be embodied in many other forms.
It is apparent from the above, that the arrangements described are applicable to the digital and analog audio processing industries.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2022901228 | May 2022 | AU | national |
This Patent Application is a Continuation of PCT Patent Application No. PCT/AU2023/050388, filed May 9, 2023, which designated the United States. PCT Patent Application No. PCT/AU2023/050388 and this application claim the benefit of Australian Patent Application No. 2022901228, filed May 9, 2022. The entire teachings and disclosures of each application are incorporated herein by reference thereto.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/AU2023/050388 | May 2023 | WO |
| Child | 18941782 | US |
