The invention provides means to improve the flexibility and usability of a variety of audio devices that are intended to produce multi-channel physical audio waveforms based upon audio data, device data and power transmitted from an audio base unit, such as a receiver body pack, to an audio transducer system, such as in-ear monitors with digital processing units. This invention transmits digital data bidirectionally to and from the audio base unit as time-division multiplexed serial data words over a connecting cable having a single active line. An arbitrary number of channels of audio, sensor data and control data can be transmitted over the active line.
Professional stage in-ear monitor systems are known to use wireless technology to send an audio mix to the in-ear monitors. The systems transmit audio data from a control console via an RF transmitter (e.g., off stage) to an RF receiver in a receiver body pack worn by the performer. Any number of receivers can receive a single audio mix. The transmitters and receivers transfer audio wirelessly via a radio frequency (e.g., tunable in VHF and UHF). The in-ear monitor cable typically plugs into a 3.5 mm stereo jack on the receiver body pack, which is often clipped onto the belt, guitar strap, clothing of the performer, or placed in a pocket. The receiver body pack outputs analog audio signals to the in-ear monitors which are the last stage of the signal path in the system. The in-ear monitors are placed in the external ear canal and seal against the sides of the ear canal.
Universal in-ear monitors include a variety of foam and silicone tips. If a universal earpiece does not fit a specific person, they may need to order custom in-ear monitors. Custom molded in-ear monitors are more comfortable to wear and better isolate the audio from ambient noise but can be quite expensive. Depending on the quality of the fit and length of the canal portion of the earpiece, a custom fit in-ear monitor will generally provide somewhere between 25 and 34 dB of noise reduction. This means that loud onstage instruments are less likely to cause hearing damage for onstage musicians wearing in-ear monitors. Impressions for custom in-ear monitors are often taken by an audiologist.
Some performers desire a more natural sound from their in-ear monitors. For this purpose, some in-ear monitors have a small hole drilled into the earpiece to allow natural ambient sound into the ear canal. This can potentially lead to increased sound exposure as it reduces the signal-to-noise ratio for the audio mix and causes the musician to increase the volume of the in-ear monitor. Active ambient in-ear monitors use external microphones to reproduce the ambient sound in the audio mix.
In-ear monitors, earbuds and headphones, are known to have multiple speakers, where a smaller speaker provides more effective sound reproduction at higher frequencies and a larger speaker provides more effective sound reproduction at lower frequencies. Other examples where multiple output transducers are desirable may include those where an output vibration transducer (or bone conduction transducer) is used, or even cases where multiple sources are to be listened to. An example prior-art application of this technique is presented by U.S. Pat. No. 8,311,259 where an in-ear monitor (or earbud) is configured to fit within a user's auditory canal and contains multiple “balanced armature” or “BA transducers” connected to the output of a “frequency divider” network (labelled as item 107 in
A primary object of the invention is to provide an effective way of transmitting data between an audio base unit (e.g. a receiver body pack) and an audio transducer system (e.g. digital in-ear monitors) to facilitate the transmission demands of multi-channel audio data, control data as well as the capability of transmitting control data and possibly sensor data from the audio transducer system (e.g., digital in-ear monitors) to the audio base unit (e.g. receiver body pack). For example, it is also known to place a microphone in an earpiece to detect sound levels in the ear canal, see U.S. Pat. No. 10,667,067 B2, entitled “Earguard Monitoring System” by Steven Wayne Goldstein., issuing May 26, 2020. The microphone data is used to determine sound levels which in turn are used to limit dangerous volume levels. The invention is able to address the data transmission needs of such a system effectively. Facilitating effective bidirectional data flow enables better allocation of processing resources on the audio base unit (e.g., receiver body pack) and the audio transducer system (e.g., in-ear monitors) as well as on other devices communicating with the audio base unit, such as a control console.
Another object of the invention is to provide DC power to the audio transducer system (e.g. in-ear monitors) from the audio base unit (e.g. receiver body pack), in a reliable, simple manner.
The present invention uses a physical cable, namely a bidirectional link having a single active line to address the data transmission needs associated with multi-channel audio and the bidirectional flow of non-audio data such as control data and possibly sensor data. Optionally, the bidirectional link is also capable of DC power transmission. The receiver audio body pack, or other audio base unit, and in-ear monitors, or other audio output transducer device, are configured to implement bidirectional, time-division multiplexed serial data transmission over the active line of the bidirectional link. Users need not be concerned with inadvertently connecting incompatible components via the bidirectional link as the system includes means for connected devices (e.g. in-ear monitors) to detect compatibility with the audio base unit (e.g. a receiver body pack) and its power supply before enabling use of the output audio transducer system (e.g. in-ear monitors, earbuds or headphone).
The exemplary embodiment of the invention is directed to using the bidirectional link in an in-ear audio monitoring system used by musicians and other performers. There are three basic elements to the in-ear audio monitoring system. The first element is a rack-mounted RF transmitter (or RF transceiver) with a display and screens, e.g. a control console operated by a sound engineer. The second element is a belt-worn, receiver body pack with an RF receiver (or RF transceiver) that communicates via tuned UHF or VHF with the control console. The third element is the earpieces or in-ear monitors, e.g. right side and left side in-ear monitors. In accordance with the invention, the bidirectional link connects the right side and the left side in-ear monitors to the receiver body pack. The bidirectional link is physically connected between the receiver body pack and the in-ear monitors in common. Multi-channel digital audio data and non-audio data are transmitted over the bidirectional link using time division multiplexed serial data transmission. Each in-ear monitor has a transducer digital processing unit, e.g. a microcontroller unit or an FPGA, and preferably internal non-volatile memory which is used to store user settings, factory ID and/or calibration information. The receiver body pack also has a digital processing unit, e.g. a microcontroller unit or an FPGA, and non-volatile memory. On stage, a multi-channel audio mix is typically transmitted at a selected radio frequency from the rack mounted RF transmitter to the RF receiver on the receiver body pack. Then, the multi-channel audio is converted to a serial digital data stream, along with other control data, which is transmitted over the bidirectional link to the in-ear monitors. As mentioned, the transmission of the multi-channel digital audio data, and the control data is accomplished via time division multiplexed serial data transmission. In the exemplary embodiment of the invention, each in-ear monitor also includes a microphone to monitor sound and/or sound energy level exposed to the user's ear canal. The microphone signal is converted to digital serial data in the in-ear monitor and is transmitted over the bidirectional link via bidirectional time division multiplexing as described in more detail below. Accordingly, the invention can be used to limit audio volume and/or extended exposure to audio above safe levels or provide warnings regarding audio safety limits. The microphone signal can also be used to detect voice commands, which can be interpreted by the audio base unit or control console or can be made available to the sound engineer.
The invention is not limited to using the bidirectional link to communicate only between a receiver body pack and in-ear monitors. In a more general sense, the term “audio base units” is used herein to identify devices that process, store, condition, amplify and/or transmit electrical audio signals and control data. The term “audio output transducer device” is used to identify in-ear monitors, earbuds, headphones or other audio output devices. The bidirectional connecting cable has an active line, and a ground line that connects between the audio base unit and the audio output transducer device. DC power output from the audio base unit, base device data, and digital audio data are transmitted over the active line in the bidirectional connecting cable to a processing unit on the audio output transducer device, and transducer device data from a processing unit in the audio output transducer device is also transmitted over the active line (in the other direction) to the audio base unit. In accordance with the invention, all transmitted data is digital data and is transmitted bidirectionally over the active line as time-division multiplexed serial data words.
In the exemplary embodiment, the invention is implemented in a multi-channel audio system and the audio base unit is configured to output multi-channel digital audio data, in addition to DC power and base device data. The audio base unit is preferably a receiver body pack that has a power source such as a battery. Each in-ear monitor in the audio transducer system includes a processing unit as mentioned previously, a plurality of transducer amplifiers and a plurality of acoustic output elements. The in-ear monitors are configured to receive DC power, base device data, and multi-channel digital audio data over the active line on the bidirectional connecting cable. The in-ear monitors are both connected to the active line in the exemplary embodiment. Optionally, in-ear monitors can also receive data to drive a haptic actuator, which generates vibration the user can feel, e.g. to provide the sensation of reverberation.
The audio transducer processing unit (in the in-ear monitor) includes an internal digital processor, e.g. an FPGA, that demultiplexes the multi-channel digital audio data transmitted from the audio base unit and outputs separate digital audio signals for each respective acoustic element. Multiple digital-to-analog converters each receive one of the separate digital audio signals from the internal digital processor (e.g. FPGA) and output an analog audio signal that drives the respective acoustic element.
The audio transducer processing unit is also configured to output transducer device data that is transmitted over the bidirectional connecting cable to the audio base unit. Desirably, the in-ear monitors include an input transducer such as a microphone in the acoustic output port of the earpiece. This microphone is desirably used to monitor the decibel level in the ear canal, or the voice of the user. The audio transducer processing unit has an analog-to-digital converter that receives an amplified signal from the microphone for this purpose. The audio transducer processing unit is configured to output digital transducer data, which in turn is transmitted over the active line of the bidirectional cable as time-division multiplexed serial data words.
Preferably, the bidirectional time-division multiplexed serial data words are transmitted over the active line during a synchronized sample period having a constant frequency and a start of each sample period ts and an end of each sample period te. The audio base unit emits a predetermined start synchronizing word at the start of each sample period ts on the active line of the bidirectional connecting cable that facilitates locking of a phase-locked loop in the transducer processing unit of the audio transducer system (e.g. in-ear monitor) to generate a word clock reference and emits data words of the multi-channel digital audio data, the base device data followed by a transition synchronizing word to notify the transducer processing unit to begin transmitting the transducer device data from the audio transducer processing unit over the active line to the audio base unit. The base unit transmits a final synchronizing signal at the end of the sample period (where t=te). Desirably, said data words of the multi-channel digital audio data are emitted sequentially. In the exemplary embodiment, both of the in-ear monitors communicate with the audio base unit (receiver body pack) over the active line in the bidirectional link, and address data is used to identify the proper in-ear monitor for the data. The audio base unit also signals over the active line when it is ready to receive data from the respective in-ear monitors.
Using the invention, audio transducer systems and audio base units are able to reliably exchange multi-channel data describing (distinct) audio signals and control information. It also enables an audio base unit to provide a flexible source of DC power to the audio transducer system. The invention can be implemented with a single shielded conductor paired with a grounding conductor. Desirably, the audio transducer systems and audio base units may be connected via these simple conductors utilizing connectors that are commonly available, such as a 3.5 mm jack, ¼ inch headphone jack, BNC or RCA connector, generic plug-type connectors or even standard USB connectors. In the exemplary embodiment, the active line and ground of the bidirectional link are connected with a jack at one end to the receiver body pack and connected to each earpiece with a jack as well.
Since the jacks removably connect the bidirectional connecting cable to a port on the audio output transducer device (e.g. in-ear monitors), the audio transducer processing unit includes an ID resistor to identify that the in-ear monitors are compatible with the receiver body packs. When the bidirectional connecting cable is connected to the audio output transducer device (e.g. in-ear monitors), DC power is transmitted from the audio base unit (receiver body pack) only if it is determined that the ID resistor is compatible with audio base unit. If so, an LED light on the in-ear monitor illuminates to indicate compatibility. In many circumstances, the in-ear monitors will be
In the exemplary embodiment of the invention, the in-ear monitor has an exterior housing, and a plurality of acoustic output elements including a first acoustic transducer (low frequency speaker) and a second acoustic transducer (high-frequency speaker). A flexible in-ear plug surrounds the acoustic output port and is configured to be placed in the ear canal of the user. A first acoustic chamber extends from the first speaker in the exterior housing into the acoustic output port and a second acoustic chamber extends from the second speaker in the exterior housing into the acoustic output port. This embodiment provides 2-channel audio output; however, the invention can be implemented with 3- or 4-channel audio output if desired. It may also be desired that the earpiece has a haptic actuator that generates vibration that the user can feel. The haptic actuator is driven from data transmitted from the audio base unit similar to the multi-channel audio data. The preferred in-ear monitor also has a microphone in the acoustic output port, as described above. DC bias voltage for the microphone in the acoustic output port is provided from a power supply control on the audio base unit over the bidirectional link.
In some embodiments of the invention, the audio base unit generates single channel audio, e.g., to drive one speaker in the earpiece or matching speakers in a system with two earpieces. Such systems are similar in other respects to the multi-channel speaker system described above. For example, the in-ear monitors or earpieces preferably have a microphone in the acoustic output port to monitor decibel levels in the ear canal, and the bidirectional connecting cable connects the in-ear monitor or earpiece to the audio base unit. Again, the transmitted data is digital data (optionally superimposed on DC power) and is transmitted bidirectionally over the active line as time-division multiplexed serial data words. Other features and advantages of the invention may be apparent to those skilled in the art after reviewing the drawings and the description thereof.
Referring to
The in-ear monitor 300 depicted in
The audio transducer system 300 desirably includes one or more microphone elements 308, as mentioned above, placed to detect sound levels representing the sound resulting in the ear canal from audio feedback presented to the performer while using this device. In some embodiments, it may be desirable to monitor ambient sound levels being experienced by the user. This feature may be especially important if the in-ear monitor includes an opening to allow some ambient sound to enter. The sound levels may be calculated by an FPGA 401 (
Sound waves produced by the output acoustic elements 304a-b are mixed through the output port 307 that fits (or protrudes) into the ear canal of a user. Even though this embodiment shows the use of three output acoustic elements 304a-c (including the two speakers 304a-b and the haptic element 304c), in other embodiments, a different number of output acoustic elements may be preferred. Unlike the prior art, a “frequency divider” circuit is not required, since the bidirectional cable 100 serially transmits multiple distinct audio data channels utilizing time-division-multiplexing, as discussed below
The analog signal 310 from the output of the microphone transducer amplifier 309,
The illustrated bidirectional link 100 is a cable with 3.5 mm jacks, however a wide array of connectors may prove suitable and are envisioned by this disclosure. Referring to
Desirably, once the bidirectional link 100 is connected between the audio base unit 200 and the transducer processing unit 400, a limited (test) from DC power supply 205,
The simplicity and flexibility of the cable portion 104 and associated connectors 101 and 105 are advantageous. Users be confident that the interconnection between the audio transducer system (e.g., in-ear monitors) 300 and the audio base unit (e.g., RF receiver body pack) 200 will function effectively. Those skilled in the art will understand that aspects of the invention can be implemented if the bidirectional cable 100 is connected permanently to the audio transducer 300, thereby avoiding the need for connector/jack 101. For example, the bidirectional cable can be connected permanently to the pair of in-ear monitors 300A, 300B. Or, a segment of bidirectional cable can be connected permanently between the pair of in-ear monitors 300A, 300B (
The exemplary embodiment uses half-duplex, bidirectional serial communications over the active line in the bidirectional link 100. A half-duplex serial communications link at each (200 and 300) end of the bidirectional link 100 provides a simple means for bidirectional communication through a single conductor. In these cases, time-division multiplexing enables bi-directional communication across the link 100, by employing time-division-multiplexing between the serial transmitter 202 in the audio base unit 200 and serial transmitter 402 in the audio transducer system 300 (i.e., within the transducer processing unit 400). A timing diagram illustrating the concept is provided in
This protocol may be repeated over each sample period where the end-time te for each end of a given sample period corresponds to the start-time ts for the next sample period. Signaling activity from the audio base unit 200 and from the transducer processing unit 400 are labelled on the left side as “Signaling from audio base unit 200” and “Signaling from audio transducer processing unit 400”, respectively. The signaling over time is readily envisioned by considering the intersection between the vertical line, labelled “time, t” and the audio base unit 200 signaling waveform (top waveform in
This disclosure describes various exemplary embodiments of the invention, however, alternative designs and applications should be considered within the scope of the invention.
The present application claims priority of U.S. Provisional Patent Application No. 63/586,589, filed Sep. 29, 2023, the content of which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
63586589 | Sep 2023 | US |