The present application claims priority from German Patent Application No. 10 2018 128 202.8 filed on Nov. 12, 2018, the disclosure of which is incorporated herein by reference in its entirety.
The invention relates to an audio reproduction system, a method for configuring an audio reproduction system and a server for an audio reproduction system.
Audio reproduction systems for sound detection by means of a microphone and for providing output audio signals via loudspeakers have been known for long and are used in lectures, presentations, conferences etc.
U.S. Pat. No. 9,232,307 B2 discloses a wireless transmission system in which users may use their mobile device, e.g. a smartphone or PDA (Personalized Digital Assistant), at a convention or conference as a personal microphone for speaking via an existing amplifier system. They may also use the mobile device for listening via headphones to the signal reproduced via the amplifier system. For this purpose, the mobile device is connected to the amplifier system via a mobile network or a wireless local network. However, the user must first call a phone number to use the service, whether in the conference room or anywhere else. A moderator or a corresponding automated function assigns a caller a place on a speaker waiting list. However, one central microphone intended for the speaker is wired and is connected to the amplifier system independently from the mobile devices. It is therefore firmly tied to the room. Different rooms use separate transmission systems and each room needs a separate central microphone.
An object of the present invention is to provide an improved method for configuring an audio reproduction system for detecting sound and for providing different output audio signals in a plurality of rooms.
A method in accordance with the invention is disclosed. In the method, at least two wireless microphones connect via a wireless local network like e.g. WiFi/WLAN to a server. Each wireless microphone detects a room identifier, or room information respectively, that indicates in which room of a building the respective wireless microphone is located, and transmits the respective room information via the local network to the server. Further, each of the wireless microphones generates an input audio signal and transmits it via the local network to the server. In the server, at least two different output audio signals are composed or compiled from the input audio signals, according to the respective room information, and each output audio signal is associated with one of the rooms. The output audio signals are sent via the local network to the rooms such that each of the output audio signals may be received in several or all rooms. In one embodiment, the output audio signals are transmitted via the local network or a further, second local network to the rooms, where they may be received and reproduced by at least one sound reproducing device located in the respective room. The local network is preferably a wireless network (“WLAN”). The second local network can be a wired network for audio transmission, as used e.g. by DANTE.
The invention further relates to a server for an audio reproduction system for detecting sound and for providing different output audio signals in a plurality of rooms.
The invention further relates to a data carrier having stored thereon program code suitable for configuring a server to compile the at least two output audio signals from the input audio signals.
Further advantageous embodiments are described in the dependent claims.
The invention enables a more flexible use of an audio reproduction system, particularly with respect to the utilized microphones. Further, the configuration of such flexible audio reproduction system is simplified.
Further details and advantageous embodiments are depicted in the drawings, showing in
However, none of the wireless microphones M11-M3 is permanently assigned to one of the rooms R1, . . . ,R4. Instead, each of the wireless microphones M11-M3 may be used in each of the rooms. However, it is automatically assigned temporarily only to the room in which it is physically located. This is done by the wireless microphone detecting room information RK1,RK2,RK3,RK4 that is detectable only in the respective room. The room information RK1, . . . ,RK4 may be e.g. an acoustic, an optic or an electromagnetic signal. Suitable for this purpose is e.g. an ultrasonic signal that is emitted in the room and that comprises a room indication or room identifier. In another variant, a QR code, bar code or something similar comprising a room identifier is provided in the room in order to be detected by the wireless microphone. In a further variant, an electromagnetic near field (NFC) is used that is available only in the room and that comprises a room identifier. When the wireless microphone leaves the room, the temporary assignment may be resolved.
A wireless microphone M11-M3 that is brought into the room is connected to the local network LN, but initially not assigned to any room. In the room, the wireless microphone preferably automatically detects the room information RK1, . . . ,RK4 and transmits it via the local network LN to the server AS. The assignment of the room information to a room R1, . . . ,R4 is known to the server AS, so that by means of this assignment it may automatically detect in which of the rooms the wireless microphone M11-M3 is currently located. To this room it assigns it temporarily.
For example, a first wireless microphone M11 may be brought into a first room R1, as shown in
Each of the wireless microphones generates an input audio signal and transmits it via the local network LN to the server AS. The server generates, corresponding to the room identifier RK1, . . . ,RK4, from the input audio signals at least two output audio signals that differ from each other and that are also assigned to one of the rooms R1, . . . ,R4 each. The server AS provides these output audio signals via the local network LN, which can be received in all rooms, at least to the respective room to which it is assigned. However, the room in which the respective wireless microphone is located and to which the respective input audio signals are therefore assigned, needs not coincide with the room to which the output audio signal is assigned. As already mentioned above, the local network is usually not necessarily limited to a room, so that the output audio signals may also be physically received in other rooms near the respective room. In one embodiment, the output audio signals may be received in the entire area of the local network LN. In one embodiment, the server AS may additionally ensure that each output audio signal can only be reproduced in the room or rooms to which it has been assigned.
For example, the server may assign an output audio signal generated from an input audio signal M11 of a first wireless microphone that is located in the first room R1 to this first room R1. At the same time, the server may assign a second output audio signal generated from an input audio signal of a second wireless microphone M2 located in the second room R2 to this second room R2. Since usually different events take place in the different rooms R1,R2 in which the wireless microphones M11,M2 are used, the input audio signals as well as the output audio signals differ from each other, depending on the room. However, the assignment of the wireless microphones M11,M2 to the rooms R1,R2 is flexible and only temporarily valid.
Due to this flexibility it is possible, for example, that a further wireless microphone M12 which is connected to the local network and which is also brought into the first room R1 and has detected the room identifier RK1 of this room, is also assigned to this room. The signals of both wireless microphones M11,M12 assigned to this room R1 may be mixed in the server AS, and the mixed audio signal may be assigned as output audio signal to the room R1. Likewise it is possible, for example, that an audio signal coming from a wireless microphone M3 located in a third room R3 is assigned to this third room R3 and to further rooms, e.g. a fourth room R4. The fourth room R4 is located within the reception area of the local network LN, e.g. due to a nearby wireless base station WS3, as shown in
The server may not assign an input audio signal neither an output audio signal to a room that has no room identifier. Therefore, in one embodiment, a mobile device there may connect to the local network LN, but not reproduce an output audio signal. In another embodiment however, the server may unlock an output audio signal, thus allowing it to be played back in the entire reception area of the local network LN, or in a defined part thereof. But this is an additional mode that is required only in exceptional cases, e.g. at a central event where the audience may be in several rooms that are distributed all over a building. If a wireless microphone is located in a room that is within the reception area of the local network LN but has no room identifier, it will either not output an audio signal, or the server will ignore its input audio signal or at least will not be able to assign it to an output audio signal.
The transmission of the output audio signal via the local network LN may be done in different ways. In one embodiment, the server AS provides via a 1:1 connection (unicast), individually for each authenticated sound reproducing device, a downlink stream comprising the output audio signal assigned to the respective room. In another embodiment, the server generates a list of sound reproducing devices that are authenticated for a particular room or a particular output audio signal, and provides the respective output audio signals via a 1:N connection (multicast) to the sound reproducing devices contained in the list. In a further embodiment, the server AS transmits to each authenticated sound reproducing device only key information that is required for audio reproduction by the sound reproducing device, while the output audio signals may be received freely.
Advantageously, in principle each wireless network with a low latency can be used as local network LN, such as for example WLAN/WiFi, LTE or similar. For the complete system comprising wireless transmission from the microphone, processing at the server and transmission to the sound reproducing devices, a low latency below a maximum value of few milliseconds, e.g. 20 ms, should be maintained.
In one embodiment, there will be initially only control data including the room information RK1, . . . ,RK4 transmitted via the connection from the wireless microphone M11-M3 via the local network LN to the server AS. Audio output from the wireless microphone is initially disabled and will only be enabled after the server verified the control data and unlocked the wireless microphone.
In one embodiment, detecting the room information RK1, . . . ,RK4 is done acoustically in at least one of the wireless microphones. In this case, the room information may be emitted e.g. as ultrasound from the loudspeaker (LS1,LS2,LS3). Alternatively, the room information may be emitted as ultrasound from another suitable additional loudspeaker (e.g. ultrasonic beacon UB), e.g. if the loudspeaker LS2 is not suitable for ultrasound. In a variant, the server may adaptively adjust the volume for the reproduction of the room information to the volume of the (low-frequency, e.g. below 15 kHz) sound recorded by the wireless microphone, so as to make use of the psychoacoustic masking effect. The louder the recorded (low-frequency) sound, the louder will the room information (higher frequency, e.g. above 18 kHz) be acoustically played back. Alternatively, the room information is acoustically played back only if the recorded (low-frequency) sound has a minimum volume. This prevents persons in the room that may sense the room information from being disturbed. Otherwise, acoustic transmission e.g. in the very high audible or near-ultrasonic frequency range of 18-20 kHz might disturb in particular persons who may sense this signal, e.g. children.
In another embodiment, detecting the room information RK1, . . . ,RK4 is done in at least one of the wireless microphones optically, e.g. using an optical display that is electronically controlled by the server. In a further embodiment, detecting the room information RK1, . . . ,RK4 in at least one of the wireless microphones is done by an electromagnetic near field (NFC).
In one embodiment, the server may, after a certain time or periodically, require a re-authentication of the wireless microphone and/or the sound reproducing device in order to ensure that it is still within the respective room. In this case, it is advantageous if the wireless microphone or sound reproducing device respectively can detect the room information at any time. This is possible e.g. with ultrasonic transmission or with optically transmitted room information that uses an electronically controlled optical display (e.g. infrared beacon, display for QR code etc.). In one embodiment, the server AS may control the room information RK1,RK2,RK3 centrally, and modify it in certain time intervals. However, in this case it may happen that all sound reproducing devices in the room detect the modification simultaneously and signal it back to the server, which may lead to undesired traffic peaks in the local network LN or at the server AS respectively, e.g. in a larger lecture hall. Therefore, in a variant, the server may modify the room information of different rooms in a time-shifted manner.
A sound reproducing device, such as e.g. a loudspeaker or a mobile receiver (e.g. smartphone) with headphones or earphones that is in one of the rooms may receive and replay at least the output audio signal assigned to the respective room in which it is. However, it is also possible that it may receive via the local network several or all other output audio signals provided by the server. In one embodiment, the sound reproducing device may automatically select the output audio signal that is assigned to the respective room in which it is currently located. For this purpose, also the sound reproducing device may detect the room information RK1, . . . ,RK4 in its environment. But, in one embodiment, it may reproduce only the output audio signal that is assigned to the room in which it is currently located. In this case, the sound reproducing device may authenticate itself to the server, i.e. prove to the server that it is in the room, by means of the room information. In response, the server will unlock for it the output audio signal assigned to the respective room.
In principle, the sound reproducing device may also detect another, alternatively usable unique room information that is in the room, instead of using the same room information as the wireless microphone. The different types of room information need not necessarily be identical, as long as the server uniquely assigns both to the same room. For example, in
Further, a loudspeaker LS2 in the same room R2 may be mobile or fixedly installed and also receive the output audio signal via the local network LN. The loudspeaker may replay the output audio signal that is assigned to the room in which the loudspeaker currently is. Likewise, the ultrasonic beacon UB may be mobile or fixedly installed and also receive the room information via the local network LN. In one embodiment, also the loudspeaker LS2 detects the respective room information RK2 and uses it to authenticate itself to the server AS. In another embodiment however, if the loudspeaker is fixedly installed, it may be addressable by the server via a fixed (network) address and is thereby authenticated indirectly.
The assignment information from the detector 201 is fed to a router 202, which can be programmable in order to flexibly assign the input audio signals 211,221,231 to the output audio signals 251, . . . ,254. In particular, it is also possible to assign a plurality of input audio signals to a single output audio signal, as indicated in
The router 202 and the mixer 203, and optionally also the detector 201, may form an associating unit that comprises at least one processor. This is configurable by means of software so as to compose the at least two output audio signals from the input audio signals.
Moreover, the server AS comprises an output unit 205 for providing the at least two output audio signals 251, . . . ,254 via the local network LN and/or a further local network LN2. As described above, this is done in such a way that the output audio signals 251, . . . ,254 are receivable in the plurality of rooms R1,R2,R3. Furthermore, in each room at least the output audio signal that is associated with it may be automatically selectable by means of the room information.
For the reproduction, the server AS may establish a connection to at least one sound reproducing device U2,LS1-LS3 via the local network LN or the further local network LN2, in order to transmit to the sound reproducing device the output audio signal 251, . . . ,254 that is associated with the respective room in which the sound reproducing device is located. As explained above, the sound reproducing device may be e.g. a loudspeaker LS1-LS3 or a wireless mobile device U2 that is connected via a base station WS2 and that has an audio playback function. In one embodiment, the server AS additionally comprises a control unit 207, wherein the server first receives from each of the wireless microphones M11-M3 only control data including the room information RK1, . . . ,RK4, and the control unit verifies the control data. Only then the control unit enables the reception of the input audio signal 211, 221,231 from the wireless microphone via the local network.
Further, the server AS may comprise a room information control unit 208, which may, via the local network LN, control and modify the room information emitted in one or more of the rooms R1, . . . ,R4. The room information control unit 208 may be connected to the control unit 207.
In one embodiment, the server comprises a receiver assignment unit 209 by which it may receive, from a mobile sound reproducing device, room information of the room in which the mobile sound reproducing device is located, in order to then send to it, individually via a wireless connection, the output audio signal 254 that is associated with this room. Communication for this assignment may be done via the local network LN and a wireless base station WS2.
It is to be noted that
In one embodiment, the method further comprises transmitting 370 the output audio signals 251, . . . ,254 via the local network LN and/or the further local network LN2 into the plurality of rooms. In one embodiment, at least one sound reproducing device LS1-LS3,U21-U42 that is in one of the plurality of rooms may receive 380 and replay 390 the output audio signal associated with the room in which the respective sound reproducing device is.
In one embodiment, the output audio signals 251, . . . ,254 are transmitted into at least one of the plurality of rooms R1,R2,R3 via the local network LN as well as via the further local network LN2, wherein the further local network LN2 is a DANTE network. At least one of the sound reproducing devices connected to it is fixedly installed and comprises one or more loudspeakers LS1,LS2,LS3.
In one embodiment, the local network is wireless, and the receiving 380 and replaying 390 of an output audio signal 251, . . . ,254 assigned to the room is done by a plurality of sound reproducing devices LS1-LS3,U21-U42 that are in the respective room. At least two of the sound reproducing devices are mobile devices U21-U42 that each do the replaying 390 via headphones or earphones. In this embodiment, the method further comprises the steps of detecting 382 the room information RK1, . . . ,RK4 or another, alternatively usable room information that is available in the same room, by each of the at least two mobile devices, and selecting 383 the output audio signal assigned to the respective room in each of the mobile devices. Using the detected room information, the selecting may be done automatically. In one embodiment, only authenticated sound reproducing devices or mobile devices respectively may reproduce the output audio signal associated with the respective room, while playback is prevented for non-authenticated sound reproducing devices. A sound reproducing device or mobile device is authenticated if the output audio signal to be reproduced by it is associated with the room whose room information it has detected.
In one embodiment, the invention relates to a data carrier having stored thereon program code adapted for configuring a server as described above, so that it compiles the at least two output audio signals from the input audio signals. In another embodiment, the invention relates to a data carrier having stored thereon program code adapted for configuring a mobile device to detect room information in its environment, authenticate itself via a local network to a server by using the room information and then can replay an output audio signal received from the server via the local network.
The invention is advantageously usable with audio reproduction systems for sound acquisition and sound output, in particular for providing different output audio signals in a plurality of rooms.
The various embodiments mentioned above may be combined with each other, even if such combination is not expressly mentioned.
Number | Date | Country | Kind |
---|---|---|---|
102018128202.8 | Nov 2018 | DE | national |