Patent Application
20130170646
This application claims the benefit of Korean Patent Application No. 10-2011-0147536, filed on Dec. 30, 2011, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
1. Field of the Invention
The present invention relates to an apparatus and method for transmitting a plurality of audio objects using a multichannel encoder and a multichannel decoder, and more particularly, to an audio object transmission apparatus and method for conveniently transmitting a plurality of audio objects by encoding the plurality of audio objects using a multichannel encoder.
2. Description of the Related Art
A wave field synthesis (WFS) reproduction scheme refers to a technology for providing the same sound field to several listeners in a listening space by synthesizing a wave front of a sound source to be reproduced.
According to the WFS reproduction scheme, a large number of audio objects are necessary for a single audio scene. However, since a transmission medium that transmits a WFS signal has a limited bandwidth, a degree of difficulty in transmission of the audio objects may increase according to an increase in the number of the audio objects.
Recently, the moving picture expert group (MPEG) has developed a method for transmitting a large number of objects using spatial audio object coding (SAOC). However, the SAOC uses a dedicated codec. That is, an additional codec needs to be implemented.
Accordingly, there is a desire for a new secure scheme and method for transmitting a plurality of audio objects without having to implementing an additional codec.
An aspect of the present invention provides an apparatus and method for conveniently transmitting a plurality of audio objects.
Another aspect of the present invention provides an apparatus and method for encoding a large number of audio objects using a conventional multichannel encoder.
According to an aspect of the present invention, there is provided an audio object encoder including a multichannel encoder determination unit to determine a multichannel encoder to be used for encoding of a plurality of audio objects according to the number of the audio objects, an encoding unit to generate an encoded signal by encoding the plurality of audio objects using the determined multichannel encoder, and a multichannel audio object signal generation unit to generating a multichannel audio object signal, by multiplexing sound image localization information of the plurality of audio objects along with the encoded signal.
According to another aspect of the present invention, there is provided an audio object decoder including a signal extraction unit to extract sound image localization information and an encoded signal of a plurality of audio objects from a multichannel audio object signal being received, a decoding unit to restore the plurality of audio objects by decoding the encoded signal using at least one multichannel decoder, and a rendering unit to perform wave field synthesis (WFS) rendering with respect to the plurality of audio objects using the sound image localization information.
According to another aspect of the present invention, there is provided an audio object transmission apparatus including an audio object encoder that transmits a plurality of audio objects by encoding the plurality of audio objects using a multichannel encoder, and an audio object decoder that restores the plurality of audio objects by decoding a received signal using a multichannel decoder.
According to another aspect of the present invention, there is provided an audio object encoding method including determining a multichannel encoder to be used for encoding of a plurality of audio objects according to the number of the plurality of audio objects, generating an encoded signal by encoding the plurality of audio objects using the determined multichannel encoder, and generating a multichannel audio object signal by multiplexing sound image localization information of the plurality of audio objects along with the encoded signal.
According to another aspect of the present invention, there is provided an audio object decoding method including extracting sound image localization information and an encoded signal of a plurality of audio objects from a multichannel audio object signal being received, restoring the plurality of audio objects by decoding the encoded signal using at least one multichannel decoder, and performing WFS rendering with respect to the plurality of audio objects using the sound image localization information.
According to embodiments of the present invention, a plurality of audio objects may be transmitted conveniently, by encoding the plurality of audio objects using a multichannel encoder.
Additionally, according to embodiments of the present invention, in a case that the audio objects are large in number, a plurality of multichannel encoders may be used in parallel. Therefore, audio objects larger in number than channels covered by a conventional multichannel encoder may be simultaneously encoded.
These and/or other aspects, features, and advantages of the invention will become apparent and more readily appreciated from the following description of exemplary embodiments, taken in conjunction with the accompanying drawings of which:
Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Exemplary embodiments are described below to explain the present invention by referring to the figures.
The audio object transmission apparatus may include an audio object encoder 110 which encodes audio objects using a multichannel encoder and transmits the audio objects in a wave field synthesis (WFS) system based on an audio object signal, and an audio object decoder 120 which restores the audio objects using a multichannel decoder.
Referring to
The multichannel encoder determination unit 111 may determine a multichannel encoder to be used in encoding audio objects based on the number of the audio objects. Here, the audio objects may be adapted to generate a 3-dimensional (3D) effect sound source. For example, the audio objects may include objects generating a sound such as a train and an animal, and objects representing a place of a natural phenomenon such as a lightning.
For example, when the audio objects are six in number, the multichannel encoder determination unit 111 may determine a 5.1 channel encoder that uses six channels as the multichannel encoder to be used for encoding of the audio objects. When the audio objects are eight, the multichannel encoder determination unit 111 may determine a 7.1 channel encoder that uses eight channels as the multichannel encoder to be used for encoding of the audio objects.
When the audio objects are larger in number than channels of the multichannel encoder, the multichannel encoder determination unit 111 may determine a plurality of multichannel encoders as the multichannel encoder to be used for encoding of the audio objects.
For example, when the audio objects are twelve in number, the multichannel encoder determination unit 111 may determine a 10.2 channel encoder that uses twelve channels as the multichannel encoder to be used for encoding of the audio objects. However, in a case where the encoding unit 112 has only the 5.1 channel encoder and the 7.1 channel encoder, the encoding unit 112 is unable to encode the audio objects using a 10.2 channel encoder.
In this case, the multichannel encoder determination unit 111 may determine to use two 5.1 channel encoders as the multichannel encoder to be used for encoding of the audio objects, thus encoding the twelve audio objects.
The encoding unit 112 may encode the audio objects using the multichannel encoder determined by the multichannel encoder determination unit 111, thereby generating an encoded signal.
In addition, when the multichannel encoder determination unit 111 determines the plurality of multichannel encoders as the multichannel encoder to be used for encoding of the audio objects, the encoding unit 112 may use the plurality of multichannel encoders in a parallel manner so that the audio objects are simultaneously encoded.
The multichannel audio object signal generation unit 113 may multiplex sound image localization information of the audio objects along with the encoded signal, thereby generating a multichannel audio object signal. Here, the sound image localization information may be information related to an orientation and a distance of the respective audio objects. The multichannel audio object signal generation unit 113 may be a multiplexer (MUX) adapted to output a plurality of signals as a single signal.
The multichannel audio object signal generation unit 113 may add, to the multichannel audio object signal, encoder information which includes information on a type and number of the multichannel encoder determined by the multichannel encoder determination unit 111.
Thus, the audio object encoder 110 according to the present embodiment may conveniently transmit the plurality of audio objects, by encoding the plurality of audio objects by a multichannel encoder. Furthermore, when the number of the audio objects is relatively large, the audio object encoder 110 may simultaneously encode the audio objects larger in number than channels covered by a conventional multichannel encoder.
Referring to
The signal extraction unit 121 may extract the sound image localization information and the encoded signal of the audio objects from the multichannel audio object signal received from the audio object encoder 110. The signal extraction unit 121 may be a demultiplexer (DEMUX) that receives a single signal and outputs a plurality of signals.
Additionally, the signal extraction unit 121 may further extract the encoder information which includes the information on a type and number of the multichannel encoder used for encoding in the received multichannel audio object signal.
The decoding unit 122 may decode the encoded signal by at least one multichannel decoder, thereby restoring the plurality of audio objects.
The decoding unit 122 may decode the audio objects using the at least one multichannel decoder according to encoder information. When the multichannel encoder is plural in number according to the encoder information, the decoding unit 122 may use the at least one multichannel decoder according to the encoder information in a parallel manner, thereby decoding the plurality of audio objects simultaneously.
The rendering unit 123 may perform WFS rendering with respect to the audio objects using the sound image localization information.
Specifically, the rendering unit 123 may perform WFS rendering by receiving user environment information and using the sound image localization information corresponding to the user environment information. Here, the user environment information may be related to a number and positions of loud speakers.
When audio objects 210 are six in number as shown in
Here, a multichannel audio object signal generation unit 113 of the audio object encoder 110 may multiplex sound image localization information 240 of the audio objects 210 along with the encoded signal 230, thereby generating a multichannel audio object signal 250. The sound image localization information may be information related to an orientation and a distance of each of a first audio object 211 to a sixth audio object 212. The multichannel audio object signal generation unit 113 may add encoder information representing that a single 5.1 channel encoder is used, to the multichannel audio object signal 250.
When audio objects 310 are twelve in number as shown in
A decoding unit 112 of the audio object encoder 110 may use the first 5.1 channel encoder 320 and the second 5.1 channel encoder 325 in a parallel manner as shown in
A multichannel audio object signal generation unit 113 of the audio object encoder 110 may multiplex sound image localization information 340 of the audio objects 310 along with the encoded signals 330 and 335, thereby generating a multichannel audio object signal 350. The multichannel audio object signal generation unit 113 may add encoder information representing that two single 5.1 channel encoders are used, to the multichannel audio object signal 350.
That is, the audio object encoder 110 may simultaneously encode twelve audio objects without a 10.2 channel encoder, by using conventional 5.1 channel encoders in a parallel manner.
A signal extraction unit 121 of the audio object decoder 120 may extract an encoded signal 410 and sound image localization information 440 of the audio objects from a multichannel audio object signal 250 received from an audio object encoder 110. The signal extraction unit 121 may further extract encoder information representing that a 5.1 channel encoder is used, from the multichannel audio object signal 250.
As shown in
At last, the rendering unit 123 may perform WFS rendering with respect to the audio objects 430 using the sound image localization information 440.
Here, the rendering unit 123 may receive user environment information 450, and perform WFS rendering using the sound image localization information 440 according to the user environment information 450. Here, the user environment information 450 may be related to a number and positions of loud speakers.
In operation 510, a multichannel encoder determination unit 111 may determine a multichannel encoder to be used for encoding of audio objects, according to the number of the audio objects. When the number of the audio objects is larger than the number of channels of a multichannel encoder usable by an encoding unit 112, the multichannel encoder determination unit 111 may determine a plurality of multichannel encoders as the multichannel encoder to be used for encoding of the audio objects.
In operation 520, the encoding unit 112 may generate an encoded signal by encoding the audio objects by the multichannel encoder determined in operation 510.
In operation 530, the multichannel audio object signal generation unit 113 may generate a multichannel audio object signal, by multiplexing sound image localization information of the audio objects along with the encoded signal generated in operation 520.
In operation 610, a signal extraction unit 121 may extract an encoded signal and sound image localization information of audio objects from a multichannel audio object signal received from an audio object encoder 110. The signal extraction unit 121 may further extract encoder information representing that a 5.1 channel encoder is used, from the multichannel audio object signal.
In operation 620, a decoding unit 122 may decode the encoded signal extracted in operation 610 by a multichannel decoder corresponding to the encoder information extracted in operation 610, thereby restoring the audio objects.
In operation 630, the rendering unit 123 may perform WFS rendering with respect to the audio objects restored in operation 620 using sound image localization information 440 extracted in operation 610.
According to the embodiments, a plurality of audio objects may be conveniently transmitted by encoding the plurality of audio objects by a multichannel encoder. When the audio objects are large in number, a plurality of the multichannel encoders may be used in parallel. That is, the plurality of audio objects larger in number than channels covered by a conventional multichannel encoder may be encoded simultaneously.
Although a few exemplary embodiments of the present invention have been shown and described, the present invention is not limited to the described exemplary embodiments.
Instead, it would be appreciated by those skilled in the art that changes may be made to these exemplary embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2011-0147536 | Dec 2011 | KR | national |
