None
None.
Embodiments of the present invention relate to the field of automatic calibration of audio/video (A/V) equipment. More particularly, embodiments of the invention relate to automatic surround sound system calibration in a home entertainment system.
In recent years, home entertainment systems have moved from simple stereo systems to multi-channel audio systems such as surround sound systems and to systems with video displays. Such systems have complicated requirements both for initial setup and for subsequent use. Furthermore, such systems have required an increase in the number and type of necessary control devices.
Currently, setup for such complicated systems often requires a user to obtain professional assistance. Current home theater setups include difficult wiring and configuration steps. For example, current systems require each speaker to be properly connected to an appropriate output on the back of an amplifier with the correct polarity. Current systems request that the distance from each speaker to a preferred listening position be manually measured. This distance must then be manually entered into the surround amplifier system or the system will perform poorly compared to a properly calibrated system
Further, additional mechanisms to control peripheral features such as DVD players, DVD jukeboxes, Personal Video Recorders (PVRs), room lights, window curtain operation, audio through an entire house or building, intercoms, and other elaborate command and control systems have been added to home theater systems. These systems are complicated due to the necessity for integrating multi-vendor components using multiple controllers. These multi-vendor components and multiple controllers are poorly integrated with computer technologies. Most users are able to install only the simplest systems. Even moderately complicated systems are usually installed using professional assistance.
A new system is needed for automatically calibrating home user audio and video systems in which users will be able to complete automatic setup without difficult wiring or configuration steps. Furthermore, a system is needed that integrates a sound system seamlessly with a computer system, thereby enabling a home computer to control and interoperate with a home entertainment system. Furthermore, a system architecture is needed that enables independent software and hardware vendors (ISVs & IHVs) to supply easily integrated additional components.
Embodiments of the present invention are directed to a calibration system for automatically calibrating a surround sound audio system e.g. a 5.1, 7.1 or larger acoustic system. The acoustic system includes a source A/V device (e.g. CD player), a computing device, and at least one rendering device (e.g. a speaker). The calibration system includes a calibration component attached to at least one selected rendering device and a source calibration module located in a computing device (which could be part of a source A/V device, rendering A/V device, or computing device e.g. a PC). The source calibration module includes distance and optionally angle calculation tools for automatically determining a distance between the rendering device and a specified reference point upon receiving information from the rendering device calibration component.
In an additional aspect, the method includes receiving a test signal at a microphone attached to a rendering device, transmitting information from the microphone to a the calibration module, and automatically calculating, at the calibration module, a distance between the rendering device and a fixed reference point based on a travel time of the received test signal.
In yet a further aspect, the invention is directed to a method for calibrating an acoustic system including at least a source A/V device, computing device and a first and a second rendering device. The method includes generating an audible test signal from the first rendering device at a selected time and receiving the audible test signal at the second rendering device at a reception time. The method additionally includes transmitting information pertaining to the received test signal from the second rendering device to the calibration computing device and calculating a distance between the second rendering device and the first rendering device based on the selected time and the reception time.
In an additional aspect, the invention is directed to a calibration module operated by a computing device for automatically calibrating acoustic equipment in an acoustic system. The acoustic system includes at least one rendering device having an attached microphone. The calibration module includes input processing tools for receiving information from the microphone and distance calculation tools for automatically determining a distance between the rendering device attached to the microphone and a specified reference point based on the information from the microphone.
In yet additional aspects, the invention is directed to automatically identifying the position of each speaker within a surround-sound system and to calibrating the surround-sound system to accommodate a preferred listening position.
The present invention is described in detail below with reference to the attached drawings figures, wherein:
Embodiments of the present invention are directed to a system and method for automatic calibration in an audio-visual (A/V) environment. In particular, multiple source devices are connected to multiple rendering devices. The rendering devices may include speakers and the source devices may include a calibration computing device. At least one of the speakers includes a calibration component including a microphone. In embodiments of the invention, more than one or all speakers include a calibration component. The calibration computing device includes a calibration module that is capable of interacting with each microphone-equipped speaker for calibration purposes.
An exemplary system embodiment is illustrated in
In the embodiment of the system shown in
As set forth in U.S. patent application Ser. Nos. 10/306,340 and U.S. Patent Publication No. 2002-0150053, hereby incorporated by reference, the system shown in
Exemplary Operating Environment
The invention is described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microcontroller-based, microprocessor-based, or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
With reference to
Computer 110 typically includes a variety of computer readable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation,
The computer 110 may also include other removable/nonremovable, volatile/nonvolatile computer storage media. By way of example only,
The drives and their associated computer storage media discussed above and illustrated in
The computer 110 in the present invention will operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in
When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation,
Although many other internal components of the computer 110 are not shown, those of ordinary skill in the art will appreciate that such components and the interconnection are well known. Accordingly, additional details concerning the internal construction of the computer 110 need not be disclosed in connection with the present invention.
Calibration Module and Components
As set forth above, the calibration components 52a-52e preferably include at least one microphone, a synchronized internal clock, and a media control system that collects microphone data, time-stamps the data, and forwards the information to the calibration module 200. Regarding the components of the calibration module 200, the input processing tools 202 receive a test signal returned from each rendering device 8. The speaker selection module 208 ensures that each speaker has an opportunity to generate a test signal at a precisely selected time. The distance and angle calculation module 204 operates based on the information received by the input processing tools 202 to determine distances and angles between participating speakers or between participating speakers and pre-set fixed reference points. The coordinate determination module 206 determines precise coordinates of the speakers relative to a fixed origin based on the distance and angle calculations. The coordinate data storage area 210 stores coordinate data generated by the coordinate determination module 206.
The calibration system described above can locate each speaker within a surround sound system and further, once each speaker is located, can calibrate the acoustic system to accommodate a preferred listening position. Techniques for performing these functions are further described below in conjunction with the description of the surround-sound system application.
Method of the Invention
In step B02 after the calibration module 200 detects connection of one or more speakers using any one of a variety of mechanisms including uPnP and others, the calibration module 200 selects a speaker. In step B04, the calibration module 200 causes a test signal to be played at a precise time based on the time master system 30 from the selected speaker. Sound can be generated from an individual speaker at a precise time as discussed in the aforementioned patent application.
In step B06, each remaining speaker records the signal using the provided microphone and time-stamps the reception using the speaker's internal clock. By playing a sound in one speaker at a precise time, the system enables all other speakers to record the calibration signal and the time it was received at each speaker.
In step B08, the speakers use the microphone to feed the test signal and reception time back to the input processing tools 202 of the calibration module 200. In step B10, the calibration module 200 time stamps and processes the received test signal. All samples are time-stamped using global time. The calibration computing device 31 processes the information from each of the calibration components 52a-52e on each speaker 50a-50e. Optionally, only some of the speakers include a calibration component. Processing includes deriving the amount of time that it took for a generated test signal to reach each speaker from the time-stamped signals recorded at each speaker.
In step B12, the calibration system 200 may determine if additional speakers exist in the system and repeat steps B04-B12 for each additional speaker.
In step B14, the calibration module makes distance and optionally angle calculations and determines the coordinates of each component of the system. These calibration steps are performed using each speaker as a sound source upon selection of each speaker by the speaker selection module 208. The distance and angles can be calculated by using the time it takes for each generated test signal to reach each speaker Taking into account the speed of the transmitted sound, the distance between the test signal generating speaker and a rendering speaker is equal to the speed of sound multiplied by the elapsed time.
In some instances the aforementioned steps could be performed in an order other than that specified above. The description is not intended to be limiting with respect to the order of the steps.
Numerous test signals can be used for the calibration steps including: simple monotone frequencies, white noise, bandwidth limited noise, and others. The most desirable test signal attribute generates a strong correlation function peak supporting both accurate distance and angle measurements especially in the presence of noise.
Specifically,
Accordingly, the key attributes of the signal include its continuous phase providing a flat frequency plot (as shown in
Surround Sound System Application
The calibration computing device 31 will initially guess at a speaker configuration. Although the calibration computing device 31 knows that five speakers are connected, it does not know their positions. Accordingly, the calibration computing device 31 makes an initial guess at an overall speaker configuration. After the initial guess, the calibration computing device 31 will initiate a calibration sequence as described above with reference to
The optional angle information is computed by comparing the relative arrival time on a speaker's two microphones. For example, if the source is directly in front of the rendering speaker, the sound will arrive at the two microphones at the exact same time. If the sound source is a little to the left, it will arrive at the left microphone a little earlier than the right microphone. The first step calculating the angle requires computing the number of samples difference between the two microphones in the arrival time of the test signal. This can be accomplished with or without knowing the time when the test signal was sent using a correlation function. Then, the following C# code segment performs the angle computation (See Formula (1) below):
angle_delta=(90.0−(180.0/Math.PI)*Math.A cos(sample_delta*1116.0/(0.5*44100.0))); (1)
This example assumes a 6″ microphone separation and a 44100 sample rate system where the input sample_delta is the test signal arrival difference between the two microphones in samples. The output is in degrees off dead center.
Using the distance and angle information, the relative x and y positioning of each speaker in this system can be determined and stored as coordinate data 210. The zero reference coordinates may be arbitrarily located at the front center speaker, preferred listening position or other selected reference point.
Alternatively, a single microphone could be used in each speaker to compute the x and y coordinates of each speaker.
In the surround sound system shown in
Additional Application Scenarios
Further scenarios include the use of a remote control device provided with a sound generator. A push of a remote button would provide the coordinates of the controller to the system. In embodiments of the system, a two-click scenario may provide two reference points allowing the construction of a room vector, where the vector could point at any object in the room. Using this approach, the remote can provide a mechanism to control room lights, fans, curtains, etc. In this system, the input of physical coordinates of an object allows subsequent use and control of the object through the system. The same mechanism can also locate the coordinates of any sound source in the room with potential advantages in rendering a soundstage in the presence of noise, or for other purposes.
Having a calibration module 200 that determines and stores the x, y, and optionally z coordinates of controllable objects allows for any number of application scenarios. For example, the system can be structured to calibrate a room by clicking at the physical location of lamps or curtains in a room. From any location, such as an easy chair, the user can click establishing the resting position coordinates. The system will interpret each subsequent click as a vector from the resting click position to the new click position. With two x, y, z coordinate pairs, a vector can then be created which points at room objects. Pointing at the ceiling could cause the ceiling lights to be controlled and pointing at a lamp could cause the lamp to be controlled. The aforementioned clicking may occur with the user's fingers or with a remote device, such as an infrared (IR) remote device modified to emit an audible click.
In some embodiments of the invention, only one microphone in each room is provided. In other embodiments, each speaker in each room may include one or more microphones. Such systems can allow leveraging of all IP connected components. For example, a baby room monitor may, through the system of the invention, connect the sounds from a baby's room to the appropriate monitoring room or to all connected speakers. Other applications include: room to room intercom, speaker phone, acoustic room equilibration etc.
Stand Alone Calibration Application
Alternatively the signal specified for use in calibration can be used with one or more rendering devices and a single microphone. The system may instruct each rendering device in turn to emit a calibration pulse of a bandwidth appropriate for the rendering device. In order to discover the appropriate bandwidth, the calibration system may use a wideband calibration pulse and measure the bandwidth, and then adjust the bandwidth as needed. By using the characteristics of the calibration pulse, the calibration system can calculate the time delay, gain, frequency response, and phase response of the surround sound or other speaker system to the microphone. Based on that calculation, an inverse filter (LPC, ARMA, or other filter that exists in the art) that partially reverses the frequency and phase errors of the sound system can be calculated, and used in the sound system, along with delay and gain compensation, to equalize the acoustic performance of the rendering device and its surroundings.
While particular embodiments of the invention have been illustrated and described in detail herein, it should be understood that various changes and modifications might be made to the invention without departing from the scope and intent of the invention. The embodiments described herein are intended in all respects to be illustrative rather than restrictive. Alternate embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its scope.
From the foregoing it will be seen that this invention is one well adapted to attain all the ends and objects set forth above, together with other advantages, which are obvious and inherent to the system and method. It will be understood that certain features and sub-combinations are of utility and may be employed without reference to other features and sub-combinations. This is contemplated and within the scope of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
7123731 | Cohen et al. | Oct 2006 | B2 |
7155017 | Kim et al. | Dec 2006 | B2 |
20030118194 | Neumann et al. | Jun 2003 | A1 |
Number | Date | Country | |
---|---|---|---|
20050254662 A1 | Nov 2005 | US |