This application claims the benefit of priority from European Patent Application No. 07000806.5, filed Jan. 16, 2007, which is incorporated by reference.
1. Technical Field
This application relates to tracking systems and, more particularly, to determining the spatial orientation of a moveable object.
2. Related Art
Many applications use surround sound techniques to enhance the quality of audio playback for listeners. The perception of surround sound reproduced from audio data may be based on the principles that listeners use to locate sound sources in space in every day life. Namely, sound signals from a particular sound source may arrive at the ears of a listener at different times and with other non-uniformities. Additionally, the human ear influences the frequency of incoming sound signals dependent on the direction of the incoming signal.
When a listener experiences surround sound from loudspeakers, the listener receives both direct sound from each loudspeaker and multiple reflections. By the time sound reaches the listener, the sound from each speaker has acquired a unique signature. These signatures cue the brain as to the size and acoustical properties of the room, the location of the loudspeakers, and the spatial properties of the original sound.
If, however, the listener experiences a surround sound reproduction through a headphone unit, then the effects of amplitude and phase shifting as well as frequency filtering may be eliminated. Without these effects, the listener may be unable to locate the position of various sound sources. Rather, the sound sources are located directly at both ears. Another drawback occurs in the situation where the head of a person turns while listening to simulated surround sound via headphones. The simulated sound field turns together with the head and seems the same to the listener regardless of the orientation of the listener's head. Therefore, the listener will not have a true surround sound experience.
Some systems attempt to overcome this drawback by tracking the movement of the head of the listener. These systems use head tracking information and additional pre-processing to reflect the movements of the head in the sound data fed to the headphones. Some head tracking systems include a measurement device. Others include transmitters. In both systems, a large amount of hardware may be required. Therefore, a need exists for an improved tracking system with a reduced hardware effort.
A tracking system may determine the orientation or position of a movable object. The tracking system includes a signal generator that generates a non-audible detection signal in an audible frequency range. A transmitting device transmits the detection signal to a detection device. The transmitting device or the detection device may be positioned on the movable object, and the other may be positioned at a remote location. A processor may determine an orientation or position of the moveable object based on the transmission time between the transmitting device and the detection device.
Other systems, methods, features, and advantages will be, or will become, apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the following claims.
The system may be better understood with reference to the following drawings and description. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. Moreover, in the figures, like referenced numerals designate corresponding parts throughout the different views.
A tracking system may determine the orientation or position of a movable object. To determine the orientation or position of a movable object, the tracking system uses one or more detection signals transmitted between one or more transmitters and one or more detectors. The transmitter or the detector may be fixed to the movable object while the other (e.g., the transmitter or the detector) may be located at a remote position. The tracking system may determine the orientation or position of the movable object based on a propagation time between the transmitters and detectors. The detection signals may be audio signals. In some systems, the detection signals may be non-audible sonic signals in an audible frequency range. The signals may be detectable by measurement technology, such as a microphone or other detection device. A microphone may detect sonic signals that have signal levels below the threshold of human hearing.
The tracking system may couple or interface an audio system. The audio system may comprise a headphone unit simulating surround sound. In alternative systems, the tracking system may interface with or comprise a portion of a vehicle entertainment system reproducing a multi-channel sound source, a teleconferencing system, a computer system generating 3D-sound (e.g. in connection with computer games), or a home audio/video system.
In an audio system, the use of audio signals for tracking may reduce the hardware needed and the costs of a tracking system. The hardware used by the tracking system may be the same kind used to produce audible sound. Non-audible audio signals may be generated by a digital signal processor (DSP). A DSP may be capable of generating a plurality of signals having various frequencies, forms, and amplitudes. The loudspeakers used in an audio system may serve as the transmitters of the tracking system. The loudspeakers may be in a vehicle, an entertainment system, or coupled to a computer. Additionally, the costs for the detectors may be relatively low as microphones may be the detectors used in the tracking system.
Due to psychoacoustic effects of the hearing process, not all sounds may be perceived by a person, even in the audible frequency range where listeners are generally able to perceive sonic signals. The perception of sonic signals by a human being may be restricted to a sound frequency domain from approximately 20 Hz to approximately 20 kHz. However, not every sonic signal within this range may be perceived by a person through their hearing. A certain sound level of a sonic signal may be required for a person to perceive the signal. The sound level defining the perceivability of a sonic signal in the case where only a single sonic signal exists may be known as an “absolute threshold of hearing” or “threshold in quiet.” The absolute threshold of hearing may depend on the frequency of the tone to be perceived.
The dashed curve 100 in
Sonic signals below the absolute threshold of hearing in the sound level-frequency plane of
The additional curves in
As sonic signals having a sound level below the absolute threshold of hearing may not be perceived, these signals may be appropriate for use as detection signals for the tracking system. In some situations, the tracking system may use detection signals in the frequency ranges where the absolute threshold of hearing is comparably high. These frequency ranges may be outside the central area of the frequency axis shown in
Under certain circumstances, a sonic signal having a sound level above the absolute threshold of hearing may be non-audible and may therefore be used as a detection signal for the tracking system. Such a situation may be caused by a psychoacoustic effect called “masking.” When the detection signal is transmitted in a quite environment, the detection signal may be at a relatively low audio level to be non-audible. Alternatively, when the detection signal is transmitted in a relatively loud environment, the detection signal may be louder and still remain non-audible. In this situation, the detection signal is masked by the other audible sounds. Specifically, the threshold for hearing is increased by the other audible sounds.
A masked threshold of hearing represents a quantitative indicator for audibility under a condition of masking. The masked threshold of hearing indicates the sound level of a test sound (e.g., a pure sine test tone) that is just audible together with the disturbing sound. The form and location of the masked threshold of hearing in the sound level-frequency plane depends on the acoustic properties of the disturbing sounds.
The effect of noise masking may be applied to the use of sonic signals in the audible frequency range as detection signals in the tracking system. The tracking system may be used in a noisy environment, such as a vehicle. In a vehicle, noise may be generated by a superposition of different sound sources that occur in the vehicle. Due to the effect of masking, even a detection signal above the absolute threshold of hearing may be used as non-audible detection signal for the tracking system.
The effect of masking occurs not only under the condition of noise, but a masked threshold of hearing also exists when other audible tones and sounds are present.
The effect of masking by sound may be used in a situation where loudspeakers of an audio system are used to contemporaneously transmit audible sound and a detection signal for the tracking system. The form of the masked threshold of hearing depends on characteristic features of the masking sound. So the detection signal may be formed based on the characteristic features of the masking sound, the signal generator for generating the detection signal may be connected to an output of the amplifier that generates the masking sound signal. The signal generator may use the output of the amplifier to determine the characteristic features of the masking sound. In this case, the signal generator may comprise an additional unit to determine the frequency dependent masked threshold of hearing for the current sound conditions. The signal generator determines the threshold on the basis of the sound characteristics input from the amplifier (in particular, the amplitude and phase distribution of the frequency constituents composing the currently output sound). The signal generator of the tracking system may then select optimal frequency and amplitude parameters for a detection signal to be generated. The signal generator may select the frequency and amplitude parameters of the detection signal to ensure it will be inaudible, while also ensuring it has sufficient amplitude to be detected by a detection device.
The effect of masking may be based on the psychoacoustic properties of the human hearing process, and may not apply to the detector. Therefore, an inaudible detection signal in the audible frequency range may be employed for transmission time measurements without causing any disturbance to the perception of audio signals transmitted simultaneously. For more details regarding the absolute threshold of hearing and the phenomenon of masking, see the textbooks E. Zwicker, M. Zollner, “Elektroakustik,” Springer-Verlag 1984 and E. Zwicker, “Psychoakustik,” Springer-Verlag 1982.
The rotation of a moveable object may be composed from a superposition of rotations around three fixed orthogonal axes. Therefore, six degrees of freedom of motion described by six parameters are sufficient to completely describe motion of a three dimensional object. Many parameters may describe the orientation and position of a moveable object. In some systems, the overall number of independent parameters may not exceed six. In some systems, motion may be further restricted or may be assumed to be restricted in a sufficiently good approximation, such that the actual number of degrees of freedom and respective number of parameters may be further reduced.
The tracking system comprises a signal generator 706, a transmitting device 708, and a processing unit 710. The transmitting device 708 may comprise a single transmitter. Alternatively, the transmitting device 708 may comprise a plurality of transmitters. The transmitting device 708 may comprise three transmitters 712, 714, and 716 positioned in a triangular arrangement. However, more or fewer transmitters may be used. Depending on the degrees of freedom to be measured, one or more transmitters may be used. The tracking system also includes a detection device 718. The detection device 718 may comprise a single detector. Alternatively, the detection device 718 may comprise a plurality of detectors. The detection device 718 may comprise three detectors 720, 722, and 724 positioned in a triangular arrangement. However, more or fewer detectors may be used. Depending on the degrees of freedom to be measured, one or more detectors may be used. In
The number of transmitters and detectors used in the tracking system may depend on the number of geometrical parameters that identify the orientation and position of the moveable object to be tracked. Three transmitters and three detectors may allow complete determination of the orientation and spatial position of a three dimensional moveable object. When fewer parameters are needed, then the number of parameters and the respective number of detectors and transmitters decrease. A similar situation occurs where certain parameters are considered to be less important. The number of transmitters and detectors used by the tracking system depends on the number of degrees of freedom of a moveable object that is to be tracked. If a single orientation parameter is relevant, then a single transmission time measurement may be sufficient. In that situation, the tracking system may use only a single transmitter and a single detector. Such a configuration may be used in a situation where a user wearing headphones to be tracked is sitting at a fixed position (such as in an armchair or in a seat of a vehicle), but the user's head turns from time to time. In this situation, the tracked orientation parameter may be a rotation angle around a vertical axis of the head.
The signal generator 706 may generate a single detection signal or a plurality of detection signals. A detection signal may be constructed by superposition of sonic signals that are non-audible for a human being in view of the psychoacoustic concepts described above. Accordingly, the detection signals may be constructed from such partial sonic signals that have spectra in the audible frequency domain below the respective threshold of hearing. The signal generator 706 of the tracking system may generate detection signals that are below the absolute threshold of hearing (e.g., the dashed curve 100 in
The generated detection signal may have an arbitrary shape. The shape of the detection signal may comprise a clearly detectable peak. Such a peak helps to indicate an exact time of transmission and an exact time of detection. The tracking system may employ a correlation technique to measure the transmission time. In the case where the transmitting device 708 comprises a plurality of transmitters 712, 714, and 716, the transmitters 712, 714, and 716 output detection signals in a manner so that they may be distinguished from each other. This may be achieved, for instance, by employing different frequency ranges or by employing specifically encoded digital signals. Alternatively, subsequent transmission in the time domain is possible.
Individual detection signals transmitted by individual transmitters 712, 714, and 716 are individually detected by detectors 720, 722, and 724. In
The transmitting device 708 may be fixed within a predetermined space to determine the orientation and position of a moveable object within that predetermined space. The space may be, for instance, a room or the interior of a vehicle. In
At act 808, the orientation/position of the headphone unit 704 is determined. The processing unit 710 may receive information related to the transmission time of the detection signal between the transmitting device 708 and the detection device 718. When determining transmission times, the tracking system may use a presumption of a preset sound velocity value. Alternatively, the tracking system may use a transmitter/detector pair to determine the current sound velocity value achieved in the area of operation of the tracking system. The processing unit 710 uses the transmission time information and the sound velocity information to determine the orientation and/or position of the headphone unit 704.
The headphone unit 704 may be configured to simulate a surround sound reproduction of audio data for a wearer of the headphone unit 704. At act 810, it is determined whether to modify the audio data based on the detected orientation/position of the headphone unit 704. The processing unit 710 may determine whether to modify one or more characteristics of the audio data based on the tracked position and/or orientation of the headphone unit 704. If the processing unit 710 decides not to modify the audio data based on the tracked position and/or orientation of the headphone unit 704, then logic 800 proceeds to act 812. This may be the case where the processing unit 710 determines that the headphone unit 704 has not changed its orientation or position since the last tracked orientation/position. This may also be the case where any detected change is negligible. At act 812, the audio data (without new modifications based on position/orientation) is sent to the headphone unit 704. The processing unit 710 may send the audio data to the headphone unit 704.
Alternatively, if at act 810 the processing unit 710 decides to modify the audio data based on the tracked position and/or orientation of the headphone unit 704, then logic 800 proceeds to act 814. At act 814, characteristics of the audio data are set based on the orientation/position of the headphone unit 704. The processing unit 710 may use the tracked position and/or orientation of the headphone unit 704 to modify the audio data for the headphone unit 704. Specifically, the processing unit 710 may adjust the amplitude, shift the phase, or make some other modification to the audio data for one or both speakers of the headphone unit 704.
The processing unit 710 may modify the audio data to be sent to the headphone unit 704 in a way to simulate the natural effects that would occur if the listener was to change head position or orientation in a space with a surround sound field. As a first illustration, consider the situation where a listener is facing a sound source, such as a loudspeaker in a room. When the head of the listener turns to the left, the listener will detect that the sound source is now on the listener's right side. As a second illustration, consider the situation where a listener is facing a video screen with associated audio content. When the listener moves from a central position in front of the video screen to a position to one side of the video screen, the listener expects an amendment of the perceived sound characteristics.
The processing unit 710 may simulate these effects through headphones by modifying the audio data to be sent to the headphone unit 704 based on the detected position/orientation of the headphone unit 704 (which corresponds to the position/orientation of the wearer of the headphone unit 704). Specifically, where the headphone unit 704 produces a surround sound simulation for a wearer of the headphone unit 704, the headphone unit 704 may produce a virtual sound source within a virtual sound field. When the headphone unit 704 turns or changes position, the processing unit 710 may modify the audio data to reflect a corresponding change to the listener's spatial orientation relative to the virtual sound source. In one instance, the headphone unit 710 turns to the left (indicating that the wearer turned to the left) and the processing unit 710 modifies the audio data to be sent to the headphone unit 710 so that the virtual sound source appears to be on the right side of the wearer. After the position/orientation based modifications to the audio data have been made at act 814, the modified audio data is sent to the headphone unit 704 for presentation to the wearer at act 816.
At act 904, a masked threshold of hearing may be determined. Where the masking sound is noise, the tracking system may determine the masked threshold of hearing on the basis of the properties of the detected noise. Where the masking sound is generated by the audio system, the tracking system may determine the masked threshold of hearing on the basis of the audio characteristics of the masking sound received from the audio system 102.
At act 906, the characteristics of the detection signal are selected to be below the determined masked threshold of hearing. The tracking system may select the frequency and/or sound amplitude level for the detection signal so that the detection signal may be detected while remaining inaudible.
The configuration of
If the current velocity of sound is known in advance, the configuration of
The configuration of
Another configuration is possible where the existing loudspeakers are temporarily not used to emit sound, but the user still employs headphones for listening to a program. In this case, the existing loudspeakers may still be employed to emit the non-audible detection signal (for instance, a signal below the absolute threshold of hearing) without causing any disturbance.
(XD−XA)2+(YD−YA)2+(ZD−ZA)2=lAD2
(XD−XB)2+(YD−YB)2+(ZD−ZB)2=lBD2
(XD−XC)2+(YD−YC)2+(ZD−ZC)2=lCD2
If the tracking system comprises two additional detectors E and F (not shown for simplicity), such that detectors D, E, and F form a fixed triangular arrangement with respect to each other, then equivalent equations are also valid for the coordinates of the additional detectors E and F. In total, nine equations and nine transmission time measurements are possible. However, as described above with reference to
The tracking system may determine at least an orientation of a moveable object. The tracking system may determine the orientation of the moveable object based on detection signal transmission time measurements between a transmitter and detector. As a detection signal, the tracking system employs sonic signals that are non-audible in view of having a sound level below the threshold of hearing. Depending on the particular circumstances of implementation, the threshold of hearing may be the absolute threshold of hearing or a masked threshold of hearing. The tracking system may be used in the environment of an audio system, such as a vehicle entertainment and information system. In this environment, the tracking system is able to make use of existing components of the audio system, such as loudspeakers. The hardware for generating and processing sonic signals may already be available in most audio systems. When the tracking system is applied to a headphone unit used to simulate a surround sound reproduction of audio data, the tracking functionality may improve simulation of surround sound via the headphone unit.
While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
07000806 | Jan 2007 | EP | regional |
Number | Name | Date | Kind |
---|---|---|---|
3962543 | Blauert et al. | Jun 1976 | A |
5181248 | Inanaga et al. | Jan 1993 | A |
5452359 | Inanaga et al. | Sep 1995 | A |
5459790 | Scofield et al. | Oct 1995 | A |
5495534 | Inanaga et al. | Feb 1996 | A |
5708719 | Greenberger et al. | Jan 1998 | A |
6021205 | Yamada et al. | Feb 2000 | A |
6021206 | McGrath | Feb 2000 | A |
6069585 | Lanciaux | May 2000 | A |
6108430 | Kurisu | Aug 2000 | A |
6118875 | Møller et al. | Sep 2000 | A |
6343130 | Yamazaki | Jan 2002 | B2 |
6614912 | Yamada et al. | Sep 2003 | B1 |
6947569 | Yamada et al. | Sep 2005 | B2 |
6975731 | Cohen et al. | Dec 2005 | B1 |
7065222 | Wilcock | Jun 2006 | B2 |
7095865 | Katayama et al. | Aug 2006 | B2 |
7260221 | Atsmon | Aug 2007 | B1 |
7272073 | Pellegrini et al. | Sep 2007 | B2 |
7415123 | Ballas | Aug 2008 | B2 |
7460991 | Jones et al. | Dec 2008 | B2 |
7480692 | Atsmon et al. | Jan 2009 | B2 |
7482951 | Brungart et al. | Jan 2009 | B1 |
7502477 | Inanaga et al. | Mar 2009 | B1 |
7693287 | Eggert et al. | Apr 2010 | B2 |
7864632 | Pfaffinger | Jan 2011 | B2 |
7936887 | Smyth | May 2011 | B2 |
7941480 | Atsmon et al. | May 2011 | B2 |
8027477 | Wang | Sep 2011 | B2 |
20020025054 | Yamada et al. | Feb 2002 | A1 |
20030031334 | Layton et al. | Feb 2003 | A1 |
20030059070 | Ballas | Mar 2003 | A1 |
20030086573 | Schobben et al. | May 2003 | A1 |
20030190047 | Aarts | Oct 2003 | A1 |
20030210800 | Yamada et al. | Nov 2003 | A1 |
20040022392 | Griesinger | Feb 2004 | A1 |
20040076301 | Algazi et al. | Apr 2004 | A1 |
20040105550 | Aylward et al. | Jun 2004 | A1 |
20040156512 | Parker | Aug 2004 | A1 |
20050047618 | Davis et al. | Mar 2005 | A1 |
20050047619 | Murata et al. | Mar 2005 | A1 |
20050147261 | Yeh | Jul 2005 | A1 |
20050152565 | Jouppi et al. | Jul 2005 | A1 |
20050213528 | Aarts et al. | Sep 2005 | A1 |
20050249367 | Bailey | Nov 2005 | A1 |
20050276419 | Eggert et al. | Dec 2005 | A1 |
20060045294 | Smyth | Mar 2006 | A1 |
20060136544 | Atsmon et al. | Jun 2006 | A1 |
20070009120 | Algazi et al. | Jan 2007 | A1 |
20070165890 | Fusakawa et al. | Jul 2007 | A1 |
20080056517 | Algazi et al. | Mar 2008 | A1 |
20080130408 | Pfaffinger | Jun 2008 | A1 |
20080170730 | Azizi et al. | Jul 2008 | A1 |
20080205675 | Kutuzov et al. | Aug 2008 | A1 |
20090034766 | Hamanaka et al. | Feb 2009 | A1 |
20090067291 | Atsmon et al. | Mar 2009 | A1 |
20100030838 | Atsmon et al. | Feb 2010 | A1 |
20100128887 | Lee et al. | May 2010 | A1 |
20100208631 | Zhang et al. | Aug 2010 | A1 |
20100246847 | Johnson et al. | Sep 2010 | A1 |
20110026745 | Said et al. | Feb 2011 | A1 |
20110182445 | Atsmon et al. | Jul 2011 | A1 |
Number | Date | Country |
---|---|---|
1176848 | Jan 2002 | EP |
1 359 437 | Nov 2003 | EP |
WO 9207346 | Apr 1992 | WO |
WO 0110065 | Feb 2001 | WO |
WO 0134264 | May 2001 | WO |
WO 2004057361 | Jul 2004 | WO |
WO 2005032209 | Apr 2005 | WO |
Number | Date | Country | |
---|---|---|---|
20080170730 A1 | Jul 2008 | US |