The disclosure is related to consumer electronics and, more particularly, to systems, methods, and apparatus to continuously calibrate audio fields.
Home theater systems allow the listener to enjoy the cinema experience while in the comfort of their home. To deliver the best possible sound, the systems allow the listener to adjust the sound field, volume and various Digital Signal Processing (DSP) effects.
Features, aspects, and advantages of the presently disclosed technology are better understood with regard to the following description, appended claims, and accompanying drawings where:
In addition, the drawings are for the purpose of illustrating example embodiments, but it is understood the present disclosure is not limited to the arrangements and instrumentality shown in the drawings.
Example systems, methods, and apparatus to calibrate sounds fields are disclosed herein. Real-time sound calibration is achieved through localizing the position of the listener. In some examples, a location sensor such as a video camera and infrared camera detect the position of the listener and then the home theater system software adjusts the sound field. Example systems, methods, and/or apparatus disclosed herein also provide localizing the position of the listener through analyzing packets with associated timestamps. The example systems, methods, and/or apparatus disclosed herein may be used in combination with a multiple-speaker configuration in which the speakers included in the configuration share one or more sources of audio information and play the audio in synchrony.
Some example systems, methods, and/or apparatus provide first triangulating the position of the listener in the listening zone by processing data gathered by location sensors in the listening zone in real-time. Accordingly, such example systems, methods, and/or apparatus provide an audio circuit capable of generating an improved sound field adjusted for the position of the listener. This real-time listener triangulation allows for potentially increased aesthetics in the sound experienced by the listener.
An example method implemented in accordance with the disclosure includes receiving infrared signals through an infrared receiver and video data captured through a video camera at the location sensor, processing the received infrared signals and video data to triangulate the position of the listener via a triangulation algorithm, and generating, through an audio processing component, audio characteristics of a sound field modified by the position of the listener to play through a speaker.
In some embodiments, the location sensors are continuously receiving location data, wherein the continuous receiving of location data allows for tracking the position of the listener as the listener moves enabling real-time sound field calibration.
An example embodiment of apparatus implemented in accordance with the present disclosure includes depth sensors to scan the listening zone, an audio processing component to modify an audio input signal with the location information to form a sound field, first and second audio speakers having first audio characteristics, and a third audio speaker having second audio characteristics, wherein the third speaker is positioned between the first and second audio speakers. Some example apparatus include a digital audio processor to implement the first and second audio characteristics.
In some embodiments, the location sensors include infrared and image cameras which receive infrared signals and image frame data. In some embodiments, the sensors include microphones which receive acoustic wave information. In some embodiments, the acoustic wave information includes a timestamp. In some embodiments, the location sensors receive packets with an associated RSSI signal. In some embodiments, a combination of depth sensors is utilized.
In some embodiments, the apparatus further includes a network interface to receive at least one of the audio input signals, a synchronization signal associated with a multiple-device arrangement, or configuration signal associated with a multiple-device arrangement. In some such embodiments, the second speaker is to be positioned on the outside when in a multiple-device configuration.
In some embodiments, the apparatus further includes a network interface to synchronize the first and second audio output with another audio device. In some such embodiments, the network interface is to receive at least one of the audio signal or a user input.
Although the following discloses example systems, methods, and apparatus including, among other components, firmware and/or software executed on hardware, it should be noted such systems, methods, and/or apparatus are merely illustrative and should not be considered as limiting. For example, it is contemplated any or all of these firmware, hardware, and/or software components could be embodied exclusively in hardware, exclusively in software, exclusively in firmware, or in any combination of hardware, software, and/or firmware. Accordingly, while the following describes example systems, methods, and/or apparatus, the examples provided are not the only way(s) to implement such systems, methods, and/or apparatus.
When any of the appended claims are read to cover a purely software and/or firmware implementation, at least one of the elements in at least one example is hereby expressly defined to include a tangible medium such as a memory, digital versatile disk (DVD), compact disc (CD), Blu-ray, and so on, storing the software and/or firmware.
These embodiments and many additional embodiments are described more below. Further, the detailed description is presented largely in terms of illustrative environments, systems, procedures, steps, logic blocks, processing, and other symbolic representations which directly or indirectly resemble the operations of data processing devices coupled to networks. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. Numerous specific details are set forth to provide a thorough understanding of the present disclosure. However, it is understood to those skilled in the art certain embodiments of the present disclosure may be practiced without certain, specific details. In other instances, well known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuring aspects of the embodiments.
Reference herein to “embodiment” means a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one example embodiment of the invention. The appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. As such, the embodiments described herein, explicitly and implicitly understood by one skilled in the art, may be combined with other embodiments.
Referring now to the drawings, in which like numerals may refer to like parts throughout the figures,
The example zone player 202 of
The example zone player 204 of
Example zone players include a “Sonos Play:3,” “ZonePlayer® 120,” and “ZonePlayer® 90,” which are offered by Sonos, Inc. of Santa Barbara, Calif. Any other past, present, and/or future zone players may additionally or alternatively be used to implement the zone players of example embodiments disclosed herein. A zone player may also be referred to herein as a playback device, and a zone player is not limited to the particular examples illustrated in
Referring back to the system configuration 100 of
Particularly, the data network 128 may be a wired network, a wireless network, or a combination of both. In some embodiments, one or more of the zone players 102-124 are wirelessly coupled to the data network 128 based on a proprietary mesh network. In some embodiments, one or more of the zone players 102-124 are wirelessly coupled to the data network 128 using a non-mesh topology. In some embodiments, one or more of the zone players 102-124 are coupled via a wire to the data network 128 using Ethernet or similar technology. In addition to the one or more zone players 102-124 connecting to the data network 128, the data network 128 may further allow access to a wide area network, such as the Internet.
In certain embodiments, the data network 128 may be created by connecting any of the zone players 102-124, or some other connecting device, to a broadband router. Other zone players 102-124 may then be added wired or wirelessly to the data network 128. For example, a zone player (e.g., any of zone players 102-124) may be added to the system configuration 100 by simply pressing a button on the zone player itself, which enables a connection to be made to the data network 128. The broadband router may be connected to an Internet Service Provider (ISP), for example. The broadband router may be used to form another data network within the system configuration 100, which may be used in other applications (e.g., web surfing). The data network 128 may also be used in other applications, if so programmed. Further, in certain embodiments, the data network 128 is the same network used for other applications in the household.
In certain embodiments, each zone may play from the same audio source as another zone or each zone may play from a different audio source. For example, someone may be grilling on the patio and listening to jazz music via zone player 124, while someone is preparing food in the kitchen and listening to classical music via zone player 102. Further, someone may be in the office listening to the same jazz music via zone player 110 which is playing on the patio via zone player 124. In some embodiments, the jazz music played via zone players 110 and 124 is played in synchrony. Synchronizing playback amongst zones allows for someone to pass through zones while seamlessly listening to the audio. Further, zones may be put into a “party mode” where all associated zones will play audio in synchrony.
In certain embodiments, a zone contains two or more zone players. For example, the family room contains two zone players 106 and 108, and the home theater room contains at least zone players 116, 118, and 120. A zone may be configured to contain as many zone players as desired, and for example, the home theater room might contain additional zone players to play audio from a 5.1 channel or greater audio source (e.g., a movie encoded with 5.1 or greater audio channels). If a zone contains two or more zone players, such as the two zone players 106 and 108 in the family room, then the two zone players 106 and 108 may be configured to play the same audio source in synchrony, or the two zone players 106 and 108 may be paired to play two separate sounds in left and right channels, for example. In other words, the stereo effects of a sound may be reproduced or enhanced through the two zone players 106 and 108, one for the left sound and the other for the right sound. In certain embodiments, paired zone players may play audio in synchrony with other zone players.
In certain embodiments, three or more zone players may be configured to play various channels of audio which is encoded with three channels or more sound. For example, the home theater room shows zone players 116, 118, and 120, which is connected to a television 132. If the sound is encoded as 2.1 channel audio, then the zone player 116 may be configured to play left channel audio, the zone player 118 may be configured to play right channel audio, and the zone player 120 may be configured to play bass frequencies. Other configurations are possible and depend on the number of zone players and the type of audio. Further, a particular zone may be configured to play a 5.1 channel audio in one instance, such as when playing audio from a movie, and then dynamically switch to play stereo, such as when playing audio from a two channel source.
In certain embodiments, two or more zone players may be sonically consolidated to form a single, consolidated zone player. A consolidated zone player (though made up of multiple, separate devices) may be configured to process and reproduce sound differently than an unconsolidated zone player or zone players which are paired, because a consolidated zone player will have additional speaker drivers from which sound may be passed. The consolidated zone player may further be paired with a single zone player or yet another consolidated zone player. Each playback device of a consolidated playback device is preferably set in a consolidated mode.
According to some embodiments, one may continue to do any of: group, consolidate, and pair zone players, for example, until a desired configuration is complete. The actions of grouping, consolidation, and pairing are preferably performed through a control interface, such as using controller 130, and not by physically connecting and re-connecting speaker wire, for example, to individual, discrete speakers to create different configurations. As such, certain embodiments described herein provide a more flexible and dynamic platform through which sound reproduction may be offered to the end-user.
Sources of audio content to be played by zone players 102-124 are numerous. Music from a personal library stored on a computer or networked-attached storage (NAS) may be accessed via the data network 128 and played. Internet radio stations, shows, and podcasts may be accessed via the data network 128. Music services which let a user stream and download music and audio content may be accessed via the data network 128. Further, music may be obtained from traditional sources, such as a turntable or CD player, via a line-in connection to a zone player, for example. Audio content may also be accessed through AirPlay™ wireless technology by Apple, Inc., for example. Audio content received from one or more sources may be shared amongst the zone players 102 to 124 via the data network 128 and/or the controller 130. The above-disclosed sources of audio content are referred to herein as network-based audio information sources. However, network-based audio information sources are not limited thereto.
Referring now to
Referring back to
In some embodiments, the network interface 402 may include one or both of a wireless interface 404 and a wired interface 406. The wireless interface 404, also referred to as a Radio Frequency (RF) interface, provides network interface functions for the zone player 400 to wirelessly communicate with other devices (e.g., other zone player(s), speaker(s), receiver(s), component(s) associated with the data network 128, and so on) in accordance with a communication protocol (e.g., any of the wireless standards IEEE 802.11a, 802.11b, 802.11g, 802.11n, or 802.15). To receive wireless signals and to provide the wireless signals to the wireless interface 404 and to transmit wireless signals, the zone player 400 of
In some embodiments, the processor 408 is a clock-driven electronic device configured to process input data according to instructions stored in memory 410. The memory 410 is data storage which may be loaded with one or more software modules 414, which may be executed by the processor 408 to achieve certain tasks. In the illustrated embodiment, the memory 410 is a tangible machine readable medium storing instructions which may be executed by the processor 408. In some embodiments, a task might be for the zone player 400 to retrieve audio data from another zone player or a device on a network. In some embodiments, a task might be for the zone player 400 to send audio data to another zone player or device on a network. In some embodiments, a task might be for the zone player 400 to synchronize playback of audio with one or more additional zone players. In some embodiments, a task might be to pair the zone player 400 with one or more zone players to create a multi-channel audio environment. Additional or alternative tasks may be achieved via the one or more software modules 414 and the processor 408.
The location component 424 may include one or more sensors, transmitters, receivers, detectors, processors, and so on. In order to determine the position of the listener or a plurality of listeners, the location circuit 424 receives location data from sensors. Based on the received location data, the location component 424 is able to generate a listener location, a number of listener locations, and/or a location point based on the number of listener locations. To gather data indicative of the position of the listener and/or listeners, the location circuit 424 communicates with the sensors. In some embodiments, a listener location is a location within a room or area. In some embodiments, a listener location is a location with a home or office space. In some embodiments, a listener location is a location relative to one or more zone players. In some embodiments, a listener location may be another predefined location.
In some embodiments, the location data is communicated to processor 408 for processing. In some embodiments, the location data is communicated to audio processing component 412 for processing. In other embodiments, the location data is processed by the location component 424. The location data may be processed by any other device or component capable of performing calculations.
In one embodiment, the location component 424 includes an image capture device such as a camera. The camera captures image frames with image characteristics. In such embodiments, the captured image frame characteristics include luminance and/or shadowing qualities. The captured image frame characteristics are then communicated to a processor for generating localization information. By comparing changes in luminance and shadowing characteristics of the captured image frames, the processor is able to detect the position of the listener to generate localization information. The generated localization information is then communicated to the audio processing circuit 412.
In another embodiment, the image capture device included in the location component 424 includes an infrared (IR) camera. In such embodiments, the IR camera captures image frame characteristics, including body heat characteristics. The captured image frame characteristics are then communicated to a processor for generating localization information. By comparing changes in body heat signatures, the processor is able to generate localization information. The generated localization information is then communicated to the audio processing component 412.
In another embodiment, an IR transmitter may be carried by the listener as a remote and/or controller (not shown). The remote may be a cellular phone, a personal digital assistant (PDA), or another portable device capable of transmitting an IR signal. The transmitted IR signals may be received by an IR receiver, such as an IR diode, included in the location component 424. These signal pulses are then gathered and communicated to the processor for generating localization data. By analyzing the phase shifts and the time delays associated with the inputted IR signals and the location of the IR receivers, the processor is able to triangulate the position of the listener. This localization information is then communicated to the audio processing circuit 412.
In another embodiment, the location component 424 includes one or more microphones. The microphones are able to gather acoustic wave information from the listener. In some embodiments, the acoustic wave information is generated by the listener. For instance, the listener may generate oratory signals which are received by the microphones included in the location component 424 as acoustic wave information. In some embodiments, the listener carries a remote, such as a cellular phone, a PDA, or another portable device, producing an auditory tone detected by the microphones included in the location component 424. The auditory tone may be in the human audible range, or may be outside of the audible range. By determining the time delay in the acoustic wave information received at the microphones, the processor is able to triangulate the position of the listener. This localization information is then communicated to the audio processing circuit 412.
In another embodiment, the listener carries a remote, such as a cellular phone, PDA, or another portable device, which transmits a control packet. Included in the control packet is an associated Received Signal Strength Indicator (RSSI) signal with a timestamp. The control packet is then received by sensors in the location component 424 of the zone player 400. The gathered control packets are then communicated to the processor. By comparing the information included in the received control packet from the listener with an associated RSSI signal and the time delay, the processor is able to triangulate the position of the listener. This localization information is then communicated to the audio processing circuit 412.
In another embodiment, the location component 424 includes sensors to receive data packets. Wireless signals, for example, transmitted at 2.4 GHz frequency, are absorbed by the human body. The data packets received by the sensors are able to detect changes in the strength of the signal received by the sensor. By comparing the expected signal strength with the actual received signal strength, the processor is able to triangulate the relative position of the listener. This localization information is then communicated to the audio processing component 412.
The audio processing component 412 may include one or more digital-to-analog converters (DAC), an audio preprocessing component, an audio enhancement component or a digital signal processor, and so on. In certain embodiments, the audio retrieved via the network interface 402 is processed and/or intentionally altered by the audio processing component 412. In some examples, the audio processing component 412 filters audio signals differently for different speakers 418. Further, the audio processing component 412 may produce analog audio signals. The processed analog audio signals are then provided to the audio amplifier 416 for play back through speakers 418. In addition, the audio processing component 412 may include necessary circuitry to process analog or digital signals as inputs to play from zone player 400, send to another zone player on a network, or both play and send to another zone player on the network. An example input includes a line-in connection (e.g., an auto-detecting 3.5 mm audio line-in connection).
The audio amplifier 416 is a device which amplifies audio signals to a level for driving one or more speakers 418. The one or more speakers 418 may include an individual transducer (e.g., a “driver”) or a complete speaker system which includes an enclosure including one or more drivers. A particular driver may be a subwoofer (for low frequencies), a mid-range driver (middle frequencies), and a tweeter (high frequencies), for example. An enclosure may be sealed or ported, for example.
A zone player 400 may also be referred to herein as a playback device. An example playback device includes a Sonos® Play:3, which is manufactured by Sonos, Inc. of Santa Barbara, Calif. The Play:3 is an example zone player with a built-in amplifier and speakers. In particular, the Play:3 is a three-driver speaker system which includes a tweeter and two mid-range speakers (also referred to as drivers). When playing audio content via the Play:3, the left audio data of a track is output from the left mid-range speaker, the right audio data of a track is output from the right mid-range driver, and the tweeter outputs center or both left and right audio data for a track. Audio from Internet radio stations, online music and video services, downloaded music, analog audio inputs, television, DVD, and so on, may be played from a Sonos® Play:3. While the Play:3 is an example of a zone player with speakers, it is understood a zone player with speakers is not limited to one with a certain number of speakers (e.g., three speakers as in the Play:3), but rather may contain one or more speakers. Further, a zone player may be part of another device, which might even serve a purpose different than audio (e.g., a lamp).
Referring now to
The controller 500 is provided with a screen 502 and an input interface 514 which allows a user to interact with the controller 500, for example, to navigate a playlist of many multimedia items and to control operations of one or more zone players. The screen 502 on the controller 500 may be a liquid crystal display (LCD) screen, for example. The screen 502 communicates with and is commanded by a screen driver 504 controlled by a microcontroller (e.g., a processor) 506. The memory 510 may be loaded with one or more application modules 512 which may be executed by the microcontroller 506 with or without a user input via the user interface 514 to achieve certain tasks. In some embodiments, an application module 512 is configured to facilitate grouping a number of selected zone players into a zone group and synchronizing the zone players for audio play back. In some embodiments, an application module 512 is configured to control the audio sounds (e.g., volume) of the zone players in a zone group. In operation, when the microcontroller 506 executes one or more of the application modules 512, the screen driver 504 generates control signals to drive the screen 502 to display an application specific user interface accordingly.
The controller 500 includes a network interface 508 which facilitates wireless communication with a zone player. In some embodiments, the commands such as volume control and audio playback synchronization are sent via the network interface 508. In some embodiments, a saved zone group configuration is transmitted between a zone player and a controller via the network interface 508. The controller 500 may control one or more zone players, such as 102-124 of
It should be noted other network-enabled devices such as an iPhone®, iPad® or any other smart phone or network-enabled device (e.g., a networked computer such as a PC or Mac®) may also be used as a controller to interact or control zone players in a particular environment. In some embodiments, a software application or upgrade may be downloaded onto a network enabled device to perform the functions described herein.
In some embodiments, a user may create a zone group including at least two zone players from the controller 500. The zone players in the zone group may play audio in a synchronized fashion, so all of the zone players in the zone group play back an identical audio source or a list of identical audio sources in a synchronized manner so no (or substantially no) audible delays or hiccups could be heard. Similarly, in some embodiments, when a user increases the audio volume of the group from the controller 500, the signals or data of increasing the audio volume for the group are sent to one of the zone players and causes other zone players in the group to be increased together in volume.
A user via the controller 500 may group zone players into a zone group by activating a “Link Zones” or “Add Zone” soft button, or de-grouping a zone group by activating an “Unlink Zones” or “Drop Zone” button. For example, one mechanism for ‘joining’ zone players together for audio play back is to link a number of zone players together to form a group. To link a number of zone players together, a user may manually link each zone player or room one after the other. For example, assume there is a multi-zone system which includes the following zones: Bathroom, Bedroom, Den, Dining Room, Family Room, and Foyer.
In some embodiments, a user may link any number of the six zone players, for example, by starting with a single zone and then manually linking each zone to the first zone.
In some embodiments, a set of zones may be dynamically linked together using a command to create a zone scene or theme (subsequent to first creating the zone scene). For instance, a “Morning” zone scene command may link the Bedroom, Office, and Kitchen zones together in one action. Without this single command, the user would need to manually and individually link each zone. The single command might include a mouse click, a double mouse click, a button press, a gesture, or some other programmed action. Other kinds of zone scenes may be programmed.
In some embodiments, a zone scene may be triggered based on time (e.g., an alarm clock function). For instance, a zone scene may be set to apply at 8:00 am. The system may link appropriate zones automatically, set specific music to play, and then stop the music after a defined duration. Although any particular zone may be triggered to an “On” or “Off” state based on time, for example, a zone scene enables any zone(s) linked to the scene to play a predefined audio (e.g., a favorable song, a predefined playlist) at a specific time and/or for a specific duration. If, for any reason, the scheduled music failed to be played (e.g., an empty playlist, no connection to a share, failed Universal Plug and Play (UPnP), no Internet connection for an Internet Radio station, and so on), a backup buzzer may be programmed to sound. The buzzer may include a sound file stored in a zone player, for example.
An MTM speaker arrangement includes two mid-range speakers 606, 608, 610, 612 (e.g., speakers having a diameter between about 3.5 inches and 6.75 inches, operating in the approximate frequency range of 300-5000 Hz) and a high-range speaker, also known as a tweeter 614, 611 (e.g., 3.5 inch diameter or smaller, operating in the approximate frequency range of 2,000-20,000 Hz) per zone player 602, 604. The example zone players 602, 604 of
The example zone players 602, 604 include respective audio filters 616, 618. As mentioned above, the example audio filters 616, 618 may be implemented using digital audio processing circuitry, such as a digital audio processor or other digital processing unit. The following example will be described with reference to the example audio filter 616 of FIG. 6. However, the description of the audio filter 616 is also applicable to the example audio filter 618. The operation of the example zone players 602, 604 as a stereo pair with respect to the audio filters 616, 618 is also discussed below. The example zone players 602, 604 may also be operated in other multiple-device arrangements. As used herein “multiple-device” refers to separate sets of speakers, such as multiple-MTM speaker arrangements, and not merely multiple speakers in the same device.
The example audio filter 616 of
Some MTM speaker arrangements experience a “narrowing” phenomenon, in which a listener positioned straight in front of the speakers will experience the audio differently than a listener positioned to the left or the right of the speakers. This phenomenon is particularly acute for audio frequencies around the center frequency f0 (e.g., the frequency on which the spacing of the mid-range speakers is based). In some cases, certain frequencies are completely canceled out in some positions relative to the speaker. While this behavior may be desirable in some circumstances, such as when the MTM speakers are oriented vertically (which reduces reflections and/or echoes off of the ceilings and floors), such behavior may be undesirable in others, such as when the MTM speakers are oriented horizontally (which results in a limited range of positions in which the frequency response is consistent and the audio sounds substantially as intended). Unlike such known MTM speaker arrangements, the example zone players 602, 604 of
In the example of
The example audio filter 618 also includes audio preprocessing 628, a first mid-range filter 630, a second mid-range filter 632, and a tweeter filter 634. Like the audio filter 616, the audio filter 618 applies the different filtering configurations to the example mid-range filters 610, 612 based on configuration information for the zone player 604 (e.g., physical orientation, status as right/left speaker of a stereo pair, etc.). In the example of
In some embodiments, the location information captured by the sensors represents image frame characteristics. In some embodiments, the location data captured by the sensors represents body heat characteristics. In some embodiments, the location information collected by the sensors is radio frequency signals. In some embodiments, the location data collected by the sensors are data packets.
Once the location information is gathered by the location component 424, the location information is processed (Block 710). The gathered location data is processed to determine the position of the listener. In some embodiments, this processed location data defines a “sweet spot” where the sound fields received by the listener are optimized to provide the listener with the most enjoyable playback experience (e.g., optimized imaging, optimized equalization values, optimized volume levels, and so on). In some embodiments, the gathered location data determines the presence of multiple listeners in the listening zone. In some such embodiments, the processed sweet spot adjusts the audio characteristics of the retrieved audio to generate a sound field most suitable for the plurality of detected listeners. For example, in one embodiment, if two listeners were detected in a zone area, the processed sweet spot would engulf both listeners and optimize the audio characteristics of the sound field to account for the two listeners.
In some embodiments, the location data is communicated to processor 408 of
The position of the listener is then communicated to the audio processing component 412 of
The audio processing component 412 then processes and/or intentionally alters the audio retrieved via the network interface 402 in combination with the localization signals (Block 725). In some examples, the audio processing component 412 filters the audio signals differently for different speakers. The processed audio signals output by the audio processing component 412 represent audio characteristics of a sound field adjusted for the position of the listener. In some embodiments, the audio signal may be processed based on a factory set of parameters. In some embodiments, the audio signal may be processed based on a listener set of parameters. In some embodiments, the audio signal may be processed based on a combination of factory and listener sets of parameters. For example, in one embodiment, more or less bass may be output depending on how close a listener is to a particular zone player.
In some examples, the processed audio signals also include additional listener preferences, such as volume levels. For example, in one embodiment, while a song is playing in synchrony in the Dining Room and Family Room of
The processed audio signals are then provided to an audio amplifier for playback through speakers (Block 730). In some embodiments, the processed audio signals are communicated to audio amplifier 416 of
Referring back to
For illustrative purposes, zone player 120 will be labeled as the master zone player. As a result, when zone players 116 and 118 are synched to the Home Theater Room zone, they are labeled as slave zone players. Once a zone player is labeled a master zone player, all slave zone players in the zone communicate information with the master zone player.
Continuing with the example, slave zone players 116 and 118 now communicate all of their information to master zone player 120. Included in the information communicated with master zone player 120 is the location data gathered by the location component 424 of each respective zone player. As a result, master zone player 120 now has the location information from each of the slave zone players 116 and 118, as well as the location information collected by the location component 424 of zone player 120. Master zone player 120 is then able to triangulate the location of the listener with all of the aggregated information. Master zone player 120 then communicates the respective localization information to each of the slave zone players 116 and 118. Each of the zone players 116-120 communicates the received localization information to the audio processing circuit 412 of each respective zone player. As a result, the audio characteristic of the output sound field of each zone player 116-120 is optimized to produce the best listening environment for the listener. For example, the volume level of the zone player or zone players nearest the position of the listener may be reduced based on the position of the listener in relation to the other zone player or zone players.
In some embodiments, the master zone player gathers the location information continuously, or near continuously, resulting in real-time, or substantially real-time, calibration of the sound field as each zone player tracks the listener throughout the listening zone. As the listener moves around in the listening zone, the sweet spot may be adjusted to track the position of the listener. In some embodiments, the master zone player gathers the location information from the slave zone players periodically. For example, the master zone player may gather the location information five times in one second. In some embodiments, the master zone player gathers the location information whenever one of the zone players in the listening zone detects a change in the position of the listener. For example, while the listener sits in a chair, all three zone players 116-120 remain idle; if zone player 116 detects movement by the listener, zone player 116 sends a signal to master zone player 120, which then gathers the location information from all of the zone players 116-120 in order to triangulate the position of the listener.
For illustrative purposes, zone player 112 in the Bedroom zone is labeled the master zone player. If a second zone player is linked to the zone scene (Block 810), then the second zone player is labeled a slave zone player (Block 815). The method waits to see if another zone player is linked with the zone scene (Block 820), and if so, the system returns to Block 815 to label another zone player. Continuing with the example, when zone player 110 is linked with the “Morning” zone scene, it is labeled as a slave zone player (Block 815). The additional linking of zone player 102 in the Kitchen zone returns the method to Block 815, where zone player 102 is also labeled a slave zone player.
In another embodiment, no additional zone players are determined at Block 810 and the method proceeds to Block 825. In another embodiment, no additional zone players are determined at Block 820 and the method proceeds to Block 825.
Continuing with the example, while in the Bedroom, the listener selects a song to play with controller 130 of
Once each zone player has completed its location scan, the location data is communicated to the master zone player (Block 830). In the current example, master zone player 112 gathers the location information from each of the zone players linked in the “Morning” zone scene, zone players 112, 110 and 102. Master zone player 112 then processes the location information with a triangulation algorithm to determine the position of the listener with respect to each of the zone players in the zone scene. In some embodiments, the master zone player 112 communicates a status update to a user, such as through controller 300 of
In another embodiment, the location information communicated to the master zone player described no listener present in the listening area (Block 835). For instance, since the listener is located in the Bedroom, the zone players in the Office zone and the Kitchen zone are unable to locate a listener. The master zone player then communicates a default sound field command along with the localization information to the zone player (Block 860). In some embodiments, the default sound field is preset by the listener. In some embodiments, the default sound field when no listener is located within the listening zone is to adjust the audio characteristics of the sound field so the volume level is decreased to a minimal level and the other audio characteristics return to a default setting as if the listener were sitting in the middle of the room. In some embodiments, the default sound field when no listener is located within the listening zone is to decrease the volume level of the speakers to the lowest setting. In some embodiments, the default sound field when no listener is located within the listening zone is to turn off the zone player so no sound field is output by the zone player. In some embodiments, the default audio setting when no listener is located within the listening zone is to make no changes to the sound field and leave the audio characteristics of the output sound field the same as they were previously set. Each zone player then adjusts the respective audio characteristics of the outputted sound field to match the default sound field command (Block 865).
The zone player then moves to Block 866, where it waits to perform the next location scan. In some embodiments, the default sound field command communicated to the zone players in Block 860 may also modify the frequency of location scans performed by the zone player. In some embodiments, since slave zone players 110 and 102 have not detected any change in their localization information, they send no location information to master zone player 112. In some embodiments, slave zone players 110 and 102 do less frequent location scans when no listener was previously detected in their respective listening zones. For instance, slave zone players 110 and 102 perform listener scans half as often as they previously were scanning. In some embodiments, slave zone players 110 and 102 perform localization scans more frequently than previously performed. For instance, slave zone players 110 and 102 perform twice as many localization scans than previously performed. In some embodiments, slave zone players 110 and 102 continue to send location information to master zone player 112 with no change in the frequency of location scans. After the waiting period is completed, the zone player then performs a new location scan (Block 870).
In some embodiments, the location scan performed in Block 870 reveals a change in the location information (Block 875) and the new location information is communicated to the master zone player in Block 830. For example, in one embodiment, zone players 110 and 102 were turned off so no sound field was output by the respective zone players at Block 865. At Block 870, zone player 110 reveals the presence of a listener in the zone player 110 listening area. Zone player 110 then resumes audio playback and communicates the new location information to the master zone player (Block 830).
In some embodiments, the location scan performed in Block 870 reveals no change in the location information (Block 875) and the method returns to Block 866 to wait to perform the next location scan.
In another embodiment, listener information communicated to the master zone player 112 in Block 830 determines the presence of a listener in the Kitchen zone as well as the Bedroom zone. In such an example, master zone player 112 and slave zone player 102 may follow the path from Block 835 to Block 840, as described above. As a result, zone players 112 and 102 output adjusted sound fields optimized for each listener. Slave zone player 110 may continue the path from Block 835 to Block 860, as described above.
In another embodiment, location scans are conducted by zone players not in the currently playing zone scene. For example, while the Morning zone scene is playing in synchrony through zone players 112, 110 and 102, zone player 114 in the Bathroom zone also performs a location scan. In some embodiments, zone player 114 detects the presence of a listener in the Bathroom zone listening area and sends the location information to the master zone player 112. Master zone player 112 may then determine if an automatic synching feature is enabled by a listener. In some embodiments, the automatic synching feature is enabled and master zone player 112 automatically adds zone player 114 to the zone scene and continues with Block 815. In some embodiments, the automatic synching feature is disabled and master zone player 112 disregards the location information provided by zone player 114.
In view of the foregoing, it should be apparent disclosed example systems, methods and apparatus may be used to provide a media playback device having improved audio quality and perception. Example systems, methods, and apparatus localize the position of the listener and then filter audio signals for outputting a sound field with audio characteristics optimized for the position of the listener.
Various inventions have been described in sufficient detail with a certain degree of particularity. It is understood to those skilled in the art the present disclosure of embodiments has been made by way of examples only and numerous changes in the arrangement and combination of parts may be resorted without departing from the spirit and scope of the present disclosure as claimed. While the embodiments discussed herein may appear to include some limitations as to the presentation of the information units, in terms of the format and arrangement, the embodiments have applicability well beyond such embodiment, which may be appreciated by those skilled in the art. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the forgoing description of embodiments.
This application is a continuation of U.S. non-provisional patent application Ser. No. 17/543,014. filed on Dec. 6, 2021, entitled “Media Playback Based on Sensor Data,” which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 17/543,014 is continuation of U.S. non-provisional patent application Ser. No. 17/207,640, filed on Mar. 20, 2021, and issued as U.S. Pat. No. 11,197,117 on Dec. 7, 2021, entitled “Media Playback Based on Sensor Data,” which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 17/207,640 is a continuation of U.S. non-provisional patent application Ser. No. 17/104,466, filed on Nov. 25, 2020, and issued as U.S. Pat. No. 11,122,382 on Sep. 14, 2021, entitled “Playback Based on Acoustic Signals,” which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 17/104,466 is a continuation of U.S. non-provisional patent application Ser. No. 16/658,896, filed on Oct. 21, 2019, entitled “Playback Based on User Settings,” and issued as U.S. Pat. No. 10,945,089 on Mar. 9, 2021, which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 16/658,896 is a continuation of U.S. non-provisional patent application Ser. No. 15/235,598, filed on Aug. 12, 2016, entitled “Playback Based Number of Listeners,” and issued as U.S. Pat. No. 10,455,347 on Oct. 22, 2019, which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 15/235,598 claims priority under 35 U.S.C. § 120 to, and is a continuation of, U.S. non-provisional patent application Ser. No. 15/166,241, filed on May 26, 2016, entitled “Playback Based on Wireless Signal,” and issued as U.S. Pat. No. 10,334,386 on Jun. 25, 2019, which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 15/166,241 claims priority under 35 U.S.C. § 120 to, and is a continuation of, U.S. non-provisional patent application Ser. No. 15/056,553, filed on Feb. 29, 2016, entitled “Location Determination According to Auditory Tones,” which is incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 15/056,553 claims priority under 35 U.S.C. § 120 to, and is a continuation of, U.S. non-provisional patent application Ser. No. 14/726,921, filed on Jun. 1, 2015, entitled “Sound Field Calibration Using Listener Localization,” and issued as U.S. Pat. No. 9,930,470 on Mar. 27, 2018, which is also incorporated herein by reference in its entirety. U.S. non-provisional patent application Ser. No. 14/726,921 claims priority under 35 U.S.C. § 120 to, and is a continuation of, U.S. non-provisional patent application Ser. No. 13/340,126, filed on Dec. 29, 2011, entitled “Sound Field Calibration Using Listener Localization,” which issued as U.S. Pat. No. 9,084,058 on Jul. 14, 2015, and which is also incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 17543014 | Dec 2021 | US |
Child | 18308016 | US | |
Parent | 17207640 | Mar 2021 | US |
Child | 17543014 | US | |
Parent | 17104466 | Nov 2020 | US |
Child | 17207640 | US | |
Parent | 16658896 | Oct 2019 | US |
Child | 17104466 | US | |
Parent | 15235598 | Aug 2016 | US |
Child | 16658896 | US | |
Parent | 15166241 | May 2016 | US |
Child | 15235598 | US | |
Parent | 15056553 | Feb 2016 | US |
Child | 15166241 | US | |
Parent | 14726921 | Jun 2015 | US |
Child | 15056553 | US | |
Parent | 13340126 | Dec 2011 | US |
Child | 14726921 | US |