The present disclosure is related to consumer goods and, more particularly, to methods, systems, products, features, services, and other elements directed to media playback or some aspect thereof.
Options for accessing and listening to digital audio in an out-loud setting were limited until in 2002, when SONOS, Inc. began development of a new type of playback system. Sonos then filed one of its first patent applications in 2003, entitled “Method for Synchronizing Audio Playback between Multiple Networked Devices,” and began offering its first media playback systems for sale in 2005. The Sonos Wireless Home Sound System enables people to experience music from many sources via one or more networked playback devices. Through a software control application installed on a controller (e.g., smartphone, tablet, computer, voice input device), one can play what she wants in any room having a networked playback device. Media content (e.g., songs, podcasts, video sound) can be streamed to playback devices such that each room with a playback device can play back corresponding different media content. In addition, rooms can be grouped together for synchronous playback of the same media content, and/or the same media content can be heard in all rooms synchronously.
Given the ever-growing interest in digital media, there continues to be a need to develop consumer-accessible technologies to further enhance the listening experience.
Features, aspects, and advantages of the presently disclosed technology may be better understood with regard to the following description, appended claims, and accompanying drawings, as listed below. A person skilled in the relevant art will understand that the features shown in the drawings are for purposes of illustrations, and variations, including different and/or additional features and arrangements thereof, are possible.
The drawings are for the purpose of illustrating example embodiments, but those of ordinary skill in the art will understand that the technology disclosed herein is not limited to the arrangements and/or instrumentality shown in the drawings.
Over the years, Sonos, Inc. (“Sonos”) has been an innovator in the area of playback device calibration experiences in order to improve sound quality and enhance a user's overall listening experience.
For example, in 2015 Sonos released an advanced spectral calibration option for its playback devices (also known as “Trueplay”), that involves a user following a sequence of instructions presented via a GUI of a media playback system controller application installed on a control device (e.g., a smartphone). The instructions direct the user to calibrate a given playback device by moving the control device around the environment of the playback device as the playback device plays back calibration tone(s) that are captured by a microphone of the control device. The captured calibration tone(s) are used to determine a spectral response of the environment, from which updated calibration settings may be determined for the playback device that allow the playback device to adapt its sound output for the specific environment. This type of advanced spectral calibration is discussed in more detail in U.S. Pat. No. 9,706,323, which is incorporated herein by reference in its entirety.
In 2019, Sonos released an automatic spectral calibration option for portable playback devices (also known as “Auto Trueplay”). This type of automatic spectral calibration option is a self-calibration using the portable playback device's own microphone, and can be performed regularly based on audio content (e.g., music) that is played by the portable playback device, rather than a calibration tone as discussed above. In this way, automatic spectral calibration may result in updated sound output each time the portable playback device is moved to a new listening environment. Further, a portable playback device may be configured to perform an automatic spectral calibration to improve its sound output based on its environment independent of any specific hardware features of the control device. Automatic spectral calibration of portable playback devices is discussed in more detail in U.S. Pat. Nos. 9,763,018, 10,299,061, 10,459,684, and 10,734,965, each of which is hereby incorporated by reference in its entirety.
Sonos continues to innovate and expand the calibration options that are available to its playback devices. For example, the type of advanced spectral calibration discussed above has traditionally depended on the control device having a qualified microphone, and so in practice, only certain types of control devices (e.g., iPhones, iPads, etc.) have been capable of supporting the advanced spectral calibration option. However, concurrent with the filing of this application, a spectral self-calibration using a playback device's own microphone, formerly only available on portable devices, has been expanded to include some microphone-equipped, non-portable playback devices as well, using calibration audio tones rather than music playback. In this way, many users that were formerly unable to calibrate their non-portable playback devices due to the lack of a compatible control device are now able to calibrate their playback devices using the playback device's own microphone.
As may be appreciated from the above, a given media playback system today may include a variety of different playback devices, each having potentially different capabilities, with the possibility of being controlled by a variety of different control devices that may also have different calibration capabilities with respect to the playback devices. In view of this array of possibilities, determining which of these different calibration options may apply to a particular playback device in a given media playback system depends on a combination of different factors. Moreover, access to and enablement of these different calibration options for a given playback device may be spread across different configuration settings options within a media playback system controller application and or physical controls on the playback device itself. Consequentially, despite having increased calibration options for different combinations of playback devices and control devices, users may not know which options are available for their respective media playback systems in various different playback scenarios. This may prevent them from utilizing the calibration options that are available to them, thereby preventing them from experiencing the improved sound quality that may result from such calibration options.
To address these and other issues, new techniques are discussed below that provide for a calibration experience that intelligently determines what calibration options are available for a given playback device at a given time based on the features and capabilities of the given playback device, and perhaps other devices in the media playback system, and then intelligently presents those calibration options to a user via a control device.
To initiate the intelligent calibration experience discussed herein, a control device of a media playback system may receive an input indicating a command to calibrate a given playback device of the media playback system. Based on the command, the control device may determine which calibration options are currently applicable to the given playback device. In practice, the control device may determine whether certain configuration options are currently applicable to the given playback device based on the hardware and/or software capabilities of (i) the given playback device, (ii) the control device, and/or (iii) another playback device that is bonded to the given playback device, among various other considerations. For example, the control device may determine whether a self-calibration option is currently applicable to the given playback device by determining whether the playback device includes a microphone, whether the microphone is enabled, and perhaps whether a respective microphone for any other playback devices bonded to the given playback device is enabled. As another example, the control device may determine whether an advanced spectral calibration option is currently applicable to the given playback device by determining whether a microphone of the control device is qualified to capture audio content according to the advanced spectral calibration option. Various other examples exist, including determining whether a spatial calibration option is currently applicable to the given playback device.
If the given playback device is capable of performing calibration actions according to a given calibration option, but is not currently configured to do so (e.g., the given playback device includes a microphone, but the microphone is disabled), then the control device may direct a user of the control device to configure the given playback device so that it may perform the calibration actions according to the given calibration option. The control device may then determine that the given playback is currently configured to perform calibration actions according to the given calibration option.
Once the control device has determined which calibration options are currently applicable to the given playback device, the control device may present one or more of the calibration options to the user via a graphical-user-interface (GUI) of media playback system controller application software that may be run by the control device, which may be referred to herein as a media playback system controller application, or more briefly, a controller application. The control device may present the calibration options that are currently applicable to the given playback device at various times based on the context of the given playback device and/or the control device, among other factors. For example, the available calibration options may include one or both of a calibration option that involves the microphone of the control device or a calibration option that involves the microphone of the playback device to be calibrated.
The control device may then receive an input indicating that a user has selected one of the presented calibration options. Based on the input, the control device may cause the given playback device to perform one or more calibration actions according to the selected calibration option. The control device may then receive an indication from the given playback device that calibration is complete, at which point the control device may present to the user, via the GUI of the media playback system controller application, an indication that calibration of the given playback device according to the selected calibration option is complete.
In some embodiments, for example, a playback device is provided including at least one processor, a wireless network interface, a non-transitory computer-readable medium, and program instructions stored on the non-transitory computer-readable medium that are executable by the at least one processor such that the playback device is configured to (i) receive a first user input indicating a command to initiate audio calibration of a playback device, (ii) based on receiving the first user input, present, via a GUI of the computing device, (a) an indication of a first calibration option that utilizes at least one microphone of the playback device and (b) an indication of a second calibration option that utilizes at least one microphone of the computing device, (iii) receive a second user input indicating a selection of the first calibration option, (iv) based on the received second user input, cause the playback device to perform one or more calibration actions according to the first calibration option, (v) after the playback device performs the one or more calibration actions according to the first calibration option, receive an indication from the playback device that the playback device has completed the one or more calibration actions according to the first calibration option, and (vi) present, via the GUI of the computing device, an indication that the playback device has completed the one or more calibration actions according to the first calibration option.
In another aspect, a non-transitory computer-readable medium in provided. The non-transitory computer-readable medium is provisioned with program instructions that, when executed by at least one processor, cause a playback device to (i) receive a first user input indicating a command to initiate audio calibration of a playback device, (ii) based on receiving the first user input, present, via a GUI of the computing device, (a) an indication of a first calibration option that utilizes at least one microphone of the playback device and (b) an indication of a second calibration option that utilizes at least one microphone of the computing device, (iii) receive a second user input indicating a selection of the first calibration option, (iv) based on the received second user input, cause the playback device to perform one or more calibration actions according to the first calibration option, (v) after the playback device performs the one or more calibration actions according to the first calibration option, receive an indication from the playback device that the playback device has completed the one or more calibration actions according to the first calibration option, and (vi) present, via the GUI of the computing device, an indication that the playback device has completed the one or more calibration actions according to the first calibration option.
In yet another aspect, a method carried out by a playback device includes, (i) receiving a first user input indicating a command to initiate audio calibration of a playback device, (ii) based on receiving the first user input, presenting, via a GUI of the computing device, (a) an indication of a first calibration option that utilizes at least one microphone of the playback device and (b) an indication of a second calibration option that utilizes at least one microphone of the computing device, (iii) receiving a second user input indicating a selection of the first calibration option, (iv) based on the received second user input, causing the playback device to perform one or more calibration actions according to the first calibration option, (v) after the playback device performs the one or more calibration actions according to the first calibration option, receiving an indication from the playback device that the playback device has completed the one or more calibration actions according to the first calibration option, and (vi) presenting, via the GUI of the computing device, an indication that the playback device has completed the one or more calibration actions according to the first calibration option.
While some examples described herein may refer to functions performed by given actors such as “users,” “listeners,” and/or other entities, it should be understood that this is for purposes of explanation only. The claims should not be interpreted to require action by any such example actor unless explicitly required by the language of the claims themselves.
Moreover, some functions are described herein as being performed “based on” or “in response to” another element or function. “Based on” should be understood that one element or function is related to another function or element. “In response to” should be understood that one element or function is a necessary result of another function or element. For the sake of brevity, functions are generally described as being based on another function when a functional link exists; however, such disclosure should be understood as disclosing either type of functional relationship.
In the figures, identical reference numbers identify generally similar, and/or identical, elements. To facilitate the discussion of any particular element, the most significant digit or digits of a reference number refers to the figure in which that element is first introduced. For example, element 110a is first introduced and discussed with reference to
a. Suitable Media Playback System
As used herein the term “playback device” can generally refer to a network device configured to receive, process, and output data of a media playback system. For example, a playback device can be a network device that receives and processes audio content. In some embodiments, a playback device includes one or more transducers or speakers powered by one or more amplifiers. In other embodiments, however, a playback device includes one of (or neither of) the speaker and the amplifier. For instance, a playback device can comprise one or more amplifiers configured to drive one or more speakers external to the playback device via a corresponding wire or cable.
Moreover, as used herein the term NMD (i.e., a “network microphone device”) can generally refer to a network device that is configured for audio detection. In some embodiments, an NMD is a stand-alone device configured primarily for audio detection. In other embodiments, an NMD is incorporated into a playback device (or vice versa).
The term “control device” can generally refer to a network device configured to perform functions relevant to facilitating user access, control, and/or configuration of the MPS 100.
Each of the playback devices 110 is configured to receive audio signals or data from one or more media sources (e.g., one or more remote servers, one or more local devices) and play back the received audio signals or data as sound. The one or more NMDs 120 are configured to receive spoken word commands, and the one or more control devices 130 are configured to receive user input. In response to the received spoken word commands and/or user input, the MPS 100 can play back audio via one or more of the playback devices 110. In certain embodiments, the playback devices 110 are configured to commence playback of media content in response to a trigger. For instance, one or more of the playback devices 110 can be configured to play back a morning playlist upon detection of an associated trigger condition (e.g., presence of a user in a kitchen, detection of a coffee machine operation). In some embodiments, for example, the MPS 100 is configured to play back audio from a first playback device (e.g., the playback device 110a) in synchrony with a second playback device (e.g., the playback device 110b). Interactions between the playback devices 110, NMDs 120, and/or control devices 130 of the MPS 100 configured in accordance with the various embodiments of the disclosure are described in greater detail below with respect to
In the illustrated embodiment of
The MPS 100 can comprise one or more playback zones, some of which may correspond to the rooms in the environment 101. The MPS 100 can be established with one or more playback zones, after which additional zones may be added and/or removed to form, for example, the configuration shown in
In the illustrated embodiment of
Referring to
With reference still to
The local network 160 may be, for example, a network that interconnects one or more devices within a limited area (e.g., a residence, an office building, a car, an individual's workspace, etc.). The local network 160 may include, for example, one or more local area networks (LANs) such as a wireless local area network (WLAN) (e.g., a WIFI network, a Z-Wave network, etc.) and/or one or more personal area networks (PANs) (e.g. a BLUETOOTH network, a wireless USB network, a ZigBee network, an IRDA network, and/or other suitable wireless communication protocol network) and/or a wired network (e.g., a network comprising Ethernet, Universal Serial Bus (USB), and/or another suitable wired communication). As those of ordinary skill in the art will appreciate, as used herein, “WIFI” can refer to several different communication protocols including, for example, Institute of Electrical and Electronics Engineers (IEEE) 802.11a, 802.11b, 802.11g, 802.12, 802.11ac, 802.11ac, 802.11ad, 802.11af, 802.11ah, 802.11ai, 802.11aj, 802.11aq, 802.11ax, 802.11ay, 802.15, etc. transmitted at 2.4 Gigahertz (GHz), 5 GHZ, 6 GHZ, and/or another suitable frequency.
The MPS 100 is configured to receive media content from the local network 160. The received media content can comprise, for example, a Uniform Resource Identifier (URI) and/or a Uniform Resource Locator (URL). For instance, in some examples, the MPS 100 can stream, download, or otherwise obtain data from a URI or a URL corresponding to the received media content.
As further shown in
In some implementations, the various playback devices 110, NMDs 120, and/or control devices 130 may be communicatively coupled to at least one remote computing device associated with a voice assistant service (“VAS”) and/or at least one remote computing device associated with a media content service (“MCS”). For instance, in the illustrated example of
In some embodiments, the local network 160 comprises a dedicated communication network that the MPS 100 uses to transmit messages between individual devices and/or to transmit media content to and from MCSes. In certain embodiments, the local network 160 is configured to be accessible only to devices in the MPS 100, thereby reducing interference and competition with other household devices. In other embodiments, however, the local network 160 comprises an existing household communication network (e.g., a household WIFI network). In some embodiments, the MPS 100 is implemented without the local network 160, and the various devices comprising the MPS 100 can communicate with each other, for example, via one or more direct connections, PANs, telecommunication networks (e.g., an LTE network or a 5G network, etc.), and/or other suitable communication links.
In some embodiments, audio content sources may be regularly added and/or removed from the MPS 100. In some embodiments, for example, the MPS 100 performs an indexing of media items when one or more media content sources are updated, added to, and/or removed from the MPS 100. The MPS 100 can scan identifiable media items in some or all folders and/or directories accessible to the various playback devices and generate or update a media content database comprising metadata (e.g., title, artist, album, track length) and other associated information (e.g., URIs, URLs) for each identifiable media item found. In some embodiments, for example, the media content database is stored on one or more of the various playback devices, network microphone devices, and/or control devices of MPS 100.
As further shown in
In various implementations, one or more of the playback devices 110 may take the form of or include an on-board (e.g., integrated) network microphone device configured to detect sound, including voice utterances from a user. For example, the playback devices 110c-110h, and 110k include or are otherwise equipped with corresponding NMDs 120c-120h, and 120k, respectively. A playback device that includes or is equipped with an NMD may be referred to herein interchangeably as a playback device or an NMD unless indicated otherwise in the description. In some cases, one or more of the NMDs 120 may be a stand-alone device. For example, the NMD 1201 (
The various playback and network microphone devices 110 and 120 of the MPS 100 may each be associated with a unique name, which may be assigned to the respective devices by a user, such as during setup of one or more of these devices. For instance, as shown in the illustrated example of
As discussed above, an NMD may detect and process sound from its environment, including audio output played by itself, played by other devices in the environment 101, and/or sound that includes background noise mixed with speech spoken by a person in the NMD's vicinity. For example, as sounds are detected by the NMD in the environment, the NMD may process the detected sound to determine if the sound includes speech that contains voice input intended for the NMD and ultimately a particular VAS. For example, the NMD may identify whether speech includes a wake word (also referred to herein as an activation word) associated with a particular VAS.
In the illustrated example of
Upon receiving the stream of sound data, the VAS 190 may determine if there is voice input in the streamed data from the NMD, and if so the VAS 190 may also determine an underlying intent in the voice input. The VAS 190 may next transmit a response back to the MPS 100, which can include transmitting the response directly to the NMD that caused the wake-word event. The response is typically based on the intent that the VAS 190 determined was present in the voice input. As an example, in response to the VAS 190 receiving a voice input with an utterance to “Play Hey Jude by The Beatles,” the VAS 190 may determine that the underlying intent of the voice input is to initiate playback and further determine that intent of the voice input is to play the particular song “Hey Jude” performed by The Beatles. After these determinations, the VAS 190 may transmit a command to a particular MCS 192 to retrieve content (i.e., the song “Hey Jude” by The Beatles), and that MCS 192, in turn, provides (e.g., streams) this content directly to the NIPS 100 or indirectly via the VAS 190. In some implementations, the VAS 190 may transmit to the NIPS 100 a command that causes the MPS 100 itself to retrieve the content from the MCS 192.
In certain implementations, NMDs may facilitate arbitration amongst one another when voice input is identified in speech detected by two or more NMDs located within proximity of one another. For example, the NMD-equipped playback device 110e in the environment 101 (
In certain implementations, an NMD may be assigned to, or otherwise associated with, a designated or default playback device that may not include an NMD. For example, the Island NMD 1201 in the Kitchen 101h (
Further aspects relating to the different components of the example MPS 100 and how the different components may interact to provide a user with a media experience may be found in the following sections. While discussions herein may generally refer to the example MPS 100, technologies described herein are not limited to applications within, among other things, the home environment described above. For instance, the technologies described herein may be useful in other home environment configurations comprising more or fewer of any of the playback devices 110, network microphone devices 120, and/or control devices 130. For example, the technologies herein may be utilized within an environment having a single playback device 110 and/or a single NMD 120. In some examples of such cases, the local network 160 (
b. Suitable Playback Devices
The playback device 110a, for example, can receive media content (e.g., audio content comprising music and/or other sounds) from a local audio source 150 via the input/output 111 (e.g., a cable, a wire, a PAN, a BLUETOOTH connection, an ad hoc wired or wireless communication network, and/or another suitable communication link). The local audio source 150 can comprise, for example, a mobile device (e.g., a smartphone, a tablet, a laptop computer) or another suitable audio component (e.g., a television, a desktop computer, an amplifier, a phonograph, a Blu-ray player, a memory storing digital media files). In some aspects, the local audio source 150 includes local music libraries on a smartphone, a computer, a networked-attached storage (NAS), and/or another suitable device configured to store media files. In certain embodiments, one or more of the playback devices 110, NMDs 120, and/or control devices 130 comprise the local audio source 150. In other embodiments, however, the media playback system omits the local audio source 150 altogether. In some embodiments, the playback device 110a does not include an input/output 111 and receives all audio content via the local network 160.
The playback device 110a further comprises electronics 112, a user interface 113 (e.g., one or more buttons, knobs, dials, touch-sensitive surfaces, displays, touchscreens), and one or more transducers 114 (e.g., a driver), referred to hereinafter as “the transducers 114.” The electronics 112 is configured to receive audio from an audio source (e.g., the local audio source 150) via the input/output 111, one or more of the computing devices 106a-c via the local network 160 (
In the illustrated embodiment of
In some embodiments, the electronics 112 optionally include one or more other components 112j (e.g., one or more sensors, video displays, touchscreens, battery charging bases). In some embodiments, the playback device 110a and electronics 112 may further include one or more voice processing components that are operably coupled to one or more microphones, and other components as described below with reference to
The processors 112a can comprise clock-driven computing component(s) configured to process data, and the memory 112b can comprise a computer-readable medium (e.g., a tangible, non-transitory computer-readable medium, data storage loaded with one or more of the software components 112c) configured to store instructions for performing various operations and/or functions. The processors 112a are configured to execute the instructions stored on the memory 112b to perform one or more of the operations. The operations can include, for example, causing the playback device 110a to retrieve audio data from an audio source (e.g., one or more of the computing devices 106a-c (
The processors 112a can be further configured to perform operations causing the playback device 110a to synchronize playback of audio content with another of the one or more playback devices 110. As those of ordinary skill in the art will appreciate, during synchronous playback of audio content on a plurality of playback devices, a listener will preferably be unable to perceive time-delay differences between playback of the audio content by the playback device 110a and the other one or more other playback devices 110. Additional details regarding audio playback synchronization among playback devices and/or zones can be found, for example, in U.S. Pat. No. 8,234,395 entitled “System and method for synchronizing operations among a plurality of independently clocked digital data processing devices,” which is herein incorporated by reference in its entirety.
In some embodiments, the memory 112b is further configured to store data associated with the playback device 110a, such as one or more zones and/or zone groups of which the playback device 110a is a member, audio sources accessible to the playback device 110a, and/or a playback queue that the playback device 110a (and/or another of the one or more playback devices) can be associated with. The stored data can comprise one or more state variables that are periodically updated and used to describe a state of the playback device 110a. The memory 112b can also include data associated with a state of one or more of the other devices (e.g., the playback devices 110, NMDs 120, control devices 130) of the MPS 100. In some aspects, for example, the state data is shared during predetermined intervals of time (e.g., every 5 seconds, every 10 seconds, every 60 seconds) among at least a portion of the devices of the MPS 100, so that one or more of the devices have the most recent data associated with the MPS 100.
The network interface 112d is configured to facilitate a transmission of data between the playback device 110a and one or more other devices on a data network. The network interface 112d is configured to transmit and receive data corresponding to media content (e.g., audio content, video content, text, photographs) and other signals (e.g., non-transitory signals) comprising digital packet data including an Internet Protocol (IP)-based source address and/or an IP-based destination address. The network interface 112d can parse the digital packet data such that the electronics 112 properly receives and processes the data destined for the playback device 110a.
In the illustrated embodiment of
The audio processing components 112g are configured to process and/or filter data comprising media content received by the electronics 112 (e.g., via the input/output 111 and/or the network interface 112d) to produce output audio signals. In some embodiments, the audio processing components 112g comprise, for example, one or more digital-to-analog converters (DAC), audio preprocessing components, audio enhancement components, digital signal processors (DSPs), and/or other suitable audio processing components, modules, circuits, etc. In certain embodiments, one or more of the audio processing components 112g can comprise one or more subcomponents of the processors 112a. In some embodiments, the electronics 112 omits the audio processing components 112g. In some aspects, for example, the processors 112a execute instructions stored on the memory 112b to perform audio processing operations to produce the output audio signals.
The amplifiers 112h are configured to receive and amplify the audio output signals produced by the audio processing components 112g and/or the processors 112a. The amplifiers 112h can comprise electronic devices and/or components configured to amplify audio signals to levels sufficient for driving one or more of the transducers 114. In some embodiments, for example, the amplifiers 112h include one or more switching or class-D power amplifiers. In other embodiments, however, the amplifiers include one or more other types of power amplifiers (e.g., linear gain power amplifiers, class-A amplifiers, class-B amplifiers, class-AB amplifiers, class-C amplifiers, class-D amplifiers, class-E amplifiers, class-F amplifiers, class-G and/or class H amplifiers, and/or another suitable type of power amplifier). In certain embodiments, the amplifiers 112h comprise a suitable combination of two or more of the foregoing types of power amplifiers. Moreover, in some embodiments, individual ones of the amplifiers 112h correspond to individual ones of the transducers 114. In other embodiments, however, the electronics 112 includes a single one of the amplifiers 112h configured to output amplified audio signals to a plurality of the transducers 114. In some other embodiments, the electronics 112 omits the amplifiers 112h.
In some implementations, the power components 112i of the playback device 110a may additionally include an internal power source (e.g., one or more batteries) configured to power the playback device 110a without a physical connection to an external power source. When equipped with the internal power source, the playback device 110a may operate independent of an external power source. In some such implementations, an external power source interface may be configured to facilitate charging the internal power source. As discussed before, a playback device comprising an internal power source may be referred to herein as a “portable playback device.” On the other hand, a playback device that operates using an external power source may be referred to herein as a “stationary playback device,” although such a device may in fact be moved around a home or other environment.
The user interface 113 may facilitate user interactions independent of or in conjunction with user interactions facilitated by one or more of the control devices 130 (
The transducers 114 (e.g., one or more speakers and/or speaker drivers) receive the amplified audio signals from the amplifier 112h and render or output the amplified audio signals as sound (e.g., audible sound waves having a frequency between about 20 Hertz (Hz) and 20 kilohertz (kHz)). In some embodiments, the transducers 114 can comprise a single transducer. In other embodiments, however, the transducers 114 comprise a plurality of audio transducers. In some embodiments, the transducers 114 comprise more than one type of transducer. For example, the transducers 114 can include one or more low frequency transducers (e.g., subwoofers, woofers), mid-range frequency transducers (e.g., mid-range transducers, mid-woofers), and one or more high frequency transducers (e.g., one or more tweeters). As used herein, “low frequency” can generally refer to audible frequencies below about 500 Hz, “mid-range frequency” can generally refer to audible frequencies between about 500 Hz and about 2 kHz, and “high frequency” can generally refer to audible frequencies above 2 kHz. In certain embodiments, however, one or more of the transducers 114 comprise transducers that do not adhere to the foregoing frequency ranges. For example, one of the transducers 114 may comprise a mid-woofer transducer configured to output sound at frequencies between about 200 Hz and about 5 kHz.
In some embodiments, the playback device 110a may include a speaker interface for connecting the playback device to external speakers. In other embodiments, the playback device 110a may include an audio interface for connecting the playback device to an external audio amplifier or audio-visual receiver.
By way of illustration, SONOS, Inc. presently offers (or has offered) for sale certain playback devices including, for example, a “SONOS ONE,” “PLAY:1,” “PLAY:3,” “PLAY:5,” “PLAYBAR,” “PLAYBASE,” “CONNECT:AMP,” “CONNECT,” “SUB,” “BEAM,” “ARC,” “MOVE,” and “ROAM,” among others. Other suitable playback devices may additionally or alternatively be used to implement the playback devices of example embodiments disclosed herein. Additionally, one of ordinary skilled in the art will appreciate that a playback device is not limited to the examples described herein or to SONOS product offerings. In some embodiments, for example, one or more of the playback devices 110 may comprise a docking station and/or an interface configured to interact with a docking station for personal mobile media playback devices. In certain embodiments, a playback device may be integral to another device or component such as a television, a lighting fixture, or some other device for indoor or outdoor use. In some embodiments, a playback device may omit a user interface and/or one or more transducers. For example,
In some embodiments, one or more of the playback devices 110 may take the form of a wired and/or wireless headphone device (e.g., over-ear headphones, on-ear headphones, in-car earphones, etc.). For instance,
As described in greater detail below, the electronic components of a playback device may include one or more network interface components (not shown in
In some instances, the headphone device may take the form of a hearable device. Hearable devices may include those headphone devices (including car-level devices) that are configured to provide a hearing enhancement function while also supporting playback of media content (e.g., streaming media content from a user device over a PAN, streaming media content from a streaming music service provider over a WLAN and/or a cellular network connection, etc.). In some instances, a hearable device may be implemented as an in-ear headphone device that is configured to playback an amplified version of at least some sounds detected from an external environment (e.g., all sound, select sounds such as human speech, etc.)
It should be appreciated that one or more of the playback devices 110 may take the form of other wearable devices separate and apart from a headphone device. Wearable devices may include those devices configured to be worn about a portion of a user (e.g., a head, a neck, a torso, an arm, a wrist, a finger, a leg, an ankle, etc.). For example, the playback devices 110 may take the form of a pair of glasses including a frame front (e.g., configured to hold one or more lenses), a first temple rotatably coupled to the frame front, and a second temple rotatable coupled to the frame front. In this example, the pair of glasses may comprise one or more transducers integrated into at least one of the first and second temples and configured to project sound towards an ear of the subject.
c. Suitable Network Microphone Devices (NMDs)
In some embodiments, an NMD can be integrated into a playback device.
In operation, the voice-processing components 124 are generally configured to detect and process sound received via the microphones 115, identify potential voice input in the detected sound, and extract detected-sound data to enable a VAS, such as the VAS 190 (
In some implementations, the voice-processing components 124 may detect and store a user's voice profile, which may be associated with a user account of the MPS 100. For example, voice profiles may be stored as and/or compared to variables stored in a set of command information or data table. The voice profile may include aspects of the tone of frequency of a user's voice and/or other unique aspects of the user's voice, such as those described in previously-referenced U.S. Pat. No. 10,499,146.
Referring again to
After detecting the activation word, voice processing components 124 monitor the microphone data for an accompanying user request in the voice input. The user request may include, for example, a command to control a third-party device, such as a thermostat (e.g., NEST® thermostat), an illumination device (e.g., a PHILIPS HUE® lighting device), or a media playback device (e.g., a Sonos® playback device). For example, a user might speak the activation word “Alexa” followed by the utterance “set the thermostat to 68 degrees” to set a temperature in a home (e.g., the environment 101 of
d. Suitable Controller Devices
The control device 130a includes electronics 132, a user interface 133, one or more speakers 134, and one or more microphones 135. The electronics 132 comprise one or more processors 132a (referred to hereinafter as “the processor(s) 132a”), a memory 132b, software components 132c, and a network interface 132d. The processor(s) 132a can be configured to perform functions relevant to facilitating user access, control, and configuration of the MPS 100. The memory 132b can comprise data storage that can be loaded with one or more of the software components executable by the processors 132a to perform those functions. The software components 132c can comprise applications and/or other executable software configured to facilitate control of the MPS 100. The memory 132b can be configured to store, for example, the software components 132c, media playback system controller application software, and/or other data associated with the MPS 100 and the user.
The network interface 132d is configured to facilitate network communications between the control device 130a and one or more other devices in the MPS 100, and/or one or more remote devices. In some embodiments, the network interface 132d is configured to operate according to one or more suitable communication industry standards (e.g., infrared, radio, wired standards including IEEE 802.3, wireless standards including IEEE 802.11a, 802.11b, 802.11g, 802.12, 802.11ac, 802.15, 4G, LTE). The network interface 132d can be configured, for example, to transmit data to and/or receive data from the playback devices 110, the NMDs 120, other ones of the control devices 130, one of the computing devices 106 of
The user interface 133 is configured to receive user input and can facilitate control of the MPS 100. The user interface 133 includes media content art 133a (e.g., album art, lyrics, videos), a playback status indicator 133b (e.g., an elapsed and/or remaining time indicator), media content information region 133c, a playback control region 133d, and a zone indicator 133c. The media content information region 133c can include a display of relevant information (e.g., title, artist, album, genre, release year) about media content currently playing and/or media content in a queue or playlist. The playback control region 133d can include selectable (e.g., via touch input and/or via a cursor or another suitable selector) icons to cause one or more playback devices in a selected playback zone or zone group to perform playback actions such as, for example, play or pause, fast forward, rewind, skip to next, skip to previous, enter/exit shuffle mode, enter/exit repeat mode, enter/exit cross fade mode, etc. The playback control region 133d may also include selectable icons to modify equalization settings, playback volume, and/or other suitable playback actions. In the illustrated embodiment, the user interface 133 comprises a display presented on a touch screen interface of a smartphone (e.g., an iPhone™, an Android phone, etc.). In some embodiments, however, user interfaces of varying formats, styles, and interactive sequences may alternatively be implemented on one or more network devices to provide comparable control access to a media playback system.
The one or more speakers 134 (e.g., one or more transducers) can be configured to output sound to the user of the control device 130a. In some embodiments, the one or more speakers 134 comprise individual transducers configured to correspondingly output low frequencies, mid-range frequencies, and/or high frequencies. In some aspects, for example, the control device 130a is configured as a playback device (e.g., one of the playback devices 110). Similarly, in some embodiments the control device 130a is configured as an NMD (e.g., one of the NMDs 120), receiving voice commands and other sounds via the one or more microphones 135.
The one or more microphones 135 can comprise, for example, one or more condenser microphones, electret condenser microphones, dynamic microphones, and/or other suitable types of microphones or transducers. In some embodiments, two or more of the microphones 135 are arranged to capture location information of an audio source (e.g., voice, audible sound) and/or configured to facilitate filtering of background noise. Moreover, in certain embodiments, the control device 130a is configured to operate as playback device and an NMD. In other embodiments, however, the control device 130a omits the one or more speakers 134 and/or the one or more microphones 135. For instance, the control device 130a may comprise a device (e.g., a thermostat, an IoT device, a network device, etc.) comprising a portion of the electronics 132 and the user interface 133 (e.g., a touch screen) without any speakers or microphones.
e. Suitable Playback Device Configurations
Each zone in the MPS 100 may be represented for control as a single user interface (UI) entity. For example, Zone A may be represented as a single entity named Master Bathroom. Zone B may be represented as a single entity named Master Bedroom. Zone C may be represented as a single entity named Second Bedroom.
In some implementations, as mentioned above playback devices that are bonded may have different playback responsibilities, such as responsibilities for certain audio channels. For example, as shown in
Additionally, bonded playback devices may have additional and/or different respective speaker drivers. As shown in
In other implementations, playback devices that are merged may not have assigned playback responsibilities and may each render the full range of audio content of which the respective playback device is capable. Nevertheless, merged devices may be represented as a single UI entity (i.e., a zone, as discussed above). For instance, the playback devices 110a and 110n in the Master Bathroom have the single UI entity of Zone A. In one embodiment, the playback devices 110a and 110n may each output the full range of audio content of which each respective playback devices 110a and 110n is capable, in synchrony.
In some embodiments, an NMD may be bonded or merged with one or more other devices so as to form a zone. As one example, the NMD 120c may be merged with the playback devices 110a and 110n to form Zone A. As another example, the NMD 120b may be bonded with the playback device 110e, which together form Zone F, named Living Room. In other embodiments, a stand-alone network microphone device may be in a zone by itself. In other embodiments, however, a stand-alone network microphone device may not be associated with a zone. Additional details regarding associating network microphone devices and playback devices as designated or default devices may be found, for example, in previously referenced U.S. Pat. No. 10,499,146.
As mentioned above, in some implementations, zones of individual, bonded, and/or merged devices may be grouped to form a zone group. For example, referring to
In various implementations, the zone groups in an environment may be named by according to a name of a zone within the group or a combination of the names of the zones within a zone group. For example, Zone Group 108b can be assigned a name such as “Dining+Kitchen”, as shown in
Certain data may be stored in a memory of a playback device (e.g., the memory 112b of
In some embodiments, the memory may store instances of various variable types associated with the states. Variables instances may be stored with identifiers (e.g., tags) corresponding to type. For example, certain identifiers may be a first type “a1” to identify playback device(s) of a zone, a second type “b1” to identify playback device(s) that may be bonded in the zone, and a third type “c1” to identify a zone group to which the zone may belong. As a related example, identifiers associated with the Second Bedroom 101c may indicate (i) that the playback device 110g is the only playback device of the Zone C and (ii) that Zone C is not in a zone group. Identifiers associated with the Den 101d may indicate that the Den 101d is not grouped with other zones but includes bonded playback devices 110h-110k. Identifiers associated with the Dining Room 101g may indicate that the Dining Room 101g is part of the Dining+Kitchen Zone Group 108b and that devices 110d and 110b (Kitchen 101h) are grouped (
In yet another example, the MPS 100 may include variables or identifiers representing other associations of zones and zone groups, such as identifiers associated with Areas, as shown in
f. Audio Content
Audio content may be any type of audio content now known or later developed. For example, in some embodiments, the audio content includes any one or more of: (i) streaming music or other audio obtained from a streaming media service, such as Spotify, Pandora, or other streaming media services; (ii) streaming music or other audio from a local music library, such as a music library stored on a user's laptop computer, desktop computer, smartphone, tablet, home server, or other computing device now known or later developed; (iii) audio content associated with video content, such as audio associated with a television program or movie received from any of a television, set-top box, Digital Video Recorder, Digital Video Disc player, streaming video service, or any other source of audio-visual media content now known or later developed; (iv) text-to-speech or other audible content from a voice assistant service (VAS), such as Amazon Alexa or other VAS services now known or later developed; (v) audio content from a doorbell or intercom system such as Nest, Ring, or other doorbells or intercom systems now known or later developed; and/or (vi) audio content from a telephone, video phone, video/teleconferencing system or other application configured to allow users to communicate with each other via audio and/or video.
Audio content that can be played by a playback device as described herein, including any of the aforementioned types of audio content, may also be referred to herein as media content. A source from which the media content is obtained may be referred to herein as a media content source.
In operation, a “sourcing” playback device obtains any of the aforementioned types of audio content from an audio source via an interface on the playback device, e.g., one of the sourcing playback device's network interfaces, a “line-in” analog interface, a digital audio interface, or any other interface suitable for receiving audio content in digital or analog format now known or later developed.
An audio source is any system, device, or application that generates, provides, or otherwise makes available any of the aforementioned audio content to a playback device. For example, in some embodiments, an audio source includes any one or more of a streaming media (audio, video) service, digital media server or other computing system, VAS service, television, cable set-top-box, streaming media player (e.g., AppleTV, Roku, gaming console), CD/DVD player, doorbell, intercom, telephone, tablet, or any other source of digital audio content.
A playback device that receives or otherwise obtains audio content from an audio source for playback and/or distribution to other playback devices may be referred to herein as the “sourcing” playback device, “master” playback device, or “group coordinator.” One function of the “sourcing” playback device is to process received audio content for playback and/or distribution to other playback devices. In some embodiments, the sourcing playback device transmits the processed audio content to all the playback devices that are configured to play the audio content. In some embodiments, the sourcing playback device transmits the processed audio content to a multicast network address, and all the other playback devices configured to play the audio content receive the audio content via that multicast address. In some embodiments, the sourcing playback device alternatively transmits the processed audio content to each unicast network address of each other playback device configured to play the audio content, and each of the other playback devices configured to play the audio content receive the audio content via its unicast address.
As discussed above, a given playback device may be calibrated in various ways, depending on the capabilities of the given playback device and/or a given control device that interacts with the playback device during the calibration process, among various other factors. Thus, techniques that provide for the intelligent determination and presentation of currently applicable calibration options for the given playback device can lead to an improved user experience.
Beginning at block 402, the control device 130 may receive a first user input indicating a command to initiate audio calibration of the playback device 110. In practice, the input indicating the command to initiate calibration of the playback device 110 may take various forms. As one possibility, the input indicating the command to calibrate the playback device 110 may take the form of a voice input uttered by the user of the control device 130, which may be received by one or more network microphone devices (e.g., any of the NMDs 120 discussed above and shown in
As another possibility, the first user input indicating the command to initiate calibration of the playback device 110 may take the form of a user selection of a selectable icon presented via a graphical user interface (GUI) of a media playback system controller application running on the control device 130.
One possible example of this type of selectable icon is shown in
In practice, the user may arrive at the example display 500 including the selectable icon 504 in various ways. As one option, the user may navigate within the media playback system controller application to a setting menu or the like for the playback device 110. Selecting a calibration option for the playback device 110 within the settings menu may cause the control device 130 to present the example display 500 of
As another option, a message, card, or other similar notification may be presented to the user via the GUI of the media playback system controller application. The notification may indicate that one or more calibration options are available for the playback device 110, and may invite the user to select the notification. If the user selects the notification, the control device 130 may present the example display 500 of
In practice, the control device 130 may present such a notification via the GUI of the media playback system controller application based on one or more conditions. One possible condition may include the passing of a certain period of time (e.g., a period of time after the playback device is initially set up, etc.), a determination by the control device 130 that the playback device 110 has not been calibrated, or has been repositioned or otherwise moved since it was last calibrated. Another possible condition that may trigger a calibration notification for the playback device 110 may include a determination by the control device 130 that a different playback device of the same media playback system as the playback device 110 has recently been calibrated, and/or that the playback device 110 has recently been bonded with one or more other playback devices of the media playback system. Yet another possible condition that may trigger a calibration notification for the playback device 110 may include a determination by the control device 130 that the playback device 110 completed a different type of calibration (e.g., a spatial calibration, described in more detail below). In this scenario, the notification may include an indication of additional calibration options (e.g., a spectral calibration) beyond those that were just completed. Various other possible conditions may cause the control device 130 to present the notification, via the GUI of the media playback system controller application.
The first user input indicating the command to initiate calibration of the playback device 110 may take any of various other forms as well.
At block 404, based on receiving the first user input, the control device 130 may determine one or more calibration options for the playback device 110 that are to be presented to the user of the control device 130 via the GUI of the media playback system controller application. As previously described, the calibration options may take any of various forms, and may be determined based on a number of factors.
One possible calibration option may include a self-calibration option that may be performed by the playback device 110 using its own microphone. For example, during a self-calibration, the playback device 110 may emit one or more calibration tones that may be detected by its own microphone and used to determine spectral characteristics for the surrounding environment of the playback device 110, which are in turn used as a basis to update one or more calibration settings (e.g., an audio processing algorithm) of the playback device 110 such that its sound output is adapted to its surrounding environment. In some implementations, spectral characteristics for the surrounding environment of the playback device may be approximated based on representative spectral characteristics that are derived based on previous calibrations (e.g., advanced spectral calibrations) of playback devices across other media playback systems. Further discussion regarding calibration of a playback device based on representative spectral characteristics can be found in U.S. Pat. No. 9,864,574, which is incorporated by reference herein it its entirety.
Accordingly, this type of self-calibration may require that the playback device 110 includes at least one microphone, that the at least one microphone is enabled, and in some instances may require that the playback device 110 is oriented in a specific way, such as in a substantially-horizontal orientation. Advantageously, the playback device 110 may be capable of performing this type of self-calibration to improve its sound output independent of any specific hardware or software features of the control device 130.
The control device 130 may determine if the playback device 110 is currently configured to perform a self-calibration as discussed above in various ways. As one possibility, the control device 130 may determine that that playback device 110 includes at least one microphone (e.g., the playback device 110 is a model that includes at least one microphone). Further, the control device 130 may determine whether at least one microphone of the playback device 110 is enabled. If the control device 130 determines that the at least one microphone is not enabled, it may prompt the user to do so.
Turning to
Beginning at block 602, the control device 130 may receive input indicating a command to perform one or more actions. The input indicating the command to perform one or more actions may be the same as the first user input described with respect to block 402 of
At block 604, based on the input received at block 602, the control device 130 may determine whether at least one microphone of the playback device 110 is enabled. The control device 130 may make this determination based on a state variable for the playback device 110 indicating whether a microphone of the playback device is enabled. In some implementations, the playback device 110 may update the state variable indicating its microphone status and may transmit an indication of this state variable to other devices in the media playback system (e.g., the control device 130, other control devices and playback devices, etc.) whenever the state changes. Alternatively, the control device 130 may transmit a message to the playback device 110 requesting a status of the state variable, which the playback device 110 may provide. The control device 130 may determine whether the at least one microphone of the playback device 110 is enabled in various other ways as well.
If the control device 130 determines that the at least one microphone of the playback device 110 is enabled, then at block 606 the control device 130 may proceed with executing the command indicated in block 602, which may involve performing the one or more actions indicated by the command. As mentioned above, this may include continuing to perform one or more of the operations described in
Alternatively, if the control device 130 determines that the at least one microphone of the playback device 110 is not enabled, then at block 608 the control device 130 may present, via the GUI of the media playback system control application, one or more instructions for how to enable the at least one microphone of the playback device 110. In practice, the at least one microphone may be enabled in various ways. As one possibility, the at least one microphone of the playback device 110 may be enabled (or alternatively, disabled) via toggling a physical microphone switch positioned on the playback device 110 that may physically close/open a microphone control circuit of the playback device 110 as it is toggled on and off. As another possibility, the at least one microphone of the playback device 110 may be enabled (or alternatively, disabled) via operation of a capacitive touch button on the playback device 110, which may toggle the playback device's software-based capability of using the at least one microphone (e.g., loading or unloading a microphone driver, etc.). As yet another possibility, the at least one microphone of the playback device 110 may be enabled (or alternatively, disabled) via user selection of a configuration option presented by the control device 130 in a microphone settings menu of the media playback system controller application, which may also toggle the playback device's software-based capability of using the at least one microphone. Other possibilities also exist.
Further yet, the display 620 includes a selectable icon 624 with a textual description “Continue”, which the user of the control device 130 may select to cause the control device 130 to return to the block 604 of
The operations described above with respect to
In addition to determining a microphone status of the playback device 110, the control device 130 may determine whether the playback device 110 is currently configured to perform a self-calibration operation based on whether the playback device 110 is oriented in a valid orientation for playback of audio content. For instance, some playback device models may include one or more orientation sensors that are used to determine an orientation of the playback device, and may be restricted from playing back audio content when the playback device is arranged in an invalid orientation. As one example, the playback device 110 may be restricted from playing back audio content when it is rotated about its pitch and/or roll axis more than a threshold amount, but capable of playing back audio content without restriction when it is in a substantially horizontal orientation.
Further, although the discussion above involves the control device 130 determining a microphone and/or orientation status of the playback device 110 in conjunction with determining if a self-calibration option is available for the playback device 110 at block 404, other implementations are also possible. For instance, the control device 130 may determine that a self-calibration option is available for the playback device 110 at block 404 based on whether the playback device 110 is a model that includes a microphone, irrespective of whether the microphone is currently enabled. Thus, a self-calibration option may be presented to the user at block 406 (discussed below). In this scenario, the control device 130 may defer its confirmation of the playback device's current microphone and/or orientation status until it receives a second input selecting the self-calibration option (e.g., at block 408, discussed below), and may perform one or more actions in line with
The control device 130 may determine whether the playback device 110 is currently configured to perform one or more self-calibration actions according to various other factors as well.
Returning now to block 404 of the flowchart 400, another possible calibration option that the control device 130 may determine is available for the playback device 110 includes an advanced spectral calibration option, which may utilize the microphone of the control device 130 rather than a microphone of the playback device 110, as noted above. During an advanced spectral calibration, the control device 130 may present a series of instructions directing a user of the control device 130 to move around an environment of the playback device 110 while holding the control device 130, as the playback device 110 emits one or more calibration tones. As the control device is moved throughout the environment, the microphone of the control device 130 may detect the calibration tone(s) played back by the playback device 110 and thereby determine a spectral response of the environment. The determined spectral response can then be used to update one or more calibration settings (e.g., an audio processing algorithm) of the playback device 110 to improve its sound output in the environment.
In this regard, the control device 130 may determine whether the advanced spectral calibration option is available for the playback device 110 in various ways. As one possibility, the control device 130 may determine whether at least one microphone of the control device 130 is qualified to capture audio content according to the advanced spectral calibration option. In some cases, a provider of the media playback system controller application may qualify the microphones of certain types of control devices to capture audio content according to the advanced spectral calibration option based on various features of the microphone such as hardware specifications, spectral response, manufacturing tolerances, etc. Certain types of control devices that include a qualified microphone (e.g., iPhones, iPads, other devices that generally use an iOS operating system, etc.) may be capable of performing the advanced spectral calibration, whereas the microphones of other types of control devices may not qualify (e.g., the microphones of hardware manufacturers that generally use an Android operating system), and thus the advanced spectral calibration option may not be applicable to playback devices that are controlled by such other types of control devices. In this regard, determining the availability of the advanced spectral calibration option may be based on the version of the media playback system controller application that is installed on the control device 130 (i.e., an iOS or an Android version).
Nonetheless, in some situations, for the types of control devices that do include qualified microphones, a newly released model of the control device may be installed with the media playback system controller application before its microphone has been qualified to capture audio content according to the advanced spectral calibration option. In such instances, the control device 130 may present to the user, via the GUI of the media playback system controller application, an indication that the microphone of the control device 130 is not yet qualified to capture audio content according to the advanced spectral calibration option, and that the advanced spectral calibration option is temporarily unavailable. Alternatively, the control device 130 may determine that the advanced calibration option is not available without presenting an indication of such.
As another possibility, the control device 130 may additionally determine whether the advanced spectral calibration option is available for the playback device 110 based on one or more of the factors discussed above with respect to self-calibration, such as determining whether the playback device 110 is oriented in a valid orientation, and may provide instructions for correcting an invalid orientation if not, as shown in
Other examples for determining whether an advanced spectral calibration option is available are also possible.
After determining which calibration options are available for the playback device 110, the control device 130 may present some or all of those calibration options to the user of the control device 130 for selection. For example, the control device 130 may determine that both a self-calibration option as well as an advanced spectral calibration option are available.
Accordingly, at block 406 of the flowchart 400, the control device 130 may present, via the GUI of the media playback system controller application, an indication of a first calibration option that utilizes at least one microphone of the playback device 110 (e.g., the self-calibration option), as well as an indication of a second calibration option that utilizes at least one microphone of the computing device 130 (e.g., the advanced spectral calibration option).
Turning to
The display 800 also includes a selectable icon 808 labeled “Continue,” the selection of which, along with the selection of one of the selectable icons 802 or 804, may cause the control device 130 to begin implementing the selected calibration option. For example, the user of the control device 130 may select the self-calibration option (e.g., the selectable icon 802 in
At block 410, based on the second user input, the control device 130 may cause the playback device 110 to perform one or more actions according to the self-calibration option. As discussed above, this may involve causing the playback device 110 to (i) play back calibration audio content, such as one or more calibration tones, (ii) record, via the at least one microphone of the playback device 110, at least a portion of the calibration audio content as it is played back, (iii) determine, based on the recorded calibration audio content, spectral data corresponding to an environment in which the playback device 110 is located, and (iv) determine, based at least on the spectral data corresponding to the environment, calibration data (e.g., an updated audio processing algorithm) for use by the playback device 110 when playing back audio content.
At block 412, after the playback device performs the one or more calibration actions according to the self-calibration option, the control device 130 may receive an indication from the playback device 110 that the playback device 110 has completed the one or more actions.
At block 414, after receiving the indication that the playback device 110 has completed the one or more actions, the control device 130 may present, via the GUI of the media playback system controller application, an indication that the playback device 110 has completed the one or more calibration actions according to the self-calibration option.
Turning to
Returning to block 406 of the flowchart 400, the user of the control device 130 may alternatively opt to select the advanced spectral calibration option (e.g., the selectable icon 804 in
At block 418, in response to receiving the second user input indicating the selection of the advanced spectral calibration option, the control device 130 may cause the playback device 110 to perform one or more actions according to the advanced spectral calibration option. As discussed above, this may involve causing the playback device 110 to (i) play back calibration audio content, such as one or more calibration tone(s) and (ii) apply updated calibration settings (e.g., an updated audio processing algorithm) at the conclusion of the calibration. In turn, at block 420, the control device 130 may carry out one or more actions according to the advanced spectral calibration. As discussed above, this may involve (i) displaying one or more instructions for the user to move the control device 130 throughout the environment in which the playback device is located, (ii) recording, via at least one microphone of the control device 130, a portion of the calibration audio content played back by the playback device 110 as the control device 130 being moved throughout the environment, (iii) determining, based on the recorded calibration audio content, spectral data corresponding to the environment, (iv) determining, based at least on the spectral data corresponding to the environment, updated calibration settings (e.g., an updated audio processing algorithm) for use by the playback device 110 when playing back audio content, and (v) transmitting the updated calibration settings to the playback device 110.
At block 422, the control device 130 may receive an indication from the playback device 110 that calibration is complete. For example, the control device 130 may receive a message from the playback device 110 indicating that the playback device 110 has applied the updated calibration settings determined by the control device 130.
At block 424, the control device 130 may present, via the GUI of the media playback system controller application, an indication that calibration of the playback device is complete. For example, the control device 130 may present the display 900 shown in
In addition to the self-calibration and advanced spectral calibration options discussed above with respect to
As one example of an additional type of calibration, the playback device 110 and/or the control device 130 may be configured to perform one or more spatial calibration actions, which may determine a relative position of the playback device 110 with respect to other playback devices (e.g., other playback devices with which the playback device 110 is bonded), which may generally occur during setup of the bonded zone by instructing the user, via the GUI of the media playback system controller application, to indicate which playback device is currently playing back and audio tone. This user selection may be used to establish, for instance, which playback device in a stereo pair or home theater arrangement should play back left channel audio and which playback device should play back right channel audio.
As another example, the playback device 110 and/or the control device 130 may be configured to perform one or more spatial calibration actions to determine an approximate user listening position with respect to one or more playback devices (e.g., in a home theater setup). In general, this type of spatial calibration has been traditionally performed during an advanced spectral calibration of the playback devices in a bonded home theater zone, by instructing the user to place the control device 130 at a preferred listening location (e.g., in a preferred seating location, at eye level) while the playback devices emit a calibration audio tone that is captured by the microphone of the control device 130 and used to approximate distance based on the time-of-flight of the audio signals. Consequently, a spatial calibration of this type to determine an approximate listening position has only been available for users of certain types of control devices that include microphones qualified for advanced spectral calibration (e.g., iPhones, iPads, etc.).
However, a spatial calibration to determine an approximate user listening position using time-of-flight of the audio signals from the playback device(s) to the microphone of the control device is not as sensitive to differences in microphone hardware characteristics as a spectral calibration. Accordingly, this type of spatial calibration may be advantageously de-coupled from the advanced spectral calibration option and made available to other types of control devices at different times.
For example, the control device 130 may present a spatial calibration option via the GUI of the media playback system controller application when a bonded group of playback devices is initially formed. As another possibility, the control device 130 may determine that a spatial calibration was not performed during the initial setup of a bonded zone, and may thereafter present a card or other notification to the user that a spatial calibration may be performed. In this regard, the control device 130 may present a notification regarding an available spatial calibration based on any of the conditions discussed above that may trigger a calibration notification to be displayed. As yet another possibility, the control device 130 may present the user with an option to undertake a spatial calibration in conjunction with performing a self-calibration operation, as generally discussed above with respect to blocks 410-414 of
In addition, for the flowcharts shown in
The program code may be stored on any type of computer readable medium, for example, such as a storage device including a disk or hard drive. The computer readable medium may include non-transitory computer readable medium, for example, such as computer-readable media that stores data for short periods of time like register memory, processor cache and Random Access Memory (RAM). The computer readable medium may also include non-transitory media, such as secondary or persistent long-term storage, like read only memory (ROM), optical or magnetic disks, compact-disc read only memory (CD-ROM), for example. The computer readable media may also be any other volatile or non-volatile storage systems. The computer readable medium may be considered a computer readable storage medium, for example, or a tangible storage device. In addition, for the processes and methods disclosed herein, each block in
The above discussions relating to playback devices, controller devices, playback zone configurations, and media content sources provide only some examples of operating environments within which functions and methods described below may be implemented. Other operating environments and configurations of media playback systems, playback devices, and network devices not explicitly described herein may also be applicable and suitable for implementation of the functions and methods.
The description above discloses, among other things, various example systems, methods, apparatus, and articles of manufacture including, among other components, firmware and/or software executed on hardware. It is understood that such examples are merely illustrative and should not be considered as limiting. For example, it is contemplated that any or all of the firmware, hardware, and/or software aspects or components can be embodied exclusively in hardware, exclusively in software, exclusively in firmware, or in any combination of hardware, software, and/or firmware. Accordingly, the examples provided are not the only ways to implement such systems, methods, apparatus, and/or articles of manufacture.
Additionally, references herein to “embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one example embodiment of an invention. The appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. As such, the embodiments described herein, explicitly and implicitly understood by one skilled in the art, can be combined with other embodiments.
Further, the examples described herein may be employed in systems separate and apart from media playback systems such as any Internet of Things (IoT) system comprising an IoT device. An IoT device may be, for example, a device designed to perform one or more specific tasks (e.g., making coffee, reheating food, locking a door, providing power to another device, playing music) based on information received via a network (e.g., a WAN such as the Internet). Example IoT devices include a smart thermostat, a smart doorbell, a smart lock (e.g., a smart door lock), a smart outlet, a smart light, a smart vacuum, a smart camera, a smart television, a smart kitchen appliance (e.g., a smart oven, a smart coffee maker, a smart microwave, and a smart refrigerator), a smart home fixture (e.g., a smart faucet, a smart showerhead, smart blinds, and a smart toilet), and a smart speaker (including the network accessible and/or voice-enabled playback devices described above). These IoT systems may also comprise one or more devices that communicate with the IoT device via one or more networks such as one or more cloud servers (e.g., that communicate with the IoT device over a WAN) and/or one or more computing devices (e.g., that communicate with the IoT device over a LAN and/or a PAN). Thus, the examples described herein are not limited to media playback systems.
It should be appreciated that references to transmitting information to particular components, devices, and/or systems herein should be understood to include transmitting information (e.g., messages, requests, responses) indirectly or directly to the particular components, devices, and/or systems. Thus, the information being transmitted to the particular components, devices, and/or systems may pass through any number of intermediary components, devices, and/or systems prior to reaching its destination. For example, a control device may transmit information to a playback device by first transmitting the information to a computing system that, in turn, transmits the information to the playback device. Further, modifications may be made to the information by the intermediary components, devices, and/or systems. For example, intermediary components, devices, and/or systems may modify a portion of the information, reformat the information, and/or incorporate additional information.
Similarly, references to receiving information from particular components, devices, and/or systems herein should be understood to include receiving information (e.g., messages, requests, responses) indirectly or directly from the particular components, devices, and/or systems. Thus, the information being received from the particular components, devices, and/or systems may pass through any number of intermediary components, devices, and/or systems prior to being received. For example, a control device may receive information from a playback device indirectly by receiving information from a cloud server that originated from the playback device. Further, modifications may be made to the information by the intermediary components, devices, and/or systems. For example, intermediary components, devices, and/or systems may modify a portion of the information, reformat the information, and/or incorporate additional information.
The specification is presented largely in terms of illustrative environments, systems, procedures, steps, logic blocks, processing, and other symbolic representations that directly or indirectly resemble the operations of data processing devices coupled to networks. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. Numerous specific details are set forth to provide a thorough understanding of the present disclosure. However, it is understood to those skilled in the art that certain embodiments of the present disclosure can be practiced without certain, specific details. In other instances, well known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuring aspects of the embodiments. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the foregoing description of embodiments.
When any of the appended claims are read to cover a purely software and/or firmware implementation, at least one of the elements in at least one example is hereby expressly defined to include a tangible, non-transitory medium such as a memory, DVD, CD, Blu-ray, and so on, storing the software and/or firmware.
This application claims priority to U.S. Provisional Application No. 63/450,312, filed Mar. 6, 2023, and titled “Systems and Methods for Calibrating a Playback Device,” the contents of which are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
63450312 | Mar 2023 | US |