Patent Grant
10123077
The present application is related to U.S. patent application Ser. No. 15/002,279 filed on Jan. 20, 2016, titled “Methods and Systems for Automatic Media Output Based on User Proximity,” which is hereby incorporated by reference in its entirety.
This application relates generally to computer technology, including but not limited to methods and systems for controlling display of media content on one or more output display devices within a smart media display environment based on user proximity and/or location detected with respect to one or more casting devices.
Media display devices have been widely applied to display media content to audience who gather around the media display devices. As far as they do not interfere with each other, multiple media display devices can be distributed at different locations of a media display environment (e.g., a family household or an office building) to display media content individually or simultaneously. Many existing media display devices are paired with casting devices (e.g., an Apple TV box and a Google TV box) or act as smart television devices to receive television broadcast, satellite broadcast or Internet-based media content. However, these existing media display devices have to be powered on and off individually when a user presses a power button that is located either on a media display device or on a remote control device that is communicatively coupled to its associated media display device.
Under some circumstances, when a user is moving around in a media display environment including multiple media display devices (e.g., from a living room to a bedroom in a family household), he or she has to power off a display device, remember a content source that provides the content displayed thereon, power on another display device, and tune this other display device to continue the display of media content that has been terminated on the previously viewed display device. This could be inconvenient for many users who desire to continue to watch the same media content while moving around in a media environment.
Accordingly, there is a need for smart media display control, and specifically, a need to create a smart media display environment where display of media content is controlled automatically without user intervention. In various implementations of this application, a smart media display environment includes multiple media display devices each disposed at a distinct location. Each media display device is coupled to a casting device (e.g., a set top box) that is configured to detect a user's proximity to the casting device. The casting device applies detected information of the user proximity to switch the media player device between an active mode and an inactive mode. Furthermore, the casting devices of the smart media environment determine a user location within the smart media display environment based on the user proximity information collected at individual casting devices. The casting devices then use the proximity information to support a follow-me mode in which media content that has been watched by a user follows a user to the user location and continues to be displayed at a media display device located at the detected user location. Such methods optionally complement or replace conventional methods of requiring an audience to use a remote control or a client device to control the display of the media content and enabling automatic control of the media display devices without user intervention.
In accordance with one aspect of this application, a method is implemented on a casting device having one or more processors and memory storing one or more programs for execution by the one or more processors. The casting device is coupled to an output device, and the method is implemented to control display of media content on the output device after it is determines that the output device operates at an inactive state. The method includes detecting a client device associated with the casting device, and determining a proximity of the client device, including determining whether the client device is within a proximity threshold from the casting device. The method further includes in accordance with a determination that the client device is within the proximity threshold from the casting device, controlling the output device to change from the inactive state to an active state, and receiving media content from one or more content sources for display on the output device.
In accordance with another aspect of this application, an electronic device is configured to control display of media content on an output device that is coupled to the electronic device. The electronic device includes one or more processors, and memory storing one or more programs to be executed by the one or more processors. The one or more programs further include instructions for implementing the operations of the above method for controlling the display of the media content.
Further, in accordance with one aspect of this application, a method is implemented on a casting device having one or more processors and memory storing one or more programs for execution by the one or more processors. The casting device is coupled to an output device, and the method is implemented to enable a follow-me mode in which the casting device controls display of media content on the output device. The method includes detecting a client device associated with the casting device, and determining a proximity of the client device. The method further includes in accordance with a determination that the client device is within a proximity threshold of the casting device, receiving content information associated with content recently accessed by the client device, obtaining the content from a content source in accordance with the content information, and outputting the obtained content to an output device in accordance with the content information.
In accordance with another aspect of this application, an electronic device is configured to control display of media content on an output device that is coupled to the electronic device according to a follow-me mode. The electronic device includes one or more processors, and memory storing one or more programs to be executed by the one or more processors. The one or more programs further include instructions for implementing the operations of the above method for controlling the display of the media content according to the follow-me mode.
In accordance with some implementations, a casting device includes means for performing the operations of any of the methods described above.
For a better understanding of the various described implementations, reference should be made to the Description of Implementations below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.
Like reference numerals refer to corresponding parts throughout the several views of the drawings.
In various implementations of the application, a smart media display environment includes at least one output device that is coupled to a casting device and configured to display media content streamed by the casting device. The smart display environment is created to control the at least one output device and the display of the media content automatically and with no or little user intervention. The casting device detects a user's proximity to the casting device, or the user's location within the smart media display environment. In some implementations, the casting device applies detected information of the user proximity to switch the media player device between an active mode and an inactive mode. For example, the casting device located at a specific location determines that the user is in proximity, and powers on an output device that is coupled to the casting device. It is noted that such automatic control of media display does not need user intervention to power on or control the output device when a user approaches the casting device.
Further, in some implementations, the casting device uses user proximity information to support a follow-me mode in which display of media content that has been watched by a user follows a user to a new user location and continues to be displayed at an output device located at the new user location. Specifically, in an example, a user is moving around in the smart media display environment including multiple output devices for displaying media content (e.g., from a living room to a bedroom in a family household). When the user leaves the living room, she does not need to power off an output device she has watched or remember a content source that provides the content displayed thereon. Rather, the output device could be automatically turned off or muted according to predetermined media control settings. When the user enters the bedroom, another output device located there will be powered on automatically and tuned to continue the display of the media content from where it has been terminated on the previously watched output device. Thus, such methods complement or replace conventional methods of requiring an audience to use a remote control or a client device to control the display of the media content, and enables control of the media display devices automatically and with no or little user intervention.
Reference will now be made in detail to implementations, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described implementations. However, it will be apparent to one of ordinary skill in the art that the various described implementations may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the implementations.
One or more media device is disposed in the smart media display environment 100 to provide media content that is stored at a local content source or streamed from a remote content source. The media devices can be classified to two categories: output devices 106 that directly output the media content to audience, and casting devices 108 that streams media content to the output devices 108. Examples of the output devices 106 include, but are not limited to television (TV) display devices and music players. Examples of the casting devices 108 include, but are not limited to, a set-top boxes (STBs), DVD players and TV boxes. In the example smart media display environment 100, the output devices 106 are disposed in more than one location, and each output device 106 is coupled to a respective casting device 108 or includes an embedded casting unit. The output device 106-1 includes a TV display that is hard wired to a DVD player or a set top box 108-1. The output device 106-2 includes a smart TV device that integrates an embedded casting unit to stream media content for display to its audience. The output device 106-3 includes a regular TV display that is coupled to a TV box 108-3 (e.g., Google TV or Apple TV products), and such a TV box 108-3 streams media content received from a media content and provides an access to the Internet for displaying Internet-based content on the output device 106-3.
In some implementations, an automatic media output mode is implemented at the casting devices 108 located in the smart media display environment 100. In accordance with the automatic media output mode, an output device 106 automatically switches to an active state based on a proximity of a client device. Specifically, after a casting device 108 determines that an output device 106 coupled thereto operates at an inactive state, the casting device 108 detects a client device 104 associated with the casting device 108, and determines that a proximity of the client device 104. The casting device 108 determines whether the client device 104 is within a proximity threshold from the casting device 108. In accordance with a determination that the client device 104 is within the proximity threshold from the casting device 108, the casting device 108 controls the output device to change from the inactive state to an active state, and receives media content from one or more content sources for display on the output device. It is noted that when the output device 106 operates at the inactive state, the casting device 108 could power off the output device 106, cease outputting media content to the output device 106, cause the output device 106 to pause display of media content received from the casting device 108 and displayed thereon, cease obtaining media content from any content source, cause the output device 106 to reduce an output volume associated with media content displayed thereon, or mute the output device 106.
In some implementations, a follow-me mode is implemented at casting devices 108 located in the smart media display environment 100. In accordance with the follow-me mode, display of media content generally follows a user when the user moves among different locations in the smart media display environment 100. Stated another way, when the user reaches a specific location, an output device located at the specific location is powered on and tuned to display the media content that was previously watched at a different location, allowing the user to continue to watch the media content with no or little interruption. Specifically, a first casting device 108 is located at a first location of the smart media display environment 100, and coupled to a display input of a first output device 106 at the first location. The first casting device 108 detects a client device 104 associated with the first casting device 106. The first casting device 108 determines a proximity of the client device 104. In accordance with a determination that the client device 104 is within a proximity threshold of the first casting device 108, the casting device 108 receives content information associated with content recently accessed by the client device 104, obtains the content from a content source in accordance with the content information, and outputs the obtained content to the first output device 106 in accordance with the content information.
Further, in some implementations, while outputting the obtained content, the first casting device 106 determines that the client device 104 is outside the proximity threshold from the first casting device 106. The first client device 106 then implements at least one operation of powering off the output device 106, ceasing outputting the obtained content on the output device 108, causing the output display 108 to pause the display of the content displayed thereon, ceasing obtaining the content from the content source in accordance with the content information, causing the output device 108 to reduce an output volume associated with the obtained content, and muting the output device. As such, in the follow-me mode, when a user moves from a first location to a second location in the smart media display environment, a casting device 108 located at the first location optionally implements one of the aforementioned operations, while another casting device 108 located at the second location detects a proximity of the user and causes its own output device 106 to display media content that has been displayed to the user at the first location.
In some implementations, smart home devices may be mounted on, integrated with and/or supported by a wall 154, floor 156 or ceiling 158 of the smart media display environment 100. The integrated devices include intelligent, multi-sensing, network-connected devices that integrate seamlessly with each other in a smart home network and/or with a central server or a cloud-computing system to provide a variety of useful smart home functions. In various implementations of the application, a smart home device is disposed at the same location of the smart home environment 100 as a casting device 108 and/or an output device 106, and therefore, is located in proximity to or with a known distance with respect to the casting device 108 and the output device 106. In some implementations, the smart home device identifies a location or a proximity of a client device 104, and directly provides to the casting device information related to the location or the proximity of the client device 104. Alternatively, in some implementations, the smart home device provides to the casting device 108 the information related to the location or the proximity of the client device 104 indirectly via a smart media display server system 140.
It is also noted that in some implementations, a smart home device identifies a location or a proximity of a user in person, and provides the information related to the location or the proximity of the user either directly to the casting device 108 or indirectly to the casting device 108 via the smart media display server system 140.
The smart home devices in the smart media display environment 100 may include, but are not limited to, one or more intelligent, multi-sensing, network-connected thermostats 122, one or more intelligent, network-connected, multi-sensing hazard detectors 124, one or more intelligent, multi-sensing, network-connected entryway interface devices 126 and 128 (hereinafter referred to as “smart doorbells 126” and “smart door locks 128”), one or more intelligent, multi-sensing, network-connected alarm systems 130, one or more intelligent, multi-sensing, network-connected camera systems 132, one or more intelligent, multi-sensing, network-connected microphone devices 134, and one or more intelligent, multi-sensing, network-connected wall switches 136. In some implementations, the smart home devices in the smart media display environment 100 of
In some implementations, the smart home devices are configured to detect a presence, proximity and/or location of a user or a client device 104 carried by a user. For example, the smart doorbell 126 and/or the smart door lock 128 may detect a person's approach to or departure from a location (e.g., a living room). The smart alarm system 130 may detect the presence of an individual within close proximity, e.g., using built-in infrared (IR) sensors. The smart wall plugs 110 may detect occupancy of a room or enclosure. The camera 132 may capture an image or a video clip at a specific location, and the image or the video clip may be processed to identify the presence of a user in the specific location (e.g., a kitchen). Moreover, in some situations, specific individuals may be identified based, for example, on their appearance (e.g., height, face) and/or movement (e.g., their walk/gait) in an image or a video clip. Alternatively, cameras 132 may additionally include one or more embedded sensors (e.g., IR sensors and motion detectors) to detect a presence, proximity or location of a user. In addition, a microphone device 124 can be regarded as a smart home device in this application, and used to determine occupancy of a location in a smart media display environment. Specifically, audio captured by the microphone device 124 may be processed to identify the presence of an occupant in a particular room. Specific individuals may be identified based, for example, on characteristic of their voices.
The smart home devices in the smart media display environment 100 may additionally or alternatively include one or more other occupancy sensors (e.g., touch screens, IR sensors, ambient light sensors and motion detectors). In some implementations, the smart home devices in the smart media display environment 100 include radio-frequency identification (RFID) readers (e.g., in each room 152 or a portion thereof) that determine occupancy based on RFID tags located on or embedded in occupants. For example, RFID readers may be integrated into the smart hazard detectors 104.
In some implementations, in addition to containing sensing capabilities, devices 122, 124, 126, 128, 130, 132, 134, 136 and 138 (which are collectively referred to as “the smart home devices” or “the smart home devices 120”) are capable of data communications and information sharing with other smart home devices, a central server or cloud-computing system, and/or other devices (e.g., the client device 104 and the casting devices 108) that are network-connected. Similarly, the casting devices 108 are capable of data communications and information sharing with the smart home devices, a central server or cloud-computing system, and/or other devices (e.g., the client device 104 and the other casting devices 108) that are network-connected. Data communications may be carried out using any of a variety of custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, MiWi, etc.) and/or any of a variety of custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
In some implementations, the casting devices 108 and the smart home devices serve as wireless or wired repeaters. In some implementations, a first one of and the casting devices 108 communicates with a second one of the casting devices 108 and the smart home devices via a wireless router. The casting devices 108 and the smart home devices may further communicate with each other via a connection (e.g., network interface 160) to a network, such as the Internet 112. Through the Internet 112, the casting devices 108 and the smart home devices may communicate with a smart media display server system 140 (also called a central server system and/or a cloud-computing system herein). Optionally, the smart media display server system 140 may be associated with a manufacturer, support entity, or service provider associated with the casting devices 108 and the media content displayed to the user. Accordingly, the smart media display server system 140 may include one or more content hosts 104 that provide the displayed media content, and a casting device host 116 associated with the casting devices 108.
In some implementations, the network interface 160 includes a conventional network device (e.g., a router). The smart media display environment 100 of
In some implementations, the user 102 is located at a location (e.g., location A) within the smart media display environment 100, and the output device 106-1 operates at an inactive state. At such an inactive state, the output device 106-1 is optionally powered off, ceases receiving media content from the casting device 108-1, pauses display of any received media content, and/or reduces the volume of its speaker while continuing display of media content. On the other hand, the casting device 108-1 optionally powers off the output device 106-1, ceases outputting media content to the output device 106-1, causes the output device 106-1 to pause the display of any received media content, ceases obtaining media content from any content source, causes the output device 106-1 to reduce an output volume while continuing display of media content, and mutes the speaker of the output device 106-1. Alternatively, in some implementations, when the output device 106-1 is a computer-based display device, the inactive mode is one of a power-off mode, a sleep mode and a hibernate mode.
When the output device 106-1 operates at the inactive device, the casting device 108-1 detects a client device 104 associated with the casting device 108-1. In some implementations, the client device 104 is detected, when the casting device 108-1 identifies existence or identity of the client device 104. The casting device 108-1 determines a proximity of the client device 104 including whether the client device 104 is within a proximity threshold from the casting device 108-1 (e.g., within a range of 5 yards). When it is determined that the client device 104 is within the proximity threshold from the casting device 108-1, the casting device 108-1 controls the output device 106-1 to change from the inactive state to an active state, and receives media content from one or more content sources for display on the output device 106-1. At the active mode, the output device 106-1 may be awake, fully powered on and ready for use. In contrast, in some implementations, when it is determined that the client device 104 is outside the proximity threshold from the casting device 108-1, the casting device 108-1 maintains the inactive state at the output device 106-1.
In some implementations, when it enables the change of the output device 106-1 from the inactive state to the active state, the casting device 104 transmits a prompt to the client device 104. The prompt informs the user 102 of the change to the active state at the output device 106-1, and provides the user 102 with an option to cancel the change to the active state. In some implementations, after it enables the change of the output device 106-1 from the inactive state to the active state, the casting device 104 sends a notification to the client device 104 via the communication networks 112. The notification informs the user 102 of the change to the active state at the output device 106-1, while not providing the user 102 with an option to cancel the change to the active state. More details of the prompt and the notification displayed on the client device 104 are discussed below with reference to
In some implementations, when the output device operates at the active state, the casting device 108-1 determines that the client device 104 is not within the proximity threshold from the casting device 108-1, and accordingly, controls the output device 106-1 to change from the active state to the inactive state. However, in some implementations, the casting device 108-1 maintains the status quo of the output device 106-1, and does not control the output device 106-1 to change from the active state to the inactive state, when the output device operates at the active state and the casting device 108-1 determines that the client device 104 is not within the proximity threshold from the casting device 108-1 any longer.
In some implementations, the casting device 108-1 detects the client device 104 and/or determines the proximity of the client device 104 according to a predefined schedule. Proximity determination could be prohibited at one or more predetermined schedules, e.g., when the use is not at home or when the user is asleep at night. More details on how to set forth the schedule for device detection and proximity determination are discussed below with reference to
The casting device 108-1 could determine the proximity of the client device 104 based on its own detection of the presence of the client device 104. The casting device 108-1 could also determine the proximity of the client device 104 by receiving proximity information from the client device 104 that has detected the proximity of the casting device 108-1. Further, in some implementations, the casting device 108-1 provides its own location information to a server 140. The server 140 is configured to obtain location information of the client device 104 and determine the information of the proximity of the client device based on the location information of both the casting device 108-1 and the client device 104. The casting device 108-1 then obtains from the server 140 information of the proximity of the client device 104. Optionally, the server 140 is a casting device host 116 that has authenticated the client device 104. Optionally, the server 140 is a specific content host 114 that provides the media content for display on the output device 106-1 and recognizes both the casting device 108-1 and the client device 104.
Under some circumstances, an active state is enabled for the output device 106-1 when the user is available. The casting device 108-1 determines availability of the user 102 in addition to the proximity of the user 102 or the client device 104 of the user 102, before the casting device 108-1 controls the output device 106-1 to change from the inactive state to the active state. In some implementations, the casting device 108-1 monitors behavior of the user 102 within a predetermined period of time, and determines the availability of the user 102 according to the monitored behavior. In some implementations, the casting device 108-1 detects that the user 102 is engaged in a telephone conversation, and that the user 102 is present but not available. In accordance with a determination that the user 102 is not available, the casting device 108-1 deactivates the active state, maintains the inactive state and forgoes a change from the inactive state to the active state. Alternatively, in some implementations, the casting device 108-1 identifies the state of the client device, and determines whether to activate the output device according to the state of the client device. For example, the casting device 108-1 identifies that the client device is at a mute mode. Then, the casting device 108-1 determines that the user is present but not available, and maintains the inactive state at the output device 106-1.
In some situations, there is another client device 104′ associated with another user is located at the same location (e.g., location A) where the user 102 is currently located. The casting device 108-2 determines whether it is associated with any other client device (e.g., the client device 104′). When it is determined that the other client device 104′ is also within the proximity threshold from the casting device 108-1, the casting device 108-1 further determines that the client device 104 has a priority over the other client device 104′, before it controls the output device 106-1 to change from the inactive state to the active state and receives media content from the one or more content sources for display on the output device 106-1.
In accordance with some implementations of this application, the casting devices 108 implement a follow-me mode that allows display of media content to follow the user 102 when the user 102 moves in the smart media display environment 100 (e.g., moves from location A to location B or from location B to location A). For example, the user 102 initially watches “Hoosiers” on the output device 106-2 at a living room (location B). When the user 102 leaves the living room and enters his bedroom (location A), the output device 106-1 is automatically powered on, and tuned to continue to play “Hoosiers” from a scene that was last viewed on the output device 106-2 located at the living room. The output device 106-2 could be powered off, paused or muted.
At the follow-me mode, the casting device 108-1 detects the client device 104 associated with the casting device 108-1. In some implementations, the client device 104 is detected when the casting device 108-1 identifies existence or identity of the client device 104. The casting device 108-1 determines a proximity of the client device 104. When it is determined that the client device is within a proximity threshold of the casting device 108-1 (e.g., within a range of 5 yards), the casting device 108-1 receives content information associated with content recently accessed by the client device 104, and obtains the content from a content source in accordance with the content information. Then, the casting device 108-1 outputs the obtained content to an output device in accordance with the content information. In an example, the content information includes information of a scene that was last viewed in another location (location B) distinct from location A. The content information is provided to the casting device 108-1 at location A, such that the casting device 108-1 could cause the output device 106-1 to play “Hoosters” at location A from the scene that was last viewed at location B.
It is noted that the content information is not limited to an output position of the media content that is last accessed or viewed at a distinct location. In some implementations, the content information includes one or more of output position, output quality, output volume and an identifier of the content source. The obtained content is outputted to the output device 106-1 from the media content source in accordance with one or more of the output position, the output quality and the output volume.
When the user 102 leaves location A, the casting device 108-1 determines that the client device 104 is outside the proximity threshold the casting device 108-1. The casting device 108-1 could update the content information (e.g., output position, output quality, output volume and content source information) to the server 140. In some implementations, the client device 104 creates at least a token indicating where the content has been stopped at the time of the determination, and updates the content information with the token. Likewise, the content information originally provided to the casting device 108-1 was previously reported by a casting device located at the other location distinct form location A when the user 102 leaves the other location for location A.
Assume that the user 102 moves from location A to location B. At the location (e.g., location B) to which the user 102 is moved, the casting device 108-2 determines that the client device 104 is within a proximity threshold from the casting device 108-2 and that the casting device 108-2 is not associated with any other user or client device in the meantime. The casting device 108-2 receives the content information that has been updated at a previous location (e.g., location A) by the casting device 108-1 or the client device 104. The casting device 108-2 then obtains the content from the content source in accordance with the content information, and outputs the obtained content to the output device 106-1 in accordance with the content information.
In some implementations, the casting devices 108-1 and 108-2 are associated with a user account of an application (e.g., a casting device application), and the content information is stored in a memory of a remote server 140 associated with the user account of the application. The casting device 108-2 obtains the content information from the remote server 140, after the casting device 108-1 updates the content information stored at the remote server 140. Alternatively, the content information is stored in a local memory of the client device 104, and the casting device 108-2 receives the content information from the client device 104.
The client device 104 executes an application for controlling the display of the media content on the output devices 106. Examples of the application include a client device application, a casting device application, a media player application, a TV program application, and a satellite broadcast application. The client device application controls operations of the client device 104. The casting device application controls operations of the casting devices 108. The media player application enables display of media content provided by different content sources (e.g., Netflix, Youtube and Hulu). In some implementations, the application executed by the client device 104 displays a user interface including an affordance, and the affordance prompts a user to enter a user input to active the follow-me mode. The displayed affordance could be a toggle button. Alternatively, the application could also display another affordance on the user interface, and the affordance prompts a user input to activate an automatic media output mode in which the output devices 106 automatically changes from an inactive state to an active state upon detection of a proximity of a client device 104. More details on user interfaces for enabling the automatic media output mode and the follow-me mode are discussed below with reference to
In some situations, there is another client device 104′ associated with another user and located at the same location as the client device 104. The casting device 108-1 determines whether it is associated with any other client device (e.g., the client device 104′). When it is determined that another client device 104′ is also within the proximity threshold from the casting device 108-1, the casting device 108-1 further determines that the client device 104 has a priority over the other client device 104′, before it obtains the content from a content source in accordance with the content information and outputs the obtained content to the output device 106-1 in accordance with the content information. Stated another way, the follow-me mode is deactivated if the client device 104 does not have a priority over another client device 104′ that exists at the same location and has been associated with the casting device 108-1.
Both the automatic media output mode and the follow-mode mode require a casting device 108 to determine a proximity of a client device 104 to the casting device 108. In some implementations, the proximity of the client device 104 is determined at the casting device 108 at least by receiving an audio signal created by a user 102 of the client device 104 and determining the proximity of the client device 104 according to the audio signal. Optionally, the audio signal is triggered by the user 102 of the client device inadvertently when the user 102 enters the location and creates some noise. Optionally, the audio signal is associated with a predetermined voice command, e.g., “Turn on TV,” that has to be spelled out by the user 102 to cause the determination of the proximity of the client device 104.
In some implementations, the casting device 104 further includes an optical sensor (e.g., an IR sensor). The proximity of the client device 104 is determined at the casting device 108 at least by receiving an optical signal associated with the user of the client device and determining the proximity of the client device according to the optical signal.
In some implementations, the proximity of the client device 104 is determined at the casting device 108 based on a Bluetooth (BT) signal emitted by the client device 104. For example, the casting device 108 measures the strength of the BT signal, and determines the proximity of the client device 104 based on the strength of the BT signal. In some implementations, the proximity of the client device 104 is determined at the casting device 108 via one or more WiFi signals communicated between the client device 104 and the casting device 108 over a local area network. In some implementations, the proximity of the client device 104 is determined at the casting device 108 based on a global positioning system (GPS) signal associated with the client device. For example, the user of the client device is approaching a household when the casting device determines the proximity of the client device based on the GPS signal. In some implementations, the proximity of the client device 104 is determined at the casting device 108 via two or more of a BT network, a WIFI network and a GPS according to a predetermined operation sequence. In some implementations, the proximity of the client device is determined based on at least two of a group consisting of an audio signal, an optical signal, a BT signal, a WiFi signal, and a GPS signal.
Further, in some implementations, the casting device 108 in the smart media display environment 100 may additionally or alternatively include one or more other occupancy sensors (e.g., touch screens, IR sensors, ambient light sensors and motion detectors). The casting device 108 could include radio-frequency identification (RFID) readers that determine occupancy based on RFID tags located in the client device 104.
As explained above with reference to
The smart home device 120 could determine the proximity of the client device 104 using an audio sensor or an optical sensor (e.g., a built-in IR sensor). For example, a microphone device 124 can be regarded as a smart home device in this application, and used to determine occupancy of a location in a smart media display environment 100. Specifically, audio captured by the microphone device 124 may be processed to identify the presence and the proximity of the user 102 in a particular room. Moreover, a camera 132 can also be regarded as a smart home device. The camera 132 captures an image or a video clip at a specific location, and the image or the video clip is processed to identify the presence and proximity of a user 102 in the location (e.g., a kitchen). Alternatively, the cameras 132 may additionally include one or more embedded sensors (e.g., IR sensors and motion detectors) to detect a presence, proximity or location of a user 102.
The smart home device 120 could also determine the proximity of the client device 104 based on one or more of a BT signal, a WiFi signal, and a GPS signal associated with the client device 104. Further, in some implementations, the smart home device 120 in the smart media display environment 100 may additionally or alternatively include one or more other occupancy sensors (e.g., touch screens, IR sensors, ambient light sensors and motion detectors). The smart home device 120 could include radio-frequency identification (RFID) readers that determine occupancy based on RFID tags located in the client device 104.
When a smart home device 120 is disposed at a known spot with respect to a casting device 108, the smart home device 120 or the client device 108 is configured to detect a proximity between the smart home device 120 and the client device 108, and the casting device 108 obtains from the smart home device 120 or the client device 108 information concerning the proximity between the smart home device 120 and the client device 108. Such a proximity between the smart home device 120 and the client device 108 is associated with the proximity of the client device 104 to the casting device 108, because the smart home device 120 is disposed at a known spot with respect to the casting device 108.
Specifically, the smart home device 120 could determine its proximity of the client device 104 based on its own detection of the presence of the client device 104, and provide it to the casting device 108 disposed at the same location. Alternatively, the client device 104 could determine its proximity of the smart home device 120 based on its own detection of the presence of the smart home device 120, and provide it to the casting device 108 disposed at the same location. Further, in some implementations, the smart home device 102 and the client device 104 provide their respective location information to a server 140. The server is configured to determine an alternative proximity of the client device with respect to the smart home device 102 based on the location information of both the casting device 108-1 and the client device 104. The server 140 could then determine the proximity of the client device 104 to the casting device 104 based on the alternative proximity of the client device 104 and the known spot of the smart home device 102, and notify the casting device 108 of the proximity of the client device 104. Alternatively, the server could inform the casting device 118 of the alternative proximity of the client device 104, and the casting device 108 determines the proximity of the client device based on the alternative proximity of the client device 104 and the known spot of the smart home device 102. Optionally, the server 140 is a casting device host 116 that has authenticated the client device 104. Optionally, the server 140 is a specific content host 114 that provides the media content for display on the output device 106 and recognizes both the casting device 108 and the client device 104.
In some implementations, the smart home device 120 is disposed in close proximity to the casting device 108. The smart home device 120 detect a proximity of the user 102 or a client device 104 carried by the user 102. Such a proximity to the smart home device 120 could be approximately regarded as the proximity of the client device 104 to the casting device 108 that is located in proximity, and used directly by the casting device 108 to enable the automatic media output mode or the follow-me mode.
Memory 406 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid state storage devices. Memory 406, optionally, includes one or more storage devices remotely located from one or more processing units 402. Memory 406, or alternatively the non-volatile memory within memory 406, includes a non-transitory computer readable storage medium. In some implementations, memory 406, or the non-transitory computer readable storage medium of memory 406, stores the following programs, modules, and data structures, or a subset or superset thereof:
In some implementations, each of the casting device application 426, the media player applications 428 and the smart home device applications 430 causes display of a respective user interface on the output device 412 of the client device 104. The user interfaces of the applications 426-430 could display a notification indicating that change of a display mode (e.g., the change from the active mode to the inactive mode) is pending or that display of media content is following a user in the smart media display environment. The user interfaces of the applications 426-430 could also prompt the user to enable automatic control of media display (e.g., in an automatic media output mode or a follow-me mode), create a schedule for such control of media display, set a priority among a plurality of users or their client devices, and confirm or forgo a display mode change. More details on the aforementioned user interfaces are discussed above with reference to
In some implementations, information for automatic media display control stored in the client data 432 includes one of more of a first enable setting for an automatic media output mode, a second enable setting for a follow-me mode, a schedule of automatic media display control, and user priority information for automatic media display control. As explained above, information for automatic media display control could be stored in association with one or more of the client device settings 434, the casting device settings 436 and the media player application settings 438.
Each of the above identified elements may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, modules or data structures, and thus various subsets of these modules may be combined or otherwise re-arranged in various implementations. In some implementations, memory 406, optionally, stores a subset of the modules and data structures identified above. Furthermore, memory 406, optionally, stores additional modules and data structures not described above.
Memory 506 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid state storage devices. Memory 506, optionally, includes one or more storage devices remotely located from one or more processing units 502. Memory 506, or alternatively the non-volatile memory within memory 506, includes a non-transitory computer readable storage medium. In some implementations, memory 506, or the non-transitory computer readable storage medium of memory 506, stores the following programs, modules, and data structures, or a subset or superset thereof:
Information for automatic media display control could be stored in association with either the casting device settings 528 or the media player application settings 530. Information for automatic media display control includes one of more of a first enable setting for an automatic media output mode, a second enable setting for a follow-me mode, a schedule of automatic media display control, and user priority information for automatic media display control.
Each of the above identified elements may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, modules or data structures, and thus various subsets of these modules may be combined or otherwise re-arranged in various implementations. In some implementations, memory 506, optionally, stores a subset of the modules and data structures identified above. Furthermore, memory 506, optionally, stores additional modules and data structures not described above.
Memory 606 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid state storage devices. Memory 606, optionally, includes one or more storage devices remotely located from one or more processing units 602. Memory 606, or alternatively the non-volatile memory within memory 606, includes a non-transitory computer readable storage medium. In some implementations, memory 606, or the non-transitory computer readable storage medium of memory 606, stores the following programs, modules, and data structures, or a subset or superset thereof:
Each of the above identified elements may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, modules or data structures, and thus various subsets of these modules may be combined or otherwise re-arranged in various implementations. In some implementations, memory 606, optionally, stores a subset of the modules and data structures identified above. Furthermore, memory 606, optionally, stores additional modules and data structures not described above.
Memory 706 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid state storage devices. Memory 706, optionally, includes one or more storage devices remotely located from one or more processing units 702. Memory 706, or alternatively the non-volatile memory within memory 706, includes a non-transitory computer readable storage medium. In some implementations, memory 706, or the non-transitory computer readable storage medium of memory 706, stores the following programs, modules, and data structures, or a subset or superset thereof:
In some implementations, each of the casting device application 722, the media player applications 724 and the smart home device applications 726 causes display of a respective user interface on the output device 712 of the client device 104. It is further noted that the server system 140 is optionally a server type selected from a casting device host 116, a content host 114 and a smart home device host. In some implementations, according to its server type, the server system 140 executes one of the casting device application 722, the media player applications 724 and the smart home device applications 726 based on corresponding data settings selected from client device settings 732, casting device settings 734, and media player application settings 738.
Further, in some implementations, information for automatic media display control is optionally stored in the server system data 730 in association with one or more of the client device settings 732, the casting device settings 734 and the media player application settings 736. The stored information for automatic media display control includes, but is not limited to, one of more of a first enable setting for an automatic media output mode, a second enable setting for a follow-me mode, a schedule of automatic media display control, and user priority information for automatic media display control.
Each of the above identified elements may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, modules or data structures, and thus various subsets of these modules may be combined or otherwise re-arranged in various implementations. In some implementations, memory 706, optionally, stores a subset of the modules and data structures identified above. Furthermore, memory 706, optionally, stores additional modules and data structures not described above.
In some implementations, the user 102 enables an automatic media output mode by selecting the first affordance 802. The user 102 could further associate the automatic media output mode with one or more media applications, when the user 102 selects one or more media applications in the list of media applications provided on the user interface 800. For example, automatic media output could be enabled for and limited to TV applications that display ESPN and Disney TV programs. Thus, in some implementations, when a casting device 108 associated with the client device 104 determines the proximity of the client device 104, the casting device 108 controls its output device 106 (if operating at an inactive state) to change from the inactive state to an active state, and receives and streams the ESPN or Display TV programs for display on the output device 106.
The user interface 850 is displayed on the display of the client device 104, and allows a user to determine the device settings of the client device 104 that define characteristics related to the follow-me mode for casting device(s) associated with the client device 104. The user interface 850 includes a third affordance 806 for enabling and disabling “Follow-Me Mode,” and a second plurality of media application affordances 808 each representing a media application available on the client device 104 for controlling display of media content provided by a corresponding media source. The media applications associated with the second plurality of media application affordances 808 are optionally identical to or different from those associated with the first plurality of media application affordances 804. The user interface 800 could also display an instruction (e.g., “select one of the following media applications to follow you”) to prompt a user 102 of the client device 104 to select one of the media applications for display of corresponding media content in the follow-me mode.
In some implementations, the user 102 enables the display of the media content in the follow-me mode by selecting the third affordance 806. The user 102 could further associate the follow-me mode with one or more media applications, when the user 102 selects one or more media applications in the list of media applications provided on the user interface 850. For example, the follow-me mode could be enabled for and limited to TV applications that display ESPN and Disney TV programs, i.e., only TV programs from ESPN and Disney follow the user 102 when the user 102 moves in the smart home environment 100 including two or more locations each disposed with a respective casting device 108 and a respective output device 106.
In addition, the user interface 900 includes a first list of selectable information items 906 and a second list of selectable information items 908 that are associated with the automatic media output mode and the follow-me mode, respectively. The first list of selectable information items 906 includes one or more schedule information items 906A and an addition information item 906B. The user 102 could select either the schedule information items 906A or the addition information item 906B. In response to a user selection of one of the schedule information items 906A, the selected schedule information item 906A becomes editable and allows the user 102 to modify a schedule for automatic media output associated with the selected schedule information item 906A. Further, in response to a user selection of the addition information item 906B, a pop-up window is displayed on top of the user interface 900, or the addition information item 906B is expanded within the user interface 900, such that the user 102 could enter a new schedule for automatic media output of casting device(s) associated with the client device 104.
Similarly, the second list of selectable information items 908 includes one or more schedule information item 908A and an addition information item 908B. The user 102 could select either the schedule information items 908A or the addition information item 908B. In response to a user selection of one of the schedule information items 908A, the selected schedule information item 908A becomes editable and allows the user 102 to modify a schedule for the follow-me mode associated with the selected schedule information item 908A. Further, in response to a user selection of the addition information item 908B, a pop-up window is displayed on top of the user interface 900, or the addition information item 908B is expanded within the user interface 900, such that the user 102 could enter a new schedule for enabling the follow-me mode of casting device(s) associated with the client device 104.
In the example shown in
In some implementations, the user 102 enables an automatic media output mode by selecting the first affordance 1002. The user 102 could further associate the automatic media output mode with one or more authorized users 102, when the user 102 selects one or more users in the list of users displayed on the user interface 1000. For example, automatic media output could be enabled for and limited to a user named “James.” Thus, in some implementations, when a casting device 108 associated with the casting device application determines a proximity of a client device 104 held by James, the casting device 108 controls its output device 106 (if operating at an inactive state) to change from the inactive state to an active state.
Further, the user interface 1050 is displayed on the display of the client device 104, and allows a user to determine settings of a casting device application for the follow-me mode associated with one or more casting devices 108 that have been connected to a user account of the casting device application. The user interface 1050 includes a third affordance 1012 for enabling and disabling the “Follow-Me Mode.” Optionally, the user interface 1050 further includes a fourth plurality of user affordances 1004 each representing a user and the client device 104 associated with the respective user that will be followed in the follow-me mode. Optionally, the user interface 1050 could also be configured to display an instruction or inquiry 1006 (e.g., “Do you want to the displayed media content to follow someone?” or “Who do you want your casting device(s) to follow?”) to prompt a user 102 of the client device 104 to enable the follow-me mode for one or more authorized users 102.
In some implementations, the user 102 enables the follow-me mode by selecting the third affordance 1012. The user 102 could further associate the follow-me mode with one or more authorized users 102, when the user 102 selects one or more users in the list of users displayed on the user interface 1050. For example, the follow-me mode could be enabled for and limited to a user named “Jill.” Thus, in some implementations, when a casting device 108 associated with the casting device application determines a proximity of a client device 104 held by Jill, the casting device 108 controls its output device 106 to continue to display media content that was previously displayed for Jill at another output device 106 located at a distinct location of the smart media display environment 100.
In some implementations not shown in
In some implementations, the user 102 enables an automatic media output mode by selecting the first affordance 1102. When a casting device 108 detects the client device 104 held by the user 102 and determines a proximity of the client device 104, the casting device 108 controls its output device 106 (if operating at an inactive state) to change from the inactive state to an active state, and display media content provided by a media source associated with the media application. Further, in some implementations, the user 102 enables the follow-me mode by selecting the second affordance 1104. Media content provided by a media source associated with the media application is initially streamed by a first casting device 108-1 for display on a first output device that is coupled to the first casting device 108-1. When the user 102 leaves the first casting device 108-1 and moves in proximity to a second casting device 108-2. The second casting device 108-2 detects the client device 104 and determines the proximity of the client device 104. The second casting device 108-2 operates under the follow-me mode, controlling a second output device 106-2 to continue the display of the media content that was displayed on the first output device 108-1.
In some implementations, the media content is displayed on the display area 1202, and the user 102 enables the automatic media output mode by clicking on the affordance 1204E. In response to the click on the affordance 1204E, the client device 104 generates a request for automatic media display on an output device 106 based on a proximity of the client device 104. In accordance with the automatic media output mode, a casting device 108 could detect the client device 104 and determine the proximity of the client device 104. When the casting device 108 determines that the client device 104 is within a proximity threshold from the casting device 108, the casting device controls the output device 106 coupled to the casting device 108 to change from an inactive state to an active state. The casting device 108 then streams the media content for display on the output device 106 coupled to the casting device, while the display area 1202 is either blank or displays the same media content. In some implementations, a first click on the affordance 1204E enables the automatic media output mode, and a second click on the affordance 1204E subsequent to the first click disables the automatic media output mode.
The user 102 could also enable the follow-me mode for the display of the media content associated with the media application by clicking on the affordance 1204F. In response to the click on the affordance 1204F, the client device 104 generates a request for displaying the media content in the follow-me mode. Casting devices 108 located at different locations of a smart media display environment 100 could detect the client device 104 and determine the proximity of the client device 104. Then, when the user 102 move among the different locations in the smart media display environment 100, the casting devices control the output devices 106 coupled to the casting devices 108, causing the display of the media content on the output devices 106 to track the location of the client device 104. In some implementations, a first click on the affordance 1204F enables the follow-me mode for the display of the media content associated with the media application, and a second click on the affordance 1204F subsequent to the first click disables the follow-me mode.
In some implementations, when the output device operates at the inactive state, the casting device implements (1414) one of a group of operations consisting of powering off the output device, ceasing outputting media content to the output device, causing the output device to pause display of media content that is received by the output device, ceasing obtaining media content from any content source, causing the output device to reduce an output volume while continuing display of media content received by the output device, and muting a speaker of the output device.
In some implementations, a smart home device is disposed at a known spot with respect to the casting device, and one of the smart home device and the client device is configured to detect a proximity between the smart home device and the client device. The proximity of the client device is determined by the casting device by obtaining (1416) from one of a smart home device and the client device information concerning the proximity between the smart home device and the client device. The proximity between the smart home device and the client device is associated with the proximity of the client device to the casting device.
Further, in some implementations, the casting device provides (1418) location information of the casting device to a server (e.g., a server system 140), and obtains (1420) from the server information of the proximity of the client device. The server is configured to obtain location information of the client device and determine the information of the proximity of the client device from the location information of both the casting device and the client device.
In some implementations, the casting device identifies (1422) a state of the client device, and determines (1424) whether to activate the output device according to the state of the client device. For example, the casting device identifies that the client device is at a mute mode, determines that the user is present but not available, and maintains the inactive state at the output device. In some implementations, the casting device detects that the user is engaged in a telephone conversation, and that the user is present but not available. In accordance with a determination that the user is not available, the casting device deactivates the active state, maintains the inactive state and forgoes a change from the inactive state to the active state. Alternatively, the casting device monitors behavior of the user having the client device within a predetermined period of time, and determines the availability of the user according to the monitored behavior.
In some implementations, the casting device transmits (1426) a prompt to the client device. See
In some implementations, while in the active state, the casting device determines (1428) that the client device is outside the proximity threshold from the casting device. In accordance with the determination that the client device is outside of the proximity threshold from the casting device, the casting device controls the output device to change from the active state to the inactive state.
In some implementations, the casting device detects the client device in accordance with a predefined schedule. For example, in accordance with the predefined schedule, proximity determination is prohibited at one or more predetermined times including a first time duration when the user is not at home, and a second time duration when the user is asleep.
The proximity of the client device could be determined based on an audio signal, an optical signal, a BT signal, a WiFi signal, a GPS signal or the like. A proximity/location determination module 522 of the casting device 108 is applied to determine the proximity of the client device. More details on proximity determination concerning the client device are discussed above with reference to at least
Further, in some implementations, while outputting the obtained content, in accordance with a determination that the client device is outside the proximity threshold from the first casting device, the casting device 108 implements (1514) one operation of a group of operations consisting of: powering off the output device, ceasing outputting the obtained content on the output device, causing the output device to pause the display of the content displayed thereon, ceasing obtaining the content from the content source in accordance with the content information, causing the output device to reduce an output volume associated with the obtained content, and muting a speaker of the output device.
In some implementations, the content information includes one or more of: output position, output quality, and output volume. The obtained content could be outputted at the output device from the output position, according to the output quality and/or at the output volume. In an example, the content information associated with the content displayed on the output device includes information indicating where the display of the content has been ceased at a last review. In another example, in accordance with a determination that the client device is outside the proximity threshold from the first casting device, the first casting device creates a token indicating at least where the content has been stopped at the time of the determination.
In some implementations, the first casting device is located at a first location of a smart media display environment. After the client device is outside the proximity threshold from the first casting device, a second casting device determines that the client device is within a proximity threshold from the second casting device and that the casting device is not associated with any other casting device. The second casting device receives the content information associated with the content, obtains the content from the content source in accordance with the content information, and outputs the obtained content to the second output device in accordance with the content information. Further, in some situations, the content information includes a token. In accordance with a determination that the client device is outside the proximity threshold from the first casting device, the first casting device updates the token indicating at least where the content has been stopped at the time of the determination. The updated token is received at the second casting device, and the obtained content is outputted to the second output device according to the token.
In some implementations, the casting device determines whether the first casting device is associated with any other client device. Optionally, the casting device determines that the first casting device is not associated with any other client device when it operates in the follow-me mode. In an example, the client device includes a first client device. The first casting device determines that a second client device is also within the proximity threshold from the casting device and associated with the first casting device, and that the first client device has a priority over the second client device.
In some implementations, the first casting device is associated with a user account of an application. The content information is stored in a memory of a remote server associated with the user account of the application, and the first casting device receives the content information from the remote server. Alternatively, in some implementations, the content information is stored in a local memory of the client device, and the first casting device receives the content information from the client device.
In some implementations, the client device executes an application for controlling the display of the content on the output device, and the application includes an affordance displayed to receive a user input to activate the follow-me mode. The application executed by the client device is one of a casting device application, a media player application, a TV program application, and a satellite broadcast application. In an example, the displayed affordance includes a toggle button.
The proximity of the client device could be determined based on an audio signal, an optical signal, a BT signal, a WiFi signal, a GPS signal or the like. More details on proximity determination concerning the client device are discussed above with reference to at least
Methods 1400 and 1500 are, optionally, governed by instructions that are stored in a non-transitory computer readable storage medium and that are executed by one or more processors of a casting device (e.g., the casting device 108). Each of the operations shown in
It should be understood that the particular order in which the operations in
It will also be understood that, although the terms first, second, etc. are, in some instances, used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first type of audio feature can be termed a second type of audio feature, and, similarly, a second type of audio feature can be termed a first type of audio feature, without departing from the scope of the various described implementations. The first type of audio feature and the second type of audio feature are both types of audio features, but they are not the same type of audio feature.
The terminology used in the description of the various described implementations herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various described implementations and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting” or “in accordance with a determination that,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event]” or “in accordance with a determination that [a stated condition or event] is detected,” depending on the context.
It is to be appreciated that “smart media display environments” may refer to smart environments for homes such as a single-family house, but the scope of the present teachings is not so limited. The present teachings are also applicable, without limitation, to duplexes, townhomes, multi-unit apartment buildings, hotels, retail stores, office buildings, industrial buildings, and more generally any living space or work space.
It is also to be appreciated that while the terms user, customer, installer, homeowner, occupant, guest, tenant, landlord, repair person, and the like may be used to refer to the person or persons acting in the context of some particularly situations described herein, these references do not limit the scope of the present teachings with respect to the person or persons who are performing such actions. Thus, for example, the terms user, customer, purchaser, installer, subscriber, and homeowner may often refer to the same person in the case of a single-family residential dwelling, because the head of the household is often the person who makes the purchasing decision, buys the unit, and installs and configures the unit, and is also one of the users of the unit. However, in other scenarios, such as a landlord-tenant environment, the customer may be the landlord with respect to purchasing the unit, the installer may be a local apartment supervisor, a first user may be the tenant, and a second user may again be the landlord with respect to remote control functionality. Importantly, while the identity of the person performing the action may be germane to a particular advantage provided by one or more of the implementations, such identity should not be construed in the descriptions that follow as necessarily limiting the scope of the present teachings to those particular individuals having those particular identities.
Although various drawings illustrate a number of logical stages in a particular order, stages that are not order dependent may be reordered and other stages may be combined or broken out. While some reordering or other groupings are specifically mentioned, others will be obvious to those of ordinary skill in the art, so the ordering and groupings presented herein are not an exhaustive list of alternatives. Moreover, it should be recognized that the stages can be implemented in hardware, firmware, software or any combination thereof.
The foregoing description, for purpose of explanation, has been described with reference to specific implementations. However, the illustrative discussions above are not intended to be exhaustive or to limit the scope of the claims to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The implementations were chosen in order to best explain the principles underlying the claims and their practical applications, to thereby enable others skilled in the art to best use the implementations with various modifications as are suited to the particular uses contemplated.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20040128065 | Taylor et al. | Jul 2004 | A1 |
| 20050097595 | Lipsanen | May 2005 | A1 |
| 20050246738 | Lockett | Nov 2005 | A1 |
| 20080141302 | Ota | Jun 2008 | A1 |
| 20080256590 | Oosterholt | Oct 2008 | A1 |
| 20090052859 | Greenberger | Feb 2009 | A1 |
| 20090265729 | Weinblatt | Oct 2009 | A1 |
| 20150215382 | Arora | Jul 2015 | A1 |
| 20150314454 | Breazeal et al. | Nov 2015 | A1 |
| 20150331666 | Bucsa et al. | Nov 2015 | A1 |
| Entry |
|---|
| Google, ISR/WO, PCT/US2017/014292, Mar. 28, 2017, 28 pgs. |
| Number | Date | Country | |
|---|---|---|---|
| 20170208364 A1 | Jul 2017 | US |
