The present invention relates to presence detection and service personalization, such as but not necessarily limited to personalizing services as a function of individuals determined to be present relative to one or more service providing devices.
A multiple system operator (MSO), an Internet service provider (ISP), a television service provider, a phone service provider or other provider of the electronically transmissible content may allow individuals or other consumers to subscribe to various types of services. Because consumers may subscribe to multiple service providers and/or to multiple types of services, the present invention contemplates enhance consumer experience with a personalized, customized service that adapts to preferences and behaviors of each individual user. First and foremost, personalized services should be designed to benefit the end user, with a secondary benefit to the service provider, content provider, and/or advertiser. When the user experience of the personalized service is clearly superior to legacy services, users may allow service providers to realize some financial benefits from the responsible and ethical collection and use of measurement data to customize the marketing of products and services.
As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
The room-by-room basis for personalization is predominately described with respect to personalizing television related services as one non-limiting aspect of the present invention contemplates allowing television service providers to personalize offerings according to occupants identified to be within each room 14, 16, 18, 20. The personalized offerings are intended to encompass any form of media, content, data, advertisement or other information made available to the dwelling, or particular users currently within with the dwelling 12, and are not necessary limited to the described television services. Each room 14, 16, 18, 20 is shown to include a presence detecting device (transceiver) configured to detect presence of occupants within the corresponding room as a function of wireless signaling, although each room 14, 16, 18, 20 need not necessary include a presence detecting device in order to facilitate room-by-room occupant detection. The wireless signaling used for presence detection may originate from wireless devices carried by the occupants. The occupants may carry a radio frequency identification (RFID) tag/transmitter, a mobile phone, a near field communication (NFC) device or other wireless device sufficient to facilitate transmission of the wireless signaling.
The wireless signaling may include information sufficient to facilitate distinguishing on occupant from another, optionally without specifically identifying the occupant. The use of the wireless device may be beneficial in allowing hands-free presence detection of the carrying occupant at least in that contemporaneous engagement may not be required to trigger presence detection after the wireless device is paired or otherwise associated with the presence detecting device. While the present invention contemplates the presence detection devices or other devices within one or more of the rooms 14, 16, 18, 20 being manually engaged to trigger presence detection, such as in the event the occupant is not currently in possession of a suitable wireless device, automatic emittance of the wireless signaling may be preferred in order to minimize user operations. Once presence detection is enabled with one or of the presence detecting devices within the dwelling 12, the other presence detection devices may be notified to facilitate presence detection in the corresponding rooms.
Optionally, the wireless devices may be paired with presence detecting devices in other dwellings (not shown) to facilitate similar operations therein. The wireless devices may be configured to periodically transmit wireless signaling for receipt by the presence detecting devices. A power level of the wireless signaling and/or a capability of the presence detecting devices to receive the wireless signaling may be adjusted according to a size of each room. The wireless signaling range of the wireless devices and/or the presence detecting devices may be adjusted in order to limit the likelihood that a single occupant is determined to be present in multiple rooms at the same time. A range testing operation may be conducted between the wireless devices and the presence detecting devices within each room in order to facilitate establishing the wireless communication ranges. Optionally, the presence detecting devices may include an application through which instructions can be provided to occupants to facilitate establishing the wireless communication ranges.
The presence detecting devices may be configured to facilitate detecting presence of one or more occupants within each of the rooms 14, 16, 18, 20. The presence detection may then be used to facilitate personalizing services provided through a television or other interface of the occupied room. The present invention is not necessarily limited to facilitating personalization of services provided through televisions and fully contemplates its use and application in facilitating personalization of other types of services, which may not necessarily be interfaced through a television. The televisions are shown for exemplary non-limiting purposes to demonstrate one type of device through which network services may be interfaced. While the television is shown to standalone from other user controllable devices, the television need not be a standalone component and may be integrated in any other type of device, including but not limited to a computer, a mobile phone, a tablet computer, etc. A set top box (STB) is shown to be associated with each of the televisions to facilitate interfacing television related signaling. The STB or other suitable gateway may be associated with the television to descramble, to provide encryption or to otherwise facilitate processing of service related signaling. The STB is shown to be separate from the television for exemplary non-limiting purposes as its function may be integrated with each television and/or its use may be omitted.
The television services may be personalized according to information received at a personalized television (TV) service application 24. The personalized TV service application 24 may be configured to facilitate personalizing the television services according to presence information received from a presence and identity Web services 26. The personalized TV service application 24, the presence and identity Web services 26 and the other illustrated components may be included as part of a presence services controller 30. The controller 30 may include a computer-readable medium having non-transitory instructions stored thereon, which operate with a processor, to facilitate the operations contemplated by the present invention. The presence and identity Web services 26 may be a Web-based server or other device configured to receive notification messages from the presence detecting devices. The notification messages may correspond with an arrival message and a departure message transmitted from one or more of the presence detecting devices to announce arrival and departure of occupants within the rooms. Each presence detecting device may be configured to transmit one or more of the notification messages upon detecting the arrival and departure of occupants. The notification messages may include an identifier for the detected wireless signaling and an identifier of the room for which the arrival and/or departure was detected. One non-limiting aspect of the present invention contemplates the presence detecting devices being configured to transmit the notification messages through a first network interface 32.
The first network interface 32 may be configured to facilitate exchanging signals between the presence detecting devices within the dwelling 12 and a first network 34 external to the dwelling. A first inside network (not shown), such as a wireless or wired network, may be included within the dwelling to facilitate interconnecting each of the presence detecting devices with the first network interface 32. One non-limiting aspect of the present invention contemplates the first network interface 32 being sufficient to facilitate exchanging Internet protocol (IP) layer messaging between the first network 34 and the presence detecting devices. The first network 34 may be configured as an IP-based network having capabilities sufficient to facilitate IP layer message exchange according to according to Hypertext Transfer Protocol (HTTP), the disclosure of which is hereby incorporated by reference in its entirety. The use of an IP-based network to facilitate IP-layer messaging may be beneficial in allowing the presence detecting devices to facilitate communications according to commonly used networking protocols and/or to allow manufacturers to provide off-the-shelf devices to facilitate the contemplated presence detection without requiring such devices to support proprietary communication protocols and messaging commonly employed by television service providers.
The presence and identify Web services 26 may be configured to process information included in the notification message to facilitate determining presence and identity of the occupants. In order to insure occupant security and integrity of collected information, the notification message may include non-descriptive identifiers generated for the occupant originating wireless signaling. The non-descriptive identifiers may be beneficial in preventing use of the underlying information in the event one of the notification messages was to be intercepted by an unintended third party. A presence and identity database 36 may include information sufficient to relate the identifying information in the notification messages to particular uses. The presence and identity database 36 may be securely maintained to protect the identity of registered users. An admin portal 38 may be included to facilitate administering the presence and identify information included in the presence and identity database 36. The admin portal 38 may be in the control of a service provider (not shown) responsible for providing the services to the dwelling for personalization. Optionally, in the event the personalization is being used to control a device to personalize content provided from other service providers, the admin portal 38 may be associated with a trusted authentication service or other trusted third party.
The presence and identity Web services 26 may cooperate with the admin portal 38, presence and detecting database 36, backend infrastructures and the like to facilitate determining identification information for particularly dwelling occupants. Optionally, the occupants may provide profiles or other identifying information to facilitate the contemplated identification, such as but not necessarily limit to preference related information representative of the occupant preferences for personalization. The identifying information, and optional preferences, may be provided from the presence and identity Web services 26 to the personalized TV service application 24. The personalized TV service application 24 may use this information to generate personalization information. The personalization information may then be provided on a room-by-room basis to the television in order to personalize the television service relative to the corresponding room occupant(s). A media database 40 may cooperate with the personalized TV service application 24 to facilitate personalizing various television services or other related media according to the particular room occupants, e.g., to personalize content advertised or made available to each room 14, 16, 18, according to the personal preferences of the user identified therein.
A quadrature amplitude modulated (QAM) based video distribution network 42 is shown to facilitate interfacing the television services with the dwelling. A second interface 44 at the dwelling 12 may be configured to facilitate interfacing the television services related signaling with each of the STBs. A second inside network (not shown), such as a wireless or wired network, may be included within the dwelling to facilitate interconnecting each of the STBs with the second network interface 44. One non-limiting aspect of the present invention contemplates the second network interface 44 being sufficient to facilitate exchanging non-IP layer messaging between the QAM network and the STBs. The QAM network may be configured as a non-IP based network having capabilities sufficient to facilitate non-IP layer message exchange according to according to Enhanced Binary Interchange Format (EBIF), the disclosure of which is hereby incorporated by reference in its entirety. The use of a non-IP-based network to facilitate non-IP layer messaging may be beneficial in allowing the STBs to facilitate communications over legacy networks commonly employed by television service providers to transmit television signaling over proprietary communication mediums. This may be beneficial in allowing the present invention to operate with legacy and/or deployed STBs without requiring the STBs to support IP-based messaging or communications over IP networks and/or IP messaging layers.
While the system in
The services personalization may include room-level personalization for secondary devices 46, such as but not necessarily limited to tablets, smartphones, computers and/or other devices that may be configured to supplemental occupant experience relative to content interfaced through the television or otherwise being delivered by the service provider. Such secondary device personalization may cooperate with the personalization provided through the television and/or operated independently thereof, such as to personalize services to a different room occupant, i.e., services interfaced through the television could be personalized to a first room occupant 48 and services interfaced through the secondary device 46 could be personalized to a second room occupant 50. The secondary device personalization may be achieved with secondary personalization message communicated from the personalization TV service application 24 and/or an Extensible Messaging and Presence Protocol (XMPP) server 54 to the relevant secondary devices. Optionally, the secondary personalization message may be transmitted to the secondary device 46 using backchannel communication, such as but not necessarily limited to that described in U.S. patent application Ser. No. 13/534,238, the disclosure of which is hereby incorporated by reference in its entirety.
The personalized TV service application 24 and/or the other resources contemplated by the present invention may be configured in accordance with the contemplated concepts to use the knowledge and other information associated with presence of the room occupants, along with that user's recorded preferences and usage history, to create a personalized service for the user. In particular, the system 10 may be beneficial in personalizing video services, including, but not limited to: recommended programming; personalized programming guide; links into social networking tools so that the user can see what his or her friends watched and liked, or can see what friends are watching right now; automatically tuning the channel to the program that the user usually watches at this time of day and day of week; automatically generating playlists of recommended programming based upon user preferences and viewing history; targeting specific advertisements to the user based upon preferences, viewing history, psychographic or demographic information, and other externally-supplied information about the user; and/or supplying de-identified and aggregated statistics to advertisers, agencies, marketers, content packagers and content creators.
The sequence diagram includes a network identifier to identify the network or combination of networks over which corresponding messaging and communications may take place to facilitate the contemplated operations (e.g., Network A, Network A & QAM, QAM Network). The network identification may be beneficial as one non-limiting aspect of the present invention contemplates a particular network configuration and system implementation where interfaces, translations and other operations may be performed to facilitate messaging and signaling for use with specific devices. The architecture may be particularly beneficial in defining interactions contemplated by the presence invention to facilitate personalization according to certain restrictions and operational limitations/capabilities of the noted devices, such as but not limited to facilitating personalization with legacy systems and devices without requiring software updates and/or component replacement.
The presence detecting device may communicate a GET presencedevices message to the presence controller, which may be communicated through the first interface according to HTTP. The GET presencedevices message may be used to facilitate identifying the presence detecting device to the presence controller. This may be done to identify the presence detecting devices authorized for use in facilitating the contemplated personalization. The presence detecting device may be configured to transmit the GET presencedevices message automatically upon power up, and response to user interaction with the presence detecting device and/or as a function of other triggering events. If the presence detecting device has been authorized previously by the presence Web services to facilitate presence determinations, a 200-OK message may return to confirm its operational status. While not shown, the presence detecting device may initiate an authentication procedure or other authenticating event to facilitate authenticating itself to the presence controller, including exchanging information sufficient to identify a particular room having the presence detecting device, a subscriber associated with the dwelling and/or other information to facilitate the room-level personalization contemplated by the present invention.
The presence controller may communicate a trigStatus message to the STB. The trigStatus message may be used to request enhance television (ETV) related information from the STB. The trigStatus message may be communicated to the STB through the second interface and formatted according to EBIF. The STB may provide the ETV related information in a POST ETV message communicated through the first interface and defined according to HTTP. The POST ETV message may identify an IP address, port and/or other information for the STB within the room of the presence detecting device communicating the GET presencedevices message. The presence controller may respond with a 200-OK message to confirm receipt of the necessary STB related parameters. The messages exchange between the presence controller and the STB may occur through the first and second interfaces in order to work within message protocol limitations/capabilities of the STB and to facilitate exchanging information sufficient to facilitate subsequent personalization of services through corresponding manipulation of the STB.
The presence detecting device may communicate a PUT add message to the presence controller to associate itself with one of the STBs. The PUT add message may be communicated to the first interface and defined according to HTTP. The presence controller may transmit a trigPresence message to the STB identified in the PUT add message. The trigPresence message may be transmitted through the second interface and defined according to EBIF. The trick message may be used to notify the STB to display a notification message when the corresponding presence detecting device determines presence of an occupant within the corresponding room. The notification message may initially be a confirmation message to notify the occupant currently in the room that they have been identified for personalization. The STB may transmit a DisplayPresence message to the television or other display used to interface the services. The DisplayPresence message may include the notification information to be displayed to the occupant to confirm presence detection. The DisplayPresence message may be beneficial in notifying the occupant that they have been enrolled in presence detection processes. A POST ETV message may be communicated from STB to the presence controller to confirm output of the DisplayPresence message.
The presence controller may transmit a displayPresenceResponse to the XMPP server to facilitate notifying a secondary device within the corresponding room of enrollment of the occupant in the presence detection processes. The presence controller may also transmit a 200-OK message to the STB to confirm receipt of the POST ETV message. The XMPP server may transmit a displayPresenceResponse message to the secondary device. The displayPresenceResponse message may be similar to the DisplayPresence message transmitted to the television in order to prompt the secondary device to provide a notification message. The notification message interfaced through the secondary device may be similarly perform a notification process to notify enrollment in the presence detection processes. Optionally, the XMPP server may detect presence of the secondary device prior to transmitting the corresponding messages. The presence of the secondary device may be determined by the presence detecting device and/or through other processes executed between the XMPP server and the secondary device.
As noted, the sequence diagram associated with
The presence controller may communicate a trigPresence message to the STB associated with the room of the presence detecting device sourcing the POST arrive message. The trigPresence message may be transmitted through the first interface and defined according to EBIF to include identifying information specific to the occupant associated with the detected wireless device. The trigPresence message may include personalization information sufficient for use in personalizing services accessed through the STB. The STB may automatically process the personalization information in order to personalize user interaction with the STB and/or television. Optionally, a DisplayPresence message may be communicated from STB to the television to provide a greeting message or other notification sufficient to notify the occupants that their presence has been detected.
Returning to
The foregoing sequences described with respect to
The presence detecting device failing to detect continued presence of an occupant may transmit a POST leave message to the presence controller through the first interface according to HTTP and similarly receive a confirming 200-OK message. The POST leave message may identify the occupant device without specifically identifying the associated user. The POST leave message may prompt to the presence controller to transmit a trigPresence message to the corresponding STB through the second interface according to EBIF. The trigPresence message may include de-personalization information for use in instructing the STB to de-personalize services. Optionally, the de-personalization information may include instructions for the STB to provide a DisplayFarewell message to the television for displaying a farewell message to the occupant, such as “Good Bye John”. The farewell message may be beneficial in providing supplemental notification to the occupant that presence detection, at least within the corresponding room, has terminated. The farewell may be particularly use if the occupant desired to remain within the room and to access services without the personalization constraints.
The STB may transmit a POST ETV message through the first interface according to HTTP to confirm de-personalization and similarly receive a 200-OK confirmation from the presence controller. Depending on whether the exiting occupant was also associated with services personalize through a secondary device, the presence controller transmit a displayPresenceResponse message to the XMPP server. The XMPP server may then transmit a displayPresenceResponse message to secondary device to provide de-personalization information to the secondary device. The de-personalization information may be used to instruct the second device to cease personalizing an application or other feature provided through the secondary device and/or to display a farewell message. While the presence detection sequence is described with respect to certain messages being defined according to HTTP and other messages being defined according to EBIF, this is done for exemplary non-limiting purposes as the present invention fully contemplates other messaging exchanges to facilitate the contemplated presence detection.
The presence controller may transmit a trigDisplay message to the STB through the second interface according to EBIF to which the STB response with a similarly transmitted 200-OK message to confirm receipt. The trigDisplay message may include replacement information sufficient to notify the STB that the personalization status for the wireless device has been replaced and changed to be inactive. The replacement information may include instructions for the STB to provide a DisplayPresence message to the television for prompting display of a corresponding notification message. The notification message may be used to convey replacement of account status to the room occupant or to otherwise facilitate notifying the user associated with the wireless device that presence detection will no longer be performed. Optionally, an interface may be provided for the user to confirm deactivation to the STB and/or to specify parameters of the deactivation, such as to select on a room-by-room the rooms for which presence detection is to be deactivated and the rooms, if any, for which presence detection may continue. The presence controller may transmit a displayResponse message to the XMPP server to prompt transmission of another displayResponse message to a secondary device within the room of the wireless device or outside of the room and associated with the wireless device. The displayResponse message may be used to appraise the XMPP service of the replaced status and to facilitate corresponding notification through the secondary device.
One component of a personalized service is the ability to recognize who is interacting with the service. Of course, this can be done by forcing the user to “log in” to the service with a username or a username and password, but many users will not have the patience for this. The automated detection of the identity of the user interacting with the service would improve the user experience, and make it more likely that the user would opt in to the use of a personalized service.
There are many ways contemplated by the present invention to automatically detect the identity and presence of a user, including those shown in the table below:
Video service users are likely the choose a personalized service if:
Therefore, service providers should be clear about the data that is collected, how long it is kept, how it is anonymized, and the limits on how the data will be shared.
As a demonstration of the transparency associated with a personalized video service, and as a check on the accuracy of the automated personalization systems, the service could display a small icon, token, or name on the viewing screen to indicate which user or users have been identified in the room, and to indicate for whom the service is being personalized.
One non-limiting aspect of the present invention contemplates measurement being a foundation of a personalized service. The measurement data should not only serve the needs of advertisers, but should also serve the needs of programmers, studios, app and game developers, service providers, and end users.
The following data elements could be measured for each end user:
Measurement data can be enhanced by combining the data collected from the use of the personalized video service with other marketing data sources to determine age, income, recent purchases, hobbies, interests, seasonal behaviors, and other demographic information.
When combining data about a specific individual, the data should be handled carefully with regard to privacy and anonymization, and processes should be defined to ensure that no personally identifying information is stored, so that a security breach could not reveal that a named individual watched a particular program or visited a particular website. Instead, each video session should simply be associated with a set of users, with each user belong to certain behavior categories for marketing purposes.
Measurement data can be used to customize a user's experience, including
Measurement data can be used to add value for content providers in multiple ways, including:
Measurement data can be used to add value for advertisers in multiple ways, including:
Measurement data can be used to add value for service provider applications in multiple ways, including allowing service providers to use measurement data for
Measurements can be enhanced by combining data from several different measurement sources, some of which are outside of a service provider's domain. For example, it could be useful to an advertiser to know that a viewer who likes to watch Seinfeld also takes an annual trip to Hawaii every Spring, and therefore might be a good target for airline and travel ads each Winter.
However, the service provider measurement infrastructure might only reveal the preference for Seinfeld, while a third-party marketing database might hold the data about the user's Spring travels. A “one-way function” is contemplated to facilitate combining these two data points without either the service provider or the third-party marketing database revealing the identity of the user. The “one-way function” may be a function that is easy to compute, but for which the inverse is very hard to compute. The application of one-way functions to anonymization would allow multiple measurement sources to use personally identifying information such as name, address, and account number to compute an encoded identifier for an end user which cannot be easily converted back into the original personally identifying information. The encoded identifier would appear to be a random sequence of numbers, so that should the encoded identifier fall into the wrong hands, the original personally identifying information would be very difficult to determine.
If multiple contributing data sources use the same one-way function to compute an encoded identifier, then each party could contribute what they know about an end-user's behavior to a common data pool by reporting the encoded identifier along with the end-user's actions, but not reporting any personally identifying information. In the example of the Seinfeld viewer, the service provider could report that end user 8A74 21F2 B635 3491 watches Seinfeld, while a third party marketing database could report that the same user always takes a Spring vacation that requires air travel, while neither party reveals the name, address, or account number of the individual.
The contemplated personalized video service can place a great deal of control in the hands of the user of the service, allowing them to customize how much information they reveal, and how the service is customized to their preferences, including the following:
As supported above, one non-limiting aspect of the present invention contemplates automatically detecting the presence and identity of the user(s) of a network based service, and using the knowledge of the user's presence to customize and personalize the service according to the user's preferences, usage history, and/or additional externally gathered information regarding the user(s).
One non-limiting aspect of the invention contemplates automatically detecting the presence of the individual(s) who are interacting with a network-connected service such as television viewing or social networking, and then uses the knowledge of the identity of the user(s) present to personalize the service for the user, and generate custom and de-identified usage reports for the service provider, advertisers, marketers, content packagers, and content creators.
The present invention uses any of several different methods to detect user presence, including but not limited to:
In the example of using RFID identity and presence detection in connection with a personalized television service, the user carries or wears an RFID Tag that has been registered as belonging to the user's identity in the Presence and Identity database. There is also an RFID reader that is co-located with a television and powered to read RFIDs at a distance appropriate to the room in which the television resides. When the user walks into the television room, the RFID reader detects the presence of the RFID tag and reports the identifier for that RFID tag to the Presence and Identity Web server over Network A. Network A is likely to be an Internet Protocol (IP) network, but is not limited to being an IP network.
The Presence and Identity Web Server may record the presence of the RFID Tag and associates that RFID tag to the user whose identity was registered for that RFID Tag, and report to the Personalized TV Service Application that the RFID tag associated with the identified user is present in the room. When the user leaves the room, the RFID reader detects the absence of the user and reports that the user has left the room to the Presence and Identity Server. The Presence and Identity Server reports the user's absence to the Personalized TV Service Application, and the personalized TV service is de-activated and normal TV service resumes.
Aspects of the present invention contemplate one or more of the following:
While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.
This application claims the benefit of U.S. provisional Application Nos. 61/648,170, filed May 17, 2012, and 61/773,701, filed Mar. 6, 2012, the disclosures of which are incorporated in their entirety by reference herein.
| Number | Date | Country | |
|---|---|---|---|
| 61648170 | May 2012 | US | |
| 61773701 | Mar 2013 | US |