Patent Grant
10897491
Embodiments of the present invention relate generally to the technical fields of digital content distribution and display, and more particularly to display systems with multiple display receiver devices.
The background description provided herein is for the purpose of generally presenting the context of the disclosure. Unless otherwise indicated herein, the materials described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
A display system may include a display transmitter device and multiple display receiver devices, where the display transmitter device may provide/relay display contents, e.g., multimedia display contents such as music, movies, photos, videos, and applications, of a digital content distributor/provider to the multiple display receiver devices. Each display receiver device of the multiple display receiver devices may receive a different display content of the digital content distributor/provider, from the display transmitter device. A display system including a display transmitter device and multiple display receiver devices may be a wireless display system. Sometimes, such a display system may be a wired system where the multiple display receiver devices may be connected to the display transmitter device by wires.
Usage analytics information associated with a display content, e.g., playback count, real time streaming, may be of great value to the content distributor/provider for many reasons. For example, based on usage analytics information, the content distributor/provider may deliver more appropriate or personalized display content for each display receiver device, leading to improved user experience and in turn, potentially increased number of subscribers for contents of the content distributor/provider. However, current techniques for delivering a display content based on usage analytics information associated with the display content may be limited to cases when there is a direct one-to-one relationship between a digital content distributor/provider and a display receiver device. Current techniques for delivering display contents based on usage analytics information do not work when multiple display contents are played on multiple display receiver devices through one display transmitter device.
Embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings.
A display system may include a display transmitter device to communicate with multiple display receiver devices. Display contents may be provided by a content server through the display transmitter device to the multiple display receiver devices. Respective usage analytics information may be associated with the display contents played on the various display receiver devices. Current techniques for delivering display contents based on usage analytics information respectively associated with the display contents may not work in respectively adjusting the display contents based on the corresponding usage analytics information from the various multiple display receiver devices communicating with the content server through the display transmitter device.
For a content server, the display contents to the multiple display receiver devices may all be delivered through one display transmitter device. Hence, from the content server's perspective, the display contents may be associated with the display transmitter device, and the content server may not be able to distinguish the multiple display receiver devices. Accordingly, the content server may not be able to distinguish different usage analytics information from the multiple display receiver devices, and respectively adjust the display contents based on the corresponding multiple usage analytics information. In embodiments, usage analytics information from a display receiver device of the multiple display receiver devices may be associated with an identification information of the display receiver device. The display transmitter device may transmit the usage analytics information of the display receiver device, including the identification information of the associated display receiver device, to the content server. Therefore, the content server may be able to properly associate the usage analytic information with the corresponding display receiver device, and adjust the display content to the particular display receiver device based on the corresponding usage analytics information, identified by the identification information of the particular display receiver device.
In embodiments, a display transmitter device for provision of display content may include a communication interface and a usage analytics engine coupled to the communication interface. The communication interface may receive from a display receiver device of the multiple display receiver services the display transmitter device services, via a backchannel of a display protocol between the display transmitter device and the particular display receiver device, usage analytics information associated with the display content being displayed at the display receiver device. The display content may be from a content server and relayed to the display receiver device, by the display transmitter device. via a forward channel of the display protocol. The usage analytics engine may transmit the usage analytics information of the display receiver device, including the identification information of the display receiver device, and other parameters to the content server.
In embodiments, a display receiver device for provision of display content may include a communication interface, and a usage analytics engine coupled to the communication interface. The communication interface may receive a display content from a content server through a display transmitter device, via a forward channel of a display protocol between the display transmitter device and the display receiver device. The display receiver device may be one of a plurality of display receiver devices to communicate and receive display contents from the display transmitter device via the display protocol. The usage analytics engine may collect usage analytics information related to the display content being displayed at the display receiver device. The communication interface may further transmit the usage analytics information to the content server through the display transmitter device via a back channel of the display protocol. An identification information of the display receiver device may be transmitted along to identify the usage analytics information as being associated with the display receiver device, and distinguishes the usage analytic information of the display receiver device from usage analytic information of other ones of the plurality of display receiver devices.
In embodiments, a content server for provision of display content may include a communication interface and a presentation engine coupled to the communication interface. The communication interface may deliver a plurality of display contents to a corresponding plurality of display receiver devices via a display transmitter device. The communication interface may also receive, from the display transmitter device a plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices along with corresponding identification information of the plurality of display receiver devices. The presentation engine may selectively adjust respective ones of the plurality of display contents based on corresponding ones of the plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices.
In the description to follow, reference is made to the accompanying drawings which form a part hereof wherein like numerals designate like parts throughout, and in which is shown by way of illustration embodiments that may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of embodiments is defined by the appended claims and their equivalents.
Operations of various methods may be described as multiple discrete actions or operations in turn, in a manner that is most helpful in understanding the claimed subject matter. However, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations may not be performed in the order of presentation. Operations described may be performed in a different order than the described embodiments. Various additional operations may be performed and/or described operations may be omitted, split or combined in additional embodiments.
For the purposes of the present disclosure, the phrase “A or B” and “A and/or B” means (A), (B), or (A and B). For the purposes of the present disclosure, the phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
The description may use the phrases “in an embodiment,” or “in embodiments,” which may each refer to one or more of the same or different embodiments. Furthermore, the terms “comprising,” “including,” “having,” and the like, as used with respect to embodiments of the present disclosure, are synonymous.
As used hereinafter, including the claims, the term “unit,” “engine,” “module,” or “routine” may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Where the disclosure recites “a” or “a first” element or the equivalent thereof, such disclosure includes one or more such elements, neither requiring nor excluding two or more such elements. Further, ordinal indicators (e.g., first, second or third) for identified elements are used to distinguish between the elements, and do not indicate or imply a required or limited number of such elements, nor do they indicate a particular position or order of such elements unless otherwise specifically stated.
The terms “coupled with” and “coupled to” and the like may be used herein. “Coupled” may mean one or more of the following. “Coupled” may mean that two or more elements are in direct physical or electrical contact. However, “coupled” may also mean that two or more elements indirectly contact each other, but yet still cooperate or interact with each other, and may mean that one or more other elements are coupled or connected between the elements that are said to be coupled with each other. By way of example and not limitation, “coupled” may mean two or more elements or devices are coupled by electrical connections on a printed circuit board such as a motherboard, for example. By way of example and not limitation, “coupled” may mean two or more elements/devices cooperate and/or interact through one or more network linkages such as wired and/or wireless networks. By way of example and not limitation, a computing apparatus may include two or more computing devices “coupled” on a motherboard or by one or more network linkages.
As used herein, the term “circuitry” may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group), and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality. As used herein, “computer-implemented method” may refer to any method executed by one or more processors, a computer system having one or more processors, a mobile device such as a smartphone (which may include one or more processors), a tablet, a laptop computer, a set-top box, a gaming console, and so forth.
As used herein, the term “interface” or “interface circuitry” may refer to, is part of, or includes circuitry providing for the exchange of information between two or more components or devices. The term “interface circuitry” may refer to one or more hardware interfaces (for example, buses, input/output (I/O) interfaces, peripheral component interfaces, network interface cards, and/or the like).
Some embodiments may be used in conjunction with various devices and systems, for example, a communication system, a communication device, a wireless communication system, a wireless communication device, a wired communication device, a wired communication system, a personal computer (PC), a desktop computer, a mobile computer, a laptop computer, a notebook computer, an Ultrabook™ computer, a tablet computer, a server computer, a handheld computer, a handheld device, a Personal Digital Assistant (PDA) device, a handheld PDA device, an on-board device, an off-board device, a hybrid device, a vehicular device, a non-vehicular device, a mobile or portable device, a consumer device, a non-mobile or non-portable device, a wireless communication station, a wireless communication device, a wired or wireless modem, a video device, an audio device, an audio-video (AN) device, a wired or wireless network, a wireless area network, a wireless video area network (WVAN), a local area network (LAN), a wireless LAN (WLAN), a personal area network (PAN), a wireless PAN (WPAN), a wireless wide area network (WWAN), and the like.
Some embodiments may be used in conjunction with devices and/or networks operating in accordance with existing web real-time communication standards, IEEE 802.11 standards, wireless-gigabit-alliance (WGA) specifications, wireless fidelity (WiFi) alliance (WFA) peer-to-peer (P2P) specifications, 3rd generation partnership project (3GPP), 3GPP long term evolution (LTE), any current and/or future versions and/or derivatives thereof, and the like.
Some embodiments may be used in conjunction with one way and/or two-way radio communication systems, cellular radio-telephone communication systems, a mobile phone, a cellular telephone, a wireless telephone, a personal communication systems (PCS) device, a PDA device which incorporates a wireless communication device, a mobile or portable global positioning system (GPS) device, a device which incorporates a GPS receiver or transceiver or chip, a device which incorporates an RFID element or chip, a multiple input multiple output (MIMO) transceiver or device, a single input multiple output (SIMO) transceiver or device, a multiple input single output (MISO) transceiver or device, a device having one or more internal antennas and/or external antennas, digital video broadcast (DVB) devices or systems, multi-standard radio devices or systems, a wired or wireless handheld device, e.g., a smartphone, a wireless application protocol (WAP) device, or the like.
Some embodiments may be used in conjunction with one or more types of wireless communication signals and/or systems, for example, radio frequency (RF), infrared (IR), frequency-division multiplexing (FDM), orthogonal FDM (OFDM), time-division multiplexing (TDM), time-division multiple access (TDMA), extended TDMA (E-TDMA), general packet radio service (GPRS), extended GPRS, code-division multiple access (CDMA), wideband CDMA (WCDMA), CDMA 2000, single-carrier CDMA, multi-carrier CDMA, multi-carrier modulation, discrete multi-tone (DMT), Bluetooth®, global positioning system (GPS), Wi-Fi, Wi-Max, ZigBee™, ultra-wideband (UWB), global system for mobile communication (GSM), 2G, 2.5G, 3G, 3.5G, 4G, fifth generation (5G) mobile networks, 3GPP, long term evolution (LTE), LTE advanced, enhanced data rates for GSM evolution (EDGE), or the like. Other embodiments may be used in various other wired and/or wireless devices, systems and/or networks.
The term “wireless device,” as used herein, includes, for example, a device capable of wireless communication, a communication device capable of wireless communication, a communication station capable of wireless communication, a portable or non-portable device capable of wireless communication, or the like. In some embodiments, a wireless device may be or may include a peripheral that is integrated with a computer, or a peripheral that is attached to a computer. In some embodiments, the term “wireless device” may optionally include a wireless service.
The term “communication device”, as used herein, includes, for example, a device capable of wireless and/or wired communication, a communication device capable of wireless and/or wired communication, a communication station capable of wireless and/or wired communication, a portable or non-portable device capable of wireless and/or wired communication, or the like. In some embodiments, a communication device may be or may include a peripheral that is integrated with a computer, or a peripheral that is attached to a computer.
In embodiments, the display system 100 may include the display transmitter device 101 and multiple display receiver devices, e.g., the display receiver device 103, and the display receiver device 105, to receive respective display contents from the content server 107. The display receiver device 103 may include a display content 131, a usage analytics information 133, a communication interface 135, and a usage analytics engine 137. The display receiver device 105 may include a display content 151, a usage analytics information 153, a communication interface 155, and a usage analytics engine 157. The display transmitter device 101 may include a communication interface 111, a usage analytics engine 113, and a storage 115. The content server 107 may include a communication interface 171, a presentation engine 173, a display content 175, and a display content 177.
In embodiments, the display system 100 may include one or more display transmitter devices, each communicating with a plurality of display receiver devices. The display transmitter device 101 may be one such exemplary display transmitter device. Similarly, the display receiver device 103 and the display receiver device 105 may be two of such exemplary display receiver devices. There may be other additional components, such as a router to facilitate the communication between the one or more display transmitter devices and one or more display receiver devices, not shown.
In embodiments, for the display receiver device 103, the communication interface 135 may receive the display content 175 from the content server 107 through the display transmitter device 101, via a forward channel 102 of a display protocol between the display transmitter device 101 and the display receiver device 103. The received display content may become the display content 131. The usage analytics engine 137 may be coupled to the communication interface 135 to collect the usage analytics information 133 related to the display content 131. The communication interface 135 may transmit the usage analytics information 133 to the content server 107 through the display transmitter device 101 via a back channel 104 of the display protocol between the display transmitter device 101 and the display receiver device 103. In some embodiments, an identification information of the display receiver device 103 may be transmitted along with the usage analytics information 133, where the identification information identifies the usage analytics information 133 as being associated with the display receiver device 103. Hence, the usage analytics information 133 may be distinguished from usage analytic information of other ones of the plurality of display receiver devices. The content server 107 may adjust the display content 175 based on the usage analytics information 133 to obtain an adjusted display content, which may be delivered to the display receiver device 103. The communication interface 135 may further receive the adjusted display content from the content server 107 through the display transmitter device 101.
Similarly, in embodiments, for the display receiver device 105, the communication interface 155 may receive the display content 177 from the content server 107 through the display transmitter device 101, via a forward channel 106 of the display protocol between the display transmitter device 101 and the display receiver device 105. The received display content may become the display content 151. The usage analytics engine 157 may be coupled to the communication interface 155 to collect the usage analytics information 153 related to the display content 151. The communication interface 155 may transmit the usage analytics information 153 to the content server 107 through the display transmitter device 101 via a back channel 108 of the display protocol. In some embodiments, an identification information of the display receiver device 105 may be transmitted along with the usage analytics information 153, where the identification information is to identify the usage analytics information 153 as being associated with the display receiver device 105. Hence, the usage analytics information 153 may be distinguished from usage analytic information of other ones of the plurality of display receiver devices. The content server 107 may adjust the display content 177 based on the usage analytics information 153 to obtain an adjusted display content, which may be delivered to the display receiver device 105. The communication interface 155 may further receive the adjusted display content from the content server 107 through the display transmitter device 101.
In embodiments, the display content 175, the display content 131, the display content 177, or the display content 151, may be a multimedia content, which may be a content that may include a combination of different content forms such as text, audio, music, movies, photos, applications, graphics, images, animations, still images, video and interactive content. The display content 175, the display content 131, the display content 177, or the display content 151 may be recorded, played, displayed, and interacted with or accessed by the display receiver device 103 or the display receiver device 105, which may be an information content processing device, such as computerized and electronic devices. In some embodiments, the display receiver device 103 or the display receiver device 105 may be a selected one of a smart phone, a tablet, a wireless display, a smart television (TV), a touchscreen display, or a head-mounted display (HMD). In embodiments, the display receiver device 103 or the display receiver device 105 may include a display, which may be a selected one of a light-emitting diode (LED) display, a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), a digital light processing (DLP) display, a plasma display, an electroluminescent panel, an organic light-emitting diode (OLED) display, or an electronic paper.
In embodiments, the usage analytics information 133 may include information about the display content 131 related to a playback count, a real time streaming duration, a number of offline views, a content key rotation, a content metering, a location of the display content 131 where a pause operation is performed, or a section of the display content 131 that has been rewound, repeated, or zoomed in. The usage analytics information 133 may be a user analytics for a user of the display receiver device 103, a device analytics for the display receiver device 103, or a content analytics related to the display content 131. The usage analytics information 153 may be similar to the usage analytics information 133.
In some embodiments, when the display receiver device 103 may be a HMD in a virtual reality (VR) system, an augmented reality and merged reality system, the usage analytics information 133 may include head tracking or eye tracking data associated with a part of the display content 131. For example, when the display system 100 may be a 360 video of a basketball game, the display receiver device 103 may be a HMD for a user. The display receiver device 103 may be used to track the user's favorite player throughout the basketball game, where the tracking data may be a part of the analytics information 133. If the content server 107 encodes data such as each player's location in the 360 space for each frame, using the head position data included in the analytics information 133, the content server 107 may determine that the view of the user was centered mostly on a specific player. Hence, the content server 107 may serve more meaningful secondary contents (such as, program metadata, player statistics/bibliography, commercials, and so forth) to the display receiver device 103 so that the user of the display receiver device 103 may view more information about the favorite player (e.g., t-shirts with the player's image printed on them).
In embodiments, the forward channel 102, and the back channel 104 may be based on a display protocol, which may include some communication or computing protocols. The display protocol for the forward channel 102 and the back channel 104 may include a protocol stack containing protocols in various layers, e.g., protocols for a physical layer, a medium access layer, a network layer, and/or an application layer. For example, the display protocol for the forward channel 102 and the back channel 104 may be a wireless display protocol designed for communication between the display transmitter device 101 and the display receiver device 103. In embodiments, the wireless display protocol may be a selected one of a mobile industry processor interface display serial interface (MIPI-DSI) protocol, a Miracast protocol, or a wireless display (WiDi) protocol. In some embodiments, when wired cables are used as some of the forward channel 102 and the back channel 104, other wired display protocol, e.g., a high-definition multimedia interface (HDMI) protocol, or a display port (DP) protocol, may be used as well. For example, the display protocol may be a Miracast protocol and the back channel 104 may be a user input back channel (UIBC) of the Miracast protocol. Additionally and alternatively, the display protocol may be a HDMI protocol, and the back channel 104 may be a consumer electronics control (CEC) channel for the HDMI protocol. In embodiments, the forward channel 106, and the back channel 108 may be similar to the forward channel 102, and the back channel 104.
In embodiments, the display transmitter device 101 may include the communication interface 111, the usage analytics engine 113 coupled to the communication interface 111, and the storage 115 coupled to the communication interface 111 and the usage analytics engine 113. The display transmitter device 101 may be a wearable device, a smartphone, a computer tablet, a laptop, a game controller, a set-top box, an infotainment console, an Internet of Things (IoT) device, or others. The display transmitter device 101 may communicate with the display receiver device 103 or the display receiver device 105 using a client-server model of computing, where the display transmitter device 101 may be a server. In some other embodiments, the display transmitter device 101 and the display receiver device 103 or the display receiver device 105 may communicate using peer-to-peer model, when the display transmitter device 101 and the display receiver device 103 or the display receiver device 105 may share and consume resources in an equipotent manner. In embodiments, the display transmitter device 101 may be a master device communicating with the display receiver device 103 or the display receiver device 105, where the display receiver device 103 or the display receiver device 105 may be a slave device.
The communication interface 111 may receive the display content 175 from the content server 107, and further relay the display content 175, via the forward channel 102, to the display receiver device 103. The received display content by the display receiver device 103 may become the display content 131. The communication interface 111 may receive from the display receiver device 103, via the backchannel 104, the usage analytics information 133 associated with the display content 131. Similarly, the communication interface 111 may receive the display content 177 from the content server 107, and further relay the display content 177, via the forward channel 106, to the display receiver device 105. The received display content by the display receiver device 105 may become the display content 151. The communication interface 111 may receive from the display receiver device 105, via the backchannel 108, the usage analytics information 153 associated with the display content 151.
The usage analytics engine 113 may transmit the usage analytics information 133 of the display receiver device 103, including an identification information 139 of the display receiver device 103, to the content server 107. In addition, the usage analytics engine 113 may transmit the usage analytics information 153 of the display receiver device 105, including an identification information 159 of the display receiver device 105, to the content server 107. Furthermore, the usage analytics engine 113 may aggregate the usage analytics information 133 and the usage analytics information 153 to generate a collective usage analytics information 141 to be transmitted to the content server 107.
In embodiments, the identification information 139 of the display receiver device 103 may identify the display receiver device 103 from a plurality of other display receiver devices, e.g., the display receiver device 103, and the display receiver device 105. The identification information 159 of the display receiver device 105 may identify the display receiver device 105 from a plurality of other display receiver devices, e.g., the display receiver device 103, and the display receiver device 103. In addition, the identification information 139 and the identification information 159 may further identify a user, a content, or a location for the display receiver devices. In some embodiments, the identification information 139 of the display receiver device 103 may be sent from the display receiver device 103. In some other embodiments, the identification information 139 of the display receiver device 103 may be stored in the storage 115. The display receiver device 103 may send the usage analytics information 133 to the communication interface 111, and the usage analytics engine 113 may match the usage analytics information 133 to the identification information 139 of the display receiver device 103, and send the usage analytics information 133 along with the identification information 139 to the content server 107. Similar operations may be available for the identification information 159 of the display receiver device 105.
The content server 107 may adjust the display content 175 based on the usage analytics information 133 to obtain an adjusted display content to be delivered to the display receiver device 103. The content server 107 may adjust the display content 177 based on the usage analytics information 153 to obtain an adjusted display content to be delivered to the display receiver device 105. The communication interface 111 may receive the adjusted display content based on the display content 175 from the content server 107, and further transmit the adjusted display content to the display receiver device 103. The communication interface 111 may receive the adjusted display content based on the display content 177 from the content server 107, and further transmit the adjusted display content to the display receiver device 105.
In embodiments, the content server 107 may include the communication interface 171 to deliver a plurality of display contents to a corresponding plurality of display receiver devices via a display transmitter device. For example, the communication interface 171 may deliver the display content 175 to the display receiver device 103 via the display transmitter device 101, where the received display content may become the display content 131 in the display receiver device 103. The communication interface 171 may deliver the display content 177 to the display receiver device 105 via the display transmitter device 101, where the received display content may become the display content 151 in the display receiver device 105.
In embodiments, the communication interface 171 may receive, from the display transmitter device 101 a plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices along with corresponding identification information of the plurality of display receiver devices. For example, the communication interface 171 may receive, from the display transmitter device 101, the usage analytics information 133 of the display content 131 of the display receiver device 103 along with corresponding identification information 139 of the display receiver device 103. The communication interface 171 may receive, from the display transmitter device 101, the usage analytics information 153 of the display content 151 of the display receiver device 105 along with corresponding identification information 159 of the display receiver device 105. The communication interface 171 may also receive the collective usage analytics information 141 aggregated by the display transmitter device 101 based on the usage analytics information 133 and the usage analytics information 153.
The presentation engine 173 may be coupled to the communication interface 171 to selectively adjust respective ones of the plurality of display contents based on corresponding ones of the plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices. For example, the presentation engine 173 may selectively adjust the display content 175 based on the usage analytics information 133 of the display content 131 of the display receiver device 103, and adjust the display content 177 based on the usage analytics information 153 of the display content 151 of the display receiver device 105. Afterwards, the communication interface 171 may further deliver through the display transmitter device 101 the selectively adjusted respective ones of display contents to corresponding ones of the plurality of display receiver devices along with the corresponding identification information of the plurality of display receiver devices. For example, the communication interface 171 may further deliver through the display transmitter device 101, the adjusted display content based on the display content 175 and the usage analytics information 133 to the display receiver device 103 along with the corresponding identification information 139 of the display receiver device 103, and the adjusted display content based on the display content 177 and the usage analytics information 153 to the display receiver device 105 along with the corresponding identification information 159 of the display receiver device 105.
In embodiments, the display system 200 may include the display transmitter device 201 and the display receiver device 203 to receive display contents from the content server 207. The display receiver device 203 may include a communication interface 235 and a secure execution environment 230. The secure execution environment 230 may include a display content 231, a usage analytics information 233, a usage analytics engine 237, a secure timer 232, and an authentication unit 234. The display transmitter device 201 may include a communication interface 211 and a secure execution environment 210. The secure execution environment 210 may include a usage analytics engine 213, a storage 215, a secure timer 212, and an authentication unit 214. An identification information 239 of the display receiver device 203 may be stored in the storage 215. The content server 207 may include a communication interface 271, and a secure execution environment 270. The secure execution environment 270 may include a presentation engine 273, a display content 275, a secure timer 272, a policy management unit 274, and a license server 276.
In embodiments, the display content 275 in the content server 207 may be a premium content or a secure content managed by the policy management unit 274 subject to a digital right management (DRM) policy. The license server 276 may grant the display receiver device 203 access to the display content 275 when certain security conditions are met by the display receiver device 203. The access granted to the display receiver device 203 may have a limited time interval, which may be managed by the secure timer 272.
In embodiments, the display transmitter device 201 may include the secure execution environment 210, and the display receiver device 203 may include the secure execution environment 230 to provide secure access to the display content 275, which may be a premium content or a secure content managed by the policy management unit 274 in the content server 207. The usage analytics engine 213 within the secure execution environment 210 may operate the authentication unit 214 to authenticate the display receiver device 203 before the communication interface 235 of the display receiver device 203 is to receive the display content 275 from the content server 207 through the display transmitter device 201. Similarly, the usage analytics engine 237 within the secure execution environment 230 may operate the authentication unit 234 to authenticate the display receiver device 203 to the display transmitter device 201 before the communication interface 235 of the display receiver device 203 is to receive the display content 275 from the content server 207.
In embodiments, after the display receiver device 203 has been authenticated, the communication interface 235 may receive the display content 275 from the content server 207 through the display transmitter device 201, via a forward channel 202 of a display protocol between the display transmitter device 201 and the display receiver device 203. In some embodiments, the display content 275 from the content server 207 may pass through the display transmitter device 201 to the display receiver device 203 without transcription by the display transmitter device 201. The received display content may become the display content 231.
In embodiments, the usage analytics engine 237 may be coupled to the communication interface 235 to collect the usage analytics information 233 related to the display content 231. The communication interface 235 may transmit the usage analytics information 233 to the content server 207 through the display transmitter device 201 via a back channel 204 of the display protocol. In some embodiments, an identification information, e.g., the identification information 239, of the display receiver device 203 may be transmitted along with the usage analytics information 233, where the identification information is to identify the usage analytics information 233 as being associated with the display receiver device 203. Hence, the usage analytics information 233 may be distinguished from usage analytic information of other ones of the plurality of display receiver devices. In embodiments, the identification information of the display receiver device 203 may be valid within a time interval. The secure timer 232 may control the time interval during which the identification information of the display receiver device 203 may be valid. In some other embodiments, the communication interface 235 may only transmit the usage analytics information 233 to the display transmitter device 201, and the display transmitter device 201 may associate the usage analytics information 233 with the identification information 239 to be transmitted together to the content server 207.
The content server 207 may adjust the display content 275 by the presentation engine 273 based on the usage analytics information 233 to obtain an adjusted display content. The adjusted display content may be delivered along with the identification information 239 to the display receiver device 203. The communication interface 235 of the display receiver device 203 may further receive the adjusted display content from the content server 207 through the display transmitter device 201.
The process 300 may start at an interaction 301. During the interaction 301, a plurality of display contents may be delivered to a corresponding plurality of display receiver devices via a display transmitter device. For example, during the interaction 301, via the display transmitter device 101, the display content 175 and the display content 177 may be delivered to the display receiver device 103 and the display receiver device 105, respectively.
During an interaction 303, a plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices may be received, from a display transmitter device, along with corresponding identification information of the plurality of display receiver devices. For example, during the interaction 303, the usage analytics information 133 of the display content 131 of the display receiver device 103 may be received, from the display transmitter device 101, along with corresponding identification information 139 of the display receiver device 103. Similarly, the usage analytics information 153 of the display content 151 of the display receiver device 105 may be received, from the display transmitter device 101, along with corresponding identification information 159 of the display receiver device 105.
During an interaction 305, respective ones of the plurality of display contents may be selectively adjusted based on corresponding ones of the plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices. For example, during the interaction 305, the display content 175 may be selectively adjusted based on the usage analytics information 133 of the display content 131 of the display receiver device 103. Similarly, the display content 177 may be selectively adjusted based on the usage analytics information 153 of the display content 151 of the display receiver device 105.
The process 400 may start at an interaction 401. During the interaction 401, a display content from a content server may be relayed to a display receiver device, via a forward channel of a display protocol between a display transmitter device and the display receiver device. For example, during the interaction 401, the display content 175 from the content server 107 may be relayed to the display receiver device 103, via the forward channel 102 of a display protocol between the display transmitter device 101 and the display receiver device 103.
During an interaction 403, a usage analytics information associated with the display content may be received from the display receiver device, via a backchannel of the display protocol. For example, during the interaction 403, the usage analytics information 133 associated with the display content 131 may be received from the display receiver device 103, via the backchannel 104.
During an interaction 405, the usage analytics information of the display receiver device, including an identification information of the display receiver device, may be transmitted to the content server. For example, during the interaction 405, the usage analytics information 133 of the display receiver device 103, including the identification information 139 of the display receiver device 103, may be transmitted to the content server 107.
The process 500 may start at an interaction 501. During the interaction 501, a display content may be received from a content server through a display transmitter device, via a forward channel of a display protocol between the display transmitter device and the display receiver device, wherein the display receiver device is one of a plurality of display receiver devices to communicate and receive display contents from the display transmitter device via the display protocol. For example, during the interaction 501, the display content 131 may be received from the content server 107 through the display transmitter device 101, via the forward channel 102, where the display receiver device 103 is one of a plurality of display receiver devices, e.g., the display receiver device 103 and the display receiver device 105, to communicate and receive display contents from the display transmitter device 101 via the display protocol.
During an interaction 503, usage analytics information related to the display content may be collected. For example, during the interaction 503, the usage analytics information 133 related to the display content 131 may be collected.
During an interaction 505, the usage analytics information may be transmitted to the content server through the display transmitter device via a back channel of the display protocol, along with an identification information of the display receiver device to identify the usage analytics information as being associated with the display receiver device, and distinguish the usage analytic information of the display receiver device from usage analytic information of other ones of the plurality of display receiver devices. For example, during the interaction 505, the usage analytics information 133 may be transmitted to the content server 107 through the display transmitter device 101 via the back channel 104, along with the identification information 139 of the display receiver device 103 to identify the usage analytics information 133 as being associated with the display receiver device 103, and distinguish the usage analytic information of the display receiver device from usage analytic information of other ones of the plurality of display receiver devices. [As described earlier, on receipt of the usage analytics information of the display receiver device, the content server may adjust the display content accordingly.]
Each of these elements may perform its conventional functions known in the art. In particular, system memory 604 may be employed to store a working copy and a permanent copy of the programming instructions implementing the operations associated with software implementations of components associated with the earlier described respective adjusting of display contents based on corresponding usage analytics information from multiple display receiver devices of a display transmitter device, as described in connection with
The various elements may be implemented by assembler instructions supported by processor(s) 602 or high-level languages, such as, for example, C, that can be compiled into such instructions. Operations associated with safety operations and configuration of safety operations not implemented in software may be implemented in hardware, e.g., via hardware accelerator 603.
The number, capability and/or capacity of these elements 601-622 may vary, depending on the number of other devices the device 600 is configured to support. Otherwise, the constitutions of elements 601-622 are known, and accordingly will not be further described.
As will be appreciated by one skilled in the art, the present disclosure may be embodied as methods or computer program products. Accordingly, the present disclosure, in addition to being embodied in hardware as earlier described, may take the form of an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to as a “circuit,” “module,” or “system.”
Furthermore, the present disclosure may take the form of a computer program product embodied in any tangible or non-transitory medium of expression having computer-usable program code embodied in the medium.
In alternate embodiments, programming instructions 704 may be disposed on multiple computer-readable non-transitory storage media 702 instead. In alternate embodiments, programming instructions 704 may be disposed on computer-readable transitory storage media 702, such as, signals. Any combination of one or more computer usable or computer readable medium(s) may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
Computer program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Embodiments may be implemented as a computer process, a computing system or as an article of manufacture such as a computer program product of computer readable media. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program instructions for executing a computer process.
The corresponding structures, material, acts, and equivalents of all means or steps plus function elements in the claims below are intended to include any structure, material or act for performing the function in combination with other claimed elements are specifically claimed. The description of the present disclosure has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the disclosure in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill without departing from the scope and spirit of the disclosure. The embodiment are chosen and described in order to best explain the principles of the disclosure and the practical application, and to enable others of ordinary skill in the art to understand the disclosure for embodiments with various modifications as are suited to the particular use contemplated.
The IoT is a concept in which a large number of computing devices are interconnected to each other and to the Internet to provide functionality and data acquisition at very low levels. As used herein, an IoT device may include a semiautonomous device performing a function, such as sensing or control, among others, in communication with other IoT devices and a wider network, such as the Internet. Often, IoT devices are limited in memory, size, or functionality, allowing larger numbers to be deployed for a similar cost to smaller numbers of larger devices. However, an IoT device may be a smart phone, laptop, tablet, or PC, or other larger device. Further, an IoT device may be a virtual device, such as an application on a smart phone or other computing device. IoT devices may include IoT gateways, used to couple IoT devices to other IoT devices and to cloud applications, for data storage, process control, and the like.
Networks of IoT devices may include commercial and home automation devices, such as water distribution systems, electric power distribution systems, pipeline control systems, plant control systems, light switches, thermostats, locks, cameras, alarms, motion sensors, and the like. The IoT devices may be accessible through remote computers, servers, and other systems, for example, to control systems or access data.
The future growth of the Internet may include very large numbers of IoT devices. Accordingly, as described herein, a number of innovations for the future Internet address the need for all these layers to grow unhindered, to discover and make accessible connected resources, and to support the ability to hide and compartmentalize connected resources. Any number of network protocols and communications standards may be used, wherein each protocol and standard is designed to address specific objectives. Further, the protocols are part of the fabric supporting human accessible services that operate regardless of location, time or space. The innovations include service delivery and associated infrastructure, such as hardware and software. The services may be provided in accordance with the Quality of Service (QoS) terms specified in service level and service delivery agreements. The use of IoT devices and networks present a number of new challenges in a heterogeneous network of connectivity comprising a combination of wired and wireless technologies as depicted in
In
The fiber backbone 806 may couple lower levels of service providers to the Internet, such as tier 3 providers 824. A tier 3 provider 824 may be considered a general Internet service provider (ISP), for example, purchasing access to the fiber backbone 810 from a tier 2 provider 810 and providing access to a corporate GW 826 and other customers. From the corporate GW 826, a wireless local area network (WLAN) can be used to communicate with IoT devices 804 through Wi-Fi® links 828. A Wi-Fi link 828 may also be used to couple to a low power wide area (LPWA) GW 830, which can communicate with IoT devices 804 over LPWA links 832, for example, compatible with the LoRaWan specification promulgated by the LoRa alliance.
The tier 3 provider 824 may also provide access to a mesh network 834 through a coordinator device 836 that communicates with the tier 3 provider 824 using any number of communications links, such as an LTE cellular link, an LPWA link, or a link 838 based on the IEEE 802.15.4 standard, such as Zigbee®. Other coordinator devices 836 may provide a chain of links that forms cluster tree of linked devices.
IoT devices 804 may be any object, device, sensor, or “thing” that is embedded with hardware and/or software components that enable the object, device, sensor, or “thing” capable of capturing and/or recording data associated with an event, and capable of communicating such data with one or more other devices over a network with little or no user intervention. For instance, in various embodiments, IoT devices 804 may be abiotic devices such as autonomous sensors, gauges, meters, image capture devices, microphones, machine-type communications (MTC) devices, machine-to-machine (M2M) devices, light emitting devices, audio emitting devices, audio and/or video playback devices, electro-mechanical devices (e.g., switch, actuator, etc.), and the like. In some embodiments, IoT devices 804 may be biotic devices such as monitoring implants, biosensors, biochips, and the like. In other embodiments, an IoT device 804 may be a computer device that is embedded in a computer system and coupled with communications circuitry of the computer system. In such embodiments, the IoT device 804 may be a system on chip (SoC), a universal integrated circuitry card (UICC), an embedded UICC (eUICC), and the like, and the computer system may be a mobile station (e.g., a smartphone) or user equipment, laptop PC, wearable device (e.g., a smart watch, fitness tracker, etc.), “smart” appliance (e.g., a television, refrigerator, a security system, etc.), and the like.
Each of the IoT devices 804 may include one or more memory devices and one or more processors to capture and store/record data. Each of the IoT devices 804 may include appropriate communications circuitry (e.g., transceiver(s), modem, antenna elements, etc.) to communicate (e.g., transmit and receive) captured and stored/recorded data. Further, each IoT device 804 may include other transceivers for communications using additional protocols and frequencies. According to various embodiments, the IoT devices 804 may be equipped with information (e.g., referred to as “modem profiles” herein) to configure configurable communications circuitry to perform communications in a corresponding communications. This may allow the IoT devices 804 to communicate using multiple wireless communications protocols without requiring an IoT device 804 to include separate hardware communications modules for each wireless communications protocol. The wireless communications protocols may be any suitable set of standardized rules or instructions implemented by the IoT devices 804 to communicate with other devices, including instructions for packetizing/depacketizing data, instructions for modulating/demodulating signals, instructions for implementation of protocols stacks, and the like. For example, IoT devices 804 may include communications circuitry that is configurable to communicate in accordance with one or more person-to-person (P2P) or personal area network (PAN) protocols (e.g., IEEE 802.15.4 based protocols including ZigBee, IPv6 over Low power Wireless Personal Area Networks (6LoWPAN), WirelessHART, MiWi, Thread, etc.; WiFi-direct; Bluetooth/BLE protocols; ANT protocols; Z-Wave; LTE D2D or ProSe; UPnP; and the like); configurable to communicate using one or more LAN and/or WLAN protocols (e.g., Wi-Fi-based protocols or IEEE 802.11 protocols, such as IEEE 802.16 protocols); one or more cellular communications protocols (e.g., LTE/LTE-A, UMTS, GSM, EDGE, Wi-MAX, etc.); and the like. In embodiments, one or more of tower 812, GW 820, 826, and 830, coordinator device 836, and so forth, may also be incorporated with the embodiments described herein, in particular, with references to
The technologies and networks may enable the exponential growth of devices and networks. As the technologies grow, the network may be developed for self-management, functional evolution, and collaboration, without needing direct human intervention. Thus, the technologies will enable networks to function without centralized controlled systems. The technologies described herein may automate the network management and operation functions beyond current capabilities.
The network topology 900 may include any number of types of IoT networks, such as a mesh network 906 using BLE links 822. Other IoT networks that may be present include a WLAN network 908, a cellular network 910, and an LPWA network 912. Each of these IoT networks may provide opportunities for new developments, as described herein. For example, communications between IoT devices 804, such as over the backbone links 902, may be protected by a decentralized system for authentication, authorization, and accounting (AAA). In a decentralized AAA system, distributed payment, credit, audit, authorization, and authentication systems may be implemented across interconnected heterogeneous infrastructure. This allows systems and networks to move towards autonomous operations.
In these types of autonomous operations, machines may contract for human resources and negotiate partnerships with other machine networks. This may allow the achievement of mutual objectives and balanced service delivery against outlined, planned service level agreements as well as achieve solutions that provide metering, measurements and traceability and trackability. The creation of new supply chain structures and methods may enable a multitude of services to be created, mined for value, and collapsed without any human involvement.
The IoT networks may be further enhanced by the integration of sensing technologies, such as sound, light, electronic traffic, facial and pattern recognition, smell, vibration, into the autonomous organizations. The integration of sensory systems may allow systematic and autonomous communication and coordination of service delivery against contractual service objectives, orchestration and quality of service (QoS) based swarming and fusion of resources.
The mesh network 906 may be enhanced by systems that perform inline data-to-information transforms. For example, self-forming chains of processing resources comprising a multi-link network may distribute the transformation of raw data to information in an efficient manner, and the ability to differentiate between assets and resources and the associated management of each. Furthermore, the proper components of infrastructure and resource based trust and service indices may be inserted to improve the data integrity, quality, assurance and deliver a metric of data confidence.
The WLAN network 908 may use systems that perform standards conversion to provide multi-standard connectivity, enabling IoT devices 804 using different protocols to communicate. Further systems may provide seamless interconnectivity across a multi-standard infrastructure comprising visible Internet resources and hidden Internet resources.
Communications in the cellular network 910 may be enhanced by systems that offload data, extend communications to more remote devices, or both. The LPWA network 912 may include systems that perform non-Internet protocol (IP) to IP interconnections, addressing, and routing.
The IoT devices in
The IoT group 1006, or other subgroups, may be in communication with the cloud 1002 through wireless links 1008, such as LPWA links, and the like. Further, a wired or wireless sub-network 1012 may allow the IoT devices to communicate with each other, such as through a local area network, a wireless local area network, and the like. The IoT devices may use another device, such as a GW 1010 to communicate with the cloud 1002. Other groups of IoT devices may include remote weather stations 1014, local information terminals 1016, alarm systems 1018, automated teller machines 1020, alarm panels 1022, or moving vehicles, such as emergency vehicles 1024 or other vehicles 1026, among many others. Each of these IoT devices may be in communication with other IoT devices, with servers 1004, or both.
As can be seen from
In another example, the IoT group 1006 may be an industrial control group (also referred to as a “connected factory”, an “industry 4.0” group, and the like) where the IoT devices in the IoT group 1006 may include machines or appliances with embedded IoT devices, radiofrequency identification (RFID) readers, cameras, client computer devices within a manufacturing plant, and the like, to provide production control, self-optimized or decentralized task management services, analytics services, etc. for a particular manufacturer or factory operator. In this example, the IoT group 1006 may communicate with the servers 1004 via GW 1010 and cloud 1002 to provide captured data, which may be used to provide performance monitoring and analytics to the manufacturer or factory operator. Additionally, the IoT devices in the IoT group 1006 may communicate among each other, and/or with other IoT devices of other IoT groups, to make decisions on their own and to perform their tasks as autonomously as possible.
Clusters of IoT devices, such as the IoT groups depicted by
Data may be captured, stored/recorded, and communicated among the IoT devices 1104. Analysis of the traffic flow and control schemes may be implemented by aggregators 1106 that are in communication with the IoT devices 1104 and each other through a mesh network. Data may be uploaded to the cloud 1002, and commands received from the cloud 1002, through GWs 1010 that are in communication with the IoT devices 1104 and the aggregators 1106 through the mesh network. Similar to
Any number of communications links may be used in the fog device 1102. Shorter-range links 1108, for example, compatible with IEEE 802.15.4 may provide local communications between IoT devices that are proximate to one another or other devices. Longer-range links 1110, for example, compatible with LPWA standards, may provide communications between the IoT devices and the GWs 1010. To simplify the diagram, not every communications link 1108 or 1110 is labeled with a reference number.
The fog device 1102 may be considered to be a massively interconnected network wherein a number of IoT devices are in communications with each other, for example, by the communication links 1108 and 1110. The network may be established using the open interconnect consortium (OIC) standard specification 1.0 released by the Open Connectivity Foundation™ (OCF) on Dec. 23, 2015. This standard allows devices to discover each other and establish communications for interconnects. Other interconnection protocols may also be used, including, for example, the AllJoyn protocol from the AllSeen alliance, the optimized link state routing (OLSR) Protocol, or the better approach to mobile ad-hoc networking (B.A.T.M.A.N), among many others.
Communications from any IoT device may be passed along the most convenient path between any of the IoT devices to reach the GWs 1010. In these networks, the number of interconnections may provide substantial redundancy, allowing communications to be maintained, even with the loss of a number of IoT devices.
Not all of the IoT devices may be permanent members of the fog device 1102. In the example in the drawing 1100, three transient IoT devices have joined the fog device 1102, a first mobile device 1112, a second mobile device 1114, and a third mobile device 1116. The fog device 1102 may be presented to clients in the cloud 1002, such as the server 1004, as a single device located at the edge of the cloud 1002. In this example, the control communications to specific resources in the fog device 1102 may occur without identifying any specific IoT device 1104 within the fog device 1102. Accordingly, if any IoT device 1104 fails, other IoT devices 1104 may be able to discover and control a resource. For example, the IoT devices 1104 may be wired so as to allow any one of the IoT devices 1104 to control measurements, inputs, outputs, etc., for the other IoT devices 1104. The aggregators 1106 may also provide redundancy in the control of the IoT devices 1104 and other functions of the fog device 1102.
In some examples, the IoT devices may be configured using an imperative programming style, e.g., with each IoT device having a specific function and communication partners. However, the IoT devices forming the fog device 1102 may be configured in a declarative programming style, allowing the IoT devices to reconfigure their operations and communications, such as to determine needed resources in response to conditions, queries, and device failures. This may be performed as transient IoT devices, such as the devices 1112, 1114, 1116, join the fog device 1102. As transient or mobile IoT devices enter or leave the fog 1102, the fog device 1102 may reconfigure itself to include those devices. This may be performed by forming a temporary group of the devices 1112 and 1114 and the third mobile device 1116 to control or otherwise communicate with the IoT devices 1104. If one or both of the devices 1112, 1114 are autonomous, the temporary group may provide instructions to the devices 1112, 1114. As the transient devices 1112, 1114, and 1116, leave the vicinity of the fog device 1102, it may reconfigure itself to eliminate those IoT devices from the network. The fog device 1102 may also divide itself into functional units, such as the IoT devices 1104 and other IoT devices proximate to a particular area or geographic feature, or other IoT devices that perform a particular function. This type of combination may enable the formation of larger IoT constructs using resources from the fog device 1102.
As illustrated by the fog device 1102, the organic evolution of IoT networks is central to maximizing the utility, availability and resiliency of IoT implementations. Further, the example indicates the usefulness of strategies for improving trust and therefore security. The local identification of devices may be important in implementations, as the decentralization of identity ensures a central authority cannot be exploited to allow impersonation of objects that may exist within the IoT networks. Further, local identification lowers communication overhead and latency.
Thus various example embodiments of the present disclosure have been described including, but are not limited to:
Example 1 may include a display transmitter device for provision of display content, comprising: a communication interface to receive from a display receiver device, via a backchannel of a display protocol between the display transmitter device and the display receiver device, usage analytics information associated with a display content relayed from a content server to the display receiver device, via a forward channel of the display protocol; and a usage analytics engine coupled to the communication interface to transmit the usage analytics information of the display receiver device, including an identification information of the display receiver device, to the content server.
Example 2 may include the display transmitter device of example 1 and/or some other examples herein, wherein the identification information of the display receiver device identifies the display receiver device from a plurality of other display receiver devices through corresponding forward channels of the display protocol with the respective plurality of other display receiver devices.
Example 3 may include the display transmitter device of any one of examples 1-2 and/or some other examples herein, further comprising: a storage coupled to the communication interface and the usage analytics engine to store the identification information of the display receiver device.
Example 4 may include the display transmitter device of any one of examples 1-2 and/or some other examples herein, wherein the communication interface is further to: receive an adjusted display content from the content server to be delivered to the display receiver device, wherein the adjusted display content is adjusted from the display content based on the usage analytics information; and transmit the adjusted display content to the display receiver device.
Example 5 may include the display transmitter device of any one of examples 1-2 and/or some other examples herein, further comprising: a secure execution environment, wherein the usage analytics engine is to operate within the secure execution environment, and the identification information of the display receiver device is valid within a time interval.
Example 6 may include the display transmitter device of example 5 and/or some other examples herein, wherein the display content is from the content server passing through the display transmitter device to the display receiver device without transcription by the display transmitter device.
Example 7 may include the display transmitter device of any one of examples 1-2 and/or some other examples herein, wherein the usage analytics information is a first usage analytics information, the display receiver device is a first display receiver device, and the communication interface is to receive from a second display receiver device a second usage analytics information associated with a second display content relayed from the content server to the second display receiver device; and the usage analytics engine is to transmit the second usage analytics information of the second display receiver device, including a second identification information of the second display receiver device, to the content server.
Example 8 may include the display transmitter device of example 7 and/or some other examples herein, wherein the usage analytics engine is further to aggregate the first usage analytics information and the second usage analytics information to be transmitted to the content server.
Example 9 may include a display receiver device for provision of display content, comprising: a communication interface to receive a display content from a content server through a display transmitter device, via a front channel of a display protocol between the display transmitter device and the display receiver device, wherein the display receiver device is one of a plurality of display receiver devices to communicate and receive display contents from the display transmitter device via the display protocol; a usage analytics engine coupled to the communication interface to collect usage analytics information related to the display content; wherein the communication interface is to transmit the usage analytics information to the content server through the display transmitter device via a back channel of the display protocol, along with an identification information of the display receiver device to identify the usage analytics information as being associated with the display receiver device, and distinguish the usage analytic information of the display receiver device from usage analytic information of other ones of the plurality of display receiver devices.
Example 10 may include the display receiver device of example 9 and/or some other examples herein, wherein the communication interface is further to receive an adjusted display content from the content server through the display transmitter device, wherein the adjusted display content is adjusted from the display content based on the usage analytics information.
Example 11 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the display protocol is a selected one of a mobile industry processor interface display serial interface (MIPI-DSI) protocol, a high-definition multimedia interface (HDMI) protocol, a display port (DP) protocol, a Miracast protocol, or a wireless display (WiDi) protocol.
Example 12 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the display protocol is a Miracast protocol and the back channel is a user input back channel (UIBC) of the Miracast protocol, or the display protocol is a high-definition multimedia interface (HDMI) protocol, and the back channel is a consumer electronics control (CEC) channel for the HDMI protocol.
Example 13 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the display receiver device is a selected one of a smart phone, a tablet, a wireless display, a smart television (TV), a touchscreen display, or a head-mounted display (HMD).
Example 14 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the usage analytics information includes information about the display content related to a playback count, a real time streaming duration, a number of offline views, a content key rotation, a content metering, a location of the display content where a pause operation is performed, or a section of the display content that has been rewound, repeated, or zoomed in.
Example 15 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the display receiver device is a head-mounted display (HMD) in a virtual reality (VR) system, and the usage analytics information comprises head tracking or eye tracking data associated with a part of the display content.
Example 16 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, wherein the usage analytics information includes a user analytics for a user of the display receiver device, a device analytics for the display receiver device, or a content analytics related to the display content.
Example 17 may include the display receiver device of any one of examples 9-10 and/or some other examples herein, further comprising: a secure execution environment, wherein the usage analytics engine is to operate within the secure execution environment, and the identification information of the display receiver device is valid within a time interval.
Example 18 may include the display receiver device of example 17 and/or some other examples herein, wherein the usage analytics engine is to operate within the secure execution environment to authenticate the display receiver device before the communication interface is to receive the display content from the content server through the display transmitter device.
Example 19 may include the display receiver device of example 17 and/or some other examples herein, wherein the secure execution environment further includes a secure timer to control the time interval during which the identification information of the display receiver device is valid.
Example 20 may include the display receiver device of example 17 and/or some other examples herein, wherein the display content is a secure content subject to a digital right management (DRM) policy.
Example 21 may include a content server for provision of display content, comprising: a communication interface to deliver a plurality of display contents to a corresponding plurality of display receiver devices via a display transmitter device, and to receive, from the display transmitter device a plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices along with corresponding identification information of the plurality of display receiver devices; and a presentation engine coupled to the communication interface to selectively adjust the plurality of display contents based on the plurality of usage analytics information of the plurality of display contents of the plurality of display receiver devices.
Example 22 may include the content server of example 21 and/or some other examples herein, wherein the communication interface is further to deliver through the display transmitter device the selectively adjusted display contents to the plurality of display receiver devices along with the corresponding identification information of the plurality of display receiver devices.
Example 23 may include the content server of any one of examples 21-22 and/or some other examples herein, wherein the plurality of usage analytics information include usage analytics information aggregated by the display transmitter device based on usage analytics information of the plurality of display contents of the plurality of display receiver devices.
Example 24 may include the content server of any one of examples 21-22 and/or some other examples herein, wherein a usage analytics information of the plurality of usage analytics information includes information about a display content of the plurality of display contents related to a playback count, a real time streaming duration, a number of offline views, a content key rotation, a content metering, a location of the display content where a pause operation is performed, or a section of the display content that has been rewound, repeated, or zoomed in.
Example 25 may include the content server of any one of examples 21-22 and/or some other examples herein, further comprising: a secure execution environment, wherein the presentation engine is to operate within the secure execution environment, and the identification information of the plurality of display receiver devices are valid within a time interval.
Example 26 may include a method for provision of display content, comprising: receiving from a display receiver device, via a backchannel of a display protocol between a display transmitter device and the display receiver device, usage analytics information associated with a display content relayed from a content server to the display receiver device, via a forward channel of the display protocol; and transmitting the usage analytics information of the display receiver device, including an identification information of the display receiver device, to the content server.
Example 27 may include the method of example 26 and/or some other examples herein, wherein the identification information of the display receiver device identifies the display receiver device from a plurality of other display receiver devices through corresponding forward channels of the display protocol with the respective plurality of other display receiver devices.
Example 28 may include the method of any one of examples 26-27 and/or some other examples herein, further comprising: storing the identification information of the display receiver device.
Example 29 may include the method of any one of examples 26-27 and/or some other examples herein, further comprising: receiving an adjusted display content from the content server to be delivered to the display receiver device, wherein the adjusted display content is adjusted from the display content based on the usage analytics information; and transmitting the adjusted display content to the display receiver device.
Example 30 may include the method of any one of examples 26-27 and/or some other examples herein, wherein the receiving the usage analytics information and the transmitting the usage analytics information of the display receiver device are to be operated within a secure execution environment, and the identification information of the display receiver device is valid within a time interval.
Example 31 may include the method of example 30 and/or some other examples herein, wherein the display content is from the content server passing through the display transmitter device to the display receiver device without transcription by the display transmitter device.
Example 32 may include one or more computer-readable media having instructions for provision of display content, upon execution of the instructions by one or more processors, to perform the method of any one of examples 26-31.
Example 33 may include an apparatus for provision of display content, comprising: means for receiving from a display receiver device, via a backchannel of a display protocol between a display transmitter device and the display receiver device, usage analytics information associated with a display content relayed from a content server to the display receiver device, via a forward channel of the display protocol; and means for transmitting the usage analytics information of the display receiver device, including an identification information of the display receiver device, to the content server.
Example 34 may include the apparatus of example 33 and/or some other examples herein, wherein the identification information of the display receiver device identifies the display receiver device from a plurality of other display receiver devices through corresponding forward channels of the display protocol with the respective plurality of other display receiver devices.
Example 35 may include the apparatus of any one of examples 33-34 and/or some other examples herein, further comprising: means for storing the identification information of the display receiver device.
Example 36 may include the apparatus of any one of examples 33-34 and/or some other examples herein, further comprising: means for receiving an adjusted display content from the content server to be delivered to the display receiver device, wherein the adjusted display content is adjusted from the display content based on the usage analytics information; and means for transmitting the adjusted display content to the display receiver device.
Example 37 may include the apparatus of any one of examples 33-34 and/or some other examples herein, wherein the means for receiving the usage analytics information and the means for transmitting the usage analytics information of the display receiver device include a secure execution environment, and the identification information of the display receiver device is valid within a time interval.
Example 38 may include the apparatus of example 37 and/or some other examples herein, wherein the display content is from the content server passing through the display transmitter device to the display receiver device without transcription by the display transmitter device.
Although certain embodiments have been illustrated and described herein for purposes of description this application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that embodiments described herein be limited only by the claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 9230212 | Su | Jan 2016 | B2 |
| 20070030393 | Lee | Feb 2007 | A1 |
| 20070169149 | Jennings | Jul 2007 | A1 |
| 20080109888 | Ullah | May 2008 | A1 |
| 20120240144 | Rose | Sep 2012 | A1 |
| 20130080194 | Im | Mar 2013 | A1 |
| 20130238702 | Sheth | Sep 2013 | A1 |
| 20140047072 | Shuster | Feb 2014 | A1 |
| 20140365611 | Praveenkumar | Dec 2014 | A1 |
| 20150066583 | Liu | Mar 2015 | A1 |
| 20160261905 | Aruga | Sep 2016 | A1 |
| 20160337689 | Yoshimura | Nov 2016 | A1 |
| Entry |
|---|
| Rajneesh Chowdhury et al., “Provision of Secure Content to a Display Receiver Device Without Transcription”, U.S. Appl. No. 15/640,025, filed Jun. 30, 2017, 53 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20190044989 A1 | Feb 2019 | US |
