A consumption experience for content such as music, video, movies, television, applications, games, etc. may be provided by a suitable computing device such as a television, personal computer, laptop, media player, mobile device, etc. It is not uncommon for a user to have more than one such device, and in some cases, two or more of the devices may be paired with one another. Further, in some consumption content scenarios, a consumption experience may have an additional supplemental experience that is related to the primary consumption experience. However, the device pairing and supplemental experience functionalities are typically separate.
According to one aspect of this disclosure, a method of enhancing consumption of digital content items using two or more computing devices is provided. The method comprises establishing a pairing between two computing devices, wherein at least one of the two computing devices provides a primary consumption experience of a digital content item, so that a secondary consumption experience can be provided via operation of at least one of the two computing devices. The method further comprises presenting, using at least one of the two computing devices, the digital content item for consumption by a user. The method further comprises performing one or more supplemental consumption functions with the other of the two computing devices.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
It is becoming increasingly common for a user to have more than one computing device for content consumption. However, traditionally, content consumption across multiple screens may either not be provided within traditional content consumption scenarios, or may be substantially ad-hoc. Therefore, it is desirable to provide a multi-screen consumption experience which enhances the overall user experience for the user.
Therefore, embodiments are disclosed herein that relate to enhanced content consumption, wherein content consumption is enhanced within an environment of two or more paired computing devices by providing a secondary consumption experience which enhances a primary consumption experience of a digital content item. Such secondary consumption experiences may include, for example, interactive supporting experiences which extend the primary consumption experience for the user and/or may not detriment the primary viewing experience for others. Further, the pairing allows for a level of fidelity of the secondary consumption experience to be determined based on capabilities learned during pairing, in some embodiments.
Computing system 100 is shown in simplified form. It is to be understood that virtually any computer architecture may be used without departing from the scope of this disclosure. In different embodiments, computing system 100 may take the form of a mainframe computer, server computer, desktop computer, laptop computer, tablet computer, home entertainment computer, network computing device, mobile computing device, mobile communication device, gaming device, etc. Further, computing system 100 may include one or more computing devices and/or server devices communicatively coupled with one another.
Computing system 100 includes a processor 102 and a data-holding subsystem 104. Computing system 100 may optionally include a display subsystem 106, communication subsystem 108, and/or other components not shown in
Computing system 100 may be configured to enhance content consumption in any suitable way, such as by executing instructions. As such, computing system 100 further includes a processor 102 which may include one or more physical devices configured to execute one or more instructions. For example, the processor may be configured to execute one or more instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more devices, or otherwise arrive at a desired result.
The processor may include one or more processors that are configured to execute software instructions. Additionally or alternatively, the processor may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions. Processors of the processor may be single core or multicore, and the programs executed thereon may be configured for parallel or distributed processing. The processor may optionally include individual components that are distributed throughout two or more devices, which may be remotely located and/or configured for coordinated processing. One or more aspects of the processor may be virtualized and executed by remotely accessible networked computing devices configured in a cloud computing configuration.
Data-holding subsystem 104 may include one or more physical, non-transitory, devices configured to hold data and/or instructions executable by the processor to implement the herein described methods and processes. When such methods and processes are implemented, the state of data-holding subsystem 104 may be transformed (e.g., to hold different data).
Data-holding subsystem 104 may include removable media and/or built-in devices. Data-holding subsystem 104 may include optical memory devices (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory devices (e.g., RAM, EPROM, EEPROM, etc.) and/or magnetic memory devices (e.g., hard disk drive, floppy disk drive, tape drive, MRAM, etc.), among others. Data-holding subsystem 104 may include devices with one or more of the following characteristics: volatile, nonvolatile, dynamic, static, read/write, read-only, random access, sequential access, location addressable, file addressable, and content addressable. In some embodiments, processor 102 and data-holding subsystem 104 may be integrated into one or more common devices, such as an application specific integrated circuit or a system on a chip.
As a nonlimiting example, data-holding subsystem 104 may hold instructions 110 executable by processor 102 for enhancing consumption of digital content items. As such, computing system 100 is configured to establish a pairing between two or more computing devices. In such a case, at least one of the computing devices provides a primary consumption experience of a digital content item. By establishing such a pairing, at least one of the two computing devices may learn capabilities of the other of the two computing devices, so that a secondary consumption experience can be provided (e.g., via operation of at least one of the devices). In some embodiments, computing system 100 may be configured to establish such a pairing via a pairing engine 112. As described in more detail below, in some embodiments a pairing may be established via a proxy server running on the Internet. As such, a service running in the cloud may know the capabilities of the two devices, but each of the two devices may not be aware of the other's capabilities. It is to be appreciated that a “service”, as used herein, may be an application program executable across multiple user sessions and available to one or more system components, programs, and/or other services. In some implementations, a service may run on a server responsive to a request from a client.
In the case that computing system 100 represents a computing device providing a primary consumption experience, computing system 100 may establish pairing with another computing device (e.g., a companion computing device). However, in the case that computing system 100 represents a companion device, computing system 100 may establish pairing with the device providing the primary consumption experience. As yet another example, computing system 100 may be an entertainment system facilitating the pairing between two other computing devices.
By establishing the pairing, at least one of the two computing devices learns capabilities of the other of the two computing devices, in some embodiments. It should be appreciated that such learning is nonlimiting. For example, in some embodiments, one of the computing devices may simply send commands to the other computing device, and the other computing device may choose to display or ignore the commands based on its capabilities. Further yet, in some embodiments, such learning may include a two-way communication wherein each device learns the capabilities of the other device. Such an intelligent pairing allows for a secondary consumption experience to then be provided via operation of at least one of the computing devices. As described in more detail herein, such secondary consumption experiences may enhance the primary consumption experience in any of a variety of possible ways, such as by providing content and/or features (e.g., context-specific displays, commands, etc.) at a companion device paired to the device providing the primary consumption experience. Further, in some embodiments, the pairing may be turned off by one or more of the computing devices.
For example, input control may be provided at the companion device for controlling aspects of the primary consumption experience. As another example, the companion device may have the capability to act as a master, and may take over control of the primary experience and/or other computing device(s). As yet another example, a deeper/richer experience may be provided at the companion device which “lights up” the primary consumption experience (e.g., by providing director's cut information, relevant information/trivia, a time-synchronized party-chat mode, etc.). As yet another example, interactions that may otherwise interfere with the primary consumption experience may be offloaded to the companion device, so as to enhance the user experience. As yet another example, two users may consume the same primary experience together, but may each have a different secondary experience on a companion device which is contextually relevant to them. It should be appreciated that these examples are illustrative and not intended to be limiting in any way.
It should also be appreciated that as used herein, the term “companion device” is used to describe at a computing device intelligently paired to another computing device which is providing a primary consumption experience, and such a companion device may provide the secondary consumption experience. However, if the capabilities of the companion device are sufficient to provide the primary consumption experience, then the companion device may additionally or alternatively provide the primary consumption experience.
Continuing with
However, for the case that computing system 100 represents an entertainment system facilitating such presentation, computing system 100 may present the digital content item to one of the two computing devices for display using one of the two computing devices.
Computing system 100 is further configured to perform one or more supplemental consumption functions with the other of the two computing devices (e.g., via a supplemental consumption function engine 116). The supplemental consumption function(s) are then implemented based on capabilities that have been learned during the pairing of the two computing devices. Performing the supplemental consumption function may establish, for example, a secondary consumption experience at a companion device.
As a nonlimiting example, a companion device may report its capabilities to the device providing the primary consumption experience, and the device providing the primary consumption experience may then send a secondary consumption experience having an appropriate level of fidelity to the companion device. However, for the case of computing system 100 being an entertainment system associated with system-level events, the system may provide the secondary consumption experience having an appropriate level of fidelity to the companion device. Performing the supplemental consumption function is described in greater detail below with reference to
It should be appreciated that the terms “module,” “program,” and “engine” may be used to describe an aspect of computing system 100 that is implemented to perform one or more particular functions. In some cases, such a module, program, or engine may be instantiated via processor 102 executing instructions held by data-holding subsystem 104. It is to be understood that different modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms “module,” “program,” and “engine” are meant to encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
When included, communication subsystem 108 may be configured to communicatively couple computing system 100 with one or more other computing devices. Such a subsystem may, for example, aid in establishing the pairing between two or more devices and/or facilitate subsequent sending/receiving of information. Communication subsystem 108 may include wired and/or wireless communication devices compatible with one or more different communication protocols, either directly or through a proxy server, for example. As nonlimiting examples, the communication subsystem may be configured for communication via a wireless telephone network, a wireless local area network, a wired local area network, a wireless wide area network, a wired wide area network, etc. In some embodiments, the communication subsystem may allow computing system 100 to send and/or receive messages to and/or from other devices via a network such as the Internet.
Turning now to
At operation 202, method 200 comprises establishing a pairing between at least two computing devices, wherein at least one of the two computing devices provides a primary consumption experience of a digital content item. It should be appreciated that the two computing devices may be any suitable devices configured to consume content. In some embodiments, at least one of the two computing devices may be a portable computing device (e.g., a mobile communication device, a tablet computer, a laptop computer, a portable media player, etc.).
The pairing may be established in any suitable manner. In some embodiments, a peer-to-peer pairing may be established directly between the two computing devices. However, in some cases, a network may be utilized to establish the pairing. The two computing devices may then remain paired via the network connection. However, in other cases, the network may be utilized to facilitate communication between the two devices and establish a peer-to-peer pairing, such that upon being paired, the two computing devices are directly paired with one another.
By establishing the pairing, at least one of the two computing devices learns capabilities of the other of the two computing devices, as indicated at operation 204. In some embodiments, one computing device may query the other computing device for its capabilities. However, in other embodiments, a computing device may provide its capabilities to the other device without being queried. The capabilities may be reported over any suitable communication protocol, such as the Internet, Bluetooth, etc. It should be appreciated that such learning is nonlimiting. In some embodiments, one of the computing devices may simply send commands to the other computing device, and the other computing device may choose to display or ignore the commands based on its capabilities. As such, a computing device need not “micro-manage” the actions of the other computing device.
The capabilities learned during intelligent pairing may include device capabilities such as processing capability, data storage capability, display capability, etc. However, in some embodiments, the capabilities may include capabilities of interaction, such as bandwidth, network availability, etc.
The capabilities are learned so that a secondary consumption experience can be provided via operation of at least one of the computing devices. Such a secondary consumption experience may be, for example, a companion experience to the primary consumption experience. The capabilities learned during the pairing may indicate a level of fidelity (e.g., an audio and/or video quality, etc.) for the secondary consumption experience.
Continuing with
At 208, method 200 includes performing a supplemental consumption function with the other of the two computing devices, wherein the supplemental consumption function is implemented based on capabilities that have been learned during the pairing of the two computing devices.
Performing the supplemental consumption function may, for example, establish the secondary consumption experience which is then provided via operation of at least one of the computing devices. As an example, a companion device, upon reporting its capabilities (e.g., to the computing device providing the primary consumption experience, to an entertainment system, etc.), may receive (e.g., from the computing device providing the primary consumption experience, from the entertainment system, etc.) a secondary consumption experience that is appropriate for the capabilities of the companion device. The secondary consumption experience may be received over any suitable communication protocol, such as the Internet, Bluetooth, etc. The secondary consumption experience may correspond to the primary consumption experience, and in some cases, may even be time-synchronized with the primary consumption experience.
As a nonlimiting example, the supplemental consumption function may be remote secondary control of one or more operations occurring in connection with the primary consumption experience. For example, the primary consumption experience may include presentation of the digital content item on a first computing device (e.g., a television), and the secondary consumption experience may include input control via a second computing device (e.g., a portable computing device). Learning capabilities for the second computing device during pairing ensures that the secondary consumption experience is configured appropriately for the second computing device. It should be appreciated that remote secondary control is not limited to traditional remote control operations such as channel and/or playback commands, volume commands, etc. and may include any suitable remote controlling operations including those aiding in content navigation and discovery. As an example, remote secondary control may include navigating menus, information, etc. on a secondary screen (e.g., to dive deeper into a topic and/or switch topics altogether). As such, the primary experience associated with the primary screen may remain uninterrupted.
As another nonlimiting example, the supplemental consumption function may include presentation of content or features. It should be appreciated that such content or features may be virtually any suitable content or features which enhance the primary consumption experience. In other words, such content or features may be in addition to, similar to, different than, etc. the content and/or features present in the primary consumption experience. Further, in some embodiments, the content or features may be a subset of the content and/or features present in the primary consumption experience, wherein the subset is configured based on the capabilities learned during pairing of the two computing devices. Accordingly, the supplemental consumption function may be an off-loading assumption of at least some functionality of the primary consumption experience to the other of the two computing devices.
As yet other examples, the supplemental consumption function may be an off-loading assumption establishing an interactive chat mode at a companion device corresponding to presentation of the digital content item; another presentation of the content item (e.g., a “director's cut” version); a layered experience wherein additional information (layers) related to content is moved to the companion device; etc.
Further, in some cases, performing the supplemental consumption function may include presentation of content or features which otherwise interfere with the primary consumption experience if within the primary consumption experience. As such, the consumption experience is enhanced for the user in that these features are moved to another device so as not to interfere with the primary consumption experience.
It should be appreciated that scenarios having more than two computing devices are fully included within the scope of this disclosure. For example, a computing device providing a primary consumption experience may be paired to multiple companion devices each providing different companion experiences. As such, the user of companion device may participate in a different enhanced experience of the primary consumption experience. Further, these different companion experiences may be contextualized to the individual consuming the secondary experience along with the primary experience.
In should be further appreciated that, in some embodiments, the capabilities learned during the pairing may indicate a capability of providing the primary consumption experience at the other of the two devices. In other words, the companion device may be a full-featured laptop, mobile communication device, etc. capable of presenting the content item, for example. In such a case, performing the supplemental consumption function may include establishing presentation of the primary consumption experience at the other of the two computing devices. Thus, the primary consumption experience may be transferred from a computing device to a companion device.
In this example, it was learned during pairing that second computing device 506 is capable of providing the primary consumption experience. Accordingly, at subsequent time t1, the primary consumption experience 500 is transferred to second computing device 506. As an example, user 508 may have left the room where first computing device 502 is located, and in response, primary consumption experience 500 is transferred to second computing device 506, allowing user 508 to continue with the primary consumption experience 500. In such a case, second computing device 506 acts as a master, and takes control of the primary consumption experience. Further, at time t2, the user may then enter yet another room with a third computing device 510, to which second computing device 506 pairs. The primary consumption experience 500 may then be transferred to third computing device 510 upon determining it has sufficient capabilities, and second computing device 506 may then provide a secondary consumption experience 512.
Turning now to
However, if pairing is established, then flow proceeds to 606, where capabilities of the other computing device are reported. As an example, a companion device may report its capabilities to a device providing the primary experience. Based on these capabilities, the device providing the primary experience may determine what level of experience (e.g., a level of fidelity of an experience) is appropriate for the companion device. The device providing the primary experience may share the primary consumption experience with the companion device (e.g., synchronously, if appropriate).
At 608, the device providing the primary experience listens for inputs. At 610, it is determined whether or not primary inputs are received at the primary listener. If so, flow proceeds to 612 where the inputs are rendered.
Upon rendering the inputs at 612, or alternatively it is determined at 610 that primary inputs are not received at the primary listener, flow proceeds to 614. At 614 it is determined whether device inputs are received at the other of the paired devices (e.g., a companion device). If it is determined that such device inputs are received, at 616 the inputs are reported (e.g., via a communication protocol) to the device providing the primary consumption experience, and flow returns to 608. However, if it is determined that such device inputs are not received, flow returns directly to 608.
It is to be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated may be performed in the sequence illustrated, in other sequences, in parallel, or in some cases omitted. Likewise, the order of the above-described processes may be changed.
The subject matter of the present disclosure includes all novel and nonobvious combinations and subcombinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
This application is a continuation of U.S. patent application Ser. No. 15/487,953 filed Apr. 14, 2017, which is a continuation of U.S. patent application Ser. No. 15/167,558, filed May 27, 2016, now U.S. Pat. No. 9,628,522, which is a continuation of U.S. patent application Ser. No. 14/550,582, filed Nov. 21, 2014, now U.S. Pat. No. 9,357,015, which is a continuation of U.S. patent application Ser. No. 12/969,148, filed on Dec. 15, 2010, now U.S. Pat. No. 8,898,310, entitled “ENHANCED CONTENT CONSUMPTION”, the entire disclosures of each of which are hereby incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
6771302 | Nimri et al. | Aug 2004 | B1 |
7035897 | Devereaux et al. | Apr 2006 | B1 |
7292588 | Milley et al. | Nov 2007 | B2 |
7450961 | Heubel et al. | Nov 2008 | B1 |
7519658 | Anglin et al. | Apr 2009 | B1 |
8359654 | Rave et al. | Jan 2013 | B2 |
8724639 | Mahmoud | May 2014 | B2 |
8738783 | Bathiche et al. | May 2014 | B2 |
8898310 | Gammill et al. | Nov 2014 | B2 |
8947199 | Lucaci et al. | Feb 2015 | B2 |
9357015 | Gammill et al. | May 2016 | B2 |
9668004 | Meuninck et al. | May 2017 | B2 |
20020091797 | Wallenius et al. | Jul 2002 | A1 |
20020194501 | Wenocur et al. | Dec 2002 | A1 |
20030041110 | Wenocur et al. | Feb 2003 | A1 |
20040203797 | Burr | Oct 2004 | A1 |
20040226041 | Smith et al. | Nov 2004 | A1 |
20050010417 | Holmes | Jan 2005 | A1 |
20050068253 | Bartels | Mar 2005 | A1 |
20050091408 | Parupudi et al. | Apr 2005 | A1 |
20060123081 | Baudino et al. | Jun 2006 | A1 |
20060232604 | Toyoda | Oct 2006 | A1 |
20060281409 | Levien et al. | Dec 2006 | A1 |
20070274233 | Ptashek et al. | Nov 2007 | A1 |
20080098450 | Wu | Apr 2008 | A1 |
20090034591 | Julian et al. | Feb 2009 | A1 |
20090240814 | Brubacher et al. | Sep 2009 | A1 |
20090319673 | Peters | Dec 2009 | A1 |
20100125735 | Zapata et al. | May 2010 | A1 |
20110119393 | Kim et al. | May 2011 | A1 |
20120075529 | Wong et al. | Mar 2012 | A1 |
Number | Date | Country |
---|---|---|
1363184 | Aug 2002 | CN |
1628450 | Jun 2005 | CN |
1798019 | Jul 2006 | CN |
Entry |
---|
“Final Office Action issued in U.S. Appl. No. 15/487,953”, dated Jan. 10, 2019, 11 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 15/487,953”, dated Jun. 10, 2019, 10 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 15/487,953” dated Aug. 15, 2018,12 Pages. |
“Sony Ericsson Introduces Bluetooth Auto-Pairing Devices”, Retrieved from <<http://www.mobiledia.com/news/37112.html>>, Sep. 28, 2005, 3 Pages. |
“Final Office Action Issued in U.S. Appl. No. 12/969,148”, dated Sep. 11, 2013, 12 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 12/969,148”, dated Jun. 8, 2012, 10 Pages. |
“Notice of Allowance Issued in U.S. Appl. No. 12/969,148”, dated Jul. 30, 2014, 10 Pages. |
“Final Office Action Issued in U.S. Appl. No. 14/550,582”, dated Nov. 4, 2015, 6 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 14/550,582”, dated May 20, 2015, 5 Pages. |
Wedlow, Tracys, “The iTV Doctor Is in!: Using the Smartphone as a TV Companion Device”, Retrieved from <<http://www.itvt.com/itv_doctor/6901/itv-doctor-using-smartphone-tv-companion-device>>, Jun. 10, 2010, 3 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 15/167,558”, dated Sep. 21, 2016, 5 Pages. |
“Notice of Allowance Issued in U.S. Appl. No. 15/167,558”, dated Dec. 14, 2016, 10 Pages. |
“Non Final Office Action Issued in U.S. Appl. No. 15/487,953”, dated Jan. 23, 2018, 12 Pages. |
“Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated May 13, 2016, 8 Pages. |
“First Office Action and Search Report Issued in Chinese Patent Application No. 201110443222.7”, dated Jul. 1, 2014, 12 Pages. |
“Fourth Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated Nov. 27, 2015, 10 Pages. |
“Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated Feb. 28, 2017, 6 Pages. |
“Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated Oct. 24, 2017, 9 Pages. |
“Second Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated Feb. 4, 2015, 8 Pages. |
“Third Office Action Issued in Chinese Patent Application No. 201110443222.7”, dated Jun. 3, 2015, 8 Pages. |
Moor, Chris, “Using your Android device as a wireless keyboard/mouse”, Retrieved from <<http://www.talkandroid.com/guides/misc/using-your-android-device-as-a-wireless-keyboardmouse/>>, Jun. 25, 2010, 14 Pages. |
“Final Office Action Issued in U.S. Appl. No. 15/487,953”, dated Oct. 7, 2019, 10 Pages. |
Number | Date | Country | |
---|---|---|---|
20180131893 A1 | May 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15487953 | Apr 2017 | US |
Child | 15865612 | US | |
Parent | 15167558 | May 2016 | US |
Child | 15487953 | US | |
Parent | 14550582 | Nov 2014 | US |
Child | 15167558 | US | |
Parent | 12969148 | Dec 2010 | US |
Child | 14550582 | US |