Media-object binding for predicting performance in a media

Information

  • Patent Grant
  • 12239909
  • Patent Number
    12,239,909
  • Date Filed
    Monday, February 27, 2023
    2 years ago
  • Date Issued
    Tuesday, March 4, 2025
    4 months ago
Abstract
A system and method for media-object binding and predicting performance in a media is provided. One or more sets of object data may be associated with the media. One or more media-object bindings between the one or more sets of object data and the media may be formed and stored in one or more databases. The one or more sets of object data may include data about an object displayed during at least the portion of the media. One or more object-object associations between the one or more sets of object data and other stored object data may be formed and stored the one or more databases. The one or more object-object associations may form one or more object aggregations. A determination may for made regarding if any of the one or more object aggregations meet or pass a threshold.
Description
BACKGROUND
Technical Field

The present technology pertains to prediction in a media. More specifically, the present technology may provide for predicting performance and measuring performance acceleration or velocity of media using media-object binding.


Background

Gaming media is an increasingly popular and growing information source for game players. Such gaming media (e.g., from a game publisher or game-related content created by peer players) may incentivize further gameplay, promote new features of a game or a new game, or provide gameplay help. Presently available gaming media may include media or live-streaming media broadcasted to one or more viewers (e.g., live-streaming media), which may feature another player broadcasting their gameplay in a live-streaming media. Viewers may have a particular interest in find exciting content in streaming media with live-broadcast gameplay wherein the player is about to accomplish a record-breaking feat or some exciting accomplishment. However, more often than not, viewers end up finding such recorded content after the fact because there was no method of predicting performance in media.


There is, therefore, a need in the art for systems and methods for predicting performance and measure performance acceleration of media.


SUMMARY

Aspects of the present disclosure include systems and methods for media-object binding and predicting performance in a media. One or more sets of object data may be associated with the media and may further be stored in memory. The media (e.g., user-generated content or publisher content) may depict an object. The media may be a live-streaming media. The media may have a length of time. The one or more sets of object data may include information about an associated aspect displayed in the media, which may be associated with other objects associated with a common activity displayed in the media. The one or more sets of object data may include at least one timestamp corresponding to time within the media. The one or more sets of object data may include data about an object type, object information, such as changes available for activities, whether activities started or ended, activities most recently started, location change of a user, actor (e.g., an entity with behavior in the game, user-controlled or game-controlled) information, and mechanic (e.g., objects and abilities that impact gameplay) information.


The one or more sets of object data may be associated with a media. One or more associations between the one or more sets of object data and the media may be formed and stored in memory, such as one or more databases. Each set of object data may include data about an associated object displayed during at least a portion of the media. One or more media-object bindings between the one or more sets of object data and the media may be formed and stored in one or more databases. One or more object-object associations between the one or more sets of object data and other stored data may be formed and stored in the one or more databases. The one or more object-object associations may form one or more object aggregations. Then, a determination of whether or not any of the one or more object aggregations met or passed a threshold may be made. When the set threshold is met or passed, the media may suggest to an associated user to stream the media in real-time if the media is not a live-streaming media.


Various aspects of the present disclosure may include methods for media-activity binding and predicting performance in a media. Such methods may include as associating one or more sets of activity data with the media, wherein the one or more sets of object data comprises data about an object displayed during in at least a portion of the media. Such methods may include forming and storing one or more media-object bindings between the one or more sets of object data and the media in one or more databases. Such methods may include forming and storing one or more object-object associations between the one or more sets of object data and other stored object data in the one or more databases, wherein object-object associations form one or more object aggregations. Such methods may include determining if any of the one or more object aggregations meet or pass a threshold.


Additional aspects of the present disclosure may include systems for media-object binding and predicting performance in a media. Such systems may include memory that stores media, one or more sets of object data, and associates between the media and the one or more sets of object data. Each set of object data may include data about an aspect displayed during at least a portion of the media. Such system may include one or more processors that executes instructions stored in memory. Execution of the instructions by the one or more processors may associate one or more sets of object data with at least a portion of the media. Execution of the instructions by the one or more processors may form and store one or more media-object bindings between the one or more sets of object data and the media in one or more databases. Execution of the instructions by the one or more processors may form and store one or more object-object associations between the one or more sets of object data and other stored data in the one or more databases. The one or more object-object associations may form one or more object aggregations. Execution of the instructions by the one or more processors may determine if any of the one or more object aggregations meets or passes a threshold.


Further aspects of the present disclosure include non-transitory computer-readable medium or storage media having embodied thereon a program executable by a processor to provide a method for predicting performance in a media.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 illustrates an example network environment in which a system for predicting performance and measuring performance acceleration or velocity in a media using media-object binding may be implemented, according to an aspect of the present disclosure;



FIG. 2A illustrates a detailed example network in which a system for binding data from a universal data system to user generated content may be implemented, according to an aspect of the present disclosure;



FIG. 2B illustrates an example table of various objects and associated events, according to an aspect of the present disclosure;



FIG. 3 illustrates a flowchart of an example method for predicting performance in a media, according to an aspect of the present disclosure; and



FIG. 4 illustrates an example electronic entertainment system that may be used in predicting performance and measuring performance acceleration or velocity in a media using media-object binding, according to an aspect of the present disclosure.





DETAILED DESCRIPTION

The detailed description set forth below is intended as a description of various configurations of the subject technology and is not intended to represent the only configurations in which the technology can be practiced. The appended drawings are incorporated herein and constitute a part of the detailed description. The detailed description includes specific details for the purpose of providing a more thorough understanding of the technology. However, it will be clear and apparent that the technology is not limited to the specific details set forth herein and may be practiced without these details. In some instances, structures and components are shown in block diagram form in order to avoid obscuring the concepts of the subject technology.


Aspects of the present disclosure include systems and methods for predicting performance and measuring performance acceleration or velocity in a media using media-object binding (e.g., providing list results for streaming media displaying a shared object). A media and one or more sets of object data associated with the media may be stored in memory. The one or more sets of object data may be associated with the media. One or more media-object bindings between the one or more sets of object data and the portion of the streaming media may be stored in memory. Each set of object data may include data about an aspect displayed during at least the portion of the streaming media. The media-object bindings between the one or more sets of object data and the media may be formed in one or more databases. One or more object-object associations between the one or more sets of object data and other stored object data maybe formed and stored in the one or more database. The one or more object associations may form one or more object aggregations. Then a determination if any object aggregation meets or passes a threshold may be made.



FIG. 1 illustrates an exemplary network environment 100 in which a system for predicting performance and measuring performance acceleration or velocity in a media using media-object binding. The network environment 100 may include one or more media streaming servers 110 that provide streaming content (e.g., interactive video, podcasts, etc.), one or more platform servers 120, one or more user devices 130, and one or more databases 140.


Media streaming servers 110 may maintain, stream, and host interactive media available to stream on a user device 130 over a communication network. Such media streaming servers 110 may be implemented in the cloud (e.g., one or more cloud servers). Each media may include one or more sets of object data that may be available for participation with (e.g., viewing or interacting with an activity) by a user. Data about the object shown in the media may be stored by the media streaming servers 110, platform servers 120 and/or the user device 130, in an object file 216, as will be discussed in detail with respect to FIGS. 2A and 3.


The platform servers 120 may be responsible for communicating with the different media streaming servers 110, databases 140, and user devices 130. Such platform servers 120 may be implemented on one or more cloud servers. The streaming servers 110 may communicate with multiple platform servers 120, though the media streaming servers 110 may be implemented on one or more platform servers 120. The platform servers 120 may also carry out instructions, for example, receiving a user request from a user to stream media (i.e., games, activities, video, podcasts, User Generated Content, publisher content, etc.). The platform servers 120 may further carry out instructions, for example, for streaming the media content titles. Such media may have at least one object set associated with the media. Each set of object data may have data about an object (e.g., activity information, zone information, actor information, mechanic information, game media information, etc.) displayed during at least a portion of the media content.


The media and the associated one or more sets of object data may be provided through an application programming interface (API) 160, which allows various types of media streaming servers 110 to communicate with different platform servers 120 and different user devices 130. API 160 may be specific to the particular computer programming language, operating system, protocols, etc., of the media streaming servers 110 providing the streaming media content titles, the platform servers 120 providing the media and the associated one or more sets of object data, and user devices 130 receiving the same. In a network environment 100 that includes multiple different types of media streaming servers 110 (or platform servers 120 or user devices 130), there may likewise be a corresponding number of APIs 160.


The user device 130 may include a plurality of different types of computing devices. For example, the user device 130 may include any number of different gaming consoles, mobile devices, laptops, and desktops. In another example, the user device 130 may be implemented in the cloud (e.g., one or more cloud servers). Such user device 130 may also be configured to access data from other storage media, such as, but not limited to memory cards or disk drives as may be appropriate in the case of downloaded services. Such devices 130 may include standard hardware computing components such as, but not limited to network and media interfaces, non-transitory computer-readable storage (memory), and processors for executing instructions that may be stored in memory. These user devices 130 may also run using a variety of different operating systems (e.g., iOS, Android), applications or computing languages (e.g., C++, JavaScript). An exemplary user device 130 is described in detail herein with respect to FIG. 4.


The databases 140 may be stored on the platform server 120, the media streaming servers 110, any of the servers 218 (shown in FIG. 2A), on the same server, on different servers, on a single server, across different servers, or on any of the user devices 130. Such databases 140 may store media and an associated set of object data. Such media may depict one or more activities that a user can participate in and/or UGC (e.g., screen shots, videos, commentary, mashups, etc.) created by peers, publishers of the media content titles and/or third party publishers. Such UGC may include metadata by which to search for such UGC. Such UGC may also include information about the media and/or peer. Such peer information may be derived from data gathered during peer interaction with an object of an interactive content title (e.g., a video game, interactive book, etc.) and may be “bound” to and stored with the UGC. Such binding enhances UGC as the UGC may deep link (e.g., directly launch) to an object, may provide for information about an object and/or a peer of the UGC, and/or may allow a user to interact with the UGC. One or more user profiles may also be stored in the databases 140. Each user profile may include information about the user (e.g., user progress in an activity and/or media content title, user id, user game characters, etc.) and may be associated to media.


In the exemplary network environment 200 of FIG. 2A, an exemplary console 228 (e.g., a user device 130) and exemplary servers 218 (e.g., streaming server 220, an activity feed server 224, an UGC server 232, and an object server 226) are shown. In one example, the console 228 may be implemented on the platform server 120, a cloud server, or on any of the servers 218. In an exemplary example, a content recorder 202 may be implemented on the platform server 120, a cloud server, or on any of the servers 218. Such content recorder 202 receives and records content (e.g., media) from an interactive content title 230 onto a content ring-buffer 208. Such ring-buffer 208 may store multiple content segments (e.g., v1, v2 and v3), start times for each segment (e.g., V1_START_TS, V2_START_TS, V3_START_TS), and end times for each segment (e.g., V1_END_TS, V2_END_TS, V3_END_TS). Such segments may be stored as a media file 212 (e.g., MP4, WebM, etc.) by the console 228. Such media file 212 may be uploaded to the streaming server 220 for storage and subsequent streaming or use, though the media file 212 may be stored on any server, a cloud server, any console 228, or any user device 130. Such start times and end times for each segment may be stored as a content time stamp file 214 by the console 228. Such content time stamp file 214 may also include a streaming ID, which matches a streaming ID of the media file 212, thereby associating the content time stamp file 214 to the media file 212. Such content time stamp file 214 may be uploaded and stored to the activity feed server 224 and/or the UGC server 232, though the content time stamp file 214 may be stored on any server, a cloud server, any console 228, or any user device 130.


Concurrent to the content recorder 202 receiving and recording content from the interactive content title 230, an object library 204 receives data from the interactive content title 230, and an object recorder 206 tracks the data to determine when an object beings and ends. The object library 204 and the object recorder 206 may be implemented on the platform server 120, a cloud server, or on any of the servers 218. When the object recorder 206 detects an object beginning, the object recorder 206 receives object data (e.g., if the object were an activity, user interaction with the activity, activity ID, activity start times, activity end times, activity results, activity types, etc.) from the object library 204 and records the activity data onto an object ring-buffer 210 (e.g., ActivityID1, START_TS; ActivityID2, START_TS; ActivityID3, START_TS). Such activity data recorded onto the object ring-buffer 210 may be stored in the object file 216. Such object file 216 may also include activity start times, activity end times, an activity ID, activity results, activity types (e.g., competitive match, quest, task, etc.), user or peer data related to the activity. For example, an object file 216 may store data regarding an item used during the activity. Such object file 216 may be stored on the object server 226, though the object file 216 may be stored on any server, a cloud server, any console 228, or any user device 130.


Such object data (e.g., the object file 216) may be associated with the content data (e.g., the media file 212 and/or the content time stamp file 214). In one example, the UGC server 232 stores and associates the content time stamp file 214 with the object file 216 based on a match between the streaming ID of the content time stamp file 214 and a corresponding activity ID of the object file 216. In another example, the object server 226 may store the object file 216 and may receive a query from the UGC server 232 for an object file 216. Such query may be executed by searching for an activity ID of an object file 216 that matches a streaming ID of a content time stamp file 214 transmitted with the query. In yet another example, a query of stored content time stamp files 214 may be executed by matching a start time and end time of a content time stamp file 214 with a start time and end time of a corresponding object file 216 transmitted with the query. Such object file 216 may also be associated with the matched content time stamp file 214 by the UGC server 232, though the association may be performed by any server, a cloud server, any console 228, or any user device 130. In another example, an object file 216 and a content time stamp file 214 may be associated by the console 228 during creation of each file 216, 214.


As shown in the exemplary table 250 of FIG. 2B, such object data (e.g., the object file 216) may be associated with event information regarding activity availability change and may be related to other objects with associated event information. For example, such object data may be zone data files 252, actor data files 254, mechanics data files 256, game media data files 258, and other gameplay-related data files.


Such object data (e.g., the object file 216) may be categorized as in in progress, open-ended, or competitive. Such activity data files 216 may include optional properties, such as a longer description of the activity, an image associated with the activity, if the activity is available to players before launching the game, whether completion of the activity is required to complete the game, whether the activity can be played repeatedly in the game, and whether there are nested tasks or associated child activities. Such activity data files 216 may include an activity availability change event for, which may indicate a list or array of currently available activities for the player. For example, this may be used to decide what activities to display in a game plan.


Such zone data files 252 may indicate an area of an associated game world with a single coordinate system wherein the zone may have a 2-D map associated with it, and may be used to display locations on the zone. If zone data files 252 are applicable, each zone may include a zone ID and a short localizable name of the Zone. Such zone data files 252 may be associated with a view projection matrix (4×4) to convert from 3-D world coordinates to a 2-D map position. Such zone data files 252 may be associated with a location change event that indicates an update to a current in-game location of the player. Such location change event may be posted regularly, or whenever the player's in-game location changes significantly. The platform server 120 may store a latest value in ‘state.’ Such zone data files 252 may include an x, y, z position of the player's character in the zone as well as an a, b, c vector indicating the player's characters orientation or direction. Such zone data files 252 may be associate with an activity start event and/or an activity end event and for the activity end event, an outcome of completed, failed, or abandoned may be associated to the activity (e.g., activity ID).


Such actor data files 254 may be associated with an entity with behaviors in the game, and can be player-controller or game-controlled, and can change dynamically during gameplay. Such actor data files 254 may include an actor ID for the actor, a localizable name for the actor, an image of the actor, and/or a short description of the actor. Such actor data files 254 may be associated with an actor select event that indicates that the player's selected actor(s) have changed. The selected actor(s) may represent the actors the player is controlling in the game and may be displayed on the player's profile and other spaces via the platform server 120. There may be more than one actor selected at time and each game may replace its list of actors upon loading save data.


Such mechanics data files 256 may be associated with an item, skill, or effect that can be used by the player or the game to impact gameplay (e.g., bow, arrow, stealth attack, fire damage) and may exclude items that do no impact gameplay (e.g., collectibles). Such mechanics data files 256 may include a mechanic ID of the mechanic, a short name of the mechanic, an image of the mechanic, and/or a short description of the mechanic. Such mechanics data files 256 may be associated with a mechanic availability change event that indicates that the mechanics available to the player have changed. Available may mean that the mechanic is available in the game world for the player to use, but may require the player to go through some steps to acquire it into inventory (e.g., buy from a shop, pick up from the world) before using it. Each game may replace its list of mechanics upon loading save data.


Such mechanics data files 256 may be associated with a mechanic inventory change event that indicates that the player's inventory has changed. Inventory may refer to mechanics that are immediately usable to the player without having to take additional steps in the game before using it. Inventory information is used to estimate a player's readiness for various activities, which may be forwarded to the platform server 120. Games may replace its list of mechanic inventory upon loading save data. Mechanics on cool down may be considered part of the inventory. Mechanic counts (e.g., ammunition, healing points) with any non-zero value may be treated as “in inventory.” Inventory mechanics may be considered a subset of available mechanics.


Such mechanics data files 256 may be associated with a mechanic use event that indicates that a mechanic has been used by or against the player and may be used to be displayed as mechanic usage in a UGC context. Such mechanics data files 256 may include a list or array of mechanics that were used (e.g, fire arrow, fire damage) or whether an initiator is the player, such that whether the mechanics were used by or against the player. Such mechanics data files 256 may include an initiator actor ID, a current zone ID of the initiator actor, and/or a current x, y, z position of the initiator actor. Such mechanics data files 256 may be associated with a mechanic impact event that indicates that a mechanic had impact on gameplay (e.g., an arrow hit an enemy) and may be used to display mechanic image in a UGC context. Mechanic use and mechanic image events may be not linked. Such mechanics data files 256 may include the initiator action ID, the current zone ID of the initiator actor, the current x, y, z position of the initiator actor, a target actor ID, a current zone ID of the target actor, a current x, y, z of the target actor, and a mitigation mechanic that may mitigate the initiator mechanic.


Such game media data files 258 may be include a game media ID of the game media, a localizable name for the game media, a media format (e.g., image, audio, video, text, etc.), a category or type of media (cut-scene, audiolog, poster, developer commentary, etc.), a URL or a server-provisioned media file, and/or whether the game media is associated with a particular activity. Such game media data files 258 may be associated with a game media start event that indicates that a particular piece of game media has started in the game right now and a game media end event that indicates that the particular piece of game media has ended.


Object data (e.g., activity data, zone data, actor data, mechanics data, etc.) may be associated with one another to form object-object associations. The object data may also be associated with the media files (e.g., media file 212) and for media-object bindings. These object-object associations and media-object bindings, along with other associations made with respect to aspects (e.g., activities, actors, actions, etc.) displayed in the media, may indicate particular patterns such that future object data may be predicted based on such associations that form object aggregations. Object aggregations may form one or more relationships between the object data through algorithms, logic functions, statistical analysis, and other dataset analyses.



FIG. 3 is a flowchart illustrating an exemplary method 300 for media-object binding and predicting performance in a media. The method 300 of FIG. 3 may be embodied as executable instructions in a non-transitory computer readable storage medium including but not limited to a CD, DVD, or non-volatile memory such as a hard drive. The instructions of the storage medium may be executed by a processor (or processors) to cause various hardware components of a computing device hosting or otherwise accessing the storage medium to effectuate the method. The execution of the instructions may be implemented on the cloud servers (e.g., the steps identified in FIG. 3 are performed in the cloud). The steps identified in FIG. 3 (and the order thereof) are exemplary and may include various alternatives, equivalents, or derivations thereof including but not limited to the order of execution of the same.


In step 310, at least one set of object data (e.g., at least one activity file 216) generated based on the one or more objects displayed in the live-streaming media (e.g., a media file 212). In step 320, the at least one set of object data is associated with at least a portion of the live-streaming media. The at least one set of object data comprises data about the one or more objects displayed in real-time in the live-streaming media. Such association or binding may be based on at least one timestamp of the set of object data associated with one or more timestamps (e.g., a content time stamp file 214) of the live-streaming media. In addition to or alternatively, such association or binding may be based on an activity ID of the set of object data associated with a media ID of the live-streaming media, wherein the set of object data may also include data about the one or more objects displayed during at least a portion of the live-streaming media (e.g., activity results, activity types (e.g., competitive match, quest, task, etc.), user or peer data related to the activity). The set of object data may also include a direct link to the associated object. Such link allows a user to directly access an object. For example, a user may wish to participate in an activity associated with the object shown by a live-streaming media. In the same example, the user can select an option to play the activity shown, and the activity may be automatically launched after selection by the user.


In step 330, based on the association, one or more media-object bindings are formed between the at least one set of object data and the at least a portion of the live-streaming media. In step 340, the one or more media-object bindings are stored in the database 140 or the user devices 130 by the media streaming servers 110 or the platform servers 120. The live-streaming media may be part of an interactive content title 230 or may be UGC (e.g., help video, screen shots, videos, commentary, mashups, etc.) generated by the user, peers, a publisher of the media content title, or a third party. One or more user profiles may also be stored in the database 140 or the user devices 130 by the media streaming servers 110 or the platform servers 120. In step 350, the real-time activity information associated with the at least one set of object data may be displayed in association with the live-streaming media.


In step 350, one or more object-object associations between the one or more sets of object data and other stored object data may be formed and stored in the one or more databases, which may include an algorithm library. The one or more object-object associations may form one or more object aggregations. The one or more object aggregations may also take into consideration user input. As mentioned above, object aggregations may be formed by evaluations of the object-object associations based on algorithms from the algorithm library and ran in an experiment module.


In step 360, a determination may be made if any of the one or more object aggregations meet or pass a set threshold. When the set threshold is met or passed, the media may suggest to an associated user to stream the media in real-time if the media is not a live-streaming media. Alternatively, the media is a live-streaming media. The set threshold may be a fastest completion time of reaching a milestone of a previous session, wherein the determination of passing the set threshold calculates and compares a predicted completion time, based on an acceleration calculated over a period of time of a current session, with a fastest completion time. The set threshold may be calculated after a percentage completion of the milestone. The set threshold may change as more object-object associations are saved and/or different object aggregations are formed. The set threshold may be dynamic depending on any number of factors such as a player's skill level, play mode, game, character, etc. The milestone may be a completion of a task, a level, a mission, speed runs, kill count, or any other kind of gameplay milestone. The milestone may also be the result of any gameplay activity that an individual can perform or can perform with one more friends simultaneously or asynchronously. The milestone may be any game behavior exhibited that can be measured and have a related threshold independent of genre or platform. The set threshold may also be calculated by determining a speed at which the player is reaching the milestone and compare the speed at which the player is reaching the milestone based on object data timestamps and stored object data timestamps of other players.


The one or more sets of object data may be compared to the other stored object data along with associated timestamps to determine the acceleration. The other stored object data, object-object associations, media-object bindings, and object aggregations may be inputs to one or more algorithms for calculating whether the set threshold is met or passed. The set threshold may be a velocity threshold wherein the determination of passing the set threshold calculates and compares the velocity at which a milestone is being reached in a current session and a fastest recorded velocity at which the milestone was reached of a previous session. The set threshold may be used for a “beat best time/world record” type of scenario. Additional, the set threshold may be used to signal trend improvements over time, wherein the set threshold is used for a “beat persona record” type of scenario or other kinds of measurements against own past performance over various period of time. The set threshold may also be used as a training mechanism as well as for novelty interest overall. For example, most players' gameplay deaths may average within a certain time period, such as an hour period. Therefore, if a player has surpassed the average gameplay session, it could be a point of interest and a reason viewers might be drawn to watch such a stream. In a broader view, a novelty interest may mean a range of business logic that can be included for predicting various results. The determination may be calculated after a percentage completion of the milestone. The determination if any object aggregation passes the set threshold may be determined by inputting one or more of the object aggregations with one or more algorithms from the algorithm library into the experiment module to evaluate whether any of the one or more object aggregations pass the set threshold.


An indicator may be display, with the media, that a milestone is being reached at or above the set threshold at which the milestone was reached in previous sessions. The set thresholds may be provided by third-party game publishers, and records of velocities and accelerations of reaching selected milestones are stored at the one or more databases. In addition, the media may be television broadcasting and the milestone being reached may be that of what is occurring in the television broadcasting.


Additionally, list results may be displayed comprising at least one matching media having matching object data. A list of streaming media where the set threshold is met may be displayed, wherein the list is ordered based on velocity or acceleration of gameplay of respective current sessions. The list results may be an aggregation from various games and players or may be filtered into particular games, skill levels, or other kinds of factors. Live broadcasted games with performance acceleration that has surpassed their respective thresholds may be of interest to viewers that want to see players attain record-breaking goals such as reaching certain goals at a record-breaking time. The list results, or elsewhere, may display a link to an associate media having an object aggregation that passes the set threshold. The media may display an indicator in the media that a milestone is being reaches at the set threshold acceleration based on velocities at which other players have reached the milestone.



FIG. 4 is an exemplary user electronic entertainment system that may be used in launching interactive content and providing dynamic interfaces. The entertainment system 400 of FIG. 4 includes a main memory 405, a central processing unit (CPU) 410, vector unit 415, a graphics processing unit 420, an input/output (I/O) processor 425, an I/O processor memory 430, a peripheral interface 435, a memory card 440, a Universal Serial Bus (USB) interface 445, and a communication network interface 450. The entertainment system 400 further includes an operating system read-only memory (OS ROM) 455, a sound processing unit 460, an optical disc control unit 470, and a hard disc drive 465, which are connected via a bus 475 to the I/O processor 425.


Entertainment system 400 may be an electronic game console. Alternatively, the entertainment system 400 may be implemented as a general-purpose computer, a set-top box, a hand-held game device, a tablet computing device, a virtual reality device, an augmented reality device, or a mobile computing device or phone. Entertainment systems may contain more or less operating components depending on a particular form factor, purpose, or design.


The CPU 410, the vector unit 415, the graphics processing unit 420, and the I/O processor 425 of FIG. 4 communicate via a system bus 485. Further, the CPU 410 of FIG. 4 communicates with the main memory 405 via a dedicated bus 480, while the vector unit 415 and the graphics processing unit 420 may communicate through a dedicated bus 490. The CPU 410 of FIG. 4 executes programs stored in the OS ROM 455 and the main memory 405. The main memory 405 of FIG. 4 may contain pre-stored programs and programs transferred through the I/O Processor 425 from a CD-ROM, DVD-ROM, or other optical disc (not shown) using the optical disc control unit 470. I/O Processor 425 of FIG. 4 may also allow for the introduction of content transferred over a wireless or other communications network (e.g., 4G, LTE, 1G, and so forth). The I/O processor 425 of FIG. 4 primarily controls data exchanges between the various devices of the entertainment system 400 including the CPU 410, the vector unit 415, the graphics processing unit 420, and the peripheral interface 435.


The graphics processing unit 420 of FIG. 4 executes graphics instructions received from the CPU 410 and the vector unit 415 to produce images for display on a display device (not shown). For example, the vector unit 415 of FIG. 4 may transform objects from three-dimensional coordinates to two-dimensional coordinates, and send the two-dimensional coordinates to the graphics processing unit 420. Furthermore, the sound processing unit 460 executes instructions to produce sound signals that are outputted to an audio device such as speakers (not shown). Other devices may be connected to the entertainment system 400 via the USB interface 445, and the communication network interface 450 such as wireless transceivers, which may also be embedded in the system 400 or as a part of some other component such as a processor.


A user of the entertainment system 400 of FIG. 4 provides instructions via the peripheral interface 435 to the CPU 410, which allows for use of a variety of different available peripheral devices (e.g., controllers) known in the art. For example, the user may instruct the CPU 410 to store certain game information on the memory card 440 or other non-transitory computer-readable storage media or instruct a character in a game to perform some specified action.


The present disclosure pertain to an application that may be operable by a variety of end user devices. For example, an end user device may be a personal computer, a home entertainment system (e.g., Sony PlayStation2® or Sony PlayStation3® or Sony PlayStation4®), a portable gaming device (e.g., Sony PSP® or Sony Vita®), or a home entertainment system of a different albeit inferior manufacturer. The present methodologies described herein are fully intended to be operable on a variety of devices. Aspects of the present disclosure may also be implemented with cross-title neutrality and/or may be utilized across a variety of titles from various publishers.


Aspects of the present disclosure may be implemented in an application that may be operable using a variety of devices. Non-transitory computer-readable storage media refer to any medium or media that participate in providing instructions to a central processing unit (CPU) for execution. Such media can take many forms, including, but not limited to, non-volatile and volatile media such as optical or magnetic disks and dynamic memory, respectively. Common forms of non-transitory computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, RAM, PROM, EPROM, a FLASHEPROM, and any other memory chip or cartridge.


Various forms of transmission media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution. A bus carries the data to system RAM, from which a CPU retrieves and executes the instructions. The instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU. Various forms of storage may likewise be implemented as well as other network interfaces and network topologies to implement the same.


In some aspects of the present disclosure, computer-readable storage devices, mediums, and memories can include a cable or wireless signal containing a bit stream and the like. However, when mentioned, non-transitory computer-readable storage media expressly exclude media such as energy, carrier signals, electromagnetic waves, and signals per se.


The foregoing detailed description of the technology has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the technology to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described aspects of the present disclosure were chosen in order to adequately explain the principles of the technology, its practical application, and to enable others skilled in the art to utilize the technology along with various modifications as are suited to the particular use contemplated. It is intended that the scope of the technology be defined by the claim.

Claims
  • 1. A method of predicting virtual events based on digital object aggregations, the method comprising: receiving a plurality of sets of object data sent over a communication network from one or more media streaming servers, the sets of object data generated during sessions with one or more user devices;storing the sets of object data in one or more databases in memory, wherein the sets of object data include one or more media-object bindings between media files and associated object data;executing instructions stored in memory, wherein execution of the instructions by one or more processors: identifies a dynamic threshold for a current session associated with a stream of a media title based on one or more factors associated with the current session;determines that one or more aggregations of the object data meet the dynamic threshold; andgenerates a prediction regarding a milestone event based on the determination that the dynamic threshold is met by the one or more aggregations of the object data; andprovides a suggestion over the communication network to one or more of the user devices based on the prediction.
  • 2. The method of claim 1, wherein the sets of object data further include one or more object-object associations between object data, and wherein the one or more aggregations are formed by object-object associations.
  • 3. The method of claim 1, wherein the dynamic threshold is a velocity threshold, wherein determining that the dynamic threshold is met includes comparing a velocity at which the milestone event is being reached in the current session and a fastest recorded velocity at which the milestone event was reached in a previous session.
  • 4. The method of claim 1, further comprising storing in the databases in memory one or more thresholds provided by game publishers, and records of velocities and accelerations of reaching selected milestones.
  • 5. The method of claim 1, wherein the dynamic threshold corresponds to a fastest completion time of reaching the milestone event in a previous session, wherein determining that the dynamic threshold is met includes comparing a predicted completion time based on a current acceleration of the current session with the fastest completion time.
  • 6. The method of claim 5, further comprising determining the current acceleration based on a comparison of the sets of object data to other stored object data along with associated timestamps.
  • 7. The method of claim 1, wherein the suggestion includes a link to media of the current session in real-time.
  • 8. The method of claim 7, wherein the linked media is a live stream of the current session that includes an indicator regarding the predicted milestone event.
  • 9. The method of claim 8, wherein the indicator further indicates a velocity or acceleration at which the milestone is being reached relative to previous sessions.
  • 10. The method of claim 7, wherein the link is presented within a list of multiple media streams each identified as having met respective dynamic thresholds.
  • 11. A system of predicting virtual events based on digital object aggregations, the system comprising: a communication interface that receives a plurality of sets of object data sent over a communication network from one or more media streaming servers, the sets of object data generated during sessions with one or more user devices;memory that stores the sets of object data in one or more databases, wherein the sets of object data include one or more media-object bindings between media files and associated object data; andone or more processors that execute instructions stored in memory, wherein the processors execute the instructions to: identify a dynamic threshold for a current session associated with a stream of a media title based on one or more factors associated with the current session;determine that one or more aggregations of the object data meet the dynamic threshold; andgenerate a prediction regarding a milestone event based on the determination that the dynamic threshold is met by the one or more aggregations of the object data, wherein the communication interface provides a suggestion over the communication network to one or more of the user devices based on the prediction.
  • 12. The system of claim 11, wherein the sets of object data further include one or more object-object associations between object data, and wherein the one or more aggregations are formed by object-object associations.
  • 13. The system of claim 11, wherein the dynamic threshold is a velocity threshold, wherein the processors determine that the dynamic threshold is met by comparing a velocity at which the milestone event is being reached in a current session and a fastest recorded velocity at which the milestone event was reached in a previous session.
  • 14. The system of claim 11, wherein the memory further stores in the databases one or more thresholds provided by game publishers, and records of velocities and accelerations of reaching selected milestones.
  • 15. The system of claim 11, wherein the dynamic threshold corresponds to a fastest completion time of reaching the milestone event in a previous session, wherein the processors determine that the dynamic threshold is met by comparing a predicted completion time based on a current acceleration of the current session with the fastest completion time.
  • 16. The system of claim 15, wherein the processors further determine the current acceleration based on a comparison of the sets of object data to other stored object data along with associated timestamps.
  • 17. The system of claim 11, wherein the suggestion includes a link to media of the current session in real-time.
  • 18. The system of claim 17, wherein the linked media is a live stream of the current session that includes an indicator regarding the predicted milestone event.
  • 19. The system of claim 18, wherein the indicator further indicates a velocity or acceleration at which the milestone is being reached relative to previous sessions.
  • 20. The system of claim 17, wherein the link is presented within a list of multiple media streams each identified as having met respective dynamic thresholds.
  • 21. A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method of predicting virtual events based on digital object aggregations, the method comprising: receiving a plurality of sets of object data sent over a communication network from one or more media streaming servers, the sets of object data generated during sessions with one or more user devices;storing the sets of object data in one or more databases in memory, wherein the sets of object data include one or more media-object bindings between media files and associated object data;executing instructions stored in memory, wherein execution of the instructions by one or more processors: identifies a dynamic threshold for a current session associated with a stream of a media title based on one or more factors associated with the current session;determines that one or more aggregations of the object data meet the dynamic threshold; andgenerates a prediction regarding a milestone event based on the determination that the dynamic threshold is met by the one or more aggregations of the object data; andprovides a suggestion over the communication network to one or more of the user devices based on the prediction.
CROSS-REFERENCE TO RELATED APPLICATION

The present application is a continuation and claims the priority benefit of U.S. patent application Ser. No. 16/885,635 filed May 28, 2020, now U.S. Pat. No. 11,602,687, which is incorporated herein by reference in its entirety.

US Referenced Citations (171)
Number Name Date Kind
5913013 Abecassis Jun 1999 A
8448095 Haussila et al. May 2013 B1
8460108 Hendrickson et al. Jun 2013 B2
8764555 Quan et al. Jul 2014 B2
8918728 Hamilton et al. Dec 2014 B2
9155963 Baynes et al. Oct 2015 B2
9168460 Pearce Oct 2015 B2
9333433 Cotter May 2016 B2
9381425 Curtis et al. Jul 2016 B1
9468851 Pieron Oct 2016 B1
9795879 Colenbrander Oct 2017 B2
9930405 Peterson et al. Mar 2018 B2
10109003 Jenkins et al. Oct 2018 B1
10315108 Perry Jun 2019 B2
10564820 Cabanero et al. Feb 2020 B1
10569164 Bleasdale-Shepherd Feb 2020 B1
10843085 Stephens Nov 2020 B2
10848805 Mattar et al. Nov 2020 B1
10881962 Stephens Jan 2021 B2
11080748 Stephens Aug 2021 B2
11090568 Mattar et al. Aug 2021 B1
11213748 Jarzebinski Jan 2022 B2
11247130 Stephens Feb 2022 B2
11269944 Stephens Mar 2022 B2
11420130 Clingman Aug 2022 B2
11442987 Clingman Sep 2022 B2
11465053 Stephens Oct 2022 B2
11602687 Clingman Mar 2023 B2
11697067 Jarzebinski Jul 2023 B2
11896909 Stephens Feb 2024 B2
11951405 Clingman Apr 2024 B2
12005354 Jarzebinski Jun 2024 B2
12070696 Thielbar et al. Aug 2024 B2
20020077170 Johnson et al. Jun 2002 A1
20020183105 Cannon et al. Dec 2002 A1
20040021684 B. Millner Feb 2004 A1
20070198740 Peters et al. Aug 2007 A1
20070198939 Gold Aug 2007 A1
20080045335 Garbow et al. Feb 2008 A1
20080262858 Broady et al. Oct 2008 A1
20090115776 Bimbra et al. May 2009 A1
20090170609 Kang et al. Jul 2009 A1
20090176557 Hall et al. Jul 2009 A1
20090197681 Krishnamoorthy et al. Aug 2009 A1
20090276713 Eddy Nov 2009 A1
20100070613 Chen et al. Mar 2010 A1
20100105484 Horneff et al. Apr 2010 A1
20100304348 Lehavi Dec 2010 A1
20110067061 Karaoguz et al. Mar 2011 A1
20110092282 Gary Apr 2011 A1
20110113149 Kaal May 2011 A1
20110250971 van Os et al. Oct 2011 A1
20110314029 Fischer et al. Dec 2011 A1
20110319229 Corbalis et al. Dec 2011 A1
20120004956 Huston et al. Jan 2012 A1
20120030123 Ocko Feb 2012 A1
20120094762 Khan Apr 2012 A1
20120115580 Homik et al. May 2012 A1
20120206574 Shikata et al. Aug 2012 A1
20120252583 Mikkelsen Oct 2012 A1
20120284292 Rechsteiner et al. Nov 2012 A1
20120309533 Horita et al. Dec 2012 A1
20120317198 Patton et al. Dec 2012 A1
20120322561 Kohlhoff Dec 2012 A1
20130064527 Maharajh et al. Mar 2013 A1
20130084969 Knoles et al. Apr 2013 A1
20130086484 Antin et al. Apr 2013 A1
20130165234 Hall et al. Jun 2013 A1
20130190094 Ronen et al. Jul 2013 A1
20130212342 McCullough et al. Aug 2013 A1
20130244785 Gary Sep 2013 A1
20130260896 Miura et al. Oct 2013 A1
20130288788 Lim et al. Oct 2013 A1
20140080601 Knutsson Mar 2014 A1
20140129322 George et al. May 2014 A1
20140179426 Perry et al. Jun 2014 A1
20140179427 Miura et al. Jun 2014 A1
20140179439 Miura et al. Jun 2014 A1
20140179440 Perry Jun 2014 A1
20140199045 Lee et al. Jul 2014 A1
20140204014 Thorn et al. Jul 2014 A1
20140206456 Koplar Jul 2014 A1
20140228112 Laakkonen et al. Aug 2014 A1
20140235338 Hansson et al. Aug 2014 A1
20140243097 Yong et al. Aug 2014 A1
20140243098 Yong et al. Aug 2014 A1
20140274297 Lewis et al. Sep 2014 A1
20140364210 Murray et al. Dec 2014 A1
20150026728 Carter et al. Jan 2015 A1
20150081777 Laine et al. Mar 2015 A1
20150094139 Kargar Apr 2015 A1
20150099249 Norman et al. Apr 2015 A1
20150142799 Eronen et al. May 2015 A1
20150224396 Okada Aug 2015 A1
20150245084 Downing et al. Aug 2015 A1
20150296250 Casper Oct 2015 A1
20150306499 Chimes et al. Oct 2015 A1
20150331856 Choi et al. Nov 2015 A1
20150381689 Ganesh et al. Dec 2015 A1
20160005326 Syrmis et al. Jan 2016 A1
20160029153 Linn et al. Jan 2016 A1
20160078471 Hamedi Mar 2016 A1
20160147890 Wissner et al. May 2016 A1
20160149956 Birnbaum et al. May 2016 A1
20160277349 Bhatt et al. Sep 2016 A1
20160287997 Laakkonen et al. Oct 2016 A1
20160350813 Balasubramanian et al. Dec 2016 A1
20160366483 Joyce et al. Dec 2016 A1
20170001111 Willette et al. Jan 2017 A1
20170001122 Leung et al. Jan 2017 A1
20170050111 Perry et al. Feb 2017 A1
20170087460 Perry Mar 2017 A1
20170126757 Kuo et al. May 2017 A1
20170157512 Long et al. Jun 2017 A1
20170188116 Major et al. Jun 2017 A1
20170189815 Tweedale et al. Jul 2017 A1
20170246544 Agarwal et al. Aug 2017 A1
20170301041 Schneider Oct 2017 A1
20170339093 Pesavento et al. Nov 2017 A1
20170354888 Benedetto et al. Dec 2017 A1
20180001194 Sherwani et al. Jan 2018 A1
20180001216 Bruzzo et al. Jan 2018 A1
20180014077 Hou et al. Jan 2018 A1
20180021684 Benedetto Jan 2018 A1
20180033250 O'Heeron et al. Feb 2018 A1
20180101614 Kuipers et al. Apr 2018 A1
20180126279 Stelovsky et al. May 2018 A1
20180192142 Paul Jul 2018 A1
20180295175 Smith et al. Oct 2018 A1
20180302761 Rizzolo et al. Oct 2018 A1
20180318708 Rom et al. Nov 2018 A1
20180343505 Loheide et al. Nov 2018 A1
20180359477 Yang Dec 2018 A1
20190052471 Panattoni et al. Feb 2019 A1
20190208242 Bates et al. Jul 2019 A1
20190240572 Perry et al. Aug 2019 A1
20190246149 Reza et al. Aug 2019 A1
20190270019 Miura et al. Sep 2019 A1
20190270020 Miura et al. Sep 2019 A1
20190282906 Yong Sep 2019 A1
20190291011 Benedetto et al. Sep 2019 A1
20190297376 McCarty et al. Sep 2019 A1
20200061465 Benedetto et al. Feb 2020 A1
20200086217 Trombetta et al. Mar 2020 A1
20200101382 Wheeler et al. Apr 2020 A1
20200111306 Oberberger et al. Apr 2020 A1
20200114267 Sakurai Apr 2020 A1
20200122031 Sherwani et al. Apr 2020 A1
20200147489 Mahlmeister et al. May 2020 A1
20200169793 Akerfeldt May 2020 A1
20200175947 Benedetto et al. Jun 2020 A1
20200184041 Andon et al. Jun 2020 A1
20200188781 Stephens Jun 2020 A1
20200188792 Stephens Jun 2020 A1
20200188794 Stephens Jun 2020 A1
20200188796 Stephens Jun 2020 A1
20200188800 Stephens Jun 2020 A1
20200192929 Stephens Jun 2020 A1
20200193476 Stephens Jun 2020 A1
20200193477 Stephens Jun 2020 A1
20200306638 Fear et al. Oct 2020 A1
20210077907 Stephens Mar 2021 A1
20210129023 Jarzebinski May 2021 A1
20210370169 Clingman Dec 2021 A1
20210370185 Clingman Dec 2021 A1
20210374180 Clingman Dec 2021 A1
20220088474 Dicken et al. Mar 2022 A1
20220143516 Thielbar May 2022 A1
20220167022 Bettner et al. May 2022 A1
20220193546 Jarzebinski Jun 2022 A1
20220401845 Clingman Dec 2022 A1
Foreign Referenced Citations (46)
Number Date Country
2953806 Dec 2015 CA
113710337 Nov 2021 CN
113710340 Nov 2021 CN
113727764 Nov 2021 CN
113727765 Nov 2021 CN
114599432 Jun 2022 CN
116457066 Jul 2023 CN
201980089789.3 Mar 2024 CN
201980089796.3 Mar 2024 CN
2014342 Jan 2009 EP
2878346 Jun 2015 EP
3894029 Oct 2021 EP
3894030 Oct 2021 EP
3894031 Oct 2021 EP
3894032 Oct 2021 EP
4051398 Sep 2022 EP
4240505 Sep 2023 EP
H11179050 Jul 1999 JP
2009522853 Jun 2009 JP
2011217803 Nov 2011 JP
2012-065831 Apr 2012 JP
2017-182603 Oct 2017 JP
2019-155103 Sep 2019 JP
2022-512425 Feb 2022 JP
2022-512492 Feb 2022 JP
2022-513485 Feb 2022 JP
2022-513849 Feb 2022 JP
2023-500868 Jan 2023 JP
2023-551386 Dec 2023 JP
7445659 Feb 2024 JP
7487201 May 2024 JP
2018-0094833 Aug 2018 KR
WO 2009094611 Jul 2009 WO
WO 2014047490 Mar 2014 WO
2015200737 Dec 2015 WO
WO 2017182642 Oct 2017 WO
WO 2017188677 Nov 2017 WO
WO 2020123115 Jun 2020 WO
WO 2020123116 Jun 2020 WO
WO 2020123117 Jun 2020 WO
WO 2020123118 Jun 2020 WO
WO 2021086561 May 2021 WO
WO 2021242476 Dec 2021 WO
WO 2021242477 Dec 2021 WO
WO 2021242478 Dec 2021 WO
WO 2022098707 May 2022 WO
Non-Patent Literature Citations (60)
Entry
U.S. Appl. No. 17/517,875 Final Office Action mailed Mar. 31, 2023.
Li et al., “Distributed Multimedia Systems”, IEEE, Jul. 1997, retrieved on [Feb. 7, 2021]. Retrieved from the internet <URL: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.128.9759&rep1&type=pdf>.
Application No. 19896349.8 Extended European search report dated Jul. 5, 2022.
Application No. 19896543.6 Extended European search report dated Aug. 12, 2022.
Application No. 19895486.9 Extended European search report dated Oct. 5, 2022.
Application No. 19897134.3 Extended European search report dated Oct. 5, 2022.
PCT Application No. PCT/US2019/062602 International Search Report and Written Opinion dated Feb. 14, 2020.
PCT Application No. PCT/US2019/062602 International Preliminary Report on Patentability dated Jun. 8, 2021.
PCT Application No. PCT/US2019/062606 International Search Report and Written Opinion dated Jan. 30, 2020.
PCT Application No. PCT/US2019/062606 International Preliminary Report on Patentability dated Jun. 8, 2021.
PCT Application No. PCT/US2019/062613 International Search Report and Written Opinion dated Feb. 3, 2020.
PCT Application No. PCT/US2019/062613 International Preliminary Report on Patentability dated Jun. 8, 2021.
PCT Application No. PCT/US2019/062626 International Search Report and Written Opinion dated Jan. 29, 2020.
PCT Application No. PCT/US2019/062626 International Preliminary Report on Patentability dated Jun. 8, 2021.
PCT Application No. PCT/US2020/054603 International Preliminary Report on Patentability dated May 2, 2022.
PCT Application No. PCT/US2020/054603 International Search Report and Written Opinion dated Jan. 28, 2021.
PCT Application No. PCT/US2021/030378 International Preliminary Report on Patentability dated Nov. 17, 2022.
PCT Application No. PCT/US2021/030378 International Search Report and Written Opinion dated Aug. 5, 2021.
PCT Application No. PCT/US2021/030379 International Preliminary Report on Patentability dated Nov. 17, 2022.
PCT Application No. PCT/US2021/030379 International Search Report and Written Opinion dated Aug. 5, 2021.
PCT Application No. PCT/US2021/030380 International Preliminary Report on Patentability dated Nov. 17, 2022.
PCT Application No. PCT/US2021/030380 International Search Report and Written Opinion dated Aug. 12, 2021.
PCT Application No. PCT/US2021/057832 International Search Report and Written Opinion dated Feb. 16, 2022.
U.S. Appl. No. 16/220,397 Office Action mailed Sep. 25, 2020.
U.S. Appl. No. 16/359,160 Office Action mailed Jul. 12, 2021.
U.S. Appl. No. 16/359,160 Final Office Action mailed Mar. 12, 2021.
U.S. Appl. No. 16/359,160 Office Action mailed Nov. 13, 2020.
U.S. Appl. No. 16/220,443 Office Action mailed Aug. 6, 2021.
U.S. Appl. No. 16/220,443 Final Office Action mailed Apr. 13, 2021.
U.S. Appl. No. 16/220,443 Office Action mailed Oct. 19, 2020.
U.S. Appl. No. 16/379,683 Final Office Action mailed May 7, 2021.
U.S. Appl. No. 16/379,683 Office Action mailed Nov. 6, 2020.
U.S. Appl. No. 16/220,460 Office Action mailed Jan. 28, 2020.
U.S. Appl. No. 16/380,760 Office Action mailed Mar. 6, 2020.
U.S. Appl. No. 16/220,465 Office Action mailed Jul. 26, 2021.
U.S. Appl. No. 16/220,465 Final Office Action mailed Dec. 24, 2020.
U.S. Appl. No. 16/220,465 Office Action mailed Jun. 15, 2020.
U.S. Appl. No. 16/358,546 Final Office Action mailed Dec. 30, 2022.
U.S. Appl. No. 16/358,546 Office Action mailed Nov. 1, 2021.
U.S. Appl. No. 16/358,546 Office Action mailed Jun. 23, 2021.
U.S. Appl. No. 16/358,546 Final Office Action mailed Jan. 27, 2021.
U.S. Appl. No. 16/358,546 Office Action mailed May 20, 2020.
U.S. Appl. No. 16/679,795 Office Action mailed May 10, 2021.
U.S. Appl. No. 17/566,964 Office Action mailed Nov. 23, 2022.
U.S. Appl. No. 16/885,635 Office Action mailed Mar. 30, 2022.
U.S. Appl. No. 17/517,875 Office Action mailed Oct. 13, 2022.
Anonymous: “New Replay and Resume Features Coming in Heart of the Swarm—StarCraft II—Blizzard News”, Jan. 24, 2013 (Jan. 24, 2013), XP093053633, Retrieved from the Internet: URL:https://news.blizzard.com/en-gb/starcraft2/10054757/new-replay-and-resume-features-coming-in-heart-of-the- swarm [retrieved on Jun. 12, 2023] * pp. 3, 5 *.
Chinese Application No. 201980089787.4 First Office Action dated Aug. 18, 2023.
Japanese Application No. 2021-533796 Non Final Notification of Reasons for Refusal date Nov. 2, 2023.
Japanese Application No. 2021-533797 Non Final Notification of Reasons for Refusal dated Oct. 17, 2023.
European Application No. 20882882.2 Extended European Search Report dated Oct. 13, 2023.
U.S. Appl. No. 17/517,875 Office Action mailed Oct. 31, 2023.
U.S. Appl. No. 16/358,546 Notice of Allowance mailed Sep. 26, 2023.
Application No. 2021-533794 Decision of Refusal dated May 14, 2024.
Application No. 201980089787.4 Second Office Action dated Mar. 29, 2024.
Application No. 2022-525694 Non Final Notification of Reasons for Refusal dated Jun. 4, 2024.
PCT Application No. PCT/US2021/057832 International Preliminary Report on Patentability dated May 19, 2023.
Application No. 19896349.8 Official Letter dated Mar. 25, 2024.
Application No. 19895486.9 Examination Report dated Aug. 12, 2024.
Application No. 21889954.0 Extended European Search Report dated Aug. 12, 2024.
Related Publications (1)
Number Date Country
20230218992 A1 Jul 2023 US
Continuations (1)
Number Date Country
Parent 16885635 May 2020 US
Child 18114482 US