Patent Application
20240100436
This disclosure relates to gameplay software and its evaluation.
When a developer releases a video or software game, the developer typically has no way to evaluate how the game is being played by the public. The kind of feedback mechanisms and analytics that do exist currently are limited to broad picture items such as downloads, replay counts, user attrition rates, traffic data of particular parts of the game etc. What is missing is actual gameplay data, which is to say, a way to understand exactly how the public is interacting with the game itself, in all its complexity. It would be beneficial to the developer to know where the players are enjoying the game more, where they are getting frustrated etc.
While it is possible for the developers to elicit feedback from users, such methods are not real-time deliverables, and require additional resources from the developer. Further, only some garners may respond, which might not give a complete picture of the true play of the game.
Along the same lines, developers are looking for ways to address situations where users of the program perform more poorly not due to game design, but the state of the player at that point in the game. Upset and unfocused players can lead to poor game play experiences, which can lead to a drop in effectiveness of the game, especially in educational-based games.
Therefore, there is a need for a system and method that addresses the shortcomings discussed above.
It is to be understood that this summary is not an extensive overview of the disclosure. This summary is exemplary and not restrictive and it is intended to neither identify key or critical elements of the disclosure nor delineate the scope thereof. The sole purpose of this summary is to explain and exemplify certain concepts of the disclosure as an introduction to the following complete and extensive detailed description.
The present disclosure relates to a system and method for gameplay evaluation. In an aspect, the invention is directed at a gameplay evaluating method (GEM) and system. The GEM system allows a game developer to observe hi real-time how players worldwide are interacting with the game. The GEM system allows the developer to keep a birds-eye view of gameplay as it happens and observe patterns of gameplay behavior of thousands of live players. Therefore, the GEM system is a tool that tells the developer which parts of the game are working well and which are not working well.
Examples of what the developer can observe may include: which activities are more users engaged with, how long a particular activity is used by a user, the order in which activities are done, places that have technical issues that prevent playing, when players are collecting points and rewards, what levels they are in at the moment and the like.
Part of the GEM system may include a focus improving mechanism to improve player attention by allowing the game to intervene when it detects that a user appears to be having difficulty or a certain task is taking longer than anticipated. In an aspect, the focus improving mechanism can be called a Bindu Focus, and implement a method for helping a user focus on the task at hand. Such a focus method may comprise having a character guide give voice instructions to the player which is then accompanied by clicking on a Mind's Eye icon.
In an aspect, the invention is directed at a system for evaluating gameplay of an interactive program, the system including a server that places game tags within the code of the interactive program, receive data captured by the game tags from a user device using the interactive program; and stores and evaluates the data captured from the game tags to evaluate and improve the interactive program. In some instances, the server includes a game tag manager that allows a developer to place the game tags with game play of the interactive program. The game tags can include special tag lines of code configured to pull data generated during use of the interactive program on the user device when triggered. The pulled data can include a location of a game tag, a game ID, and a broadcast. The system can communicate with several different user devices to evaluate the interactive program from the data collected from each of the user devices. In some aspects, the system can evaluate different interactive programs at the same time, and each of the interactive programs. The server is configured to receive the data captured by the game tags in real time or at planned timed-intervals.
The system can also include an analyzer program that applies questions to filter the data captured in order to further evaluate the interactive program. This can be done without identifying the individual users of the interactive program. In some aspects, the analyzer program can work with a reporting module configured to report back performance within the interactive program of a user of the user device based upon the evaluation of the data captured from the game tags.
In some instances, the system includes a focus improving mechanism that is presented on the user device when the evaluation of the data captured from the game tags indicates a lack of focus. The focus improving mechanism can provide audio instructions and video instructions to the user.
In an aspect, the invention is directed at a system for evaluating interaction of a user with an interactive program that includes a sever with communication means, a game tag manager configured to place game tags at events of gameplay of the interactive program, a database, an analyzer program, and a reporting module. The system is configured to interact with numerous user devices on which the interactive program operates. The game tags are configured to pull gameplay data captured during a user's interactions with the interactive program on the user device when the game tag is triggered. The data captured can include a program identification, game tag location, and broadcast. The data captured would be pulled when the game tags were triggered, and then would be communicated with the server. Upon receiving the data, the server is configured to store the data captured by the game tags in the database, provide questions, via the analyzer program, to assist in filtering the captured data to analyze the captured data to evaluate effective of the interactive program, evaluate, via the analyzer program, an individual's performance, and report, via the reporting module, the individual's performance.
The GEM system is valuable because when a developer releases a game, typically a mobile game, he has no idea how the game is being played. The data generated by the GEM system allows the developer to test his assumptions on his audience, and lets him make appropriate changes to improve the game, in subsequent updates. Further, it also assists players in tackling difficult areas in gameplay in a focused manner.
The features and components of the following figures are illustrated to emphasize the general principles of the present disclosure. Corresponding features and components throughout the figures can be designated by matching reference characters for the sake of consistency and clarity.
The present disclosure can be understood more readily by reference to the following detailed description, examples, drawings, and claims, and their previous and following description. However, before the present devices, systems, and/or methods are disclosed and described, t is to be understood that this disclosure is not limited to the specific devices, systems, and/or methods disclosed unless otherwise specified, as such can, of course, vary. It is also to be understood that the terminology used herein is for the purpose of describing particular aspects only and is not intended to be limiting.
The current invention is directed to a gameplay evaluation method and system that is configured to allow a game developer to observe and monitor in real-time how players worldwide are interacting with a video/software based game. In an aspect, the invention is directed at a gameplay evaluation method (GEM) and system that implements the method. The GEM system 10 can be utilized to evaluate the performance of any given program/software 200 that involves some form of user interaction (e.g., training programs, utility programs, and the like). These interactive programs 200 are operated on user devices 100. In such aspects, the GEM system 10 is configured to be able to communicate with downloaded/disseminated versions of the interactive programs 200 on these user devices 100. For example, the GEM system 10 can be utilized with the interactive program 200. In an aspect, the interactive program 200 can be a mobile game 200 hosted on a mobile device 100 like a tablet or smart phone, or a video game 200 played on a computer or console 100. While the GEM system 10 can be utilized with any interactive program 200 that operates on a user device 100, it is preferable that the program 200 has some type of advancing gameplay or mechanism that advances the user through the program 200, Further, the GEM system 10 is configured to be used with various user devices 100 that have communication means, discussed in more detail below.
In aspect, the interactive program 200 can take the form of a downloadable program available via various networks (e.g., internet 150) and various application stores (e.g, Google Play, Apple Play, etc.) to be used on various user devices 100. In other aspects, the interactive program 200 can be distributed physically (e.g., via a disk, a portable drive, or preloaded). In an aspect, as shown in
In any aspect, the GEM system 10 has the ability to collect interaction data from the interactive program 200 based upon user interaction for analysis. Further, the GEM system 10 is configured to communicate with several user devices 100 on which the interactive programs 200 are used. In such aspects, the user devices 100 can be any device on which an interactive program 200 can operate and has the ability to communicate to other devices via a network. In another aspect, the GEM system 10 can be configured to work with several different interactive programs 200 at the same time. In such aspects, all that is needed is a way to clearly identify the different interactive programs 200 from one another (e.g., a program ID). In an aspect, the collected data can be transmitted in real time to the GEM server 300 over a network 150 for storage (database 310) and analysis (analyzer 320), In other aspects, the GEM system 10 can be configured to collect the data locally (save in file on the user device 100) which can be downloaded and analyzed later.
In an aspect, the server 300 of the GEM system 10 can be affiliated with the developer of the interactive program 200. For example, the server 300 can be that of the developer of the interactive program 200. In other aspects, the server 300 can be configured to act as an intermediate with a separate server operated and controlled by the developer. Therefore, references to a server 300 herein cover both functionalities.
In an aspect, illustrated in
The game tags 202 are snippets of code/short strings that serve as markers within the code 204 of the gameplay 206. The game tags 202 are placed in the game/interactive program 200 by the game developer at any point of interest in the game flow 206. This is done by inserting special ‘tag’ lines of code 202 directly in the general code 204 of the game, or by adding tag nodes 202 (see the boxes in
In an aspect, as shown in
In an aspect, the GUI 332 of the game tag manager 330 of the GEM system 10 allows a designer to place the game tags 202 within the gameplay 206 of the program code 204 during programing or after programing according to an aspect of the present invention. The game tags 202 can be entered into code 204 directly, or through nodes (see
The GEM system 10 can be used with a program 200 even after the game has been developed, as long as the developer can go back to the code 204 and retroactively implement it, though it is best done during game development. Since the game tags 202 necessary for various games are dependent on the particular game, custom game tags 202 can be created to suit the game. In some aspects, the GEM system 10 utilizes the GUI 332 of the game tag manager 330, where a game developer can input text, and generate all the game tags 202 that are necessary for their particular game at the onset through a simple user interface, before proceeding to place the game tags 202 within the game code 204 of the gameplay 206. In another aspect, APIs (e.g., set of simple lines of code that allows other developers to retrieve the GEM functionalities) can be used for this, so that any game developer can access the libraries and processes to generate the game tags 202.
During gameplay, when the player reaches or activates tagged points thereby indicating the player's current status in the game or the interactive program 200, a game tag 202 is tripped. Tripped means that a particular tag 202 has been triggered. The triggering happens in the game 200, during gameplay when the player completes what the game tag 202 is checking for. When it is triggered, a small text string (e.g. “Making Tea Activity Initiated” “Making Tea Activity 50% completed” “Making Tea Activity Exited” etc.) may be transmitted to a remote server 300. When a tag 202 is tripped, the information is sent from the game 200, via a network 150 (e.g., the internet), to the GEM server 300. The information sent can include the tag 202 and the current time stamp. For example, a user can be playing a game 200 on a mobile tablet 100 or a PC 100, and the tag 202 and time stamp are transmitted via the internet 150. In an aspect, this is done instantly. In other aspects, that data can be sent periodically only—say every 1 minute or so. In other aspects, as discussed elsewhere, the game tag information can be stored for later uploading and analysis with the data being stored on the user device 100 until called to be sent out.
In an aspect, for improving overall gameplay of the program 200, names or identifiable data of players are not tracked by the GEM system 10, which therefore keeps identities protected. In another aspect, for use with the reporting module 340 (discussed in more detail below) the GEM system 10 can track an individual performance using a Device ID associated with the user device 100. In an aspect, the Device ID can be randomly generated number by GEM system 10, the manufacturer of the user device 100, or by the distributing platform of the program 200 (e.g., by Apple or Google when an app is downloaded into a device from their app stores). In such aspects, a user of the program/game 200 can create a profile to play the game 200, which information can also be included and tracked by GEM system 10. In an aspect, profile names are pre-made, and are not customized by the player. For example, the GEM system 10 may implement profile names as names of fruits and vegetables (e.g. apple, orange, carrot, celery etc.). In other aspects, profile information, provided by the user of the program 200, can be used as well. In an aspect, the GEM system 10 may also track location information of the device 100 (e.g., the city name that the app was downloaded to). This data can be collected by the device 100 operating the game 200, or from the distributor (e.g., Google and Apple). So, in some aspects, a combination of the city ID, device ID, and the profile name is sufficient of an identifier to denote a particular user in a particular part of the world. This is useful for macro data of the game. This is a piece of information that can be used for the following: where in the world are players playing the game; what countries or cities seem to like the game more; what cities do not seem to like this particular feature of the game; should advertising increase in that city?
The game tags 202, when tripped, are configured to capture and transmit any data that can be generated from the user's gameplay/activity within the program. This data can include player status (e.g., health, experience level, points earned, attributes gained), player progress (stage of the game, percentage completed, events completed, tasks completed), and the like. Below are some examples of events and the data generated when a game tag 202 is tripped.
The moment a new map is entered by the player. [Game event: Map Activity; Name of Map: Forest. Status: Entered; Timestamp: 2021-01-19 03: 14:07]
The moment a player exists a new map. [Game event: Map Activity; Name of Map: Forest. Status: Exited; Timestamp: 2021-01-19 03: 14:07]
The moment a collectible has been picked up by the player [Game event: Name of Map: Forest; Activity: Collectible pickup; Name of Collectible: Blue Shell; Status: Collected; Timestamp: 2021-01-19 03: 14:07]
In an aspect, tags 202 can also be automatic. The developer can choose the game to relay situations of the player at regular intervals (as in the state of the player below). In addition, periodic broadcasting of the health state of the player tags can be utilized, producing the following event. [Game event: Health status; Current health: 25%; Timestamp: 2021-01-19 03: 14:07]
Tags can also be set up to relay when particular situations occur in the game. In the example below, the trigger is tripped when the game detects that the player has been stuck-frozen/not responsive: Mobility state of the player [Game event: Mobility; Mobility state: Immobile; Time: 3.34 minutes; Timestamp: 2021-01-19 03: 14:07]
The above are examples of the data collected, and are no way mean to limit the data transmitted. The game tags 202 can capture and report any data that is associated with a user's progress in the program 200.
Once generated, the information collected by the game tag 202 can then be transmitted from the user device 100 to the server 300 via the internet 150. In an aspect, the game tags 202 are then stored in a real time database 310 (See
The GEM system 10 can then analyze the data as collected. In an aspect, the GEM system 10 includes an analyzer program 320. In an aspect, a standard query list used to sort and filter the data collected for the analyzer 320 can be viewed in an analyzer associated GUI 321, as shown in
Examples of queries, and the algorithm used to get the answers:
The above questions are merely examples of questions that the GEM system 10, via the analyzer 320, can use to assist in reviewing and generating useful data for a developer.
Depending on the specific needs of specific game developers, data can be mined and customized to their special needs. In an aspect, AI and machine learning can be utilized to review the code 204 and gameplay 206 of the interactive program 200 to analyze the events and determine what type of questions and data should be requested in game tags 202. Various other questions that would be useful for the analysis of data resulting from the gameplay of a program can be utilized. In other words, there are no limits on the questions that the analyzer 320 can use. In an aspect, developers utilizing the GEM system 10 can create and implement theft own questions, selecting the desired data they want analyzed and how they want such data to be analyzed. Questions can also be asked about large population-based behaviors. Example:
As shown in
The analyzed data 326, once gathered and selected, can be used in various ways, including in game development. The analyzed data 326 can be reviewed by the developers to determine what areas of the game should be improved. For example, if the developers find that many players do not do activity X in sufficient numbers, there could be an error (e.g., a bug) with the game code 204 with activity X. The developers can then examine the game/program at activity X, identify the error, and correct it. The game can then be updated almost immediately to check to see how the public responds. If the correction is effective, then the GEM system 10 would report back that a sufficient number of people completing activity X. In some aspects, the AI and machine learning can also suggest corrections for the game play 206 and code 204.
In addition, the analyzed data 326 can be used for user feedback. For example, for educational games directed at children, the GEM system 10 can collect data about a specific user, analyze the data, and send to the parents, via a reporting module 340, to show the child's progress throughout the game. For example, if the game is directed at reading, the GEM system 10 can monitor the child's progression through the game (e.g. Johnny completed 54 out of 60 word activities last week), and report back the results to the parent. The reports are compiled by GEM, to send to (in our case) parents about how their child is doing in the game. Metrics is basically a report that describes scores the player obtained at various game challenges (such as a quiz, a puzzle etc.) So, tags 202 can be utilized to improve the game program itself, as well as to track and evaluate the progress of individuals as they participate with the interactive program.
In some aspects, the GEM system 10, and its components, are able to identify that the poor performance of an individual is not the result of a mistake in the coding 204, but the lack of focus of the individual. In such instances, the GEM system 10 can provide tools to the user to supplement or improve their performance. In an aspect, the GEM system 10 can provide a focus improving mechanism 350 for the user. The focus improving mechanism 350 can provide suggestions and instructions to the user that assist in improving the individual's performance. The focusing improvement mechanism 350 can utilize text, visual/graphical, and audio components, as well as interactive means, to help improve the individual's performance. In an aspect, the focus improving mechanism 350 can be a component of the GEM system 10, or it can be programmed directly into the interactive program 200.
As discussed above, a player may use a video game 200 to supplement or improve their learning of certain skills. For example. The Magical I Am™—Sky Village™ application is an example of such an interactive game 200 which helps improve the learning experiences of children. In this game 200, it is useful to know at which point the player (e.g. a child with dyslexia) has difficulty and may require using techniques to focus their attention. The GEM system 10 can provide the monitoring functionality (via the reporting module 340, which can identify and track individual performance) needed to identify such an occurrence of loss of focus or increased frustration. Upon identifying this time period in game play, the GEM system 10, utilizing the game tags 202 in some instances, can call upon the focus improving mechanism 350. Referring back to the Sky Village application 200, the focus improving mechanism 350, which can include a focal point 352 called a Bindu Focus according to an aspect, within this game, can be utilized, as best described in reference to
For example, the character guide 354 asks the player to “check your Mind's Eye”, with a graphical representation of the Mind's Eye 356 appears on the screen. The Mind's Eye 356 is a focal point on which the user can concentrate. Then the Mind's Eye 356 may be shown above the head of the player avatar 524 as shown in a third frame 506.
Vocal instructions can be given as well. For example, the voice of the character guide 354 may give verbal instructions to the player. For instance, the instructions may include “on my count, take a deep breath” or “breathe in slowly. Hold 1, 2, 3. Now breathe out slowly” or “Now close your eyes” or “Close your eyes and breathe in slowly.” In an aspect, the focus improving mechanism 350 can monitor the actions of the user using components (e.g., camera, microphone, motion sensors) of the user device 100. In other aspects, the focus improving mechanism 350 does not monitor the actions of the user—this is done because in most instances, the user will follow the instructions of the focus improving mechanism 350. Otherwise, the GEM system 10 can be configured to have the user repeat activities in the game 200 until they have reached or surpassed the certain performance threshold that triggered the activation of the focus improving mechanism 350.
Additional effects may occur, such as music or other noises or visual effects, to encourage the player to follow the focus-inducing instructions. For example, the player avatar 524 can be configured to close its eyes in a fourth frame 508 following the advice from the character guide 354 to encourage the player to do the same. In some aspects, a facial recognition algorithm may be utilized to detect when the player viewing the screen closes their eyes, and have the player avatar follow suit, as a way of reinforcing the need to close the eyes to the player. Also, as shown in a fifth frame 510, the Mind's Eye 356 may be surrounded by a glowing aura 358. In other aspects, various other graphics and effects can be employed to assist the player focus.
In addition, the focus improving mechanism 350 can include an interactive component that requires confirmation of the user to perform a certain activity. For example, as shown in a sixth frame 512 the focus improving mechanism 350 may require the player to move a mouse icon (e.g. a pointing finger) 360 onto the Mind's Eye 356 and select/click the Mind's Eyes 356. The required action can trigger additional actions. Additional commands (vocal or text) or visual actions can occur. For example, when the player clicks the Mind's Eye icon 356, the glow 358 surrounding the Mind's Eye 356 may grow larger until it pops (or other visual or audio effects may occur). The focus improvement mechanism 350 can then alert the GEM system 10 that the player is now “focused”, and can return them to game play. For example, the player can be returned to the game play frame (e.g., 502) (a spell activity in this example) to continue from where they left off.
In this example, the GEM system 10 might detect whether the player had answered a certain number of questions correctly, or attempted a certain number of questions and can feed that information back to the game developer. Another is that the game could try different types of animations (e.g. glowing auras or larger or smaller Mind's Eyes) and see whether one appeared more popular or helped more players progress further in the game.
In addition, the focus improving mechanism 350 can also measure the mood of the user. For example, the focus improving mechanism 350 can ask the player how they are feeling at that time, by, for instance, selecting an emotion from a list of emotions, or from a picture of a face icon displaying emotion. Some emotions might include happy, grumpy, sad, frustrated, angry, annoyed, etc. The player may be asked how they feel both before and after, for example, the Mind's Eye exercise to see whether the exercise improves their mood.
In an aspect, as discussed above, the GEM system 10 relies on user devices 100 of users (e.g., smart phones and tablets) which have certain built-in hardware (e.g., a display panel, a front facing camera, gyroscope, and accelerator) to carry out some functionality. Further, the GEM system 10 utilizes the GEM sever 300, with its built-in hardware, to carry out certain functions as well. These hardware components of both the user devices 100 and the server 300 can be found on standard mobile devices and servers, and are well known in the art.
The processor 1104 can contain a plurality of processers 1104. In an aspect, the processor 104 can be a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, a controller, a microcontroller, single core processor, a multi-core processor, an Application Specific Integrated Circuit, a Field Programmable Gate Array circuit, or any other type of integrated circuit. The system memory 1108 can also house the operating system 1109 and various applications 1160.
The display controller 1134 connects to one or more displays 1134. The one or more displays 1134 may include a touch screen display, a liquid crystal display, light emitting diode display, field emission display, organic light-emitting diode display, flexible organic light emitting diode display, or the like. Input/output (VO) controllers 1140 and I/O devices 1142 are connected via the computer bus 1102. The VO input devices 1142 can include, but is not limited to, side buttons, a touchscreen, a speaker, microphone, keyboard, keypad, touchpad, display, touchscreen, wireless gesture device, a digital camera, a digital video recorder, a force-feedback device, or the like. In an exemplary aspect, the I/O devices include at least a touchscreen, a front facing camera, buttons, microphones, and sensors, as discussed below.
The computing device 1100 can include a plurality of sensors 1144, such as, but not limited to, motion, proximity, light, optical, chemical, environmental, moisture, acoustic, heat, temperature, RFID, biometric, face recognition, image, photo, or voice recognition sensors and touch detectors (not shown) for detecting any touch inputs, including multi-touch inputs, for one or more display devices. One or more interface controllers 1106 may communicate with touch detectors and VO controller 1140 for determining user inputs to the computing device 1100. The computing devices 1100 can include various communication means 1150, including, but not limited to, network connectors, and various radios (including, but not limited to, Bluetooth, GPS, Cellular, NFC, and the like), for communicating with other devices,
The system memory 1108 and storage memory 1110 may be any disk based or solid-state memory device for storing data, including volatile or non-volatile memory. The system memory 1108 and storage memory 1110 can host the operating system 1109, and also store applications 1160.
Although several aspects have been disclosed in the foregoing specification, it is understood by those skilled in the art that many modifications and other aspects will come to mind to which this disclosure pertains, having the benefit of the teaching presented in the foregoing description and associated drawings. It is thus understood that the disclosure is not limited to the specific aspects disclosed hereinabove, and that many modifications and other aspects are intended to be included within the scope of any claims that can recite the disclosed subject matter.
It should be emphasized that the above-described aspects are merely possible examples of implementations, merely set forth for a clear understanding of the principles of the present disclosure. Any process descriptions or blocks in flow diagrams should be understood as representing modules, segments, or portions of code which comprise one or more executable instructions for implementing specific logical functions or steps in the process, and alternate implementations are included in which functions may not be included or executed at all, can be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present disclosure. Many variations and modifications can be made to the above-described aspect(s) without departing substantially from the spirit and principles of the present disclosure. Further, the scope of the present disclosure is intended to cover any and all combinations and sub-combinations of all elements, features, and aspects discussed above. All such modifications and variations are intended to be included herein within the scope of the present disclosure, and all possible claims to individual aspects or combinations of elements or steps are intended to be supported by the present disclosure.
This application is a divisional application of U.S. patent application Ser. No. 17/526,686, filed Nov. 15, 2021, which claims priority to U.S. Provisional Application No. 63/113,548, filed on Nov. 13, 2020, the contents of all of said applications being hereby incorporated by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| 63113548 | Nov 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17526686 | Nov 2021 | US |
| Child | 18522969 | US |
