Patent Application
20150258436
There are many ways that a user can interact with a computer game and typically a user controls the game via a keyboard and mouse, games controller (which may be handheld or detect body movement) or touch screen, dependent upon the platform on which the game is being played (e.g. computer, games console or handheld device). A number of games have also been developed in which gameplay is enabled (or unlocked) through the use of physical character toys which are placed on a custom base connected to a games console. By placing different toys on the custom base, different gameplay is enabled.
The embodiments described below are not limited to implementations which solve any or all of the disadvantages of known gaming systems.
The following presents a simplified summary of the disclosure in order to provide a basic understanding to the reader. This summary is not an extensive overview of the disclosure and it does not identify key/critical elements or delineate the scope of the specification. Its sole purpose is to present a selection of concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later.
A data store for a modular assembly system is described. The data store comprises a number of records, each record relating to a physical module in the modular assembly system and comprising a module ID, a properties field and in various examples, an owner ID for the module. The properties field(s) define any property of the module and different records may define different properties. At least one of the fields in each data record (e.g. the module ID or owner ID) is verified by an authentication service. A user assembles two or more modules into a coherent physical whole object to act as a user input device to an interactive software experience. The data store communicates with the interactive software experience and causes a change in behavior of the interactive software experience in response to a check of the data records for each of the modules in the object.
Many of the attendant features will be more readily appreciated as the same becomes better understood by reference to the following detailed description considered in connection with the accompanying drawings.
The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein:
Like reference numerals are used to designate like parts in the accompanying drawings.
The detailed description provided below in connection with the appended drawings is intended as a description of the present examples and is not intended to represent the only forms in which the present example may be constructed or utilized. The description sets forth the functions of the example and the sequence of steps for constructing and operating the example. However, the same or equivalent functions and sequences may be accomplished by different examples.
A system is described below which comprises a data store that stores information about physical modules which are components of a larger user-assembled object. A user can connect two or more of the modules together to form a coherent physical whole object (which may be referred to as a ‘modular toy’) and by selecting different combinations and/or arrangements of modules, different objects can be created. The data store (which may be a central store or distributed) comprises a number of data records, each record being associated with a physical module and comprising a module ID (i.e. an identifier for the module), one or more properties of the module and in various examples, an owner ID (i.e. an identifier for the owner of the module). At least one of the module ID and owner ID fields are verified by an authentication service. The data store provides an interface to enable an interactive software experience (such as a game) to check one or more records and this check may trigger a change in the behavior of the interactive software experience, or may cause other actions such as changes to the data in the data store (e.g. recording history of use of the toy). As described in more detail below, the checking may be performed by the interactive software experience or the data store itself (in response to a request by the interactive software experience). Records in the data store may be updated by the interactive software experience, a module (e.g. the module to which the record relates or another module) or another application.
In addition to being affected by the outcome of the check of one or more records in the data store, operation of the interactive software experience is also affected by the particular combination of modules which are put together to form the object and in various examples by any subsequent user interaction with the object, as the object acts as a user input device for the interactive software experience. User interaction with one or more modules or one or more objects (formed from modules) translates into inputs to the interactive software experience and the translation (from user interaction to interactive software experience input) may be performed within a module, within the object and/or within the interactive software experience.
The data store 101 comprises a plurality of data records 110, each record being relating to (i.e. being associated with) a physical module 106 and comprising the ID of the module 112 (or module ID), an identifier for the owner of the module 114 (or owner ID) and one or more properties 116 of the module. At least one of the module ID 112 and owner ID 114 fields are verified by an authentication service 118 (which may form part of the system 100 or be external to the system) and the data store 101 and/or the interactive software experience 102 may communicate with the authentication service 118. An authentication service provides a method of securely verifying properties about a field's value, e.g. that the owner ID is correct, or that the module ID has been issued to the module by a trusted party and thereby that the module is not a counterfeit. The module ID 112 for a module 106 may be unique to that module and the owner ID 114 is unique to the owner of the module (which may be a person or other entity, such as manufacturer of the module, or the owner of the design of the module which may license manufacturing rights to other companies), although a person or other entity may have more than one distinct owner ID. In various examples, the data records 110 may not include an owner ID field.
The properties field(s) 116 within each data record 110 may comprise any property of the module to which the record relates (as identified by the module ID 112). Examples of properties include, but are not limited to: GPS location data for the module (e.g. a “home” location and/or a current location), interoperability data (e.g. which other modules or types of modules the module can interwork with and/or which interactive software experiences the module can be used with), statistics for the module (e.g. length of time in use, etc.), virtual objects associated with the module (e.g. where these objects have been collected within an interactive software experience), permissions associated with the module (e.g. which fields within the data record can be changed and by whom and in various examples the permissions may be dependent upon the use of the object, such as which interactive software experience it is being used with), interactive software experience data (e.g. textures, device-executable instructions for the software experience or a part thereof, etc.), state data (which may be specific to a particular interactive software experience or independent of any interactive software experience) and references to a secondary (or further) database 120 (e.g. which may contain additional information about, for example, the owner of the module, as identified by the owner ID 114). It will be appreciated that where the properties field comprises sensitive user data, consent may be collected from the user to store and release this data.
In various examples the properties field 116 may define sets of modules, these sets of modules may, for example, be predefined sets of modules which work well together and which when used together unlock particular features of the interactive software experience. Similarly, sets may be defined which do not work well together. The sets may be advertised to the user or visible through module form factors (e.g. all modules that are robot body parts may work together, but modules which are animal body parts may not work with robot body parts) or in other examples, a set may be a particular combination that a user may discover through interaction with the modules. Although the sets are described above as being part of the constant data, in other examples, set data may form part of the variable data (described below), with sets forming over time (e.g. based on which modules a user regularly uses together to form an object).
Where the properties field 116 comprises interactive software experience data, this may comprise game data, such as:
Where the properties field 116 comprises state data, this may comprise state data which is specific to a particular interactive software experience (e.g. game dependent) or independent of the interactive software experience with which the module is used (e.g. game independent). Examples of state data which is independent of the interactive software experience with which the module is used include:
Examples of state data which is specific to a particular interactive software experience include:
Where the properties field 116 comprises a reference to another database, this database may contain additional information about the owner of the module as identified by the owner ID 114 within the data record 110. By using such a reference, an owner may have properties (e.g. state, user characteristics, permissions, etc.) which are reflected in all the modules that they own. Where the reference identifies user characteristics (e.g. a user's age), this may enable different permissions to be associated with modules based on user characteristics of the owner (as identified by the owner ID 114).
Where the properties field 116 comprises a reference to another database, this database may contain additional information about the module, such as generic properties which are applicable to all modules of a particular type. By using such a reference, properties may be reflected in a group of modules such that properties do not need to be replicated within each data record 110 for each module in the group and/or stored within the interactive software experience. In an example, all modules of the type “robot arm” may comprise a link to a database entry which details the generic properties for all robot arms. Modules of the type “robot head” may comprise a link to a different database entry which details the generic properties for all robot heads.
It will be appreciated that the secondary database 120 may be part of the system 100 or external to the system. Furthermore, where the secondary database 120 is part of the system 100 it may be co-located with the data store 101.
Through inclusion of different elements within the properties field(s) 116, various different mechanisms are enabled within the system 100, such as enabling transactions involving modules, theft prevention, anti-counterfeiting measures (e.g. anti-cloning, anti-copying), etc. and these and other examples are described in more detail below. Whilst the interactive software experience changes its behavior in response to a check of a plurality of data records, it will be appreciated that where counterfeit or stolen modules are identified as a result of these checks, the interactive software experience may not change its behavior in a way which is visible to the user (e.g. the problem may be flagged to a third party in a manner which is not visible to the user, for example, for offline action). Alternatively, although there may be a change in the visible behavior, this may be unrelated to the identification of a module being counterfeit or stolen (but may be in response to other aspects of the check performed) and any flagging of the issue with the module may be performed by the data store rather than the interactive software experience.
Although
Furthermore, although
Once assembled by a user from the modules 106, 202, 204, the coherent physical whole object 108 is physically attached together to form a single object, i.e. requiring a deliberate action by the user to detach (e.g. an applied force to overcome a mechanical friction fit or a magnetic attachment holding the modules together, or an unclasping or threading action so that a module can be removed or disconnected from an adjacent module). This is in contrast to systems in which a module or modules are sensed to be near or touching one another, but no mechanical element holds them together (with the exception of gravity, if the whole assembly is only lifted vertically from underneath). The coherent physical whole object 108 is moveable freely (e.g. in three dimensions) by a user and is capable of communicating with the interactive software experience while it is in motion. The coherent physical whole object 108 (and/or the modules from which it is formed) may comprise mechanical articulation or movement affordances, e.g. it may have joints such as hinges, or some elements may be mobile compared to other elements, e.g. sliding or rotation with respect to one another.
The modules 106, 202, 204 may, for example, represent parts (e.g. head, body, limbs) of a humanoid/animal/mystical character (e.g. a human, animal or robot), vehicles or parts thereof (e.g. chassis, wheels, roof, etc.), accessories for a vehicle or character (e.g. weapons, clothing, armor, or other objects which the character may wear/carry/hold), tracks (e.g. for a car, train, human, animal or other mobile object), bricks (e.g. as part of a construction set), baseboards or levels (e.g. where the tracks/bricks/baseboards/levels may form part of a playset such as a train set, model village, tower block, dolls house or other construction) or parts of an educational toy (e.g. parts of a molecular model, skeleton or body, etc.).
At least one of the modules 106, 202, 204 in the coherent physical whole object 108 comprises a communications module 212 which enables the module 202 to communicate with the game software 102. Any suitable communication technology may be used, including wireless technologies (e.g. Bluetooth®, Bluetooth® Low Energy (BLE), WiFi™ or WiFi™ Direct, Near Field Communication (NFC), 802.15.4, etc.) and wired technologies. The communications module 212 may communicate directly with the computing device 104 running the interactive software experience 102 (e.g. smartphone, tablet computer, games console, etc.) or may communicate via a network (e.g. a home network or the internet) or intermediary device (e.g. a wireless access point) or intermediary server (e.g. cloud server).
The information which is communicated from the coherent physical whole object 108 to the interactive software experience 102 (via the communication module 212) comprises the IDs of the modules 106, 202, 204 and may also comprise information about their arrangement (which may be referred to as topology information), sensor data (if any of the modules include sensors), some or all of the module data stored in the modules etc. Where only one of the modules comprises a communication module 212 (e.g. as shown in
In various examples, one or more of the modules (e.g. a module 202 which also comprises a communication module 212) may also comprise a processor arranged to collect the IDs of other modules (e.g. all modules or a subset of modules) connected to form the coherent physical whole 108 and to collect other data from each of the modules. The processor may be a microprocessor, controller or any other suitable type of processor for processing computer executable instructions to control the operation of the core module in order to collect data from connected modules. In various examples, the data may be collected by a core module from each of the connected modules directly (e.g. via a bus which is electrically connected via the connectors or other means, such as using NFC, QR codes or computer vision). In other examples, however, each module may collect information on its neighbors such that a core module aggregates the data provided by its direct neighbor modules.
It will be appreciated that the modules 106, 202, 204 may comprise additional elements not shown in
The operation of the system 100 shown in
As described above, the data store 101 stores a plurality of data records 110, each relating to a physical module 106 which can be connected to other modules 106 by a user to form a coherent physical whole object 108. Each record 110 comprises a number of fields, including the module ID 112, properties 116 and optionally an owner ID 114.
When an object initially connects to an interactive software experience 102, the interactive software experience 102 receives data identifying the modules forming the object (block 402), as shown in
In response to receiving a request for data (or access request) from the interactive software experience (block 306), the data store 101 provides the corresponding data to the interactive software experience (block 308), e.g. the data store 101 may send the data record (or a subset of each data record) for each of the modules identified in the access request to the interactive software experience. In some examples, the data may not be sent (in block 308) unless the data store successfully authenticates the interactive software experience (block 310). The authentication may involve the authentication service 118, e.g. via the use of shared secret and a challenge/response sequence, public/private key encryption, one-time key generation, or any other authentication technique.
When the interactive software experience receives the data records from the data store (block 406), it performs a check on those records (block 408). The check (in block 408) may, for example, involve checking that the user of the interactive experience owns the modules they are using or has been given permissions to use that module by the owner (e.g. for theft prevention), checking that the modules forming the object are permitted to be used together (e.g. based on interoperability data in the properties field 116), checking that the modules are permitted to be used with the particular interactive software experience (e.g. again based on interoperability data in the properties field 116), checking that the module is not counterfeit (e.g. based on using the authentication service to verify that its manufacture was approved), checking against geographic location (e.g. modules which are released only within a certain set of countries), checking against time or date (e.g. a prerelease module might be physically distributed but only become usable on a given day), checking against known blacklists or whitelists (e.g. checking that a module has not been reported destroyed and a replacement issued), etc. Based on the outcome of the checks performed (in block 408), the interactive software experience updates the way that it operates (block 410). There are many different ways that the operation may be affected and three examples are shown in
For example, functionality may be disabled (in block 414) where a permissions or interoperability field (within the properties field(s) 116) indicate that the module cannot be used with the particular interactive software experience. In various examples this may be user dependent or dependent on characteristics of the owner, where these characteristics may be stored within a data record or within a secondary database referenced within the data record.
There are many ways in which functionality (e.g. game play, where the interactive software experience is a game) may be modified (in block 416). The modification may be to the graphical user interface (GUI) and/or to the sequence of instructions/events within the interactive software experience (e.g. dependent upon the outcome of the check, different sequences of instructions/events may occur, instructions/events may be omitted/added to a sequence, etc.).
As also shown in
In the method described above the data check is performed by the interactive software experience (in block 408) based on the data records provided to it by the data store 101 (in block 308). In other examples, however, the checks may be performed by the data store 101 instead of the interactive software experience 102, or both parties (the data store 101 and the interactive software experience 102) may perform some checks.
In various examples where checks are performed by the data store 101 instead of the interactive software experience 102, the interactive software experience 102 generates a data query based on the module data received from the modules (block 420). The data query is sent to the data store (block 422) and in response to receiving the data query (block 320), the data store analyzes the query and the corresponding data records (block 322), where again the corresponding data records are those records having module IDs which match those module IDs identified in the query. The analysis performed (in block 322) may be similar to the checks described above (with reference to block 408), for example, checking that the user of the interactive experience owns the modules they are using (e.g. for theft prevention), checking that the modules forming the object are permitted to be used together (e.g. based on interoperability data in the properties field 116), checking that the modules are permitted to be used with the particular interactive software experience (e.g. again based on interoperability data in the properties field 116), etc. Having performed the analysis (in block 322), the data store provides a query result to the interactive software experience (blocks 324 and 424) and this is used to update the operation of the interactive software experience (in block 410).
There may be some checks that are performed that can only be performed by the data store 101 and not by the interactive software experience 102, such as checking that a module ID is a valid ID (e.g. as part of an anti-copying measure) and checking for duplicate module IDs (e.g. as part of an anti-cloning measure).
In various examples there may only be a single data record associated with a single physical module; however in other examples multiple data records may be used for the same physical module (i.e. having the same module ID) to record the activities of multiple users using the same object (e.g. different members of a family). Where there are multiple data records with the same module ID, these data records are distinguished based on the owner ID (which corresponds to the user). Use of multiple data records for the same physical module in this way may enable different users to have different permissions (e.g. to implement parental control functionality such that a user who is a child can only use the module with child-friendly games).
In various examples, the access request (received by the data store in block 306) and/or the analysis (performed by the data store in block 322) may result in an update to a data record for a module (block 326). For example, where the properties field(s) 116 for a module include data about its use, this data may be updated each time an interactive software experience indicates to the data store (by means of an access request or data query) that a module is being used with it. In another example, where the analysis performed by the data store (in block 322) identifies an anomaly, the data record to which the anomaly relates may be updated to prevent further use of the module (i.e. to effectively deactivate the module). The deactivation may be achieved by setting a properties field to ‘inactive’ or ‘deactivated’ or similar and/or by removing some or all of the data record from the data store. Examples of an anomaly may include a user who is not the owner using a module or identification of a duplicate module ID (e.g. two modules with the same module ID being used simultaneously within the system 100 or two modules with the same module being used within a short time period within the system 100 but at distant geographic locations) etc.
There may be other situations which result in a data record being updated to prevent further use of the module. In various examples, the data store may provide an interface to enable a user to update data records for modules that they own, i.e. data records which contain their owner ID 114. This may, for example, enable a user to communicate with the data store 101 if one of their modules is lost or stolen and as a result the modules may be deactivated. Such an interface 502, which is shown in the system 500 in
Where the transfer (e.g. sale or loan) is a hardware swap, users physically transfer the actual module (e.g. from user A to user B) and communicate with the data store to cause the data record associated with the module to be updated from {module ID, owner ID=user A, properties} to {module ID, owner ID=user B, properties}. In contrast, where the transfer is a software swap, there is no physical transfer of a module and instead the properties of a physical module (e.g. module A) belonging to one user (e.g. user A) are instead associated with a physical module (e.g. module B) belonging to another user (e.g. user B). Again, at least user A (i.e. the owner of the module the properties of which are being transferred) communicates with the data store to cause the data records for the two modules to be updated from {module ID=module A, owner ID=user A, properties=properties of module A} and {module ID=module B, owner ID=user B, properties=properties of module B} to {module ID=module A, owner ID=user A, properties=default value} and {module ID=module B, owner ID=user B, properties=properties of module A}. In other examples, instead of swapping properties, the module IDs and/or owner IDs may be swapped, for example, the data records for the two modules to be updated from {module ID=module A, owner ID=user A, properties=properties of module A} and {module ID=module B, owner ID=user B, properties=properties of module B} to {module ID=module B, owner ID=user A, properties=default value} and {module ID=module A, owner ID=user B, properties=properties of module A}. As a result of the software swap, module B now operates as if it is module A. Module A may be deactivated as a result of the transfer or reset to factory default properties.
As described above, transfers may be permanent (e.g. where a module is sold) or temporary (e.g. where a module is lent to another user). Where the transfer is temporary, one of the fields in the data record 110 (which may be the owner ID 114 or a properties field 116) may record the permanent owner (e.g. user A in the example above) and another field may record the temporary owner of the module (e.g. user B in the example above). In an example, the owner ID 114 may record the current owner (whether a temporary or permanent owner) and a properties field 116 may record the ID of the permanent owner of the module (where this may be the same or different from the ID stored in the owner ID field).
The software swap mechanism described above may also be used in the event that a physical module is lost, stolen or broken. A user (or system administrator) may transfer the properties field(s) associated with the module that is being replaced to another (e.g. a new) physical module such that this physical module provides an exact replacement (in terms of functionality within the system 100) for the lost/stolen/broken module. In various examples, the interface 502 may provide the functionality to enable a user to order a replacement physical module and the software swap may be performed by the system administrator prior to shipping the module to the user or by the user when the replacement physical module is received.
The interface 502 may enable a user to update other aspects of a data record (in addition to, or instead of, the owner ID as described above), such as the properties field(s). In an example, the interface 502 may provide a user with the ability to set or change permissions associated with a module. This may, for example, be used where a user lends a module to another user and wants to limit the changes to the module properties while the other user is using it. In various examples, a user may set the properties field(s) of a module to be read only (e.g. by setting a permissions field within the properties field(s)) so that the temporary owner of the module can use the module with interactive software experiences but any interaction with the interactive software experience does not result in a change in the data record (e.g. referring back to
The interface 502 may, for example, be provided by a cloud-based service. As described above, this service may provide centralized access to the data records 506 for both interactive software experiences 102 and users 504.
Although in the above examples, the owner ID 114 corresponds to a user who owns the module, as described earlier, the owner ID may alternatively identify an entity other than a user, such as the manufacturer of the module or a licensee (e.g. of a particular character that the module resembles part of) and may be referred to as a manufacturer ID. In such examples, the manufacturer ID may, for example, implicitly provide interoperability information (e.g. modules can only be used with other modules having the same owner ID), although this may also apply where the owner ID corresponds to a user. In examples where the owner ID is a manufacturer ID and this manufacturer ID is verified using an authentication service, this may be used as an anti-counterfeiting measure (e.g. such that only genuine modules with a valid manufacturer ID as verified using the authentication service can be used).
In various examples, a module 106, 202, 204 stores a secret key (e.g. in storage element 206 as shown in
In another example, the secret store may operate using a challenge-response protocol, whereby it receives a challenge (a data sequence) and returns the response (another data sequence which is the result of taking the challenge data and applying cryptographic operations based on the secret key, e.g. signing the data with the secret key which may be the private key in a public/private key system). The authentication service therefore operates by providing random challenges to the interactive software experiences (e.g. game clients) for forwarding to the modules, then when the authentication service receives the response(s) to the challenge (e.g where in one mode of operation the same challenge data to be used for all the parts in a coherent whole or alternatively different challenges may be used for each module in the object), it can provide verification to the game client. The verification may be at a high level.
In a third example, the interactive software experience (e.g. game client) itself may be untrusted and require verification as part of the process. For example, the above process may be augmented such that the interactive software experience first authenticates (i.e. proving it knows a shared secret) to the authentication service, and then the authentication service's challenges (to be sent to the parts) may be verifiably sent from the authentication service (i.e. the challenges are themselves “signed” by the authentication service to prove their origin is the authentication service itself). This has advantages in that it prevents the modules from sending any authentication data to untrusted interactive software experiences (since the interactive software experiences must get “permission” from the authentication system in the form of a signed challenge before the modues will respond to the challenge) and hence makes it more difficult to break the security system within a module, e.g. through conducting many iterations of challenge-response requests with the part in order to gather data which could be used to breaking the secret key (some types of such attack may be referred to as “known plaintext” attacks). While this arrangement of communications has the advantage outlined, there are other ways of architecting this system that may have other advantages, e.g. by building in the authentication service into a trusted interactive software experience, the interactive software experience may authenticate itself to the modules directly and then request the modules authenticate back, to allow both interactive software experiences and modules to be sure that the other party is trusted before enabling gameplay to occur, without relying on an internet connection to an internet-based authentication service.
In a fourth example, there may be no secret key—e.g. for a counterfeiting system, it suffices that the authentication service receives details of the module IDs sent from each module, and can then track and act on possible counterfeiting occurrences, e.g. because the same module ID is offered by many interactive software experiences, because requests originate from many geographic locations such that a single module is unlikely to have physically been at each place, or the number of requests is too high to feasibly come from a single user. The authentication service could blacklist IDs following such patterns. To handle the case that a counterfeit part is programmed to change its ID (e.g. picking a random ID), the authentication service could examine data such as the known valid module IDs that have been manufactured (which may be a sparse subset of the address space, i.e. not easily guessable by using a random ID), the number of module IDs that a given user or given game client is putting forward for authentication (e.g. detecting behavior of a user who apparently uses each module ID only once or a few times, or a user who apparently owns an infeasible number of modules, e.g. 1000s—which is a strong indication of the module using random-address behavior and hence being counterfeit), or that the user is the registered owner of the module ID. Sanctions can include suspending that user's ID (e.g. Xbox LIVE® ID) or suspending access by that game client to the authentication service.
Computing-based device 600, 620 comprises one or more processors 604 which may be microprocessors, controllers or any other suitable type of processors for processing computer executable instructions to control the operation of the device in order to run the interactive software experience 102 or provide the interface 628 to the data records 110. In some examples, for example where a system on a chip architecture is used, the processors 604 may include one or more fixed function blocks (also referred to as accelerators) which implement a part of the functionality in hardware (rather than software or firmware). Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs).
Platform software comprising an operating system 606 or any other suitable platform software may be provided at the computing-based device to enable application software, such as the interactive software experience 102 or interface service 628 to be executed on the device.
The computer executable instructions may be provided using any computer-readable media that is accessible by computing based device 600, 620. Computer-readable media may include, for example, computer storage media such as memory 608, 628 and communications media. Computer storage media, such as memory 608, 628, includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device. In contrast, communication media may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transport mechanism. As defined herein, computer storage media does not include communication media. Therefore, a computer storage medium should not be interpreted to be a propagating signal per se. Propagated signals may be present in a computer storage media, but propagated signals per se are not examples of computer storage media. The memory 628 is also arranged to store the data records 110.
Although the computer storage media (memory 608, 628) is shown within the computing-based device 600, 620 it will be appreciated that the storage may be distributed or located remotely and accessed via a network or other communication link (e.g. using communication interface 610). The communication interface 610 enables the computing-based device 600 to communicate with modules 106 and the two computing-based device 600, 620 to communicate with each other, either directly or via a network or intermediary device. The communication interface 610 may use wired or wireless technology.
The computing-based device 600 also comprises an input/output controller 612 arranged to output display information to a display device 614 which may be separate from or integral to the computing-based device 600. The display information may provide a graphical user interface. The input/output controller 612 may also be arranged to receive and process input from one or more devices, such as a user input device 616 (e.g. a mouse, keyboard, camera, microphone or other sensor). In some examples the user input device 616 may detect voice input, user gestures or other user actions and may provide a natural user interface (NUI). This user input may be used to select or control the interactive software experience 102. In various embodiments the display device 614 may also act as the user input device 616 if it is a touch sensitive display device. The input/output controller 612 may also output data to devices other than the display device, e.g. a locally connected printing device (not shown in
Any of the input/output controller 612, display device 614 and the user input device 616 may comprise NUI technology which enables a user to interact with the computing-based device in a natural manner, free from artificial constraints imposed by input devices such as mice, keyboards, remote controls and the like. Examples of NUI technology that may be provided include but are not limited to those relying on voice and/or speech recognition, touch and/or stylus recognition (touch sensitive displays), gesture recognition both on screen and adjacent to the screen, air gestures, head and eye tracking, voice and speech, vision, touch, gestures, and machine intelligence. Other examples of NUI technology that may be used include intention and goal understanding systems, motion gesture detection systems using depth cameras (such as stereoscopic camera systems, infrared camera systems, RGB camera systems and combinations of these), motion gesture detection using accelerometers/gyroscopes, facial recognition, 3D displays, head, eye and gaze tracking, immersive augmented reality and virtual reality systems and technologies for sensing brain activity using electric field sensing electrodes (EEG and related methods).
Although the present examples are described and illustrated herein as being implemented in a system as shown in
The term ‘computer’ or ‘computing-based device’ is used herein to refer to any device with processing capability such that it can execute instructions. Those skilled in the art will realize that such processing capabilities are incorporated into many different devices and therefore the terms ‘computer’ and ‘computing-based device’ each include PCs, servers, mobile telephones (including smart phones), tablet computers, set-top boxes, media players, games consoles, personal digital assistants and many other devices.
The methods described herein may be performed by software in machine readable form on a tangible storage medium e.g. in the form of a computer program comprising computer program code means adapted to perform all the steps of any of the methods described herein when the program is run on a computer and where the computer program may be embodied on a computer readable medium. Examples of tangible storage media include computer storage devices comprising computer-readable media such as disks, thumb drives, memory etc. and do not include propagated signals. Propagated signals may be present in a tangible storage media, but propagated signals per se are not examples of tangible storage media. The software can be suitable for execution on a parallel processor or a serial processor such that the method steps may be carried out in any suitable order, or simultaneously.
This acknowledges that software can be a valuable, separately tradable commodity. It is intended to encompass software, which runs on or controls “dumb” or standard hardware, to carry out the desired functions. It is also intended to encompass software which “describes” or defines the configuration of hardware, such as HDL (hardware description language) software, as is used for designing silicon chips, or for configuring universal programmable chips, to carry out desired functions.
Those skilled in the art will realize that storage devices utilized to store program instructions can be distributed across a network. For example, a remote computer may store an example of the process described as software. A local or terminal computer may access the remote computer and download a part or all of the software to run the program. Alternatively, the local computer may download pieces of the software as needed, or execute some software instructions at the local terminal and some at the remote computer (or computer network). Those skilled in the art will also realize that by utilizing conventional techniques known to those skilled in the art that all, or a portion of the software instructions may be carried out by a dedicated circuit, such as a DSP, programmable logic array, or the like.
Any range or device value given herein may be extended or altered without losing the effect sought, as will be apparent to the skilled person.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments. The embodiments are not limited to those that solve any or all of the stated problems or those that have any or all of the stated benefits and advantages. It will further be understood that reference to ‘an’ item refers to one or more of those items.
The steps of the methods described herein may be carried out in any suitable order, or simultaneously where appropriate. Additionally, individual blocks may be deleted from any of the methods without departing from the spirit and scope of the subject matter described herein. Aspects of any of the examples described above may be combined with aspects of any of the other examples described to form further examples without losing the effect sought.
The term ‘subset’ is used herein to refer to a proper subset (i.e. such that a subset cannot comprise the entire set).
The term ‘comprising’ is used herein to mean including the method blocks or elements identified, but that such blocks or elements do not comprise an exclusive list and a method or apparatus may contain additional blocks or elements.
It will be understood that the above description is given by way of example only and that various modifications may be made by those skilled in the art. The above specification, examples and data provide a complete description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity, or with reference to one or more individual embodiments, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from the spirit or scope of this specification.
