The invention relates to gathering of data from remote locations and more particularly to gathering of metrics relating to applications in execution at the remote locations
Broadcast television has given rise to many related and ancillary industries. One such industry is the advertising industry. Advertising for television is a specialized industry that relies on past and present data to establish a value for advertisements displayed during a broadcast event. In order to support this advertising model, an entire industry exists to gather and analyse metrics of television viewership.
To this end, audiences are polled relative to their television viewing and statistics relating to viewership are determined. Similarly, each broadcast event such as a television show, television movie, a sporting event, etc., is reviewed to determine the advertisements within those broadcast events. Thus, the actual advertising content and the statistically analysed viewership are independently determined and verified by an organization to determine the metrics used to establish a value for advertisements. These metrics are typically referred to as “audited metrics” as their correctness is asserted by an independent metrics organization that asserts that it has verified the correctness thereof. One such metrics organization is the Nielsen Media Research™, which provides Nielsen® ratings that are, for the most part, audited.
A new medium into which advertising is now being inserted is the medium of video games. As a first generation of in-game advertisements, static product placements—product placements programmed into the game and that remain in the game each time it is played—were used. These first generation advertisements have metrics associated therewith calculated and gathered in a fashion similar to those for television viewership.
Presently, a next generation in game advertisement is being deployed. According thereto, product placements are inserted within video games dynamically such that each time a game is played, different advertisements may appear therein. Unfortunately, existing methods of determining metrics are not suited to function with these next generation in game advertisements. Problematically, the video games are not similar when played—different advertisements may be displayed in each; the video games are not played at a consistent time; and the video games are not played consistently by each player.
It would be advantageous to provide a method of determining metrics for next generation in game advertisements.
It is an object of the invention to provide a method of determining metrics for next generation in game advertisements.
In accordance with an embodiment of the invention there is provided a method comprising: providing video game software having executable code therein for dynamically inserting advertising data therein from an external source and for reporting data relating to impressions relating to the advertising data; executing the video game on a system for during execution inserting advertising data therein dynamically and for reporting data relating to impressions relating to the advertising data; and, comparing the reported data against impressions made during execution of the game to produce a comparison result.
In accordance with yet another embodiment of the invention there is provided a method comprising: providing video game software having executable code therein for inserting advertising data from an external source therein dynamically and for reporting data relating to impressions relating to the advertising data; executing the video game software on a system for during execution dynamically inserting advertising data therein and for reporting data relating to impressions relating to the advertising data; and, during execution of the video game, reporting the data relating to impressions relating to the advertising data in a secure fashion for avoiding tampering therewith.
In accordance with another embodiment of the invention there is provided a method comprising: providing video game software having executable code therein for dynamically inserting advertising data therein from an external source and for reporting data relating to impressions relating to the advertising data; executing the video game on a system for during execution inserting advertising data therein dynamically and for reporting data relating to impressions relating to the advertising data; and, during execution of the video game, automatically detecting advertising data dynamically inserted within the video game.
In accordance with another embodiment of the invention there is provided a method comprising: executing video game software on a gaming system; verifying a certification of at least a portion of the video game software to determine a first value; and, when the first value is indicative of a valid certification from a certifying body, reporting impression data from the video game software in execution, the reported impression data for being compiled with audited impression data.
In accordance with yet another embodiment of the invention there is provided a method comprising: providing a video game application having a certification thereof from a trusted certification body; executing the video game application; verifying the certification of the video game application as one of reliably certified and other than reliably certified; and, when the certification of the video game application is verified as reliably certified, providing certification data to the video game for use in certifying of reported impression data.
In accordance with yet another embodiment of the invention there is provided a storage medium having stored therein video game software having executable code therein for dynamically inserting advertising data therein from an external source and for reporting data relating to impressions relating to the advertising data; a video game system having an adaptor for coupling with a communication network; and, at least a processor for detecting impressions and for reporting detected impressions and for comparing the reported data against the detected impressions to produce a comparison result.
In accordance with yet another embodiment of the invention there is provided a storage medium having stored therein video game software having executable code therein for inserting advertising data from an external source therein dynamically and for reporting data relating to impressions relating to the advertising data; a video game system having an adaptor for coupling with a communication network; and, at least a processor for reporting impressions in a secure fashion for avoiding tampering therewith.
Exemplary embodiments of the invention will now be described in conjunction with the attached drawings, in which:
a is a simplified flow diagram of a process for reporting of advertising data wherein the reports are provided from a video game system directly to a certifying organization;
b is a simplified flow diagram of a process for reporting of advertising data wherein the reports are secured by certified video game software prior to transmission to a server;
Hereinbelow, the term impression is used to refer to information impressed upon a user of a system. Typically, impression refers to an advertising impression wherein advertising data is displayed, made audible, or otherwise communicated to an individual in a fashion that is statistically valid from an advertising industry perspective. The verb to impress is used to connote the action of providing an impression.
For the video game industry, audited metrics, if verifiable and available industry wide, would result in a relative advertising/gamer market share for any given game. This gives rise to an in-game analogue to Gross Ratings Points (GRP) as currently used in metrics evaluation. Because the existing advertising industry understands the existing metrics, analogous or comparable metrics are highly advantageous.
Referring to
The advertising viewership data 103 is compiled statistically into tables indicative of advertisement value. This is commonly performed by media research organizations. The tables are then applied to the verified advertisements data 102 to establish a value therefore in a fashion that is now well understood in the media research industry. The viewership data 103 and advertisement data 102 are stored by an external server 107.
Referring to
Unfortunately, in a system according to
Referring to
Referring to
In an exemplary embodiment, the advertisements displayed during testing of the video game at 403 are predetermined patterns that are designed or selected for ease of automatic identification. Preferably, the selected patterns are also distinguishable one from another to allow for verification of individual advertisements in individual advertisement locations. Further preferably, the advertisements are automatically generated in response to a request for advertising data such that a process for automatically identifying advertising data when displayed does not require significant storage resources.
In a further embodiment, the automatic detection of advertisement data when displayed is performed by an external system. Such a system, for example is coupled between a gaming system and a display for intercepting data for being displayed. Alternatively, such a system relies on a video capture device such as a video camera to capture video data relating to images presented by a video game during execution thereof. The image data is then analysed in order to extract advertising data that is displayed therein.
Referring to
Referring to
Referring to
For example, advertising data includes tag data therein for being easily identified during impressing thereof. Preferably, any such tag is not noticeable to the gamer during impressing of the advertisement thereon. Alternatively, the process for identifying impressions is provided with the advertising data prior to seeking same to facilitate the accurate and reliable identification of advertising data impressed within a video game during play thereof.
Referring to
Referring to the diagram of
Referring to
Referring to
Referring to
At 1001, a software patch for modifying video game software is provided. A certifying body patches the software with the software patch at 1002 and tests the resulting software at 1003. When the software executes and reports advertising data accordingly, the certifying body certifies the patch at 1004 and inserts within the patch a certification code for use in verifying of the patched software at 1005. In use, patching of the software results in modifications thereto that will still be verified as certified due to the further testing thereof. Alternatively, when the method of
Referring to
Though the above descriptions rely on reporting of advertising impressions to a server, the impressions are optionally aggregated prior to reporting thereof. Further optionally, the impression data is stored in a secured fashion prior to aggregation thereof to prevent tampering therewith. For example, an object code library that is trusted is used to secure and aggregate the data prior to transmission thereof.
In an embodiment, an audit log is generated for being provided to the server. As such, when content is auditable and when auditing of data is performed, then records provided to the server include audit data for use in verifying auditing of the advertisement impressions. When used with a method such as those of
Alternatively, the audited data indicates a degree of correlation between the reported data and the auditing results thereby resulting in an indication of reliability of the reported data. Though 100% is such an indication, it is also possible to have lesser percentage reliability and to still be considered trustworthy, from a statistical perspective. Application of the method of the invention for use in evaluating trustworthiness of reported impression data is supported according to the above embodiments. For example, if the reporting is reporting fewer impressions than those shown, disagreement between the reports and the audited values results in enhanced trustworthiness. Even a few reported values that are missing from the audited results may simply indicate errors in the auditing process. As such, the correlation requirements between the audited and reported data is a matter left to those of skill in the art of media research and statistics.
Though the above embodiments are described with reference to video games, those skilled in the art will recognize that the methods and systems described hereinabove are also applicable to other software applications for displaying and reporting of advertising data and or other commercial data for display thereon.
It is for those of skill in the art of media research to determine whether all advertising locations require auditing thereof or only a subset requires auditing. Further, it is possible to audit video game performance on a regular basis, at random intervals, or in a continuous uninterrupted fashion.
Numerous other embodiments may be envisaged without departing from the spirit or scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
5740549 | Reilly et al. | Apr 1998 | A |
5768382 | Schneier et al. | Jun 1998 | A |
5946664 | Ebisawa | Aug 1999 | A |
6036601 | Heckel | Mar 2000 | A |
6430301 | Petrovic | Aug 2002 | B1 |
6442259 | Culli et al. | Aug 2002 | B2 |
6487538 | Gupta et al. | Nov 2002 | B1 |
6640336 | Ebisawa | Oct 2003 | B1 |
6704415 | Katayama et al. | Mar 2004 | B1 |
6882978 | Ebisawa | Apr 2005 | B2 |
6928414 | Kim | Aug 2005 | B1 |
7047302 | Chatani et al. | May 2006 | B1 |
7085733 | Ebisawa | Aug 2006 | B2 |
7249383 | McCully et al. | Jul 2007 | B1 |
7452278 | Chen et al. | Nov 2008 | B2 |
7624046 | Galuten et al. | Nov 2009 | B2 |
8589227 | Bridge et al. | Nov 2013 | B1 |
20010010059 | Burman et al. | Jul 2001 | A1 |
20020059148 | Rosenhaft et al. | May 2002 | A1 |
20020072413 | Arias et al. | Jun 2002 | A1 |
20020082910 | Kontogouris | Jun 2002 | A1 |
20020095675 | Lowthert et al. | Jul 2002 | A1 |
20020116263 | Gouge | Aug 2002 | A1 |
20030100375 | Wakae et al. | May 2003 | A1 |
20030177187 | Levine et al. | Sep 2003 | A1 |
20040015608 | Ellis et al. | Jan 2004 | A1 |
20040043806 | Kirby et al. | Mar 2004 | A1 |
20040073909 | Arimilli et al. | Apr 2004 | A1 |
20040116183 | Prindle | Jun 2004 | A1 |
20040128364 | Clark | Jul 2004 | A1 |
20040143852 | Meyers | Jul 2004 | A1 |
20040216157 | Shain et al. | Oct 2004 | A1 |
20040221178 | Aaron et al. | Nov 2004 | A1 |
20050098955 | Rasmussen | May 2005 | A1 |
20050137015 | Rogers et al. | Jun 2005 | A1 |
20050255923 | Aoki | Nov 2005 | A1 |
20050262061 | Moritsu et al. | Nov 2005 | A1 |
20070043616 | Kutaragi et al. | Feb 2007 | A1 |
20080102947 | Hays et al. | May 2008 | A1 |
Number | Date | Country |
---|---|---|
0 752 678 | Jan 1997 | EP |
1137281 | Sep 2001 | EP |
1 492 055 | Dec 2004 | EP |
H10-290443 | Oct 1998 | JP |
2002-083219 | Mar 2002 | JP |
2002-288519 | Oct 2002 | JP |
2002-318965 | Oct 2002 | JP |
2004-054521 | Feb 2004 | JP |
WO 0140948 | Jun 2001 | WO |
Entry |
---|
High, Kamau. “Jonathan Epstein, Game On.” Nov. 19, 2007, Adweek [online] [retrieved on Jan. 2, 2008]. Retrieved from the Internet <URL: http://www.adweek.com/aw/magazine/article—display.jsp?vnu—content—id=1003674403>. |
European Extended Search Report in Application No. 06721778.6-2221 / 1866832 PCT/CA2006000525 dated Mar. 9, 2010, 1-17 pages. |
Spinellis, Diomidis, “Reflection as a Mechanism for Software Integrity Verification,” ACM, New York, NY, ACM Transactions on Information and System Security, vol. 3, No. 1, Feb. 2000, Copyright 2000 ACM, 1094-9224/00/0200, XP000976015 ISSN: 1094-9224, pp. 51-62. |
International Preliminary Report on Patentability from International Application No. PCT/CA2006/000525 mailed Oct. 18, 2007, 13 pages. |
International Search Report from International Application No. PCT/CA2006/000525 mailed May 31, 2006, 2 pages. |
Japanese Office Action dated May 10, 2011 for JP Patent Application No. 2008-504591, (with English translation), 10 pages. |
EP Communication from European Patent Office mailed Feb. 2, 2012 from EP Application No. 06721778.6, 5 pages. |
Japanese Office Action dated Jan. 4, 2012 from JP Application No. 2008-504591 (English translation), 2 pages. |
CN Office Action from The State Intellectual Property Office of the People's Republic of China (SIPO) mailed Jun. 12, 2010 from CN Application No. 200680019865.6 with English translation, 11 pgs. |
CN Office Action from The State Intellectual Property Office of the People's Republic of China (SIPO) mailed Nov. 2, 2011 from CN Application No. 200680019865.6 with English translation, 14 pgs. |
Japanese Office Action dated May 6, 2011 from JP Patent Application No. 2008-504591, (with English translation), 10 pages. |
Japanese Office Action dated Dec. 27, 2012 from JP Application No. 2008-504591 (English translation), 2 pages. |
Office Action in Canadian Application No. 2,603,743, mailed Jun. 21, 2013, 5 pages. |
Office Action in Indian Application No. 1713/MUMNP/2007, dated Jul. 8, 2013, 3 pages. |
Office Action in Japanese Application No. 2008-504591, dated May 16, 2013, 4 pages (English translation included). |
Office Action in Korean Application No. 2007-7025132 dated Apr. 16, 2013, 7 pages (English translation included). |
Office Action in Korean Application No. 2007-7025132 dated Jun. 12, 2012, 17 pages (English translation included). |
Number | Date | Country | |
---|---|---|---|
20060224455 A1 | Oct 2006 | US |
Number | Date | Country | |
---|---|---|---|
60668080 | Apr 2005 | US |