Online advertising on the World Wide Web is an increasingly important communication channel for businesses, on which significant marketing budgets are spent. In particular, digital video advertising is increasingly used. An advertiser or advertising agency will create an advertisement in the form of digital video content, which is then distributed by a publisher who delivers the digital video content to appropriate positions in web pages for viewing by the consumer. The digital video content may also be provided as “pre-roll” content to a digital video that the consumer has selected for viewing. Typically, the advertiser pays the publisher per instance of the digital video content delivered.
In order for the advertiser to be confident that they are receiving value for money it is desirable that the digital video content is provided to the viewer in a way that enables the viewer to absorb the marketing messages in the digital video content. For example, the digital video content should be visible on the viewer's screen, i.e. not hidden, should be audible to the viewer, i.e. not muted, and should be visible to the viewer for a period of time that is long enough for the viewer to watch the video content.
It is therefore desirable to be able to quantify the effectiveness of the delivery of digital media content across publishers and the services offered by publishers.
The embodiments described below are not limited to implementations which solve any or all of the disadvantages of known content consumption verification systems.
The following presents a simplified summary of the disclosure in order to provide a basic understanding to the reader. This summary is not an extensive overview of the disclosure and it does not identify key/critical elements or delineate the scope of the specification. Its sole purpose is to present a selection of concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later.
The present invention, at least in its preferred configuration, seeks to provide a method of quantifying effectiveness of the delivery of digital media content in a reliable and easily comparable indicator.
The method comprises identifying a group of instances of delivery of digital media content, calculating a plurality of metrics for the said group, each metric indicative of a different aspect of effective delivery of the digital media content, and combining the calculated metrics into a single indicator of the effectiveness of the delivery of digital media content for the group.
Thus, in accordance with the invention, a single indicator provides a reliable indicator of the effective delivery of digital media content. The indicator may be provided as a numerical value, a grade (e.g. AAA, AA, AB, etc.) or otherwise.
The group of instances may represent the delivery of digital media content by a particular supplier of digital media distribution services over a period of time. Thus, the indicator may evaluate the performance of a particular supplier. Alternatively or in addition, the group of instances may represent the delivery of digital media content by a particular service of a particular supplier of digital media distribution services over a period of time. Thus, the indicator may evaluate the performance of a particular “product” of a particular supplier or suppliers.
At least one of the metrics is an indicator (“visible media”) of the proportion of the instances that were visible to a viewer of the digital media content. It is possible for digital media content to be delivered to the web browser of a user or viewer without the digital media content being visible on the user's screen. This metric provides an indication of the delivery instances that were visible.
At least one of the metrics may be an indicator (“audible media”) of the proportion of the instances that were audible to a viewer of the digital media content. It is possible for digital media content to be delivered to the web browser of a user or viewer without the digital media content being audible to the viewer, for example because the sound level has been muted by a player control. This metric provides an indication of the delivery instances that were potentially audible.
At least one of the metrics is an indicator (“dwell time”) of the amount of time the digital media content was accessed by a viewer in each instance. It is desirable for the viewer to access the digital media content for long enough to absorb the messages in the digital media content.
At least one of the metrics is an indicator (“geo target”) of the proportion of the instances that were delivered to a viewer in a predetermined geographical area. Advertising campaigns are often geographically focused and it is important to an advertiser that the digital media content was delivered to the target geographical area, e.g. the target country.
At least one of the metrics is an indicator (“multiple exposure”) of the proportion of the instances that were delivered to a viewer without a second instance of the same digital media content being delivered to the same viewer at substantially the same time. It is possible for distributors of digital media content to deliver multiple instances of the same content to the same user at the same time in order to maximize the total number of instances of delivery. However, there is no value to the advertiser in delivering the same digital media content to the viewer at the same time.
At least one of the metrics is an indicator (“stability”) of the consistency (low variability) over time of one or more of the other metrics. This indicator may be an indicator of the consistency over time of all of the other metrics.
In the presently preferred embodiment of the invention, the single indicator is a combination of visible media, audible media, dwell time, geo target, multiple exposure and stability.
The calculation and combination of the metrics may be carried out by means of any suitable mathematical formula.
The method may further comprise providing an indication (“reach”) of the number of viewers to whom digital media content has been delivered by the instances in the group. In the presently preferred configuration, reach is not a metric which contributes to the single indicator.
The method may further comprise providing an indication (“inventory”) of the number of different items of digital media content that have been delivered by the instances in the group. In the presently preferred configuration, inventory is not a metric which contributes to the single indicator.
The method may further comprise providing a comparison of the value of the indicator for different groups of instances. For example, a ranking table or index may be provided comparing the performance of different suppliers.
The method may further comprise sending at least one of the plurality of metrics for the group and the single indicator to a user interface.
Another aspect of the invention provides an indicator value calculated in accordance with the method. Another aspect of the invention provides a collection of such indicator values, such as a ranking table, for a plurality of groups. The invention further extends to data processing apparatus configured to carry out the method and to computer software which configures a general purpose computer to operate as such data processing apparatus. Another aspect provides one or more tangible device-readable media with device-executable instructions that, when executed by a computing system, direct the computing system to perform steps of the method.
In summary, a method of quantifying the effectiveness of the delivery of digital media content comprises identifying a group of instances of delivery of digital media content, calculating a plurality of metrics for the group, each metric indicative of a different aspect of effective delivery of the digital media content and combining the calculated metrics into a single indicator of the effectiveness of the delivery of digital media content for the group.
Throughout the description and claims of this specification, the words “comprise” and “contain” and variations of them mean “including but not limited to”, and they are not intended to (and do not) exclude other components, integers or steps. Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.
Features, integers, characteristics or groups described in conjunction with a particular aspect, embodiment or example of the invention are to be understood to be applicable to any other aspect, embodiment or example described herein unless incompatible therewith. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where at least some of such features and/or steps are mutually exclusive. The invention is not restricted to the details of any foregoing embodiments. The invention extends to any novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed.
Many of the attendant features will be more readily appreciated as the same becomes better understood by reference to the following detailed description considered in connection with the accompanying drawings.
The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein:
The detailed description provided below in connection with the appended drawings is intended as a description of the present examples and is not intended to represent the only forms in which the present example may be constructed or utilized. The description sets forth the functions of the example and the sequence of steps for constructing and operating the example. However, the same or equivalent functions and sequences may be accomplished by different examples.
The transponder 105 can be a component in the video player, and is typically software running in the video player. In some situations, the transponder may be loaded via a plug-in architecture at ad-display time. In some situations, the transponder may be a physical computer or co-computer. In some situations, the transponder may be broken up into two parts, one part hardware that is fixed, or otherwise “built in”, with the other part as a loadable module.
In arrangements where the media takes the form of an advertisement, the advertisement may be distributed through a number of different servers before it is delivered to the web browser. The distribution of media and particularly video media such as advertisements can be considered a marketplace of selling and re-selling of media publications. In an exemplary arrangement, an advertiser will make an agreement with a first publisher to publish media in the form of an advertisement a fixed number of times. From this, the advertiser will distribute the media from an ad server 70 to the first publisher's server 60. The first publisher will seek to publish the advertisement to a number of user terminals, in order to fulfill the agreement. If the first publisher is unable fulfill the agreement, the first publisher may arrange the further distribution of the media with a second publisher in order to fulfill the original agreement, and the first publisher may distribute the media to the second publisher's server 50. This may then continue to a third publisher if the second publisher is unable to fulfill the original agreement, and so on. An ad server may be considered a server, such as a web server, that operates to store media such as advertisements. Such media may be delivered to user terminals when a user visits a particular web page or website. In addition, ad servers may also act to target particular media to particular users depending upon a set of rules. Therefore, a particular media, such as a particular advertisement, may have been placed on a plurality of different ad servers in order to form a chain between the original advertiser and the publisher's ad server 50 through any number of different ad servers before being published to a particular user terminal 10. Each advertisement receives media from a publisher when a web page is loaded.
When web pages are requested, the publisher sends a media player 205 to the audience. The publisher may load ad configuration from a network partner 206. The network partner (or in some circumstances, the publisher directly) will send the tracking pixel and digital media assets together 207 to the audience. Meanwhile, the embedded transponder will make a request to the server of the monitoring entity (TLM) and receive a session ID 208.
When the ad begins playback, several parties will be notified using a “tracking pixel” or a “trigger pixel”; a pixel may be fired that belongs to the publisher 209, and/or to the network partner 210, to the advertiser 211. That the monitoring entity (TLM) requires a trigger pixel is not unusual, and will be fired at the same time 212. Trigger pixels are represented later 302, 402, 502, 602, 702.
Meanwhile, while the component is loaded, it will begin sending back a pulse 213 to the monitoring entity. This pulse contains every signal generated by the component/transponder 105. Periodically, the component will send more pulse data 214. The cumulative pulse data is represented later 301, 401, 601.
In
The “trigger pixel” is being trafficked by a different team from the pulse. Generally, in media buying, an advertiser and/or their agency will identify a specific buy (which may contain a number of different products, some of which chosen dynamically and in real-time) with a pixel. This pixel may be targeting a demographic, or psychographic that the advertiser is interested in, and so when the publisher sells some audience to an advertiser, this is how the buy is identified. In contrast, the pulse is embedded in the player, which as can be seen in
In
In
In
In
Data coming from one of the computers shown in
The storage addresses for other metrics 903 feed into other calculation pipelines 900.
A mean is determined for each metric. This can be accumulated in a memory cell 1004. A standard deviation is determined for each metric. This can be accumulated in a separate memory cell 1005. The stability metric can be determined from the standard deviation, such as by multiplying the standard deviation. The stability metric can be stored in a cell 1006.
All of the metrics are combined to produce the final score 1007. The combining can, for example, use a combination of multiplication and some weighting coefficients.
Function “F” can be any device that fits with subjective sense. For example, Multiple Exposure is something that is very easy for publishers to avoid, so a function that goes to zero when the multiple exposure goes above a few percent can be used here. These could be any mathematical functions, with the data fitted to the function.
The calculation pipelines 900 feed into their metric outputs 1004 and the stability-calculator 1106 to produce the stability score 1006.
Note again the placement of data coming in 800, and that 900 represent the entire calculation device. There is a duplication, hence there is more than one 1004 and more than one 900. These are duplicated for each metric. Node 1106 comes from historical data (e.g. last 7 days). Note the arrows from the final score 1009 “feeds back” into the stability coefficient and the scoring combinator. This is done in order to make the final scores more competitive (i.e. more actionable by the media buyer). The arrows are not process-arrows but the data moves simultaneously throughout the system in a state of hysteresis.
At least one of the metrics may be an indicator (“audible media”) of the proportion of the instances that were audible to a viewer of the digital media content. It is possible for digital media content to be delivered to the web browser of a user or viewer without the digital media content being audible to the viewer, for example because the sound level has been muted by a player control. This metric provides an indication of the delivery instances that were potentially audible.
At least one of the metrics is an indicator (“dwell time”) of the amount of time the digital media content was accessed by a viewer in each instance. It is desirable for the viewer to access the digital media content for long enough to absorb the messages in the digital media content.
At least one of the metrics is an indicator (“geo target”) of the proportion of the instances that were delivered to a viewer in a predetermined geographical area. Advertising campaigns are often geographically focused and it is important to an advertiser that the digital media content was delivered to the target geographical area, e.g. the target country.
At least one of the metrics is an indicator (“multiple exposure”) of the proportion of the instances that were delivered to a viewer without a second instance of the same digital media content being delivered to the same viewer at substantially the same time. It is possible for distributors of digital media content to deliver multiple instances of the same content to the same user at the same time in order to maximize the total number of instances of delivery. However, there is no value to the advertiser in delivering the same digital media content to the viewer at the same time.
At least one of the metrics is an indicator (“stability”) of the consistency (low variability) over time of one or more of the other metrics. This indicator may be an indicator of the consistency over time of all of the other metrics.
The single indicator 1012 is a set of 1007, and the indicator 1019 is a set of 1009. The single indicator 1012 and/or indicator 1019 may be a combination of visible media, audible media, dwell time, geo target, multiple exposure and stability. The user interface can allow a user to customize the interface in various ways, such as to allow the user to select which metrics (columns) are displayed. As shown in
Computing-based device 1150 comprises one or more processors 1151 which may be microprocessors, controllers or any other suitable type of processors for processing computer executable instructions to control the operation of the device. In some examples, for example where a system on a chip architecture is used, the processors 1151 may include one or more fixed function blocks (also referred to as accelerators) which implement a part of the method in hardware (rather than software or firmware). Platform software comprising an operating system or any other suitable platform software may be provided at the computing-based device to enable application software to be executed on the device.
Computer executable instructions 1153 may be provided using any computer-readable media that is accessible by computing based device 1150. Computer-readable media may include, for example, computer storage media such as memory 1152. Computer storage media, such as memory 1152, includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device. In contrast, communication media may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transport mechanism. As defined herein, computer storage media does not include communication media. Although the computer storage media (memory 1202) is shown within the computing-based device 1150 it will be appreciated that the storage may be distributed or located remotely and accessed via a network or other communication link (e.g. using communication interface 1158).
The computing-based device 1150 also comprises an input/output controller 1159 arranged to output display information to a display device which may be separate from or integral to the computing-based device 1150. The display information may provide a graphical user interface. The input/output controller 1159 is also arranged to receive and process input from one or more devices, such as a user input device (e.g. a mouse or a keyboard). This user input may be used to control whether the device is in an offline or online state, to consume content, to control generation of proof of work tokens or for other purposes. In an embodiment the display device may also act as the user input device if it is a touch sensitive display device. The input/output controller 1159 may also output data to devices other than the display device, e.g. a locally connected printing device. One or more buses 1156 connect the components of the computing-based device.
The term ‘computer’ or ‘computing-based device’ is used herein to refer to any device with processing capability such that it can execute instructions. Those skilled in the art will realize that such processing capabilities are incorporated into many different devices and therefore the terms ‘computer’ and ‘computing-based device’ each include PCs, servers, mobile telephones (including smart phones), tablet computers, set-top boxes, media players, games consoles, personal digital assistants and many other devices.
The methods described herein may be performed by software in machine readable form on a tangible storage medium e.g. in the form of a computer program comprising computer program code means adapted to perform all the steps of any of the methods described herein when the program is run on a computer and where the computer program may be embodied on a computer readable medium. Examples of tangible storage media include computer storage devices comprising computer-readable media such as disks, thumb drives, memory etc. and do not include propagated signals. Propagated signals may be present in a tangible storage media, but propagated signals per se are not examples of tangible storage media. The software can be suitable for execution on a parallel processor or a serial processor such that the method steps may be carried out in any suitable order, or simultaneously.
This acknowledges that software can be a valuable, separately tradable commodity. It is intended to encompass software, which runs on or controls “dumb” or standard hardware, to carry out the desired functions. It is also intended to encompass software which “describes” or defines the configuration of hardware, such as HDL (hardware description language) software, as is used for designing silicon chips, or for configuring universal programmable chips, to carry out desired functions.
Those skilled in the art will realize that storage devices utilized to store program instructions can be distributed across a network. For example, a remote computer may store an example of the process described as software. A local or terminal computer may access the remote computer and download a part or all of the software to run the program. Alternatively, the local computer may download pieces of the software as needed, or execute some software instructions at the local terminal and some at the remote computer (or computer network). Those skilled in the art will also realize that by utilizing conventional techniques known to those skilled in the art that all, or a portion of the software instructions may be carried out by a dedicated circuit, such as a DSP, programmable logic array, or the like.
Any range or device value given herein may be extended or altered without losing the effect sought, as will be apparent to the skilled person.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments. The embodiments are not limited to those that solve any or all of the stated problems or those that have any or all of the stated benefits and advantages. It will further be understood that reference to ‘an’ item refers to one or more of those items.
The steps of the methods described herein may be carried out in any suitable order, or simultaneously where appropriate. Additionally, individual blocks may be deleted from any of the methods without departing from the spirit and scope of the subject matter described herein. Aspects of any of the examples described above may be combined with aspects of any of the other examples described to form further examples without losing the effect sought.
The term ‘comprising’ is used herein to mean including the method blocks or elements identified, but that such blocks or elements do not comprise an exclusive list and a method or apparatus may contain additional blocks or elements.
It will be understood that the above description is given by way of example only and that various modifications may be made by those skilled in the art. The above specification, examples and data provide a complete description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity, or with reference to one or more individual embodiments, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from the spirit or scope of this specification.
Number | Date | Country | Kind |
---|---|---|---|
1217796.0 | Oct 2012 | GB | national |