This disclosure relates generally to market research, and, more particularly, to methods and apparatus to calculate video-on-demand and dynamically inserted advertisement viewing probability.
In recent years, panelist research efforts included installing metering hardware in qualified households that fit one or more demographics of interest. In some cases, the metering hardware is capable of determining which members of the qualified households are exposed to a particular portion of media via one or more button presses on a People Meter by corresponding household member(s) near a media device (e.g., a television).
Market researchers seek to understand the audience composition and size of media, such as radio programming, television programming and/or Internet media. Such information allows the market researchers to report advertising delivery and/or targeting statistics to advertisers that target their media (e.g., advertisements) to audiences. Additionally, such information helps to establish advertising prices commensurate with audience exposure and demographic makeup (referred to herein collectively as “audience configuration”). As used herein, “media” refers to any sort of content and/or advertisement which is presented or capable of being presented by an information presentation device, such as a television, radio, computer, smart phone or tablet. To determine aspects of audience configuration (e.g., which household member is currently watching a particular portion of media and the corresponding demographics of that household member), the market researchers may perform audience measurement by enlisting any number of consumers as panelists. Panelists are audience members (household members) enlisted to be monitored, who divulge and/or otherwise share their media exposure habits and demographic data to facilitate a market research study.
An audience measurement entity (e.g., The Nielsen Company (US), LLC.) typically monitors media exposure habits (e.g., viewing, listening, etc.) of the enlisted audience members via audience measurement system(s), such as one or more metering device(s) and a People Meter. Audience measurement typically involves determining the identity of the media being displayed on a media presentation device (e.g., a television), determining demographic information of an audience, and/or determining which members of a household are to be associated with exposure to particular media.
Some audience measurement systems physically connect to the media presentation device, such as the television, to identify which channel is currently tuned by capturing a channel number, audio signatures and/or codes identifying (directly or indirectly) the programming being displayed. Physical connections between the media presentation device and the audience measurement system may be employed via an audio cable coupling the output of the media presentation device to an audio input of the audience measurement system. Additionally, audience measurement systems prompt and/or accept audience member input to reveal which household member is currently exposed to the media presented by the media presentation device.
As described above, audience measurement entities may employ the audience measurement systems to include a device, such as the People Meter (PM), having a set of inputs (e.g., input buttons) that are each assigned to a corresponding member of a household. The PM is an electronic device that is typically disposed in a media exposure (e.g., viewing) area of a monitored household and is proximate to one or more of the audience members. The PM captures information about the household audience by prompting the audience members to indicate that they are present in the media exposure area (e.g., a living room in which a television set is present) by, for example, pressing their assigned input key on the PM. When a member of the household selects their corresponding input, the PM identifies which household member is present, which includes other demographic information associated with the household member, such as a name, a gender, an age, an income category, etc. However, in the event a visitor is present in the household, the PM includes at least one input (e.g., an input button) for the visitor to select. When the visitor input button is selected, the PM prompts the visitor to enter an age and a gender (e.g., via keyboard, via an interface on the PM, etc.).
The PM may be accompanied by a meter (e.g., a set meter, an active/passive (A/P) meter, a meter within a set top box (STB), a portable people meter (PPM), portable metering via wireless telephones, portable metering via tablets, etc.) capable of measuring media selections presented on the media presentation device. The meter, hereinafter referred to as a set meter, collects tuning data from devices, such as set-top boxes, video game devices, video cassette recorders (VCRs), digital video recorders (DVRs) and/or digital versatile disk (DVD) players. The meter may be associated with any type of panel, such as a national people meter (NPM) panel, a local people meter (LPM) panel, households with third party monitoring entities (e.g., Experian®), and/or any other geographic area of interest. The set meter may monitor which station is tuned, a corresponding time-of-day in which the station is tuned, a duration (e.g., number of minutes) the station is tuned, and/or to identify media associated with the tuned station (e.g., identify a program, an advertisement, etc.). The PM and the set meter may be separate devices and/or may be integrated into a single unit. Audience measurement data captured by the set meter may include tuning information, signatures, codes (e.g., embedded into or otherwise broadcast with broadcast media), while the PM determines a number of and/or identification of corresponding household members exposed to the media output by the media presentation device (e.g., the television).
Data collected by the PM and/or the set meter may be stored in a memory and transmitted via one or more networks, such as the Internet, to a data store managed by the market research entity (e.g., The Nielsen Company (US), LLC). Typically, such data is aggregated with data collected from a large number of PMs monitoring a large number of panelist households. Such collected and/or aggregated data may be further processed to determine statistics associated with household behavior in one or more geographic regions of interest. Household behavior statistics may include, but are not limited to, a number of minutes a household media device was tuned to a particular station, a number of minutes a household media device was used (e.g., viewed) by a household panelist member and/or one or more visitors, demographics of an audience (which may be statistically projected based on the panelist data) and instances when the media device is on or off. While examples described herein employ the term “minutes,” such as “household tuning minutes,” “exposure minutes,” etc., any other time measurement of interest may be employed without limitation.
In an effort to allow collected household data to be used in a reliable manner (e.g., a manner conforming to accepted statistical sample sizes), a relatively large number of PMs are needed. Efforts to increase statistical validity (e.g., by increasing panel size and/or diversity) for a population of interest result in a corresponding increase in money spent to implement panelist households with PMs. In an effort to increase a sample size of household behavior data, example methods, apparatus, systems and/or articles of manufacture disclosed herein employ the set meters to collect household panelist behavior data. Example set meters disclosed herein are distinguished from PMs in that the set meters of panelist households capture behavior data, but do not explicitly identify which one of the household members is actively exposed to media presented on the corresponding media presentation device (e.g., a television). In some examples, the set meter captures codes embedded by one or more entities (e.g., final distributor audio codes (FDAC)), and does not include one or more inputs that are to be selected by one or more household panelists to identify which panelist is currently viewing the media device. Rather than collecting audience composition data directly from panelists, example methods, apparatus, systems and/or articles of manufacture disclosed herein apply one or more models to impute which household members are exposed to particular media programming to collected set meter data. Such example imputation techniques are described in further detail below and referred to herein as “persons imputation.” In other words, examples disclosed herein facilitate a manner of determining a probability of household exposure activity in a stochastic manner that takes advantage of available panelist data (e.g., Nielsen® panelist data, Experian® panelist data, advertising provider panelist data, etc.), and avoids the expense of additional PM device installation in panelist households.
Turning to
As described in further detail below, the example imputation engine 110 identifies and analyzes panelist data from one or more target research geographies, such as the example target research geography 104 of
The example SM HHs 108 may include panelists measured and/or otherwise managed by the audience measurement entity (e.g., The Nielsen Company (US), LLC.) and/or one or more other entities that have information that identifies a demographic composition of a corresponding household. In some examples, marketing services companies (e.g., Experian®) collect and manage household information about participating households in a manner compliant with privacy controls to link information with SM HHs to identify a number of household members, corresponding household member ages, genders, education levels, etc. In still other examples, media providers, distributors and/or advertising source agencies collect and manage household information from SM HHs to identify a number of household members, corresponding household member ages, genders, education levels, etc. As described above, because SM HHs 108 do not include PMs, they do not include physical button inputs to be selected by household members to identify which household member is currently watching particular media, and they do not include physical button inputs to be selected by household visitors to identify age and/or gender information. Therefore, example methods, systems, apparatus and/or articles of manufacture disclosed herein model household characteristics that predict a likelihood that a particular household member is watching the identified media (e.g., program, advertisement, etc.) being accessed in the SM HHs 108.
Example households that include a PM will collect panelist audience data that specifically identifies which particular household member is associated with any particular media exposure activity. As used herein, “panelist audience data” includes both (a) media identification data (e.g., code(s) embedded in or otherwise transmitted with media, signatures, channel tuning data, etc.) and (b) person information identifying the corresponding household member(s) and/or visitors that are currently watching/viewing/listening to and/or otherwise accessing the identified media. Additionally, because the PM/SM HHs 106 also include a SM, tuning behavior data is also collected to identify a selected station, a number of minutes tuned to the selected station, and/or time-of-day information associated with the tuning behavior(s). On the other hand, SM HHs 108 include only a SM to collect media data. As used herein, “media data” and/or “media identifier information” are used interchangeably and refer to information associated with media identification (e.g., codes, signatures, etc.), but does not include person information identifying which household member(s) and/or visitors are currently watching/viewing/listening to and/or otherwise accessing the identified media. As described in further detail below, example methods, apparatus, systems and/or articles of manufacture disclosed herein impute person identifying data to media data collected from SM HHs 108.
Although examples disclosed herein refer to collecting codes, techniques disclosed herein could also be applied to systems that collect signatures and/or channel tuning data to identify media (e.g., from an attached device, from a log of a server that provides content, etc.). Audio watermarking is a technique used to identify media such as television broadcasts, radio broadcasts, advertisements (television and/or radio), downloaded media, streaming media, prepackaged media, etc. Existing audio watermarking techniques identify media by embedding one or more audio codes (e.g., one or more watermarks), such as media identifying information and/or an identifier that may be mapped to media identifying information, into an audio and/or video component. In some examples, the audio or video component is selected to have a signal characteristic sufficient to hide the watermark. As used herein, the terms “code” or “watermark” are used interchangeably and are defined to mean any identification information (e.g., an identifier) that may be transmitted with, inserted in, or embedded in the audio or video of media (e.g., a program or advertisement) for the purpose of identifying the media or for another purpose such as tuning (e.g., a packet identifying header). As used herein “media” refers to audio and/or visual (still or moving) content and/or advertisements. To identify watermarked media, the watermark(s) are extracted and used to access a table of reference watermarks that are mapped to media identifying information.
Unlike media monitoring techniques based on codes and/or watermarks included with and/or embedded in the monitored media, fingerprint or signature-based media monitoring techniques generally use one or more inherent characteristics of the monitored media during a monitoring time interval to generate a substantially unique proxy for the media. Such a proxy is referred to as a signature or fingerprint, and can take any form (e.g., a series of digital values, a waveform, etc.) representative of any aspect(s) of the media signal(s) (e.g., the audio and/or video signals forming the media presentation being monitored). A good signature is one that is repeatable when processing the same media presentation, but that is unique relative to other (e.g., different) presentations of other (e.g., different) media. Accordingly, the term “fingerprint” and “signature” are used interchangeably herein and are defined herein to mean a proxy for identifying media that is generated from one or more inherent characteristics of the media.
Signature-based media monitoring generally involves determining (e.g., generating and/or collecting) signature(s) representative of a media signal (e.g., an audio signal and/or a video signal) output by a monitored media device and comparing the monitored signature(s) to one or more references signatures corresponding to known (e.g., reference) media sources. Various comparison criteria, such as a cross-correlation value, a Hamming distance, etc., can be evaluated to determine whether a monitored signature matches a particular reference signature. When a match between the monitored signature and one of the reference signatures is found, the monitored media can be identified as corresponding to the particular reference media represented by the reference signature that with matched the monitored signature. Because attributes, such as an identifier of the media, a presentation time, a broadcast channel, etc., are collected for the reference signature, these attributes may then be associated with the monitored media whose monitored signature matched the reference signature. Example systems for identifying media based on codes and/or signatures are long known and were first disclosed in Thomas, U.S. Pat. No. 5,481,294, which is hereby incorporated by reference in its entirety.
In some examples, panelist households utilize video-on-demand (VOD) services, which permit media to be displayed within the household in response to a request (e.g., program selection via a menu of the set-top-box). As used herein, “video-on-demand” differs from live telecast media based on an amount of time since the associated live telecast media was originally available. In other words, the VOD services may allow audience members to view movies and/or programs (e.g., sitcom episodes) that have been previously broadcast/telecast live at a prior date and time. In other examples, the VOD services facilitate movie and/or program viewing for media that has not been associated with a prior live broadcast, but instead reflects premium services associated with subscription fees. In some examples, media that is telecast to an audience based on a scheduled date and time is referred to as “live viewing” or “linear viewing.” Examples of linear viewing include first-run telecast instances of a sitcom during a regularly scheduled day of week and corresponding time of day.
In the event the first-run telecast media is made available to an audience at a later time, such delayed viewing is referred to as recently telecast VOD (RTVOD), and is associated with a corresponding telecast delay value. In some examples, the telecast delay value occurs moments after the corresponding linear viewing event, such as when an audience member uses a digital video recorder to watch recorded media. In other examples, a media provider provides the audience member with selectable options to choose media that has been previously associated with linear viewing (e.g., a sitcom that was telecast 24-hours earlier). Live telecast media includes certain advertisements that are presented to an audience during the scheduled telecast date and time (e.g., linear viewing associated with a weekly 30-minute sitcom timeslot), in which the advertisements are selected to target expected demographic profiles (e.g., males and females age 26-39). However, demographics of audiences that participate in live telecast viewing differ from demographics of audiences that participate in RTVOD viewing. Further still, the demographics of audiences that use RTVOD of a first telecast delay value measured from the date of live viewing may differ from the demographics of audiences that use RTVOD of a second telecast delay value (e.g., relatively older) measured from the date of live viewing. Knowledge of such audience demographic differences allows audience measurement entities and/or advertisers to target advertisements in a manner that more closely aligns with the demographics to be expected by a viewing audience. In some examples, insertion of advertisements in RTVOD media is referred to as dynamic advertisement insertion, which can be enhanced when a corresponding viewing probability is known for each corresponding RTVOD telecast delay value (e.g., a probability for a demographic profile during linear viewing as distinguished from the probability for the same demographic profile during RTVOD occurring 3 days after a corresponding live event).
While advertisers, advertisement insertion technology entities, audience measurement entities and/or, more generally, market researchers may know the specific demographic composition of a household (e.g., three household members, one male age 33, one female age 32, one male child age 3), unless such households also include a PM, such entities will not know which particular household members are exposed to any particular media displayed within the household. Additionally, in the event that an SM HH 108 requests RTVOD media a day after a corresponding live telecast of that media versus an RTVOD media request three days after the corresponding live telecast of that media, the market researchers will not know which household members are within the audience unless the household also includes a PM. Accordingly, examples disclosed herein identify a viewing probability for respective household members based on, in part, whether the media is a live telecast (linear viewing) or an RTVOD telecast of different durations (delay) from the live/original telecast event.
In operation, the example PM interface 202 acquires people meter data from any and all PMs within the example panelist households 104. In particular, the example PM interface 202 acquires PM data from the PM devices located in the example PM/SM households 106 (i.e., households that have both SMs and PM devices). The PM devices have input (s) (e.g., buttons for each household member to select to identify their respective presence in the audience currently exposed to media). In some examples, the PM/SM households 106 are associated with a particular geographic area of focus, such as nationwide (sometimes referred to as a “National People Meter” (NPM)), while in other examples the PM/SM households 106 are associated with a subset of a particular geographic area of focus, such as a localized geography of interest (e.g., a city within a nation (e.g., Chicago), and sometimes referred to as “Local People Meter” (LPM)). Because the acquired data from PM devices in NPMs and/or LPMs utilizes panelists and includes detailed information related to behaviors on a persons level, models and/or probabilities may be generated therefrom.
For example, in the event an analysis of the Charlotte designated market area (DMA) is desired, then the example PM interface 202 captures data from LPM households within a time zone corresponding to the desired DMA (e.g., the Eastern time zone). In some examples, desired data may be streamed back to one or more storage repositories, from which the example imputation engine 110 may retrieve the data. The example PM interface 202 of the illustrated examples collects, acquires and/or otherwise captures PM data (panelist audience data) from panelist households 104 (having both PMs and SMs) and records or aggregates the media exposure minutes to respective persons within the household as one or more of the possible audience members (e.g., viewers) of the corresponding media. In other words, the captured panelist audience data is at a persons-level rather than at a household level, which facilitates an ability to generate person probabilities, as described in further detail below.
The example categorizer 206 of
As used herein, categories refer to classifications associated with collected exposure minutes (also known as “viewing minutes”). Categories may include, but are not limited to, a daypart associated with collected exposure minutes (e.g., Monday through Friday from 5:00 AM to 6:00 AM, Sunday from 10:00 PM to 1:00 AM, etc.), a station associated with collected exposure minutes (e.g., WISN, WBBM, etc.), whether the media is live or RTVOD, an age/gender associated with collected exposure minutes (e.g., males age 2-5, females age 35-44, etc.), and a genre (e.g., kids programs, home repair programs, music programs, sports programs, etc.) associated with collected exposure minutes. In still other examples, the categorizer 206 categorizes the acquired panelist audience data by education (e.g., 8 years or less, 9 years to high school graduate, some college to Bachelor degree, master's degree or higher, etc.), life stage (e.g., pre-family, young family, older family, post family, retired, etc.) and/or a number of media presentation devices (e.g., television sets in the household. One or more combinations of station/affiliate/genre/live vs. RTVOD/demographic attribute(s) may be categorized in different ways based on, for example, variations between data available for one or more age/gender levels. For example, some local markets have ten stations in which a sample size for men age 45-54 may exhibit a data sample size of statistical significance for seven of those ten stations. In other examples, a local market may have relatively fewer stations where the age/gender levels are of sufficient size to support statistical significance. In some such examples, the age/gender groupings are adjusted (e.g., from males age 40-45 to males age 40-50) to increase an available sample size to achieve a desired statistical significance.
To impute panelist audience data (e.g., exposure minutes, which is sometimes referred to herein as “viewing minutes”) to media data, the example PM interface 202 identifies Local People Meter (LPM) data that has been collected within a threshold period of time. On a relative scale, when dealing with, for example, television exposure, an exposure index, which provides an indication of how well LPM data accurately imputes exposure minutes, may be computed in a manner consistent with Equation (1).
In the illustrated example of Equation (1), the exposure index is calculated as the ratio of the number of imputed LPM viewing minutes for each category of interest and the number of actual LPM viewing minutes for each category of interest.
The example exposure index of Equation (1) may be calculated on a manual, automatic, periodic, aperiodic and/or scheduled basis to empirically validate the success and/or accuracy of imputation efforts disclosed herein. Index values closer to one (1) are indicative of a greater degree of accuracy when compared to index values that deviate from one (1). Depending on the type of category associated with the collected exposure minutes, corresponding exposure index values may be affected to a greater or lesser degree based on the age of the collected data.
As described above, collected data that is more recent exhibits an imputation accuracy that is better than an imputation accuracy that can be achieved with relatively older collected data. Nonetheless, some data that is relatively older will still be useful, but such older data is weighted less than data that is more recent to reflect its lower accuracy. The example weighting engine 210 applies a temporal weight, and applies corresponding weight values by a number of days since the date of collection. Relatively greater weight values are applied to data that is relatively more recently collected. In some examples, weight values applied to collected tuning minutes and collected exposure minutes are based on a proportion of a timestamp associated therewith. For instance, a proportionally lower weight may be applied to a portion of collected minutes (e.g., tuning minutes, exposure minutes) when an associated timestamp is relatively older than a more recently collection portion of minutes.
In the illustrated example of
In the illustrated examples of Equation (2) and Equation (3), W1 reflects a relatively lower weighting value than W2, in which W2 is the weighting value associated with the current day exposure minutes value. Additionally, d reflects one of n days of the collected data prior to the current day, EMd reflects exposure minutes for corresponding days prior to the current day, TMd reflects household tuning minutes for corresponding days prior to the current day, EMc reflects exposure minutes for the current day, and TMc reflects household tuning minutes for the current day.
In connection with example data shown in the illustrated example of
However, while the market researcher may have a particular category combination of interest, a corresponding probability value accuracy may be improved when different probability calculation techniques are applied in view of corresponding available sample sizes of households sharing the particular category combination of interest. As described in further detail below, if collected LPM data associated with the category combination of interest (e.g., male, age 45-54, tuned (live) to premium channel during 6:00 PM to 7:00 PM with three household members, one television and the head of household have some college credit or a bachelor's degree) is greater than a threshold value, then a cell probability technique may yield a probability value with acceptable accuracy. As used herein, an acceptable accuracy relates to a sample size that is capable and/or otherwise required to establish results having a statistical significance. However, in the event the collected Local People Meter (LPM) data associated with the category combination of interest falls below the threshold value, then the cell probability technique yields unacceptably low probability value accuracy. Instead, example methods, apparatus, systems and/or articles of manufacture disclosed herein employ independent distribution probability calculations when the collected LPM data associated with the category combination of interest is below a threshold value, such as below a threshold value that is capable of facilitating one or more calculations to yield results having statistical significance.
The example category manager 214 of
In operation, the example category manager 214 of
In the event a market researcher seeks probability information for a male aged 50 watching a premium pay channel live (not delayed viewing) between the hours of 6:00 PM and 6:30 PM, the example category fit manager 220 of the illustrated example identifies which previously established category groups already exist that would best fit this desired task. In other words, the specific and/or otherwise unique research desires of the market researcher may not align exactly with existing categorical groups collected by LPM and/or NPM devices. Instead, the example category fit manager 220 identifies that the closest categorical combination of industry standard and/or otherwise expected data is with males age 45-54 between the hours of 6:00 PM and 7:00 PM. The example minutes aggregator 222 of the illustrated example identifies a total number of household tuning minutes in all households associated with the identified closest categorical combination, and also identifies a total number of exposure minutes associated with the males age 45-54 in such households. For example, the minutes aggregator 222 may identify forty-five (45) qualifying households that have males 45-54 (e.g., the household could have more than just the males 45-54) in which a premium pay genre station was tuned live between the hours of 6:00 PM to 7:00 PM, three household members with one television set and a head of household having some college credit or bachelor's degree.
Within these forty-five (45) qualifying households, the tuning minutes aggregator 222 may identify two-hundred (200) household tuning minutes total, but only one hundred and two (102) of those minutes were associated with the males 45-54. The example probability generator 224 of the illustrated example calculates a probability for imputation as the ratio of exposure minutes for the males 45-54 and the total household tuning minutes for all qualifying households in a manner consistent with example Equation (4).
In the illustrated example of Equation (4), the probability of imputation using the examples disclosed above is 0.51 (i.e., 102 exposure minutes divided by 200 tuning minutes, in this example). In some examples, the probability value calculated by the example cell probability engine 216 is retained and/or otherwise imputed to SM households 108 based on a normal distribution, such as a comparison of the calculated probability value to a random or pseudo-random number. In the event the calculated probability value is greater than the random number, then the household member having the categorical combination of interest is credited as viewing a tuning segment. In other words, the household tuning data is imputed to the SM household 108 as exposure data for the categorical combination of interest. On the other hand, in the event the calculated probability value is less than the random or pseudo-random number, then the household member having the categorical combination of interest is not credited as viewing the tuning segment. In other words, the household tuning data is not imputed to the SM household 108.
As discussed above, when the combinations of all categories of interest are represented by a number of households less than a threshold value within the donor pool, the cell probability calculation approach may not exhibit a level of confidence deemed suitable for statistical research. Generally speaking, a number of households in a research geography of interest matching a single one of the categories of interest may be relatively high. However, as additional categories of interest are added, the number of households having an inclusive match for all such categories decreases. In some circumstances, the number of matching households available in the donor pool after performing a logical “AND” of all categories of interest eventually results in a donor pool having a population lower than a threshold value, which may not exhibit statistical confidence when applying the cell probability technique described above. In such examples, the probability engine 212 prevents a cell probability technique from being employed to calculate a probability of whether a household of interest should be credited with exposure behavior for the categorical combination of interest (e.g., whether the male age 45-54 of the household should be credited with captured exposure (tuning) behavior of the household). Instead, the example probability engine 212 invokes the example independent distribution engine 218 when the number of households having the desired combination of categories of interest is below a threshold value. As described in further detail below, instead of using a pool of households that match all categories of interest, households are employed that match some of the categories of interest are used when calculating a probability of viewing.
In operation, the example category qualifier 226 of
Because, in the illustrated example, the donor pool is constructed with only SM households 106, the example category qualifier 226 retrieves and/or otherwise obtains a total household tuning minutes value and a total exposure minutes value for the available households meeting the size/gender/age criteria of interest (e.g., dimensions (1), (2) and (3) from above). For example, if the size/gender/age criteria of interest is for a household size of two or more people having a male age 45-54, then the example category qualifier 226 identifies a number of households from that size/gender/age subset.
The example proportion manager 228 of
For example, the proportion manager 228 of the illustrated example selects one or more secondary categories to determine a corresponding number of matching households, household tuning minutes and exposure minutes. Again, and as described above, the temporal units of “minutes” are employed herein as a convenience when discussing example methods, apparatus, systems and/or articles of manufacture disclosed herein, such that one or more additional and/or alternative temporal units (e.g., seconds, days, hours, weeks, etc.) may be considered, without limitation. In the illustrated example of
Generally speaking, the proportion manager 228 of the illustrated example identifies secondary category contributions of household tuning minutes and exposure minutes independently from the household tuning and exposure minutes that may occur for only such households that match all of the desired target combination of categories of interest. After each individual secondary category contribution household tuning minute value and exposure minute value is identified, the example distribution engine 230 calculates a corresponding household tuning proportion and exposure proportion that is based on the key predictor household tuning and exposure minute values. As described in further detail below, the example distribution engine 230 calculates a household tuning proportion and an exposure proportion associated with each of the secondary categories of interest (e.g., the live tuned station category 504, the education category 506, the number of sets category 508, the daypart category 510 and the life stage/size category 512). In other words, examples disclosed herein capture, calculate and/or otherwise identify contributory effects of one or more secondary categories of interest by calculating and/or otherwise identifying a separate corresponding tuning proportion and separate corresponding exposure proportion for each one of the secondary categories. As described in further detail below, separate contributory effects of the one or more secondary categories are aggregated to calculate expected tuning minutes and expected exposure minutes.
In the illustrated example of
The example distribution engine 230 of
The example distribution engine 230 of
The example distribution engine 230 of
The example distribution engine 230 of
As described above, each of the target combinations of categories of interest has an independently calculated household tuning proportion value and an independently calculated exposure proportion value. The example distribution engine 230 of
In the example exposure and household tuning minutes discussed above, the resulting independent distribution probability is 0.52. In effect, the resulting independent distribution probability is interpreted as a male 45-54 who lives in a three (3) person household, classified as an older family, with a head of house education of nine (9) years to high school graduate, with two (2) television sets in the household, has a 52% likelihood of watching station WAAA live during the daypart of Monday through Friday from 9:00 AM to 12:00 PM.
While an example manner of implementing the imputation engine 110 of
Flowcharts representative of example machine readable instructions for implementing the imputation engine 110 of
As mentioned above, the example processes of
The program 600 of
As described above in connection with
The example category manager 214 identifies categories of interest for which a probability of viewing (exposure) is desired (block 702), such as the example seven categories referred-to above. Based on the identified target combination of categories of interest, such as the example above having the male age 45-54 et al., the example category manager 214 determines whether the available pool of data, previously weighted by the example weighting engine 210, includes a threshold number of households that match all (e.g., all seven) of the target combination of categories of interest (block 704). In some examples, the categories of interest for which a probability is desired includes specific media (e.g., a specific program, a specific advertisement). When the example category manager 214 identifies the categories of interest, a corresponding watermark may be used as search criteria when identifying the threshold number of households (block 704). As such, a first iteration of the example program 600 of
Assuming, for the sake of example, the threshold number of households to match all of the categories of interest is thirty (30), and the pool of data includes that threshold amount of available households (block 704), the example cell probability engine 216 is invoked by the probability engine 212 to calculate a probability value via a cell probability technique (block 706). On the other hand, if the pool of data does not satisfy the threshold amount of thirty households (e.g., has less than 30 households) (block 704), then the example probability engine 212 invokes the example independent distribution engine 218 to calculate a probability value via an independent distribution technique (block 708).
The example probability generator 224 of
Returning to block 704 of
In addition to key predictors having an influence on the probability of viewing, one or more additional secondary predictors may also influence the probability of viewing. As described above, the market researcher may have a combined set or target combination of categories of interest, but a number of households having all of those combined set of categories of interest does not exceed a threshold value (e.g., thirty (30) households). However, while the combined set of categories of interest may not be represented en masse from the donor pool, sub portions of the combined set or target combination of categories may include a relatively large representation within the donor pool. Example methods, apparatus, systems and/or articles of manufacture disclosed herein identify independent sub portions (subgroups) of the combined set of categories of interest and corresponding households associated with each subgroup of interest, which are applied independently to calculate a household exposure probability.
The example proportion manager 228 identifies a number of households from the key predictors group (e.g., 200 households having a size 2+ and a male age 45-54) that match a subgroup of interest (block 904). From the subgroup of interest, the example proportion manager 228 identifies a number of household tuning minutes and divides that value by the total household tuning minutes to calculate a household tuning proportion associated with the subgroup of interest (block 906). For example, if the subgroup of interest is all households tuned to the same live station (e.g., WAAA) (e.g., the live tuned station category) and such households reflect 1800 tuning minutes, then the example proportion manager 228 divides 1800 by the total household tuning minutes of 4500 to calculate a tuned station category household tuning proportion of 0.40 (block 906). The example proportion manager 228 also identifies a number of exposure minutes and divides that value by the total exposure minutes to calculate an exposure proportion associated with the subgroup of interest (e.g., the example tuned station category) (block 908). For example, if the subgroup of interest is all households tuned to the same live station (e.g., WAAA) (e.g., the household live tuned station dimension) and such households reflect 1320 exposure minutes, then the example proportion manager 228 divides 1320 by the total exposure minutes of 3600 to calculate a tuned station category exposure proportion of 0.37 (block 908). If more subgroups of interest from the donor pool are available (block 910), then the example proportion manager 228 selects the next subgroup of interest (block 912) and control returns to block 904.
After category household tuning proportion values and exposure proportion values have been calculated for each subgroup of interest, the example distribution engine 230 calculates the product of all household tuning proportion values and the total household tuning minutes (e.g., 4500 in this example) from the categories of interest (block 914), and calculates the product of all exposure proportion values and the total exposure minutes (e.g., 3600 in this example) from the categories of interest (block 916). A final independent distribution probability may then be calculated as the ratio of the exposure minutes and the household tuning minutes in a manner consistent with example Equation (5) (block 918). For example, and as described above in connection with
The example category manager 214 identifies demographic categories of interest (block 1004) for which viewing probability information is desired. While the illustrated example of
In the event additional RTVOD activity is available (block 1008) (e.g., after determining cell probabilities (block 706 of
In the event that all values and/or variations of RTVOD telecast delay associated with the selected media of interest and the selected demographic categories of interest have been considered (block 1008), then the example imputation engine 110 generates viewing probability trend information (block 1012).
The example table 1100 of
The processor platform 1200 of the illustrated example includes a processor 1212. The processor 1212 of the illustrated example is hardware. For example, the processor 1212 can be implemented by one or more integrated circuits, logic circuits, microprocessors or controllers from any desired family or manufacturer.
The processor 1212 of the illustrated example includes a local memory 1213 (e.g., a cache). The processor 1212 of the illustrated example is in communication with a main memory including a volatile memory 1214 and a non-volatile memory 1216 via a bus 1218. The volatile memory 1214 may be implemented by Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device. The non-volatile memory 1216 may be implemented by flash memory and/or any other desired type of memory device. Access to the main memory 1214, 1216 is controlled by a memory controller.
The processor platform 1200 of the illustrated example also includes an interface circuit 1220. The interface circuit 1220 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a PCI express interface.
In the illustrated example, one or more input devices 1222 are connected to the interface circuit 1220. The input device(s) 1222 permit(s) a user to enter data and commands into the processor 1212. The input device(s) can be implemented by, for example, an audio sensor, a microphone, a camera (still or video), a keyboard, a button, a mouse, a touchscreen, a track-pad, a trackball, isopoint and/or a voice recognition system.
One or more output devices 1224 are also connected to the interface circuit 1220 of the illustrated example. The output devices 1224 can be implemented, for example, by display devices (e.g., a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal display, a cathode ray tube display (CRT), a touchscreen, a tactile output device, a printer and/or speakers). The interface circuit 1220 of the illustrated example, thus, typically includes a graphics driver card, a graphics driver chip or a graphics driver processor.
The interface circuit 1220 of the illustrated example also includes a communication device such as a transmitter, a receiver, a transceiver, a modem and/or network interface card to facilitate exchange of data with external machines (e.g., computing devices of any kind) via a network 1226 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.).
The processor platform 1200 of the illustrated example also includes one or more mass storage devices 1228 for storing software and/or data. Examples of such mass storage devices 1228 include floppy disk drives, hard drive disks, compact disk drives, Blu-ray disk drives, RAID systems, and digital versatile disk (DVD) drives.
The coded instructions 1232 of
From the foregoing, it will appreciated that the above disclosed methods, apparatus and articles of manufacture allow audience measurement techniques to occur with a substantially larger quantity of households, by employing set meter devices instead of relatively more expensive people meter devices. Examples disclosed herein permit a determination of behavior probability that can be applied to households that do not have a People Meter device and, instead, employ the SM that captures codes, signatures and/or tuning behavior data. Such examples allow behavior probability calculations based on utilization of other households that include the People Meter device, in which the calculations reveal behavior probabilities in a stochastic manner that adheres to expectations of statistical significance. Further, by identifying viewing probabilities based on a type of RTVOD viewing behavior, advertising waste may be reduced (e.g., minimized) so that marketing may be targeted to demographic characteristics related to audiences that are most likely to be consuming media.
Although certain example methods, apparatus and articles of manufacture have been disclosed herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the claims of this patent.
This patent arises from a continuation of U.S. patent application Ser. No. 15/044,939 (20004/109769US05), filed on Feb. 16, 2016, which is a continuation of U.S. patent application Ser. No. 14/618,658 (20004/109769US04), filed on Feb. 10, 2015, which claims the benefit of U.S. Provisional Application Ser. No. 61/977,916 (Attorney Docket No. 20004/109769US03), which was filed on Apr. 10, 2014, U.S. Provisional Application No. 61/940,994 (Attorney Docket No. 20004/109769US02), which was filed on Feb. 18, 2014, and U.S. Provisional Application No. 61/938,617 (Attorney Docket No. 20004/109769US01), which was filed on Feb. 11, 2014, all of which are hereby incorporated herein by reference in their entireties.
Number | Date | Country | |
---|---|---|---|
61977916 | Apr 2014 | US | |
61940994 | Feb 2014 | US | |
61938617 | Feb 2014 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15044939 | Feb 2016 | US |
Child | 15359129 | US | |
Parent | 14618658 | Feb 2015 | US |
Child | 15044939 | US |