Methods, apparatus and articles of manufacture to estimate local market audiences of media content

Abstract

Disclosed example audience measurement apparatus determine a first audience metric based on set-top box return path tuning data obtained from set-top boxes located in a first geographic area; determine a second audience metric from a portion of audience measurement data corresponding to a second geographic area, the portion of the audience measurement data associated with monitored sites in the second geographic area having second set-top box characteristics that correspond with first set-top box characteristics of the set-top boxes located in the first geographic area; determine ratios of (i) respective first audience metrics determined for respective demographic stratifications to (ii) corresponding second audience metrics determined for the respective demographic stratifications; and combine the ratios after multiplication with third audience metrics determined, for the respective demographic stratifications, from the audience measurement data to determine an audience exposure metric that estimates exposure to media in the first geographic area.

Description

FIELD OF THE DISCLOSURE

This disclosure relates generally to audience measurement and, more particularly, to methods, apparatus and articles of manufacture to estimate local market audiences of media content.

BACKGROUND

Currently, there are 210 designated market areas (DMAs) for television audience measurement in the United States, ranging in size from several million households (e.g., New York, NY) to a few thousand households (e.g., Zanesville, OH). DMAs are also referred to as local markets. For economic reasons, local market audience measurement typically relies on local audience measurement data having smaller sample sizes than national-level audience measurement data, and/or that is collected using less expensive, and potentially less accurate, measurement techniques (e.g., such as via diaries rather than automated people meters). More recently, return path data collected, measured and/or provided by cable and/or satellite set-top boxes offers an alternative method to measure audiences of media content.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an example local market audience estimation system including an example local market audience exposure estimator constructed in accordance with the teachings of this disclosure.

FIG. 2 illustrates an example manner of implementing an example national audience weighter included in the local market audience exposure estimator of FIG. 1.

FIG. 3 illustrates an example manner of implementing an example local audience factorer included in the local market audience exposure estimator of FIG. 1.

FIG. 4 illustrates an example process that may be implemented using machine-readable instructions executed by one or more processors to implement the example local market audience exposure estimator of FIG. 1.

FIG. 5 illustrates an example process that may be implemented using machine-readable instructions executed by one or more processors to implement the example national audience weighter of FIGS. 1 and/or 2.

FIG. 6 illustrates an example process that may be implemented using machine-readable instructions executed by one or more processors to implement the example local audience factorer of FIGS. 1 and/or 3.

FIGS. 7A-D and 8A-D illustrates example local market audience exposure metrics determined by the example local market audience estimation system of FIG. 1 for an example local market.

FIG. 9 is a schematic illustration of an example processing system that may be used and/or programmed to implement the example local market audience exposure estimator of FIG. 1, the example national audience weighter of FIGS. 1 and/or 2, the example local audience factorer of FIGS. 1 and/or 3, and/or the example machine-readable instructions of FIGS. 4-6.

DETAILED DESCRIPTION

Example methods, apparatus and articles of manufacture to estimate local market audiences of media content are disclosed herein. An example method disclosed herein determines a local audience exposure metric estimating exposure to media content in a local market. The local audience exposure metric can correspond to, for example, a local audience population estimate estimating a number of persons in the local market that have been exposed to the media context, or a local audience ratings estimate estimating a percentage of persons in the local market that have been exposed to the media content, etc. The example method includes weighting national audience measurement data based on local population data to form weighted data. The example method also includes factoring (e.g., scaling or otherwise processing based on one or more factors) the weighted data based on the national audience measurement data and local tuning data to determine the local audience exposure metric.

In some examples, weighting the national audience measurement data comprises weighting the national audience measurement based on a target demographic group represented in the local population data, and also one or more of a target program, a target date, a target time-of-day, etc. In some examples, the local tuning data is local set-top box return path tuning data, and factoring the weighted data includes determining a factor corresponding to a ratio of a first audience metric determined from the local set-top box return path tuning data and a second audience metric determined from a cutback portion of the national audience measurement data, and then scaling a third audience metric determined from the weighted data based on the factor to determine the local audience exposure metric. In some examples, these first, second and third audience metrics are respective first, second and third audience population estimates, or respective first, second and third audience ratings estimates, etc. In some examples, the cutback portion of the national audience measurement data corresponds to a portion of the national audience measurement data associated with monitored sites having set-top box characteristics substantially similar to the local set-top box return path tuning data. Other examples of factoring the weighted data are also described hereinbelow.

A disclosed example apparatus to determine a local audience exposure metric estimating exposure to media content in a local market includes an example national exposure weighter to weight national audience measurement data based on local population data to form weighted data. The example apparatus also includes an example local audience factorer to factor (e.g., to scale or otherwise process based on one or more factors) the weighted data based on the national audience measurement data and local tuning data to determine the local audience exposure metric. In some examples, the national exposure weighter includes an example sampler to select a subset of the national audience measurement data, and an example weighter to weight the subset based on a target demographic group represented in the local population data, and also one or more of a target program, a target date, a target time-of-day, etc. In some examples, the local tuning data is local set-top box return path tuning data, and the example local audience factorer includes: (1) an example characterizer to impute characteristics of the local set-top box return path tuning data; (2) an example cutback indicator to add cutback indicators to the weighted data; (3) a first example estimator to compute a demographic audience metric using the weighted data; (4) a second example estimator to compute a cutback audience metric using a portion of the weighted data having a cutback indicator selected based on the local set-top box return path tuning data; (5) a third example estimator to compute a set-top box audience metric using the local set-top box return path tuning data; and (4) a fourth example estimator to combine the demographic audience metric, the cutback audience metric and the set-top box audience metric to form the local audience exposure metric.

While return path data may be relatively inexpensive to obtain and/or may enable the collection of relatively large quantities of audience measurement data, return path data can be biased and/or incomplete. With respect to incompleteness, return path data may, for example, exclude sections of the population (e.g., such as excluding non-subscribers to a particular digital service providing the return path data), lack demographic attributes, lack on/off indicators for the media presentation device coupled with the set-top box providing the return path data, lack information pertaining to which persons are in the viewing area and/or lack information regarding media content viewing/consumption on devices in a subscriber's households not associated with the set-top box. In contrast, traditional sample-based audience measurement techniques (e.g., diaries and/or automated people meters) have comparatively higher costs and/or comparatively smaller sample sizes, but are substantially less biased and provide substantially more complete data.

The example methods, apparatus and articles of manufacture to estimate local market audiences of media content disclosed herein overcome at least some of the limitations associated with local market audience measurement based on just return path data or just traditional sample-based audience measurement techniques. The examples disclosed herein leverage the strengths of return path data (e.g., large sample size and low cost) and sample-based research (e.g., unbiased and complete) to obtain, at least under some circumstances, unbiased, detailed and continuous estimates of local market audiences at an affordable cost. As described in greater detail below, the examples disclosed herein estimate local market audiences using a statistical combination of national sample-based audience measurement data, local return path data (or, more generally, local tuning data), and local population and/or demographic data.

FIG. 1 illustrates an example local market audience estimation system 100 to estimate, form, compute and/or otherwise generate local market audience measurement metrics 105 characterizing exposure to media content in one or more local markets. The media content for which local market audience measurement metrics 105 are to be determined can correspond to any type of media content, such as television, cable and/or satellite broadcast programming, video-on-demand programming, radio broadcast programming, online/streaming media content, etc. Any number and/or type(s) of television audience measurement system(s) 110 can be used to collect, measure and/or otherwise obtain example data 115 representing audiences of media content. The television audience measurement system(s) 110 can obtain the audience measurement data via, for example, people meters operating in statistically-selected households, set-top boxes and/or other media devices (e.g., such as digital video recorders, personal computers, tablet computer, smartphones, etc.) capable of monitoring and returning monitored data for media content presentations, etc. In some examples, the audience measurement system(s) 110, as well as the local market television audience estimation system 100, are used by advertisers and/or content providers to measure and/or establish with scientific and/or verifiable accuracy the reach of their advertising campaigns and/or media content.

As illustrated in FIG. 1, the example audience measurement system(s) 110 obtain the example data 115 representative of audiences of media content during one or more survey time periods. The example data 115 of FIG. 1 includes national audience measurement data 115A collected and/or obtained from, for example, people meters and/or other techniques for measuring a national audience of media content, and local tuning data 115B collected and/or obtained from, for example, return path data provided by cable and/or satellite set-top boxes (STBs) and/or other media devices. In the illustrated example of FIG. 1, the national audience data 115 is assumed to include audience demographic information and to characterize person-level exposure to media content. In contrast, the local tuning data 115B is assumed to not include audience demographic information and to characterize household-level (or, more specifically, device-level or STB-level) exposure to media content. Furthermore, it is assumed that the amount of local tuning data 115B substantially exceeds the amount of national audience data 115A (or at least the portion of the national audience data 115A that corresponds to a particular local market). The example data 115, 115A and 115B can be implemented by any number and/or type(s) of data structure(s), table(s), list(s) and/or record(s). The data 115, 115A and 115B can be stored on any number and/or type(s) of volatile and/or non-volatile memory(ies), memory device(s) and/or storage device(s).

To provide information representing the population of local markets, the example local market audience estimation system 100 of FIG. 1 includes local population data 120 (also referred to as local universe estimates 120). The example local population data 120 represents the demographics of local markets and can be obtained from any source or combination of sources providing demographic information for the local population(s) for which audience estimation is to be performed. The example local population data 120 can be implemented by any number and/or type(s) of data structure(s), table(s), list(s) and/or record(s). The local population data 120 can be stored on any number and/or type(s) of volatile and/or non-volatile memory(ies), memory device(s) and/or storage device(s).

To generate and/or compute the example local market audience measurement metrics 105, the example local market audience estimation system 100 of FIG. 1 includes a local market audience exposure rater 125. The example local market audience exposure estimator 125 of FIG. 1 statistically combines the national audience measurement data 115A, the local return path data 115B, and the local population and/or demographic data 120 to generate and/or compute the local market television audience metrics 105. In the illustrated example, to perform such statistical combining, the local market audience exposure estimator 125 includes an example national audience weighter 130 and an example local audience factorer 135.

As described in greater detail below, the example national audience weighter 130 of FIG. 1 samples the national audience data 115A and weights the samples national audience data 115A based on the local population data 120 to determine weighted national audience data, also referred to herein as simply weighted data. The weighted data forms an initial estimate of the local audience of the media content. As such, the national audience weighter 130 uses any appropriate weighting technique to weight (e.g., scale, emphasize, deemphasize, etc.) the national audience data 115A based on the demographic information included the national audience data 115A and the local population data 120 such that the resulting weighted data is representative of the demographics of the local market under consideration.

However, audience exposure to media content may be influenced by local characteristics (e.g., such as local preferences, local on-air personalities, etc.) that are not functions of demographics alone. Unlike the national audience data 115A, the local tuning data 115B is obtained by, for example, STB return path data for households in the local market. As such, the local tuning data 115B can reflect the preferences in the local market that are not functions of the demographics alone. However, the local tuning data 115B by itself may be insufficient to characterize the local audience because the local tuning data 115B does not include demographic information, is at the household or device level rather than the person level, and reflects the viewing of only those local sites providing the local tuning data 115B (e.g., such as only those households having STBs capable of providing the return path data forming the local tuning data 115B). Accordingly, and as described in greater detail below, the example local audience factorer 135 of FIG. 1 factors (e.g., scales and/or otherwise processes using one or more factors) the weighted data determined by the national audience weighter 130 (which includes demographic information, is at the person level and represents audience exposure across different media content presentation platforms) based on the local tuning data 115B obtained for the local market under consideration (which can represent local preferences not accounted for by demographics alone) to determine the local market audience metrics 105.

An example implementation of the national audience weighter 130 of FIG. 1 is illustrated in FIG. 2. The example national audience weighter 130 of FIG. 2 includes an example sampler 205 to sample the national audience measurement data 115A to produce a data subset that is relevant to the local market. For example, the statistically selected panel of households containing the people meters that provide the national audience measurement data 115A can change over time. Thus, the sampler 205 can employ any appropriate sampling technique to sample the national audience measurement data 115A to select only that data corresponding to households in the current statistically selected panel and to exclude data corresponding to obsolete households no longer in the statistically selected panel. Additionally or alternatively, the sampler 205 can employ any appropriate sampling technique to sample only the portions of the national audience measurement data 115A having demographic relevance to the local market under consideration. Other type(s) of data sampling can additionally or alternatively be implemented by the sampler 205.

The example national audience weighter 130 of FIG. 2 also includes an example weighter 210 to weight the sampled national audience measurement data 115A obtained from the sampler 205 to provide an initial estimate of audience measurement data for the local market under consideration. For example, the weighter 210 can use any appropriate technique to statistically weight (e.g., scale, emphasize, deemphasize, etc.) the sampled national audience measurement data 115A to account for differences between the size and/or demographic makeup of the national audience measurement data 115A and the size and/or demographic makeup of the local market as represented by the local population data 120. The result of the weighting performed by the weighter 210 is weighted national audience measurement data 215 that can be used as an initial estimate of the local audience measurement data for the particular local market under consideration.

An example implementation of the local audience factorer 135 of FIG. 1 is illustrated in FIG. 3. The example local audience factorer 135 of FIG. 3 uses the weighted national audience measurement data 215 determined by the weighter 130 of FIG. 2 and the local tuning data 115B (e.g., which is local STB return path data 115B in the illustrated example) to determine the local market audience metrics 105. In the illustrated example of FIG. 3, the local audience factorer 135 includes an example demographic audience estimator 305 to determine (e.g., compute) an initial demographic audience metric from the weighted national audience measurement data 215 for a particular demographic stratification. For example, for a particular demographic stratification, i, the corresponding initial demographic audience metric, D_i, determined by the demographic audience estimator 305 can correspond to an audience population estimate estimating a number of persons in the local market and the particular demographic stratification, i, that have been exposed to the media context. As another example, for a particular demographic stratification, i, the corresponding initial demographic audience metric, D_i, determined by the demographic audience estimator 305 can correspond to an audience ratings estimate estimating a percentage of persons in the local market and the particular demographic stratification, i, that have been exposed to the media content, etc. Examples of demographic stratifications include, but are not limited to, gender stratifications, age stratifications, income stratifications, etc., and/or any combination(s) thereof.

The local audience factorer 135 also includes an example characterizer 310 and an example STB audience estimator 315 to determine a first factor to be used to factor the weighted national audience data 215 to determine the local market audience metrics 105. In the illustrated example, the characterizer 310 is to impute characteristics of the local STB return path tuning data 115B. As noted above, the local STB return path tuning data 115B (or, more generally, the local tuning data 115B) generally does not include demographic information. As such, to enable the local STB return path tuning data 115B to be used to factor the weighted national audience data 215 for a particular demographic stratification, the characterizer 310 adds demographic information to the local STB return path tuning data 115B. The characterizer 310 can employ any appropriate technique or techniques to add demographic information to the local STB return path tuning data 115B. For example, the characterizer 310 can add demographic information obtained from surveys and/or other sources of information for the households containing the STBs providing the local STB return path tuning data 115B. Additionally or alternatively, the characterizer 310 can bootstrap the demographic information by inferring the demographic information for a particular household based on the types of media content included in the STB return path tuning data 115B for that household.

The STB audience estimator 315 of FIG. 3 determines (e.g., computes) an STB audience metric from the local STB return path data 115B for a particular demographic stratification. For example, for a particular demographic stratification, i, the corresponding STB audience metric, S_i, determined by the STB audience estimator 315 can correspond to an audience population estimate estimating a number of households among the households represented in the STB return path data 115B and in the particular demographic stratification, i, that have been exposed to the media context. As another example, for a particular demographic stratification, i, the corresponding STB audience metric, S_i, determined by the STB audience estimator 315 can correspond to an audience ratings estimate estimating a percentage of households among the households represented in the STB return path data 115B and in the particular demographic stratification, i, that have been exposed to the media content, etc.

The local audience factorer 135 further includes an example cutback indicator appender 320 and an example cutback audience estimator 325 to determine a second factor to be used to factor the weighted national audience data 215 to determine the local market audience metrics 105. The STB audience metric determined by the STB audience estimator 315 in combination with the characterizer 320 represents, for example, local media content preferences that are not accounted for by demographics alone, which can be used to modify the initial demographic audience metric, D_i, determined from the weighted national audience measurement data 215. However, the STB audience metric is based on data obtained from only a subset of the local audience households containing the particular type(s) of STB equipment providing the return path data. Thus, to determine a factor for adjusting the initial demographic audience metric, D_i, based on the STB audience metric S_i, the cutback indicator appender 320 and the cutback audience estimator 325 determine a cutback audience metric from only those portion(s) the weighted national audience data 215 associated with type(s) of STB equipment substantially similar to that associated with the local STB return path data 115B. Selection of the appropriate portion of the weighted national audience data 215 associated with a particular type of STB equipment is facilitated by the use of cutback indicators. A cutback indicator represents a particular (e.g., unique) type of STB equipment or set of STB characteristics. Accordingly, the cutback indicator appender 320 appends cutback indicators to the weighted national audience data 215 to indicate the type of STB equipment or set of STB characteristics associated with entries in the weighted national audience data 215.

The cutback audience estimator 325 of FIG. 3 determines (e.g., computes) a cutback audience metric from the weighted national audience data 215 for a particular demographic stratification and particular cutback category associated with the local return path data 115B. For example, for a particular demographic stratification, i, the corresponding cutback audience metric, C_i, determined by the cutback audience estimator 325 can correspond to an audience population estimate estimating a number of households among the households in the weighted national audience data 215 having the same type of STB equipment or set of STB characteristics as the local return path data 115B and in the particular demographic stratification, i, that have been exposed to the media context. As another example, for a particular demographic stratification, i, the corresponding cutback audience metric, C_i, determined by the cutback audience estimator 325 can correspond to an audience ratings estimate estimating a percentage of households among the households in the weighted national audience data 215 having the same type of STB equipment or set of STB characteristics as the local return path data 115B and in the particular demographic stratification, i, that have been exposed to the media content, etc.

In the illustrated example of FIG. 3, the local audience factorer 135 includes an example local market estimator 330 to process the demographic audience metric, D_i, the STB audience metric, S_i, and the cutback audience metric, C_i, described above to determine factor(s) for use in factoring the weighted national audience data 215 to determine the local market audience metrics 105. In some examples, for a particular demographic stratification, the local audience factorer 135 scales the initial demographic audience metric, D_i, by a factor that is a ratio of the STB audience metric, S_i, and the cutback audience metric, C_i to determine a local market audience metric for this particular demographic stratification, i. Mathematically, the factoring (e.g., scaling) performed by the local market estimator 330 to determine a local market audience metric, A_i, for a particular demographic stratification, i, is represented by Equation 1:

$\begin{array}{cc}{A}_i=D_i{F}_i=D_i\left(\frac{S_i}{C_i}\right)& \mathrm{Equation}1\end{array}$ In Equation 1, the factor F_i=S_i/C_i factors (e.g., scales) the initial demographic audience metric, D_i, to account for local characteristics that are not a function of demographics alone. The examples disclosed herein are not limited to any particular technique(s) for determining the demographic audience metric(s), D_i, the STB audience metric(s), S_i, and the cutback audience metric(s), C_i.

In some examples, the local market estimator 330 determines an overall (also referred to as integrated) local market audience metric, A, by summing the local market audience metric(s), A_i, for all appropriate demographic stratifications represented in the local market. Mathematically, this is represented by Equation 2:

$\begin{array}{cc}A=\sum _i{A}_i=\sum _i{D}_i{F}_i=\sum _i{D}_i\left(\frac{S_i}{C_i}\right)& \mathrm{Equation}2\end{array}$

In some examples, the local audience factorer 135 can restrict the factor F_i to be within upper and lower limits U_i and L_i, respectively, which may be the same or different for different demographic stratifications. These upper and lower limits can prevent excessive variation in the factor Fi that may occur, for example, if Ci is very small, resulting in an unrealistically large value of Fi.

In some examples, the local market audience metric, A_i, is determined based on rewriting Equation 1 as Equation 3:

$\begin{array}{cc}{A}_i=D_i\left(\frac{S_i}{C_i}\right)=S_i\left(\frac{D_i}{C_i}\right)=S_i\left(\frac{D_i}{P}\right)\left(\frac{P}{H_t}\right)\left(\frac{H_t}{C_i}\right)& \mathrm{Equation}3\end{array}$ In Equation 3, the quantity D_i/P is an audience participation factor, the quantity P/H_t is an audience member per household factor, and the quantity H_t/C_i is a total households against cutback rating factor. In some examples, the local audience factorer 135 determines the local market audience metric, A_i, based on the quantities in Equation 3 instead of directly via Equation 1 to, for example, enable one or more of these quantities to be subjected to limits reflecting the particular audience measurement environment.

In some examples, the local audience factorer 135 includes an example local market adjuster 335 to adjust determination of the local market audience metrics 105 based on information, such as local audience measurement data, different from and in addition to the local STB return path data 115B (or, more generally, the local tuning data 115B). For example, such additional information can include local audience measurement data obtained from people meters and/or similar audience measurement equipment for the particular local market, on/off indicators to indicate whether media presentation devices (e.g., televisions) coupled to the STBs providing the return path data 115B are turned on or off, etc. For example, the local market adjuster 335 can determine the local market audience metric, A_i, for a particular demographic stratification, i, by adjusting and/or scaling the factor F_i as represented by Equation 4:

$\begin{array}{cc}{A}_i=D_i\times \left(g_i\times \mathrm{adj}\left(F_i\right)\right)=D_i\times \left(g_i\times \mathrm{adj}\left(\frac{S_i}{C_i}\right)\right)& \mathrm{Equation}4\end{array}$ In Equation 4, the quantity g_i represents a gain to be used to scale the factor F_i, and the function adj(⋅) represents an adjustment to be performed on the factor F_i. For example, the function adj(⋅) can involve raising the factor F_i to a power to, for example, enhance differences between the local market audience metrics, A_i, for different demographic stratifications. The examples disclosed herein are not limited to any particular technique(s) for determining the gain g_i and/or the adjustment function adj(⋅).

In some examples, the local market adjuster 335 determines an overall (also referred to as integrated) local market audience metric, A, by summing, after adjustment, the local market audience metric, A_i, for all appropriate demographic stratifications represented in the local market. Mathematically, this is represented by Equation 5:

$\begin{array}{cc}A=\sum _i{A}_i=\sum _i{D}_i\times \left(g_i\times \mathrm{adj}\left(F_i\right)\right)=\sum _i{D}_i\times \left(g_i\times \mathrm{adj}\left(\frac{S_i}{C_i}\right)\right)& \mathrm{Equation}5\end{array}$

Although the preceding examples refer to STB return path data and associated STB audience metric estimation, the examples disclosed herein are not limited thereto. For example, the STBs referred to above can be replaced by any media device or devices capable of providing media content and reporting media contact measurement data associated therewith.

While example manners of implementing the local market audience exposure rater 125, the example national audience weighter 130 and the example local audience factorer 135 of FIG. 1 have been illustrated in FIGS. 1-3, one or more of the elements, processes and/or devices illustrated in FIGS. 1-3 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, the example sampler 205, the example weighter 210, the example demographic audience estimator 305, the example characterizer 310, the example STB audience estimator 315, the example cutback indicator appender 320, the example cutback audience estimator 325, the example local market estimator 330, the example local market adjuster 335 and/or, more generally, the example national audience weighter 130, the example local audience factorer 135 and/or the example local market audience exposure rater 125 of FIGS. 1-3 may be implemented by hardware, software, firmware and/or any combination of hardware, software and/or firmware. Thus, for example, any of the example sampler 205, the example weighter 210, the example demographic audience estimator 305, the example characterizer 310, the example STB audience estimator 315, the example cutback indicator appender 320, the example cutback audience estimator 325, the example local market estimator 330, the example local market adjuster 335 and/or, more generally, the example national audience weighter 130, the example local audience factorer 135 and/or the example local market audience exposure rater 125 could be implemented by one or more circuit(s), programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)), etc. When any of the appended apparatus claims are read to cover a purely software and/or firmware implementation, at least one of the example local market audience exposure rater 125, the example national audience weighter 130, the example local audience factorer 135, the example sampler 205, the example weighter 210, the example demographic audience estimator 305, the example characterizer 310, the example STB audience estimator 315, the example cutback indicator appender 320, the example cutback audience estimator 325, the example local market estimator 330 and/or the example local market adjuster 335 are hereby expressly defined to include a tangible computer readable medium such as a memory, digital versatile disk (DVD), compact disk (CD), etc., storing such software and/or firmware. Further still, the example local market audience exposure rater 125, the example national audience weighter 130 and/or the example local audience factorer 135 of FIGS. 1-3 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIGS. 1-3, and/or may include more than one of any or all of the illustrated elements, processes and devices.

Flowcharts representative of example processes corresponding to example machine readable instructions that may be executed to implement the example local market audience exposure rater 125, the example national audience weighter 130, the example local audience factorer 135, the example sampler 205, the example weighter 210, the example demographic audience estimator 305, the example characterizer 310, the example STB audience estimator 315, the example cutback indicator appender 320, the example cutback audience estimator 325, the example local market estimator 330 and/or the example local market adjuster 335 are shown in FIGS. 4-6. In these examples, the machine readable instructions represented by each flowchart may comprise one or more programs for execution by a processor, such as the processor 912 shown in the example processing system 900 discussed below in connection with FIG. 9. Alternatively, the entire program or programs and/or portions thereof implementing one or more of the processes represented by the flowcharts of FIGS. 4-6 could be executed by a device other than the processor 912 (e.g., such as a controller and/or any other suitable device) and/or embodied in firmware or dedicated hardware (e.g., implemented by an ASIC, a PLD, an FPLD, discrete logic, etc.). Also, one or more of the machine readable instructions represented by the flowchart of FIGS. 4-6 may be implemented manually. Further, although the example machine readable instructions are described with reference to the flowcharts illustrated in FIGS. 4-6, many other techniques for implementing the example methods and apparatus described herein may alternatively be used. For example, with reference to the flowcharts illustrated in FIGS. 4-6, the order of execution of the blocks may be changed, and/or some of the blocks described may be changed, eliminated, combined and/or subdivided into multiple blocks.

As mentioned above, the example processes of FIGS. 4-6 may be implemented using coded instructions (e.g., computer readable instructions) stored on a tangible computer readable medium such as a hard disk drive, a flash memory, a read-only memory (ROM), a CD, a DVD, a cache, a random-access memory (RAM) and/or any other storage media in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term tangible computer readable medium is expressly defined to include any type of computer readable storage and to exclude propagating signals. Additionally or alternatively, the example processes of FIGS. 4-6 may be implemented using coded instructions (e.g., computer readable instructions) stored on a non-transitory computer readable medium, such as a flash memory, a ROM, a CD, a DVD, a cache, a random-access memory (RAM) and/or any other storage media in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term non-transitory computer readable medium is expressly defined to include any type of computer readable medium and to exclude propagating signals. Also, as used herein, the terms “computer readable” and “machine readable” are considered equivalent unless indicated otherwise.

Example machine readable instructions 400 that may be executed to implement the example local market audience exposure rater 125 of FIG. 1 are represented by the flowchart shown in FIG. 4. With reference to the preceding figures, the machine readable instructions 400 of FIG. 4 begin execution at block 405 at which the national audience weighter 130 included in the local market audience exposure rater 125 weights that national audience measurement data 115A based on the local population data 120 to determine the weighted national audience measurement data 215. As described above, the weighted national audience measurement data 215 can be used as an initial estimate of local audience measurement data for the particular local market under consideration.

At block 410, the local audience factorer 135 included in the local market audience exposure rater 125 computes scaling factor(s) (e.g., F for the overall/integrated population, and/or F_i for one or more demographic stratifications, i) from the national audience measurement data 115A and the local population data 120, as described above. At block 415, the local audience factorer 135 factors (e.g., scales or otherwise processes using factor(s)) the weighted national audience measurement data 215 to determine the local market audience metric(s) 105 for the overall/integrated population and/or one or more demographic stratifications of the local market.

Example machine readable instructions 500 that may be executed to implement the example national audience weighter 130 of FIGS. 1 and 2, and/or the processing at block 405 of FIG. 4, are illustrated in FIG. 5. With reference to the preceding figures, the machine readable instructions 500 of FIG. 5 begin execution at block 505 at which the sampler 205 included in the national audience weighter 130 samples the national audience measurement data 115A to obtain a subset of the data that is relevant to the local market under consideration, as described above. At block 510, the weighter 210 included in the national audience weighter 130 weights the subset of the national audience measurement data 115A obtained at block 505 based on the local population data 120 to determine the weighted national audience measurement data 215, as described above. For example, in the case of determining audience metrics for television programming, at block 510 the national audience weighter 130 can weight the subset of the national audience measurement data 115A to reflect a target demographic group represented in the local population data 120, as well as a target program, a target date on which the program was broadcast, a target time-of-day at which the program was broadcast, etc.

Example machine readable instructions 600 that may be executed to implement the example local audience factorer 135 of FIGS. 1 and 3, and/or the processing at blocks 410-415 of FIG. 4, are illustrated in FIG. 6. With reference to the preceding figures, the machine readable instructions 600 of FIG. 6 begin execution at block 605 at which the characterizer 310 included in the local audience factorer 135 imputes demographic characteristics of the local tuning data 115B, as described above, to yield local tuning data 610 containing demographic characteristics. In the illustrated example, the imputed demographic characteristics correspond to the demographic stratifications present in the local population data 120. At block 615, the cutback indicator appender 320 included in the local audience factorer 135 appends cutback indicators to the weighted national audience measurement data 215, as described above, to yield weighted national audience measurement data 620 containing cutback indicators.

At block 625, the demographic audience estimator 305 included in the local audience factorer 135 determines (e.g., computes) initial demographic audience metric(s), A, from the weighted national audience measurement data 215 for the overall/integrated population and/or one or more demographic stratifications, i, of the local market, as described above. At block 630, the cutback audience estimator 325 included in the local audience factorer 135 determines (e.g., computes) the cutback audience metric(s), C_i, from the weighted national audience measurement data 620 for the overall/integrated population and/or one or more demographic stratifications, i, of the local market, as described above. At block 640, the STB audience estimator 315 included in the local audience factorer 135 determines (e.g., computes) the STB audience metric(s), S_i, from the local STB return path data 610 for the overall/integrated population and/or one or more demographic stratifications, i, of the local market, as described above.

At block 640, the local market estimator 330 included in the local audience factorer 135 processes the initial demographic audience metric(s), D_i, the cutback audience metric(s), C_i, and the STB audience metric(s), S_i, determined at blocks 625-635 to determine local market audience metric(s), A_i, for one or more demographic stratifications, i, of the local market, as described above. At block 645, the local market estimator 330 determines a local market audience metric, A, by, for example, summing the local market audience metric(s), A_i, determined at block 645, as described above. At block 650, the local market adjuster 335 included in the local audience factorer 135 adjusts, if appropriate, the local market audience metric(s) A_i and/or A, as described above.

Example local market audience exposure metrics 105 determined by the example local market audience estimation system 100 of FIG. 1 for an example local market are illustrated in FIGS. 7A-D and 8A-D. Table 705 of FIG. 7A illustrates a first example operation of the local market audience estimation system 100 to determine a local market audience exposure metric 105 that is an overall/integrated local audience population estimate A (e.g., which is equivalent to selecting a single demographic stratification covering the entire local population) for a particular broadcast program and a particular day/time. Table 705 illustrates weighting national audience measurement data (referred to as national people meter (NPM) data in the figures) and calculation of the initial local audience metric (e.g., population estimate), D, from the weighted national audience measurement data. Table 705 also illustrates calculation of the cutback audience metric (e.g., population estimate), C, and the STB audience metric (e.g., population estimate), S, as well as the factor, F=S/C and its upper and lower limits, for the illustrated example. Table 705 further illustrates calculation of the overall/integrated local audience population estimate as A=D×S/C, as described above.

Table 710 of FIG. 7B illustrates a second example operation of the local market audience estimation system 100 to determine local market audience exposure metrics 105 that are local audience population estimates A_i for three demographic stratifications i. Table 710 illustrates calculation of the initial local audience metrics (e.g., population estimates), D_i, the cutback audience metrics (e.g., population estimates), C_i, the STB audience metrics (e.g., population estimates), S_i, and the factors, F_i=S_i/C_i for the three demographic stratifications i. In the illustrated example, the factors F_i have different upper and lower limits for each demographic stratifications i. Table 710 also illustrates calculation of the local market audience metrics (e.g., population estimates) A_i and A based on Equation 1 and Equation 2.

Table 715 of FIG. 7C illustrates a third example operation of the local market audience estimation system 100 to determine local market audience exposure metrics 105 that are local audience population estimates A_i for three demographic stratifications i, which are adjusted based on an adjustment function adj(⋅). The operations illustrated in Table 715 are similar to operations illustrated in FIG. 710, except that Table 715 further illustrates adjustment of the factors F_i. The adjustment function adj(⋅) utilized in Table 715 is to raise each factor F_i to an exponent represented by the illustrated amplification constant.

Table 720 of FIG. 7D illustrates a fourth example operation of the local market audience estimation system 100 to determine local market audience exposure metrics 105 that are local audience population estimates A_i for three demographic stratifications i, which are adjusted based on the adjustment function adj(⋅) of Table 715, as well as gains g_i. The operations illustrated in Table 720 are similar to operations illustrated in FIG. 715, except that Table 720 further illustrates multiplying the adjusted factors F_i by the gains g_i. In the illustrated example, different gain factors g_i are associated with each demographic stratifications i.

FIGS. 8A-D include Tables 805, 810, 815 and 820 that illustrate example operations of the local market audience estimation system 100 similar to the respective examples of Tables 705, 710, 715 and 720. However, in Tables 805, 810, 815 and 820, the determined local market audience exposure metrics 105 are local audience ratings estimates A and A_i, whereas the local market audience exposure metrics 105 determined in Tables 705, 710, 715 and 720 are local audience population estimates A and A_i.

FIG. 9 is a block diagram of an example processing system 900 capable of implementing the apparatus and methods disclosed herein. The processing system 900 can be, for example, a server, a personal computer, a personal digital assistant (PDA), an Internet appliance, a DVD player, a CD player, a digital video recorder, a personal video recorder, a set top box, or any other type of computing device.

The system 900 of the instant example includes a processor 912 such as a general purpose programmable processor. The processor 912 includes a local memory 914, and executes coded instructions 916 present in the local memory 914 and/or in another memory device. The processor 912 may execute, among other things, the machine readable instructions represented in FIGS. 4-6. The processor 912 may be any type of processing unit, such as one or more Intel® and/or ARM® microprocessors, and/or one or more PIC® microcontrollers, etc. Of course, other processors from other families are also appropriate.

The processor 912 is in communication with a main memory including a volatile memory 918 and a non-volatile memory 920 via a bus 922. The volatile memory 918 may be implemented by Static Random Access Memory (SRAM), Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device. The non-volatile memory 920 may be implemented by flash memory and/or any other desired type of memory device. Access to the main memory 918, 920 is typically controlled by a memory controller (not shown).

The processing system 900 also includes an interface circuit 924. The interface circuit 924 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a third generation input/output (3GIO) interface.

One or more input devices 926 are connected to the interface circuit 924. The input device(s) 926 permit a user to enter data and commands into the processor 912. The input device(s) can be implemented by, for example, a keyboard, a mouse, a touchscreen, a track-pad, a trackball, an isopoint and/or a voice recognition system.

One or more output devices 928 are also connected to the interface circuit 924. The output devices 928 can be implemented, for example, by display devices (e.g., a liquid crystal display, a cathode ray tube display (CRT)), by a printer and/or by speakers. The interface circuit 924, thus, typically includes a graphics driver card.

The interface circuit 924 also includes a communication device such as a modem or network interface card to facilitate exchange of data with external computers via a network (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.).

The processing system 900 also includes one or more mass storage devices 930 for storing machine readable instructions and data. Examples of such mass storage devices 930 include floppy disk drives, hard drive disks, compact disk drives, digital versatile disk (DVD) drives, flash drives, etc. In some examples, the mass storage device 930 may store one or more of the data 115, 115A, 115B, 120 and/or 215, and/or the local audience metrics 105. Additionally or alternatively, in some examples the volatile memory 918 may store one or more of the data 115, 115A, 115B, 120 and/or 215, and/or the local audience metrics 105.

The coded instructions 932 of FIGS. 4-6 may be stored in the mass storage device 930, in the volatile memory 918, in the non-volatile memory 920, in the local memory 914 and/or on a removable storage medium, such as a CD or DVD 932.

As an alternative to implementing the methods and/or apparatus described herein in a system such as the processing system of FIG. 9, the methods and or apparatus described herein may be embedded in a structure such as a processor and/or an ASIC (application specific integrated circuit).

Finally, although certain example methods, apparatus and articles of manufacture have been described herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the appended claims either literally or under the doctrine of equivalents.

Claims

1. At least one non-transitory computer readable medium comprising computer readable instructions which, when executed, cause one or more processors to at least: obtain a first audience metric value based on first data from a plurality of media devices associated with an audience;obtain a second audience metric value based on second data from a plurality of panel devices associated with panelists;determine a third audience metric value based on comparison of the first data and the second data, the comparison of the first data and the second data including comparing a first media device characteristic associated with the first data and a second media device characteristic associated with the second data, the first media device characteristic indicating a characteristic of one of the plurality of media devices and the second media device characteristic indicating a characteristic of a media device at a monitored site associated with one of the plurality of panel devices;compute a ratio based on the first audience metric value, the third audience metric value and an adjustment value;multiply the second audience metric value by the ratio to determine a fourth audience metric value associated with the audience; andoutput the fourth audience metric value.

2. The at least one non-transitory computer readable medium of claim 1, wherein the plurality of media devices includes a plurality of televisions.

3. The at least one non-transitory computer readable medium of claim 1, wherein the instructions cause the one or more processors to determine the third audience metric value by: (i) selecting, based on the comparison, a subset of the panel devices from which to define a cutback, and (ii) determining the third audience metric value based on the cutback.

4. The at least one non-transitory computer readable medium of claim 1, wherein the instructions cause the one or more processors to compute the ratio based on division of the first audience metric value by the third audience metric value.

5. The at least one non-transitory computer readable medium of claim 4, wherein the instructions cause the one or more processors to compute the ratio based on multiplication of the adjustment value by a result of the division of the first audience metric value by the third audience metric value.

6. The at least one non-transitory computer readable medium of claim 1, wherein the plurality of media devices is associated with a first geographic area and the plurality of panel devices is associated with a second geographic area different from the first geographic area.

7. The at least one non-transitory computer readable medium of claim 1, wherein the adjustment value is associated with a first demographic characteristic.

8. An audience measurement computing system comprising: memory storing machine readable instructions; andat least one processor to execute the machine readable instructions to at least: obtain a first audience metric value based on first data from a plurality of media devices associated with an audience;obtain a second audience metric value based on second data from a plurality of panel devices associated with panelists;determine a third audience metric value based on comparison of the first data and the second data, the comparison of the first data and the second data including comparing a first media device characteristic associated with the first data and a second media device characteristic associated with the second data, the first media device characteristic indicating a characteristic of one of the plurality of media devices and the second media device characteristic indicating a characteristic of a media device at a monitored site associated with one of the plurality of panel devices;compute a ratio based on the first audience metric value, the third audience metric value and an adjustment value;multiply the second audience metric value by the ratio to determine a fourth audience metric value associated with the audience; andoutput the fourth audience metric value.

9. The audience measurement computing system of claim 8, wherein the plurality of media devices includes a plurality of televisions.

10. The audience measurement computing system of claim 8, wherein the at least one processor is to determine the third audience metric value by: (i) selecting, based on the comparison, a subset of the panel devices from which to define a cutback, and (ii) determining the third audience metric value based on the cutback.

11. The audience measurement computing system of claim 8, wherein the at least one processor is to compute the ratio based on division of the first audience metric value by the third audience metric value.

12. The audience measurement computing system of claim 11, wherein the at least one processor is to compute the ratio based on multiplication of the adjustment value by a result of the division of the first audience metric value by the third audience metric value.

13. The audience measurement computing system of claim 8, wherein the plurality of media devices is associated with a first geographic area and the plurality of panel devices is associated with a second geographic area different from the first geographic area.

14. The audience measurement computing system of claim 8, wherein the adjustment value is associated with a first demographic characteristic.

15. A method performed by a computing system having at least one processor, the method comprising: obtaining a first audience metric value based on first data from a plurality of media devices associated with an audience;obtaining a second audience metric value based on second data from a plurality of panel devices associated with panelists;determining, by executing an instruction with the at least one processor, a third audience metric value based on comparison of the first data and the second data, the comparison of the first data and the second data including comparing a first media device characteristic associated with the first data and a second media device characteristic associated with the second data, the first media device characteristic indicating a characteristic of one of the plurality of media devices and the second media device characteristic indicating a characteristic of a media device at a monitored site associated with one of the plurality of panel devices;computing, by executing an instruction with the at least one processor, a ratio based on the first audience metric value, the third audience metric value and an adjustment value;multiplying, by executing an instruction with the at least one processor, the second audience metric value by the ratio to determine a fourth audience metric value associated with the audience; andoutputting the fourth audience metric value.

16. The method of claim 15, wherein the plurality of media devices includes a plurality of televisions.

17. The method of claim 15, wherein the determining of the third audience metric value includes: (i) selecting, based on the comparison, a subset of the panel devices from which to define a cutback, and (ii) determining the third audience metric value based on the cutback.

18. The method of claim 15, wherein the computing of the ratio includes dividing the first audience metric value by the third audience metric value.

19. The method of claim 18, wherein the computing of the ratio includes multiplying the adjustment value by a result of the dividing of the first audience metric value by the third audience metric value.

20. The method of claim 15, wherein the plurality of media devices is associated with a first geographic area and the plurality of panel devices is associated with a second geographic area, and the adjustment value is associated with a first demographic characteristic.