This disclosure relates generally to market research, and, more particularly, to methods and apparatus to assign viewers to media meter data.
In recent years, panelist research efforts included installing metering hardware in qualified households that fit one or more demographics of interest. In some cases, the metering hardware is capable of determining whether a media presentation device (such as a television set) is powered on and tuned to a particular station via a hardwired connection from the media presentation device to the meter. In other cases, the metering hardware is capable of determining which household member is exposed to a particular portion of media via one or more button presses on a People Meter by the household member near the television.
Market researchers seek to understand the audience composition and size of media, such as radio programming, television programming and/or Internet media so that advertising prices can be established that are commensurate with audience exposure and demographic makeup (referred to herein collectively as “audience configuration”). As used herein, “media” refers to any sort of content and/or advertisement which is presented or capable of being presented by an information presentation device, such as a television, radio, computer, smart phone or tablet. To determine aspects of audience configuration (e.g., which household member is currently watching a particular portion of media and the corresponding demographics of that household member), the market researchers may perform audience measurement by enlisting any number of consumers as panelists. Panelists are audience members (household members) enlisted to be monitored, who divulge and/or otherwise share their media exposure habits and demographic data to facilitate a market research study. An audience measurement entity typically monitors media exposure habits (e.g., viewing, listening, etc.) of the enlisted audience members via audience measurement system(s), such as a metering device and a People Meter. Audience measurement typically involves determining the identity of the media being displayed on a media presentation device, such as a television.
Some audience measurement systems physically connect to the media presentation device, such as the television, to identify which channel is currently tuned by capturing a channel number, audio signatures and/or codes identifying (directly or indirectly) the programming being displayed. Physical connections between the media presentation device and the audience measurement system may be employed via an audio cable coupling the output of the media presentation device to an audio input of the audience measurement system. Additionally, audience measurement systems prompt and/or accept audience member input to reveal which household member is currently exposed to the media presented by the media presentation device.
As described above, audience measurement entities may employ the audience measurement systems to include a device, such as the People Meter (PM), having a set of inputs (e.g., input buttons) that are each assigned to a corresponding member of a household. The PM is an electronic device that is typically disposed in a media exposure (e.g., viewing) area of a monitored household and is proximate to one or more of the audience members. The PM captures information about the household audience by prompting the audience members to indicate that they are present in the media exposure area (e.g., a living room in which a television set is present) by, for example, pressing their assigned input key on the PM. When a member of the household selects their corresponding input, the PM identifies which household member is present, which includes other demographic information associated with the household member, such as a name, a gender, an age, an income category, etc. As such, any time/date information associated with the media presented is deemed “viewing data” or “exposure data” (e.g., “viewing minutes”) because it is uniquely associated with one of the household panelist members. As used herein, “viewing data” is distinguished from “tuning data” (e.g., “tuning minutes”) in which media is presented within the household without a unique association with one of the household panelist members. In the event a visitor is present in the household, the PM includes at least one input (e.g., an input button) for the visitor to select. When the visitor input button is selected, the PM prompts the visitor to enter an age and a gender (e.g., via keyboard, via an interface on the PM, etc.).
The PM may be accompanied by a base metering device (e.g., a base meter) to measure one or more signals associated with the media presentation device. For example, the base meter may monitor a television set to determine an operational status (e.g., whether the television is powered on or powered off, a media device power sensor), and/or to identify media displayed and/or otherwise emitted by the media device (e.g., identify a program being presented by a television set). The PM and the base meter may be separate devices and/or may be integrated into a single unit. The base meter may capture audience measurement data via a cable as described above and/or wirelessly by monitoring audio and/or video output by the monitored media presentation device. Audience measurement data captured by the base meter may include tuning information, signatures, codes (e.g., embedded into or otherwise broadcast with broadcast media), and/or a number of and/or identification of corresponding household members exposed to the media output by the media presentation device (e.g., the television).
Data collected by the PM and/or the base meter may be stored in a memory and transmitted via one or more networks, such as the Internet, to a data store managed by a market research entity such as The Nielsen Company (US), LLC. Typically, such data is aggregated with data collected from a large number of PMs and/or base meters monitoring a large number of panelist households. Such collected and/or aggregated data may be further processed to determine statistics associated with household behavior in one or more geographic regions of interest. Household behavior statistics may include, but are not limited to, a number of minutes a household media device was tuned to a particular station (tuning minutes), a number of minutes a household media device was used (e.g., viewed) by a uniquely identified household panelist member (viewing minutes) and/or one or more visitors, demographics of an audience (which may be statistically projected based on the panelist data) and instances when the media device is on or off. While examples described herein employ the term “minutes,” such as “tuning minutes,” “exposure minutes,” etc., any other time measurement of interest may be employed without limitation.
To ensure audience measurement systems are properly installed in panelist households, field service personnel have traditionally visited each panelist household, assessed the household media components, physically installed (e.g., connected) the PM and/or base meter to monitor a media presentation device(s) of the household (e.g., a television), and trained the household members how to interact with the PM so that accurate audience information is captured. In the event one or more aspects of the PM and/or base meter installation are inadvertently disrupted (e.g., an audio cable connection from the media device to the base meter is disconnected), then subsequent field service personnel visit(s) may be necessary. In an effort to allow collected household data to be used in a reliable manner (e.g., a manner conforming to accepted statistical sample sizes), a relatively large number of PMs and/or base meters are needed. Each such PM and/or base meter involves one or more installation efforts and installation costs. As such, efforts to increase statistical validity (e.g., by increasing panel size and/or diversity) for a population of interest result in a corresponding increase in money spent to implement panelist households with PMs and/or base meters.
In an effort to increase a sample size of household behavior data and/or reduce a cost associated with configuring panelist households with PMs and/or base meters, example methods, apparatus, systems and/or articles of manufacture disclosed herein employ a media meter (MM) to collect household panelist behavior data. Example MMs disclosed herein are distinguished from traditional PMs and/or base meters that include a physical input to be selected by a panelist household member actively consuming the media. In examples disclosed herein, the MM captures audio with or without a physical connection to the media device. In some examples, the MM without the physical connection to the media device includes one or more microphones to capture ambient audio in a room shared by the media device. In some such examples, the MM captures codes embedded by one or more entities (e.g., final distributor audio codes (FDAC)), and does not include one or more inputs that are to be selected by one or more household panelists to identify which panelist is currently viewing the media device. Rather than collecting audience composition data directly from panelists, example methods, apparatus, systems and/or articles of manufacture disclosed herein impute which household members are viewers of media programming in households with the MM. In other words, examples disclosed herein facilitate a manner of determining which panelist household members are viewing media in a manner that avoids the expense of additional PM device installation in panelist households.
Turning to
Example households that include a PM (i.e., the learning households 104) collect panelist audience data. As used herein, “PM panelist audience data,” “learning minutes” or “PM panelists” includes both (a) media identification data (e.g., code(s) embedded in or otherwise transmitted with media, signatures, channel tuning data, etc.) and (b) person information identifying the corresponding household member(s) and/or visitor(s) that are currently watching/viewing/listening to and/or otherwise accessing the identified media. On the other hand, MM households 106 include only a MM to collect media data. As used herein, “media data,” “MM household minutes” and/or “media identifier information” are used interchangeably and refer to information associated with media identification (e.g., codes, signatures, etc.), but does not include person information identifying which household member(s) and/or visitors are currently watching/viewing/listening to and/or otherwise accessing the identified media. However, both the example learning households 104 and the example MM households 106 include panelists, which are demographically identified members of their respective households. As described above, at least one distinguishing factor between PM panelists and MM panelists is that the former also includes information that identifies which particular household member is responsible for consuming media.
Although examples disclosed herein refer to code readers and collecting codes, techniques disclosed herein could also be applied to systems that collect signatures and/or channel tuning data to identify media. Audio watermarking is a technique used to identify media such as television broadcasts, radio broadcasts, advertisements (television and/or radio), downloaded media, streaming media, prepackaged media, etc. Existing audio watermarking techniques identify media by embedding one or more audio codes (e.g., one or more watermarks), such as media identifying information and/or an identifier that may be mapped to media identifying information, into an audio and/or video component. In some examples, the audio or video component is selected to have a signal characteristic sufficient to hide the watermark. As used herein, the terms “code” or “watermark” are used interchangeably and are defined to mean any identification information (e.g., an identifier) that may be transmitted with, inserted in, or embedded in the audio or video of media (e.g., a program or advertisement) for the purpose of identifying the media or for another purpose such as tuning (e.g., a packet identifying header). As used herein “media” refers to audio and/or visual (still or moving) content and/or advertisements. To identify watermarked media, the watermark(s) are extracted and used to access a table of reference watermarks that are mapped to media identifying information.
Unlike media monitoring techniques based on codes and/or watermarks included with and/or embedded in the monitored media, fingerprint or signature-based media monitoring techniques generally use one or more inherent characteristics of the monitored media during a monitoring time interval to generate a substantially unique proxy for the media. Such a proxy is referred to as a signature or fingerprint, and can take any form (e.g., a series of digital values, a waveform, etc.) representative of any aspect(s) of the media signal(s) (e.g., the audio and/or video signals forming the media presentation being monitored). A good signature is one that is repeatable when processing the same media presentation, but that is unique relative to other (e.g., different) presentations of other (e.g., different) media. Accordingly, the term “fingerprint” and “signature” are used interchangeably herein and are defined herein to mean a proxy for identifying media that is generated from one or more inherent characteristics of the media.
Signature-based media monitoring generally involves determining (e.g., generating and/or collecting) signature(s) representative of a media signal (e.g., an audio signal and/or a video signal) output by a monitored media device and comparing the monitored signature(s) to one or more references signatures corresponding to known (e.g., reference) media sources. Various comparison criteria, such as a cross-correlation value, a Hamming distance, etc., can be evaluated to determine whether a monitored signature matches a particular reference signature. When a match between the monitored signature and one of the reference signatures is found, the monitored media can be identified as corresponding to the particular reference media represented by the reference signature that with matched the monitored signature. Because attributes, such as an identifier of the media, a presentation time, a broadcast channel, etc., are collected for the reference signature, these attributes may then be associated with the monitored media whose monitored signature matched the reference signature. Example systems for identifying media based on codes and/or signatures are long known and were first disclosed in Thomas, U.S. Pat. No. 5,481,294, which is hereby incorporated by reference in its entirety.
In still other examples, techniques disclosed herein could also be applied to systems that collect and/or otherwise acquire online data. Online data may include, but is not limited to online tags having a string of letters and/or numbers that are associated with media content so that the media content can be identified. In some examples, the tag includes attribute data and/or identifying information that has been extracted from the media content. Example tag(s) can be associated with media content prior to distribution (e.g., before Internet media content is streamed to presentation locations (e.g., households)). For example, the tag(s) may be associated with the media content in a webpage distributing the media content, inserted in metadata of the media content (e.g., in a file containing the media content or a file associated with the file containing the media content), inserted in metadata of a stream, etc. The example tag(s) can later be extracted at presentation location(s) and analyzed to identify the media content and increment records for exposure to the media content.
In operation, the example viewer assignment engine 110 identifies corresponding household members within the example MM households 106 that are most likely viewers of media via three phases. In a first phase, the example classification engine 200 classifies data from the example learning households 104 and the example MM households 106 into model dimensions. In a second phase, the example probability engine 220 identifies viewing probabilities for the example learning households 104 with the aid of IDP dimensions. In a third phase, the example MLV engine 240 uses those viewing probabilities to identify which example MM households 106 best match with corresponding example learning households 104, and imputes the viewing behaviors of the matched example learning household(s) 104 to the corresponding members of the example MM household(s) 106.
In the example first phase, the example learning household interface 202 acquires panelist (e.g., PM panelists) exposure minutes associated with learning households 104 within a geography of interest (e.g., a designated market area (DMA)), such as the example region of interest 108 of
As used herein, “exposure minutes” (also known as “viewing minutes”) refer to media data captured by a meter (e.g., a People Meter, a base meter with panelist input identification capabilities, etc.) within learning households 104, in which the identified media is uniquely associated with a particular panelist member of the household (e.g., via a People Meter button press). As used herein, “tuning minutes” distinguishes from exposure minutes and/or viewing minutes in that the former refers to media data captured by a meter within MM households 106, in which the identified media is not associated with a particular household member. The example MM interface 204 acquires panelist tuning minutes associated with MM households 106 within the geography of interest.
When collecting behavior data from households, different degrees of accuracy result based on the age of the collected data. On a relative scale, when dealing with, for example, television exposure, an exposure index may be computed. The example exposure index provides an indication of how well PM data imputes exposure minutes, and may be calculated in a manner consistent with Equation (1).
In the illustrated example of Equation (1), the exposure index is calculated as the ratio of the number of imputed PM exposure minutes (e.g., “viewing minutes”) and the number of actual PM exposure minutes. While the example described above refers to minutes obtained from learning households 104, similar expectations of accuracy occur with data (minutes) obtained from MM households 106.
The example exposure index of Equation (1) may be calculated on a manual, automatic, periodic, aperiodic and/or scheduled basis to empirically validate the success and/or accuracy of viewing behavior imputation efforts disclosed herein. Index values closer to one (1) are indicative of a greater degree of accuracy when compared to index values that deviate from one (1). Depending on the type of category associated with the collected exposure minutes, corresponding exposure index values may be affected to a greater or lesser degree based on the age of the collected data.
As described above, collected data that is more recent exhibits an accuracy that is better than an accuracy that can be achieved with relatively older collected data. Nonetheless, some data that is relatively older will still be useful, but such older data is weighted less than data that is more recent to reflect its lower accuracy. The example weighting engine 206 applies a temporal weight, and applies corresponding weight values by a number of days since the date of collection. Relatively greater weight values are applied to data that is relatively more recently collected. In some examples, weight values applied to collected tuning minutes and collected exposure minutes are based on a proportion of a timestamp associated therewith. For instance, a proportionally lower weight may be applied to a portion of collected minutes (e.g., tuning minutes, exposure minutes) when an associated timestamp is relatively older than a more recently collection portion of minutes.
In the illustrated example of
Categories (sometimes referred to herein as “dimensions”) within the example learning households 104 and the example MM households 106 may be different. A market researcher may have a particular dimension combination of interest when attempting to determine which household members of an example MM household 106 were actually consuming media (e.g., a household having males, age 35-54, etc.). When attempting to match one or more MM households 106 with one or more learning households 104, examples disclosed herein identify candidate households that have an appropriate (similar) match of dimensions. Sets of dimensions are categorized by the example cell generator 208, in which different sets represent requirements for particular ones of the learning households 104 and particular ones of the MM households 106, as described in further detail below.
Generally speaking, a number of households in a research geography of interest matching a single one of the dimensions of interest may be relatively high. However, as additional dimensional requirements are added for the study, the number of qualifying households having an inclusive match for all such dimensions decreases. In some circumstances, the number of matching households in a donor pool after performing a logical “AND” of all dimensions of interest eventually results in that donor pool having a population lower than a threshold value, which may not exhibit statistical confidence when applying probability techniques to determine which household members are actually viewing within the MM homes. In the event a particular cell does not contain enough households to satisfy the dimension requirements of the Stage 1 cell 506, a Stage 2 cell 508 is considered, which includes a relatively lower number of required dimensions to intersect. Additionally, the example dimension table 500 includes a Stage 3 cell 510 in the event a particular cell does not include the complete number of dimensional requirements of the Stage 2 cell 508. While the illustrated example of
As described above, dimensions within a cell reflect a logical “AND” condition of representation (e.g., they are intersecting dimensions). However, examples disclosed herein also consider dimensions independently in an effort to reduce imputation errors, reduce data fluctuations and improve data stability. Independent distribution probability (IDP) dimensions are associated with each example stage. Generally speaking, IDP dimensions enable an improvement on the statistical reliability when imputing potential viewing (tuning) in the MM households as actual viewing (exposure). The example IDP dimensions improve data granularity and predictive confidence of the imputation, and allows other dimensions deemed relevant to an analyst to be considered that might not otherwise be permitted (e.g., due to sample size restrictions). In some examples, one or more IDP dimensions are empirically determined to be valuable to different demographic characteristics of the household under consideration for imputation. In the illustrated example of
While the illustrated example of
For a market study of interest, the market researcher may identify a target set of dimensions of interest with which to determine viewing behavior in MM households 106. For example, the market researcher may seek to learn about households in a Pacific territory with a membership size of three having (a) one male age 35-54, (b) one female age 35-54 and (c) one child age 2-11. In view of these desired dimensions of interest, examples disclosed herein identify matches of learning households 104 and MM households 106 (and their corresponding behavior data). As described above, the first phase classifies household data into model dimensions. While examples below refer to classifying learning households 104, such examples may also consider classification from the example MM households 106.
The example cell generator 208 retrieves the target set of dimensions of interest for the study, and the example stage selector 210 selects an initial candidate stage of intersecting dimensions, such as the example Stage 1 cell dimensions 506. The example stage selector 210 determines a number of households within the geography of interest that meet the dimensional requirements of the Stage 1 cell dimensions 506. For the sake of example, assume that sixty (60) households have at least three (3) household members, two (2) adults, one (1) child, are watching a news genre, a set in the living room, and during a daypart of Monday through Sunday between 7:00 to 11:00 PM. In view of each of the persons of interest (e.g., demographic dimensions of interest for the study), such as (a) the example male age 35-54, (b) the example female age 35-54, and (c) the example child age 2-11, the example stage selector 210 identifies, out of the total number of sixty (60) households, how many households containing each person are included. The example stage selector 210 compares the number of households with each person of interest to a threshold value to determine whether Stage 1 is appropriate. If so, then the person of interest is designated as associated with Stage 1 dimensions for the remainder of the market study, in which only data from Stage 1 qualifying households will be used for probability calculations.
However, in the event one or more households do not satisfy the threshold, then the example stage selector 210 evaluates a subsequent stage (e.g., Stage 2 (508)) to determine whether a threshold number of qualifying households is available. As described above, subsequent cell stages include a relatively lower number of intersecting dimensions, thereby increasing the possibility that a greater number of available households will qualify (e.g., contain all of the dimensions).
While the above examples classify in view of the cell dimensions, which require a logical “AND” condition to qualify, examples disclosed herein also classify IDP dimensions, which are evaluated independently within each cell.
In the illustrated example of
Now that potential viewers are categorized into respective cell dimensions (intersecting dimensions) and IDP dimensions based on sample size thresholds of qualifying households (both learning households 104 and MM households 106), the example first phase of classifying households is complete. As used herein the term potential viewing refers to household tuning behaviors that have not been confirmed to be associated with a specific household member. For instance, a MM household may log and/or otherwise collect tuning behavior for a particular quarter hour (QH), in which any one of the household members therein could potentially be responsible for consuming and/or otherwise viewing the media during that particular QH. In some examples, the MM households are referred to herein as “tuning households” to reflect that the data collected therein includes, for example, an amount of time (e.g., minutes) of media detected in the household, but without a corresponding uniquely identified member within that household. In such circumstances, panelist members within the tuning household(s) may be referred to as “tuning panelists.” Unless and until actual tuning behavior can be confirmed and/or otherwise attributed to a specific person or persons within the home, the household members during that particular QH are deemed potential viewers as distinguished from actual viewers.
Next, and as described above, the example probability engine 220 identifies viewing probabilities for the example learning households 104 with the aid of respective IDP dimensions associated with the qualification criteria. In some examples, the learning households are referred to herein as “viewing households” to reflect that the data collected therein includes, for example, an amount of time (e.g., minutes) of media detected in that household, which includes unique identification of which household member is exposed to and/or otherwise consuming that media. In such circumstances, panelist members within the viewing households may be referred to as “viewing panelists.” In operation, the example classification engine 200 selects a demographic of interest (person of interest) associated with one of the previously classified stages (e.g., Stage 1, Stage 2, etc.). For example, in the event males age 35-54 is selected as the demographic of interest, then the example learning household interface 202 retrieves and/or otherwise receives corresponding exposure minutes (viewing minutes) from all households that match the classified cell dimensions (e.g., within Stage 1 dimensions). Additionally, the example learning household interface 202 retrieves and/or otherwise receives corresponding exposure minutes from those households that are associated with all other demographic members within those households, such as an associated female age 35-54 and/or child age 2-11. Again, the exposure minutes retrieved are associated with only those households that were previously identified to satisfy a threshold representative number of households matching the same stage cell dimensions (e.g., the cell dimensions of Stage 1, the cell dimensions of Stage 2, etc.).
The example total probability calculator 222 calculates a total probability in a manner consistent with example Equation (2)
In the illustrated example of Equation (2), j reflects one of the dimensions of interest under study, such as, in this example, a male age 35-54. That particular male came from a household that satisfied the threshold number of households that also contain Stage 1 cell dimensions of three (3) household members, two (2) adults, one (1) child, viewing a news genre, a set in a living room, and viewing within the daypart of Monday through Sunday between the hours of 7:00 PM through 11:00 PM. In this example, assume that the males age 35-54 are associated with 1850 exposure minutes, in which that value is the sum for all households satisfying the Stage 1 cell dimensions. Also in this example, assume that other household member persons of interest under analysis (e.g., females age 35-54 and children age 2-11) account for 2250 exposure minutes within those respective households. Stated differently, minutes associated with other household minutes are deemed “potential exposure minutes” because of the possibility that they could have also been viewing at the same time as the male age 35-54.
Applying the example scenario above to example Equation (2) yields a total probability for the male age 35-54 as 0.74. A total odds value may be calculated in a manner consistent with example Equation (3).
In the event probability values and total odds values are to be determined for one or more additional persons of interest within a marketing study, such as the example female age 35-54 and/or the example child age 2-11, then a similar approach is repeated using example Equations (2) and (3) with respective exposure minutes for those persons of interest.
As described above, in an effort to reduce imputation errors, examples disclosed herein also incorporate IDP dimensions associated with each stage. In some examples, the IDP dimensions may reduce/resolve data fluctuations and/or improve data stability, thereby improving computation efficiency by lowering one or more evaluation iterations. For each person of interest, a corresponding one or more IDP dimension marginal probabilities is calculated. Also as described above, some persons of interest may have relatively greater or fewer IDP dimensions to be calculated depending on whether that person of interest is also associated with a threshold number of households that qualify. Continuing with the example person of interest male age 35-54, it was previously determined that IDP dimensions of (a) Monday through Friday 7:00 PM to 8:00 PM daypart, (b) tuned to station WAAA and (c) Non-Hispanic each included at least thirty (30) qualifying households within Stage 1. As such, the example marginal probabilities for each of these persons of interest is calculated based on exposure minutes from those households in which the cell dimensions were previously identified. However, rather than require that each of the IDP dimensions all simultaneously be present within those households, each one of the IDP dimensions is evaluated in an independent manner so that there is one IDP marginal probability calculated for each IDP dimension in a manner consistent with example Equation (4).
In the illustrated example of Equation (4), j reflects one of the dimensions of interest under study, such as, in this example, a male age 35-54. Additionally, di reflects an IDP dimension, such as (a) Monday through Friday 7:00 PM to 8:00 PM daypart, (b) tuned to station WAAA or (c) Non-Hispanic. In this example, assume that for the person of interest males age 35-54, in which a total probability (and corresponding total odds) was previously calculated, account for 600 exposure minutes, and that the other household member persons of interest account for 850 exposure minutes. When applying example Equation (4), a marginal probability for males age 35-54 in connection with the IDP dimension Monday through Friday 7:00 PM to 8:00 PM daypart results in a marginal probability of 0.71. Example Equation (4) may then be reapplied in view of one or more additional available IDP dimensions to calculate additional marginal probability value(s).
Marginal odds associated with each marginal probability calculation may be determined in a manner consistent with example Equation (5).
Additionally, for each IDP dimension, a corresponding odds ratio is calculated in a manner consistent with example Equation (6).
When all persons of interest have been considered to calculate respective (a) total probabilities (and associated total odds), (b) marginal probabilities (and associated marginal odds) and (c) odds ratios, examples disclosed herein apply and/or otherwise impute those calculated probabilities to households associated with the MM panelists (MM households 106). In particular, the example classification engine 200 identifies MM households 106 that have dimensions that match the example learning households 104. As described above, the example learning households 104 now have corresponding total probability values (associated with cell dimensions), total odds values (associated with cell dimensions), marginal probability values (associated with IDP dimensions) and marginal odds values (associated with cell and IDP dimensions). The aforementioned total probability values, total odds values, marginal probability values and marginal odds values from the example learning households 104 are imputed by the example classification engine 200 to corresponding MM households 106 having the same matching dimensions. For each demographic of interest, the example odds appending engine 228 calculates an adjusted odds value in a manner consistent with example Equation (7).
Adjusted Odds(j, d)=Total Odds(j)×Odds Ratio (j, d1)×Odds Ratio (j, d2)× . . . Odds Ratio (j, dn) Equation(7).
In the illustrated example of Equation (7), j reflects a dimension of interest under analysis, such as a male age 35-54, and dn reflects an IDP dimension of interest under analysis. Additionally, the example appending engine 228 calculates a final probability in a manner consistent with example Equation (8).
After the application of example Equations 2-8, final probability values are available for all observations in both the example learning households 104 and the example MM households 106, which ends the second phase. However, probability calculations may be repeated in some examples, such as when a station or station genre changes, when tuning continues to another daypart, cell classification changes, etc.
As described above, the example third phase uses the final probability values to identify best matches of each TV set within the MM households 106 and learning households 104 so that the viewing behaviors on each TV set from the members of the learning households may be imputed to the corresponding members of the matching MM households 106. In operation, the example MM interface 204 selects one of the MM households 106 and the example classification engine 200 identifies a corresponding classification that was previously associated with that selected MM household. As described above, each person was classified as qualifying for a particular cell and stage, in which each stage includes a particular combination of model dimensions. This phase of the example methodology utilizes a subset of these dimensions as must-match criteria between each MM household/TV set and learning household/TV set to ensure characteristic and behavioral similarity between the matched TV sets within the homes. Additionally, for each TV set within each MM household, this phase of the example methodology finds the best matching learning household/TV set to impute viewers. Further, this phase of the example methodology is carried out by cell such that a best matching learning household/TV set is determined multiple times for any given day. That is, if, for example, a station or station genre changes, or the tuning continues to another daypart, or any other aspect of the data changes such that it is classified into a different cell, then the matching process is carried out again. Therefore, each MM household/TV set can be matched with different learning households/TV sets throughout the day; the best matching, most similar is always selected. Additionally, and as described in further detail below, preferences may be identified for homes within a particular DMA.
For each TV set, example cell, and person ID, the example average probability calculator 246 calculates an average probability value, as shown in
The example MLV engine 240 next matches the ranked MM households to corresponding learning households. In operation, the example MM interface 204 selects one of the MM households 106 and the example learning household interface 202 selects one or more candidate learning households 104 for comparison purposes, as shown in
The example MLV engine 240 calculates an absolute difference between the average probability values for each household person, which is shown in the example absolute difference column 1216. Additionally, for each compared MM household and learning household, the example MLV engine 240 calculates an MLV score based on the sum of the absolute difference values, which is shown in the example MLV score column 1218. Generally speaking, an MLV score value that is relatively lower compared to other MLV score values indicates a greater degree of similarity between the compared persons of MM household and learning household. As such, in the illustrated example of
In some examples, when making a comparison between persons of the MM households and persons of the one or more learning households to identify a closest match based on the MLV score, a greater priority may be assigned to whether such matching learning household(s) are also within the same designated market area (DMA) as the MM household. The example rank engine 248 may identify, for each comparison between a candidate MM household of interest and one or more learning household(s), whether a corresponding learning household is also within the same DMA as the MM household, which is shown in the example DMA column 1220. In the event a matching DMA status is to receive a greater priority than the MLV score, then the example MLV engine 240 will identify a closest match between the Smith household and the Jones household, despite the fact that the MLV score therebetween is 0.13, which is relatively greater than the MLV score between the Smith household and the Lee household (i.e., an MLV score of 0.11). In some examples, if a matching learning household is within a same DMA, but the corresponding MLV score is not a lowest relative value, then the in-DMA household is used only if it is within a threshold value of the overall lowest MLV score. In still other examples, if none of the households is within the DMA of interest (and within a threshold of the overall lowest MLV score), then the home with the lowest MLV score is used. While the illustrated example of
However, because viewing amounts between matched MM households and learning households may differ, the example quarter hours therebetween are misaligned. For example, while a similarity match was identified between a candidate MM household and a candidate learning household, a number of quarter hour data points collected in the example MM household may differ from the number of quarter hour data points collected in the corresponding matching learning household. For instance, between a daypart of 7:00-11:00 PM the example MM households may have collected seven (7) quarter hours of tuning data, while a corresponding learning households may have only collected four (4) quarter hours of viewing data, thereby creating a discrepancy that has traditionally resulted in erroneous imputation predictions and wasteful discarding of non-overlapping data points. Examples disclosed herein reduce an imputation error and preserve data points during one or more imputation efforts between MM households and learning households.
In the illustrated example of
Continuing with the example above, an adjusted QH value of 0.571 results when the learning household includes four (4) available quarter hour data points and the MM households include seven (7) available quarter hour data points. The example minutes aggregator 244 multiplies the adjusted QH ratio by the initial QH order (column 1410) to derive an adjusted QH order (column 1412), which is rounded to result in a final QH order (column 1414). As such, respective ones of the relatively fewer number of learning household data points are expanded to overlap with the relatively greater number of MM household data points. In the event that the matched person from the learning household was viewing during a particular quarter hour, the example MLV engine 240 designates the potential viewing minutes from the MM household as actual viewing minutes, as shown in column 1418. In other words, potential viewing minutes (tuning minutes) associated with the tuning household are imputed and/or otherwise deemed to be viewing minutes when a matching quarter hour in the viewing household exhibits viewing behavior at the same time. While examples above refer to data points associated with a quarter hour time period resolution, such examples are disclosed for illustration and not limitation. While examples disclosed above consider viewing and tuning behaviors from members of respective households, in some examples, short-term visitor viewing is collected from the learning household. As such, examples disclosed above also apply to such visitor viewing, which is carried over to MM households for a similar analysis.
To illustrate,
While an example manner of implementing the viewer assignment engine 110 of
Flowcharts representative of example machine readable instructions for implementing the viewer assignment engine 110 of
As mentioned above, the example processes of
The program 1600 of
As described above, because collected data that is more recent exhibits an accuracy that is better than that of relatively older data, the example weighting engine 206 applies importance weighting values to the data collected from the example learning households 104 and the example MM households 106 (block 1610). In view of the example three phases of
In the illustrated example of
In the illustrated example of
Returning to the example first phase 1602 of
The example cell generator 208 determines whether one or more additional demographic dimensions of interest are to be evaluated (block 1714). For instance, in the illustrated example of
As described above, a household and/or members therein can only be associated with a particular stage of cell dimensions when such dimensions intersect (e.g., each dimension is true as a logical “AND” condition). However, examples disclosed herein also evaluate households and members therein in view of IDP dimensions in a manner that is independent of one or more other IDP dimensions. In the illustrated example of
The example classification engine 200 determines whether the selected stage includes one or more additional IDP dimensions (block 1812) and, if so, control returns to block 1804. If not, the example classification engine 200 determines whether one or more additional previously classified demographic dimensions of interest are to be evaluated (block 1814) and, if so, control returns to block 1802.
Returning to the example second phase 1604 of
In the event one or more additional demographics of interest is to be considered (block 1912), then control returns to block 1902. Otherwise, the example learning household interface 202 retrieves exposure minutes of the demographic of interest from households that match the previously determined classified stage of IDP dimensions (block 1914), as well as retrieving exposure minutes from all other household members as potential viewing minutes (block 1916). The example marginal probability calculator 224 calculates a marginal probability as a ratio of the sum of exposure minutes for the demographic of interest and the sum of potential exposure minutes for all other household members (block 1918), as shown above in Equation (4). Additionally, the example marginal probability calculator 224 calculates a marginal odds value in a manner consistent with Equation (5) (block 1920).
In the event the example classification engine 200 identifies one or more additional IDP dimensions of interest are associated with the demographic of interest (block 1922), then control returns to block 1914. If not, then the example classification engine 200 determines whether another demographic of interest is to be evaluated with the IDP dimensions (block 1924). If so, then another demographic of interest is selected (block 1926) and control returns to block 1914. Now that (a) all marginal odds values for each demographic of interest and corresponding IDP dimension are calculated and (b) all total odds values for each demographic of interest are calculated, the example odds ratio calculator 226 calculates an odds ratio in a manner consistent with example Equation (6) (block 1928).
Returning to the example second phase 1604 of
Returning to the example third phase 1606 of
The example average probability calculator 246 calculates an average probability value for each cell combination and corresponding person (household member) (block 2116), averaging the probabilities across each person's potential viewing (MM data) or viewing (learning data) in within the given cell, described above in connection with
The example rank engine 248 calculates MLV scores for each paired MM household and learning household based on the sum of the individuals' absolute difference values therebetween (block 2212). The example rank engine 248 selects a final match of the MM household and best candidate learning household based on the lowest relative MLV score (block 2216). If the best candidate learning household is in the same DMA, or there is an in-DMA learning household with an MLV score within a particular range of the lowest MLV score, then priority is given to the in-DMA home and it is used as the best match. On the other hand, in the event a learning home is in the same DMA as the MM household within the lowest MLV score or a threshold range (e.g., a range deemed acceptable) of the lowest MLV score is not available, then the household with the lowest MLV score is simply used even if it is not in the same DMA as the MM home (block 2218). In either case, the closest households are now matched, and the persons therebetween are also matched based on similar MLV rank values (see columns 1204 and 1212 of
Now that the best match between MM households and corresponding learning households has been determined, and members within those households have been matched, additional detail related to imputing viewing behavior within those matched households is described in further detail in
The example minutes aggregator 244 multiplies the QH ratio by each ordered quarter hour data point value to derive an adjusted QH order (block 2308), and rounds the result to derive a final QH order value (block 2310). To reduce imputation errors that may typically occur when merely discarding data points that do not have exact parity, during a similar quarter hour of interest the example MLV engine 240 determines whether a particular household member within the learning home exhibits viewing behavior and, if so, potential viewing minutes from the corresponding MM household are imputed as actual viewing (block 2312). Further, any short-term visitor viewing from the learning household/TV set is carried over to the MM household/TV set (note that long-term visitors are considered the same way as regular household members).
The processor platform 2400 of the illustrated example includes a processor 2412. The processor 2412 of the illustrated example is hardware. For example, the processor 2412 can be implemented by one or more integrated circuits, logic circuits, microprocessors or controllers from any desired family or manufacturer.
The processor 2412 of the illustrated example includes a local memory 2413 (e.g., a cache) and the viewer assignment engine 110. The processor 2412 of the illustrated example is in communication with a main memory including a volatile memory 2414 and a non-volatile memory 2416 via a bus 2418. The volatile memory 2414 may be implemented by Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device. The non-volatile memory 2416 may be implemented by flash memory and/or any other desired type of memory device. Access to the main memory 2414, 2416 is controlled by a memory controller.
The processor platform 2400 of the illustrated example also includes an interface circuit 2420. The interface circuit 2420 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a PCI express interface.
In the illustrated example, one or more input devices 2422 are connected to the interface circuit 2420. The input device(s) 2422 permit(s) a user to enter data and commands into the processor 1012. The input device(s) can be implemented by, for example, an audio sensor, a microphone, a keyboard, a button, a mouse, a touchscreen, a track-pad, a trackball, isopoint and/or a voice recognition system.
One or more output devices 2424 are also connected to the interface circuit 2420 of the illustrated example. The output devices 2424 can be implemented, for example, by display devices (e.g., a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal display, a cathode ray tube display (CRT), a touchscreen and/or speakers). The interface circuit 2420 of the illustrated example, thus, typically includes a graphics driver card, a graphics driver chip or a graphics driver processor.
The interface circuit 2420 of the illustrated example also includes a communication device such as a transmitter, a receiver, a transceiver, a modem and/or network interface card to facilitate exchange of data with external machines (e.g., computing devices of any kind) via a network 2426 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.).
The processor platform 2400 of the illustrated example also includes one or more mass storage devices 2428 for storing software and/or data. Examples of such mass storage devices 2428 include floppy disk drives, hard drive disks, compact disk drives, Blu-ray disk drives, RAID systems, and digital versatile disk (DVD) drives.
The coded instructions 2432 of
From the foregoing, it will be appreciated that the above disclosed methods, apparatus and articles of manufacture permit the identification of unique panelist member media viewing behavior in households that do not include a People Meter. Additionally, examples disclosed herein reduce costs related to personnel and equipment by facilitating a manner of viewing behavior identification with lower cost media metering devices that reduce and/or eliminate a need for professional and/or on-site personnel installation and/or maintenance. Further, examples disclosed herein improve a statistical reliability of imputation via the application of independent distribution probability dimensions, which improve data granularity and predictive confidence. Additional examples disclosed herein reduce waste of and/or otherwise discarding data points between compared households by aligning dissimilar temporal data points when such households do not exhibit time period parity of such data points.
Although certain example methods, apparatus and articles of manufacture have been disclosed herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the claims of this patent.
This patent arises from a continuation of U.S. patent application Ser. No. 14/866,158 (now U.S. Patent No. 10,219,039), entitled “Methods and Apparatus to Assign Viewers to Media Meter Data” and filed on Sep. 25, 2015, which claims the benefit of U.S. Patent Application Ser. No. 62/130,286, entitled “Viewer Assignment of Household Viewers Without a People Meter” and filed on Mar. 9, 2015. Priority to U.S. patent application Ser. No. 14/866,158 and U.S. Patent Application Ser. No. 62/130,286 is claimed. U.S. patent application Ser. No. 14/866,158 and U.S. Patent Application Ser. No. 62/130,286 are hereby incorporated herein by reference in their respective entireties.
Number | Name | Date | Kind |
---|---|---|---|
3540003 | Murphy | Nov 1970 | A |
3696297 | Otero | Oct 1972 | A |
3818458 | Deese | Jun 1974 | A |
3906454 | Martin | Sep 1975 | A |
4058829 | Thompson | Nov 1977 | A |
4125892 | Fukuda et al. | Nov 1978 | A |
4166290 | Furtman et al. | Aug 1979 | A |
4236209 | Lombardo, Jr. et al. | Nov 1980 | A |
4258386 | Cheung | Mar 1981 | A |
4283709 | Lucero et al. | Aug 1981 | A |
4355372 | Johnson et al. | Oct 1982 | A |
4356545 | West | Oct 1982 | A |
4473824 | Claytor | Sep 1984 | A |
4516216 | Armstrong | May 1985 | A |
4546382 | McKenna et al. | Oct 1985 | A |
4566030 | Nickerson et al. | Jan 1986 | A |
4602279 | Freeman | Jul 1986 | A |
4603232 | Kurland et al. | Jul 1986 | A |
4658290 | McKenna et al. | Apr 1987 | A |
4677552 | Sibley, Jr. | Jun 1987 | A |
4695880 | Johnson et al. | Sep 1987 | A |
4700378 | Brown | Oct 1987 | A |
4706121 | Young | Nov 1987 | A |
4713791 | Saluski | Dec 1987 | A |
4718025 | Minor et al. | Jan 1988 | A |
4725886 | Galumbeck et al. | Feb 1988 | A |
4740912 | Whitaker | Apr 1988 | A |
4745549 | Hashimoto | May 1988 | A |
4745559 | Willis et al. | May 1988 | A |
4751578 | Reiter et al. | Jun 1988 | A |
4757456 | Benghiat | Jul 1988 | A |
4774658 | Lewin | Sep 1988 | A |
4783648 | Homma et al. | Nov 1988 | A |
4792921 | Corwin | Dec 1988 | A |
4817080 | Soha | Mar 1989 | A |
4823290 | Fasack et al. | Apr 1989 | A |
4831582 | Miller et al. | May 1989 | A |
4845658 | Gifford | Jul 1989 | A |
4849879 | Chinnaswamy et al. | Jul 1989 | A |
4868866 | Williams, Jr. | Sep 1989 | A |
4887308 | Dutton | Dec 1989 | A |
4907188 | Suzuki et al. | Mar 1990 | A |
4912466 | Call | Mar 1990 | A |
4912522 | Oates et al. | Mar 1990 | A |
4924488 | Kosich | May 1990 | A |
4930011 | Kiewit | May 1990 | A |
4935870 | Burk, Jr. et al. | Jun 1990 | A |
4954699 | Coffey et al. | Sep 1990 | A |
4958284 | Bishop et al. | Sep 1990 | A |
4961132 | Uehara | Oct 1990 | A |
4972367 | Burke | Nov 1990 | A |
4972504 | Daniel, Jr. et al. | Nov 1990 | A |
4977455 | Young | Dec 1990 | A |
4977594 | Shear | Dec 1990 | A |
4989230 | Gillig et al. | Jan 1991 | A |
5006978 | Neches | Apr 1991 | A |
5007017 | Kobayashi | Apr 1991 | A |
5008929 | Olsen et al. | Apr 1991 | A |
5019963 | Alderson et al. | May 1991 | A |
5023907 | Johnson et al. | Jun 1991 | A |
5023929 | Call | Jun 1991 | A |
5038211 | Hallenbeck | Aug 1991 | A |
5038374 | Kaufman et al. | Aug 1991 | A |
5042027 | Takase et al. | Aug 1991 | A |
5047867 | Strubbe et al. | Sep 1991 | A |
5049873 | Robins et al. | Sep 1991 | A |
5062147 | Pickett et al. | Oct 1991 | A |
5063610 | Alwadish | Nov 1991 | A |
5088108 | Uddenfeldt et al. | Feb 1992 | A |
5101402 | Chiu et al. | Mar 1992 | A |
5109350 | Henwood et al. | Apr 1992 | A |
5140419 | Galumbeck et al. | Aug 1992 | A |
5148365 | Dembo | Sep 1992 | A |
5150116 | West | Sep 1992 | A |
5150414 | Ng | Sep 1992 | A |
5155591 | Wachob | Oct 1992 | A |
5159685 | Kung | Oct 1992 | A |
5161109 | Keating et al. | Nov 1992 | A |
5166866 | Kim et al. | Nov 1992 | A |
5181113 | Chang | Jan 1993 | A |
5204947 | Bernstein et al. | Apr 1993 | A |
5208588 | Nishiyama | May 1993 | A |
5210530 | Kammerer et al. | May 1993 | A |
5212684 | MacNamee et al. | May 1993 | A |
5214792 | Alwadish | May 1993 | A |
5220522 | Wilson et al. | Jun 1993 | A |
5220655 | Tsutsui | Jun 1993 | A |
5223827 | Bell et al. | Jun 1993 | A |
5223924 | Strubbe | Jun 1993 | A |
5226120 | Brown et al. | Jul 1993 | A |
5231593 | Notess | Jul 1993 | A |
5235680 | Bijnagte | Aug 1993 | A |
5237677 | Hirosawa et al. | Aug 1993 | A |
5237681 | Kagan et al. | Aug 1993 | A |
5237684 | Record et al. | Aug 1993 | A |
5239540 | Rovira et al. | Aug 1993 | A |
5241625 | Epard et al. | Aug 1993 | A |
5241671 | Reed et al. | Aug 1993 | A |
5245429 | Virginio et al. | Sep 1993 | A |
5247517 | Ross et al. | Sep 1993 | A |
5247575 | Sprague et al. | Sep 1993 | A |
5247697 | Ban | Sep 1993 | A |
5249260 | Nigawara et al. | Sep 1993 | A |
5251324 | McMullan, Jr. | Oct 1993 | A |
5253346 | Okabayashi et al. | Oct 1993 | A |
5260878 | Luppy | Nov 1993 | A |
5262860 | Fitzpatrick et al. | Nov 1993 | A |
5267314 | Stambler | Nov 1993 | A |
5267351 | Reber et al. | Nov 1993 | A |
5276458 | Sawdon | Jan 1994 | A |
5276789 | Besaw et al. | Jan 1994 | A |
5281962 | Vanden Heuvel et al. | Jan 1994 | A |
5283639 | Esch et al. | Feb 1994 | A |
5287363 | Wolf et al. | Feb 1994 | A |
5297249 | Bernstein et al. | Mar 1994 | A |
5299115 | Fields et al. | Mar 1994 | A |
5301350 | Rogan et al. | Apr 1994 | A |
5309243 | Tsai | May 1994 | A |
5315093 | Stewart | May 1994 | A |
5315580 | Phaal | May 1994 | A |
5317140 | Dunthorn | May 1994 | A |
5321831 | Hirose | Jun 1994 | A |
5321838 | Hensley et al. | Jun 1994 | A |
5327237 | Gerdes et al. | Jul 1994 | A |
5327554 | Palazzi, III et al. | Jul 1994 | A |
5331544 | Lu et al. | Jul 1994 | A |
5333302 | Hensley et al. | Jul 1994 | A |
5339239 | Manabe et al. | Aug 1994 | A |
5339412 | Fueki | Aug 1994 | A |
5347632 | Filepp et al. | Sep 1994 | A |
5349662 | Johnson et al. | Sep 1994 | A |
5351278 | Koshishiba et al. | Sep 1994 | A |
5351293 | Michener et al. | Sep 1994 | A |
5355327 | Stent et al. | Oct 1994 | A |
5355484 | Record et al. | Oct 1994 | A |
5359367 | Stockill | Oct 1994 | A |
5361359 | Tajalli et al. | Nov 1994 | A |
5367677 | Stanfill | Nov 1994 | A |
5371846 | Bates | Dec 1994 | A |
5374951 | Welsh | Dec 1994 | A |
5375070 | Hershey et al. | Dec 1994 | A |
5379380 | Mori et al. | Jan 1995 | A |
5382970 | Kiefl | Jan 1995 | A |
5388211 | Hornbuckle | Feb 1995 | A |
5388252 | Dreste et al. | Feb 1995 | A |
5388258 | Larsson et al. | Feb 1995 | A |
5390281 | Luciw et al. | Feb 1995 | A |
5398336 | Tantry et al. | Mar 1995 | A |
5406569 | Isozaki | Apr 1995 | A |
5408607 | Nishikawa et al. | Apr 1995 | A |
5410598 | Shear | Apr 1995 | A |
5412778 | Andres | May 1995 | A |
5414809 | Hogan et al. | May 1995 | A |
5418728 | Yada | May 1995 | A |
5461708 | Kahn | Oct 1995 | A |
5481294 | Thomas et al. | Jan 1996 | A |
5483658 | Grube et al. | Jan 1996 | A |
5485897 | Matsumoto et al. | Jan 1996 | A |
5491820 | Belove et al. | Feb 1996 | A |
5495282 | Mostafa et al. | Feb 1996 | A |
5495581 | Tsai | Feb 1996 | A |
5499340 | Barritz | Mar 1996 | A |
5524073 | Stambler | Jun 1996 | A |
5550928 | Lu et al. | Aug 1996 | A |
5555303 | Stambler | Sep 1996 | A |
5557333 | Jungo et al. | Sep 1996 | A |
5560038 | Haddock | Sep 1996 | A |
5568471 | Hershey et al. | Oct 1996 | A |
5572643 | Judson | Nov 1996 | A |
5594911 | Cruz et al. | Jan 1997 | A |
5594934 | Lu et al. | Jan 1997 | A |
5600364 | Hendricks et al. | Feb 1997 | A |
5604867 | Harwood | Feb 1997 | A |
5608445 | Mischler | Mar 1997 | A |
5615264 | Kazmierczak et al. | Mar 1997 | A |
5623652 | Vora et al. | Apr 1997 | A |
5634100 | Capps | May 1997 | A |
5646998 | Stambler | Jul 1997 | A |
5648965 | Thadani et al. | Jul 1997 | A |
5671283 | Michener et al. | Sep 1997 | A |
5673382 | Cannon et al. | Sep 1997 | A |
5696702 | Skinner et al. | Dec 1997 | A |
5706502 | Foley et al. | Jan 1998 | A |
5708709 | Rose | Jan 1998 | A |
5708780 | Levergood et al. | Jan 1998 | A |
5710915 | McElhiney | Jan 1998 | A |
5710918 | Lagarde et al. | Jan 1998 | A |
5712979 | Graber et al. | Jan 1998 | A |
5715453 | Stewart | Feb 1998 | A |
5717860 | Graber et al. | Feb 1998 | A |
5717923 | Dedrick | Feb 1998 | A |
5724521 | Dedrick | Mar 1998 | A |
5732218 | Bland et al. | Mar 1998 | A |
5737619 | Judson | Apr 1998 | A |
5740549 | Reilly et al. | Apr 1998 | A |
5781893 | Felthauser et al. | Jul 1998 | A |
5787253 | McCreery et al. | Jul 1998 | A |
5793302 | Stambler | Aug 1998 | A |
5796952 | Davis et al. | Aug 1998 | A |
5799292 | Hekmatpour | Aug 1998 | A |
5801747 | Bedard | Sep 1998 | A |
5819156 | Belmont | Oct 1998 | A |
5819285 | Damico et al. | Oct 1998 | A |
5823879 | Goldberg et al. | Oct 1998 | A |
5829001 | Li et al. | Oct 1998 | A |
5835923 | Shibata et al. | Nov 1998 | A |
5838919 | Schwaller et al. | Nov 1998 | A |
5841433 | Chaney | Nov 1998 | A |
5848396 | Gerace | Dec 1998 | A |
5857190 | Brown | Jan 1999 | A |
5870546 | Kirsch | Feb 1999 | A |
5872588 | Aras et al. | Feb 1999 | A |
5878224 | Smith | Mar 1999 | A |
5878384 | Johnson et al. | Mar 1999 | A |
5881360 | Fong | Mar 1999 | A |
5892917 | Myerson | Apr 1999 | A |
5926168 | Fan | Jul 1999 | A |
5931912 | Wu et al. | Aug 1999 | A |
5933811 | Angles et al. | Aug 1999 | A |
5935207 | Logue et al. | Aug 1999 | A |
5936541 | Stambler | Aug 1999 | A |
5948061 | Merriman et al. | Sep 1999 | A |
5951643 | Shelton et al. | Sep 1999 | A |
5956483 | Grate et al. | Sep 1999 | A |
5958010 | Agarwal et al. | Sep 1999 | A |
5963914 | Skinner et al. | Oct 1999 | A |
5964839 | Johnson et al. | Oct 1999 | A |
5974148 | Stambler | Oct 1999 | A |
5974299 | Massetti | Oct 1999 | A |
5977964 | Williams et al. | Nov 1999 | A |
5982917 | Clarke et al. | Nov 1999 | A |
5986653 | Phathayakorn et al. | Nov 1999 | A |
5991735 | Gerace | Nov 1999 | A |
5999178 | Hwang et al. | Dec 1999 | A |
6005597 | Barrett et al. | Dec 1999 | A |
6006260 | Barrick, Jr. et al. | Dec 1999 | A |
6014638 | Burge et al. | Jan 2000 | A |
6018619 | Allard et al. | Jan 2000 | A |
6049695 | Cottam | Apr 2000 | A |
6052730 | Felciano et al. | Apr 2000 | A |
6067440 | Diefes | May 2000 | A |
6070145 | Pinsley et al. | May 2000 | A |
6078324 | Phathayakorn et al. | Jun 2000 | A |
6108637 | Blumenau | Aug 2000 | A |
6112238 | Boyd et al. | Aug 2000 | A |
6112240 | Pogue et al. | Aug 2000 | A |
6115608 | Duran et al. | Sep 2000 | A |
6115742 | Franklin et al. | Sep 2000 | A |
6119098 | Guyot et al. | Sep 2000 | A |
6138155 | Davis et al. | Oct 2000 | A |
6167358 | Othmer et al. | Dec 2000 | A |
6173311 | Hassett et al. | Jan 2001 | B1 |
6185586 | Judson | Feb 2001 | B1 |
6216129 | Eldering | Apr 2001 | B1 |
6219786 | Cunningham et al. | Apr 2001 | B1 |
6226677 | Slemmer | May 2001 | B1 |
6237033 | Doeberl et al. | May 2001 | B1 |
6250930 | Mintz | Jun 2001 | B1 |
6256739 | Skopp et al. | Jul 2001 | B1 |
6264560 | Goldberg et al. | Jul 2001 | B1 |
6275854 | Himmel et al. | Aug 2001 | B1 |
6278966 | Howard et al. | Aug 2001 | B1 |
6279036 | Himmel et al. | Aug 2001 | B1 |
6279112 | O'Toole, Jr. et al. | Aug 2001 | B1 |
6286036 | Rhoads | Sep 2001 | B1 |
6298348 | Eldering | Oct 2001 | B1 |
6317787 | Boyd et al. | Nov 2001 | B1 |
6324546 | Ka et al. | Nov 2001 | B1 |
6360261 | Boyd et al. | Mar 2002 | B1 |
6381632 | Lowell | Apr 2002 | B1 |
6393479 | Glommen et al. | May 2002 | B1 |
6397359 | Chandra et al. | May 2002 | B1 |
6408335 | Schwaller et al. | Jun 2002 | B1 |
6418470 | Blumenau | Jul 2002 | B2 |
6434532 | Goldband et al. | Aug 2002 | B2 |
6446261 | Rosser | Sep 2002 | B1 |
6449604 | Hansen et al. | Sep 2002 | B1 |
6457025 | Judson | Sep 2002 | B2 |
6466970 | Lee et al. | Oct 2002 | B1 |
6473407 | Ditmer et al. | Oct 2002 | B1 |
6483813 | Blencowe | Nov 2002 | B1 |
6484316 | Lindberg | Nov 2002 | B1 |
6569095 | Eggers | May 2003 | B2 |
6601100 | Lee et al. | Jul 2003 | B2 |
6606745 | Maggio | Aug 2003 | B2 |
6609239 | Xavier | Aug 2003 | B1 |
6621881 | Srinivasan | Sep 2003 | B2 |
6625648 | Schwaller et al. | Sep 2003 | B1 |
6662195 | Langseth et al. | Dec 2003 | B1 |
6662227 | Boyd et al. | Dec 2003 | B2 |
6671715 | Langseth et al. | Dec 2003 | B1 |
6712702 | Goldberg et al. | Mar 2004 | B2 |
6719660 | Palazzolo | Apr 2004 | B2 |
6735775 | Massetti | May 2004 | B1 |
6766370 | Glommen et al. | Jul 2004 | B2 |
6807558 | Hassett et al. | Oct 2004 | B1 |
6842782 | Malik et al. | Jan 2005 | B1 |
6859833 | Kirsch et al. | Feb 2005 | B2 |
6993590 | Gauthier et al. | Jan 2006 | B1 |
7017143 | Andrew et al. | Mar 2006 | B1 |
7117518 | Takahashi et al. | Oct 2006 | B1 |
7139723 | Conkwright et al. | Nov 2006 | B2 |
7146329 | Conkwright et al. | Dec 2006 | B2 |
7150030 | Eldering et al. | Dec 2006 | B1 |
7181412 | Fulgoni et al. | Feb 2007 | B1 |
7216149 | Briscoe et al. | May 2007 | B1 |
7222071 | Neuhauser et al. | May 2007 | B2 |
7236941 | Conkwright et al. | Jun 2007 | B2 |
7260823 | Schlack et al. | Aug 2007 | B2 |
7260837 | Abraham et al. | Aug 2007 | B2 |
7343616 | Takahashi et al. | Mar 2008 | B1 |
7376722 | Sim et al. | May 2008 | B1 |
7451151 | Horvitz et al. | Nov 2008 | B2 |
7483835 | Neuhauser et al. | Jan 2009 | B2 |
7493655 | Brown | Feb 2009 | B2 |
7757250 | Horvitz et al. | Jul 2010 | B1 |
7827227 | Iijima et al. | Nov 2010 | B2 |
7953791 | Or Sim et al. | May 2011 | B2 |
7953839 | Sim et al. | May 2011 | B2 |
7962935 | Kurosaki et al. | Jun 2011 | B2 |
8046797 | Bentolila et al. | Oct 2011 | B2 |
8112511 | Sim et al. | Feb 2012 | B2 |
8311888 | Ramer et al. | Nov 2012 | B2 |
8484677 | Eldering | Jul 2013 | B1 |
8510770 | Oztaskent et al. | Aug 2013 | B1 |
8514907 | Wright et al. | Aug 2013 | B2 |
8531606 | Pyo | Sep 2013 | B2 |
8739197 | Pecjak et al. | May 2014 | B1 |
8898689 | Georgakis | Nov 2014 | B2 |
8930989 | Knoller et al. | Jan 2015 | B2 |
8984547 | Lambert et al. | Mar 2015 | B2 |
9185435 | Shankar et al. | Nov 2015 | B2 |
9219928 | Shankar et al. | Dec 2015 | B2 |
9247273 | Shankar et al. | Jan 2016 | B2 |
9277265 | Wood et al. | Mar 2016 | B2 |
9544632 | Wood et al. | Jan 2017 | B2 |
9578357 | Wolf et al. | Feb 2017 | B2 |
9743141 | Sheppard et al. | Aug 2017 | B2 |
9774900 | Wood et al. | Sep 2017 | B2 |
10219039 | Mowrer et al. | Feb 2019 | B2 |
20010049620 | Blasko | Dec 2001 | A1 |
20020040394 | Shapira | Apr 2002 | A1 |
20020040395 | Davis et al. | Apr 2002 | A1 |
20020049762 | Shah et al. | Apr 2002 | A1 |
20020056087 | Berezowski et al. | May 2002 | A1 |
20020072966 | Eldering et al. | Jun 2002 | A1 |
20020077787 | Rappaport et al. | Jun 2002 | A1 |
20020078191 | Lorenz | Jun 2002 | A1 |
20020099812 | Davis et al. | Jul 2002 | A1 |
20020099818 | Russell et al. | Jul 2002 | A1 |
20020099819 | Hattori et al. | Jul 2002 | A1 |
20020103664 | Olsson et al. | Aug 2002 | A1 |
20020112048 | Gruyer et al. | Aug 2002 | A1 |
20020124074 | Levy et al. | Sep 2002 | A1 |
20020150054 | Sohraby et al. | Oct 2002 | A1 |
20020161673 | Lee et al. | Oct 2002 | A1 |
20030018969 | Humpleman et al. | Jan 2003 | A1 |
20030046303 | Chen et al. | Mar 2003 | A1 |
20030046385 | Vincent | Mar 2003 | A1 |
20030062223 | Coyle et al. | Apr 2003 | A1 |
20030067554 | Klarfeld et al. | Apr 2003 | A1 |
20030110485 | Lu et al. | Jun 2003 | A1 |
20030144868 | MacIntyre et al. | Jul 2003 | A1 |
20030145319 | Sato | Jul 2003 | A1 |
20030149975 | Eldering et al. | Aug 2003 | A1 |
20030163563 | Bean | Aug 2003 | A1 |
20030182387 | Geshwind | Sep 2003 | A1 |
20030187677 | Malireddy et al. | Oct 2003 | A1 |
20030208578 | Taraborelli | Nov 2003 | A1 |
20030231203 | Gallella | Dec 2003 | A1 |
20030233197 | Padilla | Dec 2003 | A1 |
20040003391 | Gutta et al. | Jan 2004 | A1 |
20040024717 | Sneeringer | Feb 2004 | A1 |
20040221033 | Davis et al. | Nov 2004 | A1 |
20050114511 | Davis et al. | May 2005 | A1 |
20050149964 | Thomas et al. | Jul 2005 | A1 |
20060074769 | Looney et al. | Apr 2006 | A1 |
20060075421 | Roberts et al. | Apr 2006 | A1 |
20060136965 | Ellis et al. | Jun 2006 | A1 |
20070011039 | Oddo | Jan 2007 | A1 |
20070022032 | Anderson et al. | Jan 2007 | A1 |
20070136753 | Bovenschulte et al. | Jun 2007 | A1 |
20070143778 | Covell et al. | Jun 2007 | A1 |
20070174295 | Abraham et al. | Jul 2007 | A1 |
20070276940 | Abraham et al. | Nov 2007 | A1 |
20070294729 | Ramaswamy | Dec 2007 | A1 |
20070294740 | Drake et al. | Dec 2007 | A1 |
20080077951 | Maggio et al. | Mar 2008 | A1 |
20080120650 | Orihara et al. | May 2008 | A1 |
20080140479 | Mello et al. | Jun 2008 | A1 |
20080235733 | Heie et al. | Sep 2008 | A1 |
20080256235 | Or Sim et al. | Oct 2008 | A1 |
20080263200 | Or Sim et al. | Oct 2008 | A1 |
20080300965 | Doe | Dec 2008 | A1 |
20090055854 | Wright et al. | Feb 2009 | A1 |
20090112703 | Brown | Apr 2009 | A1 |
20090147786 | Li et al. | Jun 2009 | A1 |
20100146533 | Matsunaga et al. | Jun 2010 | A1 |
20100205628 | Davis et al. | Aug 2010 | A1 |
20100228855 | Sim et al. | Sep 2010 | A1 |
20110004682 | Honnold et al. | Jan 2011 | A1 |
20110029636 | Smyth et al. | Feb 2011 | A1 |
20110208860 | Or Sim et al. | Aug 2011 | A1 |
20110258049 | Ramer et al. | Oct 2011 | A1 |
20120124620 | Nishizawa et al. | May 2012 | A1 |
20120254911 | Doe | Oct 2012 | A1 |
20120260278 | Lambert et al. | Oct 2012 | A1 |
20130160042 | Stokes et al. | Jun 2013 | A1 |
20130163658 | Luff et al. | Jun 2013 | A1 |
20130179914 | Falcon | Jul 2013 | A1 |
20130227595 | Nielsen et al. | Aug 2013 | A1 |
20140150003 | Doe | May 2014 | A1 |
20140379421 | Shankar et al. | Dec 2014 | A1 |
20140380348 | Shankar et al. | Dec 2014 | A1 |
20140380350 | Shankar et al. | Dec 2014 | A1 |
20150067075 | Sheppard et al. | Mar 2015 | A1 |
20150189378 | Soundararajan et al. | Jul 2015 | A1 |
20150229979 | Wood et al. | Aug 2015 | A1 |
20160037201 | Kitts et al. | Feb 2016 | A1 |
20160165277 | Kirillov et al. | Jun 2016 | A1 |
20160165287 | Wood et al. | Jun 2016 | A1 |
20160269783 | Mowrer et al. | Sep 2016 | A1 |
20170078727 | Wood et al. | Mar 2017 | A1 |
20170083580 | Sheppard et al. | Mar 2017 | A1 |
20180005128 | Sheppard et al. | Jan 2018 | A1 |
Number | Date | Country |
---|---|---|
101980174 | Feb 2011 | CN |
0228242 | Jul 1987 | EP |
0388658 | Sep 1990 | EP |
0228458 | Oct 1991 | EP |
0451384 | Oct 1991 | EP |
0632382 | Jan 1995 | EP |
0747841 | Dec 1996 | EP |
2004357311 | Dec 2004 | JP |
2008011365 | Jan 2008 | JP |
20130008978 | Jan 2013 | KR |
9826529 | Jun 1998 | WO |
0111606 | Feb 2001 | WO |
2006096177 | Sep 2006 | WO |
2007022250 | Feb 2007 | WO |
Entry |
---|
Screen Shot of ftp.ist.utl.pt, 1999 (3 page). |
Pestana et al., “A Visual History of Web Measurement: Vendor Emergence, Technology Deployment and Seminal Events,” 2005 (1 page). |
“Third International World-Wide Web Conference-Technology, Tools and Applications,” Apr. 10-14, 1995, retrieved from <http://www.igd.fhg.de/archive/1995_www95/>, retrieved on May 24, 2006 (1 page). |
Sanders, “Plexus Log File Summaries,” email message from sanders@bsdi.com, Jun. 18, 1993, retrieved from <http://ksi.cpsc.ucalgary.ca/archives/WWW-TALK/www-talk-1993q2.messages/563.html> retrieved from May 24, 2006 (4 pages). |
“2.4—Windows Based Only Internet BBS Software—The Official BBS FAQ,” retrieved from <http://www.sysopworld.com/bbsfaq/ch02.2.4.htm>, retrieved on May 24, 2006 (23 pages). |
java@mt.e-technik.uni-kassel.de, “Counter,” retrieved from <http://we.archive.org/web/19970802020140/www.uni-kassel.de/fb16/ipm/mt/java/counteru.html>, retrieved on May 24, 2006 (1 page). |
“Linear IP Advertising Infrastructure,” retrieved from <http://blackarrow.tv/wp-content/uploads/2015/04/Linear-IP-Advertising_Infrastructure_CED-Wallchart.jpg>, retrieved on Dec. 9, 2015 (1 page). |
McGrew, “Web Authoring FAQ,” 2005 (59 pages). |
WwwTalk 1991 Archives, “Messages from Monday Oct. 28, 1991 to Friday, Dec. 13, 1991,” retrieved from <http://ksi.cpsc.ucalgary.ca/archives/www-talk/www-talk-1991.index.html>, retrieved on May 24, 2006 (1 page). |
Applet Demos, 1995-1996 (2 pages). |
Wendt, “Applet Collection,” retrieved from <http://www.thew.de/t/collection/readme.html>, retrieved on Dec. 9, 2015 (5 pages). |
Applets at Kassel, “Applets and Applications,” Department of Engineering Measurement, Dec. 12, 1996, retrieved from <http://web.archive.org/web/19970802020436/http://www..uni-kassel.de/fb16Iipm/mUjavae/html>, retrieved on May 24, 2006 (5 pages). |
Arbitron Inc., “Smartplus 8.0: Keeps Getting Smarter So You Can Too,” 2007 (13 pages). |
Arbitron Inc., “Respondent-Level Data: Your Key to Reaching the Hispanic Listener,” retrieved from <http://arbitronratings.com/ad_agencies/rld_vs_hispsumm.htm?inframe>, retrieved on Sep. 21, 2007 (1 page). |
Abrams et al., “Multimedia Traffic Analysis Using CHITRA95,” ACM Multimedia 95—Electronic Proceedings, Nov. 5-9 1995, retrieved from <http://ei.cs.vt.edu/˜succeed/95multimediaAWAFPR/95multimediaAWAFPR.html>, retrieved on Jun. 9, 2006 (17 pages). |
Abrams, “A Tool to Aid in Model Development and Validation,” NCR Corporation, Annual Simulation Symposium, 1986 (10 pages). |
Anderson et al., “Next Generation Intrusion Detection Expert System (NIDES)—Software Users Manual Beta—Update Release,” SRI International, Dec. 1, 1994 (316 pages). |
Arlitt et al., “Internet Web Servers: Workload Characterization and Performance Implications,” IEEE/ACM Transactions on Networking, vol. 5, No. 5, Oct. 1997 (15 pages). |
Bank, “Java Security,” MIT, Dec. 8, 1995, retrieved from <http://groups.csail.mit.edu/mac/users/jbank/javapaper/javapaper.html,> retrieved on Apr. 30, 2015 (11 pages). |
Barber, e-mail dated May 3, 1996, (2 pages). |
Baskaran, “Gamelan Who's Who More Info,” Earth Web, Inc., 1996 (2 pages). |
Becker, “Department of Engineering Measurement,” UNI Kassel, Sep. 20, 1996 (1 page). |
Beckett, “Combined Log System,” Computing Laboratory, University of Kent, retrieved from <http://www.igd.fhg.de/archive/1995_www95/papers/46/comblog.html>, retrieved on May 24, 2006 (8 pages). |
Bates, “The Design of Browsing and Berrypicking Techniques for the Online Search Interface,” Graduate School of Library and Information Science, University of California at Los Angeles, 1989, retrieved from <file://P:\Drive Files\CLIENTS\Nielsen-NetRatings\SettledCases\Sane Solutions LLC\>, retrieved on Dec. 21, 2006 (19 pages). |
Berners-Lee et al., “Uniform Resource Locators” Network Working Group, Dec. 1994 (23 pages). |
Berners-Lee et al., “WorldWideWeb: Proposal for a HyperText Project,” Nov. 12, 1990 (7 pages). |
Berners-Lee, “Information Management: A Proposal,” CERN, Mar. 1989, May 1990, retrieved from <http://www.w3org/History/1989/proposal.html>, retrieved on May 24, 2006 (14 pages). |
Berners-Lee, “Presentation of WWW to Online Publishing 93,” retrieved from <http://www.w3org/Talks/OnlinePublishing93/Overview.html>, retrieved on May 24, 2006 (1 pages). |
Berners-Lee et al., “Hypertext Transfer Protocol—HTTP/1.0,” Network Working Group, May 1996, retrieved from <http://www.3.org/Protocols/rfc1945/rfc1945>, retrieved on Mar. 22, 2007 (57 pages). |
Berners-Lee, “The World Wide Web Browser,” retrieved from <http://www.w3.org/People/Berners-Lee/WorldWideWeb.html>, retrieved on May 24, 2006 (4 pages). |
Bernstein et al., “Architectures for Volatile Hypertext,” Hypertext '91 Proceedings, Dec. 1991 (18 pages). |
Bertot et al., “Web Usage Statistics: Measurement Issues and Analytical Techniques,” Government Information Quarterly, vol. 14, No. 4, 1997 (23 pages). |
Bestavros et al., “Application-Level Document Caching in the Internet,” Proceeding of the Second International Workshop on Services in Distributed and Networked Environments (SDNE '95), Jun. 5-6, 1995 (8 pages). |
Bieber et al., “Backtracking in a Multiple-window Hypertext Environment,” ECHT '94 Proceedings, Sep. 1994 (9 pages). |
Berners-Lee, “Plenary Talk at WWW Geneva 94,” retrieved from <http://www.w3.org/Talks/WWW94Tim/> retrieved on May 24, 2006 (4 pages). |
Bl et al., “W3 Project—Assorted Design Notes,” W3.org, retrieved from <http://w3.org/History/1994/WWW/WorkingNotes/Overview.html>, retrieved on May 24, 2006 (2 pages). |
Blackarrow, Inc., “Meeting the Challenges of Video Advertising in an IP ABR Environment,” 2012 (10 pages). |
Blythe et al., “Lynx Users Guide Version 2.3,” retrieved from <http://www.cse.unsw.edu.au/help/doc/lynx/lynx_help/Lynx_users_guide.html>, retrieved on Jun. 12, 2006 (12 pages). |
Boyan, “Anonymous Surfing, the Anonymizer Homepage,” Anonymizer, Sep. 1, 1995, retrieved from <http://web.archive.org/web/19990208003332m/_1/anonymizer.cs.cmu.edu:8080/>, retrieved on May 24, 2006 (1 page). |
Boyns, “Crazy Counter,” modified Mar. 8, 1996 (2 pages). |
Boyns, “Crazy Counter (GIF89a),” modified Mar. 8, 1996 (1 page). |
Boyns, “CrazyCounter.java,” 1996 (5 pages). |
Braun et al., “Applied Network Research: 1994 Annual Status Report,” Applied Network Research, San Diego Supercomputer Center and University of California, San Diego, Apr. 19, 1995 (15 pages). |
Brueggeman, “Monitoring CDROM Usage,” UCSD Scripps Institution of Oceanography Library, retrieved from <http://www.peterbrueggeman.com/cv/usage.txt>, retrieved on Oct. 1, 2015 (5 pages). |
Carmel et al., “Browsing in Hypertext: A Cognitive Study,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 22, No. 5, Sep./Oct. 1992 (23 pages). |
Catledge et al., “Characterizing Browsing Strategies in the World-Wide Web,” Proceedings of the Third International World-Wide Web Conference on Technology, Tools and Applications, Apr. 1995 (9 pages). |
CERN, “Computer News Letter Oct.-Dec. 1991,” Ref. CERN-CNL-1991-204, vol. 26, Issue No. 3, retrieved from <http://ref.web.cern.ch/ref/CERN/CNL/1991/204>, retrieved on May 24, 2006 (2 pages). |
Chankhunthod et al., “A Hierarchical Internet Object Cache,” ATEC' 96 Proceedings of the 1996 Annual Conference on USENIX Annual Technical Conference, 1996 (11 pages). |
Chen, “Supporting Advertisement on Electronic Publications,”IBM Technical Disclosure Bulletin, Aug. 1996 (2 pages). |
Claffy et al., “Traffic Characteristics of the T1 NSFNET Backbone,” INFOCOM '93 Proceedings, Twelfth Annual Joint Conference of the IEEE Computer and Communications Societies, Networking: Foundation for the Future, IEEE, 1993 (11 pages). |
Cooley et al., “Data Preparation for Mining World Wide Web Browsing Patterns,” Knowledge and Information Systems, vol. 1, 1999 (27 pages). |
Cooley et al., “Web Mining: Information and Pattern Discovery on the World Wide Web,” Department of Computer Science, University of Minnesota, Jul. 16, 1997 (2 pages). |
Cooper, “Design Considerations in Instrumenting and Monitoring Web-Based Information Retrieval Systems,” Journal of the American Society for Information Science, vol. 49, No. 10, 1998 (17 pages). |
Cove et al., “Online Text Retrieval via Browsing,” Information Processing and Management, vol. 24, No. 1, 1988 (10 pages). |
Crovella et al., “Explaining World Wide Web Traffic Self-Similarity,” Computer Science Department, Boston University, Technical Report TR-95-15, Oct. 12, 1995 (19 pages). |
Crovella et al., “Self-Similarity in World Wide Web Traffic: Evidence and Possible Causes,” IEEE/ACM Transactions on Networking, vol. 5, No. 6, Dec. 1997 (25 pages). |
Cunha et al., “Characteristics of WWW Client-Based Traces,” Computer Science Department, Boston University, Jul. 18, 1995 (19 pages). |
Davis et al., “Instant Java Applets,” Macmillan Computer Publishing USA, 1996 (234 pages). |
Dean et al. (1995) “Security Flaws in the HotJava Web Browser,” Department of Computer Science, Princeton University, Nov. 3, 1995 (8 pages). |
December et al., “HTML and CGI Unleashed,” 1995 (841 pages). |
Dellecave Jr., “The 'Net Effect,” Sales & Marketing Management: An Excutive's Guide to Sales and Marketing Technology, Mar. 1996 (9 pages). |
Desjardins, “Activity Monitor 1.1 User's Guide,” 1994 (5 pages). |
Digital Envoy, “NetAcuity IP Intelligence Whitepaper,” Digital Envoy, Inc. 2002-2003 (10 pages). |
Email Counter Logs, 1996 (33 pages). |
Earth Station 9, “Computers and the Internet,” <http://www.earthstation9.com/counters.htm>, retrieved from May 24, 2006 (2 pages). |
Earthweb, Inc., “Java-Enhanced Communication Tools,” Gamelan, The Official Directory for Java, 1996 (7 pages). |
Engagement Marketing Group, “Advanced Advertising Media Project—Phase One: Summary Report—Remaking Video-on-Demand to Deliver Media Value,” May 11, 2011 (50 pages). |
European Patent Office, “Supplementary Search Report,” issued in connection with European Patent Application No. 00949006.1, dated Jul. 12, 2006 (5 pages). |
European Patent Office, “Search Report,” issued in connection with European Patent Application No. 10012280.3, dated Mar. 17, 2014 (6 pages). |
European Patent Office, “Supplementary Partial Search Report,” issued in connection with European Patent Application No. 00949006.1, dated Apr. 19, 2006 (4 pages). |
European Patent Office, “Office Action,” issued in connection with European Patent Application No. 00949006.1, dated Apr. 18, 2008 (7 pages). |
European Patent Office, “Office Action,” issued in connection with European Patent Application No. 00949006.1, dated Oct. 7, 2014 (6 pages). |
Feliciano et al., “Lamprey: Tracking Users on the World Wide Web,” Section on Medical Informatics, Stanford University, 1996 (5 pages). |
Fielding, “wwwstat manual,” retrieved from <http://ftp.ics.uci.edu/pub/websoft/wwwstat/wwwstat.html>, retrieved on Jun. 12, 2006 (11 pages). |
Fielding, “wwwstat: HTTPd Logfile Analysis Software,” Department of Information and Computer Science, University of California, Irvine, retrieved from <http://ftp.ics.uci.edu/pub/websoft/wwwstat/>, retrieved on May 24, 2006 (3 pages). |
Finke, “Monitoring Usage of Workstations with a Relational Database,” 1994 LISA—San Diego, California, Sep. 19-23, 1994 (10 pages). |
Fleishman, “Web Log Analysis: Who's Doing What, When? Part 2,” retrieved from <http://www,webdeveloper.com/management/management_log_analysis_2.html> retrieved on Dec. 21, 2006 (4 pages). |
Fuller, “Measuring User Motivation From Server Log Files,” Usability Research, retrieved from <http://www.microsoft.com/usability/webconf/fuller/fuller.htm>, Oct. 30, 2000 (15 pages). |
Gellman, “They Could be Monitoring Your Every Web Move,” GCN, retrieved from <http:www.gcn.com/print/15 9/31672-1.html>, retrieved on Apr. 29, 2006 (3 pages). |
Girdley et al., “Web Programming with Java,” 1996 (pp. 365-370). |
Girdley et al., “Web Programming with Java,” 1996 (499 pages). |
Gile, “Reporting Application Usage in a LAN Environment,” ACM SIGUCCS, vol. 18, 1990 (13 pages). |
Gilula et al., “A Direct Approach to Data Fusion,” journal of Marketing Research, vol. 43, Feb. 2006 (22 pages). |
GoldMail, “GoldMail Thinks Consumers Should Get Paid for Reading Advertising!” Google Groups, Jul. 7, 1996 (4 pages). |
GoldMail, “GoldMail Revolutionizes Internet Advertising!” Google Groups, Jul. 7, 1996 (4 pages). |
Glassman, “A Caching Relay for the World Wide Web,” Systems Research Center, Digital Euipment Corporation, 1994 (10 pages). |
Google Groups, “java project” “I am volunteering my time,” retrieved from <http://groups.google.com/group/comp.lang.java.programmer/browse_thread/thread/5430a3 . . . > , retrieved on Apr. 12, 2006 (3 pages). |
Google Groups, “xferstats,” retrieved from <http://groups.google.com/group/alt.sources/browse_thread/thread/c9360d434be3ad86/0a180fb213f27e2b?q=xferstats&mum=199&hl=en>, retrieved on May 24, 2006 (10 pages). |
Google Groups, “Counter,” retrieved from <http://groups-beta.google.com/group/comp.lang.javascript/browse_thread/thread/4874a9f9c . . . >, retrieved on Jun. 8, 2005 (4 pages). |
Google Groups, “Can U Make a Hit Counter in a Java Applet?,” retrieved from <http://groups.google.com/group/comp.lang.java/browse_thread/thread/f2a41d0cb5c8eee4/c8 . . . >, retrieved on May 2, 2006 (10 pages). |
Google Groups, “xferstats,” retrieved from <http://groups.google.com/group/comp.unix.xenix/browse_thread/thread/cb3d1aed21bc0e3e/8d9ce54693af9e98?q=xferstats&mum=200 . . . >, retrieved on May 24, 2006 (3 pages). |
Google Groups, “wwwstat,” retrieved from <http://groups.google.com/group/comp.infosystems.www/browse_thread/thread/784aa9c20470d342/fc0cde0742990875?q=wwwstat&mum=43 . . . >, retrieved on May 24, 2006 (8 pages). |
Google Groups, “fwgstat,” retrieved from <http://groups.google.com/group/comp.infosystems.gopher/browse_thread/thread/c15dc16c0284c02d0/953bf38f2cee15ea?q=fwgstat&mum=34>, retrieved on May 24, 2006 (3 pages). |
Google Groups, “fwgstat,” retrieved from <http://groups.google.com/group/comp.infosystems.gopher/browse_thread/thread/4790232128a9157/d1534978ddddf998?q=fwgstat&mum=33>, retrieved on May 24, 2006 (10 pages). |
Google Groups, “getsites,” retrieved from <http://groups.google.com/group/comp.infosystems.www/browse_thread/threada36eeb6daea735d8/0fa7adf53e51b894?q=getsites&mum=19 & h . . . >, retrieved on May 24, 2006 (2 pages). |
Google Groups, “javascript counter script,” retrieved from <http://groups.google.com/group/comp.database.oraclelbrowse_thread/thread/97671e385d1bac94n77a82875e328555?q=javascript+counter+sc . . . >, retrieved on May 24, 2006 (2 pages). |
Google Groups, “javascript exploit,” retrieved from <http://groups.google.com/group/comp.sys.mac.misclbrowse_thread/thread/f9285c7d4e4354cd/eb94d5066981 0159?q=javascript+exp;oit&mum>, retrieved on May 24, 2006 (3 pages). |
Google Groups, “hit counter” retrieved from <http://groups.google.com/group/comp.infosystems.www.authoring.html/browse_thread/e515dad2e5d1e8cc/0ebdc329e9ec00cc?q=hit...> retrieved on May 24, 2006 (7 pages). |
Google Groups, “access counters,” retrieved from <http://groups.google.com/group/comp.infosystems.www.authoring.html/browse_thread/dfb1a837f29e165e/a0e0e6a131c6102d?q=access . . . > retrieved on May 24, 2006 (3 pages). |
Google Groups, “cgi hit counter,” retrieved from <http://groups.google.com/group/comp.lang.per1/browse_thread/thread/b4ef428d8c96d525/3e18b779b1dad79e?q=cgi+hit+counter & mum=74 & . . . > retrieved on May 24, 2006 (7 pages). |
Google Groups, “cgi hit counter,” retrieved from <http://groups.google.com/group/comp.infosystems.www.users/browse_thread/thread/390de231bb3f0097/64bddc80086f124b?q=cgi+hit+counter> retrieved on May 24, 2006 (2 pages). |
Google Groups, “Garrett Casey,” retrieved from <Google Groups: comp.infosystems.www.authoring.cgi>, 2007 (2 pages). |
Google Groups, “Garrett Casey counter,” Jul. 2, 1996, retrieved from <Google Groups: comp.infosystems.www.misc.entrepreneurs>, 2007 (3 pages). |
Google Groups, “javascript,” retrieved from <http://groups.google.com/group/comp.society.privacr/browse_thread/thread/9b12496aeda7fd78/dd2ebe5f8966fd05?q=javascript&mum=1&h1>, retrieved on May 24, 2006 (3 pages). |
Google Groups, “wusage 1.0,” retrieved from <http://groups.google.com/group/comp.infosystems.www/browse_thread/thread/a07834d8b38dbc4f/f05bf1df25d47fd3?q=wusage+1.0&mum=1 . . . >, retrieved on May 24, 2006 (2 pages). |
Google Groups, “getstats,” retrieved from <http://groups.google.com/group/comp.infosystems.www/browse_thread/thread/1009129de1aaf6aa/ed924b219923cc7d?q=getstats&mum=1 & h1 . . . >, retrieved on May 24, 2006 (3 pages). |
Gotta et al., “Performance Evaluation of Web Applications,” Proceeding of the Computer Measurement Group International Conference, 1998 (13 pages). |
Greenberg, “Using Unix: Collected Traces of 168 Users,” Advanced Technologies, The Alberta Research Council, 1988 (14 pages). |
Grobe, “An Early History of Lynx: Multidimensional Collaboration,” Academic Computing Services, University of Kansas, Apr. 10, 1997, retrieved from <http://people.cc.ku.edu/˜grobe/early-lynx.html>, retrieved on May 24, 2006 (8 pages). |
Gundavaram, “CGI Programming on the World Wide Web,” 1996 (455 pages). |
Hallam-Baker et al., “Extended Log File Format,” W3C Working Draft WD-logfile-960323, retrieved from <http://www.w3.org/TR1WD-logfile.html>, retrieved on May 24, 2006 (6 pages). |
Hansen et al., “Automated System Monitoring and Notification With Swatch,” Seventh System Administration Conference (LISA ' 93), Monterey California, Nov. 1993 (9 pages). |
Haran, “PC-Meter Tracks Computer Users,” Advertising Age, Oct. 2, 1995, retrieved from <http://adage.com/print/85520>, retrieved on Jun. 2, 2015 (2 pages). |
Hello Net! Counter, filed Aug. 21, 2007 (1 page). |
Highbeam Research, “Harris Computer Systems and Webster Network Strategies Announce Alliance to Offer WWW Monitoring Capabilities Through Firewalls,” Business Wire, Mar. 4, 1996, retrieved from <http://www.highbeam.com> (5 pages). |
Hilbert et al., “Agents for Collecting Application Usage Data Over the Internet,” Department of Information and Computer Science, University of California, Irvine, retrieved from <http://www.ics.uci.edu/˜redmiles/publications/C027-HR98.pdf>, retrieved on Oct. 1, 2015 (8 pages). |
Holgermetzger, “A Netscape Timeline,” Mar. 1993 through Mar. 17, 2006, retrieved from <http://www.holgermetzger.de/Netscape_History.html,> retrieved on May 24, 2006 (4 pages). |
“Horace's Java—Page View Timer Demo—Form 1,” Aug. 7, 1999 (2 pages). |
Horak, “IOMON—Protected Mode I/O Port Monitor,” Technical University of Prague, Faculty of Nuclear Science and Physical Engineering, Jan. 1992 (6 pages). |
Houston, “A Vision of Advertising Technology—How It Will Work and Why Advertisers Must Involve Themselves in the Process,” Modern Media, Aug. 1994, retrieved from <http://www.web.archive.org/web/19961111095749/www.modernmedia.com/clippings/articles/sm . . . >, retrieved on Jun. 8, 2005 (6 pages). |
Ibiblio, “Ibiblio—Ten Years in the Making—Aligning the Sites,” retrieved from <http://www.ibiblio.org/history/> , retrieved on May 24, 2006 (10 pages). |
W3, “Logging Control in W3C httpd,” retrieved from <http://www.w3.org/Daemon/User/Config/Logging.html,> retrieved on May 24, 2006 (3 pages). |
Intellectual Property Office of the United Kingdom, “Examination Report,” issued in connection with United Kingdom Patent Application No. GB0920943.8, dated Apr. 11, 2011 (5 pages). |
Intellectual Property Office of the United Kingdom, “Examination Report,” issued in connection with United Kingdom Patent Application No. GB0920943.8, dated Nov. 10, 2010 (6 pages). |
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2015/015219, dated May 22, 2015 (4 pages). |
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2015/015219, dated May 22, 2015 (7 pages). |
International Searching Authority, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US2015/015219, dated Aug. 25, 2016 (9 pages). |
International Bureau, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US2008/059874, dated Dec. 10, 2009 (7 pages). |
International Preliminary Examining Authority, “International Preliminary Examination Report,” issued in connection with International Patent Application No. PCT/AU00/00937, dated Nov. 2, 2001 (3 pages). |
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2008/059874, dated Mar. 2, 2009 (3 pages). |
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2008/059874, dated Mar. 2, 2009 (5 pages). |
IP Australia, “Examiner's First Report,” issued in connection with Australian Patent Application No. 2008260397, dated Nov. 17, 2010 (2 pages). |
IP Australia, “Notice of Acceptance,” issued in connection with Australian Patent Application No. 2008260397, dated Aug. 7, 2012 (2 pages). |
Ivler, “Advertising Models and Associated Software . . . ,” Google Groups, May 15, 1996 (5 pages). |
Japan Patent Office, “Notice of Reasons for Rejection,” issued in connection with Japanese Patent Application No. 2001-516087, dated Jan. 25, 2011 (8 pages). |
Japan Patent Office, “Notice of Reasons for Rejection,” issued in connection with Japanese Patent Application No. 2001-516087, dated May 18, 2010 (14 pages). |
Javapage, “JAVA,” retrieved from <http://web.archive.org/web/20040712072256/http://www.groton.k12.ct.us/WWW/fsr/student/Spring02/W . . . >, retrieved on May 24, 2006 (4 pages). |
JavaWorld, JavaWorld Editorial Calendar, Feb. 26, 1996 ( 1 page). |
JavaWorld, JavaWorld: IDG's Magazine for the Java Community, vol. 1, Issue 1, retrieved from <www.javaworld.com>. Mar. 8, 1996 ( 1 page). |
JavaWorld, JavaWorld: IDG's Magazine for the Java Community, vol. 1, Issue 2, retrieved from <www.javaworld.com>. Apr. 1, 1996 ( 1 page). |
Johnson et al., “Automatic Touring in a Hypertext System,” IEEE Twelfth Annual International Phoenix Conference on Computers and Communications, 1993 (7 pages). |
Johnson, “Implementation Guide, HBX On-Demand Web Analytics,” WebSideStory, Inc., 2006 (12 pages). |
Kamba et al., “The Krakatoa Chronicle—An Interactive, Personalized, Newspaper on the Web,” Georgia Institute of Technology, 1995 (15 pages). |
Kamba, “Personalized Online Newspaper,” NEC, vol. 49, No. 7, 1996 (6 pages) (English Abstract Included). |
Kent et al., “Official Netscape JavaScript Book,” 1996 (508 pages). |
Kiesler et al., “Homenet: A Field Trial of Residential Internet Services,” Carnegie Mellon University, Apr. 1995, retrieved from <http://homenet.hcii.cs.cmu.edu/progress/report1.html> (12 pages). |
Kraut et al., “Homenet: A Field Trial of Residential Internet Services,” Carnegie Mellon University, Apr. 1995, retrieved from <http://www.acm.org/sigchi/chi96/proceedings/papers/Kraut/rek_txt.htm> (14 pages). |
Kugel et al., “Decay Effects in Online Advertising: Quantifying the Impact of Time Since Last Exposure,” Presented at the ARF 50th Annual Convention, New York City, Apr. 26-28, 2004 (19 pages). |
Lamers, “WebThreads, LLC of Vienna, VA, USA is Pleased to Announce WebThreads™ 1.0.1 Website Interactivity and Visitor Tracking Solution,” Oct. 8, 1996 (5 pages). |
Lee et al., “Intelligent Agents for Matching Information Providers and Consumers on the World-Wide-Web,” Proceedings of the Thirtieth Annual Hawaii International Conference on System Sciences, IEEE, 1997 (11 pages). |
Levine, “Computer Privacy Digest V8#024” Computer Privacy Digest, vol. 8, Issue No. 024, Mar. 17, 1996, retrieved from <http://web.archive.org/web/20000829051834/itu.rdg.ac.uk/misc/Mailing_Lists/cpd/00000002.htm>, retrieved on May 24, 2006 (19 pages). |
Lubow, “An Engineer's Guide to Autocad,” Industrial Engineering, vol. 19, No. 8, Aug. 1987 (6 pages). |
Long, “Gwstat v1.1—Generate Graphs of HTTPD Server Traffic,” BUBL Administrator, Jul. 14, 1994, retrieved from <http://www.bubl.ac.uk//archive/internet/www/servers/gswtat6.htm>, retrieved on Jun. 12, 2006 (1 page). |
Loverso, “Netscape Nav. 2.0 Exposes User's Browsing History,” the Risks Digest, vol. 7, No. 79, Feb. 23, 1996 (2 pages). |
Lynnworth, “Tracking Home Page Hits,” Dr. Dobbs Journal, Dec. 1, 1995, retrieved from <http://www.drdobbs.com/article/print?articleId=184409739&siteSectionName=web-development>, retrieved on Apr. 30, 2015 (7 pages). |
Marchionini, “Information-Seeking Strategies of Novices Using a Full-Text Electronic Encyclopedia,” journal of the American Society for Information Science, vol. 40, No. 1, 1989 (16 pages). |
Mayer-Schonberger, “The Internet and Privacy Legislation: Cookies for a Treat?” West Virginia University, retrieved from <http://web.archive.org/web/19990203034203/www.wvjolt.wvu.edu/wvjolt/current/issue1/articles/mayer/ . . . >, retrieved on May 24, 2006 (7 pages). |
McCanne et al., “The BSD Packet Filter: A New Architecture for User-level Packet Capture,” Lawrence Berkeley Laboratory, Berkeley, CA, Dec. 19, 1992 (11 pages). |
McGee, “Web Pages: A Programmer's Perspective,” Jun. 10, 1996, retrieved from <http://www.dfpug/loseblattsammlung/migration/whitepapers/webpages.htm>, retrieved on Mar. 22, 2007 (13 pages). |
McGrath, “The Tail-Less Mouse,” Computer Graphics World, vol. 11, Oct. 1988 (5 pages). |
McGraw et al., “Untangling the Woven Web: Testing Web-based Software,” Reliable Software Technologies Corporation, Apr. 1, 1996 (9 pages). |
McKenzie et al., “An Empirical Analysis of Web Page Revisitation,” Department of Computer Science, University of Canterbury, 2001 (7 pages). |
Consoli, “Nielsen Unveils National TV/Internet Fusion,” Mediaweek.com, Nov. 1, 2006 (2 pages). |
Microsoft Corporation, “Screen Shots of Windows NT 3:1,” retrieved from <http://www.cs.umd.edu/hcil/muiseum/systems/winnt31src.html>, retrieved on Jun. 7, 2005 (4 pages). |
Mobasher, “Data Cleaning,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node11.html>, 1997 (1 page). |
Mobasher, “Pattern Discovery from Web Transactions,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node9.html>, 1997 (1 page). |
Mobasher, “Preprocessing Tasks,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node10.html>, 1997 (1 page). |
Mobasher, “A Taxonomy of Web Mining,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node2.html>, 1997 (1 page). |
Mobasher, “Agent-Based Approach,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node4.html>, 1997 (2 pages). |
Mobasher, “Web Content Mining,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node3.html>, 1997 (1 page). |
Mobasher, “DataBase Approach,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node5.html>, 1997 (2 pages). |
Mobasher, “Introduction,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node1.html>, 1997 (2 pages). |
Mobasher, “Pattern Analysis Tools,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node8.html>, 1997 (1 pages). |
Mobasher, “Pattern Discovery Tools,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node7.html>, 1997 (1 pages). |
Mobasher, “Web Usage Mining,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node6.html>, 1997 (2 pages). |
Mobasher, “Discovery Techniques in Web Transactions,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node13.html>, 1997 (1 page). |
Mobasher, “Path Analysis,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node14.html>, 1997 (1 page). |
Mobasher, “Transaction Identification,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node12.html>, 1997 (1 page). |
Mobasher, “Association Rules,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node15.html>, 1997 (1 page). |
Mobasher, “Sequential Patterns,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node16.html>, 1997 (1 page). |
Mobasher, “Clustering and Classification,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node17.html>, 1997 (1 page). |
Mobasher, “Analysis of Discovered Patterns,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node18.html>, 1997 (1 page). |
Mobasher, “Visualization Techniques,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node19.html>, 1997 (1 page). |
Mobasher, “OLAP Techniques,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node20.html>, 1997 (1 page). |
Mobasher, “Data and Knowledge Querying,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node21.html>, 1997 (1 page). |
Mobasher, “Usability Analysis,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node22.html>, 1997 (1 page). |
Mobasher, “Web Usage Mining Architecture,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node23.html>, 1997 (1 page). |
Mobasher, “Research Directions,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node24.html>, 1997 (1 page). |
Mobasher, “Data Pre-Processing for Mining,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node25.html>, 1997 (1 page). |
Mobasher, “The Mining Process,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node26.html>, 1997 (1 page). |
Mobasher, “Analysis of Mined Knowledge,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node27.html>, 1997 (1 page). |
Mobasher, “Conclusion,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node28.html>, 1997 (1 page). |
Mobasher, “References,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node29.html>, 1997 (1 page). |
Mobasher, “About This Document,” retrieved from <http://maya.cs.edpaul.edu/˜mobasher/webminer/survey/node30.html>, 1997 (1 page). |
Mogul, “Efficient Use of Workstations for Passive Monitoring of Local Area Networks,” WRL Research Report 90/5, Western Research Laboratory, Jul. 1990 (29 pages). |
Mosaic Communications Corporation, “Welcome to Netscape,” retrieved from <http://www.hnehosting.com/mirrors/Origin_of_a_Browser/mcom.10.1994/home/welcome.htm1>, retrieved on May 24, 2006 (2 pages). |
Mulvenna et al., “The 'Soft-Push:' Mining Internet Data for Marketing Intelligence,” Working Conference: Electronic Commerce in the Framework of Mediterranean Countries Development, Ioannina, Greece (12 pages). |
Montgomery, “Using Clickstream Data to Predict WWW Usage,” Aug. 1999 (27 pages). |
Mueller, “InfoTicker Java Applet,” Google Groups, May 11, 1996, retrieved from <http://groups.google.com/group/comp.infosystems.www.announce/browse_thread/thread/cc . . . >, retrieved on May 2, 2006 (2 pages). |
Muquit, “WWW Homepage Access Counter and Clock!” retrieved from <http://www.muquit.com/muquit/software/Count/Count.html>, retrieved on May 24, 2006 (32 pages). |
Naor et al., “Secure Accounting and Auditing on the Web,” Computer Networks and ISDN Systems, vol. 30, 1998 (10 pages). |
Nardone, “The Modem Media Internet Reach and Involvement Scale (IRIS),” Modem Media, Feb. 1995, retreived from <http://web.archive.org/web/19961111095728/www.modernmedia.com/clippings/articles/iris>, retrieved on Jun. 8, 2005 (3 pages). |
National Defense University, “Information Operations Timeline,” retrieved from <http://www.jfsc.ndu.edu/schools_programs/jciws/iw/io_timeline.asp>, retrieved on May 24, 2006 (9 pages). |
Naughton, “The JAVA Handbook,” 1996 (446 pages). |
NCSA, “In the Beginning There was NCSA Mosaic . . . ” NCSA, retrieved from <http://www.ncsa.uiuc.edu/News/MosaicHistory/>, retrieved on Jun. 12, 2006 (15 pages). |
Net.Genesis et al., “Build a Web Site: The Programmer's Guide to Creating, Building, and Maintaining Web Presence,” 1995 (721 pages). |
Netscape, “Mosaic Communications Changes Name to “Netscape Communications Corporation,”” Netscape Communications Corporation, retrieved from <http://www.holgermetzger.de/netscape/NetscapeCommunicationsNewsRelease.htm>, retrieved on May 24, 2006 (2 pages). |
Netscape Communication and Sun Microsystems, “Sun and Netscape Announce JavaScript,” Dec. 4, 1995 (8 pages). |
Neumann, “Forum on Risks to the Public in Computers and Related Systems,” Risks-Forum Digest, vol. 17, Issue 83, Mar. 4, 1996 (11 pages). |
Nielsen, “Classic HTTP Documents,” 1998, retrieved from <http://www.w3.org/Protocols/Classic.html>, retrieved on May 24, 2006 (1 page). |
O'Connell, “A New Pitch: Advertising on the World Wide Web is a Whole New Ball Game,” Modern Media, May 1995, retrieved from <http://web.archive.org/web/19961111095738/www.modernmedia.com/clippings/articles/ne . . . >, retrieved on Jun. 8, 2005 (8 pages). |
Older Counter.html history, Older History of Changes, retrieved from <http://www.ualberta.ca/GEO/Counter.History.html>, retrieved on May 24, 2006, (8 pages). |
Ostermann, “Tcptrace Homepage,” tcptrace.org, retrieved from <http://www.tcptrace.org, retrieved on Jun. 12, 2006 (1 page). |
Ousterhout et al., “A Trace-Driven Analysis of the UNIX 4.2 BSD File System,” Computer Science Division, Electrical Engineering and Computer Sciences, University of California, Apr. 25, 1985 (30 pages). |
Padmanabhan et al., “Analysis of Web Site Usage Data: How Much Can We Learn About the Consumer from Web Logfiles?,” Working Paper IS-96-18, Dec. 1996 (33 pages). |
Paul, “Marketing on the Internet,” Journal of Consumer Marketing, vol. 13, No. 4, Aug. 1996 (17 pages). |
Perlman, “Asynchronous Design/Evaluation Methods for Hypertext Technology Development,” Hypertext '89 Proceedings, Nov. 1989 (21 pages). |
Pew, “Instant Java,” Sun Microsystems, Inc., 1996 (370 pages). |
Philip Morris, “Teenage Attitudes and Behavior Study Methodology 2006” (9 pages). |
Pierrakos et al., “Web Usage Mining as a Tool for Personalization: A Survey,” User Modeling and User-Adapted Interaction vol. 13, 2003 (62 pages). |
Pitkow et al., “A Simple Yet Robust Caching Algorithm Based on Dynamic Access Patterns,” Proceedings of the Second International WWW Conference, GVU Technical Report; VU-GIT-94-39, Jan. 1994 (8 pages). |
Pitkow et al., “Results From the First World-Wide Web User Survey,” Journal of Computer Networks and ISDN Systems, vol. 27, No. 2, 1994 (15 pages). |
Pitkow et al., “Using the Web as a Survey Tool: Results From the Second WWW User Survey,” Third International WWW Conference, GVU Technical Report: GVU-GIT-94-40, 1994 (12 pages). |
Pitkow et al., “Results From the Third World-Wide Web User Survey,”Graphics, Visualization, & Usability Center, Georgia Institute of Technology, 1995 (10 pages). |
Poler, “Improving WWW Marketing Through User Information and Non-Intrusive Communication,” Internet Profiles Corporation (I/PRO), received Nov. 16, 2000 (4 pages). |
Powell, “Tomorrow's Heavyweight?” Network World, vol. 15, No. 49, Dec. 7, 1998 (1 page). |
Internet Profiles Corporation, “I/PRO is First to Develop a Solution for Measuring Java Applets,” Apr. 12, 1996 (2 pages). |
Progressive Networks, Inc., “RealServer Administration and Content Creation Guide Version 4.0,” Progressive Networks, Inc., 1995-1997 (366 pages). |
Progressive Networks, Inc., “RealServer Administration and Content Creation Guide Version 3.0,” Progressive Networks, Inc., 1995-1996 (292 pages). |
Raggett, “HTML 3.2 Reference Specification,” W3C, 1997, retreived from <http://www.w3.org/TR/REC-htm132>, retrieved from Mar. 22, 2007 (49 pages). |
Realnetworks Inc., “RealServer Administration Guide Version 5.0,” 1995-1997 (262 pages). |
Realnetworks, “Real System 5.0 Security Features Whitepaper,” 1997 (10 pages). |
Regents of the University of California, “Changes to wwwstat: httpd Logfile Analysis Package,” 1994,1996, retrieved from <http://ftp.ics.uci.edu/pub/websoft/wwwstat/Changes>, retrieved on Jun. 12, 2006 (4 pages). |
Resonate, “Network Traffic Mangement, Database Traffic Management,” Resonate, Inc. 2005 (2 pages). |
Reuters, “Study Faults Online Ads for Kids, FTC Probes,” Googel Groups, Mar. 28, 1996 (3 pages). |
Rodley, “Writing JAVA Applets,” 1996 (438 pages). |
Rust et al, “An Audience Flow Model of Television Viewing Choice,” Marketing Science, vol. 3, No. 2, Spring 1984, 12 pages. |
Schmittlein, “Why Does the NBD Model Work?” Marketing Science, vol. 4, No. 3, Summer 1985 (1 page). |
Seshan et al., “SPAND: Shared Passive Network Performance Discovery,” Proceedings of the USENIX Symposium on Internet Techonoligies and Systems, Monterey, California, Dec. 1997 (13 pages). |
Shahabi et al., “Knowledge Discovery from Users Web-Page Navigation,” 1997 retrieved from <http://www.ict.griffith.edu.au/˜vlad/teaching/kdd.d/readings.d/shahabi97knowledge.pdf> (11 pages). |
Shepard, “TCP Packet Trace Analysis,” MIT/LCS/TR-494, MIT Laboratory for Computer Science, Feb. 1991 (70 pages). |
Siochi et al., “Computer Analysis of User Interfaces Based on Repetition in Transcripts of User Session,” ACM Transactions on Information System, vol. 9, No. 4, 1991 (27 pages). |
Staten, “Navigator Tricks Raise Concerns,” MacWeek, vol. 10, No. 11, Mar. 1996 (2 pages). |
Stengle, “Tying TV Advertising to Action: Leveraging the Second Screen to Raise the Effectiveness & Measurability of TV Advertising,” BlackArrow USA, 2012 (8 pages). |
Sukaviriya et al., “A Second Generation User Interface Design Environment: The Model and the Runtime Architecture,” Graphics, Visualization & Usability Center, Georgia Institute of Technology, Sep. 1992 (10 pages). |
Sunsite, “Hot Java README and Link to the Software on SunSITE,” SunSITE Software Information and Technology Exchange, retrieved from http://www.ibiblio.org/hotjava/>, retrieved on May 24, 2006 (1 page). |
Symantec, “Using Norton pcANYWHERE for DOS,” Symantec Corporation, 1994 (30 pages). |
“Tcpslice(8):—Linux Man p.,” retrieved from <http://www.die.net/doc/linux/man/man8/tcpslice.8.html>, retrieved on Jun. 12, 2006 (3 pages). |
Tapley et al., “The Official Gamelan Java Directory,” Earth Web, 1996 (6 pages). |
“Tcpslice—Linux Command—Unix Command,” 2006, retrieved from <http://linux.about.com/library/cmd/blcmd18/tcpslice.htm>, retrieved on Jun. 12, 2006 (3 pages). |
The Nielsen Company (US), LLC, “Complaint for Patent Infringement,” filed with the United States District Court for the Eastern District of Virginia Alexandra Division and transferred to the Norfolk Division on Mar. 15, 2011 (13 pages). |
Thielman, “Comcast Pushes VOD Reruns into the C3 Window,” Adweek, Dec. 2, 2013, retrieved from <http://www.adweek.comnews/television/comcast-pushes-vod-reruns-c3 . . . >, retrieved on Feb. 10, 2014 (1 page). |
Thomson Jr., “Creation of the NSFnet,” Commercialization of the Internet, 2000, retrieved from <http://johnthomson.org/j561/NSFcreate-4.html>, retrieved on May 24, 2006 (2 pages). |
Thomson Jr., “The Beginning of Commercialization of the NSFnet,” Commercialization of the Internet, 2000, retrieved from <http://johnthomson.org/j561/NSFcomm-5.html>, retrieved on May 24, 2006 (1 page). |
Thomson Jr., “Criticism of the NSF Grows,” Commercialization of the Internet, 2000, retrieved from <http://johnthomson.org/j561/NSFcriticism-6.html>, retrieved on May 24, 2006 (1 page). |
Thomson Jr., “The NSF Starts to Change Their Policy,” Commercialization of the Internet, 2000, retrieved from <http://johnthomson.org/j561/NSFpolicy-7.html>, retrieved on May 24, 2006 (1 page). |
Thomson Jr., Changes in NSF Policy Becomes Law—The Internet is Commercialized, Commercialization of the Internet, 2000, retrieved from <http://johnthomson.org/j561/NSFpolicy-7.html>, retrieved on May 24, 2006 (1 page). |
tcpdump.org, “Tcpdump—dump traffic on a network,” retrieved from <http://www.tcpdump.org/tcpdump_man.html>, retrieved on Jun. 12, 2006 (26 pages). |
Tolle, “Performance Measurement and Evaluation of Online Information Systems,” Proceedings of the 1985 ACM Computer Science Conference-Agenda for Computing Research:The Challenge for Creativity, Mar. 12-14, 1985 (8 pages). |
“Tradewinds,” Harvard Business School, vol. 2, No. 5, May 1995 (11 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/866,158, dated Sep. 23, 2016 (8 pages). |
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 12/100,685, dated Nov. 16, 2009 (9 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/100,685, dated Feb. 12, 2009 (15 pages). |
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 09/763,338, dated Jul. 12, 2007 (20 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/100,698, dated Jan. 20, 2010 (18 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/100,698, dated Sep. 25, 2009 (17 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/780,890, dated Oct. 1, 2010 (9 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 13/098,358, dated Jul. 27, 2011 (10 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 09/763,338, dated Nov. 21, 2006 (18 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 12/100,698, dated Feb. 25, 2011 (12 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 12/100,698, dated Oct. 20, 2010 (11 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 12/780,890, dated Mar. 22, 2011 (12 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 13/098,358, dated Dec. 13, 2011 (12 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 09/763,338, dated Jan. 2, 2008 (7 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/313,390, dated Jul. 7, 2015 (8 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/313,390, dated Jan. 22, 2015 (9 pages). |
United States Patent and Trademark Office, “Requirement for Restriction/Election,” issued in connection with U.S. Appl. No. 09/763,338, dated Aug. 1, 2006 (6 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/618,658, dated Oct. 26, 2015 (9 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/044,939, dated Apr. 29, 2016 (8 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/044,939, dated Apr. 28, 2016 (9 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/359,129 dated Apr. 5, 2017 (9 pages). |
User Society, “First International Conference on the World-Wide Web,” May 1994, retrieved from <http://www.94.web.cern.ch/WWW94/>, retrieved on May 24, 2006 (2 pages). |
w3.org, “CGI—Common Gateway Interface,” W3C, retrieved from <http://www.w3.org/CGI/>, retrieved on May 24, 2006 (2 pages). |
w3.org, “HTTP: A Protocol for Network Information: Basic HTTP as Defined in 1992,” W3C, retrieved from <http://www.w3.org/Protocols/HTTP/HTTP2.html>, retrieved on May 24, 2006 (2 pages). |
w3.org, “The World Wide Web Servers: W3 Servers,” retrieved from <http://www.w3.org/History/19921103-hypertext/hypertext/DataSources/WWW/Servers.html>, retrieved on May 24, 2006 (2 pages). |
w3.org, “The World Wide Web Project,” retrieved from <http://www.w3.org/History/19921103-hypertext/hypertext/www/html>, retrieved on May 24, 2006 (1 page). |
w3.org, “Demonstrations—/JENC92,” retrieved from <http://www.w3.org/Conferences/JENC92/Demonstrations.html>, retrieved on May 24, 2006 (1 page). |
w3.org, “An Updated Quick Look at Viola WWW,” W3C, retrieved from <http://www.w3.org/History/19921103-hptertext/Viola/Review.html>, retrieved on May 24, 2006 (4 pages). |
w3.org, “HyperText Transfer Protocol Design Issues,” W3C, retrieved from <http://www.w3.org/Protocols/DesignIssues.html>, retrieved on May 24, 2006 (3 pages). |
w3.org, “WorldWideWeb for C5,” Presentation, May 17, 1991, retrieved from <http://www.w3.org/Talks/C5_17_May_91.html>, retrieved on May 24, 2006 (1 page). |
w3.org, “Change History for httpd,” W3C, retrieved from <http://www.w3.org/Daemon/Features.html>, retrieved on May 24, 2006 (15 pages). |
W3C, “A Little History of the Word Wide Web (1945-1995),” retrieved from <http://www.w3.org/History.html>, retrieved on May 24, 2006 (6 pages). |
Wandschneider, “ActiveX Controls Framework: Sample Code for Authoring Non-MFC Controls,” Microsoft Corporation, Apr. 1996, retrieved from <http://msdn.microsoft.com/archive/en-us/dnaractivex/html/msdn_ctrlfmk.asp?frame=true>, retrieved on Mar. 22, 2007 (15 pages). |
Warren, “Audience Tracking System for Electronic Newspapers” Google Groups, May 3, 1995 (3 pages). |
Watt, “Management Tools Get with the Web,” Network World, vol. 14, No. 25, Jun. 23, 1997 (1 page). |
Weber, “New Software Helps Advertisers Get Through Tangled Web Pages,” The Wall Street Journal, Oct. 1996 (2 pages). |
Websidestory and AIG, “On Demand Analytics Presentation,” Jun. 22, 2005 (10 pages). |
Weiler et al., “Usability Lab Tools: One Year Later,” CHI'94, Conference Companion, 1994, p. 330 (1 page). |
Weston, “Netscape 2.0b2 allows for invasion of privacy,” TBTF, Dec. 2, 1995, retrieved from <http://www.tbtf.com/resource/b2-privacy-bug.html>, retrieved on May 24, 2006 (2 pages). |
Wilson, “Browser Timelines (Releases Important to HTML and CSS Development = Index DOT Html/Css,” retrieved from <http://www.blooberry.com/indexdot/history/browsers6.htm> retrieved on May 24, 2006 (3 pages). |
Wilson, “Opera (Opera Software) Index DOT Html/Css,” retrieved from <http://www.blooberry.com/indexdot/history/opera.htm> retrieved on May 24, 2006 (3 pages). |
Wright, “Matt's Script Archive: Book'em Dano:Readme,” 1996 (2 pages). |
Wu et al., “Virtual Proxy Servers for WWW and Intelligent Agents on the Internet,” Proceedings of the Thirtieth Annual Hawaii International Conference on System Sciences, 1997 (10 pages). |
Yahoo!, “Yahoo! Search Directory > Web Programming > Access Counters,” retrieved from <http://dir.yahoo.com/Computers_and_Internet/Internet/World_Wide_Web/Programming/Access_Counters/>, retrieved from May 24, 2006 (5 pages). |
Zaiane et al., “Discovering Web Access Patterns and Trends by Applying OLAP and Data Mining Technology on Web Logs,” Research and Technology Advances in Digital Libraries, Apr. 1998 (12 pages). |
Zeigler, “Startup Net Count Seeks to Tally How Many Web Surfers See Ads,” The Wall Street Journal, Oct. 1996 (2 pages). |
Zillmer, “How to Make Your Web Ads Pay Off,” Marketing Magazine, vol. 101, No. 23, Jun. 10, 1996 (4 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/866,158, dated May 19, 2017, 18 pages. |
Australian Patent Office, “Patent Examination Report No. 1”, issued in connection with Australian patent application No. 2014203758, dated May 12, 2015, 3 pages. |
Australian Patent Office, “Notice of Acceptance”, issued in connection with Australian patent application No. 2014203758, dated Apr. 29, 2016, 3 pages. |
Australian Patent Office, “Certificate of Grant”, issued in connection with Australian patent application No. 2014203758, dated Aug. 25, 2016, 1 pages. |
Canadian Patent Office, “Office action”, issued in connection with Canadian patent application No. 2,856,246, dated Sep. 28, 2015, 5 pages. |
Canadian Patent Office, “Office action”, issued in connection with Canadian patent application No. 2,856,246, dated May 5, 2017, 3 pages. |
The State Intelluactual Property Office of China, “First Notification of Office action”, issued in connection with Chinese patent application No. 201410341892.1, dated Aug. 17, 2016, 8 pages. |
European Patent Office, “Extended European Search Report”, issued in connection with European patent application No. 14002366.4, dated Nov. 27, 2014, 9 pages. |
The State Intellectual Property Office of China,“Second Notification of Office action”, issued in connection with Chinese patent application No. 201410341892.1, dated Jun. 5, 2017, 8 pages. |
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 15/359,129, dated Jun. 29, 2017, 21 pages. |
Australian Patent Office, “Examination Report No. 1”, issued in connection with Australian patent application No. 2016213749, dated Jul. 10, 2017, 2 pages. |
United States Patent and Trademark Office, “Non-Final Office action”, issued in connection with U.S. Appl. No. 14/313,457, dated Jul. 14, 2017, 13 pages. |
Raghunathan et al. “A Unified Imputation Approach for the treatment and Analysis of Missing Data in Marketing Research” Feb. 1999, 43 pages. |
Reiter “Simultaneous Use of Multiple Imputation for Missing Data and Disclosure Limitation” Sep. 29, 2011, 20 pages. |
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 14/866,158, dated Nov. 30, 2017, 14 pages. |
United States Patent and Trademark Office, “Non-final Office Action,” issued in connection with U.S. Appl. No. 15/385,508, dated Dec. 4, 2017, 16 pages. |
Lane, “Basic Concepts,” available at http://www.onlinestatbook.com/2/probability/basic.html, retrieved Feb. 28, 2018 (6 pages). |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/866,158, dated Mar. 30, 2018, 37 pages. |
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 15/385,508, dated May 30, 2018, 28 pages. |
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/385,508, dated Aug. 28, 2018, 31 pages. |
Dempster et al., “Maximum Likelihood from Incomplete Data via the EM Algorithm,” Journal of the Royal Statistical Society, Series B (Methodological), vol. 39, No. 1. (1977), pp. 1-38, http://links.jstor.org/sici?sici=0035-9246%281977%2939%3A1%3C1%3AMLFIDV%3E2.0.CO%3B2-Z. |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/044,939, dated Aug. 29, 2016 (8 pages). |
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/866,158, dated Nov. 8, 2018 (7 pages). |
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 15/385,508, dated Jan. 14, 2019, 37 pages. |
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 15/385,508, dated Apr. 21, 2020, 42 pages. |
Number | Date | Country | |
---|---|---|---|
20190158921 A1 | May 2019 | US |
Number | Date | Country | |
---|---|---|---|
62130286 | Mar 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14866158 | Sep 2015 | US |
Child | 16261035 | US |