Methods and apparatus for crediting a media presentation device

Information

  • Patent Grant
  • 10924788
  • Patent Number
    10,924,788
  • Date Filed
    Tuesday, April 28, 2020
    3 years ago
  • Date Issued
    Tuesday, February 16, 2021
    3 years ago
Abstract
Methods and apparatus for crediting a media presentation device are disclosed. Example apparatus disclosed include means for computing a signature from audio obtained from a media device, means for determining an on/off state of the media device based on a gain level, means for crediting the media device with presenting media when (1) the signature matches at least one of a set of reference signatures and the on/off state determined for the media device is an on state, and (2) when the signature matches at least one of the set of reference signatures and the on/off state determined for the media device is an off state, the means for crediting to not credit the media device with presenting the media when (3) the signature does not match at least one of the set of reference signatures and the on/off state determined for the media device is the off state.
Description
FIELD OF THE DISCLOSURE

The present disclosure relates generally to audience measurement and, more particularly, to methods and apparatus for crediting a media presentation device.


BACKGROUND

Media ratings and other audience metering information are typically generated by collecting media exposure information from a group of statistically selected households. Each of the statistically selected households, also called metered households, typically has a data logging and processing unit commonly referred to as a “home unit,” “meter” or “audience measurement device.” In metered households or, more generally, metering sites having multiple media presentation devices, the data logging and processing functionality may be distributed among a single home unit and multiple site units, where one site unit may be provided for each media presentation device or media presentation area and provides data to the home unit for processing and/or communicating to a central processing site. The home unit (or the combination of the home unit and the site units) includes sensors to gather data from the monitored media presentation devices (e.g., audio-video (AV) devices) at the selected site.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram of an example media monitoring system constructed in accordance with the teachings of this disclosure to credit media presentation to a media presentation device.



FIG. 2 is a block diagram of an example audience measurement device in communication with an example media creditor as illustrated in FIG. 1.



FIG. 3 is a block diagram of another example audience measurement device in communication with another example media creditor as illustrated in FIG. 1.



FIG. 4 illustrates a time period representative of crediting media presentations and/or non-presentations to a media presentation device during in an example process to perform crediting.



FIG. 5 is a flowchart representative of example machine readable instructions that may be executed to implement the example audience measurement device of FIGS. 1-3.



FIG. 6 is a flowchart representative of example machine readable instructions that may be executed to implement the example media creditor of FIGS. 1-3.



FIG. 7 is a flowchart representative of example machine readable instructions that may be executed to implement the example media creditor and/or the example audience measurement device of FIGS. 1-3 to process captured audio.



FIG. 8 is a block diagram of an example processor system that may be used to execute the example machine readable instructions of FIGS. 5-7 to implement the example audience measurement devices and/or the example media creditors of FIGS. 1-3.





DETAILED DESCRIPTION

Certain examples are shown in the above-identified figures and described in detail below. In describing these examples, like or identical reference numbers are used to identify common or similar elements. Although the example systems and apparatus described herein include, among other components, software executed on hardware, such systems and apparatus is merely illustrative and should not be considered as limiting. Any or all of the disclosed components could be embodied exclusively in hardware, exclusively in software, exclusively in firmware or in some combination of hardware, firmware or software.


Metering data providing an accurate representation of the exposure to media content of persons in metered households is useful in generating media ratings of value to advertisers and/or producers of media content. Generating accurate metering data has become difficult as the media presentation devices have become more complex in functionality and interoperability.


Some existing methods for crediting metered environments with media exposure include connecting a metering device to a media presentation device (e.g., a television) in the metered environment and/or to sources of media (e.g., set top boxes, game consoles, etc.). Connecting and configuring the metering devices can be costly and time-consuming. Other existing methods include equipping each person in a metered environment with a personal meter to capture audio codes from ambient sounds. Personal meters are prone to being left in a different location than the associated person, and can result in inaccurate measurements. Still other existing methods include obtaining set top box data from multi-system operators, such as cable and/or satellite delivery systems. However, such information may be proprietary and/or may result in skewed data due to the differing characteristics of the customers of each type of delivery system. For example, customers of cable providers are statistically likely to watch different types of shows than customers of satellite providers. Extrapolating set top box data (or equivalent data) from multi-system operators to a general population may result in inaccurate measurements.


Furthermore, the previously-known technologies to detect the on state or the off state of a media presentation device, as discussed above, are complex to set up by a person without additional training (e.g., in locating the additional sensors properly to obtain a signal) and/or are expensive to build and/or transport (e.g., because additional components add cost and weight), which may reduce the number of participants capable of being included in a metering project. Acquiring data from other sources (e.g., purchasing set top box data from a multi-system operator) may be prohibitively expensive and/or statistically misrepresentative.


Against this backdrop, methods, apparatus, and articles of manufacture to capture data regarding media exposure (e.g., television viewing habits of person(s) in metered households) and to credit metered locations and/or devices with media presentation, exposure, and/or consumption are disclosed herein.


One example method of crediting media content as being presented by a media presentation device includes capturing ambient audio from the location of the media presentation device and, based on the ambient audio: 1) identifying information encoded in the ambient audio (e.g., watermarks, codes, etc.), 2) generating signatures of the ambient audio for comparison with signatures of known media, and/or 3) determining whether the media presentation device is in an on state or an off state based on the ambient audio). In some examples, the recognition of embedded code(s) during a time period overrides a determination that the media presentation device is in an off state during the same time period, and enables the media presentation device to be credited with the media corresponding to the embedded code(s).


As used herein, media may refer to any type of audio and/or visual media including, but not limited to, television programs, advertisements, movies, video games, time-shifted programs, on-demand programs, and/or any other type of audio and/or video content and/or non-content media. Furthermore, the term media may refer to portions of and/or the entireties of such audio and/or visual media.


Example methods disclosed herein include obtaining ambient audio for a time period from a location including a media presentation device, detecting encoded information present in the ambient audio, crediting a first portion of the time period for the media presentation device to first media based on the encoded information, determining an on/off state of the media presentation device for a second portion of the time period different than the first portion based on the ambient audio, and crediting the second portion of the time period based on the on/off state of the media presentation device.


Some example methods further include computing a signature of the ambient audio corresponding to a third portion of the time period different from the first and second portions and crediting the third portion of the time period to the first media or to second media based on the signature. Some such example methods further include comparing the signature to a second signature, wherein crediting the third portion of the time period to the first media or to second media is based on the comparison. In some such examples, crediting the first portion based on the encoded information is performed before crediting the third portion based on the signature, and crediting the third portion is performed prior to crediting the second portion based on the on/off state of the media presentation device. In some such example methods, crediting the third portion based on the signature comprises overriding a determination that the media presentation device is in an off state during the third portion with a determination that the media presentation device is in an on state based on a comparison of the signature to a reference signature.


In some examples, crediting the second portion comprising assigning an off state to the second portion. In some example methods, crediting the first portion comprises overriding a determination that the media presentation device is in an off state during the first portion with a determination that the media presentation device is in an on state based on detecting the encoded information. In some example methods, obtaining the ambient audio comprises recording the ambient audio at the location.


In some examples, obtaining the ambient audio comprises receiving a data file including the ambient audio. In some example methods, detecting the encoded information comprises extracting a steganographically encoded watermark. In some examples, determining the on/off state of the audience measurement device is based only on the ambient audio.


Example apparatus disclosed herein include a code detector, an on/off detector, and a location creditor. The example code detector detects encoded information present in ambient audio collected from a monitored location. The example on/off detector determines a first portion of a time period during which a media presentation device in the monitored location is in an on state and determines a second portion of the time period during which the media presentation device is in an off state based on the ambient audio. The example location creditor credits a third portion of the time period for the media presentation device to first media based on the encoded information and credits a fourth portion of the time period different from the third portion based on the on state or the off state of the media presentation device during the fourth portion of the time period.


Some example apparatus further include a microphone to collect the ambient audio in the location including the media presentation device during a time period. Some example apparatus further include a network interface to receive the ambient audio via a network. Some example apparatus further include a signature generator to generate a signature of a portion of the ambient audio, the location creditor to credit a fifth portion of the time period based on the signature. In some such examples, the location creditor credits the third portion based on the encoded information prior to crediting the fifth portion based on the signature and credits the fifth portion prior to crediting the fourth portion based on the on state or the off state of the media presentation device.


Some other example methods disclosed herein include obtaining encoded information extracted from ambient audio, the ambient audio being recorded during a time period in a location including a media presentation device, crediting a first portion of the time period for the media presentation device to first media based on the encoded information, obtaining an on/off state of the media presentation device for a second portion of the time period different than the first portion, the on/off state being based on the ambient audio, and crediting the second portion of the time period based on the on/off state of the media presentation device.


In some examples, obtaining the encoded information includes receiving the encoded information in a data file from an audience measurement device located in the location. Some example methods further include obtaining a characterization of the ambient audio corresponding to a third portion of the time period different from the first and second portions, and crediting the third portion of the time period to the first media or to second media based on the signature. In some such example methods, obtaining the characterization comprises receiving a digital signature in the data file from an audience measurement device located in the location.


Some disclosed example apparatus include a processor and a memory storing computer readable instructions. When executed, the computer readable instructions cause the processor to access encoded information extracted from ambient audio, the ambient audio being recorded during a time period in a location including a media presentation device, credit a first portion of the time period for the media presentation device to first media based on the encoded information, access an on/off state of the media presentation device for a second portion of the time period different than the first portion, the on/off state being based on the ambient audio, and credit the second portion of the time period based on the on/off state of the media presentation device.


In some such example apparatus, the instructions are to cause the processor to access the encoded information in a data file received from an audience measurement device located in the location. In some examples, the instructions further cause the processor to access a characterization of the ambient audio corresponding to a third portion of the time period different from the first and second portions and credit the third portion of the time period to the first media or to second media based on the signature. In some such examples, the instructions are to cause the processor to access a digital signature in a data file received from an audience measurement device located in the location.


Some disclosed example methods include obtaining ambient audio for a time period from a location including a media presentation device, computing a signature of the ambient audio, crediting a first portion of the time period for the media presentation device to first media based on the signature, determining an on/off state of the media presentation device for a second portion of the time period different than the first portion based on the ambient audio, and crediting the second portion of the time period based on the on/off state of the media presentation device. Some example methods further include comparing the signature to a second signature, wherein crediting the first portion of the time period to the first media is based on the comparison.


Some disclosed example apparatus include a signature generator, an on/off detector, and a location creditor. The example signature generator computes a signature of ambient audio collected from a monitored location. The on/off detector determines a first portion of a time period during which a media presentation device in the monitored location is in an on state and determines a second portion of the time period during which the media presentation device is in an off state based on the ambient audio. The example location creditor credits a third portion of the time period for the media presentation device to first media based on the signature and credits a fourth portion of the time period different from the third portion based on the on state or the off state of the media presentation device during the fourth portion of the time period. In some such example apparatus the location creditor compares the signature to a reference signature associated with the first media, wherein crediting the third portion of the time period is based on the comparison.


Some disclosed example methods include obtaining a characterization of ambient audio, the ambient audio being recorded during a time period in a location including a media presentation device, crediting a first portion of the time period for the media presentation device to first media based on the characterization, obtaining an on/off state of the media presentation device for a second portion of the time period different than the first portion, the on/off state being based on the ambient audio, and crediting the second portion of the time period based on the on/off state of the media presentation device. In some examples, obtaining the characterization includes accessing a digital signature in a data file received from the media presentation device. Some example methods further include comparing the characterization to a reference characterization, wherein crediting the first portion is based on the comparison.


Some disclosed example apparatus include a processor and a memory. The example memory stores computer readable instructions which, when executed, cause the processor to access a characterization of ambient audio, the ambient audio being recorded during a time period in a location including a media presentation device, credit a first portion of the time period for the media presentation device to first media based on the characterization, access an on/off state of the media presentation device for a second portion of the time period different than the first portion, the on/off state being based on the ambient audio, and credit the second portion of the time period based on the on/off state of the media presentation device. In some examples, the instructions are to cause the processor to access the characterization from a data file received from the media presentation device. In some examples, the instructions are further to cause the processor to compare the characterization to a reference characterization, wherein crediting the first portion is based on the comparison.


Referring to FIG. 1, a media content provider 102 provides content to an audience via one or more information presentation devices, such as a set top box 104 and a television 106. The components of the media presentation system may be coupled in any manner. In the illustrated example, the television 106 is positioned in a monitored area 120 located within a household occupied by one or more people, represented by a person 122, some or all of whom have agreed to participate in an audience measurement research study. The monitored area 120 includes the area in which the television 106 is located and from which the one or more household member(s) 122 located in the monitored area 120 may view the television 106.


The media content provider 102 may convey the media content to a metered household 120 via a cable network, a radio transmitter or one or more satellites. For example, the media content provider 102 may be a cable television provider distributing the television programs exclusively via a cable network or a satellite provider distributing media via satellite. The media content provider 102 may transmit media signals in any suitable format, such as a National Television Standards Committee (NTSC) television signal format, a high definition television (HDTV) signal format, an Association of Radio Industries and Businesses (ARIB) television signal format, etc.


In the example of FIG. 1, an audience measurement system 100 is used to collect audience measurement data concerning media activity associated with the metered household. A metered household may include one or more monitored areas 120. To this end, the audience measurement system 100 includes an audience measurement device 108 to collect media presentation information associated with one or more media device(s) (e.g., the set top box 104 and the television 106) in the monitored area 120. In the example of FIG. 1, the audience measurement device 108 collects presentation information including ambient audio (e.g., via one or more microphones) and/or audience member identification (e.g., via audience member log-ins and/or audience member prompt suppression). The audio recorded via the microphone(s) of the example audience measurement device 108 may include ambient audio signals from the monitored media presentation device (e.g., the television 106) and/or background noise from within the monitored area 120. For example, the ambient audio may comprise audio signal(s) reflecting humanly audible and/or humanly inaudible sounds within the household recorded via microphone(s) coupled to or included in the audience measurement device 108. Additionally or alternatively, the audience measurement device 108 may collect information including signals (e.g., infrared, radio frequency, etc.) generated by a remote control device 112.


The example audience measurement device 108 of FIG. 1 provides the presentation information, which may include recorded or captured audio, detected codes associated with the ambient audio, digital signatures representative of the ambient audio, tuning and/or demographic information, etc. for evaluation in a back office 130. In some examples, the audience measurement device 108 processes captured audio information to generate the presentation information. In some other examples, the audience measurement device transmits the captured audio to the back office 130 for processing. In the example of FIG. 1, the audience measurement device 108 transmits the presentation information via a data return path, such as cellular communications and/or wireless data communications, to the back office 130 for evaluation.


In the example of FIG. 1, the information collected by the audience measurement device 108 is processed and/or stored in the back office 130 to produce ratings information. The example back office 130 of FIG. 1 includes a media creditor 132 to credit the television 106, the monitored area 120, and/or the person 122 with media presentation. The media creditor 132 and the audience measurement device 108 of FIG. 1 cooperate to identify codes or watermarks embedded in the ambient audio, generate signatures of the ambient audio, compare the generated signatures with reference signatures of known media, and/or determine whether the media presentation device is in an on state or an off state based on the ambient audio. Based on these factors, the example media creditor 132 credits the media presentation device 106, the monitored area 120, and/or the person 122 during the time period represented by the ambient audio with media.



FIG. 2 is a block diagram of an example audience measurement device 202 in communication with an example media creditor 204 to implement the audience measurement system 100 of FIG. 1. The example audience measurement device 202 of FIG. 2 may be used to implement the audience measurement device 108 and the example media creditor 204 of FIG. 2 may be used to implement the media creditor 132 at the back office 130 of FIG. 1.


The example audience measurement device 202 of FIG. 2 includes one or more microphones 206, an automatic gain controller 210, and a data file generator 212. The example microphone 206 records ambient audio from a location within which the audience measurement device 202 is located. For example, the audience measurement device 202 may be configured such that the microphone 206 reliably captures audio output from a media presentation device (e.g., the presentation device 106 of FIG. 1) to be monitored.


The example automatic gain controller (AGC) 210 of FIG. 2 receives the captured audio signals and applies an automatic gain algorithm to boost the signal levels based on the level (e.g., energy, amplitude) of the input signal. The example AGC 210 outputs the boosted signals and the amount of gain applied to the data file generator 212. The example data file generator 212 of FIG. 2 generates a data file that includes the captured audio. In some examples, the data file further includes an indication of the gain applied by the AGC 210. The example data file generator 212 includes time stamps corresponding to the captured audio and/or to the gain levels to enable correlation of the audio with particular times (e.g., to credit the media presentation device with media presentation for the proper time periods).


The example data file generator 212 outputs the data file to an input database 214 via a return path interface 216. The example input database 214 of FIG. 2 obtains data files from multiple audience measurement devices for retrieval and processing by the media creditor 204. The example return path interface 216 of FIG. 2 may include any type of communications interface, such as a cellular radio or wireless local area network (WLAN) radio. In the example of FIG. 2, the return path interface 216 communicates with the input database 214 via a cellular data connection to an Internet protocol (IP) network to reduce or eliminate any dependency of the return path to the media creditor 304 on WLAN infrastructure of the location being monitored.


The example media creditor 204 of FIG. 2 obtains the data file including captured ambient audio from the monitored area 120 (e.g., from the input database 214, from the data file generator 212) via a network interface 218 and credits the monitored location associated with the audience measurement device 202 (e.g., the monitored location 120 of FIG. 1). To accurately credit the location based on the data file, the example media creditor 204 includes a code detector 220, a signature generator 222, an on/off detector 224, and a location creditor 226. The network interface 218 provides the received data file to each of the example code detector 220, the example signature generator 222, and the example on/off detector 224 to process the data file (e.g., process the audio).


The example code detector 220 of FIG. 2 detects embedded codes (e.g., steganographically embedded codes, watermarks, and/or other auxiliary data) present in the captured audio in the data file. The embedded codes may include information describing the media being presented, the channel being watched, and/or other audience measurement information. The example code detector 220 outputs the detected codes to the location creditor 226 to credit the media presentation device 106 with the media identified in the code(s).


The example code detector 220 may use any method(s) for detecting codes embedded in audio for audience measurement. In some cases, multiple embedded codes are present in a given block of audio and may be extracted using different techniques. Examples of techniques that may be used to extract embedded codes (e.g., watermarks) from the audio are described in U.S. patent application Ser. No. 12/249,619, assigned to The Nielsen Company (US), LLC, filed on Oct. 10, 2008; in U.S. patent application Ser. No. 12/361,991, assigned to The Nielsen Company (US), LLC, filed on Jan. 29, 2009; in U.S. Pat. No. 6,421,445, assigned to Arbitron Inc., issued on Jul. 16, 2002; and/or in U.S. Pat. No. 6,272,176, assigned to The Nielsen Company (US), LLC, issued on Aug. 7, 2001. The methods described in these patents and applications are merely examples, and any other method(s) may be used in addition and/or as an alternative to these methods.


The extracted embedded codes or watermarks may be identified using a code database 228 including a library of codes. In some examples, the codes in the code database 228 include information identifying media into which the codes have been inserted or embedded. The example location creditor 226 may determine whether an extracted code corresponds to a code that has been inserted into audio by querying the code database 228 for the extracted code. If the extracted code (or a code within an error range of the extracted code) is found, the example location creditor 226 may identify the extracted code as corresponding to the media of the code in the code database 228.


The example signature generator 222 generates signatures of the captured audio in the data file. The generated signatures may be compared to reference signatures to match the audio to known media. The example media creditor 204 of FIG. 2 receives the reference signatures from a reference signature database 230. Signature matching may be used to credit media presentation to portions of time in which embedded codes are not detected and/or are not recognizable.


The example signature generator 222 may use any method(s) for characterizing audio (e.g., generating signatures of audio) and/or comparing generated signatures to reference signatures. In some cases, multiple signatures using different techniques. Examples of techniques that may be used to extract embedded codes (e.g., watermarks) from the audio are described in U.S. Pat. No. 8,060,372, assigned to The Nielsen Company (US), LLC, issued on Nov. 15, 2011; in U.S. patent application Ser. No. 12/110,951, assigned to The Nielsen Company (US), LLC, filed on Apr. 28, 2008; and/or U.S. patent application Ser. No. 12/266,380, assigned to The Nielsen Company (US), LLC, filed on Nov. 6, 2008. The methods described in these patents and applications are merely examples, and any other method(s) to generate signatures may be used in addition and/or as an alternative to these methods to implement the signature generator 222.


The example on/off detector 224 of FIG. 2 determines when the media presentation device 106 is in an on state and/or when the media presentation device 106 is in an off state during the time period represented by the audio in the data file. To determine the on state(s) and/or the off state(s), the example on/off detector 224 uses, for example, fuzzy logic, rules, or heuristics to make inferences regarding the on/off state of the media presentation device 106. In some examples, the on/off detector 224 determines the on/off state of the media presentation device 106 based only on the captured audio, where processing of the audio (e.g., gain levels, statistics of the audio) are considered to be based on the captured audio. For example, the on/off detector 224 may determine, for a given portion of the time period, whether the media presentation device 106 is in an on state or an off state based on the gain level applied by the AGC 210 and/or based on processing the audio, without measuring power drawn by the media presentation device 106. An example method to implement the on/off detector 224 of FIG. 2 is described in U.S. Pat. No. 8,180,712, assigned to The Nielsen Company (US), LLC, issued on May 15, 2012. However, other methods of audio-based on/off detection may additionally or alternatively be used.


The example location creditor 226 of FIG. 2 receives extracted codes (e.g., from the code detector 220), generated signatures representative of the audio (e.g., from the signature generator 222), and/or determinations of the on state periods and/or the off state periods of the media presentation device 106 (e.g., from the on/off detector 224). Based on the received codes, signatures, and determinations, the example location creditor 226 credits the media presentation device 106 with the appropriate media presentations during the time period represented by the data file.


In the example of FIG. 2, the location creditor 226 overrides determinations of an off state by the on/off detector 224 when extracted codes and/or matching signatures from the audio in the data file indicates that media being presented by the media presentation device 106 during a corresponding time. For example, the location creditor 226 may credit the time periods for which a code is extracted and for which matching signatures are found prior to crediting time periods based on on/off detection information.


The example location creditor 226 outputs the crediting information for the time period represented by the captured audio. The crediting information may be stored and/or aggregated with crediting information for other time periods and/or other audience measurement devices to, for example, generate ratings information.



FIG. 3 is a block diagram of another example audience measurement device 302 in communication with another example media creditor 304 to implement the audience measurement system 100 of FIG. 1. The example audience measurement device 302 of FIG. 3 may be used to implement the audience measurement device 108 and the example media creditor 304 of FIG. 3 may be used to implement the media creditor 132 at the back office 130 of FIG. 1.


In contrast to the example audience measurement device 202 of FIG. 2, the example audience measurement device 302 of FIG. 3 generates a data file including extracted codes, generated signatures, and/or on/off detection information. The example media creditor 304 may then perform the crediting of the location based on the information received via the data file.


The example audience measurement device 302 of FIG. 3 includes one or more microphones 206, an AGC 210, a data file generator 212, a return path interface 216, a code detector 220, a signature generator 222, and an on/off detector 224. Because many of the elements of FIG. 3 are similar to elements in the example of FIG. 2, like reference numbers are used to refer to like elements. This numbering convention is employed throughout this description to reduce redundant description.


The example microphone 206 of FIG. 3 captures ambient audio from a media presentation device to be measured (e.g., the media presentation device 106 of FIG. 1). The microphone 206 outputs an electrical signal representative of the audio to the AGC 210, which applies a gain to the electrical signal based on the level (e.g., the energy, the amplitude, etc.) of the captured audio. In contrast to the AGC 210 of FIG. 2, which outputs the amplified signal and the gain level to the data file generator 212, the example AGC 210 of FIG. 3 outputs the audio and/or the gain level to the code detector 220, the signature generator 222, and the on/off detector 224. In some examples, the AGC 210 also provides the amplified signal to the data file generator 212 for inclusion (e.g., storage) in a data file generated by the data file generator 212.


The example data file generator 212 of FIG. 3 receives outputs from the example code detector 220, the example signature generator 222, and the example on/off detector 224. For example, the code detector 220 of FIG. 3 extracts codes embedded in the captured audio and provides the codes to the example data file generator 212. The example signature generator 222 of FIG. 3 generates signatures representative of the captured audio and provides the generated signatures to the example data file generator 212. The example on/off detector 224 of FIG. 3 determines periods of time during which the media presentation device 106 is in an on state and periods of time during which the media presentation device 106 is in on off state, and provides the determinations and/or the time periods to the example data file generator 212.


The example data file generator 212 of FIG. 3 generates a data file including extracted codes or watermarks, generated signatures, and/or on state and/or off state determinations for the media presentation device 106. As mentioned above, the example data file generator 212 may further include the captured audio and/or the gain levels. The audience measurement device 302 transmits the data file via the return path interface 216 to an input database 214, which stores the data file for retrieval by the media creditor 304.


The example media creditor 304 of FIG. 3 includes a network interface 218 and a location creditor 226. The example network interface 218 receives the data file from the input database 214 and/or from the return path interface 216. Based on the data file, the location creditor 226 credits the media presentation device 106 with media presentations based on the extracted codes, the generated signatures, and/or the on/off state determinations. In the example of FIG. 3, the location creditor 226 compares the generated signatures in the data file to signatures from a reference signature database 230 to identify media represented by the generated signatures. The example location creditor 226 outputs the crediting of the media presentation device 106 to, for example, generate television ratings information.


In the example of FIG. 3, the location creditor 226 first applies extracted codes (e.g., watermarks) in the data file to credit the media presentation device 106. For portions of a time period represented by the data file in which codes are not recognized, the example location creditor 226 of FIG. 3 determines whether the signatures corresponding to those portions match reference signatures. The example location creditor 226 of FIG. 3 credits the media presentation device 106 for the portions of the time period based on matching signatures. For portions of the time period that cannot be credited based on either codes or signatures (e.g., the remaining portions of the time period), the example location creditor 226 credits the media presentation device 106 using the determinations of the on states of the media presentation device 106 and the off states of the media presentation device 106.


While example manners of implementing the audience measurement system 100 of FIG. 1 have been illustrated in FIGS. 2 and 3, one or more of the elements, processes and/or devices illustrated in FIGS. 2 and/or 3 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, the example AGC 210, the example data file generator 212, the example input database 214, the example return path interface 216, the example network interface 218, the example code detector 220, the example signature generator 222, the example on/off detector 224, the example location creditor 226, the example reference signature database 230 and/or, more generally, the example audience measurement device 108, 202, 302 and/or the example media creditor 132, 204, 304 of FIGS. 1-3 may be implemented by hardware, software, firmware and/or any combination of hardware, software and/or firmware. Thus, for example, any of the example AGC 210, the example data file generator 212, the example input database 214, the example return path interface 216, the example network interface 218, the example code detector 220, the example signature generator 222, the example on/off detector 224, the example location creditor 226, the example reference signature database 230 and/or, more generally, the example audience measurement device 108, 202, 302 and/or the example media creditor 132, 204, 304 of FIGS. 1-3 could be implemented by one or more circuit(s), programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)), etc.


When any of the apparatus or system claims of this patent are read to cover a purely software and/or firmware implementation, at least one of the example AGC 210, the example data file generator 212, the example input database 214, the example return path interface 216, the example network interface 218, the example code detector 220, the example signature generator 222, the example on/off detector 224, the example location creditor 226, the example reference signature database 230 of FIGS. 2 and/or 3 are hereby expressly defined to include a tangible computer readable medium such as a memory, DVD, CD, Blu-ray, etc. storing the software and/or firmware. Further still, the example audience measurement device 202, 302 and/or the example media creditor 204, 304 of FIGS. 2 and/or 3 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIGS. 2 and/or 3, and/or may include more than one of any or all of the illustrated elements, processes and devices.



FIG. 4 illustrates a time period 400 representative of crediting media presentations and/or non-presentations to a media presentation device during in an example process to perform crediting. The example process of FIG. 4 includes a set of credited time periods 402-410 that may be performed using the audience measurement device 108, 202, 302 and/or the media creditor 132, 204, 304 of FIGS. 1-3. The example credited time periods 402-410 correspond to the same time period 400, which represents captured or recorded audio in a data file to be processed. The example time period 400 and the portions of the time period 400 discussed below are illustrative, and are not necessarily to scale. In the example of FIG. 4, different crosshatching is used to illustrate portions of the time period 400 that are credited using different techniques and do not necessarily represent different media.


In the example credited time period 402 of FIG. 4 the data file is yet to be processed and no part of the time period 400 has been credited. In the example credited time period 404, the example code extractor 220 and/or the example location creditor 226 of FIGS. 2 and/or 3 determine, based on the data file, that embedded codes were present in the captured audio during portions 414, 416, 418 of the time period 400. Accordingly, the example location creditor 226 credits the portions 414-418 with respective media presentations, while the remainder of the time period 400 in the credited time period 404 are not credited.


In the example credited time period 406 of FIG. 4, the example signature generator 222 and/or the example location creditor 226 of FIGS. 2 and/or 3 determine, based on generated signatures in the data file, that a portion 420 of the time period 400 corresponds to a media presentation. The example location creditor 226 of FIGS. 2 and/or 3 credits the portion 420 with media presentation (e.g., based on the reference signature to which the generated signature is matched). The remaining portions of the time period 400 that have not been credited based on codes or signature matching remain not credited at credited time period 406.


In the example credited time period 408, the example on/off detector 224 and/or the example location creditor 226 of FIGS. 2 and/or 3 determine, based on generated signatures in the data file, that portions 422, 424 of the time period 400 are to be credited as in an on state (e.g., presenting media) and portions 426, 428, 430 of the time period 400 are to be credited as in an off state (e.g., not presenting media). Therefore, after the example credited time period 408, the media presentation device 106 has been credited for the entire example time period 400 (e.g., based on particular media, not based on particular media, and/or in an off state).


In the example credited time period 410, the example location creditor 226 of FIGS. 2 and/or 3 determines the media with which the media presentation device 106 is to be credited during the time period 400. For example, while the portions 422, 424 in the credited time period 408 are initially credited as in an on state (and, therefore, presumably presenting media), the example location creditor 226 may determine the media being presented during the portions based on, for example, continuity of audio with portions 414, 416, and/or 420 adjacent to the portions 422 and/or 424. In some examples, if the portions 422 and/or 424 are sufficiently brief and the portions adjacent the portions 422, 424 represent identical media, the location creditor 226 may assume that the portions 422 and/or 424 represent the same media as the adjacent portion(s). Any other appropriate assumptions may be used to credit the portions 422, 424 that correspond to an on state of the media presentation device 106.


In the example credited time period 410 of FIG. 4, the location creditor 226 credits contiguous portion 430, contiguous portion 432, and contiguous portion 434 with different media. The example location creditor 226 credits the portions 436, 438, and 440 with an off state representative of media not being presented by the media presentation device 106.


In some other examples, the audio may be provided for the portions 422, 424 for further analysis to determine the media being presented during the portions 422, 424. Such analysis may include applying additional signaturing techniques and performing comparisons of the signatures and/or enabling a human to listen to the audio to determine whether the audio corresponds to the same media as adjacent portions 414, 416, and/or 420.


While the example credited time periods 402-410 of FIG. 4 are shown in a particular order, other sequences of crediting may be used. For example, the location creditor 226 of FIGS. 2 and/or 3 may credit the on states and/or the off states of the media presentation device 106 and subsequently override the on states and/or the off states with crediting of media based on extracted codes and/or signaturing.


Flowcharts representative of example machine readable instructions for implementing the example AGC 210, the example data file generator 212, the example input database 214, the example return path interface 216, the example network interface 218, the example code detector 220, the example signature generator 222, the example on/off detector 224, the example location creditor 226, the example reference signature database 230 and/or, more generally, the example audience measurement device 108, 202, 302 and/or the example media creditor 132, 204, 304 of FIGS. 1-3 are shown in FIGS. 5-7. In this example, the machine readable instructions comprise program(s) for execution by a processor such as the processor 812 shown in the example processor platform 800 discussed below in connection with FIG. 8. The program(s) may be embodied in software stored on a tangible computer readable medium such as a CD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), a Blu-ray disk, or a memory associated with the processor 812, but the entire program(s) and/or parts thereof could alternatively be executed by a device other than the processor 812 and/or embodied in firmware or dedicated hardware. Further, although the example program is described with reference to the flowcharts illustrated in FIGS. 5-7 many other methods of implementing the example AGC 210, the example data file generator 212, the example input database 214, the example return path interface 216, the example network interface 218, the example code detector 220, the example signature generator 222, the example on/off detector 224, the example location creditor 226, the example reference signature database 230 and/or, more generally, the example audience measurement device 108, 202, 302 and/or the example media creditor 132, 204, 304 of FIGS. 1-3 may alternatively be used. For example, the order of execution of the blocks may be changed, and/or some of the blocks described may be changed, eliminated, or combined.


The example instructions 500-700 of FIGS. 5, 6, and/or 7 may be implemented using coded instructions (e.g., computer readable instructions) stored on a tangible computer readable medium such as a hard disk drive, a flash memory, a read-only memory (ROM), a compact disk (CD), a digital versatile disk (DVD), a cache, a random-access memory (RAM) and/or any other storage medium in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term tangible computer readable storage medium is expressly defined to include any type of computer readable storage device or storage disc (e.g., a magnetic storage disc, an optical storage disc) and to exclude propagating signals. Additionally or alternatively, the example processes of FIGS. 5, 6, and/or 7 may be implemented using coded instructions (e.g., computer readable instructions) stored on a non-transitory computer readable medium such as a hard disk drive, a flash memory, a read-only memory, a compact disk, a digital versatile disk, a cache, a random-access memory and/or any other storage media in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term non-transitory computer readable medium is expressly defined to include any type of computer readable storage device or storage disc (e.g., a magnetic storage disc, an optical storage disc) and to exclude propagating signals. As used herein, when the phrase “at least” is used as the transition term in a preamble of a claim, it is open-ended in the same manner as the term “comprising” is open ended. Thus, a claim using “at least” as the transition term in its preamble may include elements in addition to those expressly recited in the claim.



FIG. 5 is a flowchart representative of example machine readable instructions 500 that may be executed to implement the example audience measurement devices 108, 202, 302 of FIGS. 1-3. The example instructions 500 may be executed to generate a data file for transmission via a return path to the example media creditors 116, 204, 304 of FIGS. 1-3. The instructions 500 of FIG. 5 will be described, by way of example, with reference to the example audience measurement device 302 of FIG. 3.


The example audience measurement device 302 initializes (block 502). For example, the audience measurement device 108 may determine a number and/or type of microphones 206, 208 for capturing audio and determine a reference time signal (e.g., from a cellular data connection via the return path interface 216). The example audience measurement device 302 is calibrated (block 504). For example, the audience measurement device 302 may be calibrated to an ambient audio level in a location in which the audience measurement device 302 is placed and/or may be calibrated to an audio level and/or audio range of a media presentation device 106 to be monitored via the audience measurement device 302. In some examples, calibration improves the accuracy of on/off state determinations.


The example audience measurement device 302 captures (e.g., records) ambient audio in the location (block 506). For example, the audience measurement device 302 captures audio output from the media presentation device 106 being monitored when the media presentation device 106 is playing audio.


The example audience measurement device 302 determines whether to process the captured audio (block 508). For example, the audience measurement device 302 may be enabled to extract codes or watermarks embedded in the captured audio, generate digital signatures representative of the captured audio, and/or determine whether the media presentation device 106 is in an on state or an off state based on the captured audio. If the audience measurement device 302 is to process the captured audio (block 508), the example audience measurement device 302 proceeds to process the audio (block 510). Example instructions to implement block 510 are described below with reference to FIG. 7.


After processing the audio (block 510), or if the audience measurement device 302 is to not process the audio (block 508), the example audience measurement device 302 determines whether to include the captured audio in the data file (block 512). If the audience measurement device 302 is to include the captured audio in the data file (block 512), the example audience measurement device 302 stores the captured audio in the data file (block 514). In some examples, the audience measurement device 302 includes the captured audio in the data file (block 514) when the audio is not processed by the audience measurement device 302 (block 508). In some examples, the audience measurement device 302 does not include the captured audio in the data file when the audience measurement device 302 processes the audio in the data file (e.g., includes extracted code(s), generated signature(s), and/or on/off determinations in the data file in block 510).


After storing the captured audio in the data file (block 514), or if the captured audio is not to be included (block 512), the example audience measurement device 302 determines whether the data file is to be transmitted (block 516). For example, the audience measurement device 302 may transmit the data file (e.g., from the data file generator 212 via the return path interface 216 of FIGS. 2 and/or 3) periodically, aperiodically, at particular times, in response to an event or condition (e.g., a local memory is filled), on request, and/or based on any other criteria. If the audience measurement device 302 is to not transmit the data file (block 516) (e.g., a measurement period has not yet elapsed), control returns to block 506 to continue capturing ambient audio.


When the audience measurement device 302 is to transmit the data file (block 516) (e.g., a time period has elapsed), the example data file generator 212 generates the data file corresponding to a time period (block 518). The generated data file may include the captured audio and/or any data resulting from processing the audio. The example data file generator 212 transmits the data file via the return path interface 216 (block 520). For example, the return path interface 216 may establish a cellular data connection to transmit the data file to the input database 214 and/or to the media creditor 304 of FIG. 3. The example instructions 500 may then end and/or iterate to capture audio for a subsequent measurement period. In some examples, iterating the instructions 500 may result in omitting blocks 502 and/or 504 for the subsequent iterations.



FIG. 6 is a flowchart representative of example machine readable instructions 600 that may be executed to implement the example media creditor 132, 204, 304 of FIGS. 1-3. The example instructions 600 may be executed to credit a media presentation device based on a data file. The instructions 600 of FIG. 6 will be described, by way of example, with reference to the example media creditor 204 of FIG. 2.


The example media creditor 204 receives a data file (e.g., from the audience measurement device 202 and/or the input database 214 of FIG. 2) (block 602). The example data file may include captured audio, gain levels for the AGC 210, codes or watermarks extracted from the audio, signatures representative of the audio, on/off determinations, time stamps, and/or identification data for the monitored location associated with the audience measurement device 202.


The example media creditor 204 (e.g., via the location creditor 226) determines a time period and an audience measurement device represented by the data file (block 604). For example, the location creditor 226 may determine that the data file corresponds to a predetermined time period (e.g., a particular day, a particular week, etc.) and/or may determine the time period based on a range of time stamps in the data file. The example location creditor 226 of FIG. 3 may determine the audience measurement device based on an identification of the audience measurement device 202 and/or an identification of the media presentation device 106 included in the data file.


The example location creditor 226 determines whether the audio in the data file is to be processed (block 606). In examples in which the audience measurement device 202 does not process the audio, the example location creditor 226 may determine that the audio is to be processed. For example, the location creditor 226 may determine whether signatures and/or on/off determinations are present or omitted from the data file, which may indicate whether the audience measurement device 202 performed processing on the captured audio.


For example, the media creditor 204 may be enabled to extract codes or watermarks embedded in the captured audio (e.g., via the code extractor 220 of FIG. 2), generate digital signatures representative of the captured audio (e.g., via the signature generator 222 of FIG. 2), and/or determine whether the media presentation device 106 is in an on state or an off state based on the captured audio (e.g., via the on/off detector 224 of FIG. 2). If the audience measurement device 302 is to process the captured audio (block 606), the example audience measurement device 302 proceeds to process the audio (block 608). Example instructions to implement block 608 are described below with reference to FIG. 7.


After processing the audio (block 608), or if the media creditor 204 is to not process the audio (block 606), the example media creditor 204 determines (e.g., via the location creditor 226) whether extracted code(s) are present (block 610). The location creditor 226 may determine whether code(s) are present in the data file and/or from processing the audio. If extracted codes are present (block 610), the example location creditor 226 credits the respective portion(s) of the time period represented by the data file based on the extracted code(s) (block 612). Crediting the portions of the time period may include, for example, associating media identified via the extracted codes with the media presentation device 106 for the portions of the time period.


After crediting based on the extracted code(s) (block 612), or if no extracted codes are present (block 610), the example location creditor 226 determines whether any signatures of the audio are present (block 614). The location creditor 226 may determine whether signatures(s) are present in the data file and/or from processing the audio. If signature(s) are present (block 614), the example location creditor 226 compares the signature(s) to reference signature(s) (block 616). The example location creditor 226 credits portion(s) of the time period represented by the data file based on the comparison(s) of the signature(s) to the reference signature(s) (block 618). For example, if a generated signature is considered to match a reference signature, the example location creditor 226 credits the portion of the time period associated with the generated signature (e.g., credits the media presentation device 106 with the media corresponding to the matched reference signature).


After crediting based on the comparison(s) of the signature(s) to reference signature(s) (block 618), or if there are no signatures present (block 614), the example location creditor 226 credits portion(s) of the time period based on determinations of on states of the media presentation device 106 and/or off states of the media presentation device 106 (block 620). For example, the location creditor 226 may use the on/off determinations to credit the portion(s) of the time period that were not credited using codes (block 612) and/or signatures (block 618). In some examples, the location creditor 226 further credits media to the media presentation device 106 for the portion(s) of the time period during which the media presentation device 106 is determined to be on.


The example location creditor 226 outputs the crediting of the media presentation device 106 for the time period represented by the data file (block 622). The crediting of the media presentation device 106 may be used to, for example, determine demographic information and/or generate television ratings information.



FIG. 7 is a flowchart representative of example machine readable instructions 700 that may be executed to implement the example media creditor 132, 204, 304 of FIGS. 1-3 and/or the example audience measurement device 108, 202, 302 of FIGS. 1-3 to process captured audio. The instructions 700 of FIG. 7 will be described, by way of example, with reference to the example media creditor 204 of FIG. 2.


The example instructions 700 of FIG. 7 may be executed in response to an audience measurement device (e.g., the audience measurement device 108, 202, 302 of FIGS. 1-3) and/or a media creditor (e.g., media creditor 132, 204, 304 of FIGS. 1-3). The example media creditor 204 (e.g., via the code extractor 220 of FIG. 2) detects code(s) present in the captured audio (block 702). The example code extractor 220 may use any method of detecting and/or extracting embedded codes, watermarks, and/or any other type of auxiliary information from the audio. The example code extractor 220 determines whether any codes are detected (block 704) and, if so, stores the detected code(s) (block 706). For example, the code extractor 220 may store the codes in association with the data file for later crediting of the time period represented by the data file. The example code extractor 220 of FIG. 2 may further store a timestamp corresponding to a time or a range of time represented by the data file at which each particular code was detected.


After storing the detected code(s) (block 706), or if no codes are detected in the audio (block 704), the example media creditor 204 (e.g., via the signature generator 222 of FIG. 2) generates signature(s) of the captured audio (block 708). The example signature generator 222 may use any method of digitally characterizing the captured audio. In some examples, the signature generator 222 generates multiple signatures to characterize the time period of the data file. In some examples, the signature generator 222 also generates multiple signatures of identical or overlapping portions of the time period to perform one or more characterization or signaturing methods. The example signature generator 222 stores the generated signature(s) (block 710). For example, the signature generator 222 may store the generated signature(s) in association with the data file for later crediting of the time period represented by the data file. The example signature generator 222 of FIG. 2 may further store timestamp(s) corresponding to time(s) and/or range(s) of time represented by the data file that are characterized by each of the generated signature(s).


The example media creditor 204 (e.g., via the on/off detector 224) determines whether the captured audio represents an on state or an off state of the media presentation device 106 for the time periods represented by the data file (block 712). For example, the on/off detector 224 may analyze portions of the audio and/or other data, such as gain levels applied to captured audio by the AGC 210, to determine at what times the media presentation device 106 was in an on state and at what times the media presentation device 106 was in an off state during the time period represented by the data file. The example on/off detector 224 stores the on/off determination(s) (block 714). For example, the on/off detector 224 may store the on/off determinations in association with the data file for later crediting of the time period represented by the data file.


The example instructions 700 may then end and control returns to block 512 of FIG. 5 or block 610 of FIG. 6.



FIG. 8 is a block diagram of an example processor platform 800 capable of executing the instructions of FIGS. 5-7 to implement the example audience measurement device 108, 202, 302 and/or the example media creditor 132, 204, 304 of FIGS. 1, 2, and/or 3. The processor platform 800 can be, for example, a server, a personal computer, or any other type of computing device.


The processor platform 800 of FIG. 8 includes a processor 812. For example, the processor 812 can be implemented by one or more microprocessors or controllers from any desired family or manufacturer.


The processor 812 includes a local memory 813 (e.g., a cache) and is in communication with a main memory including a volatile memory 814 and a non-volatile memory 816 via a bus 818. The volatile memory 814 may be implemented by Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device. The non-volatile memory 816 may be implemented by flash memory and/or any other desired type of memory device. Access to the main memory 814, 816 is controlled by a memory controller.


The processor platform 800 also includes an interface circuit 820. The interface circuit 820 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a PCI express interface.


One or more input devices 822 are connected to the interface circuit 820. The input device(s) 822 permit a user to enter data and commands into the processor 812. The input device(s) can be implemented by, for example, a keyboard, a mouse, a touchscreen, a track-pad, a trackball, isopoint and/or a voice recognition system.


One or more output devices 824 are also connected to the interface circuit 820. The output devices 824 can be implemented, for example, by display devices (e.g., a liquid crystal display, a cathode ray tube display (CRT), a printer and/or speakers). The interface circuit 820, thus, typically includes a graphics driver card.


The interface circuit 820 also includes a communication device such as a modem or network interface card to facilitate exchange of data with external computers via a network 826 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.). The example interface circuit 820 may implement the return path interface 216 and/or the network interface 218 of FIGS. 2 and/or 3.


The processor platform 800 also includes one or more mass storage devices 828 for storing software and data. Examples of such mass storage devices 828 include floppy disk drives, hard drive disks, compact disk drives and digital versatile disk (DVD) drives. The mass storage device 828 may implement the input database 214 of FIGS. 2 and/or 3.


The coded instructions 832 of FIGS. 5-7 may be stored in the mass storage device 828, in the volatile memory 814, in the non-volatile memory 816, and/or on a removable storage medium such as a CD or DVD.


Although certain example methods, apparatus and articles of manufacture have been described herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the appended claims either literally or under the doctrine of equivalents.

Claims
  • 1. An apparatus comprising: means for computing a signature from audio obtained from a media device during a time period;means for determining an on/off state of the media device based on a gain level applied by an automatic gain controller during collection of the audio; andmeans for crediting the media device with presenting media during the time period when (1) the signature matches at least one of a set of reference signatures and the on/off state determined for the media device is an on state, and (2) when the signature matches at least one of the set of reference signatures and the on/off state determined for the media device is an off state, the means for crediting to not credit the media device with presenting the media during the time period when (3) the signature does not match at least one of the set of reference signatures and the on/off state determined for the media device is the off state.
  • 2. The apparatus as defined in claim 1, wherein the audio is recorded with a microphone at a monitored location.
  • 3. The apparatus as defined in claim 1, wherein the audio is included in a data file received from the media device.
  • 4. The apparatus as defined in claim 1, wherein the means for computing is to generate multiple signatures for the time period.
  • 5. The apparatus as defined in claim 1, further including means for detecting encoded information present in the audio obtained for the time period when the signature does not match at least one of the set of reference signatures, the means for crediting to credit the media device with presenting media during the time period when the means for detecting detects the encoded information irrespective of the determination of the on/off state, and the means for crediting not to credit the media device with presenting the media during the time period when the means for detecting does not detect the encoded information and the on/off state determined for the media device is the off state.
  • 6. The apparatus as defined in claim 5, wherein the means for detecting is to detect the encoded information based on extracting a steganographically encoded watermark from the audio.
  • 7. An apparatus comprising: a code detector to detect whether encoded information is presenting audio obtained from a media device during a time period;an on/off detector to determine an on/off state of the media device based on a gain level applied by an automatic gain controller to collect the audio; anda location creditor to credit the media device with presenting media during the time period when the encoded information is detected and the on/off state is determined to be an on state, the location creditor to credit the media device with presenting media during the time period when the encoded information is detected and the on/off state is determined to be an off state, the location creditor not to credit the media device with presenting the media during the time period when the encoded information is not detected and the on/off state determined for the media device is the off state.
  • 8. The apparatus of claim 7, wherein the audio is recorded with a microphone at a monitored location.
  • 9. The apparatus of claim 7, wherein the audio is included in a data file received from the media device.
  • 10. The apparatus of claim 7, wherein the code detector is to detect the encoded information based on extracting a steganographically encoded watermark from the audio.
  • 11. The apparatus of claim 7, further including a signature generator, wherein when the encoded information is not detected: the signature generator is to generate a signature of the audio and attempt to match the generated signature to a set of reference signatures;the location creditor is to credit the media device with presenting media during the time period when the generated signature match at least one of the reference signatures irrespective of the determination of the on/off state; andthe location creditor is not to credit the media device with presenting the media during the time period when the generated signature does not match at least one of the reference signatures and the on/off state determined for the media device is the off state.
  • 12. A non-transitory computer readable medium comprising computer readable instructions which, when executed, cause a processor to at least: obtain a file including audio collected for a time period by an audience measurement device monitoring a media presentation device at a monitored location remote from a back office, the file identifying a gain level applied to collect the audio;determine the media presentation device was in an off state during the time period based on the gain level;analyze the audio for encoded information;at least when the encoded information is not present in the audio, generate a signature based on the audio and attempt to match the signature to a set of reference signatures;if either the encoded information is present in the audio or the signature matches at least one of the reference signatures: override the determination that the media presentation device was in the off state; andcredit the media presentation device with presenting media corresponding to at least one of the encoded information or the signature during the time period.
  • 13. The non-transitory computer readable medium as defined in claim 12, wherein the audio is recorded at the monitored location.
  • 14. The non-transitory computer readable medium as defined in claim 12, wherein the audio is stored in a data file.
  • 15. The non-transitory computer readable medium as defined in claim 12, wherein the instructions cause the processor to detect the encoded information by extracting a steganographically encoded watermark.
  • 16. The non-transitory computer readable medium as defined in claim 12, wherein the instructions cause the processor to override the determination that the media presentation device was in the off state based only on the audio.
Parent Case Info

This patent arises from a continuation of U.S. patent application Ser. No. 15/729,395, now U.S. Pat. No. 10,687,098, which was filed on Oct. 10, 2017, and is entitled “Methods and Apparatus for Crediting a Media Presentation Device,” which is a continuation of U.S. patent application Ser. No. 15/015,784, now U.S. Pat. No. 9,832,496, which was filed on Feb. 4, 2016, and is entitled “Methods and Apparatus for Crediting a Media Presentation Device,” which is a continuation of U.S. patent application Ser. No. 13/718,878, now U.S. Pat. No. 9,473,795, which was filed on Dec. 18, 2012, and is entitled “Methods and Apparatus for Crediting a Media Presentation Device,” which claims the benefit of and priority to U.S. Provisional Patent Application No. 61/577,467, filed Dec. 19, 2011. U.S. patent application Ser. No. 15/729,395, U.S. patent application Ser. No. 15/015,784, U.S. patent application Ser. No. 13/718,878 and U.S. Provisional Patent Application No. 61/577,467 are hereby incorporated herein by reference in their respective entireties.

US Referenced Citations (189)
Number Name Date Kind
3281695 Bass Oct 1966 A
3315160 Goodman Apr 1967 A
3483327 Schwartz Dec 1969 A
3651471 Haselwood et al. Mar 1972 A
3733430 Thompson et al. May 1973 A
3803349 Watanabe Apr 1974 A
3906454 Martin Sep 1975 A
3947624 Miyake Mar 1976 A
4027332 Wu et al. May 1977 A
4044376 Porter Aug 1977 A
4058829 Thompson Nov 1977 A
4245245 Matsumoto et al. Jan 1981 A
4388644 Ishman et al. Jun 1983 A
4546382 McKenna et al. Oct 1985 A
4566030 Nickerson et al. Jan 1986 A
4574304 Watanbe et al. Mar 1986 A
4613904 Lurie Sep 1986 A
4622583 Watanbe et al. Nov 1986 A
4642685 Roberts et al. Feb 1987 A
4644393 Smith et al. Feb 1987 A
4647964 Weinblatt Mar 1987 A
4697209 Kiewit et al. Sep 1987 A
4723302 Fulmer et al. Feb 1988 A
4764808 Solar Aug 1988 A
4769697 Gilley et al. Sep 1988 A
4779198 Lurie Oct 1988 A
4800437 Hosoya Jan 1989 A
4807031 Broughton et al. Feb 1989 A
4876736 Kiewit Oct 1989 A
4885632 Mabey et al. Dec 1989 A
4907079 Turner et al. Mar 1990 A
4912552 Allison, III et al. Mar 1990 A
4931865 Scarampi Jun 1990 A
4943963 Waechter et al. Jul 1990 A
4965825 Harvey et al. Oct 1990 A
4972503 Zurlinden Nov 1990 A
5097328 Boyette Mar 1992 A
5136644 Audebert et al. Aug 1992 A
5165069 Vitt et al. Nov 1992 A
5226177 Nickerson Jul 1993 A
5235414 Cohen Aug 1993 A
5251324 McMullan, Jr. Oct 1993 A
5310222 Chatwin et al. May 1994 A
5319453 Copriviza et al. Jun 1994 A
5335277 Harvey et al. Aug 1994 A
5355161 Bird et al. Oct 1994 A
5398055 Nonomura et al. Mar 1995 A
5404161 Douglass et al. Apr 1995 A
5404172 Berman et al. Apr 1995 A
5408258 Kolessar Apr 1995 A
5425100 Thomas et al. Jun 1995 A
5481294 Thomas et al. Jan 1996 A
5483276 Brooks et al. Jan 1996 A
5488408 Maduzia et al. Jan 1996 A
5505901 Harney et al. Apr 1996 A
5512933 Wheatley et al. Apr 1996 A
5550928 Lu et al. Aug 1996 A
5659367 Yuen Aug 1997 A
5760760 Helms Jun 1998 A
5767922 Zabih et al. Jun 1998 A
5771307 Lu et al. Jun 1998 A
5801747 Bedard Sep 1998 A
5874724 Cato Feb 1999 A
5889548 Chan Mar 1999 A
5896554 Itoh et al. Apr 1999 A
5963844 Dail Oct 1999 A
6035177 Moses et al. Mar 2000 A
6049286 Forr Apr 2000 A
6124877 Schmidt Sep 2000 A
6137539 Lownes et al. Oct 2000 A
6177931 Alexander et al. Jan 2001 B1
6184918 Goldschmidt Iki et al. Feb 2001 B1
6272176 Srinivasan Aug 2001 B1
6281695 Chung et al. Aug 2001 B1
6286140 Ivanyi Sep 2001 B1
6297859 George Oct 2001 B1
6311214 Rhoads Oct 2001 B1
6388662 Narui et al. May 2002 B2
6400996 Hoffberg et al. Jun 2002 B1
6421445 Jensen et al. Jul 2002 B1
6457010 Eldering et al. Sep 2002 B1
6462685 Korkala Oct 2002 B1
6463413 Applebaum et al. Oct 2002 B1
6467089 Aust et al. Oct 2002 B1
6477508 Lazar et al. Nov 2002 B1
6487719 Itoh et al. Nov 2002 B1
6519769 Hopple et al. Feb 2003 B1
6523175 Chan Feb 2003 B1
6529212 Miller et al. Mar 2003 B2
6542878 Heckerman et al. Apr 2003 B1
6567978 Jarrell May 2003 B1
6570559 Oshima May 2003 B1
6647212 Toriumi et al. Nov 2003 B1
6647548 Lu et al. Nov 2003 B1
6675383 Wheeler et al. Jan 2004 B1
6681396 Bates et al. Jan 2004 B1
6791472 Hoffberg Sep 2004 B1
6934508 Ceresoli et al. Aug 2005 B2
6946803 Moore Sep 2005 B2
7051352 Schaffer May 2006 B1
7100181 Srinivasan et al. Aug 2006 B2
7150030 Eldering et al. Dec 2006 B1
7647604 Ramaswamy Jan 2010 B2
7786987 Nielsen Aug 2010 B2
7882514 Nielsen et al. Feb 2011 B2
7958526 Wheeler et al. Jun 2011 B2
8060372 Topchy et al. Nov 2011 B2
8180712 Nelson et al. May 2012 B2
8249992 Harkness et al. Aug 2012 B2
8526626 Nielsen et al. Sep 2013 B2
8863166 Harsh et al. Oct 2014 B2
9312973 Nelson et al. Apr 2016 B2
9332305 Lee May 2016 B1
9420334 Nielsen et al. Aug 2016 B2
9680584 Lee Jun 2017 B2
9961342 Nielsen et al. May 2018 B2
10110889 Nielsen et al. Oct 2018 B2
10306221 Nielsen et al. May 2019 B2
10506226 Nielsen et al. Dec 2019 B2
20020012353 Gerszberg et al. Jan 2002 A1
20020015112 Nagakubo et al. Feb 2002 A1
20020026635 Wheeler et al. Feb 2002 A1
20020056087 Berezowski et al. May 2002 A1
20020057893 Wood et al. May 2002 A1
20020059577 Lu et al. May 2002 A1
20020072952 Hamzy et al. Jun 2002 A1
20020077880 Gordon et al. Jun 2002 A1
20020080286 Dagtas et al. Jun 2002 A1
20020083435 Blasko et al. Jun 2002 A1
20020141730 Haken Oct 2002 A1
20020174425 Markel et al. Nov 2002 A1
20020198762 Donato Dec 2002 A1
20030046685 Srininvasan et al. Mar 2003 A1
20030054757 Kolessar et al. Mar 2003 A1
20030056215 Kanungo Mar 2003 A1
20030067459 Lim Apr 2003 A1
20030093790 Logan et al. May 2003 A1
20030101449 Bentolila et al. May 2003 A1
20030110485 Lu et al. Jun 2003 A1
20030115591 Weissmueller, Jr. et al. Jun 2003 A1
20030131350 Peiffer et al. Jul 2003 A1
20030216120 Ceresoli et al. Nov 2003 A1
20040003394 Ramaswamy Jan 2004 A1
20040055020 Delpuch Mar 2004 A1
20040058675 Lu et al. Mar 2004 A1
20040073918 Ferman et al. Apr 2004 A1
20040088212 Hill May 2004 A1
20040088721 Wheeler et al. May 2004 A1
20040100437 Hunter et al. May 2004 A1
20040181799 Lu et al. Sep 2004 A1
20040210922 Peiffer et al. Oct 2004 A1
20040233126 Moore Nov 2004 A1
20050054285 Mears et al. Mar 2005 A1
20050057550 George Mar 2005 A1
20050125820 Nelson et al. Jun 2005 A1
20050221774 Ceresoli et al. Oct 2005 A1
20050286860 Conklin Dec 2005 A1
20060075421 Roberts et al. Apr 2006 A1
20060093998 Vertegaal May 2006 A1
20060195857 Wheeler et al. Aug 2006 A1
20060212895 Johnson Sep 2006 A1
20060232575 Nielsen Oct 2006 A1
20070011040 Wright Jan 2007 A1
20070050832 Wright et al. Mar 2007 A1
20070063850 Devaul et al. Mar 2007 A1
20070186228 Ramaswamy et al. Aug 2007 A1
20070192782 Ramaswamy et al. Aug 2007 A1
20080028427 Nesvadba et al. Jan 2008 A1
20080148307 Nielsen et al. Jun 2008 A1
20080148309 Wilcox et al. Jun 2008 A1
20080276265 Topchy et al. Nov 2008 A1
20090192805 Topchy et al. Jul 2009 A1
20090225994 Topchy et al. Sep 2009 A1
20090259325 Topchy et al. Oct 2009 A1
20090305677 Ellison Dec 2009 A1
20100083299 Nelson Apr 2010 A1
20100162285 Cohen et al. Jun 2010 A1
20100211967 Ramaswamy et al. Aug 2010 A1
20110016231 Ramaswamy et al. Jan 2011 A1
20120102515 Ramaswamy et al. Apr 2012 A1
20130084056 Harsh et al. Apr 2013 A1
20130160042 Stokes et al. Jun 2013 A1
20130218974 Cao Aug 2013 A1
20140059579 Vinson et al. Feb 2014 A1
20160173921 Stokes et al. Jun 2016 A1
20160210557 Nelson et al. Jul 2016 A1
20160323571 Nielsen et al. Nov 2016 A1
20180035141 Stokes et al. Feb 2018 A1
20180241989 Nielsen et al. Aug 2018 A1
Foreign Referenced Citations (36)
Number Date Country
2015255256 Dec 2012 AU
1244982 Feb 2000 CN
1574964 Sep 1980 DE
3401762 Aug 1985 DE
0593202 Apr 1994 EP
0946012 Sep 1999 EP
1318679 Jun 2003 EP
8331482 Dec 1996 JP
2000307520 Nov 2000 JP
9115062 Oct 1991 WO
9512278 May 1995 WO
9526106 Sep 1995 WO
9810539 Mar 1998 WO
9832251 Jul 1998 WO
9933206 Jul 1999 WO
9959275 Nov 1999 WO
0038360 Jun 2000 WO
0072484 Nov 2000 WO
0111506 Feb 2001 WO
0145103 Jun 2001 WO
0161892 Aug 2001 WO
0219581 Mar 2002 WO
02052759 Jul 2002 WO
03049339 Jun 2003 WO
03052552 Jun 2003 WO
03060630 Jul 2003 WO
2005032145 Apr 2005 WO
2005038625 Apr 2005 WO
2005041166 May 2005 WO
2005055601 Jun 2005 WO
2005065159 Jul 2005 WO
2005079457 Sep 2005 WO
2006012629 Feb 2006 WO
2007022250 Feb 2007 WO
2007120518 Oct 2007 WO
2011115945 Sep 2011 WO
Non-Patent Literature Citations (72)
Entry
Thomas, “Television Audience Research Technology, Today's Systems and Tomorrow's Challenges,” Nielsen Media Research, Jun. 3, 1992, 4 pages.
Dai et al., “Transferring Naive Bayes Classifiers for Text Classification,” Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, held in Vancouver, British Columbia on Jul. 22-26, 2007, 6 pages.
Elkan, “Naive Bayesian Learning,” Adapted from Technical Report No. CS97-557, Department of Computer Science and Engineering, University of California, San Diego, U.S.A., Sep. 1997, 4 pages.
Zhang, “The Optimality of Naive Bayes,” Proceedings of the Seventeenth International FLAIRS Conference, 2004, 6 pages.
Domingos et al., “On the Optimality of the Simple Bayesian Classifier under Zero-One Loss,” Machine Learning, vol. 29, No. 2, pp. 103-130, Nov. 1, 1997, 28 pages.
Patron-Perez et al., “A Probabilistic Framework for Recognizing Similar Actions using Spatio-Temporal Features,” BMVC07, 2007 [Retrieved from the Internet on Feb. 29, 2008], 10 pages.
Mitchell, Tom M., “Chapter 1; Generative and Discriminative Classifiers: Naive Bayes and Logistic Regression,” Machine Learning, Sep. 21, 2006, 17 pages.
Lang, “Implementation on Naive Bayesian Classifiers in Java,” http://www.iit.edul˜ipro356f03/ipro/documents/naive-bayes.edu [Retrieved from the Internet on Feb. 29, 2008], 4 pages.
Liang et aI., “Learning Naive Bayes Tree for Conditional Probability Estimation,” Proceedings of the Canadian Al-2006 Conference, held in Quebec, Canada, pp. 456-466, on Jun. 7-9, 2006, 13 pages.
Mozina et al., “Nomograms for Visualization of Naive Bayesian Classifier,” Proceedings of the Eight European Conference on Principles and Practice of Knowledge Discovery in Databases, held in Pisa, Italy, pp. 337-348, 2004 [Retrieved from the Internet on Feb. 29, 2008], 12 pages.
“Lecture 3; Naive Bayes Classification,” http://www.cs. utoronto. ca/˜strider/CSCD 11_f08INaiveBayes_Zemel. pdf [Retrieved from the Internet on Feb. 29, 2008], 9 pages.
Klein, PowerPoint Presentation of “Lecture 23: Naive Bayes,” CS 188: Artificial Intelligence held on Nov. 15, 2007, 6 pages.
“Learning Bayesian Networks: Naive and non-Naive Bayes” Oregon State University, Oregon [Retrieved from the Internet on Feb. 29, 2008]. Retrieved from the Internet: http://web.engr.oregonstate.edu1˜tgd/classess/534/slides/part6.pdf, 18 pages.
“The Naive Bayes Classifier,” CS534-Machine Learning, Oregon State University, Oregon [Retrieved from the Internet on Feb. 29, 2008]. Retrieved from the Internet: http://web.engr.oregonstate.edu1˜afern/classes/cs534/notes1Naivebayes-10.pdf, 19 pages).
“Bayesian Networks,” Machine Learning A, 708.064 07 1sst KU Oregon State University, Oregon [Retrieved from the Internet on Feb. 29, 2008]. Retrieved from the Internet: http://www.igi.tugraz.at.lehre /MLA/WS07/slides3.pdf, 21 pages.
“The Peltarion Blog,” Jul. 10, 2006 [Retrieved from the Internet on Mar. 11, 2009] Retrieved from the Internet: http//blog.peltarion.com/2006/07/10/classifier-showdown, 14 pages.
“Logical Connective: Philosophy 103: Introduction to Logic Conjunction, Negation, and Disjunction,” [Retrieved from the Internet on Mar. 11, 200] Retrieved from the Internet: http://philosophy.lander.edu/logic/conjunct.html, 5 pages.
“Naive Bayes Classifier,” Wikipedia entry as of Mar. 11, 2009 [Retrieved from the Internet on Mar. 11, 2009], 7 pages.
“Naive Bayes Classifier,” Wikipedia entry as of Jan. 11, 2008 [Retrieved from the Internet from Wikipedia history pages on Mar. 11, 2009], 7 pages.
Zimmerman, “Fuzzy set applications in pattern recognition and data-analysis,” 11th IAPR International conference on Pattern Recognition, Aug. 29, 1992, 81 pages.
Patent Cooperation Treaty, International Search Report and Written Opinion of the International Searching Authority for PCT/US2006/031960, dated Feb. 21, 2007, 3 pages.
Vincent et al., “A Tentative Typology of Audio Source 2 Separation Tasks,” 4th International Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, Apr. 2003, pp. 715-720.
Smith, “Using liDs to Estimate Sound Source Direction,” University of Stirling, United Kingdom, 2 pages.
United States Patent and Trademark Office, “Notice of Allowance” issued in connection with U.S. Appl. No. 11/576,328 dated Apr. 7, 2010, 8 pages.
The State Intellectual Property Office of China (SIPO), “Notice of Allowance,” issued in connection with Chinese Patent Application Serial No. 200680036510.8, dated Aug. 9, 2010, 5 pages.
The State Intellectual Property Office of China (SIPO), “Second Office Action” issued in connection with Chinese Patent Application Serial No. 200680036510.8, dated Mar. 24, 2010, 9 pages.
The State Intellectual Property Office of China (SIPO), “First Office Action” issued in connection with Chinese Patent Application Serial No. 200680036510.8, dated Jul. 10, 2009, 10 pages.
Lu et al., “Content Analysis for Audio Classification and Segmentation,” IEEE Transactions on Speech and Audio Processing, vol. 10, No. 7, Oct. 2002, 14 pages.
IP Australia, “Examination Report,” issued in connection with Australian Patent Application No. 2010219320, dated Jun. 20, 2012, 4 pages.
EPO, “Extended European Search Report,” issued in connection with European Patent Application No. 06801611.2, dated Mar. 2, 2012, 5 pages.
EPO, “Examination Report,” issued in connection with European Patent Application No. 06801611.2, dated Jun. 25, 2013, 4 pages.
United States Patent and Trademark Office, “Non-Final Office Action”, issued in connection with U.S. Appl. No. 12/831,870, dated Nov. 29, 2012, 9 pages.
United States Patent and Trademark Office, “Notice of Allowance”, issued in U.S. Appl. No. 12/831,870, dated Apr. 23, 2013, 9 pages.
United States Patent and Trademark Office, “Notice of Allowance”, issued in U.S. Appl. No. 12/831,870, dated Aug. 1, 2013, 6 pages.
IP Australia, “Examination Report”, issued in connection with Australian Patent Application No. 2013203468, dated Aug. 26, 2014, 3 pages.
IP Australia, “Notice of Acceptance”, issued in connection with Australian Patent Application No. 2013203468, dated Oct. 1, 2015, 2 pages.
Canadian Intellectual Property Office, “Office Action”, issued in connection with Canadian Patent Application No. 2,619,781, dated Sep. 12, 2013, 3 pages.
Canadian Intellectual Property Office, “Office Action”, issued in connection with Canadian Patent Application No. 2,619,781, dated Jan. 26, 2015, 4 pages.
Canadian Intellectual Property Office, “Office Action,” issued in connection with Canadian Patent Application No. 2,619,781, dated Apr. 1, 2016, 8 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/015,664, dated Jan. 4, 2016, 6 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/015,664, dated Apr. 20, 2016, 10 pages.
United States Patent and Trademark Office, “Notice of Allowability,” issued in connection with U.S. Appl. No. 14/015,664, dated Jul. 20, 2016, 2 pages.
Canadian Intellectual Property Office, “Notice of Allowance”, issued in connection with Canadian Patent Application No. 2,619,781, dated Apr. 10, 2017, 1 page.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/207,019, dated Apr. 19, 2017, 6 pages.
Canadian Intellectual Property Office, “Office Action,” issued in connection with Application No. 2,859,560, dated Nov. 3, 2015, 5 pages.
IP Australia, “Notice of Acceptance,” issued in connection with Application No. 2012327192, dated Jul. 29, 2015, 2 pages.
European Patent Office, “Extended European Search Report,” issued in connection with Application No. 12859707.7, dated Jul. 6, 2015, 7 pages.
Doe, “Bringing Set Top Box Data to Life,” ARF Audience Measurement Symposium 2.0, NYC, Jun. 26, 2007, 9 pages.
IP Australia, “Patent Examination Report No. 1 ,” issued in connection with Application No. 2012327192, dated Aug. 6, 2014, 3 pages.
European Patent Office, “Communication pursuant to Rules 161(2) and 162 EPC,” issued in connection with Application No. 12859707.7, dated Aug. 1, 2014, 3 pages.
Patent Cooperation Treaty, “International Preliminary Report on Patentability,” issued in connection with Application No. PCT/US2012/070362, dated Jun. 24, 2014, 9 pp.
International Search Report and Written Opinion, issued by the International Searching Authority in connection with International application No. PCT/US2012/070362, dated Apr. 30, 2013, 11 pages.
United States Patent and Trademark Office, “Requirement for Restriction/Election,” issued in connection with U.S. Appl. No. 13/718,878, dated Mar. 13, 2014, 6 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 13/718,878, dated Jul. 14, 2014, 30 pages.
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 13/718,878, dated Jan. 6, 2015, 32 pages.
United States Patent and Trademark Office, “Notice of Allowance” issued in connection with U.S. Appl. No. 13/718,878, dated Sep. 25, 2015, 49 pages.
State Intellectual Property Office of the People's Republic of China, “Office Action,” issued in connection with Chinese Patent Application No. 201280070000.8, dated Oct. 21, 2016, 7 pages.
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 15/207,019, dated Sep. 6, 2017, 9 pages.
IP Australia, “Notice of Acceptance,” issued in connection with Australian Patent Application No. 2015255256, dated Apr. 13, 2017, 3 pages.
IP Australia, “Patent Examination Report No. 1,” issued in connection with Australian Patent Application No. 2015255256, dated Nov. 11, 2016, 2 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/015,784, dated Sep. 9, 2016, 39 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/015,784, dated Apr. 17, 2017, 26 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/015,784, dated Jul. 12, 2017, 37 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/729,395, dated Jul. 16, 2018, 17 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/729,395, dated Jan. 8, 2019, 18 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/729,395, dated Jun. 28, 2019, 18 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/729,395, dated Jan. 29, 2020, 8 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 11/576,328, dated Feb. 5, 2009, 13 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 11/576,328, dated Aug. 7, 2009, 10 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/958,814, dated Jun. 15, 2018, 9 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/417,128, dated Jul. 29, 2019, 12 pages.
United States Patent and Trademark Office, “Corrected Notice of Allowability,” issued in connection with U.S. Appl. No. 16/417,128, dated Oct. 8, 2019, 2 pages.
Related Publications (1)
Number Date Country
20200260131 A1 Aug 2020 US
Provisional Applications (1)
Number Date Country
61577467 Dec 2011 US
Continuations (3)
Number Date Country
Parent 15729395 Oct 2017 US
Child 16860987 US
Parent 15015784 Feb 2016 US
Child 15729395 US
Parent 13718878 Dec 2012 US
Child 15015784 US