Methods and apparatus to monitor a media presentation

Information

  • Patent Grant
  • 11683070
  • Patent Number
    11,683,070
  • Date Filed
    Friday, July 1, 2022
    2 years ago
  • Date Issued
    Tuesday, June 20, 2023
    a year ago
Abstract
Methods and apparatus for gathering research data indicating exposure to media are disclosed. An example apparatus includes a first wireless receiver to receive a first modulated audio signal via a wireless data connection from a media device using a wireless communication protocol, the first modulated audio signal associated with the media, the first wireless receiver to output a baseband audio signal corresponding to the first modulated audio signal. The example apparatus includes a first wireless transmitter to modulate the baseband audio signal to form a second modulated audio signal, the first wireless transmitter to transmit the second modulated audio signal to wireless headphones using the wireless communication protocol. The example apparatus includes a monitoring device to receive the baseband audio signal, and to generate research data identifying the media, the media device including a second wireless transmitter to transmit the first modulated audio signal to the first wireless receiver, and the wireless headphones including a second wireless receiver to receive the second modulated audio signal from the first wireless transmitter.
Description
BACKGROUND

Efforts to monitor the exposure of consumers to audio and video media such as, e.g., programs, music, and advertisements, have long relied on gathering data from audience survey participants. Traditionally, such data gathering has involved the manual recording of media content consumption patterns by survey participants in participant diaries. Audience surveys have been conducted by providing selected and consenting members with record diaries and requiring that the audience members record their media consumption periodically over a particular time span. Unfortunately, survey participants often prove unreliable in their ability to maintain complete and accurate records of their media consumption activities. Record diaries may be forgotten or lost, and, even when remembered, significant discipline is required to maintain accurate written records on a regular basis. The metric of survey participant adherence to the data collection protocol of a survey is termed “compliance.” More recently, the development of miniaturized electronic technologies has permitted the automation of some data collection functions useful in the study of audience media consumption. Compliance is generally improved by this automation of data collection.


Many consumer electronic devices are now enabled to provide personal area network wireless connectivity with other devices over short distances. Bluetooth is a particularly popular short-range wireless technology that allows electronic devices to communicate with one another wirelessly, i.e., without connectors, wires, or cables. Bluetooth enabled headsets and vehicle speaker systems are now widely used with cellular phones and media players to wirelessly receive audio signals and to produce an audio output heard by the user.


Capturing complete and accurate information regarding consumer media consumption using Bluetooth or other wireless personal area network enabled devices in a convenient and effective manner remains difficult. Despite the ongoing efforts of many creative practitioners of skill in the art, this problem has remained unsolved until now.


SUMMARY

In accordance with certain embodiments of the invention, an apparatus is provided for gathering research data indicating exposure to audio content to a user of an audio source device and an audio receiver device. The audio source device wirelessly transmits an audio signal containing the audio content. The audio receiver device receives an audio signal containing the audio content. The audio receiver device includes a speaker to output the audio content to be heard by the user. The apparatus includes a bridge device for wirelessly bridging the audio signal from the audio source device to the audio receiver device. The bridge device includes a speaker for outputting the audio content from the audio signal. The apparatus also includes a monitoring device acoustically coupled to the bridge device for monitoring the audio content output by the speaker of the bridge device, and generating research data identifying the audio content.


In accordance with certain embodiments of the invention, a method is provided for gathering research data indicating exposure to audio content to a user of an audio source device and an audio receiver device. The audio source device wirelessly transmits an audio signal containing the audio content. The audio receiver device receives an audio signal containing the audio content and uses a speaker to output the audio content to be heard by the user. The method comprises: (a) wirelessly bridging the audio signal from the audio source device to the audio receiver device; (b) outputting the audio content from the audio signal; and (c) monitoring the audio content output in (b) and generating research data identifying the audio content.


In accordance with certain embodiments of the invention, a system is provided for gathering research data indicating exposure to audio content to a user. The system includes an audio source device for wirelessly transmitting an audio signal containing the audio content. The system also includes an audio receiver device including a speaker for outputting the audio content to be heard by the user. The system further includes a bridge device for wirelessly bridging the audio signal from the audio source device to the audio receiver device. The bridge device includes a speaker for outputting the audio content from the audio signal. The system also includes a monitoring device acoustically coupled to the bridge device for monitoring the audio content output by the speaker of the bridge device and generating research data identifying the audio content.


These and other advantages and features of the invention will be more readily understood in relation to the following detailed description of the invention, which is provided in conjunction with the accompanying drawings.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is an illustration of an exemplary research data collection system in accordance with certain embodiments of the invention.



FIG. 2 is a block diagram of an exemplary audio source device.



FIG. 3 is a block diagram of an exemplary audio receiver device.



FIG. 4A is a block diagram of a bridge device and a monitoring device in accordance with certain embodiments of the invention.



FIG. 4B is a block diagram of a bridge device and a monitoring device in accordance with certain further embodiments of the invention.



FIG. 5 is a block diagram of a bridge device in accordance with certain alternate embodiments of the invention.



FIG. 6 is a block diagram of a bridge device in accordance with certain further alternate embodiments of the invention.





DETAILED DESCRIPTION

The following description is provided to enable any person skilled in the art to make and use the disclosed inventions and sets forth the best modes presently contemplated by the inventors of carrying out their inventions. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In certain instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present inventions.


For this application the following terms and definitions shall apply:


The term “data” as used herein means any indicia, signals, marks, symbols, domains, symbol sets, representations, and any other physical form or forms representing information, whether permanent or temporary, whether visible, audible, acoustic, electric, magnetic, electromagnetic or otherwise manifested. The term “data” as used to represent predetermined information in one physical form shall be deemed to encompass any and all representations of corresponding information in a different physical form or forms.


The terms “media data” and “media” as used herein mean data that is widely accessible, whether over-the-air, or via cable, satellite, network, internetwork (including the Internet), print, displayed, distributed on storage media, or by any other means or technique that is humanly perceptible, without regard to the form or content of such data, and including but not limited to audio, video, text, images, animations, databases, files, broadcasts, displays (including but not limited to video displays, posters and billboards), signs, signals, web pages, print media and streaming media data.


The term “research data” as used herein means data comprising (1) data concerning usage of media, (2) data concerning exposure to media, and/or (3) market research data.


The terms “gather” and “gathering” as used herein include both directly gathering data with the use of a device as well as emitting data from a device that causes or enables another device to gather data.


The term “research operation” as used herein means an operation comprising gathering, storing and/or communicating research data.


The term “network” as used herein includes both networks and internetworks of all kinds, including the Internet, and is not limited to any particular network or internetwork.


The terms “first,” “second,” “primary,” and “secondary” are used herein to distinguish one element, set, data, object, step, process, function, action or thing from another, and are not used to designate relative position, arrangement in time or relative importance, unless otherwise stated explicitly.


The terms “coupled”, “coupled to”, and “coupled with” as used herein each mean a relationship between or among two or more devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, and/or means, constituting any one or more of (a) a connection, whether direct or through one or more other devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means, (b) a communications relationship, whether direct or through one or more other devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means, and/or (c) a functional relationship in which the operation of any one or more devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means depends, in whole or in part, on the operation of any one or more others thereof.


The terms “communicate”, and “communicating” as used herein include both conveying data from a source to a destination, and delivering data to a communications medium, system, channel, device, wire, cable, fiber, circuit, or link to be conveyed to a destination, and the term “communication” as used herein means data so conveyed or delivered. The term “communications’ as used herein includes one or more of a communications medium, system, channel, device, wire, cable, fiber, circuit, and link.


The term “processor” as used herein means processing devices, apparatus, programs, circuits, components, systems, and subsystems, whether implemented in hardware, software, or both, and whether or not programmable. The term “processor” as used herein includes, but is not limited to computers, hardwired circuits, signal modifying devices and systems, devices and machines for controlling systems, central processing units, programmable devices, field programmable gate arrays, application specific integrated circuits, systems on a chip, systems comprised of discrete elements and circuits, state machines, virtual machines, and combinations of any of the foregoing.


The terms “storage” and “data storage” as used herein mean data storage devices, apparatus, programs, circuits, components, systems, subsystems, and storage media serving to retain data, whether on a temporary or permanent basis, and to provide such retained data.


The present application relates to methods and apparatus for gathering research data by identifying audio content (such as, e.g., programs, music, and advertisements) to which a user of a Bluetooth or other wireless personal area network enabled audio source device is exposed. Numerous types of research operations are possible, including, without limitation, television and radio program audience measurement; exposure to advertising in various media such as television and radio; and exposure to downloaded audio and video recordings such as podcasts. For the desired type of media and/or market research operation to be conducted, particular activity of individuals is monitored, or data concerning their attitudes, awareness, and/or preferences is gathered. In certain embodiments, research data relating to two or more of the foregoing are gathered, while in others only one kind of such data is gathered.


Monitoring devices have been developed including the hardware and software required to Monitor exposure to audio media. In the course of developing the present invention, the inventors have understood the limitations of such existing Monitoring devices including the inability of existing devices to effectively capture information related to signals received at a Bluetooth earpiece. The inventors have understood that this processes may particularly difficult by the peer-to-peer parent that exists in the Bluetooth communication protocol. Although Bluetooth communications have been in existence for some time, the problems understood and identified by the inventors have remained unresolved. Through diligent effort the inventors have developed a superior method and apparatus for conducting the desired information capture.



FIG. 1 illustrates an exemplary system 100 for gathering research data indicating exposure to audio content by a user in accordance with one or more embodiments of the invention. The system 100 includes an audio source device 102 to provide audio content to a user such as, e.g., a cellular telephone, a portable media player (e.g., an iPod® device), a personal digital assistant (“PDA”), a smartphone (e.g., Blackberry® device), a radio, a television, a game system (e.g., a Gameboy® device), a notebook or laptop or other computer, a GPS device, a DVD player, and a walkie talkie.


The system 100 also includes an audio receiver device 104 such as, e.g., a wireless headset, wireless earphones, or speaker system such as a vehicle speaker system. The audio source device 102 and the audio receiver device 104 are enabled to provide Bluetooth or other personal area network wireless connectivity such that in ordinary use, the audio receiver device 104 receives wireless audio streaming containing audio content from the audio source device and outputs the audio content to be heard by the user.


The system 100 further includes a bridge device 106 for diverting and bridging the audio stream transmitted by the audio source device 102 to the audio receiver device 104. Thus, unlike the ordinary use of the audio source device 102 and the audio receiver device 104 in which the audio source device 102 transmits an audio stream directly to the audio receiver device 104, in accordance with various embodiments of the invention, the audio stream from the audio source device 102 is sent to the bridge device 106, which in turn sends the audio stream to the audio receiver device 104.


The system 100 also includes a monitoring device 108 (sometimes referred to as a “portable people meter”), which is acoustically coupled to the bridge device 106, for generating research data identifying the audio content to which the user is exposed.



FIG. 2 is a block diagram illustrating an exemplary audio source device 102. The audio source device 102 can include a processor 120 that is operative to exercise overall control and to process audio and other data for transmission or reception. The audio source device 102 includes a wireless transmitter node 122 (such as a Bluetooth transmitter node) coupled to the processor 120 to wirelessly transmit audio signals containing audio content. In other embodiments, the audio source device 102 does not include a wireless transmitter node, in which case, a wireless transmitter node is provided in a separate device attached to the audio source device 102. The wireless transmitter node 122 includes a transceiver configured to allow the audio source device 102 to communicate with another device using a wireless protocol such as, e.g., Bluetooth protocol, ZigBee™ protocol, wireless LAN protocol, or via an infrared data link, inductive link or the like, for enabling communications with the bridge device 106 as will be described below.


In some audio source devices 102, the processor 120 can also execute other applications such as, e.g., applications serving to download audio and/or video data, e-mail clients and applications enabling the user to play games using the audio source device 102.


The audio source device 102 can also include storage 124 coupled with processor 120 and operative to store data such as, e.g., audio content, and application programs. In certain embodiments, storage 124 stores software providing audio and/or video downloading and reproducing functionality, such as iPod® software, enabling the user to reproduce audio and/or video content downloaded from a source, such as a personal computer.


In addition, audio source device 102 can also include a user input interface 126 coupled with processor, such as a keypad, to enter telephone numbers and other control data. The audio source device 102 can also include a display 128 coupled with processor 120 to provide data visually to the user under the control of processor 120.



FIG. 3 is a block diagram of an exemplary audio receiver device 104, which can be any Bluetooth or other personal area network enabled device that produces an acoustic output to be heard by the user from received wireless audio signals. As indicated above, audio receiver devices 104 can include, without limitation, wireless headsets, earphones, and speaker systems. The audio receiver device 104 includes a processor 140 that is operative to exercise overall control and to process audio and other data received by the device. The device 104 also includes a wireless receiver node 142 coupled to the processor 140 to receive wireless audio signals containing audio content. The audio receiver device 104 also includes one or more speakers or earphones 144 coupled with processor 140 to transduce received audio signals from processor 140 to an acoustic output to be heard by the user. The audio receiver device 104 also includes a user input interface 148 (such as control buttons for entering data and user commands) coupled with the processor 140, and a display 146 or indicator coupled with the processor device to indicate, e.g., operational status of the device.



FIG. 4A is a block diagram illustrating an exemplary bridge device 106 and an exemplary monitoring device 108 in accordance with certain embodiments of the invention. The bridge device 106 includes a processor 160 that is operative to exercise overall control and to process audio data for transmission and reception. The bridge device 106 bridges wireless audio signals received from the audio source device 102 to the audio receiver device 104. For this purpose, the bridge device 106 includes a wireless receiver node 162 (such as a Bluetooth receiver node) coupled to the processor 160 that wirelessly receives audio signals containing audio content from the audio source device 102, and a wireless transmitter node 164 (such as a Bluetooth transmitter node) coupled to the processor 160 that wirelessly transmits outgoing audio signals containing audio content received from the audio source device 102. The wireless receiver and transmitter nodes 162, 164 of the bridge device 106 each include a transceiver configured to allow the bridge device 106 to communicate with the audio source device 102 and the audio receiver device 104, respectively, using a wireless protocol such as, e.g., Bluetooth protocol, ZigBee™ protocol, wireless LAN protocol, or via an infrared data link, inductive link or the like.


According to certain embodiments of the invention, power supplies 161, 163 are shown in the exemplary bridge device 106 and in the exemplary monitoring device 108 respectively. In various embodiments, these power supplies include, for example, one or more of a disposable electrochemical battery, a rechargeable electrochemical battery, a fuel cell, a capacitive power storage device, a miniature heat engine such as a micro-electro-mechanical system (MEMS) turbine, a miniature generator such as a hand-crank generator, and a electromagnetic energy capture device such as a photovoltaic device, among others known in the art.


In certain embodiments, the wireless receiver node 162 of the bridge device 106 outputs a demodulated audio baseband signal to the processor 160 from the wireless audio signal received from the audio source device 102. The processor 160 transmits the demodulated audio baseband signal to the wireless transmitter module 164, which re-modulates the signal for wireless transmission to the audio receiver device 104.


The processor 160 also transmits the demodulated audio baseband signal to a speaker 166, which transduces the signal to an acoustic output. The acoustic output is received by the monitoring device 108 and used to generate research data identifying the audio content as will be described below.


In certain embodiments, no processor (such as processor 160) is present between the receiver node 162 and the transmitter node 164 such that the audio baseband signal from the receiver node 162 is transmitted to the transmitter node 164 without passing through a processor. The audio baseband signal output by the receiver node is also distributed to the speaker 166. Accordingly, FIG. 4B shows exemplary monitoring device 191 in accordance with certain embodiment of the invention. The bridge device 189 includes a wireless receiver node 167 such as a Bluetooth receiver node mutually coupled to a wireless transmitter node 165 and to a speaker 166. In one embodiment, the speaker 166 includes a driver (i.e. an amplifier) device.


The bridge device 106 also includes a user input coupled with processor 160, such as control buttons 168, 170 each associated with one of the nodes 162, 164 to input user commands to “pair” the device 106 to the audio source device 102 and to the audio receiver device 104 as will be described below. The bridge device 106 also includes one or more indicators 172, 174 (such as LED indicators) coupled with processor 160 to indicate pairing with other devices. In certain embodiments, the control button and indicator for each node are integrated in a single button/indicator.


In certain embodiments, processor 160 comprises two or more processing devices, such as a first processing device (such as a digital signal processor) that processes audio, and a second processing device that exercises overall control over operation of the bridge device 106. In certain embodiments, processor employs a single processing device. In certain embodiments, some or all of the functions of processor are implemented by hardwired circuitry.


The bridge device 106 also includes a power source (not shown) such as a non-rechargeable battery or a rechargeable battery with a battery charge connector.


The monitoring device 108 includes a processor 180 that is operative to exercise overall control and to process audio data from the bridge device 106 for identifying data content therein. The monitoring device 108 also includes a microphone 182 to receive and transduce acoustic energy from the speaker 166 of the bridge device 106 into an electrical signal for processing by processor 180. Analog conditioning circuits (not shown) can be coupled with the microphone 182 to receive the electrical signal from the speaker to perform signal conditioning functions as needed prior to analog-to-digital conversion and processing by the processor 180.


The monitoring device 108 further includes storage 184 (including both program and data storage memories) coupled with processor 180 and operative to store data as needed. In certain embodiments, storage 184 comprises a single storage device, while in others it comprises multiple storage devices. In certain embodiments, a single device implements certain functions of both processor and storage.


In certain embodiments, processor 180 comprises two or more processing devices, such as a first processing device (such as a digital signal processor) that processes audio, and a second processing device that exercises overall control over operation of the monitoring device 108. In certain embodiments, processor 180 employs a single processing device. In certain embodiments, some or all of the functions of processor are implemented by hardwired circuitry.


The monitoring device 108 also includes a power source (not shown) such as a non-rechargeable battery or a rechargeable battery with a battery charge connector.


To enable the monitoring device 108 to gather research data, namely data indicating exposure to audio content such as programs, music and advertisements, in certain embodiments, research software is installed in storage 184 to control processor 180 to gather such data and to store the data for subsequent downloading through output connection 186 and communication to a research organization. In certain embodiments, the monitoring device 108 further includes a transceiver (such as a cellular telephone transceiver—not shown) configured to communicate with and transmit the research data to the research organization.


In certain embodiments, the research software controls the processor 180 to decode ancillary codes in the transduced audio from microphone 182 using one or more of the known techniques identified herein, and then to store and/or communicate the decoded data for use as research data indicating encoded audio to which the user was exposed. In certain embodiments, the research software controls the processor 180 to extract signatures from the transduced audio from microphone 182 using one or more of the known techniques identified herein, and then to store and/or communicate the extracted signature data for use as research data to be matched with reference signatures representing known audio to detect the audio to which the user was exposed. In certain embodiments, the research software both decodes ancillary codes in the transduced audio and extracts signatures therefrom for identifying the audio to which the user was exposed. In certain embodiments, the research software controls the processor 180 to store samples of the transduced audio, either in compressed or uncompressed form for subsequent processing either to decode ancillary codes therein or to extract signatures therefrom. In certain ones of these embodiments, the compressed or uncompressed audio is communicated to a remote processor for decoding and/or signature extraction.


In certain embodiments, processor 180 adds a time and/or date stamp to the research data.


In certain embodiments, processor 180 comprises two or more processing devices, such as a first processing device (such as a digital signal processor) that processes audio data, and a second processing device that exercises overall control over operation of the monitoring device 108. In certain embodiments, processor 180 employs a single processing device. In certain embodiments, some or all of the functions of processor 180 are implemented by software, while in other embodiments, the functions of processor 180 are implemented in hardwired circuitry without the use of software.


As shown in FIG. 1, in certain embodiments, the bridge device 106 is configured as a sleeve or holster to hold the monitoring device 108. The monitoring device 108 is preferably closely fitted within the bridge device 106 such that the speaker 166 in the bridge device 106 and the microphone 182 in the monitoring device 108 are close proximity. Close positioning of the speaker 166 and microphone 182 allows a low-volume acoustic output from the bridge device 106 to be used by the monitoring device 108 to identify the audio content thereby reducing the acoustic output heard by the user, which might be an annoyance. The bridge device 106 is preferably made of rubber and plastic to provide some degree of water and shock resistance protection for the bridge device 106 and the monitoring device 108 held therein.


In certain embodiments, the bridge device 106 and the monitoring device 108 are integrated in a single device.


In certain embodiments, the wireless nodes (particularly if they follow the Bluetooth protocol) of the audio source device 102, the audio receiver device 104, and the bridge device 106 must be “paired” before the research system can be operated. In particular, the user pairs the wireless receiver node 162 of the bridge device 106 with the wireless transmitter node 122 of the audio source device 102, and also pairs the wireless transmitter node 164 of the bridge device 106 with the wireless receiver node 142 of the audio receiver device 104. Pairing can be established, e.g., by pressing one of the pairing button 168, 170 associated with one node 162, 164 on the bridge device 106 while activating a pairing function at a corresponding audio source device 102 or audio receiver device 104, and then repeating the process for the other node 162, 164 on the bridge device 106. The LED indicators 170, 172 on the bridge device 106 can indicate established pairings.


Once the wireless nodes have been paired, audio data can be sent from the audio source device 102 to the bridge device 106, and from the bridge device 106 to the audio receiver device 104. Bluetooth wireless transmitter nodes encode audio data into a selected format and pack the encoded audio data into a payload, which is the data portion of a digital data packet. The data packets are optionally encrypted, and delivered through an asynchronous connectionless link to a Bluetooth wireless receiver node. A generally reverse operation is performed at the Bluetooth wireless receiver node.


Bluetooth wireless transmitter and receiver nodes suitable for use in the bridge device 106 are commercially available, e.g., from manufacturers such as, BluePioneer, Darvon, and BluePacket Communications, built from Bluetooth microprocessors made, e.g., by Broadcom and Cambridge Silicon Radio.


In certain embodiments, the wireless transmitter node 164 and the wireless receiver node 162 of the bridge device 106 provide wireless signal bridging for stereo audio signals. In particular, if the nodes 162, 164 are Bluetooth nodes, they can follow the Advanced Audio Distribution Profile (A2DP) protocol, which is designed to transfer a two channel stereo audio stream. Thus, in accordance with various embodiments of the invention, the system 100 can be used to monitor exposure of a user to audio content as the audio content is transmitted to the user in a stereo audio stream.


As illustrated in FIG. 5, a multicasting bridge device 200 is provided in accordance with certain alternate embodiments of the invention. The bridge device 200 includes a single wireless receiver node 202 for communicating with an audio source device 102, and two or more wireless transmitter nodes 204, 206, 208, each of which can be paired with a wireless receiver node of a different audio receiver device 104. A processor 210 in the bridge device 200 sends the signal received from the wireless receiver module 202 to each of the wireless transmitter nodes 204, 206, 208. The processor 210 also transmits a demodulated audio baseband signal to a speaker 212, which transduces the signal to an acoustic output, which is received by a monitoring device 108 and used to generate data identifying the audio content as previously discussed. The device allows multiple users to wirelessly receive audio content from a single audio source device 102. This structure also allows a single bridge device 200 to be used to monitor the exposure of multiple users to audio content at a time. In one embodiment, a power supply 213 is included in the bridge device 200.


The bridge device 200 can provide wireless signal bridging for stereo audio signals. The nodes 202, 204, 206, 208 can be Bluetooth nodes following the A2DP protocol to provide stereo audio streaming, with the processor 210 acting as a stereo audio distributor. Thus, bridge device 200 can be used to distribute stereo audio signals wirelessly to a plurality of users.


A bridge device 220 in accordance with further alternate embodiments of the invention is shown in FIG. 6. In this device, the functionality of the wireless receiver node and the wireless transmitter node of the bridge device 106 (FIG. 4) are integrated in a single integrated node 222 coupled to a processor 224. The data packets received at the integrated node 222 from the audio source device 102 are transmitted to the wireless receiver node 142 of the audio receiver device 104 without being demodulated and again modulated at the bridge device 220 before being sent. The integrated node 222 outputs a demodulated audio baseband signal that is sent to a speaker 226, which transduces the signal to an acoustic output, which is received by a monitoring device 108 and used to identify the audio content as previously discussed.


Various monitoring techniques by the monitoring device 108 for identifying audio content are possible. For example, television viewing or radio listening habits, including exposure to commercials therein, can be monitored utilizing a variety of techniques. In certain techniques, acoustic energy to which an individual is exposed is monitored to produce data that identifies or characterizes a program, song, station, channel, commercial, etc. that is being watched or listened to by the individual. Where audio media includes ancillary codes that provide such information, suitable decoding techniques are employed to detect the encoded information, such as those disclosed in U.S. Pat. Nos. 5,450,490 and 5,764,763 to Jensen, et al., U.S. Pat. No. 5,579,124 to Aijala, et al., U.S. Pat. Nos. 5,574,962, 5,581,800 and 5,787,334 to Fardeau, et al., U.S. Pat. No. 6,871,180 to Neuhauser, et al., U.S. Pat. No. 6,862,355 to Kolessar, et al., U.S. Pat. No. 6,845,360 to Jensen, et al., U.S. Pat. No. 5,319,735 to Preuss et al., U.S. Pat. No. 5,687,191 to Lee, et al., U.S. Pat. No. 6,175,627 to Petrovich et al., U.S. Pat. No. 5,828,325 to Wolosewicz et al., U.S. Pat. No. 6,154,484 to Lee et al., U.S. Pat. No. 5,945,932 to Smith et al., U.S. Patent Application Publication No. 2001/0053190 to Srinivasan, U.S. Patent Application Publication No. 2003/0110485 to Lu, et al., U.S. Pat. No. 5,737,025 to Dougherty, et al., U.S. Patent Application Publication No. 2004/0170381 to Srinivasan, and WO 06/14362 to Srinivasan, et al., all of which hereby are incorporated by reference herein.


Examples of techniques for encoding ancillary codes in audio, and for reading such codes, are provided in Bender, et al., “Techniques for Data Hiding”, IBM Systems Journal, Vol. 35, Nos. 3 & 4, 1996, which is incorporated herein in its entirety. Bender, et al. disclose a technique for encoding audio termed “phase encoding” in which segments of the audio are transformed to the frequency domain, e.g., by a discrete Fourier transform (DFT), so that phase data is produced for each segment. Then the phase data is modified to encode a code symbol, such as one bit. Processing of the phase encoded audio to read the code is carried out by synchronizing with the data sequence, and detecting the phase encoded data using the known values of the segment length, the DFT points and the data interval.


Bender, et al. also describe spread spectrum encoding and decoding, of which multiple embodiments are disclosed in the above-cited Aijala, et al. U.S. Pat. No. 5,579,124.


Still another audio encoding and decoding technique described by Bender, et al. is echo data hiding, in which data is embedded in a host audio signal by introducing an echo. Symbol states are represented by the values of the echo delays, and they are read by any appropriate processing that serves to evaluate the lengths and/or presence of the encoded delays.


A further technique or category of techniques, termed “amplitude modulation” is described in R. Walker, “Audio Watermarking”, BBC Research and Development, 2004. In this category fall techniques that modify the envelope of the audio signal, e.g., by notching or otherwise modifying brief portions of the signal, or by subjecting the envelope to longer term modifications. Processing the audio to read the code can be achieved by detecting the transitions representing a notch or other modifications, or by accumulation or integration over a time period comparable to the duration of an encoded symbol, or by another suitable technique.


Another category of techniques identified by Walker involves transforming the audio from the time domain to some transform domain, such as a frequency domain, and then encoding by adding data or otherwise modifying the transformed audio. The domain transformation can be carried out by a Fourier, DCT, Hadamard, Wavelet or other transformation, or by digital or analog filtering. Encoding can be achieved by adding a modulated carrier or other data (such as noise, noise-like data or other symbols in the transform domain) or by modifying the transformed audio, such as by notching or altering one or more frequency bands, bins or combinations of bins, or by combining these methods. Still other related techniques modify the frequency distribution of the audio data in the transform domain to encode. Psychoacoustic masking can be employed to render the codes inaudible or to reduce their prominence. Processing to read ancillary codes in audio data encoded by techniques within this category typically involves transforming the encoded audio to the transform domain and detecting the additions or other modifications representing the codes.


A still further category of techniques identified by Walker involves modifying audio data encoded for compression (whether lossy or lossless) or other purpose, such as audio data encoded in an MP3 format or other MPEG audio format, AC-3, DTS, ATRAC, WMA, RealAudio, Ogg Vorbis, APT X100, FLAC, Shorten, Monkey's Audio, or other. Encoding involves modifications to the encoded audio data, such as modifications to coding coefficients and/or to predefined decision thresholds. Processing the audio to read the code is carried out by detecting such modifications using knowledge of predefined audio encoding parameters.


It will be appreciated that various known encoding techniques may be employed, either alone or in combination with the above-described techniques. Such known encoding techniques include, but are not limited to FSK, PSK (such as BPSK), amplitude modulation, frequency modulation and phase modulation.


In some cases a signature is extracted from transduced media data for identification by matching with reference signatures of known media data. Suitable techniques for this purpose include those disclosed in U.S. Pat. No. 5,612,729 to Ellis, et al. and in U.S. Pat. No. 4,739,398 to Thomas, et al., each of which is assigned to the assignee of the present application and both of which are incorporated herein by reference in their entireties.


Still other suitable techniques are the subject of U.S. Pat. No. 2,662,168 to Scherbatskoy, U.S. Pat. No. 3,919,479 to Moon, et al., U.S. Pat. No. 4,697,209 to Kiewit, et al., U.S. Pat. No. 4,677,466 to Lert, et al., U.S. Pat. No. 5,512,933 to Wheatley, et al., U.S. Pat. No. 4,955,070 to Welsh, et al., U.S. Pat. No. 4,918,730 to Schulze, U.S. Pat. No. 4,843,562 to Kenyon, et al., U.S. Pat. No. 4,450,551 to Kenyon, et al., U.S. Pat. No. 4,230,990 to Lert, et al., U.S. Pat. No. 5,594,934 to Lu, et al., European Published Patent Application EP 0887958 to Bichsel and PCT publication WO91/11062 to Young, et al., all of which are incorporated herein by reference in their entireties.


An advantageous signature extraction technique transforms audio data within a predetermined frequency range to the frequency domain by a transform function, such as an FFT. The FFT data from an even number of frequency bands (for example, eight, ten, sixteen or thirty two frequency bands) spanning the predetermined frequency range are used two bands at a time during successive time intervals.


When each band is selected, the energy values of the FFT bins within such band and such time interval are processed to form one bit of the signature. If there are ten FFT's for each interval of the audio signal, for example, the values of all bins of such band within the first five FFT's are summed to form a value “A” and the values of all bins of such band within the last five FFT's are summed to form a value “B”. In the case of a received broadcast audio signal, the value A is formed from portions of the audio signal that were broadcast prior to those used to form the value B.


To form a bit of the signature, the values A and B are compared. If B is greater than A, the bit is assigned a value “1” and if A is greater than or equal to B, the bit is assigned a value of “0”. Thus, during each time interval, two bits of the signature are produced.


One advantageous technique carries out either or both of code detection and signature extraction remotely from the location where the research data is gathered, as disclosed in U.S. Patent Application Publication No. 2003/0005430 published Jan. 2, 2003 to Ronald S. Kolessar, which is assigned to the assignee of the present application and is hereby incorporated herein by reference in its entirety.


While the invention has been described in detail in connection with the presently preferred embodiments, it should be readily understood that the invention is not limited to such disclosed embodiments. Rather, the invention can be modified to incorporate any number of variations, alterations, substitutions, or equivalent arrangements not heretofore described, but which are commensurate with the spirit and scope of the invention. Accordingly, the invention is not to be seen as limited by the foregoing description, but is only limited by the scope of the appended claims.

Claims
  • 1. An apparatus for gathering research data indicating exposure to media, the apparatus comprising: a first wireless receiver to receive a first modulated audio signal via a wireless data connection from a media device using a wireless communication protocol, the first modulated audio signal associated with the media, the first wireless receiver to output a baseband audio signal corresponding to the first modulated audio signal;a first wireless transmitter to modulate the baseband audio signal to form a second modulated audio signal, the first wireless transmitter to transmit the second modulated audio signal to wireless headphones using the wireless communication protocol; anda monitoring device to receive the baseband audio signal, and to generate research data identifying the media, the media device including a second wireless transmitter to transmit the first modulated audio signal to the first wireless receiver, and the wireless headphones including a second wireless receiver to receive the second modulated audio signal from the first wireless transmitter.
  • 2. The apparatus of claim 1, wherein the wireless communication protocol comprises at least one of a Bluetooth protocol, a ZigBee protocol, a wireless LAN protocol, an infrared data link, or an inductive link.
  • 3. The apparatus of claim 1, further including a processor to receive the baseband audio signal from the first wireless receiver, the processor to transmit the baseband audio signal to the first wireless transmitter, the processor to transmit the baseband audio signal to the monitoring device.
  • 4. The apparatus of claim 1, wherein the media device is at least one of a cellular telephone, a portable media player, a personal digital assistant, a smartphone, a radio, a television, a game system, a computer, a GPS device, a DVD player, or a walkie-talkie.
  • 5. The apparatus of claim 1, further including a speaker to emit the baseband audio signal to the monitoring device, wherein the monitoring device includes: a microphone to receive the baseband audio signal from the speaker; anda processor to generate the research data identifying the media based on the received baseband audio signal.
  • 6. The apparatus of claim 1, wherein the monitoring device is to decode a code identifying the media or to extract an audio signature identifying the media from the baseband audio signal.
  • 7. The apparatus of claim 1, wherein the wireless headphones are first wireless headphones, and further including a third wireless transmitter to modulate the baseband audio signal to form a third modulated audio signal, the third wireless transmitter to transmit the third modulated audio signal to second wireless headphones.
  • 8. The apparatus of claim 1, further including: a first pairing button to cause the first wireless receiver to pair with the media device; anda second pairing button to cause the first wireless transmitter to pair with the wireless headphones.
  • 9. An apparatus to monitor a media presentation, the apparatus comprising: a housing defining a holster dimensioned to receive a monitoring device, the monitoring device to monitor the media presentation;a receiver carried by the housing to receive a first modulated audio signal from an audio source device via a wireless data connection using a wireless communication protocol, the first modulated audio signal associated with the media presentation, the receiver to output a baseband audio signal corresponding to the first modulated audio signal;a speaker carried by the housing to emit the baseband audio signal for receipt by the monitoring device;a transmitter carried by the housing to modulate the baseband audio signal to form a second modulated audio signal, the transmitter to transmit the second modulated audio signal to an audio receiver using the wireless communication protocol;a first pairing button to cause the receiver to pair with the audio source device; anda second pairing button to cause the transmitter to pair with the audio receiver.
  • 10. The apparatus of claim 9, wherein the wireless communication protocol includes at least one of a Bluetooth protocol, a ZigBee protocol, a wireless LAN protocol, an infrared data link, or an inductive link.
  • 11. The apparatus of claim 9, further including a processor to receive the baseband audio signal from the receiver, the processor to transmit the baseband audio signal to the transmitter, the processor to transmit the baseband audio signal to the speaker.
  • 12. The apparatus of claim 9, wherein the audio source device is at least one of a cellular phone, a portable media player, a personal digital assistant, a smartphone, a radio, a television, a game system, a computer, a GPS device, a DVD player, or a walkie-talkie.
  • 13. The apparatus of claim 9, wherein the monitoring device includes: a microphone to receive the baseband audio signal from the speaker; anda processor to generate research data identifying media associated with the media presentation based on the received baseband audio signal.
  • 14. The apparatus of claim 13, wherein the monitoring device is to decode a code identifying the media or to extract an audio signature identifying the media from the baseband audio signal.
  • 15. The apparatus of claim 13, wherein the speaker is oriented to emit the baseband audio signal in the holster towards the microphone of the monitoring device.
  • 16. An apparatus for gathering research data indicating exposure to media, the apparatus comprising: a housing dimensioned to receive a portable people meter, the portable people meter to monitor a media presentation;a wireless receiver carried by the housing to receive a first modulated audio signal via a wireless data connection from a media device using a wireless communication protocol, the first modulated audio signal associated with the media, the wireless receiver to output a baseband audio signal corresponding to the first modulated audio signal;a speaker carried by the housing to emit the baseband audio signal for receipt by the portable people meter; andthe portable people meter to be received by the housing to receive the baseband audio signal from the speaker, and to generate research data identifying the media.
  • 17. The apparatus as described in claim 16, wherein the media device is a cellular phone.
  • 18. The apparatus of claim 16, wherein the housing further includes a pairing button to cause the wireless receiver to pair with the media device.
  • 19. The apparatus of claim 16, wherein the wireless communication protocol includes at least one of a Bluetooth protocol, a ZigBee protocol, a wireless LAN protocol, an infrared data link, or an inductive link.
  • 20. The apparatus of claim 16, wherein the portable people meter includes: a microphone to receive the baseband audio signal from the speaker; anda processor to generate research data identifying media associated with the media presentation based on the received baseband audio signal.
  • 21. The apparatus of claim 20, wherein the portable people meter is to decode a code identifying the media or to extract an audio signature identifying the media from the baseband audio signal.
  • 22. The apparatus of claim 16, wherein the speaker is oriented to emit the baseband audio signal in the housing towards a microphone of the portable people meter.
RELATED APPLICATION

This patent arises from a continuation of U.S. patent application Ser. No. 16/902,061, filed on Jun. 15, 2020, and entitled “METHODS AND APPARATUS TO MONITOR A MEDIA PRESENTATION”, which is a continuation of U.S. patent application Ser. No. 16/208,497, filed on Dec. 3, 2018, and entitled “METHODS AND APPARATUS TO MONITOR A MEDIA PRESENTATION”, which is a continuation of U.S. patent application Ser. No. 15/477,711, filed on Apr. 3, 2017, and entitled “METHODS AND APPARATUS TO MONITOR A MEDIA PRESENTATION”, which is a continuation of U.S. patent application Ser. No. 14/577,888, filed on Dec. 19, 2014, and entitled “METHODS AND APPARATUS TO MONITOR A MEDIA PRESENTATION”, which is a continuation of U.S. patent application Ser. No. 12/006,452, filed on Dec. 31, 2007, and entitled “DATA CAPTURE BRIDGE”. Priority to U.S. patent application Ser. No. 16/902,061, U.S. patent application Ser. No. 16/208,497, U.S. patent application Ser. No. 15/477,711, U.S. patent application Ser. No. 14/577,888, and U.S. patent application Ser. No. 12/006,452 is hereby claimed. U.S. patent application Ser. No. 16/902,061, U.S. patent application Ser. No. 16/208,497, U.S. patent application Ser. No. 15/477,711, U.S. patent application Ser. No. 14/577,888, and U.S. patent application Ser. No. 12/006,452 are hereby incorporated herein by reference in their entireties.

US Referenced Citations (68)
Number Name Date Kind
2662168 Scherbatskoy Dec 1953 A
3919479 Moon et al. Nov 1975 A
4230990 Lert, Jr. et al. Oct 1980 A
4450551 Kudo et al. May 1984 A
4677466 Lert, Jr. et al. Jun 1987 A
4697209 Kiewit et al. Sep 1987 A
4739398 Thomas et al. Apr 1988 A
4843562 Kenyon et al. Jun 1989 A
4918730 Schulze Apr 1990 A
4955070 Welsh et al. Sep 1990 A
5319735 Preuss et al. Jun 1994 A
5450490 Jensen et al. Sep 1995 A
5512933 Wheatley et al. Apr 1996 A
5574962 Fardeau et al. Nov 1996 A
5579124 Aijala et al. Nov 1996 A
5581800 Fardeau et al. Dec 1996 A
5594934 Lu et al. Jan 1997 A
5612729 Ellis et al. Mar 1997 A
5687191 Lee et al. Nov 1997 A
5737025 Dougherty et al. Apr 1998 A
5764763 Jensen et al. Jun 1998 A
5787334 Fardeau et al. Jul 1998 A
5828325 Wolosewicz et al. Oct 1998 A
5945932 Smith et al. Aug 1999 A
6154484 Lee et al. Nov 2000 A
6175627 Petrovic et al. Jan 2001 B1
6539358 Coon et al. Mar 2003 B1
6621881 Srinivasan Sep 2003 B2
6845360 Jensen et al. Jan 2005 B2
6862355 Kolessar et al. Mar 2005 B2
6871180 Neuhauser et al. Mar 2005 B1
7222071 Neuhauser et al. May 2007 B2
7324824 Smith et al. Jan 2008 B2
RE42627 Neuhauser et al. Aug 2011 E
8019449 Barzegar et al. Sep 2011 B2
8027282 Boehnke et al. Sep 2011 B2
8116401 Ibrahim et al. Feb 2012 B2
8295766 Zimbric et al. Oct 2012 B2
8335576 Bradshaw et al. Dec 2012 B1
8930003 Krug et al. Jan 2015 B2
9614881 Krug et al. Apr 2017 B2
10148317 Krug et al. Dec 2018 B2
10715214 Krug et al. Jul 2020 B2
20010003166 Gulick Jun 2001 A1
20010053190 Srinivasan Dec 2001 A1
20030005430 Kolessar Jan 2003 A1
20030061490 Abajian Mar 2003 A1
20030110485 Lu et al. Jun 2003 A1
20030229900 Reisman Dec 2003 A1
20040064319 Neuhauser et al. Apr 2004 A1
20040230332 Cheng Nov 2004 A1
20050054285 Mears et al. Mar 2005 A1
20050144632 Mears et al. Jun 2005 A1
20050267750 Steuer et al. Dec 2005 A1
20060195861 Lee Aug 2006 A1
20060269004 Ibrahim et al. Nov 2006 A1
20070115827 Boehnke et al. May 2007 A1
20070142024 Clayton et al. Jun 2007 A1
20070155430 Cheon et al. Jul 2007 A1
20070259621 Lin et al. Nov 2007 A1
20070260682 Guccione Nov 2007 A1
20080049704 Witteman et al. Feb 2008 A1
20080263579 Mears et al. Oct 2008 A1
20090034750 Ayoub et al. Feb 2009 A1
20090061769 Zimbric et al. Mar 2009 A1
20090068949 Lin Mar 2009 A1
20090169024 Krug et al. Jul 2009 A1
20150112466 Krug et al. Apr 2015 A1
Foreign Referenced Citations (8)
Number Date Country
2008347051 Jul 2009 AU
0887958 Jan 2003 EP
2227865 Sep 2010 EP
9111062 Jul 1991 WO
2005038625 Apr 2005 WO
2005041109 May 2005 WO
2006014362 Feb 2006 WO
2009088485 Jul 2009 WO
Non-Patent Literature Citations (28)
Entry
European Patent Office, “Search Report,” issued in connection with European Patent Application No. 20163604.0, dated Jun. 2, 2020, 7 pages.
European Patent Office, “European Patent Office,” issued in connection with European Patent Application No. 20163604.0, dated May 29, 2020, 9 pages.
Goss et al., “Spectral Retrieval By Fuzzy Matching,” Analytical Proceedings Including Analytical Communications, vol. 31, Jan. 1994, 3 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/208,497, dated Oct. 23, 2019, 14 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/208,497, dated Feb. 12, 2020, 7 pages.
European Patent Office, “First Examination Report,” issued in connection with European Patent Application No. 08870324.4 dated Apr. 26, 2018, 11 pages.
Apple Inc., “AirPort Express”, [www.apple.com/airport], 2007, 56 pages.
Bender et al.,“Techniques for Data Hiding,” IBM Systems Journal, 1996, vol. 35, Nos. 34, 24 pages.
Canadian Intellectual Property Office, “Office Action,” issued in connection with Canadian Patent Application No. 2,710,836, dated Jul. 14, 2015, 4 pages.
Canadian Intellectual Property Office, “Notice of Allowance,” issued in connection with Canadian Patent Application No. 2,710,836, dated Oct. 18, 2016, 1 page.
European Patent Office, “Communication Pursuant to Article 94(3) EPC,” issued in connection with European Application No. 10008093.6 dated Aug. 17, 2016, 8 pages.
IP Australia, “Examination Report No. 1,” issued in connection with corresponding Australian Patent Application No. 2008347051, dated Oct. 31, 2012, 3 pages.
IP Australia, “Notice of Acceptance”, issued in connection with corresponding Australian Patent Application No. 2008347051, dated Jan. 7, 2013, 1 page.
International Searching Authority “International Search Report and Written Opinion,” issued in connection with corresponding International Patent Application No. PCT/US2008/014142, dated Mar. 3, 2009, 9 pages.
R. Walker, “Audio Watermarking,” BBC Research and Development, Aug. 2004, 17 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/006,452, dated Jul. 12, 2011, 6 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/006,452, dated Nov. 18, 2011, 12 pages.
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 12/006,452, dated Apr. 26, 2012, 14 pages.
United States Patent and Trademark Office, “Advisory Action,” issued in connection with U.S. Appl. No. 12/006,452, dated Aug. 3, 2012, 3 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 12/006,452, dated Oct. 28, 2013, 13 pages.
United States Patent and Trademark Office, “Notice of Allowance,” Issued in connection with U.S. Appl. No. 12/006,452, dated Apr. 17, 2014, 17 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 12/006,452, dated Sep. 5, 2014, 5 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/577,888, dated Dec. 6, 2016, 6 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/577,888, dated Jun. 23, 2016, 8 pages.
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/477,711, dated Jul. 27, 2018, 8 pages.
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/902,061, dated Oct. 13, 2021, 14 pages.
United States Patent and Trademark Office, “Notice of Allowance and Fee(s) Due,” issued in connection with U.S. Appl. No. 16/902,061, dated Mar. 25, 2022, 9 pages.
European Patent Office, “Communication pursuant to Article 94(3) EPC,” issued in connection with European Patent Application No. 20163604.0, dated Aug. 5, 2022, 5 pages.
Related Publications (1)
Number Date Country
20220337288 A1 Oct 2022 US
Continuations (5)
Number Date Country
Parent 16902061 Jun 2020 US
Child 17856766 US
Parent 16208497 Dec 2018 US
Child 16902061 US
Parent 15477711 Apr 2017 US
Child 16208497 US
Parent 14577888 Dec 2014 US
Child 15477711 US
Parent 12006452 Dec 2007 US
Child 14577888 US