The present application claims priority to United Kingdom Patent Application No. GB 1914862.6 to Liam Whiteside, et al., filed Oct. 14, 2019, and entitled “Audio-Based User Matching”, and incorporates its disclosure herein by reference in its entirety.
This invention relates to a method for establishing one or more personal characterisations of a user of an audio content stream.
Targeted advertising is a commonly used form of advertising that provides retailers with an opportunity to identify consumers that may be interested in their products and to track the purchases of those consumers in response to their advertisements. In online targeted advertising, when a user accesses the webpage of a retailer, a data tag known as a cookie is generated on the user's device and is sent to the server of the retailer. The cookie comprises details such as information about the user, the webpages that the user has searched and their location. The retailer can use this information to build a profile of the user, and to target advertisements to the user that are determined to complement this profile. By implementing this technique, the retailer increases the chance of the users that receive their advertisements being motivated by the advertisements to purchase their products.
The targeted advertising methods described above cannot generally be used for profiling users that are exposed to audio advertisements whilst listening to audio content. Firstly, as the streaming of audio often does not require the use of a webpage, cookie-based identification cannot be used reliably. Secondly, users streaming audio content often do not have to provide login details to access this content, and so user identification is further hindered. There is therefore currently an inability to identify many of the users listening to an audio stream, and so an inability to provide targeted audio advertisements to such users. There is also an inability to track the users' response to an advertisement that they are exposed to over an audio stream.
There is a need for a method of providing targeted advertising to listeners of an audio content stream.
According to a first aspect of the present invention there is provided a method for establishing one or more personal characterisations of a user of an audio content stream, the method comprising: storing a plurality of predetermined relationships between one or more receiving conditions of transmissions and one or more personal characterisations of a user; transmitting a first transmission comprising the audio content stream to a receiving device; receiving, from the receiving device, one or more receiving conditions of the first transmission; and comparing the one or more receiving conditions received from the receiving device with the plurality of predetermined relationships to establish one or more personal characterisations of the user of the first receiving device.
According to a second aspect of the present invention there is provided a method for establishing a mutual identity of a user of an audio content stream on a plurality of receiving devices, the method comprising: transmitting a first transmission comprising the audio content stream to a first receiving device; receiving, from the first receiving device, a first set of information comprising one or more receiving conditions of the first transmission; transmitting a second transmission comprising the audio content stream to a second receiving device; receiving, from the second receiving device, a second set of information comprising one or more receiving conditions of the second transmission; comparing the receiving conditions from the first set of information and the second set of information; determining that the identity of the user of the first receiving device is the same as an identity of a user of the second receiving device if the comparison of the receiving conditions from the first set of information and the receiving conditions of the second set of information fulfils one or more predetermined match conditions.
One of the one or more of the receiving conditions may be a temporal indicator.
The temporal indicator may be the time at which the first transmission is transmitted.
The temporal indicator may be a number of times the audio content of the first transmission is accessed.
The temporal indicator may be a duration for which the first transmission is transmitted to the first receiving device.
The identification that the identity of the user of the first receiving device is the same as the identity of the user of a second receiving device may comprise determining, from the first set of information, that the streaming of the audio content is terminated on the first receiving device at a first time and determining, from the second set of information, that the streaming is initiated on the second receiving device at a second specified time, the first and the second specified times differing from each other less than a predetermined threshold
The one or more personal characterisations of the user may include one or more of age, gender, profession, social classification and interests.
One of the one or more receiving conditions may be a geographical indicator.
The geographical indicator may indicate the IP address from which the first device is receiving the first transmission.
One of the one or more receiving conditions may be a content indicator.
The content indicator may be selected from a group comprising a name of a radio station, a type of content, a song or an artist.
One of the one or more receiving conditions may be an indication of the identity of the device.
The indication of the identity of the device may indicate that the first device is relaying the first transmission to the user using a Bluetooth connection.
The indication of the identity of the device may indicate that the user is accessing the audio stream using a pair of headphones.
The comparison between the first set of information and the prestored relationship may be conducted by measuring the vectoral displacement of the data of the first set of information from the data of the prestored relationship.
The vectoral displacement may be established by determining the cosine of the angle between a first non-zero vector representing a predetermined relationship for a personal characterisation of a user and a second non-zero vector representing two receiving conditions received from the receiving device.
The method may further comprise selecting an interstitial item for insertion into the audio content stream from a plurality of interstitial items in dependence on the one or more personal characterisations that have been identified for the user.
The interstitial items to be selected may be advertisements.
The present invention will now be described by way of example with reference to the accompanying drawings. In the drawings,
The media playout system comprises a management suite 104 that has access to both the primary programming provided from either the live entertainment source 101 or the first media store 102 and the interstitial items stored in the second store 103. The management suite 104 collates the primary programming and the interstitial items to generate a content stream that can be streamed to one or more users. The management suite 104 may intersperse one or more advertisements retrieved from the advertisement store into the main content in order to create the content stream to be played out. The content stream may be played out from its start at a time when it is requested by a user (in other words, it may be played out on demand), or it may be played out with a predetermined start time that is independent of when it is requested by a consumer.
Different content streams may be provided to different consumers for the same main content. For some users, interstitial items may not be provided between their primary content. Other users may receive content streams that comprise different interstitial items for their main content. The management suite 104 stores in a database 105 an indication of which interstitial items have been played to which consumers.
The content streams to be played out are passed through the management suite 104 to a media server 106. The media server 106 encodes each content stream into a suitable digital format and transmits it over the internet 107 to any devices that have requested it. Examples of devices that may receive the content stream are smart speakers 108, mobile devices 109 and fixed computing devices 110. Different devices can be used to receive the media streams depending on the preference of an individual user. In some examples, the same user may own multiple receiving devices, and may use these multiple receiving devices to listen to the content stream. When any of the devices 108, 109, 110 receive the media feed, a processor of the device decodes the media feed into audio data and a user interface and the device plays out that audio data. For some devices, the user interface could include a loudspeaker and/or a display.
When a content stream is provided to a receiving device 108, 109, 110, its metadata may be transmitted to the device together with the media content. In addition to indicating the identity of the item and/or an attribute of the item, the metadata may also indicate one or more receiving conditions of the content stream by the receiving device. A receiving condition may be defined as any criterion that indicates a condition in which the transmission was received. Examples of receiving conditions include the time of day at which the transmission was received, or the radio station that it was received from.
In addition to storing an indication of which interstitial items have been played to consumers, the database 105 comprises information indicating a plurality of predetermined relationships between a number of receiving conditions of a content stream and one or more personal characterisations of a user. A personalised characterisation may be defined as a demographic characteristic of a user, or a classifiable characteristic of a given population such as age, gender or social classification. Media server 106 is configured to store one or more receiving conditions of the content stream when a stream of media content is transmitted to one or more of the receiving devices 108, 109, 110, and to compare one or more of these receiving conditions to the plurality of predetermined relationships in order to identify one or more personal characterisations of the user of the receiving device.
The media playout system further comprises an additional server 111 that can be accessed by any of the devices 108, 109, 110 over the internet 107. The other server could be a web server. It could operate a commerce site such as an online shop or store, by means of which products or services can be acquired or consumed. The server 111 has access to a data store 112 which holds the content to be provided to the server 111. That may, for example, be information defining a set of webpages to be served by the server 111, how to take payment for products or services, and how to initiate the supply of products or services once payment has been made.
When any of the receiving devices 108, 109, 110 accesses the server 111, the server 111 instructs the receiving device to report information to server 113 including the identity of the user of the receiving device and what content it was accessing from server 111. The receiving device transmits to server 113 one or more messages indicating the content that it was accessing from the server. The content may be identified in that/those messages by its address (e.g. URL) or any other identity such as its title or a unique reference by which the content is designated on server 111. Server 113 adds this to the history in database 105.
The method starts at step 201, where a plurality of predetermined relationships between one or more receiving conditions of transmissions and one or more personal characterisation of a user is stored in the database 105. The predetermined relationships may be created using a predefined algorithm and may be defined using user survey data or alternative analytical research. All of the predetermined relationships to be stored in the database 105 are stored in advance of the proceeding method steps. The predetermined relationships will be described in further detail below, with reference to
At step 202 the content stream is transmitted, from the media server 106, to one or more of the receiving devices 108, 109, 110. The content stream comprises the main content that is recorded from either the live entertainment source 101 or the first media store 102 and one or more interstitial items that are obtained from the second media store 103. The content stream may be transmitted to the user in real-time, or alternatively may be transmitted on-demand. In one example, when the content stream is transmitted to a receiving device, the media server creates and stores a set of metadata indicating the receiving conditions of the transmission. This metadata may be stored in the database 105 that is connected to the server, and in some examples is transmitted with the content stream to the receiving device. In an alternative example, the metadata may be created by the receiving device when it receives the content stream. In this example, when a receiving device receives the content stream, that device transmits the metadata to the media server 106 which stores the data in the database 105.
At step 203, the metadata is received at the media server, either because it has been created at the media server 106 or transmitted from one or more receiving devices 108, 109, 110. Once the media server 106 receives the metadata it proceeds to compare the one or more receiving conditions comprised within the metadata with the plurality of predetermined relationships received stored in the database 105. This step is illustrated at step 204 of
The receiving conditions of the transmission of a content stream can be used to establish a personal characterisation of a user of a receiving device or may indicate a number of characteristics associated with the transmission. In one example, a receiving condition may be a temporal indicator, such as the time (e.g. time of day or day of the week) at which the content stream is transmitted to the receiving device. This may indicate the time at which the user is exposed to the content stream. Alternatively, the temporal indicator may be the frequency or number of times that the user is listening to content. The temporal indicator may also be the duration for which the transmission is transmitted to the first receiving device. In a second example, a receiving condition may be a content indicator that indicates the type of content that is being transmitted to the receiving device. Examples of content indicators that may be identified are the radio station, the type of content or the song/artist that is being played in the transmitted stream. In a further example, a receiving condition may be a device indicator, such as the OS or ISP preference of the user, information about the browser or platform that is being used, or the type of device that is being used. For example, the device may be an Apple® or an Amazon® device. The device indicator may alternatively indicate whether the receiving device is relaying the content stream to a user using a Bluetooth connection, or whether the user is accessing the audio stream using a pair of headphones. A receiving condition may additionally be a geographical indicator, such as the latitudinal and longitudinal position of the user or the Internet Protocol (IP) address that is being used. In some examples, metadata that is received by the media server 106 may comprise any one of these receiving conditions in isolation. In preferred examples the metadata may comprise any combination of these conditions. The receiving conditions identified above are merely examples of such conditions. Any alternative indicators as to the status of a transmitted content stream may be used.
The method shown in
At step 303 the media server 106 transmits a second transmission to a second device. As with the first transmission, the second transmission is initiated after a user of the second receiving device issues a command on the receiving device to initiate the receiving of a transmission. The second receiving device may be any of the types of device referenced in
It should be noted that method steps 301 and 303 may occur simultaneously, or alternatively either of these steps could occur in advance of the other. The same is true of method steps 302 and 304. The method may also be expanded to apply to the use of more than two receiving devices by a user.
In certain scenarios, a listener of a content stream may initiate the transmission of a content stream on a first receiving device, and then may pause the transmission on the first device and subsequently initiate transmission on a second device. An example of when this might happen is if a user were to start their streaming activity at home on a first computing device such as the device depicted by reference 110 of
For scenarios such as the above, for the purposes of targeting advertisements to a user, it will be important to establish that the user that initiates the transmission of the content stream on a first device is in fact the same user that initiates the transmission of the content stream on a second device. To achieve this, at step 305 of
At step 306 the media server is able, through comparison of the receiving conditions of the first transmission and the second transmission of the audio content stream, to determine whether the receiving conditions from the first set of information and the receiving conditions from the second set of information fulfil one or more predetermined match conditions. As with the predetermined relationships defined with respect to
In one example, the receiving conditions that are compared are the time at which the first transmission starts and the time at which the second transmission starts. More importantly, if the same content stream is played out in a first transmission and then paused at a certain point, and then that same content stream is resumed in a second transmission from the same point at which the first transmission has been paused, then these two transmissions can be identified as being initiated from the same user. This specific match condition can be fulfilled by determining the time at which the streaming of the audio content is terminated on a first receiving device and the time at which the streaming is initiated on the second receiving device, as well as the place in the audio content at which the first and second transmissions are paused and resumed respectively. If the first and second specified times differ from each other by less than a predetermined threshold, then the method can determine that the user of the first device has the same identity as the user of the second device.
As such, the predetermined similarity that is used to determine the common identity of a user may use parameters that correspond to the receiving conditions described above. For example, the predetermined similarity may concern a temporal characteristic of the receiving conditions, such as the time at which the first transmission has started and the time at which the second transmission has started. Preferably, the predetermined similarity may concern the time at which the first transmission has ended and the time at which the second transmission has started. The predetermined similarity may comprise a geographical, device related or content indicators, or any alternative indicator.
Whilst
The method described in
A common vector 406 is displayed on each of the displayed graphs 401, 402, 403. This vector represents a predetermined relationship for a personal characterisation of a user. The personal characterisation may be any demographic characteristic of the user, such as the age of the user or their general life stage, their profession, their interests, their gender or their social classification. In an exemplary implementation of this graph, the vector may represent that the gender of a user is female.
The graphs displayed in
The second graph 402 of
In the third graph identified by reference numeral 403 of
It will be appreciated by the skilled person that a combination of the cosine measures displayed in
Although the exemplary comparisons provided in
Although the comparisons between stored predetermined relationships and receiving conditions for a transmission are illustrated in
On completing the method illustrated in
In addition to the metadata that is sent to the receiving device, the metadata indicating the content of the media stream can also be provided to a retailer whose advertisement has been provided to the user of the receiving device. If the user uses the receiving device on which they are listening to the content stream to access the webpage of the retailer, or uses an alternative device that has been associated with the user using the method described in
The applicant hereby discloses in isolation each individual feature described herein and any combination of two or more such features, to the extent that such features or combinations are capable of being carried out based on the present specification as a whole in the light of the common general knowledge of a person skilled in the art, irrespective of whether such features or combinations of features solve any problems disclosed herein, and without limitation to the scope of the claims. The applicant indicates that aspects of the present invention may consist of any such individual feature or combination of features. In view of the foregoing description it will be evident to a person skilled in the art that various modifications may be made within the scope of the invention.
One or more aspects or features of the subject matter described herein can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) computer hardware, firmware, software, and/or combinations thereof. These various aspects or features can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device. The programmable system or computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
These computer programs, which can also be referred to programs, software, software applications, applications, components, or code, include machine instructions for a programmable processor, and can be implemented in a high-level procedural language, an object-oriented programming language, a functional programming language, a logical programming language, and/or in assembly/machine language. As used herein, the term “machine-readable medium” refers to any computer program product, apparatus and/or device, such as for example magnetic discs, optical disks, memory, and Programmable Logic Devices (PLDs), used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term “machine-readable signal” refers to any signal used to provide machine instructions and/or data to a programmable processor. The machine-readable medium can store such machine instructions non-transitorily, such as for example as would a non-transient solid-state memory or a magnetic hard drive or any equivalent storage medium. The machine-readable medium can alternatively or additionally store such machine instructions in a transient manner, such as for example as would a processor cache or other random access memory associated with one or more physical processor cores.
To provide for interaction with a user, one or more aspects or features of the subject matter described herein can be implemented on a computer having a display device, such as for example a cathode ray tube (CRT) or a liquid crystal display (LCD) or a light emitting diode (LED) monitor for displaying information to the user and a keyboard and a pointing device, such as for example a mouse or a trackball, by which the user may provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well. For example, feedback provided to the user can be any form of sensory feedback, such as for example visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including, but not limited to, acoustic, speech, or tactile input. Other possible input devices include, but are not limited to, touch screens or other touch-sensitive devices such as single or multi-point resistive or capacitive trackpads, voice recognition hardware and software, optical scanners, optical pointers, digital image capture devices and associated interpretation software, and the like.
In the descriptions above and in the claims, phrases such as “at least one of” or “one or more of” may occur followed by a conjunctive list of elements or features. The term “and/or” may also occur in a list of two or more elements or features. Unless otherwise implicitly or explicitly contradicted by the context in which it used, such a phrase is intended to mean any of the listed elements or features individually or any of the recited elements or features in combination with any of the other recited elements or features. For example, the phrases “at least one of A and B;” “one or more of A and B;” and “A and/or B” are each intended to mean “A alone, B alone, or A and B together.” A similar interpretation is also intended for lists including three or more items. For example, the phrases “at least one of A, B, and C;” “one or more of A, B, and C;” and “A, B, and/or C” are each intended to mean “A alone, B alone, C alone, A and B together, A and C together, B and C together, or A and B and C together.” Use of the term “based on,” above and in the claims is intended to mean, “based at least in part on,” such that an unrecited feature or element is also permissible.
The subject matter described herein can be embodied in systems, apparatus, methods, and/or articles depending on the desired configuration. The implementations set forth in the foregoing description do not represent all implementations consistent with the subject matter described herein. Instead, they are merely some examples consistent with aspects related to the described subject matter. Although a few variations have been described in detail above, other modifications or additions are possible. In particular, further features and/or variations can be provided in addition to those set forth herein. For example, the implementations described above can be directed to various combinations and subcombinations of the disclosed features and/or combinations and subcombinations of several further features disclosed above. In addition, the logic flows depicted in the accompanying figures and/or described herein do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Other implementations may be within the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
1914862.6 | Oct 2019 | GB | national |