The present invention is directed to providing technological support for advertising strategizing.
The process of advertising involves presenting advertising messages for a cause, such as the purchase of a product or service, to people. Advertising messages can be presented via a variety of channels, including television, print periodicals, postal mail, billboards, web pages, and electronic mail.
Depending upon the type of channel used for particular advertising and the specific technology that supports that channel, advertising may be targeted at different levels to specific people or groups of people. For example, in some cases, advertising presented on web pages can be targeted to specific people or groups of people.
Targeting advertising to particular people can provide advantages, including (1) increasing the average level of relevancy of an advertising message to the people that receive it, (2) ensuring that the advertising message is seen by the people most likely to be receptive to it, and (3) reducing the total cost of advertising by reducing the number of people to whom the message is presented. One approach to targeting advertising is population segmentation, in which groups of people are created that have common characteristics, and that are likely to be receptive to particular types of advertising messages.
Conventional approaches to defining segments within a population of people begin by collecting a body of profile information about each person in the population, such as information characterizing the person's web browsing activity, as well as other demographic or biographical information for the person. A user builds a query against this profile information, which is executed to identify the people in the segment, referred to as “populating” the segment.
While such conventional approaches to defining segments can often be completely effective at selecting the people intended by the user defining the segment, they are often difficult to use. Such a user must understand all of the information available in the profiles, understand the set of tests available in the query engine, and understand how to assemble these into a query. This process often requires the use of a fairly involved user interface. As a result, such conventional approaches are typically used only by a small number of very sophisticated users, and are very seldom used by users—such as front-line marketing and advertising personnel—who have the greatest capacity to identify and refine characteristics likely to make a person receptive to a particular cause or advertising message.
Further, the results of defining a segment are often not immediately available, and are often not meaningful or comprehensible to the user defining the segment, making it difficult for the user defining the query to reiteratively refine the segment definition to achieve the desired result.
In view of the shortcomings of conventional segment definition techniques, a new approach to segment definitions that enabled a larger group of users to more easily define segments, understand the result of a particular segment definitions, and to reiteratively refine the segment definition to achieve the desired result would have significant utility.
A software facility for defining a segment or audience of advertising prospects or other people based upon a natural-language query (“the facility”) is described. The facility operates with respect to a body of documents, such as web pages (“pages”) making up a web site called the “subject web site,” whose access by individual users can be tracked. The facility may also operate with respect to other groups of web pages, such as web pages making up web sites among a group of web sites; a body of documents of another type; or a group of objects other than documents each having text associated with them with which people may interact.
In some embodiments, the facility provides a user interface for receiving a natural-language query from a user, such as a group of keywords relating to the segment that the user wishes to create. As one example, for a segment intended to contain people interested in the field of wireless communication, the user might input the query “wireless.” In some embodiments, queries can include such other elements as phrase grouping symbols, logical operators, logical grouping symbols, and/or property/value specifications. The facility identifies documents of the body that satisfy the query. For example, where the body of documents corresponds to the pages of a subject web site, some embodiments of the facility determine which pages satisfy the query by accessing a search index compiled on the pages of the web site.
The facility then selects people, who have accessed at least a minimum number of the identified documents. For example, where the body of documents corresponds to the pages of a subject web site, some embodiments of the facility access a user web browsing history derived from a web log generated by the web server serving the subject web site to select these users. The facility then displays information characterizing the users that are included in the defined segment is displayed, such as statistical overview information, details of representative selected users, aspects that tend to distinguish selected users from users not selected, etc. This characterizing information enables the user to assess the extent to which the defined segment resembles the intended segment.
After reviewing the characterizing information, the user may input a new query to refine the membership of the segment, or may use the last query to create a new segment definition based upon the query. The segment defined in the created segment definition may be used to sell and serve advertising directed to the people who are members of the segment. In some embodiments, a group of people satisfying the query may be immediately exported in order to perform an advertising campaign with respect to that group of people, or take other action with respect to that group of people. In some embodiments, the facility enables the user to augment the group of users satisfying a query with all of the users who accessed one or more documents among a group of documents that contains the higher number of documents satisfying the query. In some embodiments, the facility enables the user to select various subgroups of people from those identified by the facility for inclusion in the segment.
By enabling users to define segments in some or all of the manners discussed above, the facility reduces the levels of effort and instruction required to perform segment definition, and accordingly significantly expands the set of people able to do so. The facility also provides prompt feedback that makes it easy for the user to quickly judge the success of his or her efforts, and successfully define the intended segment through a process of incremental improvement. The facility's prompt feedback also makes the facility a useful tool for exploring a group of advertising prospects or other people, such as people browsing a subject web site.
The web server computer system 140 contains a web server computer program 141 for delivering web pages in response to requests from web clients; web page data 142 either containing the web pages served by the web server themselves, or data used by the web server to construct the web pages, such as instructions for constructing the web pages; and one or more logs 143 containing information about requests received and serviced by the web server, which includes the identity of the web page requested and the user submitting the request, as indicated by the cookie value enclosed with the request.
The sequentation computer system 150 contains a memory 160. The memory 160 preferably contains the facility 161; a web site index 162 indicating, for the subject web site, which web pages contain which words, typically compiled by sending a series of requests to the web server in order to “crawl” the subject web site; and a user browsing history 163 that indicates which web pages of the subject web site have recently been visited by which users, typically constructed by retrieving and analyzing the contents of the web log. While items 161-163 are preferably stored in memory while being used, those skilled in the art will appreciate that these items, or portions of them, maybe be transferred between memory and a persistent storage device 172 for purposes of memory management and maintaining data integrity. The sequentation computer system further contains one or more central processing units (CPU) 171 for executing programs, such as the facility 161; a computer-readable medium drive 173 for reading information or installing programs such as the facility from computer-readable media, such as a floppy disk, a CD-ROM, or a DVD; a display device 174 for displaying visual information, such as a CRT or LCD monitor; a text input device 175, such as a keyboard or voice recognition system; and a pointing device 176, such as a mouse or touch pad.
While various embodiments of the facility are described in terms in the environment described above, those skilled in the art will appreciate that the facility may be implemented in a variety of other environments including a single, monolithic computer system, as well as various other combinations of computer systems or similar devices connected in various ways. In particular, the facility may interact with users via a wide range of portable and/or wireless user interface devices, such as cellular telephones, pagers, personal digital assistants, etc.
After the user selects the search button 206, the facility displays the contents of the first view that are below the search button 206. These include a list 207 of additional keywords that are related to the keywords in the query. In some embodiments, this list is generated by identifying words that frequently occur in the titles, contents, or metadata of web pages matching the query. In other embodiments, the facility generates the list 207 of additional keywords that are associated or correlated with the user-specified keywords in a variety of other ways, such as by selecting keywords that appear together in a thesaurus, commonly appear together in queries, or occur together in other contexts.
The first view further contains statistics about the subject web site, including an indication 208 of the total number of unique users that visited the subject web site during the period in question, an indication 209 of the total number of unique pages in the subject web site during the period in question, and indications 210 of the number of those pages of the subject web site that matched the query.
The first view further contains information 249 characterizing the users identified by the query. Here, this information 249 is a table whose rows each correspond to a group of users satisfying the query at a different level of relevance. Each row is divided into the following columns: a rank column 211 indicating the group's relative relevance among all of the groups; an audience segment column 212 including an icon whose color reflects the level of relevance of the group, as well as a textual name for the group; a relevance events column 213 that contains an indication of the number of web pages matching the query that were viewed by each member of the group; a relevance score column 214 containing a numerical score indicating how relevant the members of the group are to the query; a reach size column 215 indicating the number of users in the group; a reach percentage column 216, indicating the percentage of total unique users that are in this group; a CPM column 217 indicating a cost-per-thousand impressions for advertising to members of this group; and an include in segment column 218, containing a checkbox that the user may check in order to include this group of users in the segment that is defined or exported based upon this query. For example, row 219 corresponds to Group 1, having rank 1, whose members each read 198 web pages at the subject web site that matched the query, having a relevant score of 79.1, containing a single user which comprises 0.0% of the total unique users, and having a CPM of zero. The user selects the checkbox in this row in order to include this group in the segment. The facility computes the score shown in column 214 using a variety of approaches, which may include such aspects as the number of pages read by the members of the group; the relevance of the particular documents read by the group—that is, the extent to which they satisfy the query; the extent to which the members of the group focus on reading matching documents, to the exclusion of documents that do not match; the past conversion performance of the members of the group; etc.
Where the user selects button 240 to export a list of selected users, this exported list can typically be used immediately to conduct an advertising campaign with respect to this group of users, or perform some other action with respect to this group of users. Where the user selects button 239 to save a segment definition based upon the query, this saved segment definition can typically be used at any time in the future to populate the defined segment with whichever users satisfy the segment definition at that point in time. Such populated segments may then be used to conduct an advertising campaign with respect to the users within the populated segment, or to perform any other action with respect to these users.
The second view further contains a search results section 241 which lists the web pages of the subject web site satisfying the query. For example, the first row shows web page 244 to have rank 1242, with a query satisfaction score of “0.3934689” 243. In some embodiments, web page name 244 is a link that the user may select in order to view a copy of this web page.
The user interface further includes a table 280, in which each row relates to a group of users that may be included in the segment. The first row, rows 263, corresponds to rows 219-238 of the first user interface, in that it relates to all of the users who viewed any web page matching the query. Subsequent rows of the table, i.e., rows 264-269, each relate to a section of the subject web site, called a “category” of the subject web site, that contains a relatively high number of web pages satisfying the query, and the users who have accessed at least one web page of that category. Each row is divided into the following columns: an include column 256 containing a checkbox that the user may select in order to include the group of users to which the row relates to the segment; a rank column 257 that, for category rows, indicates the relevance rank of the category among the other categories relative to the query; a category column 258 containing text identifying the category hierarchically within the subject web site; a relevance score column 259 containing a relevance score for the group of users similar to that in column 214; a reach column 260 indicating the number of users in the group of users; a total page views column 261 indicating, for category rows, the total number of times that pages within that category were requested during the period; and a frequency column 262 indicating, for category rows, the average number of web pages in this category requested during the period by users who requested at least one page within the category during the period. The table also includes an aggregate row 270, which contain values for columns 259-262 that are aggregated among the rows of table 280 whose checkbox in column 256 is checked. The second user interface further includes an export users button 272 similar to button 240, and a create segment button 271, similar to button 239.
In some embodiments, the facility uses additional user interfaces, such as user interfaces that characterize the users identified by the query in a variety of other ways. In some embodiments, the facility enables the user to “drill down” into groups of users identified using the query, to select and display attributes for individual such users. For example, in some embodiments, the facility displays such individual user attributes as sex, household income, frequency with which the user visits the subject web site or particular pages or sections thereof, recency with which the user has visited the subject web site or pages or sections thereof, etc. In other user interfaces, the facility automatically selects representative users among the identified users and displays their characteristics. The facility can perform this automatic selection by selecting users randomly from among the identified users, or by selecting users having different levels of relevance to the query selected from across the relevancy spectrum. In other user interfaces, the facility displays information characterizing identified users using a variety of other forms of statistical overview of these users, including statistical overviews of user properties such as those discussed above. Some user interfaces display a list of properties commonly possessed by identified users that distinguish the identified users from other users in the population; that is, that are not commonly possessed by other users of the population. In some embodiments, such attributes are discerned using the process described in U.S. patent application Ser. No. 09/751,366, filed on Dec. 29, 2000, which is hereby incorporated by reference in its entirety.
In step 302, the facility constructs a user browsing history for the subject web site. In some embodiments, the facility retrieves and analyzes the web log for the subject web site, generating a user browsing history that indicates, for each page of the subject web site, the users that requested that page during a recent period. In some embodiments, the facility performs this step in a manner described in U.S. patent application Ser. No. 09/613,403, filed on Jul. 11, 2000, which is hereby incorporated by reference in its entirety. In some embodiments, the facility generates the user browsing history in a variety of other ways, including constructing it based upon HTTP requests received at a web server each time the user retrieves a web page from the subject web site responsive to a special inclusion link contained in each web page of the subject web site, based upon information provided by client-side agents executing on the web client computer systems; based upon information collected by proxy servers through which users' page retrieval requests for the subject web site pass; etc. A sample user browsing history is shown in
In step 503, the facility uses the web site index to identify pages of the subject web site satisfying the query string received in step 502. In some embodiments, the facility in step 503 assigns each page a query score quantifying the extent to which the page satisfies the query. In step 504, the facility uses a user browsing history to identify users visiting some or all of the pages identified in step 503. In step 505, the facility displays a characterization of the identified users, such as one or more of those depicted in
In step 506, the facility displays a control for creating a segment definition predicated on the query string received in step 502. In some embodiments, the facility displays additional controls for selecting different groups of identified people for inclusion in the segment to be defined. In step 507, if the segment definition creation control is activated, then the facility continues in step 508, or else the facility continues in step 502 to receive the next query string. In step 508, the facility creates a segment definition predicated on the query string received in step 502. Where the facility employs controls for selecting groups of users for the segment, the segment definition created in step 508 includes only the people in the groups selected. The segment definition created in step 508 may be used by the publisher of the subject web site to sell advertising for the defined segment. The segment may periodically be populated for use in such advertising by performing the processing of steps 503 and 504 with respect to the query string stored in the created segment definition. In some embodiments, the facility performs such population using techniques described in U.S. Patent Application Nos. 60/479,353 and 60/479,609, both filed on Jun. 17, 2003, each of which is hereby incorporated by reference in its entirety. In some embodiments, rather than creating a segment definition, the facility in step 508 exports information specifically identifying the people identified by the query, such as a sequence of unique identifiers identifying these people, and/or other information corresponding to these people. After step 508, the facility continues in step 502 to receive the next query string.
In some embodiments, instead of or in addition to identifying users that have visited pages that satisfy the query string as shown in steps 503-504, the facility employs additional approaches to identify users. In some embodiments, after step 502, in step 511, the facility identifies categories of the subject web site whose metadata satisfies the received query string. A variety of such metadata may be associated with categories of the subject web site, including such metadata as category name, category description, category keywords, etc. After step 511, in step 512, the facility identifies pages of the subject web site that belong to the identified category. After step 512, the facility continues in step 504 to identify users visiting the pages identified in step 512. In some embodiments, after step 502, in step 521, the facility identifies users whose properties satisfy the received query string. Such user properties may include virtually any textural information provided by or collected about a user. After step 521, the facility continues in step 505 to display a characterization of the users identified in step 521.
In a range of embodiments, the facility enables its user to select a segment or audience of people based upon a wide variety of kinds of interactions of those users with a wide variety of objects having text associated with them. As examples: the facility may identify people who bought or rated a product or other item that has product description text associated with it that matches a query; identify users who read documents that satisfy a query; identify users that send or receive email messages or messages of other types whose contents or metadata satisfy a query; identify people who retrieve or listen to music whose lyrics match a query; etc. In some embodiments, the facility identifies people who interacted with objects that, while their text does not satisfy a query, text associated with objects that are related to the interacted-with objects in a particular way—such as sharing a common metadata attribute (such as musical artist identity), or such as by links in one or both directions (such as a first page of the subject web site that is linked to a second page of the subject web site)—does satisfy the query.
It will be appreciated by those skilled in the art that the above-described facility may be straightforwardly adapted or extended in various ways. For example, the facility may be used to define segments in populations of people other than computer users visiting one or more particular web sites. Further, the facility may be used to create segments of people based upon their access to, retrieval of, reading of, or other interaction with documents other than web pages. The facility may display a wide variety of different types of information characterizing the membership of a segment defined by the facility. The facility may use a wide variety of visual user interfaces and other user interfaces to interact with its users. Segment definitions created by the facility may be stored in a wide variety of forms, and the segments defined thereby may be populated in a variety of different ways. While the foregoing description makes reference to certain preferred embodiments, the scope of the invention is defined solely by the claims that follow and the elements recited therein.
This application is a continuation of U.S. application Ser. No. 11/051,294, filed on Feb. 3, 2005 now abandoned, which is a continuation of U.S. application Ser. No. 10/968,643863, filed on Oct. 18, 2004 now abandoned, which is a continuation of U.S. application Ser. No. 10/733,815, filed on Dec. 10, 2003 now abandoned, each of which are hereby incorporated by reference in its entirety. This application is related to U.S. application Ser. No. 10/653,703, filed on Sep. 2, 2003, which is hereby incorporated by reference in its entirety. This application claims the benefit of provisional U.S. Patent Application No. 60/520,141, filed on Nov. 13, 2003, which is hereby incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5414838 | Kolton et al. | May 1995 | A |
5740425 | Povilus | Apr 1998 | A |
5873056 | Liddy et al. | Feb 1999 | A |
5918014 | Robinson | Jun 1999 | A |
5974398 | Hanson et al. | Oct 1999 | A |
5974413 | Beauregard et al. | Oct 1999 | A |
5974451 | Simmons | Oct 1999 | A |
6029165 | Gable | Feb 2000 | A |
6029195 | Herz | Feb 2000 | A |
6070160 | Geary | May 2000 | A |
6078866 | Buck et al. | Jun 2000 | A |
6085229 | Newman et al. | Jul 2000 | A |
6247021 | Himmel et al. | Jun 2001 | B1 |
6266649 | Linden et al. | Jul 2001 | B1 |
6285987 | Roth et al. | Sep 2001 | B1 |
6292796 | Drucker et al. | Sep 2001 | B1 |
6317761 | Landsman et al. | Nov 2001 | B1 |
6324519 | Eldering | Nov 2001 | B1 |
6356879 | Aggarwal et al. | Mar 2002 | B2 |
6487538 | Gupta et al. | Nov 2002 | B1 |
6692796 | Ichinose et al. | Feb 2004 | B2 |
6732150 | Thrane | May 2004 | B1 |
6804659 | Graham et al. | Oct 2004 | B1 |
6829780 | Kraft et al. | Dec 2004 | B2 |
6832207 | Shkedi | Dec 2004 | B1 |
6834252 | Yokota | Dec 2004 | B2 |
6937996 | Forsythe et al. | Aug 2005 | B1 |
6978263 | Soulanille | Dec 2005 | B2 |
6981040 | Konig et al. | Dec 2005 | B1 |
6983272 | Davis et al. | Jan 2006 | B2 |
7299195 | Tawakol et al. | Nov 2007 | B1 |
7503057 | Rosin et al. | Mar 2009 | B2 |
7555485 | Soulanille | Jun 2009 | B2 |
7747465 | Srinivasan et al. | Jun 2010 | B2 |
20010014876 | Miyashita | Aug 2001 | A1 |
20010041566 | Xanthos et al. | Nov 2001 | A1 |
20010047354 | Davis et al. | Nov 2001 | A1 |
20010049674 | Talib et al. | Dec 2001 | A1 |
20020007308 | Anderson et al. | Jan 2002 | A1 |
20020013729 | Kida | Jan 2002 | A1 |
20020046104 | Kaddeche et al. | Apr 2002 | A1 |
20020077900 | Thompson et al. | Jun 2002 | A1 |
20020120564 | Strietzel | Aug 2002 | A1 |
20020124098 | Shaw | Sep 2002 | A1 |
20020133490 | Conkwright et al. | Sep 2002 | A1 |
20030014213 | Yokota | Jan 2003 | A1 |
20030028451 | Ananian | Feb 2003 | A1 |
20030055729 | Bezos et al. | Mar 2003 | A1 |
20030088465 | Monteverde | May 2003 | A1 |
20030110080 | Tsutani et al. | Jun 2003 | A1 |
20030110497 | Yassin et al. | Jun 2003 | A1 |
20030135460 | Talegon | Jul 2003 | A1 |
20030191753 | Hoch | Oct 2003 | A1 |
20030200168 | Cullen et al. | Oct 2003 | A1 |
20040015397 | Barry et al. | Jan 2004 | A1 |
20040036622 | Dukach et al. | Feb 2004 | A1 |
20040059708 | Dean et al. | Mar 2004 | A1 |
20040267611 | Hoerenz | Dec 2004 | A1 |
20050033771 | Schmitter et al. | Feb 2005 | A1 |
20050071325 | Bem | Mar 2005 | A1 |
20050080772 | Bem | Apr 2005 | A1 |
20050091109 | Howard et al. | Apr 2005 | A1 |
20050097088 | Bennett et al. | May 2005 | A1 |
20050123006 | Tanaka et al. | Jun 2005 | A1 |
20050144067 | Farahat et al. | Jun 2005 | A1 |
20060253434 | Beriker et al. | Nov 2006 | A1 |
Number | Date | Country |
---|---|---|
1026610 | Aug 2000 | EP |
2000228704 | Aug 2000 | JP |
WO 9721183 | Jun 1997 | WO |
WO 9834189 | Aug 1998 | WO |
WO 9960504 | Nov 1999 | WO |
WO 0008802 | Feb 2000 | WO |
WO 0107985 | Feb 2001 | WO |
WO 0221292 | Mar 2002 | WO |
Number | Date | Country | |
---|---|---|---|
60520141 | Nov 2003 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11051294 | Feb 2005 | US |
Child | 11972591 | US | |
Parent | 10968863 | Oct 2004 | US |
Child | 11051294 | US | |
Parent | 10733815 | Dec 2003 | US |
Child | 10968863 | US |