Patent Application
20060020506
1.1 Field of the Invention
The present invention concerns advertisements (“ads”), such as ads served in an online environment. In particular, the present invention concerns techniques that can be used to manage ad quality, or end user perceptions of ad quality, and ad quality branding.
1.2 Background Information
Advertising using traditional media, such as television, radio, newspapers and magazines, is well known. Unfortunately, even when armed with demographic studies and entirely reasonable assumptions about the typical audience of various media outlets, advertisers recognize that much of their ad budget is simply wasted. Moreover, it is very difficult to identify and eliminate such waste.
Recently, advertising over more interactive media has become popular. For example, as the number of people using the Internet has exploded, advertisers have come to appreciate media and services offered over the Internet as a potentially powerful way to advertise.
Interactive advertising provides opportunities for advertisers to target their ads to a receptive audience. That is, targeted ads are more likely to be useful to end users since the ads may be relevant to a need inferred from some user activity (e.g., relevant to a user's search query to a search engine, relevant to content in a document requested by the user, etc.) Query keyword-relevant advertising has been used by search engines. The AdWords advertising system by Google of Mountain View, Calif. is one example of query keyword-relevant advertising. Similarly, content-relevant advertising systems have been proposed. For example, U.S. patent application Ser. No. 10/314,427 (incorporated herein by reference and referred to as “the '427 application”) titled “METHODS AND APPARATUS FOR SERVING RELEVANT ADVERTISEMENTS”, filed on Dec. 6, 2002 and listing Jeffrey A. Dean, Georges R. Harik and Paul Buchheit as inventors; and Ser. No. 10/375,900 (incorporated by reference and referred to as “the '900 application”) titled “SERVING ADVERTISEMENTS BASED ON CONTENT,” filed on Feb. 26, 2003 and listing Darrell Anderson, Paul Buchheit, Alex Carobus, Claire Cui, Jeffrey A. Dean, Georges R. Harik, Deepak Jindal and Narayanan Shivakumar as inventors, describe methods and apparatus for serving ads relevant to the content of a document, such as a Web page for example. Content-relevant advertising, such as the AdSense advertising system by Google, has been used to serve ads on Web pages.
Some ad delivery systems (e.g. DoubleClick) dynamically select ads with the highest price per Web page view. Other ad delivery systems (e.g. Overture) are pay per performance based and simply select ads with the highest price per click. Most content Website ad delivery systems (e.g. DoubleClick) show an ad in every slot on a Web page to maximize the revenue of the Web page view. Sadly, this focus on maximizing Web page view revenue often comes at the expense of end users being inundated with too many ads, often of marginal or no value to the end user. Furthermore, some content ad systems target ads to users of a given Website, but do not target ads to a specific topic on a Webpage. Ads from such content ad delivery systems that employ crude and rudimentary targeting are often of marginal or no value to the end user. Worse yet, some advertisers, such as eBay for example, place ads that are purely static, with no content matching.
Consequently, end users can become conditioned to ignore ads from such ad delivery systems. Moreover, since such ads often have exactly the same look, or at least a confusingly similar look, as ads served by more sophisticated and discriminating ad delivery systems such as the AdSense content-relevant ad system from Google, end users can become conditioned to ignore more relevant, useful ads.
In addition, even with more sophisticated and discriminating ad delivery systems such as the AdSense content-relevant ad system from Google, the performance of ads (e.g., as derived from some indicator(s) of usefulness to end users, such as selections, conversions, etc.) may vary depending on the document (e.g., Web page) with which the ads are rendered. Thus, even if end users were able to discriminate ads delivered by a better ad delivery system, from ads of other ad delivery systems, if the usefulness of ads of the better ad delivery system varies across different documents, ads found to be less useful on poorer performing documents might condition users to ignore more useful ads on better performing documents.
In view of the foregoing, it would be useful for better ad delivery systems to maintain a good perception of its ads by end users and to avoid tarnishing such a good perception due to ads with the same or similar format by other ad delivery systems, and/or due to its own ads on poorly performing documents.
At least some embodiments consistent with the present invention may be used to control (e.g., adjust or determine) the number of ads rendered, and/or a type and/or degree of branding associated with ads, using one or more factors that affect end user perception of the ads.
In at least some embodiments consistent with the present invention, such factors may include some measure of the performance of the document (e.g., a Web page) on which the ads will be rendered. In at least some embodiments consistent with the present invention, such factors may include some degree of confidence in the targeting used (e.g., some degree of similarity, type of targeting used, etc).
The present invention may involve novel methods, apparatus, message formats, and/or data structures for scoring documents or document groups, and/or using such a score of a document or document group, and/or some other factor of end user perception of ad quality, to control a number of ads to served with the document or with a document of the document group, and/or to control a type and/or level of branding to be used with such ads. The following description is presented to enable one skilled in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Thus, the following description of embodiments consistent with the present invention provides illustration and description, but is not intended to be exhaustive or to limit the present invention to the precise form disclosed. Various modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles set forth below may be applied to other embodiments and applications. For example, although a series of acts may be described with reference to a flow diagram, the order of acts may differ in other implementations when the performance of one act is not dependent on the completion of another act. Further, non-dependent acts may be performed in parallel. No element, act or instruction used in the description should be construed as critical or essential to the present invention unless explicitly described as such. Also, as used herein, the article “a” is intended to include one or more items. Where only one item is intended, the term “one” or similar language is used. Thus, the present invention is not intended to be limited to the embodiments shown and the inventors regard their invention as any patentable subject matter described.
In the following, definitions that may be used in this description are provided in § 4.1. Then, environments in which, or with which, the present invention may operate are described in § 4.2. Thereafter, exemplary embodiments consistent with the present invention are described in § 4.3. Then, some illustrative examples are provided in § 4.4. Finally, some conclusions regarding the present invention are set forth in § 4.5.
4.1 Definitions
Online ads may have various intrinsic features. Such features may be specified by an application and/or an advertiser. These features are referred to as “ad features” below. For example, in the case of a text ad, ad features may include a title line, ad text, and an embedded link. In the case of an image ad, ad features may include images, executable code, and an embedded link. Depending on the type of online ad, ad features may include one or more of the following: text, a link, an audio file, a video file, an image file, executable code, embedded information, etc.
When an online ad is served; one or more parameters may be used to describe how, when, and/or where the ad was served. These parameters are referred to as “serving parameters” below. Serving parameters may include, for example, one or more of the following: features of (including information on) a document on which, or with which, the ad was served, a search query or search results associated with the serving of the ad, a user characteristic (e.g., their geographic location, the language used by the user, the type of browser used, previous page views, previous behavior, user account, any Web cookies used by the system, etc.), a host or affiliate site (e.g., America Online, Google, Yahoo) that initiated the request, an absolute position of the ad on the page on which it was served, a position (spatial or temporal) of the ad relative to other ads served, an absolute size of the ad, a size of the ad relative to other ads, a color of the ad, a number of other ads served, types of other ads served, time of day served, time of week served, time of year served, a type of targeting used (e.g., concept (which may include the specific type of concept targeting used), broad keyword, exact keyword, phrase keyword, etc.), a degree of relevancy of ad, a quality metric of a publisher of the document with which the ad was served, etc. Naturally, there are other serving parameters that may be used in the context of the invention.
Although serving parameters may be extrinsic to ad features, they may be associated with an ad as serving conditions or constraints. When used as serving conditions or constraints, such serving parameters are referred to simply as “serving constraints” (or “targeting criteria”). For example, in some systems, an advertiser may be able to target the serving of its ad by specifying that it is only to be served on weekdays, no lower than a certain position, only to users in a certain location, etc. As another example, in some systems, an advertiser may specify that its ad is to be served only if a page or search query includes certain keywords or phrases. As yet another example, in some systems, an advertiser may specify that its ad is to be served only if a document being served includes certain topics or concepts, or falls under a particular cluster or clusters, or some other classification or classifications.
“Ad information” may include any combination of ad features, ad serving constraints, information derivable from ad features or ad serving constraints (referred to as “ad derived information”), and/or information related to the ad (referred to as “ad related information”), as well as an extension of such information (e.g., information derived from ad related information).
The ratio of the number of selections (e.g., clickthroughs) of an ad to the number of impressions of the ad (i.e., the number of times an ad is rendered) is defined as the “selection rate” (or “clickthrough rate”) of the ad.
A “conversion” is said to occur when a user consummates a transaction related to a previously served ad. What constitutes a conversion may vary from case to case and can be determined in a variety of ways. For example, it may be the case that a conversion occurs when a user clicks on an ad, is referred to the advertiser's Web page, and consummates a purchase there before leaving that Web page. Conversions can also be tracked with different levels of granularity (e.g., number of items purchased, classes of items or services purchased, total purchase cost, limited to one conversion per selection in a conservative case, etc.) Alternatively, a conversion may be defined as a user being shown an ad, and making a purchase on the advertiser's Web page within a predetermined time (e.g., seven days). In yet another alternative, a conversion may be defined by an advertiser to be any measurable/observable user action such as, for example, downloading a white paper, navigating to at least a given depth of a Website, viewing at least a certain number of Web pages, spending at least a predetermined amount of time on a Website or Web page, registering on a Website, etc. Often, if user actions don't indicate a consummated purchase, they may indicate a sales lead, although user actions constituting a conversion are not limited to this. Indeed, many other definitions of what constitutes a conversion are possible.
The ratio of the number of conversions to the number of impressions or selections of the ad (i.e., the number of times an ad is rendered or selected) is referred to as the “conversion rate.” If a conversion is defined to be able to occur within a predetermined time since the serving of an ad, one possible definition of the conversion rate might only consider ads that have been served more than the predetermined time in the past.
A “document” is to be broadly interpreted to include any machine-readable and machine-storable work product. A document may be a file, a combination of files, one or more files with embedded links to other files, etc. The files may be of any type, such as text, audio, image, video, etc. Parts of a document to be rendered to an end user can be thought of as “content” of the document. A document may include “structured data” containing both content (words, pictures, etc.) and some indication of the meaning of that content (for example, e-mail fields and associated data, HTML tags and associated data, etc.) Ad spots in the document may be defined by embedded information or instructions. In the context of the Internet, a common document is a Web page. Web pages often include content and may include embedded information (such as meta information, hyperlinks, etc.) and/or embedded instructions (such as JavaScript, etc.). In many cases, a document has a unique, addressable, storage location and can therefore be uniquely identified by this addressable location. A universal resource locator (URL) is a unique address used to access information on the Internet (though instances of information may often be replicated and stored at multiple locations).
“Document information” may include any information included in the document, information derivable from information included in the document (referred to as “document derived information”), and/or information related to the document (referred to as “document related information”), as well as an extensions of such information (e.g., information derived from related information). An example of document derived information is a classification based on textual content of a document. Examples of document related information include document information from other documents with links to the instant document, as well as document information from other documents to which the instant document links.
Content from a document may be rendered on a “content rendering application or device”. Examples of content rendering applications include an Internet browser (e.g., Explorer, Netscape, Opera, etc.), a media player (e.g., an MP3 player, a Realnetworks streaming audio or video file player, etc.), a viewer (e.g., an Abobe Acrobat pdf reader), etc.
A “content owner” is a person or entity that has some property right in the content of a document. A content owner may be an author of the content. In addition, or alternatively, a content owner may have rights to reproduce the content, rights to prepare derivative works of the content, rights to display or perform the content publicly, and/or other proscribed rights in the content. Although a content server (e.g., a Web publisher) might be a content owner in the content of the documents it serves, this is not necessary.
“User information” may include user behavior information and/or user profile information.
“E-mail information” may include any information included in an e-mail (also referred to as “internal e-mail information”), information derivable from information included in the e-mail and/or information related to the e-mail, as well as extensions of such information (e.g., information derived from related information). An example of information derived from e-mail information is information extracted or otherwise derived from search results returned in response to a search query composed of terms extracted from an e-mail subject line. Examples of information related to e-mail information include e-mail information about one or more other e-mails sent by the same sender of a given e-mail, or user information about an e-mail recipient. Information derived from or related to e-mail information may be referred to as “external e-mail information.”
“Ad area” may be used to describe an area (e.g., spatial and/or temporal) of a document reserved or made available to accommodate the rendering of ads. For example, Web pages often allocate a number of spots where ads can be rendered, referred to as “ad spots”. An ad spot may be able to accommodate one or more ads. As another example, an audio program may allocate “ad time slots”.
A “graphical element” may include, but is not limited to, a portable network graphics (PNG) element, a joint photographic experts group (JPEG) element, a graphics interchange format (GIF) element, a scalable vector graphics (SVG) element, a tagged image file format (TIFF) element, a bitmap, etc.
4.2 Environments in Which, or with Which, the Present Invention may Operate
4.2.1 Exemplary Advertising Environment
The ad server 120 may be similar to the one described in
As discussed in the '900 application (introduced above), ads may be targeted to documents served by content servers. Thus, one example of an ad consumer 130 is a general content server 230 that receives requests for documents (e.g., articles, discussion threads, music, video, graphics, search results, Web page listings, etc.), and retrieves the requested document in response to, or otherwise services, the request. The content server may submit a request for ads to the ad server 120/210. Such an ad request may include a number of ads desired. The ad request may also include document request information. This information may include the document itself (e.g., a Web page), a category or topic corresponding to the content of the document or the document request (e.g., arts, business, computers, arts-movies, arts-music, etc.), part or all of the document request, content age, content type (e.g., text, graphics, video, audio, mixed media, etc.), geo-location information, document information, etc.
The content server 230 may combine the requested document with one or more of the advertisements provided by the ad server 120/210. This combined information including the document content and advertisement(s) is then forwarded towards the end user device 250 that requested the document, for presentation to the user. Finally, the content server 230 may transmit information about the ads and how, when, and/or where the ads are to be rendered (e.g., position, selection or not, impression time, impression date, size, conversion or not, etc.) back to the ad server 120/210. Alternatively, or in addition, such information may be provided back to the ad server 120/210 by some other means.
Another example of an ad consumer 130 is the search engine 220. A search engine 220 may receive queries for search results. In response, the search engine may retrieve relevant search results (e.g., from an index of Web pages). An exemplary search engine is described in the article S. Brin and L. Page, “The Anatomy of a Large-Scale Hypertextual Search Engine,” Seventh International World Wide Web Conference, Brisbane, Australia and in U.S. Pat. No. 6,285,999 (both incorporated herein by reference). Such search results may include, for example, lists of Web page titles, snippets of text extracted from those Web pages, and hypertext links to those Web pages, and may be grouped into a predetermined number (e.g., ten) of search results.
The search engine 220 may submit a request for ads to the ad server 120/210. The request may include a number of ads desired. This number may depend on the search results, the amount of screen or page space occupied by the search results, the size and shape of the ads, etc. In one embodiment, the number of desired ads will be from one to ten, and preferably from three to five. The request for ads may also include the query (as entered or parsed), information based on the query (such as geolocation information, whether the query came from an affiliate and an identifier of such an affiliate, and/or as described below, information related to, and/or derived from, the search query), and/or information associated with, or based on, the search results. Such information may include, for example, identifiers related to the search results (e.g., document identifiers or “docIDs”), scores related to the search results (e.g., information retrieval (“IR”) scores such as dot products of feature vectors corresponding to a query and a document, Page Rank scores, and/or combinations of IR scores and Page Rank scores), snippets of text extracted from identified documents (e.g., Web pages), full text of identified documents, topics of identified documents, feature vectors of identified documents, etc.
The search engine 220 may combine the search results with one or more of the advertisements provided by the ad server 120/210. This combined information including the search results and advertisement(s) is then forwarded towards the user that submitted the search, for presentation to the user. Preferably, the search results are maintained as distinct from the ads, so as not to confuse the user between paid advertisements and presumably neutral search results.
The search engine 220 may transmit information about the ad and when, where, and/or how the ad was to be rendered (e.g., position, click-through or not, impression time, impression date, size, conversion or not, etc.) back to the ad server 120/210. As described below, such information may include information for determining on what basis the ad was determined relevant (e.g., strict or relaxed match, or exact, phrase, or broad match, etc.) Alternatively, or in addition, such information may be provided back to the ad server 120/210 by some other means.
Finally, the e-mail server 240 may be thought of, generally, as a content server in which a document served is simply an e-mail. Further, e-mail applications (such as Microsoft Outlook for example) may be used to send and/or receive e-mail. Therefore, an e-mail server 240 or application may be thought of as an ad consumer 130. Thus, e-mails may be thought of as documents, and targeted ads may be served in association with such documents. For example, one or more ads may be served in, under over, or otherwise in association with an e-mail.
Although the foregoing examples described servers as (i) requesting ads, and (ii) combining them with content, one or both of these operations may be performed by a client device (such as an end user computer for example).
4.3 Exemplary Embodiments
Embodiments consistent with the present invention may be used to help ad delivery systems to maintain a good perception of its ads by end users and to avoid tarnishing such a good perception due to ads with the same or similar format by other ad delivery systems, and/or due to its own ads being rendered with poorly performing documents or being served under circumstances that might decrease their usefulness to end users. The present invention may do so by controlling the number of ads rendered, and/or a type and/or degree of branding associated with ads, using one or more factors that affect end user perception of the ads. Such factors may include some measure of the performance of the document (e.g., a Web page) on which the ads will be rendered, some degree of confidence in the targeting (e.g., some degree of similarity, type of targeting used, etc), etc.
4.3.1 Determining Document Quality Scores
Although embodiments consistent with the present invention can be used with various types of document quality scores, even including manually determined document quality scores or scores provided from a third party source, this section describes various techniques that may be used to determine document quality scores. The same or similar techniques are described in U.S. patent application Ser. No. 10/880,972 (incorporated herein by reference, and referred to as “the '972 application”), titled “ADJUSTING AD COSTS USING DOCUMENT PERFORMANCE OR DOCUMENT COLLECTION PERFORMANCE,” filed on Jun. 30, 2004, and listing Brian Axe, Doug Beeferman, Amit Patel, Nathan Stoll and Hal Varian as inventors.
As documents 332 with ads 334 are served, various performances may be tracked. For example, per ad performance tracking and determination operations 340 may be used to generate ad performance information 342. The ad performance information 342 may include a number of entries, and each entry may include an ad identifier 344 and one or more performance values 346. The one or more performance values 346 may be selection rates, conversion rates, user ratings, etc., over some collection of documents (e.g., across all documents with which the ad was served). As another example, per document (set) performance tracking and determination operations 350 may be used to generate document performance information 352. The document performance information 352 may include a number of entries, and each entry may include a document identifier (e.g., a URL of a Web page) 354, and one or more performance values 356. The one or more performance values 356 may be selection rates, conversion rates, user ratings, etc., over some collection of ads (e.g., across all ads that were served with the document).
The document performance values 356 could be used, without further processing, in the context of the present invention. However, for a given document, a better document performance value might be discovered if the influence of the performance of ads that the document has shown was removed. This may be done as follows. Document quality scoring operations 360 may use ad performance information 342 and/or document performance information 352 to generate document score information 370. As shown, the document score information 370 may include a number of entries, and each entry may include a document identifier 372 and a document quality score 374. In at least some embodiments consistent with the present invention, score combination operations 380 may be used to generate document set score information 390. As shown, the document set score information 390 may include a number of entries, and each entry may include a document set identifier 392 and a quality score 394 for the document set. Although not shown, a mapping of document identifiers to document set identifiers may also be stored.
The document scores may be used to indicate an expected performance (e.g., selection rate, conversion rate, etc.) for the document over a collection of ads (e.g., all ads). Similarly, the document set scores may be used to indicate an expected performance for the document set over a collection of ads (e.g., all ads). As will be described in § 4.3.2 below, such scores can be used to help ad delivery systems maintain a good perception of its ads by end users and avoid tarnishing such a good perception due to ads with the same or similar format by other ad delivery systems, and/or due to its own ads being served with poorly performing documents.
4.3.2 Adjusting AD Number and/or AD Branding Level/Type Using One or More Factors that Affect End User Perception of the Ads, Such as Document Quality Scores
Although the document (or document set) quality score may be one factor affecting an end user perception of the quality of the ads, one or more other factors may be used instead of, or in addition to, document (or document set) quality. For example, the performance of an ad itself, or some combined performance of a set of ads, may be such a factor. As another example, various ad serve quality indicators may be factors. More specifically, in the context of content-relevant ad serving, a degree of similarity between the ad and the document, and/or a confidence level in such a degree of similarity (or some other relevancy score), may be such a factor. A content score, which rates whether the content-relevant ad server can determine what specific topic the Web page, or area of the Web page, is about with an appropriate level of certainty, may be another factor. In the context of keyword-targeted ad serving, a type of keyword targeting used (e.g., broad, phrase, exact) may be such a factor. As yet another example, user behavior may be such a factor. For example, if a user selects a certain type of ad (or converts on, or remains at the ad landing page for a certain amount of time), then more of that same ad may be shown, perhaps with enhanced branding, especially when the user navigates or views content related to the ad(s) selected.
At least some of the foregoing embodiments tracked some performance of documents, scored the documents using the tracked value, and determined a number of ads to serve and/or a type or level of branding to provide using the scores. In at least some embodiments consistent with the present invention, the performance of documents can be tracked with finer granularity. For example, the performance of a document per ad can be tracked, the performance of the document per ad collection (e.g., text ads, image ads, video ads, audio ads, ads from a given advertiser, etc.) can be tracked, the performance of the document per targeting criteria (e.g., per keyword, per keyword collection, per geolocation, per time, per date, per season, per month, per day of week, per user type, per user behavior, etc.) can be tracked, the performance of the document per targeting technique (e.g., keyword targeted, content targeted, etc.), the performance of the document per query match type can be tracked (e.g., exact, phrase, broad, etc.), etc. This tracked information may be used in determining more specific per document scores. Such more specific document scores can be selectively used, perhaps along with other factors, to determine a number of ads to serve and/or a type or level of branding to provide using the scores.
As one example, consider an embodiment consistent with the present invention in which ad-specific document scores S(doci, adj) could be used directly (if there was enough data). In such an alternative embodiment, the branding applied to different ads might be different.
As an example of determining a branding type depending on the performance of the type of targeting used, suppose the keyword “diamond” delivers ads with a better end user quality perception (as inferred from a higher conversion rate) when the ad is targeted to search than when it is targeted to content. This fact could be used to apply a lower level of branding to ads targeted to content using the concept “diamond.” As another example, suppose that the keyword “diamond” converts much better via exact match (search query contains only that keyword) than broad match (search query contains any of the keywords or synonyms of the keyword). This fact could be used to apply a higher level of branding to ads using diamond with exact matching than to ads using diamond with broad matching. There may also be different types of content-targeting which could have different affects on end user quality perceptions (e.g., URL-based where the entire Webpage is crawled versus content extraction where javascript sends key pieces of the Webpage versus publisher specified keywords used as hints along with the page contents versus publisher specified keywords and no page content).
A publisher quality metric (which may be a function of one or more of the use of pop-up ads, search index spamming techniques like invisible text, suspect fraudulent activity like clicking on ads or forging conversions, etc.) may also be a factor in end user quality perceptions.
4.3.3 Exemplary Data Structures
Data structures, such as 342, 352, 370 and 390 of
4.3.4 Exemplary Methods
As introduced above, embodiments consistent with the present invention may be used to score documents, or sets of documents, typically using some measure of value of an action or user action triggering a cost to an advertiser. Exemplary methods that may be used to score documents, in a manner consistent with the present invention, are described in § 4.3.4.1 below.
As also introduced above, embodiments consistent with the present invention may be used to control a number of ads to be served with a document, and/or to control a level and/or type of branding to be used with such ads, using one or more factors affecting end user quality perception, such as a determined document quality score for example. Exemplary methods that may be used to provide such control, in a manner consistent with the present invention, are described in § 4.3.4.2 below.
4.3.4.1 Exemplary Methods for Determining Document Scores
Recall from block 510 of
The score of an ad on a document may be determined in various ways. For example, a selection rate may be tracked and used. Alternatively, or in addition, ad ROI may be tracked and used. Alternatively, or in addition, ad conversion rate may be tracked and used.
4.3.2.2 Exemplary Methods for Controlling a Number of Ads to be Served with a Document, and/or Branding Associated with ads to be Served with a Document
In the context of a system, such as system 200 of
In at least one embodiment consistent with the invention, for low scoring Web pages (e.g., those with low predicted selection rates), any slot beyond the first slot does not show any ads. This may be done by having the ad system not send any html to be displayed in the transparent iframe, or by having the ad system send a background color (e.g., a custom color specified by the publisher). Alternatively, some publishers may be configured to have a publisher specified alternative ad (which may be managed and/or inserted by the publisher) show which will appear in the additional slots instead of making the slots blank.
On the other hand, for high scoring Web pages (e.g., those with high predicted selection rates), all slots may be filled with ads. Further, eye-catching ad formats (e.g., including a brand icon, brand colors, etc.) may be used to more strongly associate the brand of the ad server with the displayed ads.
For requests coming from browsers which do not support transparent iframes (e.g. Netscape), the ad serving system may detect the browser in the header of the request and send back html setting the iframe window to the same background color as the parent window.
4.3.5 Exemplary Apparatus
The one or more processors 910 may execute machine-executable instructions (e.g., C or C++ running on the Solaris operating system available from Sun Microsystems Inc. of Palo Alto, Calif. or the Linux operating system widely available from a number of vendors such as Red Hat, Inc. of Durham, N.C.) to effect one or more aspects of the present invention. At least a portion of the machine executable instructions may be stored (temporarily or more permanently) on the one or more storage devices 920 and/or may be received from an external source via one or more input interface units 930.
In one embodiment, the machine 900 may be one or more conventional personal computers. In this case, the processing units 910 may be one or more microprocessors. The bus 940 may include a system bus. The storage devices 920 may include system memory, such as read only memory (ROM) and/or random access memory (RAM). The storage devices 920 may also include a hard disk drive for reading from and writing to a hard disk, a magnetic disk drive for reading from or writing to a (e.g., removable) magnetic disk, and an optical disk drive for reading from or writing to a removable (magneto-) optical disk such as a compact disk or other (magneto-) optical media.
A user may enter commands and information into the personal computer through input devices 932, such as a keyboard and pointing device (e.g., a mouse) for example. Other input devices such as a microphone, a joystick, a game pad, a satellite dish, a scanner, or the like, may also (or alternatively) be included. These and other input devices are often connected to the processing unit(s) 910 through an appropriate interface 930 coupled to the system bus 940. The output devices 934 may include a monitor or other type of display device, which may also be connected to the system bus 940 via an appropriate interface. In addition to (or instead of) the monitor, the personal computer may include other (peripheral) output devices (not shown), such as speakers and printers for example.
The various operations described above may be performed by one or more machines 900, and the various information described above may be stored on one or more machines 900. The ad server 210, search engine 220, content server 230, e-mail server 240, and/or user device 250 may include one or more machines 800.
4.3.6 Exemplary Ad Formats with Various Types and/or Levels of Ad Branding
As shown in
As shown in
As shown in
As shown in
Naturally, other ad formats are possible. Such ad formats may include one or more of text elements, graphical elements, line segment elements, etc. Similarly, other graphical elements are possible, as are other border designs. One or more of the elements may be associated with the brand of the content-relevant ad server that provided the ads. When it is desired to provide more prominent branding, it may be desirable to place branding elements higher and/or more to the left, since that is the way people read in the U.S., or to locate such branding based on how people read.
A minimum level of branding might be an ad format with “Ads by Google” text, with no brand colors or graphical elements. An intermediate level of branding might be an ad format with “Ads by Google” text and a box surrounding the ads, where the segments of the box are provided in colors associated with the Google brand. Another intermediate level of branding might be an ad format with “Ads by Google” text and a graphical element associated with the Google brand. An high level of branding might be an ad format with “Ads by Google” text, a box surrounding the ads, where the segments of the box are provided in colors associated with the Google brand and a graphical element associated with the Google brand. Another example of a high level of branding might be an ad format with “Ads by Google” text and large graphical elements associated with the Google brand. Naturally, a wide number of branding levels employing various branding elements is possible.
Further, some ad formats, such as those 1000-1900 of
In embodiments in which publishers have selected, or can select, custom colors for ads to be provided on their Web page, such color selections may be considered in how ads are provided. For example, if an existing publisher has specified customer colors, such a publisher may be notified of the new Google brand color formats. Such a publisher may then log onto the content-relevant ad serving system and opt-into having their current custom color replaced by the new Google brand color formats (e.g., on high performance Web pages). The publisher can select one or more Google ad formats, or even all Google brand color formats. If more than one format is selected, they may be randomly rotated on high performance Web pages. If the publisher does not opt-in, then there is no change to their format. Publishers may be offered incentives, such as a larger share of ad revenue, to opt-into having their current custom color replaced by the new Google brand color formats on high performance Web pages.
If, on the other hand, an existing or new publisher does not have custom colors, such a publisher may be notified of the new Google brand color formats. When such a publisher logs onto the content-relevant ad delivery system, it may be provided with a time period (e.g., two weeks notice) in which to opt-out (in which case the generic Google format of no color customization is not replaced by the new Google brand color formats on high performance pages only). If the publisher does not opt-out within the specified time period, the new Google brand color formats will replace the standard Google format with no color customization (e.g., on high performance pages only). As Google adds more Google brand color formats, a publisher can login and change their selections. The publisher can select one or more Google ad formats, or even all Google brand color formats. If more than one format is selected, they may be randomly rotated on high performance Web pages. Publishers may be offered incentives, such as a larger share of ad revenue, to opt-into having their current custom color replaced by the new Google brand color formats on high performance Web pages.
Similarly, a publisher may be notified of versions of an ad delivery system that change a number of ads served using some factor that may affect end user perception of the ads. For example, a publisher may log onto the content-relevant ad delivery system and configure up to N (e.g., three) new creatives to place in up to N ad slots on a single Web page. The publisher may then place new creative on Web page. That is, the publisher can place multiple ad creatives on the same Webpage. This allows the content-relevant ad delivery system to serve more ads when it is appropriate. The publisher may optionally configure the background color and/or alternative ads to be used when the slot is not filled with ads. In some embodiments, the publisher may be provided with the ability to control how many ads to show, and/or the performance (e.g., selection rate) threshold controlling the number of ads to be rendered.
4.3.7 Alternatives and Refinements
Although some of the foregoing embodiments controlled a number of ads and/or branding, factors affecting end user perceptions of ad quality may also be used to select an ad spot in which to show ads. For example, if the end user perception of the quality of the ads is expected to be bad, the ads can be shown in less prominent ad spots (e.g., a “skyscraper” spot in side margin rather that “leader-board” spot at top).
Although some of the foregoing embodiments discussed scoring a document, sets of documents can be scored. The set of documents may be documents belonging to one Website or one publisher for example. Note that although some of the exemplary embodiments were described in the context of publishers of content-based Web pages, the present invention may be used with other types of publishers, such as search engine Websites generating search result page views for example.
In some of the foregoing embodiments, it was assumed that there would be enough data to determine a document score. However, it may be the case that there won't be enough data to compute a score (or a score with a desired degree of confidence) for all documents. In at least some embodiments consistent with the present invention, a document score can be determined using data from “related” and/or “similar” documents. For example, if a document D does not have enough scores with high confidence, additional data is needed. A good source of such additional data would be to look at “related” and/or “similar” documents. As one example, a document similarity tree may be generated as follows. In a bottom-up process, a node for each document is created. Then at every step, two parentless nodes that are most similar to each other (using some similarity score, like similarity of the set of advertisers that they serve) are found and associated as sibling nodes under a new parent. Once the document similarity tree is generated, if a document D does not have enough data to compute a score S(D), D's parent D1 is found. Some data (e.g., sales, selections) of the parent D1 is set to be the sum of the data for all documents under D1. A score for the parent document S(A,D1) can be determined from the imputed data (i.e., data of its descendants). In a first alternative (e.g., if there is enough data) the new score of the document S(D) can be set to some mix of the score of the parent document S(D1) and the original score of the document S(D). In a second alternative (e.g., if there is not enough data), parent document D1's parent (D2) can be found, and the merging process can be continued. In yet another alternative, the score of the document S(D) can simply inherit the score of its parent S(D1).
In at least some embodiments consistent with the present invention, the publisher may be allowed to control how many ads to show, or to set some performance (e.g., selection rate) threshold for increasing or reducing the number of ads.
Although most of the embodiments discussed above concerned Web page documents, the present invention may be used in the context of other types of documents, such as for ads shown while rendering email, ads shown in the email body via a personal email, a newsletter or a group mailing list, ads shown in document readers like Word or Adobe Acrobat, etc. If the document and/or ads include audio components, the branding may include tones, jingles, sound effects, etc., used to convey source or quality of the ads. Similarly, if the document and/or ads include video components, the branding may include a video sequence used to convey source or quality of the ads.
For publishers receiving ads via an xml datafeed, the number of ads returned could be expanded and a parameter denoting if the ad format branding type should be modified, could be passed to the publisher's server so that it would then render the ads in the appropriate format.
In the following examples, a document is a Web page and the document score is a selection rate associated with the Web page. A first Web page is considered to be a “high performance” Web page having a selection rate of >0.20. A second Web page is considered to be a “low performance” Web page with a selection rate of <0.20.
For the high performance Web page, it is assumed that the Web page loads and all available ad slots (e.g. leader-board on top, skyscraper on right hand side, and ad banner on bottom) are filled with ads. Each slot includes a strong branding format. (e.g., Google brand colors, if configured, Google trademark icon and if configured, Google brand colors, etc.). If there are no relevant ads found, or if the Webpage is determined to be negative (i.e., concerning negative topics such as murder, suicide, war, tragedy, etc.), then public service ads (PSAs) fill only the top slot, while the others disappear or convert into publisher specified alternative ads (if the publisher has configured fallback ads). Image ads may replace any text ad slot. In at least some embodiments, different amounts of shading, different colors, and/or different visual cues may be used to distinguish normally targeted ads from public service ads, or publisher provided ads.
For the low performance Web page, it is assumed that the Web page loads and only one of the ad slots (e.g. leader-board on top) is filled with ads. Image ads may replace the first text ad slot. Other ad slots on the Web page (e.g. skyscraper on right hand side, and ad banner on bottom) either disappear (blank background), or convert into publisher specified alternative ads (if the publisher has configured fallback ads). The format displayed includes Google attribution, but less prominently (e.g., the Google trademark icon is not shown). If Google does not have the content of the page, or ads to show, or the page is determined to be negative, then PSAs show on only the top slot and the other slots either disappear (blank background) or convert into publisher specified alternative ads (if the publisher has configured fallback ads).
As can be appreciated from the foregoing, the present invention is advantageous in that it allows high quality ad delivery systems to protect their brand image and enhance the perceived quality of their ads by end users.
