Search engines allow users to search indexes of various types of items, such as products offered for sale, social networking profiles, web pages, images, videos, audio tracks, and/or other types of items. To search, a user provides a search query, which may be a string of terms, perhaps with Boolean or other connectors. The search engine receives the search query and executes a search against the index of items. In response to the search, a result set is returned. The search engine may then employ a relevance algorithm to rank the results. The relevance algorithm may take into account a variety of factors, such as closeness of match to the search query, location of matching terms in the item, popularity of the items, and so on. The results, or a subset of results, are then presented to the user in ranked order within a network page.
Many aspects of the present disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, with emphasis instead being placed upon clearly illustrating the principles of the disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
The present disclosure relates to selecting supplemental content for inclusion in a search results page. When a user executes a search query with a search engine, a search results page is returned. The search results constitute the primary content within this search results page. However, it may be desirable to include supplemental content in addition to the search results. The supplemental content may drive revenues for the operator of the search engine as much as, or even more than, the actual search results themselves. The supplemental content may be relevant to the search query, such that the user may benefit from viewing the supplemental content in the search page in lieu of, or in addition to, search results. The supplemental content may also serve the function of filling otherwise empty area on the user's display.
Various forms of supplemental content may include, for example, advertisements for external network sites, sponsored search result listings, recommendations for similar products, advertisements for merchants local to the user, and/or other supplemental content. The various forms of supplemental content may be provided by different systems, which may be controlled by different entities. The different systems that provide the supplemental content in response to the search query may employ vastly different relevance algorithms. Further, the different sources of supplemental content may have differing relevancies to the search query.
Embodiments of the present disclosure are configured to select supplemental content from multiple sources for inclusion in the search results page. In doing so, the differing relevancies of the sources may be taken into account, as well as the differing algorithms used by each in producing ranked results. Accordingly, a subset of the sources may be selected, while a subset of the sources may be excluded. Moreover, immediate monetary value may be weighed with downstream business value in order to select sources and supplemental content. In some scenarios, different layouts for the search results page may be employed to feature the supplemental content from the selected sources.
Turning now to
When a search query is submitted, search results 121 are obtained from the search engine 106. Also, in this example, supplemental content 124a and 124b are obtained from the supplemental content providers 109a and 109b. To obtain the supplemental content 124a, 124b, the search query and/or other information may be supplied to the supplemental content providers 109a and 109b. The content selection logic 115 then obtains content from the supplemental content providers 109. In some cases, the content selection logic 115 may obtain supplemental content 124 only from supplemental content providers 109 that have been selected by the provider selection logic 112. Sets of content may be obtained from each of the selected supplemental content providers 109, and these sets of content may be in a ranked order according to relevance as determined by a respective algorithm for each supplemental content provider 109. The content selection logic 115 selects supplemental content 124a and 124b from these ranked sets of content according to another relevance algorithm that blends or weights the respective relevancies, taking into account relevancy to the search query, relevancy to the user, immediate monetary value, downstream business value, and/or other factors.
The provider selection logic 112 selects a subset of the supplemental content providers 109 based at least in part on mutual compatibility of their content, relevancy to the search query, relevancy to the user who initiated the search query, immediate monetary value, downstream business value, and/or other factors. In some cases, the selection decision by the provider selection logic 112 may trigger further processing by the content selection logic 115.
The search results 121, the supplemental content 124a, and the supplemental content 124b are provided to the page generation logic 118, which generates the search results page 103. In various embodiments, the layout of the search results page 103 may depend on the supplemental content 124a and 124b that is selected. For example, hyper-relevant supplemental content 124 may be rendered above the search results 121 or in a pop-up/pop-over dialog, while less relevant supplemental content 124 may be rendered alongside the search results 121, on a subsequent screen of the search results page 103 (“below-the-fold”), and/or in other locations. In the following discussion, a further description of the system and its components is provided, followed by a discussion of the operation of the same.
With reference to
The computing environment 203 may comprise, for example, a server computer or any other system providing computing capability. Alternatively, the computing environment 203 may employ a plurality of computing devices that may be arranged, for example, in one or more server banks, computer banks, or other arrangements. Such computing devices may be located in a single installation or may be distributed among many different geographical locations. For example, the computing environment 203 may include a plurality of computing devices that together may comprise a hosted or “cloud” computing resource, a grid computing resource, and/or any other distributed computing arrangement. In some cases, the computing environment 203 may correspond to an elastic computing resource where the allotted capacity of processing, network, storage, or other computing-related resources may vary over time.
Various applications and/or other functionality may be executed in the computing environment 203 according to various embodiments. Also, various data is stored in a data store 212 that is accessible to the computing environment 203. The data store 212 may be representative of a plurality of data stores 212 as can be appreciated. The data stored in the data store 212, for example, is associated with the operation of the various applications and/or functional entities described below.
The components executed on the computing environment 203, for example, include a search engine 106, a plurality of supplemental content providers 109, a compatibility rule generation application 215, a page generation application 218, a network page server application 221, and other applications, services, processes, systems, engines, or functionality not discussed in detail herein. The search engine 106 is executed to perform a search upon an item database using a search query and return a set of search results 121 (
The supplemental content providers 109 are configured to provide supplemental content 124 (
The compatibility rule generation application 215 is executed to generate compatibility rules 224 that determine whether different types of supplemental content 124 served by different supplemental content providers 109 are compatible or incompatible. For example, it may be determined that supplemental content 124 containing customer reviews of products are incompatible with supplemental content 124 containing advertisements to sign-up with a preferred customer program. It may be the case that a first supplemental content provider 109 is incompatible with a second supplemental content provider 109. Alternatively, it may be that a first supplemental content provider 109 is incompatible with a combination of a second supplemental content provider 109 with a third supplemental content provider 109.
The compatibility rule generation application 215 may, for example, examine supplemental content selection history 227 for multiple users to empirically determine which supplemental content providers 109 result in click-throughs, revenue, and/or other metrics. That is to say, it may be empirically determined that when supplemental content 124 from two particular supplemental content providers 109 are rendered in the same search results page 103 (
The page generation application 218 is executed to assemble the search results pages 103 and/or other network pages. To this end, the page generation application 218 may include, for example, the provider selection logic 112 (
The network page server application 221 is executed to receive search query requests from clients 206 and to respond with the search results pages 103 and/or other pages. The network page server application 221 may serve information via hypertext transfer protocol (HTTP), simple object access protocol (SOAP), representational state transfer (REST), and/or other protocols. The network page server application 221 may comprise a commercially available HTTP server such as, for example, Apache® HTTP Server, Apache® Tomcat®, Microsoft® Internet Information Services (IIS), and so on.
The data stored in the data store 212 includes, for example, item data 230, supplemental content data 233, supplemental content selection history 227, network page data 236, compatibility rules 224, relevance configuration data 239, user profile data 242, layout configuration data 245, and potentially other data. The item data 230 may store information relating to items that are searchable by the search engine 106. Such items may include products, services, web pages, social network profiles, music, videos, and so on. In various scenarios, the item data 230 may store data such as title, description, keywords, price, quantity, customer reviews, and/or other data.
The supplemental content data 233 corresponds to the different forms of supplemental content 124 provided by the supplemental content providers 109. Such supplemental content 124 may include advertising, related items, customer reviews, local offers, and/or other forms of supplemental content 124. In one embodiment, the supplemental content data 233 associated with different supplemental content providers 109 may be maintained in separate data stores 212.
The supplemental content selection history 227 includes selection or browse history to indicate click-throughs for supplemental content 124 on search results pages 103. The supplemental content selection history 227 may include context to indicate the other supplemental content 124 present on a page when particular supplemental content 124 was selected, where the supplemental content 124 was situated in a display layout, sales conversions, and/or other information for assessing the efficacy of the presentations of the supplemental content 124.
The network page data 236 may include various data employed in generating search results pages 103 and/or other network pages. The network page data 236 may include hypertext markup language (HTML), extensible markup language (XML), cascading style sheets (CSS), images, text, audio, video, templates, and/or other data. The compatibility rules 224 define whether supplemental content 124 from different supplemental content providers 109 are compatible or are incompatible. The compatibility rules 224 may be manually created or may be dynamically generated by the compatibility rule generation application 215.
The relevance configuration data 239 includes configuration data for the various relevance ranking algorithms or approaches employed by the page generation application 218 and the various supplemental content providers 109. For example, the relevance configuration data 239 may indicate which factors are to be considered in generating relevance rankings, and constants used in blending or weighting the factors. The user profile data 242 may include profile characteristics for users. Such profile characteristics may include product preferences, browse history, order history, demographic information, location information, and/or other information. The layout configuration data 245 configures the selection or generation of page layouts by the page generation application 218.
The client 206 is representative of a plurality of client devices that may be coupled to the network 209. The client 206 may comprise, for example, a processor-based system such as a computer system. Such a computer system may be embodied in the form of a desktop computer, a laptop computer, personal digital assistants, cellular telephones, smartphones, set-top boxes, music players, web pads, tablet computer systems, game consoles, electronic book readers, or other devices with like capability. The client 206 may include a display 248. The display 248 may comprise, for example, one or more devices such as liquid crystal display (LCD) displays, gas plasma-based flat panel displays, organic light-emitting diode (OLED) displays, electrophoretic ink (E ink) displays, LCD projectors, or other types of display devices, etc.
The client 206 may be configured to execute various applications such as a client application 251 and/or other applications. The client application 251 may be executed in a client 206, for example, to access network content served up by the computing environment 203 and/or other servers, thereby rendering a user interface 254 on the display 248. To this end, the client application 251 may comprise, for example, a browser, a dedicated application, etc., and the user interface 254 may comprise a network page, an application screen, etc. The client 206 may be configured to execute applications beyond the client application 251 such as, for example, email applications, social networking applications, word processors, spreadsheets, and/or other applications.
Next, a general description of the operation of the various components of the networked environment 200 is provided. To begin, a user at a client 206 uses a client application 251 to send a search query via the network 209 to the network page server application 221. The network page server application 221 invokes the page generation application 218 to generate a search results page 103 in response to the search query. Additionally, identification of the user and/or the client 206 may be provided to the page generation application 218 in order to personalize the search results page 103 for the user.
The page generation application 218 uses the search engine 106 to execute a search based at least in part on the search query, user profile characteristics, and/or other information. In addition, the page generation application 218 obtains supplemental content 124 from selected supplemental content providers 109. The supplemental content providers 109 may be selected based at least in part on a compatibility rule 224 that defines whether supplemental content 124 from a first supplemental content provider 109 is permitted to be rendered in association with supplemental content 124 from a second supplemental content provider 109.
The page generation application 218 then generates a search results page 103 configured to present supplemental content from the selected supplemental content providers 109 and at least a portion of the search results 121. The page generation application 218 generates a display layout for the search results page 103 based upon the search results 121 and/or the supplemental content 124 that is selected. For example, the layout for the supplemental content 124 may be generated based at least in part on respective relevance scores for the supplemental content 124 using a blended or weighted relevance approach that takes into account different relevance approaches used by the different supplemental content providers 109. New relevance scores may be generated for the supplemental content 124 by weighting relevance scores provided by the respective relevance approaches based at least in part on the relevancies of the supplemental content providers 109 to the search query.
As a non-limiting example, suppose that the relevance scores from a first supplemental content provider 109 correlate to the immediate monetary value from the content when converted. It may be the case that the immediate monetary value is rather negligible, but the downstream business value of promoting the business associated with the first supplemental content provider 109 is substantial. Thus, in the blended relevance approach, the relevance scores may be weighted by a factor that greatly increases the relevance scores. Suppose that a first result from a first provider has an immediate monetary value of $0.01, while a second result from a second provider has an immediate monetary value of $5.00. After weighting, suppose that the first result has a blended value of $10.00, and the second result has a blended value of $6.00. The page generation application 218 may therefore select the first result for inclusion in the search results page 103 in place of, or with a higher prominence, than the second result. Additional factors may also weigh in to the blended relevance approach. For example, if the second result were hyper-relevant to the search query, the second result may achieve a higher blended relevance score than the first result.
The blended relevance scores may determine the layout of the search results page 103 as well as the position of supplemental content 124 within the layout. The search results page 103 is provided to the network page server application 221, and data encoding the search results page 103 is then returned to the client 206 via the network 209. In some embodiments, at least a portion of the content of the search results page 103 may be provided asynchronously using technologies such as asynchronous JavaScript and XML (AJAX). In some cases, an “infinite” scrolling layout may be used, where additional search results 121 and supplemental content 124 may be provided responsive to a user scrolling to a new screen of the search results page 103.
Referring next to
The network page layout 300 is merely one example of how a network page may be divided into a number of slots 303 corresponding to display regions. The page generation application 218 (
Furthermore, although the slots 303 of the network page layout 300 are indicated with a certain size relative to the user interface 254, it is understood that the slots 303 may be fixed in size or may change in size based on other attributes (e.g., glue elements, constraints, etc.) and/or what features are assigned to each slot 303. For example, when no features are assigned to a particular slot 303, that slot 303 may collapse in area and occupy no display region of the user interface 254. However, in another embodiment, the particular slot 303 may comprise a display region having a fixed or proportional size while including no features.
Moving on to
In this example, the slot(s) 303 have been populated with search results 121 (
The supplemental content 124 in the header slot 306 is more relevant to the search query than the supplemental content 124 in the bottom left slot 307. However, the supplemental content 124 in the header slot 306 may result in a lesser immediate monetary value upon conversion. That is to say, the operator of the network site may make less money via the local offer than a product offered for online ordering. Nonetheless, the local offer may have a greater downstream business value, e.g., building a “local offers” business, that may outweigh the lower immediate monetary value as determined by a relevance ranking approach that blends the relevance as reported by the supplemental content providers 109. Thus, ultimately, the “local offers” content is given a more prominent position in the network page layout 320 than the online product offer content.
Referring next to
Beginning with box 403, the compatibility rule generation application 215 receives supplemental content selection history 227 (
In box 406, using the received supplemental content selection history 227, the compatibility rule generation application 215 determines click-throughs, conversions, sales, etc. for supplemental content 124 (
In box 412, the compatibility rule generation application 215 generates a compatibility rule 224 (
Referring next to
Beginning with box 503, the page generation application 218 receives a search query. In box 506, the page generation application 218 receives a ranked set of search results 121 (
In box 509, the page generation application 218 receives a ranked set of supplemental content 124 (
In box 515, the page generation application 218 generates blended relevance scores for the supplemental content 124 using a different relevance approach. The different relevance approach may take into account immediate monetary value, downstream business value, user personalization, relevance to the search query, and/or other factors. In box 518, the page generation application 218 selects a subset of the supplemental content 124 based at least in part on the blended relevance scores.
In box 521, the page generation application 218 determines a display layout for the search results page 103 (
With reference to
Stored in the memory 606 are both data and several components that are executable by the processor 603. In particular, stored in the memory 606 and executable by the processor 603 are the search engine 106, the supplemental content providers 109, the compatibility rule generation application 215, the page generation application 218, the network page server application 221, and potentially other applications. Also stored in the memory 606 may be a data store 212 and other data. In addition, an operating system may be stored in the memory 606 and executable by the processor 603.
It is understood that there may be other applications that are stored in the memory 606 and are executable by the processor 603 as can be appreciated. Where any component discussed herein is implemented in the form of software, any one of a number of programming languages may be employed such as, for example, C, C++, C#, Objective C, Java®, JavaScript®, Perl, PHP, Visual Basic®, Python®, Ruby, Flash®, or other programming languages.
A number of software components are stored in the memory 606 and are executable by the processor 603. In this respect, the term “executable” means a program file that is in a form that can ultimately be run by the processor 603. Examples of executable programs may be, for example, a compiled program that can be translated into machine code in a format that can be loaded into a random access portion of the memory 606 and run by the processor 603, source code that may be expressed in proper format such as object code that is capable of being loaded into a random access portion of the memory 606 and executed by the processor 603, or source code that may be interpreted by another executable program to generate instructions in a random access portion of the memory 606 to be executed by the processor 603, etc. An executable program may be stored in any portion or component of the memory 606 including, for example, random access memory (RAM), read-only memory (ROM), hard drive, solid-state drive, USB flash drive, memory card, optical disc such as compact disc (CD) or digital versatile disc (DVD), floppy disk, magnetic tape, or other memory components.
The memory 606 is defined herein as including both volatile and non-volatile memory and data storage components. Volatile components are those that do not retain data values upon loss of power. Nonvolatile components are those that retain data upon a loss of power. Thus, the memory 606 may comprise, for example, random access memory (RAM), read-only memory (ROM), hard disk drives, solid-state drives, USB flash drives, memory cards accessed via a memory card reader, floppy disks accessed via an associated floppy disk drive, optical discs accessed via an optical disc drive, magnetic tapes accessed via an appropriate tape drive, and/or other memory components, or a combination of any two or more of these memory components. In addition, the RAM may comprise, for example, static random access memory (SRAM), dynamic random access memory (DRAM), or magnetic random access memory (MRAM) and other such devices. The ROM may comprise, for example, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other like memory device.
Also, the processor 603 may represent multiple processors 603 and/or multiple processor cores and the memory 606 may represent multiple memories 606 that operate in parallel processing circuits, respectively. In such a case, the local interface 609 may be an appropriate network that facilitates communication between any two of the multiple processors 603, between any processor 603 and any of the memories 606, or between any two of the memories 606, etc. The local interface 609 may comprise additional systems designed to coordinate this communication, including, for example, performing load balancing. The processor 603 may be of electrical or of some other available construction.
Although the search engine 106, the supplemental content providers 109, the compatibility rule generation application 215, the page generation application 218, the network page server application 221, and other various systems described herein may be embodied in software or code executed by general purpose hardware as discussed above, as an alternative the same may also be embodied in dedicated hardware or a combination of software/general purpose hardware and dedicated hardware. If embodied in dedicated hardware, each can be implemented as a circuit or state machine that employs any one of or a combination of a number of technologies. These technologies may include, but are not limited to, discrete logic circuits having logic gates for implementing various logic functions upon an application of one or more data signals, application specific integrated circuits (ASICs) having appropriate logic gates, field-programmable gate arrays (FPGAs), or other components, etc. Such technologies are generally well known by those skilled in the art and, consequently, are not described in detail herein.
The flowcharts of
Although the flowcharts of
Also, any logic or application described herein, including the search engine 106, the supplemental content providers 109, the compatibility rule generation application 215, the page generation application 218, and the network page server application 221, that comprises software or code can be embodied in any non-transitory computer-readable medium for use by or in connection with an instruction execution system such as, for example, a processor 603 in a computer system or other system. In this sense, the logic may comprise, for example, statements including instructions and declarations that can be fetched from the computer-readable medium and executed by the instruction execution system. In the context of the present disclosure, a “computer-readable medium” can be any medium that can contain, store, or maintain the logic or application described herein for use by or in connection with the instruction execution system.
The computer-readable medium can comprise any one of many physical media such as, for example, magnetic, optical, or semiconductor media. More specific examples of a suitable computer-readable medium would include, but are not limited to, magnetic tapes, magnetic floppy diskettes, magnetic hard drives, memory cards, solid-state drives, USB flash drives, or optical discs. Also, the computer-readable medium may be a random access memory (RAM) including, for example, static random access memory (SRAM) and dynamic random access memory (DRAM), or magnetic random access memory (MRAM). In addition, the computer-readable medium may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other type of memory device.
Further, any logic or application described herein, including the search engine 106, the supplemental content providers 109, the compatibility rule generation application 215, the page generation application 218, and the network page server application 221, may be implemented and structured in a variety of ways. For example, one or more applications described may be implemented as modules or components of a single application. Further, one or more applications described herein may be executed in shared or separate computing devices or a combination thereof. For example, a plurality of the applications described herein may execute in the same computing device 600, or in multiple computing devices in the same computing environment 203. Additionally, it is understood that terms such as “application,” “service,” “system,” “engine,” “module,” and so on may be interchangeable and are not intended to be limiting.
Disjunctive language such as the phrase “at least one of X, Y, or Z,” unless specifically stated otherwise, is otherwise understood with the context as used in general to present that an item, term, etc., may be either X, Y, or Z, or any combination thereof (e.g., X, Y, and/or Z). Thus, such disjunctive language is not generally intended to, and should not, imply that certain embodiments require at least one of X, at least one of Y, or at least one of Z to each be present.
It should be emphasized that the above-described embodiments of the present disclosure are merely possible examples of implementations set forth for a clear understanding of the principles of the disclosure. Many variations and modifications may be made to the above-described embodiment(s) without departing substantially from the spirit and principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
This application is a continuation of, and claims priority to, co-pending U.S. patent application Ser. No. 15/151,766, entitled “SELECTING SUPPLEMENTAL CONTENT FOR INCLUSION IN A SEARCH RESULTS PAGE,” and filed May 11, 2016, which is a continuation of and claims priority to U.S. patent application Ser. No. 14/095,428, entitled “SELECTING SUPPLEMENTAL CONTENT FOR INCLUSION IN A SEARCH RESULTS PAGE,” and filed Dec. 3, 2013, each of which is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
6804675 | Knight et al. | Oct 2004 | B1 |
9367627 | Banti et al. | Jun 2016 | B1 |
20070282621 | Altman | Dec 2007 | A1 |
20080091482 | Whitsett | Apr 2008 | A1 |
20080140607 | Chi | Jun 2008 | A1 |
20100198628 | Rayner | Aug 2010 | A1 |
20120047483 | Amit et al. | Feb 2012 | A1 |
20140258260 | Rayborn | Sep 2014 | A1 |
20150220492 | Simeonov | Aug 2015 | A1 |
20160253429 | Banti et al. | Sep 2016 | A1 |
Number | Date | Country | |
---|---|---|---|
20180121523 A1 | May 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15151766 | May 2016 | US |
Child | 15851190 | US | |
Parent | 14095428 | Dec 2013 | US |
Child | 15151766 | US |