A web search engine searches for information on the World Wide Web in response to queries submitted by users. Search results can be presented in a list ordered by relevance and can include web pages, images, videos, information and other types of content deemed to be responsive to queries. Some search engines also mine data available in databases or other types of data repositories. A web crawler is a tool that systematically visits web sites in order to index their contents. Search engines use indexes built by web crawlers in order to find documents that are relevant to queries. When a user enters a query into a search engine, the engine examines its index and provides a listing of best-matching documents, usually with a short snippet containing the document's title and a portion of the document's text.
In general, one aspect of the subject matter described in this specification can be embodied in a method that includes creating a first label on behalf of a first user and a second label on behalf of a second user; receiving an association by the first user of the first label to a first search result in a plurality of first search results that were presented to the first user in response to a query submitted by the first user, and wherein the second user is unable to view the association; receiving an association by the second user of the second label to a second search result in a plurality of second search results that were presented to the second user in response to a query submitted by the second user, and wherein the first user is unable to view the association; granting permission on behalf of the first user to allow the second user to share the second label; and subsequent to granting permission, receiving an association of the first label by the second user to a third search result in a plurality of third search results that were presented to the second user in response to a query submitted by the second user. Other embodiments of this aspect include corresponding systems, apparatus, and computer program products.
These and other embodiments can optionally include one or more of the following features. A search result can be a web page, an image, a video, a news article or an advertisement. The first label and the second label can be identical. Concepts can be derived by analyzing content of search results associated with the first label. Ad categories can be associated with the first user based on the derived concepts. Advertising can be targeted to the first user based on the derived concepts. Search results associated with the first label can be published. Receiving an association by the first user of the first label to the first search result can include storing a portion of the first search result as part of the association.
Particular embodiments of the subject matter described in this specification can be implemented so as to realize one or more of the following advantages. Users can label search results and other content for easy retrieval. Labels can be used to cooperatively label content by sharing the label with others. Labeled content can be mined for concepts in order to target advertisements to users.
The details of one or more embodiments of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will become apparent from the description, the drawings, and the claims.
Like reference numbers and designations in the various drawings indicate like elements.
Client devices 100, 102, and 104, such as personal computers, mobile phones, tablet computers, or other devices or data processing apparatuses, are capable of interacting with server devices (search engine 106, label server 108 and document server 110), by transmitting and receiving data through one or more computer networks such as, for example, the Internet. While the server devices are illustrated as single devices in
By way of illustration, User 1 interacting with client device 100 through a software application such as a web browser or other application, submits a query 112 to a search engine 106. The query can comprise text, one or more images, or sounds (e.g., spoken words or phrases), for example. The search engine 106 uses one or more indexes of content on the world wide web, or indexes of other content, to identify results responsive to the query. The search engine 106 transmits search results 114 to the client device 100, and the software application executing on the client device 100 presents the results to User 1. The search results can consist of, for instance, references or links to content that satisfy the query, the actual content itself, or combinations thereof.
By way of illustration, user selection of display element 114b causes a pop-up menu 216 to appear in the user interface 200. The menu 216 allows the user to select a preexisting label to assign to the search result B or create a new label for the search result B. Menu 216 includes label 216a “Hawaii Trip”, label 216b “Paris Trip”, label 216c “AI Project”, and a special menu item 216d which allows the user to create new labels. The menu 216 grows as new labels are added to it. In response to selection of menu item 216a by User 1, client device 100 sends a message 116 to the label server 108 requesting association of search result B with the label “Hawaii Trip”. The label server 108 maintains a label repository 142 (see
Content for a specific label or for all of a user's labels can be searched. In some implementations, a text field display element 232 where users can enter queries and submit them by selecting a button display element 234 to search content of the currently selected label (e.g., 224a), or by selecting a button display element 236 to search the content of all of the user's labels.
One or more regions (e.g., 226) of the user interface 250, or other user interface, can be reserved for ads. Ads can be selected automatically based on the relevance of the ad to the labeled content for a given category (e.g., video 228b), to the labeled content for all categories for the currently selected label, or to all content associated with some or all of the user's labels. Ads can also be selected automatically based on keywords, for example. Ads that are presented in region 226 can themselves be labeled by selection of display elements 226a or 226b. In further implementations, users can also publish their label content to a publicly accessible web page or social networking sites such as Orkut, facebook, and so on, to let a broader audience know about their labeled content. Ads can also be selected for these publications based on relevance to the label content or keywords, for instance. Ads are described further below with reference to
Users can invite others to share their labels by selecting a graphical display element 240, for example. For example, an email message containing the invitation in the form of a hyperlink that, when selected, causes a web page to be presented that allows the invitee to accept or decline the invitation. Alternatively, graphical user interface 260 shown in
Returning to
Continuing with example of
Other entities, such as users 302 and advertisers 304, can provide usage information to the system 308, such as, for example, whether or not a conversion or click-through related to an ad has occurred. In some implementations, conversion data can be stored in a repository 312, where it can be used by the system 308 to improve ad targeting performance. The usage information provided to the system 308 can include measured or observed user behavior related to ads that have been served. In some implementations, the system 308 performs financial transactions, such as crediting the publishers 306 and charging the advertisers 304 based on the usage information.
A computer network, such as a local area network (LAN), wide area network (WAN), the Internet, wireless network or a combination thereof, can connect the advertisers 304, the system 308, the publishers 306, and the users 302.
One example of a publisher 306 is a general content server that receives requests for content (e.g., articles, electronic mail messages, discussion threads, music, video, graphics, networked games, search results, labels and associated label content, web page listings, information feeds, dynamic web page content, etc.), and retrieves the requested content in response to the request. The content server may submit a request (either directly or indirectly) for ads or ad link units to an ad server in the system 308. The ad request may include the number of ads desired. The ad link unit request may include the number of ad link units desired and the number of ad links per ad link unit. The ad or ad link unit request may also include content request information. This information can include the content itself (e.g., page or other content document), a category or keyword corresponding to the content or the content request (e.g., arts, business, computers, arts-movies, arts-music, etc.), the structure of the publisher's content (e.g., news articles, videos, images, products, and so on), part or all of the content request, content age, content type (e.g., text, graphics, video, audio, mixed media, etc.), geo-location information, demographic information related to the content, keyword, web property, and the like.
In various implementations, concepts for a given user's labeled content can be automatically derived by system 308 and used to match the user with ad categories or verticals so that ads can be targeted to the user. For example, all of user's labeled content, or the content for a specific label, can be treated as a single document from which concepts can be extracted by concept extraction engines. Examples of a concept extraction engines are described in U.S. Pat. No. 7,231,393, filed Feb. 26, 2004, entitled “Method and Apparatus for Learning a Probabilistic Generative Model for Text,” and U.S. Pat. No. 7,383,258, filed Sep. 30, 2003, entitled “Method and Apparatus for Characterizing Documents Based on Clusters of Related Words.” Other concept extraction engines or techniques are possible, however.
In some implementations, the content server (or a browser rendering content provided by the content server) can combine the requested content with one or more of the ads or ad link units provided by the system 308. The combination can happen prior to delivery of the content to the user or contemporaneously where the advertising server can serve the ads or ad link units directly to an end user. The combined content and ads or ad link units can be delivered to the user 302 that requested the content for presentation in a viewer (e.g., a browser or other content display system). The content server can transmit information about the ads or ad link units back to the ad server, including information describing how, when, and/or where the ads or ad link units are to be rendered (e.g., in HTML or JavaScript™). The content page 320 can be rendered in the user's viewer with one or more ads 322. When the user 302 clicks on a displayed ad 322 of an advertiser, the user 302 can be redirected to a landing page 318 of the advertiser's web site.
In one implementation, for the system 308 to provide advertisements to the publisher 306 that are targeted to the user 308 upon whose browser the advertisements will be displayed, it is advantageous for user profile information about the user 302 to be provided to the system 308. In some implementations, user profile information and other types of data can be collected by the system 308 and stored in a repository 116. The stored data may include, for example, geographic locations of users, ad context information, etc. The system can then select the advertisements to provide for viewing by the user 302 based at least in part on the user profile information.
The client devices 590 are connected to the server 510 through the network 580. The user device 590 is one or more data processing apparatus. Users interact with the client devices 590 through application software such as web browsers or other applications.
The server 510 is a data processing apparatus and has hardware or firmware devices including one or more processors 550, one or more additional devices 570, a computer readable medium 540, and one or more user interface devices 560. User interface devices 560 can include, for example, a display, a camera, a speaker, a microphone, a tactile feedback device, a keyboard, and a mouse. The server 510 uses its communication interface 530 to communicate with client devices 590 through the network 580. For example, the server 510 can receive requests to create labels, associate labels with content, and share labels, for instance, through its communication interface 530, and can provide user interfaces (e.g., 250, 260) to client devices 590 through its communication interface 560.
In various implementations, the server 510 includes various modules, e.g. executable software programs. In various implementations, these modules include a label association engine 525 and a label ad engine 520. The label association engine 525 maintains and updates label associations 143 and handles requests to share labels with other users. The label ad engine 520 processes label associations in order to determine concepts or ad categories for different users. This information can be used to target ads to the users.
Embodiments of the subject matter and the operations described in this specification can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Embodiments of the subject matter described in this specification can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on computer storage medium for execution by, or to control the operation of, data processing apparatus. Alternatively or in addition, the program instructions can be encoded on an artificially-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. A computer storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Moreover, while a computer storage medium is not a propagated signal, a computer storage medium can be a source or destination of computer program instructions encoded in an artificially-generated propagated signal. The computer storage medium can also be, or be included in, one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices).
The operations described in this specification can be implemented as operations performed by a data processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
The term “data processing apparatus” encompasses all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, a system on a chip, or multiple ones, or combinations of the foregoing. The apparatus can include special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). The apparatus can also include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The apparatus and execution environment can realize various different computing model infrastructures, such as web services, distributed computing and grid computing infrastructures.
A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for performing actions in accordance with instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name just a few. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
To provide for interaction with a user, embodiments of the subject matter described in this specification can be implemented on a computer having a display device, e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input. In addition, a computer can interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.
Embodiments of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front-end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (“LAN”) and a wide area network (“WAN”), an inter-network (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).
The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. In some embodiments, a server transmits data (e.g., an HTML page) to a client device (e.g., for purposes of displaying data to and receiving user input from a user interacting with the client device). Data generated at the client device (e.g., a result of the user interaction) can be received from the client device at the server.
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any inventions or of what may be claimed, but rather as descriptions of features specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.
Number | Name | Date | Kind |
---|---|---|---|
7231393 | Harik et al. | Jun 2007 | B1 |
7383258 | Harik et al. | Jun 2008 | B2 |
20040249801 | Kapur | Dec 2004 | A1 |
20100145927 | Kasbekar et al. | Jun 2010 | A1 |
20110010092 | Kavranoglu | Jan 2011 | A1 |