Patent Grant
10134055
Online advertising may be an important source of revenue for enterprises engaged in electronic commerce. A number of different kinds of web page based online advertisements are currently in use, along with various associated distribution requirements, advertising metrics, and pricing mechanisms. Processes associated with technologies such as Hypertext Markup Language (HTML) and Hypertext Transfer Protocol (HTTP) enable a web page to be configured to contain a location for inclusion of an advertisement. A page may not only be a web page, but any other electronically created page or document. An advertisement can be selected for display each time the page is requested, for example, by a browser or server application.
Online advertising may be linked to online searching Online searching is a very common way for consumers to locate information, goods, or services on the Internet. A consumer may use an online search engine to type in one or more keywords to search for other pages or web sites with information related to the keyword(s). The advertising that is shown on the search engine page may be related to the keyword(s). In particular, a search results page may be displayed, which may include the search results, as well as advertisements, related to the keyword(s) that produced the search results.
The advertisements related to search results shown as a search engine page, or based on content from other pages may be targeted to the consumer viewing the page. In particular, advertisers would like for their advertisements to be shown to those consumers who would be most likely to select the advertisement and to view the advertiser's page, or purchase the advertiser's goods or services. Accordingly, the advertising provider, such as a search engine, may attempt to determine the intent of consumers when those consumers view or interact with a web page.
Consumers use the Internet and search engines to find information and make decisions among online entities such as websites, online companies, or online services, independent of geographic constraints. For example, online retailers may provide goods or services to any location in the United States. Accordingly, contextual relevancy plays a role in driving economic value by helping consumers make decisions in their online lives. For example, the Internet may be used to help consumers find useful online services, online merchants and online information. In addition, the Internet is evolving into a type of informational utility that helps consumers make important local or geographic-specific decisions in their offline lives as well. Consumers are turning to the Internet for services that help them manage more of their day-to-day offline activities and needs.
A search engine may attempt to determine the intent of a consumer who just performed a search. In one example, the intent that is analyzed may be geographic, such as for a search for the keyword “dry cleaning,” it is likely that the intent of the consumer is a local intent, such that the results should be directed to a specific geographic location. Local intent may refer to whether the consumer would like geographically specific (local) results or whether there is a geographic component to the search query. Accordingly, the search engine may determine the presence of local intent of certain keywords and attempt to provide search results that are targeted to a specific geography. Local intent may refer to any aspect of intent that the consumer would like to see in the results. The search engine determines and analyzes that intent to produce search results that satisfy the intent of the consumer. The local intent may be geo-related, rather than geo-specific, such that search results for goods or services from a national online retailer may be targeted to minimize shipping costs or other expenses.
The consumer who searches for a local dry cleaner should be shown content, advertising and listings that are geographically relevant because it is likely the consumer is only concerned with dry cleaners located at a certain geographic location. In addition, the relevant advertisements may relate to which local dry cleaners have specials, which don't use harmful chemicals, which are open late, and which are rated best by their community. General online information or websites about “dry cleaning” may not be relevant to a consumer concerned only with local dry cleaners. Directory information, social media, maps, and advertising may all contribute to help the consumer make the best decision. Accordingly, geographic relevancy plays a greater role (in combination with contextual relevancy) in driving overall relevancy.
Some consumers may explicitly geo-modify their searches to specify a location. For example, a consumer may search for “Chicago dry cleaning,” which shows local intent for dry cleaners in Chicago. However, there may be hundreds of dry cleaners in Chicago, and the geographic location may need to be narrower than Chicago to achieve useful results. In addition, smaller, lesser-known towns or cities that are included in a search may result in search results that are not relevant to the specific location that is referenced. Further, many users fail to explicitly geo-modify searches, so the search engine must determine whether a consumer would like geo-specific results and how big a range of geography should be covered.
As the amount of local search traffic increases, there is a need for a search engine to respond with more geographically relevant results. Search behavior with local intent may gradually increase over time, as consumers receive more relevant local media and advertising in response to local keyword searches. Search traffic may contain more local intent, as users increasingly rely on the Internet as a primary source of information for their local purchasing decisions. Accordingly, a system that accurately determines when a consumer has local intent and determines the geographical scope of that intent in order to select the most relevant content and/or advertisements would be beneficial.
The system and/or method may be better understood with reference to the following drawings and description. Non-limiting and non-exhaustive embodiments are described with reference to the following drawings. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. In the figures, like referenced numerals designate corresponding parts throughout the different views.
By way of introduction, the embodiments described below include a system and method for determining local intent, determining a geographic range of the local intent, and providing relevant advertisements based on that local intent and its geographic range. In particular, a search engine may receive keywords or queries from users and the keywords are used to determine local intent and select targeted content and/or advertisements based on the local intent and its geographic range. Local intent may refer to the intent that a consumer may have when performing a search, such as if the consumer desires geographic specific search results. The embodiments relate to determining whether local intent exists, determining the geographic range of this local intent, and selecting geographically and contextually relevant targeted content to be displayed.
Other systems, methods, features and advantages will be, or will become, apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the following claims and be defined by the following claims. Nothing in this section should be taken as a limitation on those claims. Further aspects and advantages are discussed below in conjunction with the embodiments.
In block 102, after a user submits a query to a search engine, the system recognizes which queries have local intent. Local intent refers to when a user submits a search query for which the user would like results that are local or geographically specific. For example, a search for “restaurants” likely has local intent in that the user would like search results that are for a certain location. In block 104, the system may determine the geographic range of the local intent. For example, the range may be the size of a geographic radius of the local restaurants that are displayed. The range may vary from country, state, city, neighborhood or any other measured distance. As described below, the geographic range may be reflected in a local intent value (LIV). In block 106, the search query generates search results that are geographically and contextually relevant based on the local intent and the determined geographic range. As described in more detail below, a system may be operative to recognize local intent, calculate the geographic range of local intent and respond with geographically and contextually relevant information.
The network environment 200 includes an advertisement services server 210, which may provide a platform for selection, optimization, and/or distribution of advertisements for inclusion in pages. Pages may be provided to users by a portal server 204 and/or a third-party server 202. In
Some or all of advertisement services server 210, portal server 204, and/or third-party server 202 may be in communication with each other by way of network 208 and may include the system or components described below with respect to
The user device 206 may be represented by user-interactive devices that typically run browser applications, and the like, to display requested pages received over a network. The user may be a consumer of goods of services that is searching for a business such as a business that is associated with advertiser. The device may communicate with the portal server 204 and/or the third-party server 202 by way of the network 209. The network 209 may include the Internet or be the same as the network 208. The networks 208 and/or 209 may be the network discussed below with respect to
The portal server 204, the third-party server 202, the advertisement services server 210, and the user device 206 represent computing devices of various kinds. Such computing devices may generally include any device that is configured to perform computation and that is capable of sending and receiving data communications by way of one or more wired and/or wireless communication interfaces. Such devices may be configured to communicate in accordance with any of a variety of network protocols, including but not limited to protocols within the Transmission Control Protocol/Internet Protocol (TCP/IP) protocol suite. For example, user device 206 may be configured to execute a browser application that employs HTTP to request information, such as a web page, from a web server, which may be a process executing on portal server 204 or third-party server 202.
The networks 208, 209 may be configured to couple one computing device with another computing device to enable communication of data between the devices. Herein, the phrase “coupled with” is defined to mean directly connected to or indirectly connected through one or more intermediate components. Such intermediate components may include both hardware and software based components. The networks 208, 209 may generally be enabled to employ any form of machine-readable media for communicating information from one device to another. Each of the networks 208, 209 may include one or more of a wireless network, a wired network, a local area network (LAN), a wide area network (WAN), a direct connection such as through a Universal Serial Bus (USB) port, and the like, and may include the set of interconnected networks that make up the Internet. The networks 208, 209 may include any communication method by which information may travel between computing devices.
The advertisement services server 210 may be used for providing advertisements that are displayed to the user device 206. In particular, the portal server 202, or the third-party server 204 may be a search engine that receives a search query from the user device 206 and responds with search results. The portal server 202, or the third-party server 204 combined with the advertisement services server 210 may be utilized to determine local intent, determine the geographic range of local intent, and/or select the most relevant targeted advertisements based on the local intent described with respect to
The user device 302 may be any device that a user utilizes to connect with the network 308. In one embodiment, the network 308 is the Internet and the user device 302 connects with a website provided by a web server, such as search engine 304, coupled with the network 308. In alternate embodiments, there may be multiple user devices 302 representing the users that are connected with the network 308. A user may not only include any individual, but a business entity or group of people. Any user may utilize a user device 302, which may include a conventional personal computer, computing device, or a mobile user device, including a network-enabled mobile phone, VoIP phone, cellular phone, personal digital assistant (PDA), pager, network-enabled television, digital video recorder, such as TIVO®, and/or automobile. A user device 302 configured to connect with the network 308, may be the general computer system or any of the components as described with respect to
The network 308 may generally be enabled to employ any form of machine-comprehensible media for communicating information from one device to another and may include any communication method by which information may travel between devices. The network may be a network 1426 as described with respect to
The search engine 304 may be a content provider or a web server operated over the network 308 that provides pages to users, such as to the user device 302. The search engine 304 may comprise a general computer system or any of the components as described below with respect to
The local intent analyzer 310 may determine and/or analyze local intent in search queries submitted to the search engine 304. The local intent analyzer 310 may comprise a general computer system or any of the components as described below with respect to
The local intent analyzer 310 may receive data from the internal data source 320 and/or the external data source 322. In one embodiment, the data sources 320, 322 may be one or more databases that are used to store and/or provide information that may assist in the determination and analysis of local intent within the local intent analyzer 310. The internal data source 320 may include search terms and traffic that are associated with the search engine 304. The search engine's 304 historical search data may be used to provide insight regarding local intent for searches by identifying which queries required location-specific information. The external data source 322 may include any data from sources other than the search engine 304. For example, classification trees and topic taxonomies from pre-existing businesses that express the intrinsic local nature of search terms such as the category headings of yellow page or direct mail companies, (e.g. “dry cleaning” may be a popular, well-monetized advertiser heading).
The external data source 322 may include other sources, which use the United State's standard industrial classification code, (formerly known as SIC code and now the NAIC). The industrial classification index may contain topics and/or subtopics made up of inherently local search terms, such as “Autos>AutoRepair>Bodyshops.” Accordingly, local intent may be determined based on these identified topics, which may be present in a search query. The percentage of time that a local term like “dry cleaner” has commercial local intent may be determined from data sources of user behavior or commercial use of the term “dry cleaners.” Historical data of how the term “dry cleaners” is searched or how commercial use of the term generates money in other businesses can form the basis of the probability with which dry cleaners has local intent. The solution provides for the ability to use multiple data sources in determining the probability of local intent for high volumes of user terms as described below.
The local intent analyzer may include a location extractor 312 which may receive a search query from the search engine 304 and determine if the search query includes a root term and/or a location term. The root term may be the content or subject of the search, while the location term identifies a location for that content or subject. A search query may include a root term only that is the subject of the search, or it may also include a location term that identifies a relevant location for the displayed results that are related to the root term. For example, a search query for “Chicago restaurants” has a location term “Chicago” and a root term “restaurants.” The location extractor 312 may analyze and determine if the query includes a location term, which may be separated from the root term. The root term may include the remainder of the query minus the location term. The analysis may be done for current search queries from the search engine 304 or may be from historical data from the internal or external data sources 320, 322. The extraction of a root term and a location term from a search query may be used in determining and analyzing local intent for the search query.
The location extractor 312 may be coupled with the user query database 326. The user query database 326 may include storage of root terms along with a measure of an associated local intent or possible location terms that are associated with those root terms. The stored root terms may include historical data related to search queries that include that root term. For example, if a root term is frequently coupled with a location term, then that root term is likely to have local intent. Accordingly, the user query database 326 receives data regarding the search queries for particular root terms. That data may used in determining local intent, which also may be stored in the user query database 326. In one embodiment, the user query database 326 includes a list of root terms from historical search queries along with all the location terms that have been searched with each of the root terms. For example, the root term “restaurants” may have been searched with the location terms “Chicago,” or “New York City.” Both of the location terms may be recorded in the user query database 326 as well as a frequency with which the location term has appeared with each root term in the historical search data.
The local intent analyzer may include an intent determiner 314 which may determine if a search query includes local intent. In one embodiment, the data from the user query database 326 may be used to determine a probability of local intent for particular root terms. Accordingly, a search query including certain root terms may be determined to have local intent. For example, a root term that is frequently associated with a location term may be an indicator that a search query with that root term has local intent.
The local intent analyzer may include a localness calculator 316, which may determine the geographic scope of the local intent for a search query. The localness calculator 316 may analyze the search query and calculate the geographic scope of local intent as described below with respect to
The local intent analyzer may include a location tagger 318, which may be used to identify and label the locality of a search query. The location tagger 318 may perform location tagging of a search query. The location tagger 318 may be coupled with a geographic database 328 that includes geographic identifiers for locations. The geographic database 328 may also be referred to as a geo-planet database. The geographic identifiers may also be referred to as location identifiers. In one embodiment, the geographic identifiers may include numbers, referred to as location or geographic identifiers, that identify its location as described below with respect to
A matching engine 324 may receive the analyzed search query from the local intent analyzer 310 and select an appropriate advertisement to be displayed with the search results. The matching engine 324 is coupled with the advertisement provider 306. The advertisement provider 306 receives a search query from the search engine 304 and/or receives information on the search query from the matching engine 324, which is used for the selection of relevant advertisements to be displayed on the user device 302. The matching engine 324 may be a part of the advertisement provider 306 and/or the search engine 304 for selecting an advertisement based on a search query.
The advertisement provider 306 may be a server that provides advertisements to the search engine 304 and/or the user device 302 directly. The advertisement provider 306 may comprise a general computer system or any of the components as described below with respect to
The advertiser database 336 may be coupled with the advertisement provider 306. The advertiser database 336 may include available advertisements that are available to the advertiser provider 306. The advertiser database 336 may also include available advertisers as well as information on size, content, pricing, and location specificity of the advertisements. In one embodiment, the advertiser database 336 may include at least one location identifier for each advertisement, that identifies a geographic association of the advertisement. For example, advertisements may be specific to states, regions, cities, or neighborhoods, such as advertisements for a sports team in the city and/or state that the team is located. Accordingly, an appropriate advertisement may be matched with a search query based on the location tagger 318. The location identifier(s) associated with each advertisement may be used for geographically matching the advertisements. In addition, each advertisement may also be associated with a geographic range that establishes the geographic areas in which the advertisement is targeted towards.
The advertisement provider 306 may be coupled with or may include an advertisement filter 330. The advertisement filter 330 may categorize or tag the available advertisements based on content and/or location. For example, the advertisement filter 330 may include root term associated advertisements 332 which categorize advertisements based on the root term of search queries. Root term associated advertisements 332 may be identified and categorized based in part from the user query database 326. Also, geo-identified advertisements 334 may categorize the advertisements based on the location of the advertisement. Geo-identified advertisements 334 may be tagged according to the same geographic identifiers as in the location tagger 318 with the geographic database 328. Accordingly, the advertisement filter 330 may categorize and filter available advertisements for appropriate matching of the advertisements with a search query by the advertisement provider 306 and/or the matching engine.
Upon receiving the search query, the search engine 304 determines if the search query includes local intent (block 404). In block 404, if there is no local intent, then in block 406, the search query is processed. In one embodiment, the search query is received by the search engine 304 and analyzed. The analysis may include extraction of a root term from the search query. In block 408, the search engine 304 may look for a text match to with the root term. Based on the text matches, in block 410, relevant media and advertising is found. Because no local intent was found in block 404, the search results as well as the advertisements are based on the text of the search query and contextual matches with the query. In block 412, the matched media and advertising may be ranked based on relevance. The ranking may be based on the matching of the search query. Based on the rankings from block 412, the most relevant media and advertising may be provided in block 420. Accordingly, the search engine 304 provides the user device 302 with relevant search results and advertisements based on the provided search query.
Referring back to block 404, the determination of local intent may include either an explicit local intent or an implicit local intent. An explicit local intent would be a location that is included in the search as one of the keywords, such as “Chicago dry cleaning.” In particular, explicit local intent found in a search query that includes a location term in addition to a root term. The location term in the search query shows explicit local intent. Implicit local intent may be certain keywords that are known to frequently be associated with a particular geographic location. For example, in a search for “dry cleaning” it is implicit that the consumer would like geographic specific results.
Explicit local intent may be analyzed based on recognition of the explicit location term. When an explicit location is recognized, the query is parsed into its location term and root term, and the root term is said to have local intent. If the search is “Pasadena dentist,” then the local intent is determined to be the geographic location of Pasadena and the root term that is contextually matched is dentist. In alternate embodiments, the location term may be an area, neighborhood, landmark, store or zip code. Colloquial areas, national parks, schools, hospitals, museums, sports stadiums, airports, public transportation locations, subway stops, and other types of popular landmarks may be other locations that consumers may identify.
Explicit location recognition parses location terms that may not be used as a location. For example, a search for “Jack London” or “Paris Hilton” include a common location term, but in fact that location term is actually part of a name instead. Accordingly, the system may recognize such false positives. Further, ambiguous locations may also introduce errors in recognizing local intent from explicit location names. For example, there exists a city named “Auto” in West Virginia, a city “Mobile” in Alabama, a city “Car” in France, and a city “George” in Washington State. Accordingly, the system may recognize ambiguous location names as well as false positives in which there is no local intent despite the presence of an explicit location term.
An implicit local intent may be found despite the absence of an explicit location term in the query. In one embodiment, the search engine 304 may include or be coupled with a term database. The term database may be the user query database 326, or may be an alternate database that stores root terms, or keywords, as well as an indication to whether those root terms are likely to include local intent. For example, searches for root terms “restaurants” and “hotels” are likely to include local intent and may be so labeled. Accordingly, a root term database may be utilized to help determine whether a local intent is present.
Both implicit local intent and explicit local intent may be identified and analyzed further as described below with respect to
In one embodiment, there may be different probabilities calculated for different sources of search query data. In block 502, sources of query data are identified. As described above in system 300 for
The presence of an explicit location is frequently indicative of local intent. Accordingly, the sources of search query data, such as internal data sources 320 and/or external data sources 322, may be used to determine which search queries and root terms were associated with an explicit location. A root term that is frequently searched with a location term has a high probability of local intent, while a search query that rarely includes a location term may have a low probability of local intent. Accordingly, the search query data may be used to develop the probability that a search query has local intent.
In block 504, large volumes of query data containing users' search behaviors may be captured and assembled for the purpose of determining local intent. This user query data may be captured by sampling large volumes of statistically-representative user search queries from multiple user query data sources. Query data sources may include different types of searches, such as a general search over the web, a geographically specific search, a shopping related search, or any other specialized search. For example, some search engines may have a mainline search as well as local search queries and/or queries conducted within local online categories such as auto, shopping and real estate. Various query data sources may then be assembled using weighting functions to weight the contribution that each query source has in determining the local intent of a the search terms. The weights may be relative and may indicate which query source best represents the local intent of a user. Each of the search query data sources are analyzed to extract a representative set of search queries that may be used in determining local intent.
In block 506, the root term is separated from the location term for each search query from the data sources. As described in block 504, a set of search queries may be extracted from each of the data sources and it is those queries that are analyzed in block 506 by first determining the root term and location term. In particular, the location extractor 312 may remove the location term and leave the root term. In block 508, the set of queries are analyzed to identify location probability for each of the root terms removed in block 506. The analysis in block 508 may occur simultaneously with the removal from block 506.
In one embodiment, a probability of local intent is determined for a removed root term. That root term may also be associated with a location identifier as described below. In block 510, the location probability for each root term is averaged across multiple data sources for each available query. The available queries may include a set of search queries as extracted in block 504.
In block 512, the search query data is analyzed and the queries are categorized into location bands, which may be referred to as a location type.
The fifth location band 612 is a ZIP code, point of interest, or neighborhood. A neighborhood may be a subset of a city, such as Lincoln Park is may be considered a neighborhood in Chicago. Points of interest may include specific locations, such as landmarks, colloquial areas, parks, schools, hospitals, museums, sports stadiums, airports, public transportation locations, subway stops, and other types of popular landmarks. For example, a search query for “Wrigley Field bars” is based on the location band 612 for a specific point of interest. The user identifies a specific location, Wrigley Field, and would like to know the bars that are located around that location. It would not be relevant to provide bars throughout a city or county as in location band 610 because a point of interest is identified establishing a narrow geographic range.
As shown in
Referring back to
In block 514, the search queries from the data sources are analyzed relative to the location bands from block 512 to determine the frequency each query appears in a particular location band in the historical search query data. For example, each root term of a search query may appear with a variety of location terms. The frequency that the root term is associated with each location band is determined based on the historical search queries and is stored in a database, such as the user query database 326. In other words, count-statistics are computed for each root term to tally how many times it appears within each location band based on historical search queries that matched the root term with location terms from each of the location bands. For example, the number of queries containing the term “handyman” occur with no location, with any state name, with any large city name, with any small city name or with any neighborhood, zip code, village, town or landmark name are tallied. It is likely that the frequency that the root term “handyman” is associated with more narrow location bands is higher than the frequency that it is associated with broad location bands. Accordingly, the frequency in the neighborhood location band is likely greater than the frequency in the country location band because it is unlikely a search query would want any handyman in the United States, but rather would identify a more specific location for finding a handyman. This frequency analysis determines which location band that the root term “handyman” may belong.
For example, if the root term is “delivery pizza” then 29.8% of the searches are for a large city, such as “Los Angeles delivery pizza.” However, 44.4% of the searches are for a neighborhood or point of interest, such as “Lincoln Park delivery pizza.” The explicit location terms are analyzed and categorized into one of the location bands for each root term. A search without a location term would suggest no local intent and would not be included in one of the location bands, or would be a location band identified as not being associated with a particular location. Based on the frequency distribution shown in chart 700, the root term of “delivery pizza” would be classified in the small cities location band or the neighborhood band.
Alternatively, for the root term “job,” chart 700 illustrates that the localness is lower than for “delivery pizza.” People are more likely to associate a job with a large city or even a small city. Rarely would a search for “job” focus on a neighborhood or a point of interest. Based on the frequency distribution shown in chart 700, the root term of “job” would be classified in the large cities location band, or location band 608 in
Referring back to
In block 802, the LIP is calculated with a statistical probability model. In alternate embodiments, there are alternative models that may be used to calculate the LIP than the three that are illustrated. In one embodiment a local intent value (LIV) may be used in the statistical function. In a second embodiment, the LRP may be used as the statistical function. In a third embodiment, the location band distributions for each term may be used as the statistical function. The LIV may a representation of the geographic range of the local intent and is further described below in block 1012 of
In block 804, the LIP is a function of a local intent value (LIV) combined with an error term. In particular, LIP[term]=f(LIV)+error, where term is the root term from the search query for which the LIP is being calculated. Block 805 is one example of this LIP calculation and may be an LIP regression model. Specifically, the LIP may be calculated to be:
where the LIV is calculated as described above. Error (ε) model can be white noise process i.e. normal with mean=0, standard deviation=σ or any stationary process whose parameters can be calculated empirically. In a mathematical notation, ε=N(0,σ). LIP(term) is the probability of a term being local intent or not and λ (lambda) and θ (theta) are the parameters of the model. The value of λ yields LIP when LIV(term) is zero, and θ adjusts how quickly the probability changes with changing LIV(term) a single unit
In block 806, an alternative statistical probability model is used for calculating the LIP based on a location related probability (LRP) combined with an error term. The LRP may be a quantification of probability that a search term is related to geography, or a specific location. In particular, in block 806, LIP[term]=f(LRP)+error.
An alternative statistical probability model for calculating the LIP is shown in block 808. In particular, LIP[term]=g(freqlocation band l, . . . , freqlocation band k, location query frequency, relative frequency of verticals, . . . )+error. In an abbreviated expression, as shown in block 808, the LIP(term) may be f(term, location band)+error. The location query frequency may be calculated from the distribution histogram of location bands for each term. This direct LIP formula may be based on weighted data from the location bands.
Alternatively, the location query frequency may be calculated as the number of root term queries in a particular location band divided by the total number of root term queries. The relative frequency of a term for a query source data may be the percentage of that term occurring out of all or a subset of search for a specified time interval. In an alternative embodiment, there may be a different LIP regression model.
An LIP regression model is shown in block 809. Specifically, the LIP may be calculated to be:
where the location bands are any of the location types as discussed in
Referring back to
In block 520, a list of the root terms and their corresponding LIP may be outputted. In one embodiment, the search engine 304 and/or the local intent analyzer produce the list of terms with their associated LIP value. In particular, the list of root terms and their local intent probability are stored in a table for use within applications that scan structure or unstructured text and queries to identify the local intent of the search terms or text terms scanned. In one embodiment, the list of root terms and LIP values may be stored in the user query database 326.
Accordingly,
Referring back to
The local intent value (LIV) is calculated in block 414. In particular, the LIV is a representation of the geographic range of the local intent. The geographic range of local intent is used as a measure of a consumer's consideration of a commercial offer or media content. The geographic range for a user to consider offers or media content may vary based on the product or service being purchased, or the media being consumed.
In one example, a person buying a car may have a large range for their willingness to purchase the car they want, of 5-50 miles or more from their home or work location. This range of 5-50 miles may be consistent with the general size of a large city metro area or a county. Conversely, a person who needs to dry clean their clothes will have a much smaller range for a dry cleaner, such as a 1-5 mile radius from the user's work or home. This range of 1-5 miles may be consistent with the general size of a small city, town, neighborhood, or suburb. Accordingly, the geographic range of the purchase opportunity for the root term “dry cleaners” is much lower than that for the root term “new/used cars.” In other words, the term “dry cleaner” has greater localness in terms of commercial value than the term “used cars.” The establishment of this geographic range may then be used in providing search results, content and/or advertisements that are within the geographic range.
The geographic range of searched root terms may be correlated to the frequencies with which their root terms are searched with geographic modifiers for explicit local intent. The range varies across the root terms. For example, root terms such as “mover,” “home builder,” and “new car dealer” may be associated with states and the larger cities 60-70% of the time. Conversely, root terms such as “dry cleaner,” “mall,” “condo rental,” “medical center,” and “winery” may be associated with smaller cities, neighborhoods, and/or landmarks over 70% of the time indicating that these root terms have a smaller geographic range. Accordingly, a user query for “malls,” “stores,” or “dry cleaners,” may result in geo-targeting of advertising offers and media content that is very local with a small geographic radius. However when a user searches for “new auto dealer,” “mover,” or “home builder,” geo-targeting may respond with city, metro, or large geographic radius advertising offers and media content.
The local intent value (LIV) as calculated in block 414 is a quantification that identifies the range of local intent for high volumes of root terms. The LIV may offer a measure of localness for each root term in a search query. The LIV quantifies queries with low localness, (such as “new homebuilder, mover, lottery, tickets”), as well as those with high localness, (such as “dry cleaner, mall, outlet, medical center and winery”). Accordingly, the LIV represents the geographic range of a root term, with a higher LIV representing a narrower geographic range and a lower LIV representing a larger geographic range.
In block 1002, data sources containing search query data are located. As described above in block 502 of
In block 1004, large volumes of query data containing users' search behaviors may be captured and assembled for the purpose of determining local intent similar to block 504 of
The queries stored or recorded in the data sources may be analyzed to determine which queries include explicit locations. Queries with explicit locations or explicit local intent may also be referred to as geo-modified queries because they include a location term in addition to a root term. In block 1006, the root term and the location term are separated for each query that includes a location term.
In block 1008, the location band of the explicit location term is determined and stored. In one embodiment the location bands that are available are shown in
As shown in
The larger geographic areas, such as the first location band 1110 have a lower LIV, whereas the smaller geographic areas, such as the fifth location band 1102 has a larger LIV. The localness (and the LIV) increases as the geographic area is narrowed. In one embodiment, for the fifth location band 1102 the LIV=5, for the fourth location band 1104 the LIV=4, for the third location band 1106 the LIV=3, for the second location band 1108 the LIV=2, and for the first location band 1110 the LIV=1.
Referring back to
Each search query with a location term is analyzed to determine the location band. The location bands are recorded along with the root term that they are associated with. In other words, each search query with a location term has a root term that is associated with a location band that corresponds to the location term. The frequency of each location band for each root term may be recorded in a histogram.
In block 1012, the local intent value (LIV) may be calculated based on the search query data of the location bands associated with each root term. In one embodiment, the LIV is calculated by:
LIV (term)=Σ frequency (term, location band i)×locality integer I; where “i” refers to the five location bands (1-5) that are shown and described with respect to
As one example of the calculation of LIV the following frequency chart may be used that illustrates a root term with the frequency for that term in each location band. This frequency chart corresponds with the visual representation of the location bands shown in Chart 700 of
According to the LIV formula listed above, the LIV may be calculated according to the above formula: LIV(delivery pizza)=0%×1+5.0%×2+29.8%×3+20.4%×4+44.4%×5=4.03. The LIV for the root term delivery pizza is 4.03, which corresponds to a small city (location band 4) suggesting that the root term “delivery pizza” is most often searched for in the location of a small city. Conversely, for the root term “job” the LIV is calculated as: LIV(job)=7.3%×1+19.1%×2+35.3%×3+33.2%×4+0.2%×5=2.852. The LIV of 2.852 for the root term “job” is closest to location band three, or a large city. Accordingly, the root term “job” has lower localness than the root term “delivery pizza.” The formula described above may provide for the ability to weight how often a term is searched with any location name.
The formula may be expanded to include no location type, which corresponds to a location band of zero. Accordingly, the LIV formula may be expanded to a probability distribution formula: LIV=Σ Probability (term, location band i)*Expected Value (term, location band i)+Probability (term, no location)*Expected Value (term, no location band). The probability distribution formula may be an extension to the LIV formula described above. Probability(term, no location) may be a statistical estimate of the percentage of occurrences of a term without location name. Expected value(term, no location band) may a default value for the local intent value (LIV) in the absence of any query with location names. Different source tags may be utilized to determine the default value, at least partly based on the relative frequency of the term for source tags.
The way in which queries for a particular term are weighted and used in any of the LIV functions may differ. The weighting and functions that are used may vary and may depend on the search data that is available. In addition, the formulas may be modified over time to more accurately determine the local intent of users.
In one embodiment, a different LIV may be calculated for each of the data sources that are available. Accordingly, in block 1014, the LIV from each data source may be combined and/or averaged to get an overall LIV score. The formula described above may be expanded to account for multiple data sources. Accordingly, the LIV formula may be expanded to a probability distribution formula: LIV=ΣΣ Probability (term, location band i, source j)*Expected Value (term, location band i, source j)+Probability (term, no location)*Expected Value (term, no location band). The variable “i” refers to each location band, and “j” refers to the potential sources of frequency data. The summations are over variables “i” and “j.” Alternatively, the formula may be LIV=f (probability term, location band i, source j)+error, where the variable “i” refers to each location band, and “j” refers to each source of frequency data.
A manually identified truth set may be developed for error analysis in block 1016. An editorial truth set may be established in which editors may manually identify the local intent of a large sample of terms. Using one of the tunable probability models with error functions as discussed above may allow for the tuning of model parameters to replicate or exceed the precision and recall of the editorially-controlled truth set. The truth set may minimize the error function. Accordingly, each additional data source that contributes to the calculation of the local intent probability of each term may be refined. In block 1018, the LIP function is tuned with the truth set to minimize errors.
In block 1020, the root terms and corresponding LIV's may be stored in a table or list. In one embodiment, the list is stored in the user query database 326. The user query database 326 may include a list of all root terms from the search query data sources as well as associated location terms, associated location bands, frequency of the term in each location band, LIP and LIV. Alternatively, each root term may be stored with only the LIV.
The LIV formulas may be adapted to include additional data and information to increase the predictive value for each LIV. For example, algorithms may account for demographics and time/day. In addition, algorithms may consider the context of the property in which the term is being searched, such as mobile versus local news versus national news.
As discussed below, queries that have high local intent values may have the user location geo-modified at a smaller city or neighborhood level. Those queries may receive search results in which local/neighborhood geography may be weighted more heavily. Queries that have medium or low local intent values may have the user location geo-modified with a larger city metro level. Those queries may receive search results in which geography is moderately weighted or combined with national advertising. Queries that have no local intent will not have the user location geo-modified with any location type and will receive search results in which geography is not weighted at all, thus only contextually relevant or topic-driven advertising will be served.
Referring back to
Referring back to
In alternate embodiments, the identification of a location in block 1202 may be determined differently. In one embodiment, U.S. Patent Publication No. 2005/0060430, published Mar. 17, 2005, entitled “METHOD OF DETERMINING A LIKELY GEOGRAPHICAL LOCATION,” which is incorporated by reference herein, determines the likely geographic location based on submitted criteria. In addition, U.S. Patent Publication No. 2005/0108213, published May 19, 2005, entitled “GEOGRAPHICAL LOCATION EXTRACTION,” which is incorporated by reference herein, infers a likely geographical location from one or more search terms. In one embodiment, the location may be determined based on the users IP address as in U.S. Patent Publication No. 2005/0108244, published May 19, 2005, entitled “METHOD OF DETERMINING GEOGRAPHICAL LOCATION FROM IP ADDRESS INFORMATION,” which is incorporated by reference herein. For a search performed on a mobile device, the geographic location may be determined as in U.S. Patent Publication No. 2005/0003835, published Jan. 6, 2005, entitled “METHOD OF PROVIDING LOCATION BASED INFORMATION TO A MOBILE-TERMINAL WITHIN A COMMUNICATIONS NETWORK,” which is incorporated by reference herein.
In block 1204, the identified location is removed from the root term of the query and is given a location identifier. The root term may be removed from the location term by the location extractor 312 in
The location identifier may be a unique identification for any location. In one embodiment, each city, town, county, zip code, and state in the United States is associated with a unique location identifier. An example of assigning location identifiers is described in U.S. Patent Publication No. 2006/0004797, published Jan. 5, 2006, entitled “GEOGRAPHICAL LOCATION INDEXING,” which is hereby incorporated by reference. That application describes zones that are represented by location identifiers that establish relationships and overlap with adjacent zones.
The location identifier may be used to record adjacencies between locations. In addition the location identifier may also be used to identify a parent location or child locations. In one embodiment, the location identifiers and the relationships between locations may be categorized as described with respect to
One example of a child location for a large city location 1308 is a small city location 1312. As shown, San Gabriel is a smaller city identified by location identifier 37. Adjacent smaller cities that are associated with location identifier 37 are Temple City, Alhambra, and Sierra Madre. In addition, the adjacent small city location 1314 of Pasadena is shown. San Gabriel is a child location of Los Angeles. Child locations of a small city location 1312 may include zip code locations 1316. In an alternative embodiment, the child locations of a small city location 1312 may include specific points of interest or neighborhoods as described above.
The chart 1320 in
Accordingly, in block 1204 of
The localness value may be used to determine which locations are included for the providing of search results, content and/or advertisements as in block 1208. The location identifier is used to identify an exact location as discussed with respect to
In one embodiment, if the localness or LIV is high, which suggests a smaller geographic range, then the relevant geographies may be contracted to find locations in that range. For example, if the LIV is a small city and the location associated with an advertisement is at the state level, then the small city location is expanded to its parent locations to select relevant advertisements. Accordingly, the location identifier may be used for the expansion of geographies to cover adjacent locations, parent locations, or child locations. The expansion down to child locations may be referred to as contraction.
In block 1210, location identifiers are used for an expansion of the geographic area. In one embodiment, an expansion list of location identifiers is generated based on the exact location identifier. As discussed above, the geographic database 328 may include relationships between parent, child, and/or adjacent locations. Accordingly, an expansion may include all adjacent locations and/or the parent location. The expansion or contraction may be based on the available search results, content, and/or advertisements. For example, advertisements may only be available on the large city level. Accordingly, if the exact location is a small city, then expansion of that location may give a large city location that is associated with an advertisement. In one embodiment, the available advertisements may only be related to certain areas. For example, if the only advertisements that are associated with Illinois relate to Chicago, then if the exact location is Peoria, Ill., expansion into the parent location of Illinois may result in Chicago advertisements being displayed. Likewise, the expansion of Peoria, Ill. into adjacent locations may also result in Chicago advertisements being displayed.
In block 1212, geo-relevant advertisement candidate listings are retrieved from the advertiser database. In one embodiment, the listings are stored in the advertiser database 336 discussed with respect to
In block 1218, the candidate set of geo-relevant listings may be ranked. The candidate set may be relevant advertisements or may be search results or other content. In one embodiment, a quality scoring function may rank the candidate set as in block 1220. The quality scoring function may weigh an advertisements relative bid for the advertisement, as well as a willingness to pay to the marketplace, click-thru-rate, and overall advertisement relevancy.
The quality scoring function may be used for scoring which relevant advertisements may appear first in response to a user query having local intent. Any quality scoring function may be used to rank the advertisements and to improve geo-relevancy of the relevant advertisements. In one example, the rank of an advertiser may determined based on the advertisement's eCPM value which may be defined as f(quality score)×g(bid) value. eCPM may represent effective clicks per thousand, which determines when a user clicks on an advertisement. The quality score may be a linear function of machine learning search algorithmic relevancy, which may include past click through data. The quality score may further relate to local intent and advertiser geo-relevancy factors, such that ads are ranked and served once eCPM values are calculated for each query. In one embodiment, advertisement services are described in U.S. Patent Publication No. 2006/0282314 A1, published Dec. 14, 2006, entitled “UNIVERSAL ADVERTISEMENT SERVICES ARCHITECTURE,” which is incorporated by reference herein.
The geographic relevancy may also be an input to the quality scoring function. In block 1222, geographic relevancy may be an input based on physical proximity and/or spatial proximity between a user's local intent and an advertisers' geo-targeting intent. Proximity measure may be multi-dimensional which may effectively encapsulate several factors such as business context (e.g. in/out service tendency), local shopping intent, inventory availability, willingness to drive/walk, and/or traffic/density conditions. Proximity may be calculated on these numerous factors for a given candidate advertisement and user search query.
Referring to
In a networked deployment, the computer system may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 1400 can also be implemented as or incorporated into various devices, such as a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a mobile device, a palmtop computer, a laptop computer, a desktop computer, a communications device, a wireless telephone, a land-line telephone, a control system, a camera, a scanner, a facsimile machine, a printer, a pager, a personal trusted device, a web appliance, a network router, switch or bridge, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. In a particular embodiment, the computer system 1400 can be implemented using electronic devices that provide voice, video or data communication. Further, while a single computer system 1400 is illustrated, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.
As illustrated in
The computer system 1400 may include a memory 1404 that can communicate via a bus 1408. The memory 1404 may be a main memory, a static memory, or a dynamic memory. The memory 1404 may include, but is not limited to computer readable storage media such as various types of volatile and non-volatile storage media, including but not limited to random access memory, read-only memory, programmable read-only memory, electrically programmable read-only memory, electrically erasable read-only memory, flash memory, magnetic tape or disk, optical media and the like. In one embodiment, the memory 1404 includes a cache or random access memory for the processor 1402. In alternative embodiments, the memory 1404 is separate from the processor 1402, such as a cache memory of a processor, the system memory, or other memory. The memory 1404 may be an external storage device or database for storing data. Examples include a hard drive, compact disc (“CD”), digital video disc (“DVD”), memory card, memory stick, floppy disc, universal serial bus (“USB”) memory device, or any other device operative to store data. The memory 1404 is operable to store instructions executable by the processor 1402. The functions, acts or tasks illustrated in the figures or described herein may be performed by the programmed processor 1402 executing the instructions stored in the memory 1404. The functions, acts or tasks are independent of the particular type of instructions set, storage media, processor or processing strategy and may be performed by software, hardware, integrated circuits, firmware, micro-code and the like, operating alone or in combination. Likewise, processing strategies may include multiprocessing, multitasking, parallel processing and the like.
As shown, the computer system 1400 may further include a display unit 1414, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a flat panel display, a solid state display, a cathode ray tube (CRT), a projector, a printer or other now known or later developed display device for outputting determined information. The display 1414 may act as an interface for the user to see the functioning of the processor 1402, or specifically as an interface with the software stored in the memory 1404 or in the drive unit 1406.
Additionally, the computer system 1400 may include an input device 1416 configured to allow a user to interact with any of the components of system 1400. The input device 1416 may be a number pad, a keyboard, or a cursor control device, such as a mouse, or a joystick, touch screen display, remote control or any other device operative to interact with the system 1400.
In a particular embodiment, as depicted in
The present disclosure contemplates a computer-readable medium that includes instructions 1412 or receives and executes instructions 1412 responsive to a propagated signal, so that a device connected to a network 1420 can communicate voice, video, audio, images or any other data over the network 1420. Further, the instructions 1412 may be transmitted or received over the network 1420 via a communication port 1418. The communication port 1418 may be a part of the processor 1402 or may be a separate component. The communication port 1418 may be created in software or may be a physical connection in hardware. The communication port 1418 is configured to connect with a network 1420, external media, the display 1414, or any other components in system 1400, or combinations thereof. The connection with the network 1420 may be a physical connection, such as a wired Ethernet connection or may be established wirelessly as discussed below. Likewise, the additional connections with other components of the system 1400 may be physical connections or may be established wirelessly.
The network 1420 may include wired networks, wireless networks, or combinations thereof. The wireless network may be a cellular telephone network, an 802.11, 802.16, 802.20, or WiMax network. Further, the network 1420 may be a public network, such as the Internet, a private network, such as an intranet, or combinations thereof, and may utilize a variety of networking protocols now available or later developed including, but not limited to TCP/IP based networking protocols.
While the computer-readable medium is shown to be a single medium, the term “computer-readable medium” includes a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable medium” shall also include any medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a computer system to perform any one or more of the methods or operations disclosed herein.
In a particular non-limiting, exemplary embodiment, the computer-readable medium can include a solid-state memory such as a memory card or other package that houses one or more non-volatile read-only memories. Further, the computer-readable medium can be a random access memory or other volatile re-writable memory. Additionally, the computer-readable medium can include a magneto-optical or optical medium, such as a disk or tapes or other storage device to capture carrier wave signals such as a signal communicated over a transmission medium. A digital file attachment to an e-mail or other self-contained information archive or set of archives may be considered a distribution medium that is a tangible storage medium. Accordingly, the disclosure is considered to include any one or more of a computer-readable medium or a distribution medium and other equivalents and successor media, in which data or instructions may be stored.
In an alternative embodiment, dedicated hardware implementations, such as application specific integrated circuits, programmable logic arrays and other hardware devices, can be constructed to implement one or more of the methods described herein. Applications that may include the apparatus and systems of various embodiments can broadly include a variety of electronic and computer systems. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules, or as portions of an application-specific integrated circuit. Accordingly, the present system encompasses software, firmware, and hardware implementations.
In accordance with various embodiments of the present disclosure, the methods described herein may be implemented by software programs executable by a computer system. Further, in an exemplary, non-limited embodiment, implementations can include distributed processing, component/object distributed processing, and parallel processing. Alternatively, virtual computer system processing can be constructed to implement one or more of the methods or functionality as described herein.
Although the present specification describes components and functions that may be implemented in particular embodiments with reference to particular standards and protocols, the invention is not limited to such standards and protocols. For example, standards for Internet and other packet switched network transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) represent examples of the state of the art. Such standards are periodically superseded by faster or more efficient equivalents having essentially the same functions. Accordingly, replacement standards and protocols having the same or similar functions as those disclosed herein are considered equivalents thereof.
The illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of apparatus and systems that utilize the structures or methods described herein. Many other embodiments may be apparent to those of skill in the art upon reviewing the disclosure. Other embodiments may be utilized and derived from the disclosure, such that structural and logical substitutions and changes may be made without departing from the scope of the disclosure. Additionally, the illustrations are merely representational and may not be drawn to scale. Certain proportions within the illustrations may be exaggerated, while other proportions may be minimized. Accordingly, the disclosure and the figures are to be regarded as illustrative rather than restrictive.
One or more embodiments of the disclosure may be referred to herein, individually and/or collectively, by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any particular invention or inventive concept. Moreover, although specific embodiments have been illustrated and described herein, it should be appreciated that any subsequent arrangement designed to achieve the same or similar purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all subsequent adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the description.
The Abstract of the Disclosure is provided to comply with 37 C.F.R. § 1.72(b) and is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, various features may be grouped together or described in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter may be directed to less than all of the features of any of the disclosed embodiments. Thus, the following claims are incorporated into the Detailed Description, with each claim standing on its own as defining separately claimed subject matter.
The above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments, which fall within the true spirit and scope of the present invention. Thus, to the maximum extent allowed by law, the scope of the present invention is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description. While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents.
The present application is a Continuation of U.S. Pat. No. 9,262,439 (U.S. Ser. No. 14/094,309), entitled “SYSTEM FOR DETERMINING LOCAL INTENT IN A SEARCH QUERY,” filed on Dec. 2, 2013, which is a Continuation of U.S. Pat. No. 8,601,008 (U.S. Ser. No. 13/460,188), entitled “SYSTEM FOR DETERMINING THE GEOGRAPHIC RANGE OF LOCAL INTENT IN A SEARCH QUERY,” filed on Apr. 30, 2012, which was a Continuation of U.S. Pat. No. 8,185,538 (U.S. Ser. No. 12/834,659), entitled “SYSTEM FOR DETERMINING THE GEOGRAPHIC RANGE OF LOCAL INTENT IN A SEARCH QUERY,” filed on Jul. 12, 2010, which was a Continuation of U.S. Pat. No. 7,805,450 (U.S. Ser. No. 11/729,104), entitled “SYSTEM FOR DETERMINING THE GEOGRAPHIC RANGE OF LOCAL INTENT IN A SEARCH QUERY,” filed on Mar. 28, 2007, which is further related to applications entitled “SYSTEM AND METHOD FOR ASSOCIATING A GEOGRAPHIC LOCATION WITH AN INTERNET PROTOCOL ADDRESS,” filed on Mar. 28, 2007, U.S. patent application Ser. No. 11/729,365; “SYSTEM AND METHOD FOR ASSOCIATING A GEOGRAPHIC LOCATION WITH AN INTERNET PROTOCOL ADDRESS,” (Atty. Dkt. 12729.225) filed on Mar. 28, 2007, U.S. patent application Ser. No. 11/729,364; “SYSTEM AND METHOD FOR ASSOCIATING A GEOGRAPHIC LOCATION WITH AN INTERNET PROTOCOL ADDRESS,” filed on Mar. 28, 2007, U.S. Pat. No. 7,774,348 (Ser. No. 11/729,377); “SYSTEM FOR PROVIDING GEOGRAPHICALLY RELEVANT CONTENT TO A SEARCH QUERY WITH LOCAL INTENT,” filed on Mar. 28, 2007, U.S. Pat. No. 7,774,348 (application Ser. No. 11/729,103); “SYSTEM FOR DETERMINING LOCAL INTENT IN A SEARCH QUERY,” filed on Mar. 28, 2007, U.S. Pat. No. 7,788,252 (application Ser. No. 11/729,096); each of which is incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5583763 | Atcheson et al. | Dec 1996 | A |
| 6006221 | Liddy et al. | Dec 1999 | A |
| 6076088 | Paik et al. | Jun 2000 | A |
| 6102969 | Christianson et al. | Aug 2000 | A |
| 6363373 | Steinkraus | Mar 2002 | B1 |
| 6539348 | Bond et al. | Mar 2003 | B1 |
| 6584464 | Warthen et al. | Jun 2003 | B1 |
| 6665715 | Houri | Dec 2003 | B1 |
| 6675159 | Lin et al. | Jan 2004 | B1 |
| 6772150 | Whitman et al. | Aug 2004 | B1 |
| 7051023 | Kapur et al. | May 2006 | B2 |
| 7376714 | Gerken | May 2008 | B1 |
| 7606875 | Xie et al. | Oct 2009 | B2 |
| 8850473 | Sheehan | Sep 2014 | B2 |
| 20020143991 | Chow et al. | Oct 2002 | A1 |
| 20020199018 | Diedrich et al. | Dec 2002 | A1 |
| 20030074471 | Anderson et al. | Apr 2003 | A1 |
| 20050003835 | Riise et al. | Jan 2005 | A1 |
| 20050060430 | Riise et al. | Mar 2005 | A1 |
| 20050108213 | Riise et al. | May 2005 | A1 |
| 20050108244 | Riise et al. | May 2005 | A1 |
| 20060004797 | Riise et al. | Jan 2006 | A1 |
| 20060085392 | Wang | Apr 2006 | A1 |
| 20060106778 | Baldwin | May 2006 | A1 |
| 20060149734 | Egnor et al. | Jul 2006 | A1 |
| 20070027743 | Carson et al. | Feb 2007 | A1 |
| 20070121845 | Altberg et al. | May 2007 | A1 |
| 20070136140 | Smith, Jr. | Jun 2007 | A1 |
| 20070233864 | Xie et al. | Oct 2007 | A1 |
| 20080010270 | Gross | Jan 2008 | A1 |
| 20080086368 | Bauman et al. | Apr 2008 | A1 |
| 20080109277 | Hengel | May 2008 | A1 |
| 20080114672 | Yahia et al. | May 2008 | A1 |
| 20080189257 | Wiseman et al. | Aug 2008 | A1 |
| 20080222119 | Dai et al. | Sep 2008 | A1 |
| 20080243611 | Delli Santi et al. | Oct 2008 | A1 |
| 20080243822 | Campbell et al. | Oct 2008 | A1 |
| 20080244046 | Campbell et al. | Oct 2008 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20160162946 A1 | Jun 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14094309 | Dec 2013 | US |
| Child | 15043051 | US | |
| Parent | 13460188 | Apr 2012 | US |
| Child | 14094309 | US | |
| Parent | 12834659 | Jul 2010 | US |
| Child | 13460188 | US | |
| Parent | 11729104 | Mar 2007 | US |
| Child | 12834659 | US |
