The present invention generally relates to systems, computer software and methods and, more particularly, to mechanisms and techniques for web browsing based on the topical relatedness of domain names.
During the past several years, interest in data available on the Internet and Internet services has dramatically increased, in part due to the affordability of access to the Internet and in part due to the ease of obtaining fast and reliable information. Moreover, Internet users have come to realize that the amount of data that is available on the Internet is phenomenal. Various search engines are available to aid Internet users to search for desired information. Conventional search engines (e.g., those provided by Yahoo, Google, etc.) provide the user with an input box into which the user must enter keywords related to the desired information.
With this approach pages from a domain are unlikely to be displayed to the user unless user's query includes its domain name or other words included in its content verbatim. In contrast, in many scenarios the user many be interested in finding web pages related to the content of a particular domain but not belonging to the domain itself. This may be the case, for example, when a user who knows one online store specializing in a particular area is looking to find other stores which sell similar products for purposes of price comparison.
Additionally, there is an opportunity to supply ads which are embedded into the information that a user is looking for, and the advertisement industry is repositioning itself to occupy this new advertising field. More and more ads are being placed on most of the web pages visited by Internet users with the expectation that some of the users will visit those ads and at least explore, if not buy, the goods or services featured in the ads. Various companies have started to specialize in tracking consumer/client behavior such that more targeted ads are placed on the visited web pages. It is known that it is not efficient to advertise goods or services on web pages that are not related to those goods or services.
Accordingly, it would be desirable to provide systems and methods for generating and updating information about relatedness of Internet domains and web pages.
According to one exemplary embodiment, there is a method for searching plural domain names based on domain name system queries. The method includes receiving as input a domain name; searching a database for identifying scores measuring relatedness of the input domain name and other domain names of the plural domain names; retrieving related domain names with the highest relatedness scores; and associating the input domain name and the related domain names, wherein the relatedness scores are calculated based on the domain name system queries of users.
According to another exemplary embodiment, there is a computer readable medium including computer executable instructions, where the instructions, when executed, implement a method for searching plural domain names based on domain names queries. The method includes providing a system comprising distinct software modules, wherein the distinct software modules comprise a relatedness score module and a ranking module; receiving as input a domain name; searching a database for identifying scores measuring relatedness of the input domain name and other domain names of the plural domain names; retrieving related domain names with the highest relatedness scores; and associating the input domain name and the related domain names, wherein the relatedness scores are calculated based on the domain name system queries of users.
According to still another exemplary embodiment, there is a graphical user interface for searching plural domain names based on domain name system queries. The graphical user interface includes means for receiving, as input, a domain name; means for searching a database for identifying scores measuring relatedness of the input domain name and other domain names of the plural domain names; means for retrieving related domain names with the highest relatedness scores; and means for associating the input domain name and the related domain names, wherein the relatedness scores are calculated based on the domain name system queries of users.
According to still another exemplary embodiment, there is a computing system for searching plural domain names based on domain names queries. The computing system includes an input/output interface configured to receive as input a domain name and a processor connected to the input/output interface. The processor is configured to search a database for identifying scores measuring relatedness of the input domain name and other domain names of the plural domain names, retrieve related domain names with the highest relatedness scores, and associate the input domain name and the related domain names. The relatedness scores are calculated based on the domain name system queries of users.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate one or more embodiments and, together with the description, explain these embodiments. In the drawings:
The following description of the exemplary embodiments refers to the accompanying drawings. The same reference numbers in different drawings identify the same or similar elements. The following detailed description does not limit the invention. Instead, the scope of the invention is defined by the appended claims. The following embodiments are discussed, for simplicity, with regard to the terminology and structure of Internet based systems having, among other things, DNS functionality. However, the embodiments to be discussed next are not limited to these systems but may be applied to other existing data systems.
Reference throughout the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with an embodiment is included in at least one embodiment of the present invention. Thus, the appearance of the phrases “in one embodiment” or “in an embodiment” in various places throughout the specification is not necessarily referring to the same embodiment. Further, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
As discussed in the Background section, there is a need to develop new tools and search engines that are more accurate, faster, more reliable and more capable than the existing tools. According to an exemplary embodiment, a domain-query search engine that does not use only keywords to search for desired information is shown in
For example, as shown in
Based on, among other things, the concept that the collective wisdom is the best approach to follow, search engines or other applications according to these exemplary embodiments, calculate, as will be described later, a relatedness score between the input domain name or web site (e.g., “Expedia” in the example above) and other domain names or web sites. This relatedness score can, for example, be calculated based on captured data generated by various users while searching the Internet, for example, data generated in a Domain Name System (DNS) server. The DNS server, which is discussed in more detail later, is capable of storing the IP addresses of the users, the addresses of the user requested web pages, and the relationships between the users and web pages requested by those users. According to exemplary embodiments, those sites having the highest relatedness scores to the domain name(s) entered as input are then returned to the user in any desired format.
According to another exemplary embodiment, the graphical user interface shown in
According to another exemplary embodiment, the user may be provided initially with the interface shown in
According to another exemplary embodiment, the user may navigate from one web site to another web site by rolling a cursor over a desired web site, which is displayed on the screen. By moving the cursor over any displayed web site, the graphical interface may, based on the relatedness scores, display the links between the newly selected web site and related web sites. According to an exemplary embodiment, this action may reposition the newly selected web site in the center of the screen and may also move all the other web sites accordingly. Thus, a browsable graph may be generated on the screen as shown, for example, in
According to another exemplary embodiment, the graphical user interface may present the user with full information available about a selected web site, e.g., the information in the format that a traditional search engine would use to present information based upon a keyword search. More specifically, after the user has arrived at a desired web site 210 (for example Paxfire) as shown in
According to another exemplary embodiment, the graphical interface may present the user, when selecting a specific web site, only with those related web sites that are either geographically connected with the selected web site or with those related web sites that are temporally connected to the selected web site. For example, suppose that the user is interested to fix his flat tire and the user knows about a repair shop called FixFlatTire in his or her community. However, the user is not happy with the prices charged by FixFlatTire. Thus, the user may type, e.g., in the input box of the novel browser according to this exemplary embodiment, the domain name “FixFlatTire” and the browser could returns one or more places that may fix a flat tire, e.g., based upon the topical relatedness techniques described below, and which are also located in close geographic proximity to the FixFlatTire or to the location of the user, because the user is interested only in places that are close to his or her location, e.g., house, work place, etc. Close proximity in this sense may be defined in terms of miles or zip codes by the user prior to performing the search, e.g., by entering such information into the user interface prior to clicking the “Search” button or “Domain Name Search” button.
Regarding the temporal approach, suppose that a user intends to watch a movie around 8 pm during a certain day. The user is aware of a movie theater called BestMovie in her community. After the user enters the name of the movie theater, a browser according to these exemplary embodiments may present the user, based on the calculated relatedness scores and the desired time, with other movie theaters that offer a movie around the same time. Thus, the user is presented with a more focused search result than a traditional search engine.
According to another exemplary embodiment, a tool may be developed based on the calculated relatedness scores, and the tool presents a user with “Internet paths” followed by other users after visiting a certain domain name. For example, by knowing that many or most of Internet users that have visit the domain name “Hotels.com” after visiting the domain name “Expedia.com”, e.g., using one or more of the below described topical relatedness techniques, a company that, for certain reasons, wishes to advertise on Expedia, may decide to also advertise on Hotels as many or most of the users would be expected to transit from Expedia to Hotels. Thus, this tool may provide the user with a road map of “highways” that start from an initial domain name and continue to related domain names, such that the user may make an informed decision when selecting which domain names to target for his or her ads.
Other implementations of the relatedness score may be envisioned by those skilled in the art. However, a common component of such implementations is the ability to calculate the relatedness score of various domain names based on the behavior of many users.
How the relatedness score is calculated has been described in patent application Ser. No. ______, filed concurrently herewith, entitled “Probabilistic Association based Method and System for Determining Topical Relatedness of Domain Names” to M. Subotin and A. Sullivan and patent application Ser. No. ______, filed concurrently herewith, entitled “Distribution Similarity based Method and System for Determining Topical Relatedness of Domain Names” to M. Subotin and A. Sullivan, the content of both of which is incorporated herein by reference. For the convenience of the reader, a brief description of how the relatedness scores can be calculated is discussed next.
Data related to client queries from DNS resolvers may be used to determine topical relatedness of various Internet domains with respect to contents of their web pages or other services they may provide to clients. For that purpose, queries from DNS resolvers may be stored in dedicated files (logs) together with the IP address of the client (which may correspond to one or more clients) and the time of the request.
The topical relatedness scores of domains can be estimated using probabilistic methods for measuring statistical association between random variables, called herein “probabilistic association estimates.” These are computed based on occurrence counts for domain names and domain name pairs.
A topical relatedness score between domains dA and dB may be estimated using pointwise mutual information PMI(dA,dB), which is defined as:
where p(dA,dB), p(dA) and p(dB) are empirical estimates of the probabilities of co-occurrence of domain name queries dA and dB and their individual occurrence, respectively.
An improved score may be calculated if using the probability-weighted pointwise mutual information (PWPMI):
By calculating the “PWPMI” probability for each pair of domains requested by the clients of a certain ISP, a path tree for each domain name may be constructed, as shown in
The relatedness score may also be calculated based on the distributional similarity method. A collection of vectors is generated based on the DNS data. The distributional similarity technique assumes that two domains are related if they tend to appear in the same client session. A matrix representation of client sessions is introduced and various mathematical operations are applied to reduce the dimensionality of the original matrix. Dimensionality reduction may be performed by applying a dimensionality reduction method, for example, the truncated singular value decomposition (SVD) method. The resulting k-dimensional vectors that correspond to the rows of the matrix may be used for calculating the relatedness score. Alternatively or in addition, the cosine of the angle between the vectors of the reduced matrix or, equivalently, the dot product of normalized vectors of the matrix may be used to measure the relatedness score between a pair of vectors.
According to an exemplary embodiment, a method for calculating a relatedness score of pairs of domain names requested by clients may be implemented at the ISP 14 provider or at another location outside the ISP, for example, an independent server 50 connected to the ISP 14 as shown in
If the user enters the name Paxfire.com in the search engine shown in
In response to the query of the user, the independent server 50, based on the already calculated PWPMI of Paxfire and other domain names, provides the user with A and B's domain names (or other information pointing the user toward A and B's domains, e.g., a complete URL or link to a URL associated with the A and B's domains) instead of any other domains, based on the high correlation between Paxfire and A and B.
In addition or alternately, the independent server 50 may provide the user with ads related to the A and/or B domains, i.e., ads associated with the most related domains to Paxfire. Alternatively, the independent server 50 may inform the A or B companies about the type of ad to be provided to the user and the companies then provide the ad to the user. Thus, most of the users that visit Paxfire may be automatically provided with information associated with and/or an identifier of the web site of A and/or B when searching by domain name.
According to another exemplary embodiment, the graphical user interface may be configured to provide, in response to an input domain name from the user, a single path linking the input domain name to a sequence of related domain names as shown in
Next, some specific implementations of the exemplary embodiments are discussed in the context of a user interface that may be implemented on a computing device, i.e., a mobile phone, personal computer, laptop, server, personal digital assistant, etc. According to an exemplary embodiment illustrated in
The user interface may retrieve in step 1204 the relatedness scores of the related domain names and may display them in step 1206, either numerically or in any desired manner. Further domain names, related to the related domain names may also be retrieved. Two possible modes for displaying the related and further domain names are shown in
For example, the relatedness of a pair of domain names may be determined by combining scores determined with the probabilistic method with scores determined with other methods, for example, the distribution similarity method. The weights of such scores may be determined such that the final results fit the real relatedness of the considered domain names. A button corresponding to such calculations may be added to the user interface. According to another exemplary embodiment, the scores of several models may be interpolated into a single score equal to a weighted sum, with the weights tuned to maximize DMOZ-based accuracies. A corresponding button may be added to the user interface.
Once the user moves the cursor above one domain name of the related and/or further domain names, the user interface calculates (in real time in one application) the relatedness scores of the rolled over domain name and other domains to generate new related and/or further domain names. The interface may then be updated to display the connections (links) between the rolled over domain name and these new related and/or further domain names. If the user decides to select the rolled over domain name in step 1208 of
According to an exemplary embodiment, the user interface may retrieve and display relatedness scores among the related domain names or the further domain names. In addition, the user interface may be configured to switch between searching domain names based on relatedness scores or searching based on a keyword, as a conventional search engine. In one application, a combination of the two methods may be used for searching a desired domain name.
The steps for searching plural domain names based on domain name queries are discussed next with regard to
For purposes of illustration and not of limitation, an example of a representative computing system capable of carrying out operations in accordance with the exemplary embodiments is illustrated in
An exemplary computing arrangement 1600, suitable for performing the activities described in the exemplary embodiments, may include a server 1601 with appropriate configuration and access. Such a server 1601 may include a central processor (CPU) 1602 coupled to a random access memory (RAM) 1604 and to a read-only memory (ROM) 1606. The ROM 1606 may also be implemented as other types of storage media to store programs, such as a programmable ROM (PROM), an erasable PROM (EPROM), etc. The processor 1602 may communicate with other internal and external components through input/output (I/O) circuitry 1608 and bussing 1610, to provide control signals and the like. The processor 1602 carries out a variety of functions as is known in the art, as dictated by software and/or firmware instructions.
The server 1601 may also include one or more data storage devices, including hard and floppy disk drives 1612, CD-ROM drives 1614, and other hardware capable of reading and/or storing information such as DVD, etc. In one embodiment, software for carrying out the above discussed steps may be stored and distributed on a CD-ROM 1616, diskette 1618 or other form of media capable of portably storing information. These storage media may be inserted into, and read by, devices such as the CD-ROM drive 1614, the disk drive 1612, etc. The server 1601 may be coupled to a display 1620, which may be any type of known display or presentation screen, such as LCD displays, plasma display, cathode ray tubes (CRT), etc. A user input interface 1622 is provided, including one or more user interface mechanisms such as a mouse, keyboard, microphone, touch pad, touch screen, voice-recognition system, etc.
The server 1601 may be coupled to other computing devices, such as landline and/or wireless terminals and associated watcher applications, via a network. The server may be part of a larger network configuration as in a global area network (GAN) such as the Internet 1628, which allows ultimate connection to the various landline and/or mobile client devices.
The processor 1602 of the server 1601 may be programmed to generate specific modules for implementing the methods illustrated in
The disclosed exemplary embodiments provide a server, a method and a computer program product for identifying domain names that are related to each other. It should be understood that this description is not intended to limit the invention. On the contrary, the exemplary embodiments are intended to cover alternatives, modifications and equivalents, which are included in the spirit and scope of the invention as defined by the appended claims. For example, according to exemplary embodiments, a search engine's graphical user interface can provide options for the user input to be considered as a keyword (i.e., perform a traditional keyword search using the input(s)), a domain name (i.e., perform a domain name relatedness search using the input(s)), or both (i.e., perform both a traditional keyword search using the inputs and a domain name relatedness search using the input(s) and combine or select results from both searches to be displayed to the user). Further, in the detailed description of the exemplary embodiments, numerous specific details are set forth in order to provide a comprehensive understanding of the claimed invention. However, one skilled in the art would understand that various embodiments may be practiced without such specific details.
As also will be appreciated by one skilled in the art, the exemplary embodiments may be embodied in a wireless communication device, a telecommunication network, as a method or in a computer program product. Accordingly, the exemplary embodiments may take the form of an entirely hardware embodiment or an embodiment combining hardware and software aspects. Further, the exemplary embodiments may take the form of a computer program product stored on a computer-readable storage medium having computer-readable instructions embodied in the medium. Any suitable computer readable medium may be utilized including hard disks, CD-ROMs, digital versatile disc (DVD), optical storage devices, or magnetic storage devices such a floppy disk or magnetic tape. Other non-limiting examples of computer readable media include flash-type memories or other known memories.
Although the features and elements of the present exemplary embodiments are described in the embodiments in particular combinations, each feature or element can be used alone without the other features and elements of the embodiments or in various combinations with or without other features and elements disclosed herein. The methods or flow charts provided in the present application may be implemented in a computer program, software, or firmware tangibly embodied in a computer-readable storage medium for execution by a general purpose computer or a processor.
This application is related to, and claims priority from, U.S. Provisional Patent Application Ser. No. 61/192,942, filed on Sep. 23, 2008, entitled “Method and System for Determining Topical Relatedness of Domain Names” to M. Subotin and A. Sullivan, the entire disclosure of which is incorporated here by reference.
| Number | Date | Country | |
|---|---|---|---|
| 61192942 | Sep 2008 | US |