The present invention relates to a system for analyzing and comparing demographic and other data related to identifiable geographic areas to evaluate their similarity or dissimilarity. More specifically, this invention relates to a new system for calculating numeric values that are related to identifiable characteristics for a specific area of the country based on that area's demographic and other information and comparing it to similarly generated numbers for another area of the country to determine the relative similarity or differences. A forty-page inventor's disclosure is attached which illustrates the present invention.
Currently, a broad range of data regarding the character of particular areas of the country is available for public access. The data however is in raw form. Data describing the demographics, crime rates, educational quality, housing characteristics, employment opportunities, climates and geographic data is all available for review. The difficulty is that none of the data is presented in a manner that facilitates accurate and easy comparison between selected geographic areas that can incorporate multiple characteristics regarding each area. Although many services attempt to provide comparison information, the accuracy provided by these systems is questionable. For example, if a person wished to find several cities that had similar characteristics and qualities to the town in which they currently live, they would have to first find the city in which they are interested and subsequently search all of the data manually to find cities having similar data sets.
The other difficulty is that the data that is available is primarily numeric making searching difficult. Before a user could search the data to arrive at a useful result, the user would have to have a thorough understanding of the rating system or systems used in the database.
In accordance with the present invention a system is provided that automatically analyzes and compares the data available in the database to produce a result based on user selected input and desired characteristics. The present invention provides both for a system of analyzing the available data and a method of automatically comparing the data to arrive at a listing of comparable geographic areas based on the users desired characteristics. The first aspect of the present invention is the utilization of known statistical and mathematical functions using Principal Components Analysis to produce factors followed by squared Euclidean distance calculated on these resulting factors. This mathematical function is applied to compare large amounts of demographic, crime, school and geographic data for identifiable locations all across America relative to each other. The result of this unique mathematical function provides a quantitative value for each pair of locations that are compared providing a matrix containing a quantitative measure of dissimilarity for each compared set of locations in America.
The method first compares the numbers related to the first chosen characteristic of each geographic area of interest, calculates their difference and squares it. The method then repeats this calculation on the second chosen characteristic and adds the result to the result of the first calculation. This process is repeated using each of the identifiable characteristics related to the given geographic areas. This aggregate number is then placed in a matrix in the location identified by the intersection of the row containing the first geographic area of interest and the column containing the second area of interest. The larger the accumulated value between any two intersecting rows and columns in this matrix, the more dissimilar those two locations are based on all of the factors used to describe the locations. Small numeric values between any two locations in the matrix means those locations are quite similar to each other based on all of the factors used to describe the locations. Thus, the present invention provides a system for the development of quantitative measures of similarity between all locations in America.
The second component of the present invention is the use of key word descriptors that provide a verbal expression describing features and characteristics of locations, where each key word is related to and associated with the quantitative values provided in an underlying data base that reflect local conditions in particular geographic areas. This component allows users of the application to select verbal, natural language descriptors in the form of these key words to easily relate to and identify characteristics that they find desirable about a geographic location and instruct the application of the present invention to find locations that most closely match the chosen characteristics. Using key words that correspond to identifiable quantitative values to describe locations creates an interface that allows the users never to have to think in quantitative terms, while still requesting a list of locations that have the characteristics that they want. Once the user selects the key words that correspond to the characteristics that they find desirable, the application of the present invention automatically converts the key words to quantitative values and performs an average absolute difference calculation to compute a value corresponding to the selected set of keywords and calculate the overall level of similarity between the key words a user chooses, and real locations that exist.
The final component of the application of the present invention is the ability of the user to choose a location they presently find desirable and view the set of key words that are associated with that location. The user can then modify the set of key words by selecting or unselecting key words that describe the location and adding or subtracting key words that they either like or dislike, resulting in a modified set of key words. This new set of key words can then be used as a new set of search criteria to find locations that best match these newly selected key words. This allows a user to find locations that are comparable to an existing location that they like, but with, for example, less crime, better schools, or less expensive housing. Again, as stated above, once the set of keywords is provided by the user, the application automatically calculates the average absolute difference between all of the data base values using the value for the original location, in combination with the newly modified keywords selected by the user.
The present invention therefore as described above provides both for the underlying method of analysis of the demographical and location data, the various means of user interface provided in the application and the process whereby the application is used by a user to provide meaningful analysis and produce ordered search results based on characteristics of the locations in relation to user selected search criteria.
Referring now to the drawings, the invention will be described in greater detail.
The first distinctive component is the utilization of known statistical and mathematical functions (Principal Components Analysis followed by squared Euclidean distance calculated on the resulting factors) applied to large amounts of demographic, crime, school, and geographic data for locations all across America. The result of this unique combination is the creation of a matrix containing a quantitative measure of dissimilarity for all locations in America. The larger the value between any two intersecting rows and columns in this matrix, means those locations arc more dissimilar based on all of the factors used to describe the locations. Small numeric values between any two locations in the matrix means those locations are quite similar to each other based on all of the factors used to describe the locations. Thus, this approach allows the development of quantitative measures of similarity between all locations in America.
The second distinctive component of this application is the use of key words that describe features and characteristics of locations, where each key word is linked to quantitative values in an underlying data base, values that reflect local conditions. This unique approach allows users of the application to select these easy to understand key words to choose what characteristics they wish to have in a location, and then ask the application to automatically find locations that most closely match those chosen characteristics. Using key words that describe locations linked to quantitative values in a data base means users never have to think in quantitative terms, but can still request to find those locations that have characteristics they want.
The third distinctive component of this application is the use of an average absolute difference calculation to compute the match level between any or a set of key words a user chooses, and real locations that exist.
The fourth distinctive component of this application is the ability of the user to choose a location they like, and then select or unselect key words that describe the location, resulting in the modification of the location descriptors and, thus, a new set of search criteria to use to find locations that best match these modified criteria. This allows a user to find locations just like a location they like, but with, for example, less crime, better schools, or less expensive housing. To find best matching locations to these modified criteria, average absolute difference is calculated between all of the data base values for the original location, in combination with the new modifications selected by the user. Each of these four unique characteristics is further described below.
Referring to
The search the user requested above is automatically completed by the system by searching a data base with the following structure:
Values between any two intersecting rows and columns represent the dissimilarity between the two locations labeled on the axes. Larger numbers denote larger difference. Smaller numbers denote smaller difference. Zero denotes either identity (the intersecting row and column represent the same location) or that two different locations are identical. To conduct the search the user specified above, only those locations within five miles of downtown Boston would be included, and then those locations with the smallest numbers between them and the location for which the user chose to find a match would be shown to the user as the ordered result of the user's search, and would be displayed to the user as shown in
The dissimilarity values between locations, like in the example matrix shown in Table 1 are calculated as follows:
Step 1. Data are collected for nearly 200 characteristics for each location (in this case, census tract) in America.
Step 2. a factor analysis using Principal components as the extraction method is performed on the data (formula shown in A). This rids the raw data of multicolinearity, and simultaneously serves to standardize all values.
And where m<p is the number of common factors, and p is the total number of original variables (in this case 26 sustainable development indicators).
The estimated specific variances are provided by the diagonal elements of the matrix.
for ith variable, jth factor.
Step 3. The number of factors extracted is set to capture 95% of the total variance contained in the original data.
Step 4. The extracted factors are saved in the data base, thus there are factor scores for each census tract for every factor.
Step 5. The saved factors scores for every census tract in America are input to the formula in B to calculate a dissimilarity matrix containing all census tracts.
This results in a “distance” matrix or dissimilarity matrix showing a mathematical calculation of the similarity or dissimilarity of every census tract in America, to every other census tract in America.
where d=distance, and xik=value of factor k for census tract i.
What is unique here is the application of first the factor analysis, and then the squared Euclidean distance measure to resultant factors that are composed of geographic, school, crime, and demographic data describing locations in America, such that a true measure of similarity between all included locations is derived. That this is applied to geographic location to find similarity is unique, it should not be limited to the notion of census tracts only. The result of this unique combination of statistics and mathematics to this type of data is a way for people to specify a location they like, and then automatically search the database to find best matching locations in any part of the country in which the user has an interest, resulting in an automatically generated ordered list of the best matching locations. It is this combination of known elements that is the first unique element in this product.
Searching the database for best matching locations within 5 miles of Boston, yields these results shown in
Referring to
Table 3 below, which can be selected by the user, is a continuation of the breakdown of the categories of characteristics, and how well they match the census tract for which matches were sought. These calculations for matches by category are based on the average absolute difference between rank percent values for all characteristics in each category. This calculation is explained on the next slide.
Overall matches for one census tract to the other are calculated as set forth previously. However, matches for different categories of characteristics within the census tracts—to show the user what elements of the census tracts are the best and worst matches to the census tract the user wishes to match—such as age or type of homes—are based on the average absolute difference between rank percent values for each characteristic in any category. This approach and calculation are outlined below.
Step 1. Rank percent scores are calculated for each characteristic, as shown in C, and saved in the data base.
For ranking, ties are assigned the highest value, and the first rank is assigned a value of 0. This serves to curve the values for each characteristic, such that the rank percent values show the percentage of census tracts in America that are better matches to that specific characteristic than the current census tract (e.g., a rank percent score of 10.5 means that 10.5 percent of the census tracts in America had higher scores for that characteristic than the current census tract).
Rank percent=(k/N)*100 C.
Where k is assigned rank from 1 . . . N, and N is the total number of cases (census tracts).
Step 2. The average absolute difference between any category of characteristics (e.g., types of housing) for any two census tracts is calculated on demand, as shown in D. Only the characteristics within each category are included for this calculation (e.g., for types of housing this would be the average absolute difference in rank percent scores between two compared census tracts for these categories: detached single family homes, small apartment buildings, big apartment buildings, townhouses or other attached homes, and mobile homes). As the value inflates for this category, the match for housing type between the two census tracts is shown to be less good. Lastly, the results of the calculation in D are subtracted from 100, so a value of 10 becomes a 90% match. See the previous slide for an example.
where MccZ=match level for characteristic category Z, Xik=value of rank percent score k for census tract l, and n=the number of k characteristics in characteristic category Z.
Turning now to
This use of key words is the second distinctive component of this application. As illustrated in preceding slides, these key words describe features and characteristics of locations, where each key word is linked to quantitative values in an underlying data base. This unique approach allows users of the application to select these easy to understand key words to choose what characteristics they wish to have in a location, and then ask the application to find and order locations that most closely match those chosen characteristics.
Using key words that describe locations linked to quantitative values in a data base means users never have to think in quantitative terms, but can still request to find those locations that have characteristics they want. It is a revolutionary and simple way for users to find the locations that best match their own personal criteria. This is a unique application of key words to geographic, demographic, school, and crime information to describe and find best matching geographic locations.
In another aspect of the invention,
Best matching locations are automatically calculated as follows, based on the two key words selected:
Step 1. Rank percent scores are calculated for each characteristic, as shown in E, and saved in the data base ahead of time. When the user requests a query, these values are already to go.
Rank percent=(k/N)*100 E.
Where k is assigned rank from 1 . . . N, and N is the total number of cases (census tracts).
To calculate rank percent scores, ties are assigned the highest value, and the first rank is assigned a value of 0. This serves to curve the values for each characteristic, such that the rank percent values show the percentage of census tracts in America that are better matches to that specific characteristic than the current census tract (e.g., a rank percent score of 10.5 means that 10.5 percent of the census tracts in America had higher scores for that characteristic than the current census tract).
Step 2. The average absolute difference between the best rank percent score possible for each selected key word and the rank percent score for each of these same key words for every census tract in the search area is calculated. **A zero is always the best rank percent score possible, because this means that zero percent of the census tracts in America have a better score for that key word. This calculation is shown in F. Lastly, the results of the calculation in F are subtracted from 100, so a value of 10 is represented as a 90% match.
where Mkwz=a location's average match level to the best score possible for all selected key words, Xik=value of the rank percent score for key word k for location l, Xhk=the lowest possible value for key word k (always zero), and n=the number of k key words selected.
In this example, the user has chosen historic homes, and large homes. The user then chose to search within five miles of Newport, R.I. Matches were calculated as described and are presented on the screen as shown in
In on embodiment as shown in Table 3 are listed in descending order the actual percentages of buildings in each class, while the matches are based on the percentages of census tracts in America that have fewer percentages of the types of buildings the user wishes to have in a location. Thus, the left hand column shows the user what to expect in the location (Newport, R.I., neighborhood #9), and the match level shows how this census tract falls relative to other census tracts in America in regards to the characteristics chosen by the user (historic homes and large homes).
Another characteristic of this new product is the ability given to the user to select a location they like, and then modify some characteristics of it by selecting or unselecting key words in a list, so that the location is more to the users liking. Then the modified version (modified search criteria) is quantitatively compared against real locations in a user-defined search area to automatically find and rank order best matches.
For example, if a user loves a location, but wishes it were less expensive, or had better schools, the user can select key words to specify just those changes while leaving everything else about the location the same, and then the user can search for locations that match this modified set of criteria. The screen display and selection of this feature is shown in
Search results are delivered as shown in
The unique calculation used to match modified locations is performed as follows. The essence of the calculation in G is described here:
where Mmod=a location's match level to the combination of both the modified and unmodified key word values for which we are searching for matches, Xik=value of the rank percent score for key word k for location l, Xi,k=the user selected value for the rank percent score for modified key word k (if a check box is used, than the value will be zero, for drop-down boxes, the value can be anything the user chooses), and n=the sum of the number of k key words modified*2, and the number of k key words unmodified.
The absolute difference is summed between rank percent scores for each unmodified characteristic of the location to match, and each location in the user-specified search area. This summed difference between each compared location is saved. This summed difference is then added to the summed absolute difference for the rank percent scores the user has modified. These modified scores, however, are first multiplied by 2 to increase their relative importance because the user purposefully wants to change them. Then, these two absolute difference values are summed, and divided by the number of modified key words (on this instance 2), plus the number of key words unmodified (=n). This value is then subtracted from 100 to give a match level where 0=no match, and 100=a perfect match.
Obviously, many modifications and variations of the present invention are possible in light of the above teachings. It is, therefore, to be understood that within the scope of the present application, the present invention may be practiced otherwise than as specifically described.
This application is a continuation of U.S. patent application Ser. No. 11/331,262, filed Jan. 11, 2006, which is a continuation of U.S. Pat. No. 7,043,501, issued May 9, 2006, which claims priority from provisional patent application No. 60/342,285, filed on Dec. 21, 2001. The priority of this prior application is expressly claimed and its disclosure is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60342285 | Dec 2001 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12720817 | Mar 2010 | US |
Child | 14480252 | US | |
Parent | 11331262 | Jan 2006 | US |
Child | 12720817 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10329179 | Dec 2002 | US |
Child | 11331262 | US |