Patent Application
20060149767
This description relates in general to searching for data objects using a normalized index.
In many applications, such as, for example, in enterprise resource planning (ERP), master data management (MDM), customer relation management (CRM), for instance implemented within the products of SAP Aktiengesellschaft “R/3,” “mySAP.com,” “mySAP,” “SAP NetWeaver,” data is stored within databases as data objects. The data objects can be, for example, business objects. Customer relation management data can comprise business partner business objects. Business partner business objects can comprise, for example, contact data of contact persons. Contact data may include address, telephone, email or other information that can facilitate communication. Communication with the contact persons can be supported by communication modules within the ERP programs. Additionally, communication with contact persons can be supported by communication programs, of which email clients may be one example. These communication programs can be embedded within the ERP products. Communication programs can also be supported as plug-ins. Communication programs can also be supported as stand-alone solutions. Within the communication programs, the contact data can be stored as well.
Insofar as data objects in general can be structured data—having attributes and attribute values describing a corresponding real world item—a company's contact information can be represented using data objects, for example, business objects.
Business objects can be, for example, business partners, products, plants, machines, or any other real world objects being mapped into the corresponding data structure of the business objects. Various different types of data of a company, for example, information about persons and products, can be stored within the business objects.
For example, information about contact persons can be stored in business partner business objects. The information about the contact persons can be contact data. The contact data can also be stored within communication programs or devices, for example, email clients, email servers, personal digital assistants, and other communication programs or devices. The contact data can also be stored in databases. The databases may be part of the communication programs or devices. The contact data can comprise, for example, a first name, a last name, an address, a phone number, a facsimile number, an email-address, and/or other contact information.
Communication programs may have search capabilities that can return data, for example contact data, in response to a search request or query entered by a user. General search capabilities that might be used within communication programs have been proposed. For example, in PC Magazine, “Web Searching goes Local,” Neil J. Rubenking, 21 Oct. 2004, various search programs for searching within a local computer or within a local area network are described. These programs provide search engines to search communication items such as contact data. In PC Magazine, “Supersonic Search Engines,” Gary Berline, 12 Nov. 2004, searching within the local communication information is also disclosed.
To enable a search engine to search for data objects faster, data objects that are stored in a structured format may be indexed in an unstructured format. Mapping of data objects, for example business objects, into an unstructured document is described in application number U.S. 60/476,496, which is incorporated herein by reference. A method of searching for data objects, for example business objects, is described in application Ser. No. 10/367,661, which is also incorporated herein by reference.
Users working with communication programs or devices, for example, may search for certain contact data, but have difficulty finding the contacts, because they do not enter the search request (search query) in a format that exactly matches the format in which the contact data is stored or indexed. For example, a user may search for a person living on “123 Road.” The contact data can be stored within the communication program, for example, as “123 Road.” If the communication program requires an exact search query, then a query of “123 Road” would return a result, but a query of “123 Rd.” would not return a result. Truncated searches or wildcard searching may not be supported. Moreover, current methods may not return contact data in response to a query from a user if the user does not know the format in which the
In order to overcome one or more of the above mentioned problems, one general aspect provides a method for searching for data objects, the method comprising creating an index of the data objects, and searching for data objects in the index. Creating the index may comprise obtaining data objects from a data source, normalizing the data objects into a standardized format, and indexing the normalized data objects. Searching for data objects may comprise receiving a search request that comprises search criteria, normalizing the search criteria into the standardized format, and searching within the normalized index for data objects that meet the normalized search criteria.
Another general aspect of the disclosure is a computer program product tangibly embodied in an information carrier, the computer program product comprising instructions that, when executed, cause at least one processor to perform operations comprising creating an index of data objects, and searching for data objects in the index. Creating the index may comprise obtaining data objects from a data source, normalizing the data objects into a standardized format, and indexing the normalized data objects. Searching for data objects may comprise receiving a search request, the search request comprising search criteria; normalizing the search criteria into the standardized format, and searching within the normalized index for data objects that meet the normalized search criteria.
Yet a further general aspect of the disclosure is a computer system arranged for searching for data objects, wherein the system includes an indexing module arranged for creating an index of data objects, and a search module arranged for searching for data objects. The indexing module may comprise a retrieval engine arranged to obtain data objects from a data source, a normalization engine arranged to normalize the data objects into a standardized format, and an indexing engine arranged to index the normalized data objects. The search module may comprise a normalization engine arranged to normalize received search criteria into the standardized format, and a search engine arranged to search within the normalized index for data objects that meet the normalized search criteria.
Advantages of one or more aspects or embodiments may include one or more of the following. Some embodiments may allow users to search for data objects without knowing the exact format in which the data objects are stored. Some embodiments may allow users to retrieve data objects in spite of inconsistencies in format of similar stored data.
The details of one or more embodiments are set forth in the accompanying drawings and description below. Other features and advantages will become apparent from the description, the drawings and the claims.
In the FIGS:
Computer 900 can communicate with computers 901 and 902 over network 990. Computer 900 has processor 910, memory 920, bus 930, and, optionally, input device 940 and output device 950 (I/O devices, user interface 960). As illustrated, the invention is implemented by computer program product 100 (CPP), carrier 970 and signal 980. With respect to computer 900, computer 901/902 is sometimes referred to as a “remote computer.” Computer 901/902 is, for example, a server, a peer device, or other common network node, and typically has many or all of the elements described for computer 900.
Computer 900 is, for example, a conventional personal computer (PC), a desktop device or a hand-held device, a multiprocessor computer, a pen computer, a microprocessor-based or programmable consumer electronics device, a minicomputer, a mainframe computer, a personal mobile computing device, a mobile phone, a portable or stationary personal computer, a palmtop computer or the like.
Processor 910 is, for example, a central processing unit (CPU), a micro-controller unit (MCU), digital signal processor (DSP), or the like.
Memory 920 is comprised of elements that temporarily or permanently store data and instructions. Although memory 920 is illustrated as part of computer 900, memory can also be implemented in network 990, in computers 901/902, and in processor 910 itself (e.g., cache, register), or elsewhere. Memory 920 can be a read-only memory (ROM), a random-access memory (RAM), or a memory with other access options. Memory 920 is physically implemented by computer-readable media, for example: (a) magnetic media, like a hard disk, a floppy disk, or other magnetic disk, a tape, a cassette tape; (b) optical media, like optical disk (CD-ROM, digital versatile disk—DVD); (c) semiconductor media, like DRAM, SRAM, EPROM, EEPROM, or memory stick; or (d) or other memory that allows data to be stored and subsequently retrieved or modified.
Optionally, memory 920 is distributed. Portions of memory 920 can be removable or non-removable. For reading from media and for writing to media, computer 900 uses well-known devices, for example, disk drives, or tape drives.
Memory 920 stores modules such as, for example, a basic input output system (BIOS), an operating system (OS), a program library, a compiler, an interpreter, and a text-processing tool. Modules are commercially available and can be installed on computer 900. For simplicity, these modules are not illustrated.
CPP 100 has program instructions and, optionally, data that cause processor 910 to execute method steps of the present invention. In other words, CPP 100 can control the operation of computer 900 and its interaction in network system 999 so that it operates to perform in accordance with the invention. For example and without the intention to be limiting, CPP 100 can be available as source code in any programming language, and as object code (“binary code”) in a compiled form.
Although CPP 100 is illustrated as being stored in memory 920, CPP 100 can be located elsewhere. CPP 100 can also be embodied in carrier 970.
Carrier 970 is illustrated outside computer 900. For communicating CPP 100 to computer 900, carrier 970 is conveniently inserted into input device 940. Carrier 970 is implemented as any computer readable medium, such as a medium largely explained above (cf. memory 920). Generally, carrier 970 is an article of manufacture having a computer-readable medium with computer-readable program code to cause the computer to perform methods of the present invention. Further, signal 980 can also include computer program product 100.
Having described CPP 100, carrier 970, and signal 980 in connection with computer 900 is convenient. Optionally, further carriers and further signals embody computer program products (CPP) to be executed by further processors in computers 901 and 902.
Input device 940 provides data and instructions for processing by computer 900. Device 940 can be a keyboard, a pointing device (e.g., mouse, trackball, cursor direction keys), microphone, joystick, game pad, scanner, or disc drive. Although the examples are devices with human interaction, device 940 can also be a device without human interaction, for example, a wireless receiver (e.g., with satellite dish or terrestrial antenna), a sensor (e.g., a thermometer), or a counter (e.g., a goods counter in a factory). Input device 940 can serve to read carrier 970.
Output device 950 presents instructions and data that have been processed. For example, this can be a monitor or a display, cathode ray tube (CRT), flat panel display, liquid crystal display (LCD), speaker, printer, plotter, or vibration alert device. Output device 950 can communicate with the user, but it can also communicate with other computers.
Input device 940 and output device 950 can be combined into a single device. Any device 940 and 950 can be provided optionally.
Bus 930 and network 990 provide logical and physical connections by conveying instruction and data signals. While connections inside computer 900 are conveniently referred to as “bus 930,” connections between computers 900 and 902 are referred to as “network 990.” Optionally, network 990 includes gateways, which are computers that specialize in data transmission and protocol conversion.
Devices 940 and 950 are coupled to computer 900 by bus 930 (as illustrated) or by network 990 (optionally). While the signals inside computer 900 are mostly electrical signals, the signals in network 990 are electrical, electromagnetic, optical or wireless (radio) signals.
Networks are commonplace in offices, enterprise-wide computer networks, intranets and the Internet (e.g., the world wide web (WWW)). Network 990 can be a wired or a wireless network. To name a few network implementations, network 990 can be, for example, a local area network (LAN); a wide area network (WAN); a public switched telephone network (PSTN); an Integrated Services Digital Network (ISDN); an infrared (IR) link; a radio link, like Universal Mobile Telecommunications System (UMTS), Global System for Mobile Communication (GSM), or Code Division Multiple Access (CDMA); or a satellite link.
A variety of transmission protocols, data formats and conventions is known; for example, transmission control protocol/internet protocol (TCP/IP), hypertext transfer protocol (HTTP), secure HTTP, wireless application protocol (WAP), unique resource locator (URL), a unique resource identifier (URI), hypertext markup language (HTML), extensible markup language (XML), extensible hypertext markup language (XHTML), wireless markup language (WML), and Standard Generalized Markup Language (SGML).
Interfaces coupled between the elements are also well known in the art. For simplicity, interfaces are not illustrated. An interface can be, for example, a serial port interface, a parallel port interface, a game port, a universal serial bus (USB) interface, an internal or external modem, a video adapter, or a sound card.
The external system 206 can comprise a wide area network (WAN) 290b, and computers 201 and 202. Communication between the local system 204 and the external system 206 can be provided using a network connection 208 between the LAN 290a and the WAN 290b. On each local computer 200a, 200b, an email client can be installed. The email client can be part of a communication engine. The email client can use data objects, for example contact data, which can be stored on the local computers in a database. In one embodiment, it may also be possible to access from the local computer 200a via the local area network 990a and the wide area network 990b, an external email client, for example, a web-application, running on one of the external computers 201, 202. Within the external computers 201, 202, contact data of users can be stored as well. When communicating with persons, users can use the email client, and can send messages, electronically or using common mail, using the contact data stored on the computers 200a, 200b, 201, and 202.
The local computer 200a is illustrated in more detail in
The computer program product 100 may provide several functions, for example the engines 301-305. These engines 301-305 can be part of the computer program product 100 or they can be separate modules, controlled by the computer program product 100. For example, within the local computer 200 can be arranged a search engine 301, a retrieval engine 302, a normalization engine 303, an indexing engine 304 and a communication engine 305.
The search engine 301 can comprise executable instructions for running a search process. The search process may, for example, retrieve data from a local index 321, or from an external index 320. The search engine can comprise executable instructions for running an attribute search within particular attributes of data objects, or running a full text search, searching for search statements within the full text of different attributes.
The search engine can comprise a dictionary, which enables fast access to the data. Embodiments provide using a search engine to execute the search within its indexes (described below). The search engine may provide full text searches within indexes. It may also provide a dictionary to search for particular search statements. Through a dictionary, a search engine may facilitate “fuzzy” searches to identify data objects that do not exactly match search terms. For example, a dictionary may allow full-text searches with only partial search terms. Moreover, a dictionary may retrieve results that do not exactly match a search term. For example, if a user enters a misspelled search term, for example “raod,” a dictionary may nevertheless retrieve results that include “rd,” “road,” and “raod.” The search engine may also provide attribute searches within a database.
The retrieval engine 302 can comprise executable instructions for retrieving data objects from a database 322. The retrieval engine can retrieve data objects stored on a local computer 200b or on an external host computer 201, 202.
Obtaining the data objects may comprise searching within local or external programs and databases for data objects, according to one embodiment.
According to one embodiment, the data objects can comprise attributes and attribute values. According to one embodiment, the search criteria can comprise search attributes and search values. According to one embodiment, it may also be possible for users to search for attributes using a full-text search. The search criteria may comprise any string of characters.
The normalization engine 303 can comprise executable instructions for normalizing the data objects.
Normalizing the data objects may comprise converting the data objects from a format in which they are stored to a commonly agreed-upon format, according to one embodiment. The format can be agreed-upon for each attribute. For example, in one embodiment, address attribute values may be converted into a “long text” format, for example, a format in which “rd.” is converted to “road,” “blvd.” to “boulevard,” “ave.” to “avenue,” etc.
Normalizing the data objects can comprise, according to one embodiment, normalizing the attribute values. Normalizing the attribute values into a standardized format can comprise, according to embodiments, converting the character string of the attribute values of at least one of the contact attributes, e.g., phone number, street data, zip code, state, first name, or last name, into the corresponding standardized format.
Converting the character string can comprise converting language-specific characters into the corresponding plain characters, according to embodiments. Language-specific characters can be, for example, German Umlauts. There can also be, for example, corresponding vocal or consonant combinations in the Latin script that represent the specific characters. These corresponding combinations can be used for normalization.
Normalizing the data objects into the standardized format can comprise converting nicknames into their corresponding long format, according to one embodiment. For example, a look-up table can provide full names corresponding to nicknames. According to a look-up table, the nickname “Bill” ma be converted into “William”. The look-up table can provide for different nicknames the corresponding full names for normalization.
The normalization engine may also comprise executable instructions for normalizing a search request before starting the search within the search engine 301.
According to embodiments, normalizing the search criteria can comprise normalizing the search values in the same manner as described above.
The normalization can be performed algorithmically or by using a look-up table. An algorithmic normalization may use normalization rules, for example, for processing telephone numbers. As part of an algorithmic normalization, an algorithm may identify several fields within a telephone number. For example, the algorithm may identify a country code and convert it to three digits which may or may not be preceded or surrounded by other symbols-for instance, parentheses or a ‘+’ symbol. A look-up table normalization may use a look-up table for converting the data. For example, a look-up table may, based on other context-for instance country context-determine how to convert a string. If country context associates an address object with Germany, a look-up table may convert “str.” to “strasse.” Alternatively, if country context associates the same address object with the U.S., the look-up table may convert “str.” to “street.”
The indexing engine 304 may comprise executable instructions for creating a local index 321 of locally-stored contact data. The indexing engine 304 may also comprise executable instructions for creating an external index 320 of externally-stored contact data.
Indexing may comprise reading the normalized data objects and creating an index.
Although the foregoing describes normalization as preceding indexing, data objects may also be indexed first, and the index may then be normalized.
The communication engine 305 can comprise executable instructions at least for providing a communication client, for example an email client.
Upon receipt of a search request from a user, within the local computer 200, the microprocessor 310 may execute the computer program product 100 to create an index of data objects. Creating an index may be part of an indexing phase 401 that the microprocessor can run. If an index has already been created of data objects, the microprocessor 310, running the computer program product 100, may skip creating or re-creating the index and instead to a search phase 403.
To create the index, the microprocessor can start the retrieval engine 302 to retrieve (402) data objects from a data source. The data objects may comprise contact data attributes, for example, street, city, first name, surname, phone number, etc. The contact data can also comprise contact data attribute values, which can be the data of the attributes for the respective data objects.
The microprocessor 310 can cause the retrieval engine 302 to search on the local computer 200a for data objects. For example, the data objects can be stored on the local computer 200a within the database 322. The data objects stored in the data database 322 can be read from the database. The retrieval engine can further use the network interface 312 and the local area network 290a to search on the local computer 200b for further contact data. If the retrieval engine 302 also finds data objects on local computer 200b, this data can be retrieved.
External data objects can also be retrieved by the retrieval engine 302. Via network interface 312, LAN 290a and WAN 290b, the retrieval engine 302 can access external data objects stored on one of the external computers 201, 202. These data objects may also be retrieved.
After local or external data objects have been retrieved by the retrieval engine 302, the data objects may normalized (404) by the normalization engine 303. The normalization engine 303 can normalize the attribute values by converting the attribute values into a standardized format.
In one embodiment, the attribute values may comprise a character string. The normalization engine 303 can normalize (404) the attribute values into a standardized format by converting the character string, for example, of the attribute values of the contact attributes, e.g., phone number, street data, zip code, state, first name, or last name, into the corresponding standardized format.
In one embodiment, the phone numbers can be converted into the format “[+international code] [regional code] [dialthrough]”, for example “+49 123 12345678”. For example, a phone number stored as “+049 0111 11111” can be converted into “+49 111 11111”. This normalization could be, for an example, an algorithmic normalization.
In one embodiment, the street data can be converted from an abbreviated form into a full-text name. For example “blvd.” can be converted into “boulevard,” or “str.” can be converted into “street.” This conversion can be langauge- or country-specific. For example, in English, “str.” could be converted into “street,” while in German “str.” could be converted into “strasse.” This normalization could be, for example, a look-up table normalization.
State data may also be converted from an abbreviated format into a standardized full format. For example, “CA” can be converted into “California,” etc. This could also be a look-up table normalization, in one embodiment.
Converting names can comprise converting nicknames into corresponding full names. For example, “Bill” can be converted into “William.” This can be done using a look-up table, which can comprise different conversion rules for different countries, in one embodiment.
The same can apply for converting within the normalization engine language-specific characters into the corresponding plain characters. For example “Ä” can be converted into “AE,” or “β” can be converted into “ss.”
The data objects can also be indexed (406) by the indexing engine 304. The indexing engine 304 may differentiate local data objects from external data objects. For example, local data objects may be indexed separately, in a local index 321; external data objects may be indexed in an external index 320. The indexing engine 304 may also index all data objects into one index. Indexing (406) may comprise storing a single data object, for example one field or attribute from a database record, together with a reference to other associated data objects, for example the entire database record, to enable retrieving data objects using the index.
Indexing (406) may precede normalizing (404), or normalizing (404) may preceed indexing (406). When retrieved data objects have been indexed and normalized, indexed, normalized data objects are stored (407) in a normalized index.
After a normalized index has been created, the microprocessor 310 can operate search engine 301 to provide a user interface on GUI 960 capable of accepting a search query from a user. The user can enter a search request into the search mask of GUI 960 and the search request can be received (408) by the search engine 301. The search request can comprise a search criterion, which can, in turn, can comprise a search attribute and/or a search value.
The search request from the user can be, for example, a string of characters or digits. For example, a user can search for contact data, where the respective contact has an address in Germany, with a search request, “Germany.” The search request may be entered in one of several possible formats. For example, telephone numbers can be entered in various different formats. These can be, among others, “+49 123 12345678,” “0049 123 12345678,” “(49) 123 12345678,” “(49) 0123 12345678,” (0049) 123 12345678,” etc. There are multiple possibilities to enter a phone number. Another example can be hyphenated names. For example, the name “Schmitt-Mayer” can also be spelled “Schmitt Mayer,” or “SchmittMayer,” etc.
Since a user searching for data objects may not be aware of the format data objects are stored, normalizing the data objects before they are stored in the normalized index may increase a user's flexibility in entering a search request. In addition, the search request can be normalized. This normalization of the search request can be done, for example, in the same manner as the normalization of the data objects.
To normalize the search request comprising a search criterion, the search request can be sent to the normalization engine 303, where the search criterion can be normalized (410) into a standardized format. Normalization of the search request can be similar to the normalization of the data objects, as described above. Normalizing the data objects and the search request into the same format enables users to search for data objects without knowledge of the specific format for either the data objects or the search request.
After the normalization (410) of the search criterion within the search request, the search engine 301 can search (412) within the index 322, 321 for data objects that meet the normalized search criterion. The search can be done on both the local index 321 and the external index 320, but it can also be limited to one of these indexes 320, 321.
When a data object is found that meets the normalized search criterion, the search result can be provided (414) to the user. The search result may comprises a link to one or more data objects. For example, a user searching for a particular person may receive, through the search result, the full name of the person, a corresponding address, and a corresponding telephone number. The link can enable the user to access the one or more data objects where they are stored. The search result can be presented to the user through the GUI 960.
All of the variations described above may be eliminated by a normalization process. A second database table 504 illustrates how the data in database table 502 might look after being normalized. Nicknames may be converted to full names, telephone number format may be standardized, abbreviations may be eliminated or standardized, language-specific characters may be removed, character case may be standardized, and other changes may be made to standardize, or normalize, the data.
Some data may be indexed either before or after it is normalized. Indexing may comprise creating an “unstructured” list from a “structured” database table. For example, an index 506 of normalized street addresses is shown. The index may include the values from one or more fields or attributes, along with a reference to a database table from which the values came. In the index 506, for example, “123 ROAD” is associated with “12,” since “2” may be an identifier for a database row that includes the data object corresponding to the normalized “123 ROAD.” The identifier may be a globally unique identifier (GUID), for example.
Although the index 506 is shown as including normalized data objects from the database table 502, an index may include data objects that have not been normalized.
Indices may be created for other attributes or fields. Index 508 is an example of an index of last names in the database table 502. As shown in the index 508, last names that appear in more than one row in the database table 502 may be associated with more than one identifier, as is shown.
A number of embodiments have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of this disclosure. Accordingly, other implementations are within the scope of the following claims.
