Patent Application
20110066606
The invention relates to computer data access control and privacy in general, and more particularly in relation to search engines.
Many companies strive to make data in one part of the company available to employees in other parts of the company to maximize the use and benefit of the data. While search engines are excellent tools for indexing company data and allowing the data to be searched, access to such data is often restricted in accordance with a predefined access control model, allowing employees to access data to which they are authorized, while preventing them from accessing data to which they are not authorized. As such, managers of company search engines must choose between excluding restricted information from the search engine index, potentially depriving employees from learning about useful company data which they may be authorized to access, or including restricted information in the search engine index, potentially exposing employees to company data, even in abbreviated form in a search result set, which they may not be authorized to access.
The invention in embodiments thereof discloses novel systems and methods for searching access-controlled documents that include restricted information and providing search results therefor.
In one aspect of the invention a search engine system with privacy protection is provided, the system including a data indexer configured to create an index of data, a search engine configured to search the index of the data in response to a query, and create a search result set including excerpts from the data, and a privacy protector configured to identify at least one data entity within at least one excerpt of the search result set that meets at least one predefined entity extraction criterion, redact the search result set by removing the data entity from the excerpt, and present the redacted search result set on a computer output device, where any of the data indexer, search engine, and privacy protector are implemented in either of computer hardware and computer software embodied in a computer-readable medium.
In another aspect of the invention the data indexer is configured to create a set of excerpts from the data independent from the processing of queries by the search engine, where the privacy protector is configured to identify at least one data entity within the set of excerpts that meets at least one predefined entity extraction criterion, and pre-redact the set of excerpts by removing from the set of excerpts the data entity identified in the set of excerpts, and where the search engine is configured to create the search result set from the pre-redacted set of excerpts in response to the query.
In another aspect of the invention the data indexer is configured to identify at least one data entity within the index that meets at least one predefined entity extraction criterion, and redact the index set by removing the data entity from the index.
In another aspect of the invention a method is provided for providing privacy protection in a search engine system, the method including searching a index of data in response to a query, creating a search result set including excerpts from the data as a result of the searching, identifying at least one data entity within at least one excerpt of the search result set, where the data entity meets at least one predefined entity extraction criterion, redacting the search result set by removing the data entity from the excerpt, and presenting the redacted search result set on a computer output device.
In another aspect of the invention the method further includes creating a set of excerpts from the data independent from the processing of queries by a search engine, identifying at least one data entity within the set of excerpts that meets at least one predefined entity extraction criterion, and pre-redacting the set of excerpts by removing from the set of excerpts the data entity identified in the set of excerpts, where the step of creating a search result set includes creating the search result set from the pre-redacted set of excerpts in response to the query.
In another aspect of the invention a system is provided for classifying data in accordance with data access reasons, the system including a predefined access reasons database having a plurality of predefined access reasons, and a data classifier configured to create a classification index of data by identifying an association between any of the data and at least one of the predefined access reasons, and storing the association in the classification index, where any of the predefined access reasons database and data classifier are implemented in either of computer hardware and computer software embodied in a computer-readable medium.
In another aspect of the invention the predefined access reasons database includes at least one predefined association between any of the predefined access reasons and at least one predefined data entity type, and where the predefined association indicates that access is permitted to any of the data that includes a data entity of the data entity type.
In another aspect of the invention the data classifier is configured to identify the association by identifying at least one data entity within any of the data, where the data entity is of any of the predefined data entity types, and associating any of the data that includes the identified data entity with the access reasons that is associated with the data entity type of the identified data entity.
In another aspect of the invention the data classifier is configured to identify the association by determining that the data matches a statistical profile of a sample data set associated with the access reason.
In another aspect of the invention the system further includes a data access request logger configured to require the selection of an access reason from the database in association with a query to be processed regarding the data, and a privacy protector configured to eliminate from a search result set resulting from the processing of the query any search result excerpt except where access to the data underlying the search result excerpt is permitted for the selected access reason as indicated by the association in the classification index between the underlying data and the selected access reason.
In another aspect of the invention the system further includes a data access request logger configured to require the selection of an access reason from the database in association with a query to be processed regarding the data, and a privacy protector configured to identify at least one data entity within at least one excerpt of a search result set resulting from the processing of the query, where the data entity meets at least one predefined entity extraction criterion, and redact the search result set by removing the data entity from the excerpt unless the data entity is of a data entity type that is associated with the selected access reason as indicated in the predefined access reasons database as permitting access to the data entity type.
In another aspect of the invention further includes a data access request logger configured to require the selection of an access reason from the predefined access reasons database if the underlying data of any excerpt in a search result set resulting from the processing of a query is associated with any access reason in classification index, and a privacy protector configured to eliminate from the search result set any search result excerpt except where access to the data underlying the search result excerpt is permitted for the selected access reason as indicated by the association in the classification index between the underlying data and the selected access reason.
In another aspect of the invention the data access request logger is configured to present for selection only those of the access reasons that are associated with the underlying data of the search result set as indicated in the classification index.
In another aspect of the invention the system further includes a privacy protector configured to identify at least one data entity within at least one excerpt of a search result set resulting from the processing of a query, where the data entity meets at least one predefined entity extraction criterion, and redact the search result set by removing the data entity from the excerpt, and a data access request logger configured to allow the selection of an access reason from the database in association with the query to be processed regarding the data, and restore the data entity that was previously removed from the excerpt of the search result set if the data entity is of a data entity type that is associated with the selected access reason as indicated in the predefined access reasons database as permitting access to the data entity type.
In another aspect of the invention a method is provided for classifying data in accordance with data access reasons, the method including providing a plurality of predefined access reasons, identifying an association between a unit of data and at least one of the predefined access reasons, and storing the association in the classification index.
In another aspect of the invention the providing step includes providing at least one predefined association between any of the predefined access reasons and at least one predefined data entity type, where the predefined association indicates that access is permitted to any of the data that includes a data entity of the data entity type.
In another aspect of the invention the identifying step includes identifying at least one data entity within any of the data, where the data entity is of any of the predefined data entity types, and associating any of the data that includes the identified data entity with the access reasons that is associated with the data entity type of the identified data entity.
In another aspect of the invention the identifying step includes determining that the data matches a statistical profile of a sample data set associated with the access reason.
In another aspect of the invention the method further includes requiring the selection of an access reason from the access reasons in association with a query to be processed regarding the data, and eliminating from a search result set resulting from the processing of the query any search result excerpt except where access to the data underlying the search result excerpt is permitted for the selected access reason as indicated by the association in the classification index between the underlying data and the selected access reason.
In another aspect of the invention the method further includes requiring the selection of an access reason from the access reasons in association with a query to be processed regarding the data, identifying at least one data entity within at least one excerpt of a search result set resulting from the processing of the query, where the data entity meets at least one predefined entity extraction criterion, and redacting the search result set by removing the data entity from the excerpt unless the data entity is of a data entity type that is associated with the selected access reason as indicated in the predefined access reasons as permitting access to the data entity type.
In another aspect of the invention the method further includes requiring the selection of an access reason from the predefined access reasons if the underlying data of any excerpt in a search result set resulting from the processing of a query is associated with any access reason in classification index, and eliminating from the search result set any search result excerpt except where access to the data underlying the search result excerpt is permitted for the selected access reason as indicated by the association in the classification index between the underlying data and the selected access reason.
In another aspect of the invention the method further includes identifying at least one data entity within at least one excerpt of a search result set resulting from the processing of a query, where the data entity meets at least one predefined entity extraction criterion, redacting the search result set by removing the data entity from the excerpt, allowing the selection of an access reason from the access reasons in association with the query to be processed regarding the data, and restore the data entity that was previously removed from the excerpt of the search result set if the data entity is of a data entity type that is associated with the selected access reason as indicated in the predefined access reasons as permitting access to the data entity type.
In another aspect of the invention a computer program product is provided for providing privacy protection in a search engine system, the computer program product including a computer readable medium, and computer program instructions operative to search a index of data in response to a query, create a search result set including excerpts from the data as a result of the searching, identify at least one data entity within at least one excerpt of the search result set, where the data entity meets at least one predefined entity extraction criterion, redact the search result set by removing the data entity from the excerpt, and present the redacted search result set on a computer output device, where the program instructions are stored on the computer readable medium.
In another aspect of the invention a computer program product is provided for classifying data in accordance with data access reasons, the computer program product including a computer readable medium, and computer program instructions operative to provide a plurality of predefined access reasons, identify an association between a unit of data and at least one of the predefined access reasons, store the association in the classification index, require the selection of an access reason from the access reasons in association with a query to be processed regarding the data, and eliminate from a search result set resulting from the processing of the query any search result excerpt except where access to the data underlying the search result excerpt is permitted for the selected access reason as indicated by the association in the classification index between the underlying data and the selected access reason, where the program instructions are stored on the computer readable medium.
The invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the appended drawings in which:
The invention is now described within the context of one or more embodiments, although the description is intended to be illustrative of the invention as a whole, and is not to be construed as limiting the invention to the embodiments shown. It is appreciated that various modifications may occur to those skilled in the art that, while not specifically shown herein, are nevertheless within the true spirit and scope of the invention.
As will be appreciated by one skilled in the art, the invention may be embodied as a system, method or computer program product. Accordingly, the invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, the invention may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium.
Any combination of one or more computer usable or computer readable medium(s) may be utilized. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CDROM), an optical storage device, a transmission media such as those supporting the Internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of this document, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable medium may include a propagated data signal with the computer-usable program code embodied therewith, either in baseband or as part of a carrier wave. The computer usable program code may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc.
Computer program code for carrying out operations of the invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
The invention is described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable medium that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Reference is now made to
When search engine 106 queries data 104 in response to a query, search engine 106 creates a search result set 108 which includes excerpts from data 104 in accordance with conventional techniques. A privacy protector 110 uses conventional techniques, such as those employed by System T™ and IBM Classification Module™ (ICM), both commercially available from International Business Machines, Armonk, N.Y., to identify data entities within the excerpts in search result set 108 that meet predefined entity extraction criteria 112, where the criteria preferably indicate what types of information should be removed from the search result excerpts due to privacy considerations. Examples of such data entities include, but are not limited to, Social Security Numbers, patient names, and credit card numbers. Predefined entity extraction criteria 112 may include criteria that are applicable regardless of the persons or parties that initiated the query, and/or criteria that are specific to individual persons or parties. Privacy protector 110 then presents search result set 108, such as on a computer display or other computer output device, in a redacted format, where access to those data entities of search result set 108 that meet predefined entity extraction criteria 112 is prevented, such as by displaying the excerpts of search result set 108 without those data entities. Privacy protector 110 preferably presents one or more access control indicators in place of removed data entities indicating that access to the data entities is prevented, such as by displaying in place of the removed data entity an icon or the words “Access Restricted” or the semantic type of the deleted data.
In accordance with an alternative embodiment of the invention, data indexer 100 creates a set of excerpts 114 from data 104 in accordance with conventional techniques independent from the processing of queries by search engine 106. Privacy protector 110 then identifies data entities within excerpts 114 that meet predefined entity extraction criteria 112, preferably where the criteria are applicable regardless of the persons or parties that may initiate queries, and pre-redacts excerpts 114 by removing the identified data entities from within excerpts 114 as described above. Search engine 106 then creates search result set 108 from pre-redacted excerpts 114 in response to a query and presents search result set 108 as is, or with additional redaction as described above by applying predefined entity extraction criteria 112 that are specific the person or party that initiated the query.
In accordance with an embodiment of the invention, predefined entity extraction criteria 112 that are specific to individual persons or parties are defined in accordance with an access control model, such as a regulation-driven policy model, of entities, roles, policies, rules, actions, and obligations based on regulations and business requirements. For example, where data 104 includes medical records, predefined entity extraction criteria 112 may be defined to identify any data entities within data 104 that are to be redacted as described above for any individuals identified as having a role other than that of a physician. Thus, access to a given type of data entity or to a data entity matching a given rule may be defined as permitted or forbidden to an individual having a certain role, such as that of Physician or Chief Financial Officer.
Once search result set 108 has been presented as described above, any item in search result set 108 may be selected by a requestor, whereupon access may be given to the complete version of the item in data 104 from which the selected excerpt was taken, subject to any applicable access and/or privacy controls, such as may be provided by an underlying enterprise information system in accordance with conventional techniques. In accordance with an embodiment of the invention, a data access request logger 116 is configured such that when an item in search result set is selected, data access request logger 116 allows or requires that the request be accompanied by a reason. The reason may be manually entered or selected from a database 118 of predefined access reasons, which may be predefined at any level of access control, such as for a specific user, role, data item, etc., and which may also indicate whether or not to grant access to requested data, subject to any applicable access controls. Data access request logger 116 is preferably configured to maintain a record of the identity of the requestor together with a description of the requested data item and the reason given for the request, if given, and may also include additional information such as the role of the requester and the time of the request. Such information may be later analyzed to determine whether the request was justified, whether disciplinary action should be taken, and/or whether any of the data access model entities, permissions, or reasons described above should be modified to further restrict access to data and/or relax existing restrictions.
In the embodiments above index 102 is constructed from data 104 without restriction and is itself allowed to contain data that are removed from search result excerpts as described hereinabove. Alternatively, index 102 is constructed such that it does not itself contain data that are defined, using any conventional technique, as private data. Thus, in this alternative embodiment, index 102 would not, for example, contain patient names or identification numbers.
Reference is now made to
The system and method of
In addition to, or as an alternative to, removing data from search result excerpts due to privacy considerations as described hereinabove, documents may be classified based on the types of data that they contain and access reasons that permit or restrict access to such data. These classifications may then be used in conjunction with search engine queries as is now described hereinbelow.
Reference is now made to
Data classifier 400 preferably employs predefined access reasons database 118 (
In another embodiment, data classifier 400 employs text classification techniques, such as those employed by the IBM Classification Module™ (ICM), to build statistical profiles 410 of sample data sets 412, where for each predefined access reason in database 118 one manually categorized sample data set 412 is provided as an example of data to which access is permitted for the access reason, and/or another manually categorized sample data set 412 is provided as an example of data to which access is not permitted for the access reason. Data classifier 400 then constructs classification index 402 by determining which portions (e.g., documents, data sets) of data 104 match the statistical profiles 410 of which predefined access reasons in database 118 and stores the associations in classification index 402.
The system of
In another embodiment, as shown in
In yet another embodiment, as shown in
In still another embodiment, as shown in
In any of the embodiments of
Any of the elements shown in
Referring now to
As shown, the techniques for controlling access to at least one resource may be implemented in accordance with a processor 510, a memory 512, I/O devices 514, and a network interface 516, coupled via a computer bus 518 or alternate connection arrangement.
It is to be appreciated that the term “processor” as used herein is intended to include any processing device, such as, for example, one that includes a CPU (central processing unit) and/or other processing circuitry. It is also to be understood that the term “processor” may refer to more than one processing device and that various elements associated with a processing device may be shared by other processing devices.
The term “memory” as used herein is intended to include memory associated with a processor or CPU, such as, for example, RAM, ROM, a fixed memory device (e.g., hard drive), a removable memory device (e.g., diskette), flash memory, etc. Such memory may be considered a computer readable storage medium.
In addition, the phrase “input/output devices” or “I/O devices” as used herein is intended to include, for example, one or more input devices (e.g., keyboard, mouse, scanner, etc.) for entering data to the processing unit, and/or one or more output devices (e.g., speaker, display, printer, etc.) for presenting results associated with the processing unit.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
While the methods and apparatus herein may or may not have been described with reference to specific computer hardware or software, it is appreciated that the methods and apparatus described herein may be readily implemented in computer hardware or software using conventional techniques.
While the invention has been described with reference to one or more specific embodiments, the description is intended to be illustrative of the invention as a whole and is not to be construed as limiting the invention to the embodiments shown. It is appreciated that various modifications may occur to those skilled in the art that, while not specifically shown herein, are nevertheless within the true spirit and scope of the invention.
