Patent Application
20100169788
The present invention relates to computer-assisted systems and methods for interactive data visualization and analysis. More particularly, the present invention relates to methods and systems for multiple individuals to collaborate on the visualization, manipulation and analysis of a complex multi-dimensional data set.
Thorough analysis and comprehension of complex data sets is often the key to strategic decision making. While data presentation, visualization and manipulation software tools are known, they are limited in that they are one dimensional in terms of interactivity. That is, they are oriented towards a single user/single analytical process paradigm. For this reason, they do not contemplate and do not permit collaborative, integrated and interactive analysis of complex data sets among multiple users/analysts. This has effectively prevented organizations from effectively leveraging the collective intellect and knowledge of their work force on the same analytic problem. What is needed is an improved method for enabling collaboration in an interactive visual analysis context.
In order to address the above-described short-comings in the prior art, the present invention provides methods and systems for multiple individuals to collaborate on the visualization, manipulation and analysis of a complex multi-dimensional data set. According to this invention, a computer assisted system and method for the visualization, manipulation and analysis of data is provided, in which a computer-assisted data visualization and analysis session undertaken by a user, analyst, or group of users/analysts, including all intermediate and final data visualization, manipulation and analysis steps and functions, are electronically maintained on a computer-readable medium and instantly made available to authorized collaborators so that authorized collaborators may review all the intermediate visualization, manipulation and analysis stages. In addition, any authorized collaborator may choose any intermediate or final data visualization stage and commence a new, but related data visualization, manipulation and analysis derivative session. Like the original session, all derivative sessions, including all intermediate and final data visualization, manipulation and analysis steps and functions are electronically stored and made available to authorized collaborators.
According to the invention, the data in any visualization, manipulation and analysis session may be displayed using multiple visualization techniques including quantitative, relational, temporal and geospatial views of the data. These visualizations are highly interactive, allowing a user to interrogate and ask questions through direct interaction with the display entities that are rendered. All user interactions with the system are saved as part of a session, and available for retrieval and additional review and analysis by the same user or by any authorized collaborator.
In this way, multiple analysts can collaborate in the visualization, manipulation and analysis of complex data sets, instantly sharing their conclusions and the data analysis sessions which led them to such conclusions. Collaborators can instantly access any intermediate stage in a visualization, manipulation and analysis session and follow the subsequent visualization, manipulation and analysis stages followed by the original session analyst, or, beginning from any first, intermediate or final visualization stage in the original session, start a new, derivative session to follow their own analytical processes and queries. Like the original session, each derivative session is made instantly available to each authorized collaborators, for review and/or the development of further derivative sessions.
The method allows for collaborators to see the effects of other collaborators, on the session, immediately. For example, if the author were to add an additional state while continuing the analysis, that artifact would be instantly available to the other collaborators. Finally, authorized collaborators are able to tag and annotate any stage of the session for subsequent review by the session author and/or other collaborators. In addition, any authorized collaborator may contribute to a current session at the discretion of the session author through simultaneous interactions with the data visualization.
The present invention provides for collaborative analysis in a visual paradigm in which users can simultaneously pursue a cognitive line of reasoning while visually exploring a complex set of data and in which the conclusions and insights can be shared amongst a group and leveraged immediately.
The present invention also provides a unique method for training analysts in the process of conducting effective visual analysis. Through the “unwinding” or replay of an electronically stored data visualization, manipulation and analysis session, new users can benefit from understanding the thought process behind an investigative approach pursued by seasoned analysts.
Accordingly, there is provided according to an embodiment of the invention a system for collaborative data visualization including a server and a database configured to store consecutive states of a computer-assisted data visualization session carried out by a first user; a server and a database configured to control access by a second user to said stored consecutive states of a computer-assisted data visualization session; a server and a database configured to allow said second user to select and display on a computer screen one or more of said stored consecutive states; a server and a database configured to consecutively display consecutive states said computer assisted data visualization session to said second user; a server and database configured to process new data visualization queries by said second user based on a stored state of said computer-assisted data visualization session; a server and a database configured to display new data visualization states based on said new data visualization queries by said second user; a server and a database configured to electronically store said new data visualization states as a derivative data visualization session.
There is also provided according to an embodiment of the invention a system for collaborative data visualization having a server and a database configured to store new consecutive states of said computer assisted data visualization session as they are generated by said first user and simultaneously make them available for display to said second user.
The servers described herein may be integrated into a single device or they may be separated into two or more devices. Similarly, the databases described herein may be integrated into a single database and/or with one or more of the servers described herein, or they may be maintained on separate devices.
There is also provided according to an embodiment of the invention a system for collaborative data visualization having a server and a database configured to receive and electronically store annotation input from said second user relating to one or more of said consecutive states of the first user's data visualization session.
There is also provided according to an embodiment of the invention a system for collaborative data visualization having a server and a database configured to make available for display to said first user said annotation input from said second user.
There is also provided according to an embodiment of the invention a system for collaborative data visualization having a server and a database configured to control access by a third user to said stored data visualization states of said derivative data visualization session; a server and a database configured to allow said third user to select and display on a computer screen one or more of said states of said derivative data visualization session; a server and a database configured to consecutively display consecutive states said derivative data visualization session to said third user; a server and database configured to process new data visualization queries by said third user based on a stored state of said derivative data visualization session; a server and a database configured to display new data visualization states based on said new data visualization queries by said third user; a server and a database configured to electronically store said new data visualization states as a sub-derivative data visualization.
There is also provided according to an embodiment of the invention a computer readable medium storing executable instructions to: store consecutive states of a computer-assisted data visualization session carried out by a first user; to control access by a second user to said stored consecutive states of a computer-assisted data visualization session; to allow said second user to select and display on a computer screen one or more of said stored consecutive states; to consecutively display consecutive states said computer assisted data visualization session to said second user; to process new data visualization queries by said second user based on a stored state of said computer-assisted data visualization session; to display new data visualization states based on said new data visualization queries by said second user; and to electronically store said new data visualization states as a derivative data visualization.
There is also provided according to an embodiment of the invention a computer readable medium storing executable instructions to store new consecutive states of said computer assisted data visualization session as they are generated by said first user and simultaneously make them available for display to said second user.
There is also provided according to an embodiment of the invention a computer readable medium storing executable instructions to receive and electronically store annotation input from said second user relating to one or more of said consecutive states of the first user's data visualization session.
There is also provided according to an embodiment of the invention a computer readable medium storing executable instructions to make available for display to said first user said annotation input from said second user.
There is also provided according to an embodiment of the invention a computer readable medium storing executable instructions to control access by a third user to said stored data visualization states of said derivative data visualization session; to allow said third user to select and display on a computer screen one or more of said states of said derivative data visualization session; to consecutively display consecutive states said derivative data visualization session to said third user; to process new data visualization queries by said third user based on a stored state of said derivative data visualization session; to display new data visualization states based on said new data visualization queries by said third user; and to electronically store said new data visualization states as a sub-derivative data visualization.
There is also provided according to an embodiment of the invention a method for collaborative data visualization and analysis, including providing a server and a database configured to store consecutive states of a computer-assisted data visualization session carried out by a first user; a server and a database configured to control access by a second user to said stored consecutive states of a computer-assisted data visualization session; a server and a database configured to allow said second user to select and display on a computer screen one or more of said stored consecutive states; a server and a database configured to consecutively display consecutive states said computer assisted data visualization session to said second user; a server and database configured to process new data visualization queries by said second user based on a stored state of said computer-assisted data visualization session; a server and a database configured to display new data visualization states based on said new data visualization queries by said second user; a server and a database configured to electronically store said new data visualization states as a derivative data visualization.
There is also provided according to an embodiment of the invention a method for collaborative data visualization and analysis including providing a server and a database configured to store new consecutive states of said computer assisted data visualization session as they are generated by said first user and simultaneously make them available for display to said second user.
There is also provided according to an embodiment of the invention a method for collaborative data visualization and analysis including providing a server and a database configured to receive and electronically store annotation input from said second user relating to one or more of said consecutive states of the first user's data visualization session.
There is also provided according to an embodiment of the invention a method for collaborative data visualization and analysis including providing a server and a database configured to make available for display to said first user said annotation input from said second user.
There is also provided according to an embodiment of the invention a method for collaborative data visualization and analysis including providing a server and a database configured to control access by a third user to said stored data visualization states of said derivative data visualization session; a server and a database configured to allow said third user to select and display on a computer screen one or more of said states of said derivative data visualization session; a server and a database configured to consecutively display consecutive states said derivative data visualization session to said third user; a server and database configured to process new data visualization queries by said third user based on a stored state of said derivative data visualization session; a server and a database configured to display new data visualization states based on said new data visualization queries by said third user; a server and a database configured to electronically store said new data visualization states as a sub-derivative data visualization.
The accompanying drawings, which are incorporated herein and form a part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention by describing a number of embodiments of the present invention.
Specific embodiments of the present invention are now described with reference to various figures. While specific embodiments are described, it should be understood that this is done for illustrative purposes only. A person skilled in the art will recognize that other configurations can be used without departing from the spirit and scope of the present invention.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not as limitation. It will be apparent to those skilled in the art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention, and such embodiments are within the purview of the present invention. Thus, the scope of the present invention should not be limited by any of the above-described embodiments, but should be defined only in accordance with the following claims and their equivalents. All patents and publications discussed herein are incorporated by reference.
Through this process, any number of visualization stages may be produced and saved, together with the underlying data selection and processing request, as an analytic session. representing the beginning, interim and final states of an analytic session.
According to the invention, when an analyst opens the data visualization and analysis tool to initiate a session, the system may give the analyst the option of starting a new session, or to select an existing session generated by the same analyst or a different analyst. If the analyst chooses to initiate a new session, the system may prompt the analyst to identify authorized collaborators who will be permitted to access and interact with the new session. Alternatively, the system may be set up so that authorizations are automatic, based on administrative and/or managerial protocol. If, instead of initiating a new session, the user selects an existing session, the system may allow access to the session if the analyst was the creator of the original session, or if the analyst is an authorized collaborator for a session generated by another analyst. If the analyst is refused access to an existing session, the system may be set up to send an access authorization request to the session creator or to an administrator.
When an analyst is authorized to access an existing session, the existing session is presented to the authorized analyst, or “collaborator,” in such a way that the collaborator can view any of the beginning 109, interim 1xx and final 111 stages of the session 107, as shown in
Collaborators may also access an active session or a dormant session. As used herein, a dormant session is used to refer to a session that that is not currently in progress. As used herein, an active session is a data visualization, manipulation and analysis session that is currently in progress. In this case, each new stage is made available to the collaborators in real-time, or nearly real-time, as it is generated by the analyst that originated the session.
In addition to merely reviewing the various beginning, interim and final stages of dormant or active sessions, collaborators that have accessed an existing session may initiate derivative sessions. When a collaborator is viewing a session stage, the collaborator is presented with a menu that includes the option of interacting with the data according to his or her own queries. In this case, the collaborator may select various data selection, visualization and analytical tools that are different from the choices made during the original session. As shown in
In this fashion, an original session and various derivative and sub-derivative sessions may be established, as shown in
According to a further embodiment of the invention, software is provided for implementing the method described herein. The following steps describe the process according to which an organization of users would carry out the method of this invention under the management of a computer program.
Step 1: A user initiates an interactive visualization session and designates that the session is to be shared with collaborators. Alternatively, authorized collaborators may be set by system default, or the system may be set up so that authorizations can be established or changed at any time.
Step 2: The user proceeds with the analysis through direct interaction with the data visualizations to uncover insights. This process will result in multiple artifacts or interim states that the user reaches through a particular line of inquiry. This process can include data subsetting and/or data augmenting, in which the use instructs the system to retrieve additional data that is related to the data undergoing analysis. For example, for a sample of data involving persons, the user can request the system to retrieve birth data information for each of the persons in sample being analyzed, if not already included in the present body of data.
Step 3: Other users, collaborators, access the session that was initiated by the first user. This access allows the collaborator(s) to move to the current state of the session or any of the interim states that were reached by the original analyst. From any state, the collaborator is able to contribute to the analysis through direct interaction with the visualizations.
Step 4: From any state, collaborators may also tag and annotate the artifacts. Any such ancillary information is instantly available to other collaborators.
Step 5: Collaborators and observers are able to see the analytic session unfold in real time. That is, any updates are instantly available to the other parties as they occur.
Another embodiment of this invention is the ability for collaborators to passively watch an analytic session in progress. This allows for users to observe the analysis without actually attaching to the session and contributing to it. The users would simply observer the session as a series of visualization states as the analysis is performed by the primary investigator.
