The present invention relates in general to the field of portable information handling systems, and more particularly to contextual grouping of handwritten notes to a portable information handling system.
As the value and use of information continues to increase, individuals and businesses seek additional ways to process and store information. One option available to users is information handling systems. An information handling system generally processes, compiles, stores, and/or communicates information or data for business, personal, or other purposes thereby allowing users to take advantage of the value of the information. Because technology and information handling needs and requirements vary between different users or applications, information handling systems may also vary regarding what information is handled, how the information is handled, how much information is processed, stored, or communicated, and how quickly and efficiently the information may be processed, stored, or communicated. The variations in information handling systems allow for information handling systems to be general or configured for a specific user or specific use such as financial transaction processing, airline reservations, enterprise data storage, or global communications. In addition, information handling systems may include a variety of hardware and software components that may be configured to process, store, and communicate information and may include one or more computer systems, data storage systems, and networking systems.
Portable information handling systems integrate processing components, a display and a power source in a portable housing to support mobile operations. Portable information handling systems allow end users to carry a system between meetings, during travel, and between home and office locations so that an end user has access to processing capabilities while mobile. Tablet configurations typically expose a touchscreen display on a planar housing that both outputs information as visual images and accepts inputs as touches. Convertible configurations typically include multiple separate housing portions that couple to each other so that the system converts between closed and open positions. For example, a main housing portion integrates processing components and a keyboard and rotationally couples with hinges to a lid housing portion that integrates a display. In clamshell configuration, the lid housing portion rotates approximately ninety degrees to a raised position above the main housing portion so that an end user can type inputs while viewing the display. Some convertible systems convert to a tablet position, such as by rotating the housing 360 degrees, so that an end user can perform touch inputs at a touchscreen of the display. After usage, convertible information handling systems rotate the lid housing portion over the main housing portion to protect the keyboard and display, thus reducing the system footprint for improved storage and mobility.
One advantage of portable information handling systems that include a touchscreen is that end users can write notes to the touchscreen rather than use a keyboard. In particular, end users often handwrite notes to a tablet information handling system touchscreen much as they might write to a notebook. Logic executing on the tablet information handling system recognizes handwritten letters to translate the notes to digital content that can be stored and manipulated with word processing and other applications. Generally, handwritten notes are stored both as visual images and digital content by a note taking application, such as in a dashboard that the end user accesses to retrieve the handwritten notes. One difficulty with this approach is that handwritten notes tend to have a wide variety of content written during a hurry or in a pause of other events. For example, handwritten notes might include work tasks like scheduling meetings, home tasks like grocery lists and extraneous thoughts like a poem. As a tablet information handling system notes dashboard populates, the end user generally must spend time organizing the notes and taking actions in the notes, otherwise the dashboard can become too crowded to be useful. Generally, manually organizing notes can be a big task and involve a variety of interactions at different computers and applications, such as a calendar, a phonebook, a word processing application, a photo library, etc.... In some instances, confusion regarding the contents of written notes and difficulty organizing them can defeat the purpose of a notes application to simplify tablet information handling system interactions.
Therefore, a need has arisen for a system and method which manages handwritten notes made at an information handling system.
In accordance with the present invention, a system and method are provided which substantially reduce the disadvantages and problems associated with previous methods and systems for managing handwritten notes input at a tablet information handling system. Cross unification of user generated information and system generated information are applied to define a vocabulary that is used to perform cluster analysis on handwritten notes. The cluster analysis sorts handwritten notes by topic in an order of relevance so that a feature comparison of new handwritten notes provide efficient association with existing clusters using the vocabulary.
More specifically, a tablet information handling system accepts and saves handwritten notes made to a touchscreen display by a stylus and organizes the handwritten notes by a cluster analysis of a vocabulary cross unified by user generated information and system generated information, such as physical location, time of day and participants involved in a meeting at which the handwritten notes were taken. A notes application defines clusters sorted by topics using a vocabulary selected from the user and system generated information so that soft clusters of handwritten notes relate by relevant topics in an ordered list of matches to the cluster definitions. The note application allows the end user to search for written notes by content, the physical location at which the notes were taken, the time of day that the notes were taken, collaborators in a meeting at which the notes were taken or other relevant factors isolated through the cluster training process. New handwritten notes infer a cluster relationship through a feature comparison of vocabulary shared with clusters defined in the cluster analysis.
The present invention provides a number of important technical advantages. One example of an important technical advantage is that handwritten notes are quickly and efficiently organized into topics based on a cluster analysis of vocabulary derived from user generated information and system generated information. An end user is provided with a rapid organization of handwritten notes to review and apply in a practical manner, such as for scheduling events like recurring meetings and tracking discussions at the recurring meetings. A variety of different views of relationships across handwritten notes, such as by including notes in multiple soft clusters defined by time, location and meeting participants, enables an end user to put the handwritten information to use in an efficient manner with a decluttered dashboard.
The present invention may be better understood, and its numerous objects, features and advantages made apparent to those skilled in the art by referencing the accompanying drawings. The use of the same reference number throughout the several figures designates a like or similar element.
Handwritten notes taken at a tablet information handling system are managed by reference to a vocabulary cross unified by user-generated information and system-generated information. For purposes of this disclosure, an information handling system may include any instrumentality or aggregate of instrumentalities operable to compute, classify, process, transmit, receive, retrieve, originate, switch, store, display, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, or other purposes. For example, an information handling system may be a personal computer, a network storage device, or any other suitable device and may vary in size, shape, performance, functionality, and price. The information handling system may include random access memory (RAM), one or more processing resources such as a central processing unit (CPU) or hardware or software control logic, ROM, and/or other types of nonvolatile memory. Additional components of the information handling system may include one or more disk drives, one or more network ports for communicating with external devices as well as various input and output (I/O) devices, such as a keyboard, a mouse, and a video display. The information handling system may also include one or more buses operable to transmit communications between the various hardware components.
Referring now to
A notes application executing on tablet information handling system 10 manages handwritten notes 16 stored by end user 18 through selective formation of a vocabulary with a cross unification of user generated information and system generated information. Handwritten notes 16 stored by an end user are analyzed in a training stage to select a vocabulary that relates user generated and system generated content and defines soft clusters that each sorts handwritten notes in an order of relevance for the cluster. Soft clusters mean that a handwritten note might be placed in plural clusters based upon the vocabulary of the handwritten note and with a different level of relevance in each cluster. As an example, handwritten notes may be related to a regularly scheduled meeting based upon time, location and participants, and may also be related to a project covered at the meeting based upon documents referenced during the meeting. Cross unification of user generated information and system generated information may generate a vocabulary with a prominent word selected as a topic based upon the timing of the meeting and the various contents addressed in the meeting. A dashboard of the notes application presents the handwritten note by topic and automatically relates the handwritten note to other actions, such as scheduling another meeting or saving a digital copy of the content in a folder related to the project. Once clusters are defined and given a topic based upon vocabulary determined through training, subsequent handwritten notes may be applied to the vocabulary to infer topic assignments for placement of the handwritten notes in clusters. As an example, clusters may include topics for recurring meetings, physical location, title similarities and shared users.
Referring now to
Referring now to
Once the content of the handwritten note is prepared for analysis, the process continues to vocabulary selection at step 52. As vocabulary is identified in the training cluster analysis system at step 52, the vocabulary is added to the inference cluster analysis system for use by a text data reformation step 66. Vocabulary selection at step 52 splits the information into different categories, such as title, location, timing, contents, etc... The representation of words in the categories carries different semantic values based upon the context that the words appear in. Vocabulary selection 52 selects the top important words of each category and combines these words to form a vocabulary that is applied by cluster analysis to new handwritten notes made by the end user at step 66 by reforming the new handwritten notes. At steps 54 and 68 feature extraction is performed with the vocabulary words found in the handwritten note that maps each word of the vocabulary onto an n-dimensional vector space. The mapping transforms text information into numerical data to which cluster analysis is applied at step 56 and feature comparison is applied at step 70. At step 56 cluster analysis performed to associated vocabulary across the handwritten note data and relate vocabulary to clusters. In the example embodiment, a soft cluster analysis is used that assigns times to multiple soft cluster groups. These defined clusters are used at step 70 by comparing extracted features with cluster features to assign handwritten notes to clusters. At step 58 cluster topics are selected from the vocabulary found in each cluster, such as by identifying a prominent vocabulary word that is understandable to an end user. At step 72, the topic name for a new handwritten note is identified from the cluster that it is related to, such as by association with vocabulary word in the topic name for the most relevant cluster. Once a new handwritten note is assigned to a cluster, the note application can query other relevant notes for retrieval and presentation to the end user.
Referring now to
In one example Use Case 1 embodiment, the notes application works with a scheduling application to manage recurring meetings and handwritten notes generated in the recurring meetings. For instance, an end user establishes a weekly recurring meeting for a “Project X” with a team of predetermined individuals. The note application issues a reminder at the meeting start time and provides a user interface to create a meeting note associated with the meeting. The meeting note is auto populated with the meeting name and related tags from the schedule and the user is prompted to define the meeting as a recurring meeting if appropriate so that future handwritten notes will cluster with this note. If the handwritten note is indicated as recurring, then future notes from the recurring meeting will cluster while other related factors, such as participants in the meeting, are used to define other soft clusters that are related with less relevance to the handwritten notes.
In another example Use Case 2 embodiment, the notes application works with a location sensor, such as a GPS sensor or WNIC 40 that identifies network locations, to tie handwritten notes to a location. For instance, an end user travels to different locations to hold meetings. At a location when the note application opens and detects the location, the end user is prompted to inquire if notes for the location should be related to a topic named for the location. If the end user selects location association and takes notes, the notes are clustered with the location, such as under a topic named for the location. The other information for the content may be applied to soft cluster with other handwritten notes.
In another example Use Case 3 embodiment, the notes application tracks content over time to relate handwritten notes by a cluster with a topic title. For instance, an end user has several projects at work and includes a title on the notes with project name. The notes application picks up the commonality in the title name and inquires if all notes for the title should be kept as a project. If the end user selects yes, the notes are organized in a common folder using the title and associated by soft clusters with other notes as appropriate.
In another example Use Case 4 embodiment, the notes application tracks notes based upon collaboration with other end users at the time the notes are taken. For instance, an end user works closely with two other individuals on several projects and shares notes during collaboration. The notes application detects the presence of the two other individuals during notetaking, such as by the exchange of documents or of the notes. The end user is queried whether to relate collaborative notes with the two individuals as a cluster. If the end user selects yes, then previous collaborative notes and future collaborations are stored as a project or file.
In another example Use Case 5 embodiment, the notes application performs an analysis of handwritten notes to provide organization to an end user. After an extended time period of using notes, an end user may have difficulty sorting through the notes to ensure that all of the information is properly saved and accessible. The end user can initiate a cluster analysis that sorts and organizes the handwritten notes to provide a list of topics and files based upon triangulation of meeting titles, recurrence, time of meetings, physical location and collaborators in the meetings, as well as content of the notes analyzed as text and images. The end user may be presented with the handwritten notes with titles applied to soft clusters so that actions on the notes are more readily performed. In one example Use Case 6 embodiment, as an end user takes notes the end user might recall previous related meetings. The end user requests that the notes application find similar handwritten notes resulting in suggestions provided based upon a cluster feature comparison. For instance, the similar notes are based upon a proximity index of the information triangulating from meeting titles, recurrence, time, location, collaborators and content tags of shared vocabulary.
Referring now to
Although the present invention has been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the invention as defined by the appended claims.