This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-063048, filed on Mar. 25, 2013; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to an information display device.
A technology is known in which a plurality of pieces of window information is associated; and, when one piece of window information is closed, an icon of the one piece of window information is displayed in an associated manner to the other pieces of window information.
In such a conventional technology, since the associated information is displayed in the form of an icon, there occurs a decline in the perspicuity of the contents of the associated information.
According to an embodiment, an information display device includes a receiving unit, a processor, a generating unit, an associating unit, and a controller. The receiving unit receives input of a stroke with respect to at least one of either a first document or a second document displayed on a display. The processor analyzes the stroke, at least whether the stroke is an area specifying stroke which specifies an area in the second document or whether the stroke is an association stroke which associates the first document with area in the second document. When the stroke is an area specifying stroke, the generating unit generates area information of the area. When the stroke is an association stroke, the associating unit associates the first document with the area information. Based on an operation, the controller displays, on the display, a list of one or more pieces of the area information that are associated to the first document.
Various embodiments will be described below in detail with reference to the accompanying drawings.
The memory unit 11 is used to store various computer programs executed in the information display device 10 and to store data that is used during various operations performed in the information display device 10. The memory unit 11 can be configured with a memory device capable of magnetically, optically, or electrically storing information. Examples of such a memory device include a hard disk drive (HDD), a solid state drive (SSD), a memory card, an optical disk, a read only memory (ROM), and a random access memory (ROM).
The receiving unit 12, the analyzing unit 13, the generating unit 15, the associating unit 17, and the display control unit 19 can be implemented by executing computer programs in a processor such as a central processing unit (CPU), that is, can be implemented using software; or can be implemented using hardware such as an integrated circuit (IC); or can be implemented using a combination of software and hardware.
The display unit 21 can be implemented using a display device such as a touch-sensitive display or a liquid crystal display.
The receiving unit 12 receives input of strokes with respect to at least either one of a first document and a second document that are being displayed on the display unit 21. More particularly, from an input unit (not illustrated), the receiving unit 12 receives input of strokes with respect to at least either one of the first document and the second document that are being displayed on the display unit 21.
Herein, the input unit can be implemented using an input device such as a touch-sensitive panel, a touch-pad, a mouse, or an electronic pen that enables handwritten input. In the first embodiment, it is assumed that the input unit is a touch-sensitive panel, and that a user inputs strokes by writing a character or a drawing on the touch-sensitive panel by hand using a stylus pen or a finger. However, that is not the only possible case. Alternatively, for example, the input unit can also be implemented using a touch-pad, a mouse, or an electronic pen.
Herein, “stroke” points to a stroke of a character or a drawing that is input in handwriting by the user, and represents data of the locus from the time when a stylus pen or a finger makes contact with the input screen of the touch-sensitive panel until it is lifted from the input screen (i.e., locus from a pen-down action to a pen-up action). A stroke is expressed as time-series coordinate values, such as {(x1, y1), (x2, y2), . . . , (xn, yn)}, of the contact points of the stylus pen or a finger with the input screen. However, the representational form of strokes is not limited to this example.
The receiving unit 12 also receives input of various operations.
The analyzing unit 13 analyzes the strokes received by the receiving unit 12. More particularly, the analyzing unit 13 analyzes whether a stroke received by the receiving unit 12 is an area specification stroke that specifies a particular area in the second document, or is an attachment stroke that attaches information to the particular area in the second document, or is an association stroke that associates the first document and area information.
For example, if the stroke received by the receiving unit 12 forms a closed loop in the second document and has a size equal to or greater than a certain size; then the analyzing unit 13 analyzes that the stroke is an area specification stroke. Moreover, for example, if the second document has a document structure, then the analyzing unit 13 determines whether or not the stroke received by the receiving unit 12 corresponds to an enclosing line or an underline with respect to some part of the document structure. If that stroke corresponds to an enclosing line or an underline with respect to some part of the document structure, then the analyzing unit 13 analyzes that the stroke is an area specification stroke.
The document structure is expressed using bounding rectangles indicating areas including characters, areas including lines, and areas including drawings; and using character codes indicating the meaning of the document structure. Whether the received stroke is an area specification stroke is determined by obtaining the overlapping on the x-axis and the y-axis between the bounding rectangles of the document structure and the bounding rectangle of the received stroke. If there is any overlapping area, then it is determined that the document structure is relevant to the received stroke.
The explanation regarding an area specification stroke is given below in concrete terms. For example, in the case of using an enclosing line or an underline as a stroke; firstly, circular shape determination is performed with the assumption that other strokes represent underlines.
The circular shape determination is performed in the following manner. As illustrated in
dispp<0.31, and ls+dispp>1.51r and ls+dispp<3.01,
Then, the stroke subjected to such area specification is identified in detail compared to the document structures. A detailed document structure points to the smallest unit such as a character or a drawing. For example, it is better if meaningful units are used in a document.
As a result of performing the circular shape determination, if a stroke is determined to be a circular stroke; then the sum of the dimensions of the bounding rectangles of the document structure is obtained. Moreover, the dimension of bounding rectangle of the stroke subjected to area specification is obtained. Then, a predetermined threshold value, such as 75% or more, of the ratio of the dimension (combined value) of the bounding rectangles of the document structure and the dimension of the stroke subjected to area specification is decided, and if the ratio is equal to or greater than the threshold value, a document structure is assumed to be included in the stroke subjected to the area specification. The document structure included in the stroke can be selected as annotation (see
When an area specification stroke is determined to be an underline, it can be analyzed by obtaining the overlapping on the x-axis or the y-axis with the bounding rectangle of the received stroke. If the second document has a document structure, a rectangle that sufficiently overlaps the area of the document structure can be set.
Meanwhile, for example, if one of the ends of the stroke received by the receiving unit 12 specifies the first document and the other end specifies area information of the second document; then the analyzing unit 13 analyzes that the stroke is an association stroke.
Moreover, for example, if the stroke received by the receiving unit 12 is neither an area specification stroke nor an association stroke, then the analyzing unit 13 analyzes that the received stroke is an attachment stroke.
If the stroke received by the receiving unit 12 is an area specification stroke, then the generating unit 15 generates area information of the corresponding area and stores the area information in the memory unit 11. For example, the generating unit 15 generates, as the area information, an ID of the area in the second document which is specified by the area specification stroke, the start point, the width, the area specification stroke, and the like. Then, the generating unit 15 stores the area information in the memory unit 11 in a corresponding manner to page information of the second document.
If the stroke received by the receiving unit 12 is an attachment stroke, then the generating unit 15 generates additional information in a corresponding manner to the area information and stores the additional information in the memory unit 11. For example, the generating unit 15 generates, as the additional information, an attachment stroke, an ID of the attachment stroke, and an ID of area information corresponding to the additional information; and stores the additional information in the memory unit 11 in a corresponding manner to the page information of the second document.
Meanwhile, when the stroke received by the receiving unit 12 is an association stroke, the associating unit 17 associates the first document and the area information. More particularly, if the stroke received by the receiving unit 12 is an association stroke, then the associating unit 17 generates association information that associates an area in the first document with the association information, and stores the association information in the memory unit 11.
For example, as the association information, the associating unit 17 generates information of the link source such as page information of the first document and an ID of the area in the first document, and generates information of the link destination such as page information of the second document and the position (start point) of the area information, and generates an association stroke. Then, the associating unit 17 stores the association information in the memory unit 11 in a corresponding manner to the area information.
When the receiving unit 12 receives a predetermined operation, the display control unit 19 displays on the display unit 21 a list of one or more pieces of area information associated with the first document. More particularly, on the display unit 21, the display control unit 19 displays a list of one or more pieces of area information each of which has the corresponding additional information appended thereto.
Examples of the display form of the area information include displaying the thumbnail of a clipping image of the area corresponding to the area information. Moreover, examples of the display form of the additional information include displaying the stroke corresponding to the additional information without modification, changing the position of the stroke corresponding to the additional information and displaying it in the neighborhood of the clipping image, or displaying the stroke corresponding to the additional information close to the link.
Firstly, when the receiving unit 12 receives a stroke, the analyzing unit 13 analyzes the received stroke (Step S101).
If the analysis result indicates that the received stroke is an association stroke (Yes at Step S103), then the associating unit 17 performs an association operation so as to associate the first document with the area information (Step S105). Then, the display control unit 19 displays a post-association-operation screen on the display unit 21 (Step S113).
If the analysis result indicates that the received stroke is an area specification stroke (No at Step S103, Yes at Step S107); then the generating unit 15 generates area information of the area specified in the area specification information (Step S109). Subsequently, the display control unit 19 displays a post-area-information-generation screen on the display unit 21 (Step S113).
In case the analysis result indicates that the received stroke is neither an association stroke nor an area specification stroke (No at Step S103, No at Step S107), then the received stroke happens to be an attachment stroke. Hence, the generating unit 15 generates additional information in a corresponding manner to the area information (Step S111). Then, the display control unit 19 displays a post-additional information-generation screen on the display unit 21 (Step S113).
Firstly, the analyzing unit 13 checks whether or not the start point and the end point of the stroke received by the receiving unit 12 are present within the document area (Step S201). If the start point and the end point of the received stroke are not present within the document area (No at Step S201), then the analyzing unit 13 analyzes that the received stroke is not an association stroke. That marks the end of the operations.
On the other hand, if the start point and the end point of the received stroke are present within the document area (Yes at Step S201), then it is checked whether or not the start point and the end point are included in different documents (Step S203). If the start point and the end point are included in the same document (No at Step S203), then the analyzing unit 13 analyzes that the received stroke is not an association stroke. That marks the end of the operations.
On the other hand, if the start point and the end point are not included in the same document (Yes at Step S203) and if an area is present in the neighborhood of the start point as well as in the neighborhood of the end point (Yes at Step S205), then the associating unit 17 links the two areas (Step S207).
In contrast, if an area is present in the neighborhood of only the start point (No at Step S205, Yes at Step S209), then the associating unit 17 links the end point to that area (Step S211).
If an area is present in the neighborhood of only the end point (No at Step S205, No at Step S209, Yes at Step S213), then the associating unit links the start point to that area (Step S215).
Firstly, the receiving unit 12 receives input of a list display operation (Step S301).
Once the receiving unit 12 receives a list display operation; the display control unit 19 displays, on the display unit 21, a list of one or more pieces of area information each of which is associated to the first document and has the corresponding additional information appended thereto (Step S303).
In this way, according to the first embodiment, the areas in the second document that are associated to the first document are displayed as a list. That enables achieving enhancement in the perspicuity of the contents of the associated information.
In a second embodiment, the explanation is given about an example in which the area information is divided into groups and the groups are displayed. The following explanation is given with the focus on the differences with the first embodiment. Thus, the constituent elements having identical functions to the first embodiment are referred to by the same names/reference numerals, and the explanation thereof is not repeated.
The similarity degree calculating unit 118 calculates the degrees of similarity between one or more pieces of additional information. For example, the similarity degree calculating unit 118 performs character recognition with respect to the attachment stroke corresponding to each piece of additional information, and calculates the degrees of similarity between the character recognition results.
Moreover, for example, the similarity degree calculating unit 118 calculates the degrees of similarity between the attachment strokes. For example, from an attachment stroke, the similarity degree calculating unit 118 extracts the entire stroke line that is made of K number of strokes having continuous stroke numbers. If the stroke count of an attachment stroke is N and if K is equal to 3, then the similarity degree calculating unit 118 extracts (1, 2, 3), (2, 3, 4), . . . , (N−2, N−1, N) as the stroke line from that combination of N and K. In an identical manner, from a target attachment stroke for comparison too, the similarity degree calculating unit 118 calculates the entire stroke line that is made of K number of strokes having continuous stroke numbers. Then, the similarity degree calculating unit 118 normalizes the positions and the sizes of the stroke lines of both attachment strokes, and calculates the degree of similarity therebetween.
Based on the additional information corresponding to each of one or more pieces of area information, the display control unit 119 divides the one or more pieces of area information into groups (i.e., performs clustering) and displays a list of groups on the display unit 21. More particularly, the display control unit 119 groups such pieces of area information each of which corresponds to the additional information included in a combination having the degree of similarity equal to or greater than a threshold value; and displays a list of the groups on the display unit 21. Examples of the grouping form include a list structure or partial overlapping.
For that reason, as illustrated in
In the neighborhood of the group including the area information of the stroke 131 and the area information of the stroke 135, the display control unit 119 displays the additional information of the stroke 132 (or the stroke 136) that is used for the grouping purpose. Similarly, in the neighborhood of the group including the area information of the stroke 133 and the area information of the stroke 137, the display control unit 119 displays the additional information of the stroke 134 (or the stroke 138) that is used for the grouping purpose.
In the case when a plurality of pieces of additional information is present, then the pieces of additional information that are not used for the grouping purpose can be displayed in the respective pieces of area information as usual. Moreover, if any area information belongs to a plurality of groups, then that area information can either be displayed in all groups or be displayed in the group having the highest degree of similarity.
In this way, according to the second embodiment, the areas in the second document that are associated to the first document are grouped, and the groups are displayed in the form of a list. As a result, it becomes possible to further enhance the perspicuity of the contents of the associated information.
In a third embodiment, the explanation is given about an example in which the area information having a high degree of importance is displayed on priority. The following explanation is given with the focus on the differences with the first embodiment. Thus, the constituent elements having identical functions to the first embodiment are referred to by the same names/reference numerals, and the explanation thereof is not repeated.
The important degree calculating unit 218 calculates, for each piece of area information, the degree of importance based on at least one of the association strokes, the area specification strokes, and the attachment strokes corresponding to that area information. In the case of calculating the degree of importance based on the association strokes; it is possible to make use of the number of association strokes (the association count), the thickness of the association strokes, the writing pressure of the association strokes, the shapes of the association strokes, and the timings of the association strokes. In the case of calculating the degree of importance based on the area specification strokes or based on the attachment strokes; it is possible to make use of the thickness, the writing pressure, the shape, and the additional information contents of the area specification strokes or the attachment strokes.
In the case of making use of the number of association strokes; greater the number, greater can be the degree of importance. In the case of making use of the thicknesses of the strokes; greater the thickness, greater can be the degree of importance. In the case of making use of the writing pressures of the strokes; greater the writing pressure, greater can be the degree of importance. In the case of making use of the colors of the strokes; the degree of importance can be greater for specific colors (such as red). In the case of making use of the shapes of the strokes, greater the complexity in the shape of a stroke, that is longer a stroke; greater can be the degree of importance. In the case of making use of the timings of the strokes; closer the timing to the current timing, greater can be the degree of importance. In the case of making use of the contents of the additional information; greater the frequency of occurrence of the contents, greater can be the degree of importance.
Based on the degrees of importance; the display control unit 219 displays, on the display unit 21, a list of one or more pieces of area information that are associated to the first document. More particularly, on the display unit 21, the display control unit 219 displays, in descending order of the degrees of importance, a list of one or more pieces of area information associated to the first document.
In this way, according to the third embodiment, the areas in the second document that are associated to the first document are displayed in a list according to the degrees of importance. As a result, it becomes possible to further enhance the perspicuity of the contents of the associated information.
In a fourth embodiment, the explanation is given about an example in which the area information and the additional information that are associated to each other are clipped out into another document. The following explanation is given with the focus on the differences with the first embodiment. Thus, the constituent elements having identical functions to the first embodiment are referred to by the same names/reference numerals, and the explanation thereof is not repeated.
The generating unit 315 duplicates, in a third document, one or more pieces of area information and the additional information corresponding to each piece of area information.
Meanwhile, in the third document, it is also possible to duplicate the thumbnail of the first document or to perform grouping as described in the second embodiment.
Hardware Configuration
Meanwhile, the computer programs that are executed in the information display device according to the embodiments described above are recorded in the form of installable or executable files in a computer-readable recording medium such as a compact disk read only memory (CD-ROM), a compact disk readable (CD-R), a memory card, a digital versatile disk (DVD), or a flexible disk (FD).
Alternatively, the computer programs that are executed in the information display device according to the embodiments described above can be saved as downloadable files on a computer connected to the Internet or can be made available for distribution through a network such as the Internet. Still alternatively, the computer programs that are executed in the information display device according to the embodiments described above can be stored in advance in a ROM.
Meanwhile, the computer programs that are executed in the information display device according to the embodiments described above contain a module for each of the abovementioned constituent elements to be implemented in a computer. As the actual hardware, for example, a CPU reads the computer programs from an HDD and runs them such that the computer programs are loaded in a RAM. As a result, the module for each of the abovementioned constituent elements is implemented in the computer.
For example, unless contrary to the nature thereof, the steps of the flowcharts according to the embodiments described above can have a different execution sequence, can be executed in plurality at the same time, or can be executed in a different sequence every time.
As described above, according to the embodiments described above, it is possible to enhance the perspicuity of the contents of the associated information.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2013-063048 | Mar 2013 | JP | national |