This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2016-134402 filed Jul. 6, 2016.
The present invention relates to a data processing apparatus, a system, a data processing method, and a non-transitory computer readable medium.
According to an aspect of the present invention, there is provided a data processing apparatus including: a display controller that displays, on a display, an operation screen for a process performed in a different device connected via a network; a first acquisition unit that acquires an image of the operation screen; a second acquisition unit that acquires plural pieces of information received on the operation screen; and a combining unit that combines an annotation image that represents each of the acquired pieces of information with the image that represents the operation screen.
An exemplary embodiment of the present invention will be described in detail based on the following figures, wherein:
[1] Configuration
In the exemplary embodiment, the storage server 30 stores document files to be used as work manuals when a user works using an operation screen of a coordination system. The document files describe an example of data to be input to the operation screen of the coordination system and an example of operation procedures. In the following description, for the convenience of description, the document files to be used as work manuals are called “know-how documents”.
The know-how documents are distributed to the client device 10 in response to a request or the like from the client device 10. The distributed know-how documents and the know-how documents stored in the storage server 30 are subjected to a synchronization process to be discussed later at a timing determined in advance.
The memory controller 15 stores a history of screen transitions of the operation screen in a memory. The second display controller 16 displays, on the display 18, a page that includes an image whose degree of similarity to the operation screen being displayed on the display 18 meets a condition determined in advance, among plural images of the operation screen included in a document file, when the document file that includes the plural images is opened. A transmitting unit 31 of the storage server 30 transmits a document file, to which an image of the operation screen has been added, to a device to which an identifier corresponding to the document file has been assigned, among other devices connected via a network.
In this example, the functions illustrated in
The electronic document conversion section 105 is a component that performs a process of converting a screenshot of a screen of the coordination system into an electronic document. The electronic document conversion section 105 includes a text extraction section 106, a link destination extraction section 107, a screenshot generation section 108, and an annotation generation section 109. The text extraction section 106 extracts a text input to the operation screen of the coordination system. The link destination extraction section 107 performs a process of extracting a link destination (such as a URL) for the screen of the coordination system. The screenshot generation section 108 generates a screenshot of the operation screen of the coordination system. The annotation generation section 109 generates an annotation on an electronic document. The notification display section 110 has a function of notifying the user, in the case where a know-how document in the work folder 103 has been updated, that the know-how document has been updated through display on the user interface section 156.
A synchronization processing section 301 is a component that performs a synchronization process for a know-how document in accordance with the content of the description in the setting file 303. In the exemplary embodiment, when a request for a synchronization process is received from the client device 10, the synchronization processing section 301 specifies a work folder ID linked to the know-how document as the target of the synchronization process, and transmits the know-how document as the target of the synchronization process to a client device 10 that stores a work folder indicated by the specified work folder ID. A notification processing section 302 is a component that performs a notification process for the work folder 103 as the notification destination described in the setting file 303.
[2] Operation
The user utilizes the coordination system using the client device 10. First, the user performs an operation for starting the document handling system 102 using the user interface section 156. The OS 120 implemented by the CPU 151 starts the document handling system 102 in response to information output from the user interface section 156. The document handling system 102 causes the user interface section 156 to display an operation screen of the document handling system 102. On the operation screen of the document handling system 102, the user first performs an operation for creating a work folder. This operation may be an operation of depressing a “create new work folder” button on the operation screen of the document handling system 102, for example.
[2-1] Operation to Generate Work Folder
In step S103, the document handling system 102 acquires information that indicates the location of storage of the setting file 303 from the storage server 30, and describes the acquired information in the setting file 104 in the work folder 103 to save the acquired information.
In step S104, the document handling system 102 requests the storage server 30 to link the work folder ID of the generated work folder to the coordination system ID of the coordination system which has been started. The storage server 30 links the work folder ID and the coordination system ID to each other in the setting file 303 in accordance with the request from the document handling system 102.
In step S105, the document handling system 102 determines whether or not there is any know-how document ID linked to the coordination system ID. In the case where it is determined that there is no such know-how document ID, the document handling system ends the process. In the case where it is determined that there is any such know-how document ID, on the other hand, the document handling system 102 proceeds to the process in step S106.
In step S106, the document handling system 102 saves the know-how document ID by adding the know-how document ID to the setting file 104 in the work folder 103. In step S107, the document handling system 102 requests the storage server 30 to link the saved know-how document ID and the work folder ID for identification of a work folder in the device itself to each other. The storage server 30 links the know-how document ID and the work folder ID to each other by adding the pair of the know-how document ID and the work folder ID to the setting file 303 in accordance with the request from the client device 10.
[2-2] Operation to Generate Know-how Document
In step S202, the document handling system 102 converts the generated screenshot into an electronic document by generating a know-how document (file) and pasting the screenshot to the know-how document. In step S203, the document handling system 102 acquires an address (such as a URL) corresponding to the system operation screen. In step S204, the document handling system 20 generates a link annotation which is an annotation for jumping to a link destination, and combines the generated link annotation with the screenshot. This link is a URL of the screen of the coordination system, or a command path for opening the screen of the coordination system.
In step S206, the document handling system 102 acquires character strings from an HTML attribute to acquire plural pieces of information received on the system operation screen. Examples of this HTML attribute include the type=“text” attribute of an <input> tag and the attribute of a <textarea> tag. In step S207, the document handling system 102 acquires a position on the system operation screen at which each of the character strings acquired in step S206 has been received for each of the character strings on the basis of the character strings. When the process in step S207 is finished, the document handling system 102 proceeds to the process in step S209.
In the case where the system operation screen is not an HTML document, the document handling system 102 acquires character strings from the electronic document to acquire plural pieces of information received on the system operation screen in step S208. In an example of a method of acquiring character strings, the document handling system 102 may perform a character recognition process on the electronic document to acquire character strings surrounded by a rectangular figure in a shape determined in advance, for example. In another example, the document handling system 102 may acquire character strings in a font size or a font color determined in advance, for example. The document handling system 102 acquires a position on the system operation screen at which each of the acquired pieces of information has been received for each of the pieces of information. When the process in step S208 is finished, the document handling system 102 proceeds to the process in step S209.
In step S209, the document handling system 102 generates a text annotation which is an annotation that indicates the character strings acquired in step S206 or step S208, and pastes the generated text annotation to the electronic document. The text annotation is an example of an annotation image that represents the information acquired in step S206 or step S208. That is, the document handling system 102 performs a process of combining the text annotation which represents each of the acquired pieces of information with the screenshot of the system operation screen. In this event, the document handling system 102 combines the generated text annotation at a position in the screenshot corresponding to the position at which each of the pieces of information has been acquired. In the exemplary embodiment, the document handling system 102 combines the text annotation with the screenshot such that the display position of each of the pieces of information and the display position of the text annotation overlap each other.
In step S303, the document handling system 102 generates a binder for the coordination system corresponding to the know-how document to be processed. In step S305, the document handling system 102 issues a know-how document ID of the know-how document to be processed, and links the issued know-how document ID and the coordination system ID to each other in the setting file 104 in the work folder 103.
In step S306, the document handling system 102 determines whether or not there is any other know-how document that includes a screenshot corresponding to the URL of a screenshot included in the know-how document to be processed, that is, any know-how document with a common URL link. In the case where it is determined that there is any other know-how document, the document handling system 102 proceeds to the process in step S307. In the case where it is determined that there is no other know-how document, on the other hand, the document handling system 102 skips the process in step S307, and proceeds to the process in step S308.
In step S307, the document handling system 102 performs a process of linking plural know-how documents with a common URL link to each other into a single know-how document. That is, in the exemplary embodiment, in the case where there are plural screenshots for one system operation screen, the plural screenshots are compiled into a single know-how document.
In step S308, the document handling system 102 provides the know-how document with information that indicates the date and time of update. In step S309, the document handling system 102 inserts the know-how document into the binder. In step S310, the document handling system 102 requests the storage server 30 to update the date and time of update of the know-how document registered in the setting file 303. The storage server 30 updates the date and time of update of the know-how document in accordance with the request from the client device 10.
[2-2] Operation to Synchronize Know-How Document
In step S405, the document handling system 102 acquires the date and time of update of the know-how document from the setting file in the storage server 30 by making an inquiry of the storage server 30 about the date and time of update of the know-how document. In step S406, the document handling system 102 determines whether or not the acquired date and time of update is later than the date and time of update of the know-how document in the work folder 103 of the device itself. In the case where it is determined that the acquired date and time of update is the later, the document handling system 102 proceeds to the process in step S407. In the case where it is determined that the acquired date and time of update is the earlier, the document handling system 102 skips the process in step S407, and ends the process.
In step S407, the document handling system 102 acquires the know-how document from the storage server 30, and updates the know-how document stored in the work folder 103 using the acquired know-how document.
[2-4] Operation to Display Know-How Document
Next, operation for a case where the know-how document is referenced by the user will be described. When an operation of opening the work folder is performed by the user, the document handling system 102 causes the user interface section 156 to display the operation screen of the document handling system 102, and causes the user interface section 156 to display the know-how document.
The user works with reference to the screenshot of the system operation screen included in the know-how document. A text input to the system operation screen in the previous work is displayed as a text annotation on the displayed screenshot. In order to access the coordination system, it is only necessary for the user to click a URL link (link annotation) of the know-how document. In the exemplary embodiment, in the case where there are plural screenshots for one system operation screen, the plural screenshots are compiled into a single know-how document.
[3] Modifications
The exemplary embodiment discussed above is merely exemplary of the present invention, and may be modified as follows. The exemplary embodiment discussed above and the modifications described below may be implemented in combination as necessary.
(1) In the exemplary embodiment discussed above, the know-how document generation process is performed with the user's operation for generating a know-how document as an impetus. However, the timing to perform the know-how document generation process is not limited thereto. For example, the know-how document generation process or updating process may be performed regularly at each timing determined in advance. Alternatively, the know-how document generation process or updating process may be performed each time the system operation screen is updated because of text input, item selection, a screen transition, or the like on the system operation screen, for example. Alternatively, the know-how document generation process or updating process may be performed each time the system operation screen transitions, for example. Alternatively, the know-how document generation process or updating process may be performed at the timing when the system operation screen is closed, for example.
(2) In the exemplary embodiment discussed above, the know-how document synchronization process (process illustrated in
(3) In the exemplary embodiment discussed above, the document handling system 102 may record the order of transition of the system operation screen, and paste information that indicates the transition destination to the screenshots as an annotation. In this example, the document handling system 102 stores a history of screen transitions of the system operation screen according to an operation by the user when creating a know-how document. The document handling system 102 provides each of the screenshots of the system operation screen with information (e.g. a link annotation) that indicates the system operation screen as the transition destination in accordance with the stored history.
In this case, the screen transition of the system operation screen is reproduced when the know-how document is displayed.
(4) In the exemplary embodiment discussed above, the document handling system 102 may display, on the user interface section 156, a page that includes a screenshot whose degree of similarity to the system operation screen being displayed on the user interface section 156 meets a condition determined in advance, among the plural screenshots included in the know-how document, when the system operation screen is referenced by the user. In this case, the document handling system 102 may select and display a screenshot with the highest degree of similarity, or may select and display a screenshot with the degree of similarity equal to or more than a threshold determined in advance, for example, among the plural screenshots included in the know-how document.
Work related to the coordination system differs in accordance with the division to which the user belongs or the attribute of the user. Therefore, the electronic document desired to be referenced during work differs among users. For example, in an attendance management system, operation days may differ among business institutions, and even the content to be displayed in one operation screen may differ among business institutions. Meanwhile, in a divisional discussion system, for example, the content to be displayed may differ in accordance with the type of the division and the name of the budget. In this aspect, when the system operation screen is referenced by the user, a page of the know-how document that is similar to the system operation screen is displayed.
(5) In the exemplary embodiment discussed above, the document handling system 102 displays the know-how document, together with the operation screen of the document handling system 102, on the user interface section 156 when an operation of opening the work folder is performed by the user. However, the timing to display the know-how document is not limited thereto. For example, the document handling system 102 may display the know-how document on the user interface section 156 in the case where an operation for opening the know-how document is performed by the user. Alternatively, the document handling system 102 may display the know-how document, together with the system operation screen, on the user interface section 156 in the case where an operation for opening the system operation screen is performed.
(6) In the exemplary embodiment discussed above, a service is provided by a single server 20. However, a service may be provided through cooperation of plural servers.
(7) In the exemplary embodiment discussed above, a text annotation or a link annotation is provided as the annotation image which represents information received on the system operation screen. However, the annotation image is not limited thereto. For example, a balloon image, an exclamation mark, or a combination of such an image or a mark and a character string may be used as the annotation image.
(8) In the exemplary embodiment discussed above, the document handling system 102 combines the annotation image which represents information received on the system operation screen at a position in the screenshot at which the information has been acquired. However, the position at which the annotation image is composed is not limited thereto. The annotation image may be composed at a position that is different from the position in the screenshot corresponding to the position at which the information has been acquired on the system operation screen. Alternatively, a balloon image that indicates the position in the screenshot at which the information has been acquired may be composed at a position that is different from the position in the screenshot at which the information has been acquired.
(9) In the exemplary embodiment discussed above, the programs executed by the CPU 151 of the client device 10 and the programs executed by the CPU of the storage server 30 may be downloaded via a communication line such as the Internet. Alternatively, such programs may be provided as stored in a computer-readable storage medium such as a magnetic storage medium (such as a magnetic tape and a magnetic disk), an optical storage medium (such as an optical disc), a magneto-optical storage medium, and a semiconductor memory.
The foregoing description of the exemplary embodiment of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiment was chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2016-134402 | Jul 2016 | JP | national |