Document processing system, document processing method, computer readable medium and data signal

Abstract

A document processing system includes a first acquisition section, a storage section, a second acquisition section and a data processor. The first acquisition section acquires a position specified by a user in an actual document. The storage section stores layout data of the document and content data of the document associated with the layout data. The second acquisition section acquires data in the specified position from the content data of the document stored in the storage section, based on the layout data stored in the storage section and the specified position. The data processor processes the data acquired by the second acquisition section.

Description

BACKGROUND

Technical Field

This invention relates to a document processing system, a document processing method, a computer readable medium and a data signal, and in particular to a user interface, which uses an actual document.

SUMMARY

According to an aspect of the invention, a document processing system includes a first acquisition section, a storage section, a second acquisition section and a data processor. The first acquisition section acquires a position specified by a user in an actual document. The storage section stores layout data of the document and content data of the document associated with the layout data. The second acquisition section acquires data in the specified position from the content data of the document stored in the storage section, based on the layout data stored in the storage section and the specified position. The data processor processes the data acquired by the second acquisition section.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the invention will be described in detail below with reference to accompanying drawings wherein:

FIG. 1 is a drawing to show the general configuration of a document processing system according to an embodiment of the invention;

FIG. 2 is a drawing to show an example of an actual document;

FIG. 3 is a drawing to schematically show the contents of document data and layout data;

FIG. 4 is a drawing to schematically show the storage contents of a document database;

FIG. 5 is a drawing to show how an region identification image is projected onto an actual document; and

FIG. 6 is an operation flowchart of the document processing system.

DETAILED DESCRIPTION

Exemplary embodiments of the invention will be discussed in detail based on the accompanying drawings.

First Exemplary Embodiment

FIG. 1 is a drawing to show the general configuration of a document processing system 10 according to an exemplary embodiment of the invention. As shown in FIG. 1, in the document processing system 10, an actual document 24 on which a document and a pattern 26 are formed is placed on a projection table 20. A projector 18 is installed above the projection table 20 and projects an image concerning a program for document processing, specifically a program window, next to the actual document 24. That is, the actual document 24 is placed in a projection target region 22 of the projector 18, and the program window 28 is projected next to the actual document 24 in the projection target area 22. The projector 18 also projects a cursor image 30 indicating a position currently specified by a user (may be referred to as “user's specifying position”) in the projection target region 22. The user can move the projection position of the cursor image 30 as desired with a pointing device 16 such as a mouse or a touch pad. Also, the user may specify a desired position on the actual document 24 with the cursor image 30, press a button provided in the pointing device 16 at that point, move the cursor image 30 into the region where the program window 28 is projected with keeping pressing the button and release the button. That is, the user may perform a so-called drag and drop operation to thereby pass data in the user's specifying position on the actual document 24 to the program for document processing. Accordingly, the program can use the passed data to perform various types of data processing.

To realize this function, the document processing system 10 includes a computer 12 to which the projector 18 is connected. A camera 14 and the pointing device 16 are also connected to the computer 12.

The computer 12 is connected to a communication network 32 such as the Internet and can perform data communication with a server 34 connected to the communication network 32. Another computer 38 is also connected to the communication network 32 can also perform data communication with the server 34. The computer 38 is a computer for creating document data. The computer 38 includes a printer 40, which prints document data on a print medium such as a sheet of paper to prepare the actual document 24. When creating a document, the computer 38 generates identification information of the document, that is, document ID. The document ID may be a hash value generated based on the document data, for example. The computer 38 assigns to each document, information representing the document ID. Then, the printer 40 prints such information on the actual document 24. In the exemplary embodiment, a one-dimensional or two-dimensional bar code 26 is adopted as the information representing the document ID. The bar code 26 is printed in a corner of the actual document 24 as shown in FIG. 2. The document data generated by the computer 38 contains layout data 44 indicating layout of the document and content data 46 indicating descriptions to be formed at respective positions as shown in FIG. 3A.

When creating the document data, the computer 38 transmits the document data to the server 34 together with the document ID. Upon reception of the document data and the document ID from the computer 38, the server 34 registers them in a document database 36. In this case, the server 34 extracts the layout data 44 contained in the document data from the document data. FIG. 3B schematically shows the extracted layout data 44, which contains data indicating positions of regions where description is made (description regions) in the document. The server 34 stores the document ID, the document data identified by the document ID and the layout data 44 extracted from the document data in the document database 36 in association with each other, as shown in FIG. 4. Accordingly, using the document ID as a key, the document data and the layout data can be read from the document database 36.

When the user gets the actual document 24 printed out by the printer 40, the user captures the bar code 26 formed in the corner of the actual document 24 with the camera 14. The captured image of the bar code 26 is input to the computer 12. Then, the computer 12 generates the document ID represented by the captured image of the bar code 26. The computer 12 transmits the generated document ID to the server 34 through the communication network 32. The server 34 reads the layout data 44, which is associated with the received document ID, from the document database 36, and returns the read layout data 44 to the computer 12.

The computer 12 is configured to project a calibration image (not shown), which specifies a location at which the actual document 24 is to be placed, onto the projection target region 22. The calibration image may include four L-shaped images indicating positions to match the four corners of the actual document 24. The user places the actual document 24 at a predetermined position in the projection table 20 with relying on a position guide of the calibration image. The computer 12 retains data for specifying a region where the actual document 24 thus guided by the position guide is placed, that is, actual-document specifying data. Furthermore, the computer 12 manages the current position of the cursor image 30. The computer 12 a relative position of the current position of the cursor image 30 to the region specified by the actual-document specifying data, to thereby acquire which position in the actual document 24 the user specifies. The computer 12 determines which description region the user specifies, based on the acquired position and the layout data 44 received from the server 34. That is, the computer 12 determines which of one or more description regions specified by the layout data 44 the cursor image 30 is currently located in.

If the cursor image 30 is positioned in any of the description regions, the computer 12 causes the projector 18 to project an image, which identifies the description region (region identification image), onto the actual document 24. At this time, the projection position of the region identification image is adjusted so that description, which corresponds to a region identified by the region identification image and is formed on the actual document 24, is located in the region identified by the region identification image. FIG. 5 shows a state where when the cursor image 30 is projected in the position of one description on the actual document 24, a region identification image 42 identifying the region corresponding to the description is projected onto the actual document 24. Since the region identification image 42, which identifies the description region indicated by the cursor image 30, is projected onto the actual document 24, the user can intuitively grasp which description region a candidate for data processing is.

That is, if the user performs drag-and-drop operation of the pointing device 16 as described above in a state where any of description regions is indicated by the cursor image 30 and the region identification image 42 identifying the description region is projected onto the actual document 24, the already generated document ID is transmitted through the communication network 32 to the server 34 based on data, which specifies the indicated description region (description-region specifying data) and the bar code 26. The server 34 acquires data, which indicates the description in the description region specified by the received description-region specifying data from among the plural pieces of document data stored in the document database 36 in association with the received document ID. Then, the server 34 returns the acquired data to the computer 12. The data is passed as the processing target of the program relating to the program window 28. Thus, a program such as document processing executes data processing using the data received from the server 34.

FIG. 6 is an operation flowchart of the document processing system 10. The processing shown in FIG. 6 is implemented by the following manner. That is, the computer 12 executes a document processing program according to the exemplary embodiment. The program is stored in a computer-readable information storage medium such as a CD-ROM or a DVD-ROM, for example, and is installed in the computer 12 through the information storage medium or is downloaded to the computer 12 from any other computer through the communication network 32.

As shown in FIG. 6, in the document processing system 10, first a bar code 26 printed on an actual document 24 is captured with the camera 14 (S101). Next, the computer 12 generates the document ID from the captured image of the bar code 26 (S102). The computer 12 transmits the document ID thus generated to the server 34, and receives layout data 44 returned from the server 34 (S103). A calibration image is projected onto the projection target region 22 in accordance with the layout data 44. The user is guided so as to place the actual document 24 at a predetermined position of the projection table 20 (S104).

Thereafter, coordinates of the current position of the cursor image 30 are calculated in accordance with an output signal of the pointing device 16 (S105). It is determined whether or not the coordinates of the current position of the cursor image 30 are in any of description regions of the actual document 24 (S106). If the coordinates of the current position of the cursor image 30 are not in any of the description regions, the process returns to S105. On the other hand, if the coordinates of the current position of the cursor image 30 is in any of the description regions, the projector 18 projects a region identification image, which identifies the description region, onto the description region (S107). Further, it is determined whether or not the user clicks the pointing device 16 (S108). If the user does not click the pointing device 16, the process returns to S105. On the other hand, if the user clicks the pointing device 16, the coordinates of the current position of the cursor image 30 at the timing when the clicking is released, that is, when the user releases the button of the pointing device 16 are acquired as coordinates of an end position of the drag-and-drop operation (S109). It is determined whether or not the coordinates of the end position of the drag-and-drop operation are in the program window 28 (S110). If the coordinates of the end position of the drag-and-drop operation are not in the program window 28, the process returns to S105. On the other hand, if the coordinates of the end position of the drag-and-drop operation are in the program window 28, the description-region specifying data, which specifies the description region identified by the projected region identification image, is transmitted to the server 34. Then, the data of the description returned from the server 34 is received (S111). Processing of the received data is started by the program corresponding to the program window 28 (S112).

Various modified embodiments of the invention are possible. For example, when the data of the description determined by the description-region specifying data is read from the document database 36, the server 34 may record the fact in association with the user of the computer 12. In so doing, control of charging the user for acquiring the data of each description, etc., is made possible. As one of service cases utilized as a portal UI in the ubiquitous society, the user may use a multiple function machine installed in a convenience store to purchase the electronic version of any desired one of photos, text, etc., published in magazines and newspapers and transfer it to his or her own mobile machine.

Further, a display for displaying the processing result of the computer 12 on a display screen may be connected to the computer 12, the projector 18 may further project an image indicating the current user's specification position onto the projection target region, and if the specification position is placed out of a predetermined projection area, the window 28 may be displayed on the display screen of the display.

Further, data storage means may store the storage address of the content data in place of the content data and data acquisition means may acquire the data based on the content data from the storage means indicated by the storage address.

Claims

1. A document processing system comprising: a first acquisition section that acquires a position specified by a user in an actual document being derived from an electronic document;a storage section comprising a non-transitory computer readable medium that stores layout data of the electronic document and content data of the electronic document associated with the layout data;a second acquisition section that acquires data in the specified position from the content data of the electronic document stored in the storage section, based on the layout data stored in the storage section and the specified position;a data processor that processes the data acquired by the second acquisition section; anda projector that projects onto a projection target region i) an image concerning a computer program where the actual document is placed, ii) an image indicating the position currently specified by the user, and iii) a region identification image that identifies a region specified by the position currently specified by the user, wherein the data processor processes the data acquired by the second acquisition section in accordance with the computer program based on a drag-and-drop command entered by the user, the drag-and-drop command relating to the image concerning the computer program.

2. The system according to claim 1, wherein the image concerning the computer program is at least one of (i) an image for operation command entry containing a menu relating to an application software, which serves as a computer program, and (ii) an image indicating a region where processing content is displayed.

3. The system according to claim 2, wherein: the region where the processing content is displayed is a window, andthe data processor displays processing result data in the window through the projector.

4. The system according to claim 1, further comprising: a display, wherein;if the specified position is placed out of a predetermined projection region, the data processor displays the processing result on the display screen of the display.

5. The system according to claim 1, further comprising: a logging section, wherein if second acquisition section acquires the data, the logging section logs information concerning the data acquired by the second acquisition section as a history.

6. The system according to claim 1, wherein: the storage section stores a storage address of the content data in place of the content data, andthe second acquisition section acquires the data based on the content data from the storage section indicated by the storage address.

7. The system according to claim 1, wherein: the document includes one or more partial regions each containing content,when the image indicating the position specified by the user is projected onto any of the partial areas, the projector projects the region identification image, which identifies the partial area, onto the projection target region based on the layout data, andthe second acquisition section acquires the data of the content contained in the partial area identified by the region identification image from the content data stored in the storage section.

8. The system according to claim 1, wherein: identification information, which identifies the document, is recorded in the actual document,the system further comprising:a document specifying section that specifies the document based on the identification information recorded in the actual document, wherein:the second acquisition section acquires the data in the position specified by the user from the content data of the specified document based on the layout data of the specified document and the position specified by the user.

9. The system according to claim 1, wherein the layout data of the electronic document includes positional data including coordinates indicating positions of passages of text identified by region identification images where content is made in the electronic document, and the content data includes text contained within the passages.

10. A document processing method comprising: acquiring a position specified by a user in an actual document;acquiring data in the specified position from content data of the document associated with layout data stored in a storage section, based on the layout data of the document stored in the storage section and the specified position;projecting onto a projection target region i) an image concerning a computer program where the actual document is placed, ii) an image indicating the position currently specified by the user, and iii) a region identification image that identifies a region specified by the position currently specified by the user; andprocessing the acquired data in accordance with the computer program based on a drag-and-drop command entered by the user, the drag-and-drop command relating to the image concerning the computer program.

11. The method according to claim 10, wherein the layout data of the electronic document includes positional data including coordinates indicating positions of passages of text identified by region identification images where content is made in the electronic document, and the content data includes text contained within the passages.

12. A non-transitory computer readable medium storing a program causing a computer to execute document processing, the document processing comprising: acquiring a position specified by a user in an actual document being derived from an electronic document;storing layout data of the electronic document and content data of the electronic document associated with the layout data;acquiring data in the specified position from the stored content data of the electronic document based on the stored layout data;projecting onto a projection target region i) an image concerning a computer program where the actual document is placed, ii) an image indicating the position currently specified by the user, and iii) a region identification image that identifies a region specified by the position currently specified by the user; andprocessing the acquired data in accordance with the computer program based on a drag-and-drop command entered by the user, the drag-and-drop command relating to the image concerning the computer program.

13. The non-transitory computer readable medium according to claim 12, wherein the layout data of the electronic document includes positional data including coordinates indicating positions of passages of text identified by region identification images where content is made in the electronic document, and the content data includes text contained within the passages.