Patent Application
20150085307
This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-196933, filed on Sep. 24, 2013; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a management system, an image forming device, and a terminal device.
Conventional image forming devices for printing image data of content data use a known technique that stores content data and image data serving as tag data in association with each other, searches the image data stored in association with the content data based on image data of a printed material where the image data are printed, and accesses the content data.
In such a conventional technique, the content data are stored in printing whereas the tag data are stored by a user asynchronously with the printing. This increases load and cost to the user. In addition, this may cause omission of registration and incorrect construction of data to be managed.
Furthermore, such a conventional technique stores content data themselves. This requires an increase in the memory capacity of a storage and thus increases the cost.
An advantage of some aspects of the embodiments is to provide a management system, an image forming device, and a terminal device that can correctly construct data to be managed with a reduced cost.
According to an embodiment, a management system includes a first storage, a first generator, a second generator, a second storage, and a printer. The first storage is configured to store therein content data. The first generator is configured to acquire, the content data and address data where the content data is stored, from the first storage, and generate a drawing command for printing the content data from the content data. The second generator is configured to generate image data of the content data according to the drawing command. The second storage is configured to store therein the address data and tag data based on the image data in association with each other. The printer is configured to generate a printed medium by printing the image data on a medium.
Embodiments will be described in detail with reference to the accompanying drawings.
The first communication path is implemented by a network such as a local area network (LAN) and the Internet. The second communication path is implemented with a network such as a LAN and the Internet, a communication cable such as a universal serial bus (USB) cable and a printer cable, and the like.
The storage device 10 is a device for storing content data, whose examples include a database and cloud. The terminal device 20 is a user terminal to which a printer driver of the image forming device 30 is installed. Examples of the terminal device 20 include a personal computer (PC), a smart phone, and a tablet terminal. The image forming device 30 is a device for forming an image on media such as print paper by printing, whose examples include a multifunction peripheral (MFP). The multifunction peripheral has at least one function of a copying function, a scanning function, and a facsimile function in addition to a printing function.
The storage device 10 includes a first storage 11.
The first storage 11 stores therein content data. It is implemented by a storage device capable of magnetically or electrically storing therein data, such as a hard disk drive (HDD) and a solid state drive (SSD).
The terminal device 20 includes a first generator 21 and a changing unit 23. The first generator 21 and the changing unit 23 are implemented with a processing device such as a central processor (CPU) executing a program, in other words, by software.
The first generator 21 acquires, from the first storage 11, content data and address data where the content data is stored, and generates a drawing command for printing the content data from the acquired content data.
For example, the first generator 21 acquires the address data together with the content data from the first storage 11 according to a printing instruction input by a user through an input device (not illustrated) of the terminal device 20, and generates a drawing command.
If the first storage 11 is a file system, examples of the address data may include a file path of the content data. If the storage device 10 is a server on the web, examples of the address data may include a uniform resource locator (URL) of the content data. The drawing command is written, for example, in a page description language (PDL).
The first generator 21 outputs the generated drawing command and the acquired address data to the image forming device 30.
When acquiring the content data from the first storage 11, the first generator 21 sets a monitoring flag indicating that the content is to be monitored on file properties of the content data stored in the first storage 11.
The changing unit 23 will be described later.
The image forming device 30 includes a second generator 31, a second storage 33, a printer 35, a reader 37, a searching unit 39, and a processor 41.
The second generator 31, the searching unit 39, and the processor 41 are implemented with a processing device such as a CPU executing a program, in other words, by software. The second storage 33 is implemented by a storage device capable of magnetically and electrically storing therein data, such as an HDD and SSD. The printer 35 is implemented by a printing device such as a printer and a plotter. The reader 37 is implemented by a reading device such as a scanner.
The second generator 31 generates image data of the content data according to the drawing command output from the first generator 21. The second generator 31 stores tag data based on the generated image data and the address data output from the first generator 21 in the second storage 33 in association with each other. For example, the second generator 31 stores the tag data and the address data as a record in the second storage 33, and manages the record (the tag data and the address data) as a managed object.
The embodiment discloses tag data as image data; however, that is not limiting. Tag data may be hereinafter called image data.
The printer 35 prints the image data generated by the second generator 31 on a medium, and generates a printed medium.
The changing unit 23 of the terminal device 20 is now described.
The changing unit 23 monitors the content data stored in the first storage 11. For example, the changing unit 23 constantly monitors content data with file properties on which a monitoring flag is set by the first generator 21 among the content data stored in the first storage 11.
If any change occurs on the content data as a monitored object, the changing unit 23 changes the address data, being stored in the second storage 33, of the content data according to the change.
In specific, if the change on the content data is renaming, which changes a name of the content data, or a transfer, which changes the area where the content data is stored in the first storage 11, the changing unit 23 acquires, from the first storage 11, address data where the content data is stored after the renaming or the transfer, and changes (updates) the address data, being stored in the second storage 33, of the content data to the acquired address data.
The changing unit 23 monitors the operation of a user on the content data stored in the first storage 11 as a monitored object. When detecting a renaming or transferring operation, the changing unit 23 acquires address data before the renaming or transferring operation and address data after the renaming or transferring operation from the first storage 11.
The changing unit 23 outputs an address updating command including the address data before the renaming or transferring operation and the address data after the renaming or transferring operation to the second storage 33, and updates address data of the content data as a monitored object, the address data coinciding with the address data before the renaming or transferring operation and stored in the second storage 33, to the address data after the renaming or transferring operation.
If the change on the content data is a deletion of the content data, the changing unit 23 acquires the content data from the first storage 11 before the deletion and changes/replaces address data, being stored in the second storage 33, of the content data to/with the content data.
More specifically, the changing unit 23 monitors the operation of a user on the content data stored in the first storage 11 as a monitored object. When detecting a deleting operation, the changing unit 23 acquires address data before the deleting operation and the content data as a monitored object from the first storage 11.
The changing unit 23 outputs an address replacing command including the address data before the deleting operation and the content data to the second storage 33, and replaces address data of the content data as a monitored object, the address data coinciding with the address data before the deleting operation and stored in the second storage 33, with the content data.
The image forming device 30 is now further described.
The reader 37 electrically reads a printed medium generated by the printer 35 and generates media image data. More specifically, the reader 37 reads a printed medium according to a searching instruction input by a user through an input device (not illustrated) of the image forming device 30, and generates the media image data.
The searching unit 39 searches the second storage 33 for image data (tag data) in which the degree of similarity with query data based on the media image data generated by the reader 37 is equal to or greater than a threshold, and acquires address data associated with the image data (tag data).
The embodiment discloses query data as media image data; however, that is not limiting. Query data may be hereinafter called media image data.
The searching unit 39 extracts a certain image feature point from each of the media image data (query data) and the image data (tag data). In specific, the searching unit 39 extracts an image feature point from each image using algorithms such as the scale-invariant feature transform (SIFT), the speed-up robust features (SURF), and the fast retina keypoint (FREAK).
The searching unit 39 extracts a set of image feature points in which the degree of similarity between them is equal to or greater than a first threshold. Setting the number of sets of the extracted image feature points as the degree of similarity between the images, the searching unit 39 searches image data (tag data) in which the degree of similarity is equal to or greater than a second threshold and the highest.
The processor 41 performs processing based on the address data acquired by the searching unit 39. The processor 41 performs processing based on the address data acquired by the searching unit 39, the media image data (query data) generated by the reader 37, and the image data (tag data) retrieved by the searching unit 39.
The content data may be application data such as document data generated by a document editing program, spreadsheet data generated by a spreadsheet program, and image data generated by an image editing program. The printed medium may be a printed material of the application data. The printed material may be used as a conference material on which a variety of writing such as a memo is written by attendees at the conference.
In this case, the processor 41 extracts additional data in the media image data (specifically, additional data added to the content data) from the media image data based on the image data retrieved by the searching unit 39.
Specifically, the processor 41 evaluates the difference in images between the media image data and the image data, and extracts a certain group of pixels that is not found on the image data but found on the media image data as the additional data. The processor 41 detects the difference in images between both image data by transforming the coordinates of the media image data so that an image feature point on the media image data comes to the same position as the corresponding image feature point on the image data. The homography transformation may be applied for the coordinate transformation.
The processor 41 may store the additional data in the first storage 11 in association with the content data using the address data. This enables management of not only the content data but what is added thereto as a memo.
The processor 41 may acquire the content data from the first storage 11 using the address data, and output the content data and the additional data. Furthermore, the processor 41 may output the content data and the additional data on a display device (not illustrated) or the like of the terminal device 20. This enables a user to recognize what is added as a memo and determine whether any falsification is made.
In another way, the processor 41 may acquire the content data from the first storage 11 using the address data, generate additional content data by adding the additional data to the acquired content data, and store the additional content data in the first storage 11. This also enables management of not only the content data but what is added thereto as a memo.
At this time, version management of the content data is achieved by making the changing unit 23 store address data of the additional content data in a manner of associating the address data with the address data of the content data stored in the first storage 11.
The processor 41 may acquire the content data from the first storage 11 using the address data, generate the additional content data by adding the additional data to the acquired content data, and output the additional content data. The processor 41 may output the additional content data on a display device (not illustrated) or the like of the terminal device 20. This also enables a user to recognize what is added as a memo and determine whether any falsification is made.
The first generator 21 acquires content data and address data from the first storage 11 according to a printing instruction input by a user through an input device (not illustrated) of the terminal device 20 (Step S101), generates a drawing command (Step S103), and outputs the generated drawing command and the acquired address data to the image forming device 30 (Step S105).
The second generator 31 generates image data of the content data according to the drawing command output from the first generator 21 (Step S107), and stores the image data and the address data output from the first generator 21 in the second storage 33 in association with each other (Step S109).
The printer 35 prints the image data generated by the second generator 31 on a medium, and generates a printed medium (Step S111).
According to a searching instruction input by a user through an input device (not illustrated) of the image forming device 30, the reader 37 reads the printed medium and generates media image data (Step S201).
The searching unit 39 searches the second storage 33 for image data in which the degree of similarity with the media image data generated by the reader 37 is equal to or greater than a threshold (Step S203), and acquires address data associated with the image data (Step S205).
The processor 41 performs processing based on the address data acquired by the searching unit 39 (Step S207).
The changing unit 23 monitors the operation of a user on the content data stored in the first storage 11 as a monitored object. When detecting a renaming or transferring operation (Step S301), the changing unit 23 acquires address data before the renaming or transferring operation and address data after the renaming or transferring operation from the first storage 11 (Step S303).
The changing unit 23 thereafter outputs an address changing command (address updating command) including the address data before the renaming or transferring operation and the address data after the renaming or transferring operation to the second storage 33 (Step S305), and changes (updates) address data of the content data as an monitored object, the address data coinciding with the address data before the renaming or transferring operation and stored in the second storage 33, to the address data after the renaming or transferring operation (Step S307).
The changing unit 23 monitors the operation of a user on the content data stored in the first storage 11 as a monitored object. When detecting a deleting operation (Step S401), the changing unit 23 acquires address data before the deleting operation and the content data as a monitored object from the first storage 11 (Step S403).
The changing unit 23 thereafter outputs an address replacing command including the address data before the deleting operation and the content data to the second storage 33 (Step S405), and changes/replaces address data of the content data as a monitored object, the address data coinciding with the address data before the deleting operation and stored in the second storage 33, to/with the content data (Step S407).
The processor 41 extracts an image feature point from each of the media image data (query data) and the image data (tag data) retrieved by the searching unit 39 (Step S501). At this time, it is preferable that the processor 41 extract a larger number of precise image feature points than that extracted by the searching unit 39 so as to keep the image resolution of the media image data (query data) and the image data (tag data) high. The calculation cost for the search of the searching unit 39 can be saved by lowering image resolution of both images to reduce the number of feature points.
The processor 41 associates the respective image feature points extracted from the media image data (query data) and the image data (tag data) with each other, and estimates the transformation matrix for transforming the coordinates of the media image data (query data) with the least square error so that the image feature point on the media image data (query data) comes to the same position as the corresponding image feature point on the image data (tag data). The processor 41 thereafter generates media image data with its coordinates transformed so that the media image data (query data) overlap the image data (tag data) (Step S503).
The processor 41 calculates the difference between the media image data (query data) and the image data (tag data) after the coordinate transformation, and extracts at least one of an added pixel and a deleted pixel, which exist on one data but does not exist on the other (Step S505). At this time, it is preferable that the processor 41 calculate the difference between binary images obtained by binarizing both images so as to be less affected by the difference in the luminance level of both images.
The additional data are extracted in this way. The additional data include an added pixel that exists on the media image data (query data) but does not exist on the image data (tag data) and a deleted pixel that exists on the image data (tag data) but is not found on the media image data (query data). Data with an added pixel and data with a deleted pixel are collectively referred to as additional data. The additional data may include at least coordinate values of the added pixel and the deleted pixel. The embodiment describes an example of extracting an image feature point from the image data (tag data) retrieved by the searching unit 39. In another way, an image feature point extracted in advance from the image data (tag data) may be stored in the second storage 33 and used for an extraction of the additional data.
According to the embodiment, the tag data are stored in printing. It is thus possible to save the cost to a user by reducing load on the user and correctly construct data to be managed. Furthermore, in the embodiment, not content data themselves but address data of the content data are stored. This can reduce required memory capacity, and thus save the cost.
The terminal device 20 of the embodiment only needs to output address data of content data instead of the content data themselves. This results in a reduction in the amount of communication traffic to the image forming device 30, and thus prevents the reduction in the productivity of producing a printed material due to the delay of communication is thus prevented. The amount of communication traffic to the image forming device 30 is further reduced with the increasing number of the terminal devices 20 that perform printing with the image forming device 30. This prevents the reduction in the productivity of producing a printed material due to the delay of communication.
According to the embodiment, when any change (such as renaming, a transfer, and a deletion) occurs on the content data stored in the first storage 11, address data, being stored in the second storage 33, of the content data are changed according to the change. This enables access to the content data after the change.
Modification 1
In the embodiment, a printing instruction input by a user through an input device (not illustrated) of the terminal device 20 may include a first instruction indicating registration or no registration. For example, a registration setting screen 50 as illustrated in
When the first instruction indicates registration, the first generator 21 acquires address data together with content data from the first storage 11, generates a drawing command, and outputs the drawing command and the address data to the image forming device 30. The second storage 33 stores therein tag data based on the drawing command and the address data in association with each other.
When the first instruction indicates no registration, the first generator 21 acquires content data from the first storage 11, generates a drawing command, and outputs the drawing command to the image forming device 30. The second storage 33, however, does not stores therein tag data based on the drawing command or address data.
In this way, a user can select whether to construct data.
Modification 2
In the embodiment, image data and first-letter data of a first letter included in the image data may be used as tag data, and media image data and second-letter data of a second letter included in the media image data may be used as query data.
The first-letter data are extracted with the second generator 31 performing a morphological analysis on a drawing command. The second-letter data are extracted with the searching unit 39 implementing the optical character reader (OCR) processing on the media image data.
A searching instruction input by a user through an input device (not illustrated) of the image forming device 30 may include a second instruction indicating image or letter. For example, an image or letter setting screen 60 as illustrated in
When the second instruction indicates image, the searching unit 39 searches the second storage 33 for image data in which the degree of similarity with the media image data is equal to or greater than a threshold and acquires address data associated with the image data.
When the second instruction indicates letter, the searching unit 39 searches the second storage 33 for the first-letter data in which the degree of similarity with the second-letter data is equal to or greater than a threshold and acquires address data associated with the first-letter data.
In this way, a user can select image or letter by which to search.
Modification 3
If the content data stored in the first storage 11 in the embodiment cannot be edited freely by a user (such as content on the web in which no authority for editing is allowed for a user), the changing unit 23 cannot monitor the content data stored in the first storage 11.
In this case, the changing unit 23 may regularly access the content data with address data stored in the second storage 33. If the content data are inaccessible, the changing unit 23 may output an address invalidation command invalidating the address data to the second storage 33 and invalidate the address data.
Modification 4
The second storage 33 in the embodiment may store therein content data in addition to tag data and address data. This enables access to the content data even if the content data stored in the first storage 11 cannot be edited freely by a user (such as content on the web in which no authority for editing is allowed for a user) and any change (such as renaming, a transfer, and a deletion) occurs on the content data.
Modification 5
The elements included in the management system 1 in the embodiment are replaceable as appropriate. For example, the second storage 33 may be provided outside the image forming device 30 in the manner of a network-attached storage (NAS) or the like. The terminal device 20 may include the reader 37. In this case, the reader 37 is implemented by an imaging device such as a camera. The terminal device 20 may include at least one of the first storage 11, the searching unit 39, and the processor 41. The image forming device 30 may include the changing unit 23.
Modification 6
The image forming device 30, content data, and a printed medium in the embodiment may be a three-dimensional printer, three-dimensional data, and a solid molding, respectively. In this case, the search is performed with tag data as multi-view image data of the solid molding generated in computer graphics and with query data as media image data imaging the solid molding (a printed medium). This enables access to the three-dimensional data based on which the solid molding is fabricated from the media image data imaging the solid molding output by the three-dimensional printer. In this case, it is preferable that the terminal device 20 include the reader 37 and the processor 41.
Hardware Configuration
The program executed by the terminal device 20 of the embodiment and the modifications is embedded and provided in a ROM and the like. In another way, the program executed by the terminal device 20 of the embodiment and the modifications may be stored and provided in a computer-readable memory medium such as a compact disc read only memory (CD-ROM), a compact disc recordable (CD-R), a memory card, a digital versatile disc (DVD), and a flexible disk (FD) as an installable or executable file. Furthermore, the program executed by the terminal device 20 of the embodiment and the modifications may be stored in a computer connected to a network such as the Internet and provided by being downloaded via the network.
The program executed by the terminal device 20 of the embodiment and the modifications has a module configuration to implement the above described units on a computer. As an example of the hardware, the control device 81 reads out the program from the external storage device 83 onto the storage device 82 and executes the program, whereby those units are implemented on a computer.
The program executed by the image forming device 30 of the embodiment and the modifications is embedded and provided in a ROM or the like. In another way, the program executed by the image forming device 30 of the embodiment and the modifications may be stored and provided in a computer-readable memory medium such as a CD-ROM, a CD-R, a memory card, a DVD, and a flexible disc (FD) as an installable or executable file. Furthermore, the program executed by the image forming device 30 of the embodiment and the modifications may be stored in a computer connected to a network such as the Internet and provided by being downloaded via the network.
The program executed by the image forming device 30 of the embodiment and the modifications has a module configuration to implement the above described units on a computer. As an example of the hardware, the control device 91 reads out the program from the external storage device 93 onto the storage device 92 and executes the program, whereby those units are implemented on a computer.
As already described, the embodiment and the modifications achieve correct construction of data to be managed with a saved cost.
The steps in each of the flowcharts of the embodiment may be carried out in a changed order, in a manner that a plurality of steps are simultaneously carried out, or in a different order on every operation without departing from the properties of the steps.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-196933 | Sep 2013 | JP | national |
