Patent Application
20110069351
This invention relates to the use of substrates that carry machine-readable data relating to the identification of the substrate, and more particularly to paper substrates that are printed on. However, the invention is applicable for use on substrates other than paper. Whilst reference is made to paper in the specification it is to be understood that the invention is not limited to paper.
Various methods, systems and apparatus relating to the present invention are disclosed in the following patent filed by the applicant or assignee of the present invention:
The disclosures of these patent are incorporated herein by cross-reference.
Systems have been proposed to enable printed substrates to be used interactively, in a manner similar to how computer displays are used interactively. By “interactively”, we mean that the printed substrate includes visible human-readable information which, when “activated” by the user using an appropriate device, causes an action to occur in the system. Systems have been proposed in which pages are printed with machine-readable tags that are not discernable to the unaided eye of a human. These tags are typically printed over the entire surface of each page in a regular pattern. Each tag incorporates information, hereinafter referred to as a page ID, that differentiates each page from other pages and information, and information, hereinafter referred to as a location ID, that differentiates a subarea of the page associated with the tag from other subareas within each page. The association between the machine- and human-readable information is recorded in the system, and the system is thereby able to interpret actions performed relative to the substrate by the user using an appropriate tag-sensing device as actions relative to the human-readable information.
In our earlier application U.S. Ser. No. 09/575,187, we have proposed a printer which prints both the machine- and human-readable information simultaneously and a system that has the ability to print customized versions of documents, for example newspapers, for different customers. When the same printer prints the machine- and human-readable information, it is relatively simple to associate unique page and location Ids with the human-readable data. However, where pages are used with pre-printed or pre-formed tags it is necessary to associate each page with the data printed on a page-by-page basis. Even with mass production there is no certainty that a particular paper sheet will have particular information printed on it or that particular information will be printed on a sheet having a particular page ID or sheets having a particular range of page Ids.
According to an aspect of the present invention there is provided a system comprising:
a printer for printing document information onto at least one surface of a print medium, the print medium including a plurality of tags on respective surfaces of the print medium, each tag on each respective surface encoding an identity unique to the surface;
at least one sensor for sensing the tags of the print medium in a media feed path of the printer; and
a computer system for creating association data associating the document information printed onto the surface of the print medium with the identity of the surface.
Other aspects are also disclosed.
Preferred and other embodiments of the invention will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:
A printer 1010 according to a first embodiment of the invention is shown schematically in
Print mechanisms other than conventional ink deposition type print mechanisms mentioned above may be used. Examples of other types of print mechanisms include a Braille imprinting mechanism or use of thermal paper, such as used in older facsimile machines. In addition the sheets 1012 may be imprinted with electronically active inks and the print mechanism 1016 may be a device for selectively changing the state of the electronically active inks. For a better understanding of electronically active inks, reference is made to U.S. Pat. Nos. 6,017,584, 6,124,851, 6,120,839, 6,120,588, 6,118,426 and 6,067,185, all assigned to E Ink Corporation, the contents of which are included herein by reference. The printer mechanism 1016 prints on both sides of the paper in one pass but printing on a single side per pass is within the scope of the invention.
Each of the paper sheets 1012 is pre-printed or pre-formed with tags 1017 on at least one surface of each of the sheets 1012 with tags 1017 on each surface encoding a common page ID and each encoding a unique (on the surface) location ID. Whilst it is preferred that there is a one-to-one relationship between a page ID and a physical surface, this is not essential. A single surface may have more than one region, each with a different page ID. Similarly a single region having a single page ID may span more than one physically separate distinct surface, such as a number of sheets of paper. Tags at the same location on different surfaces have different page Ids but typically the same location ID. Page Ids are preferably unique to each surface but where not, two or more of the page ID and location Ids may serve to uniquely identify a page, as will be explained later. For a full explanation of tags, coding and physical structure of the tags, see our earlier applications U.S. Ser. No. 09/575,187 U.S. Ser. No. 09/575,154 and U.S. Ser. No. 09/663,701. The tags are preferably printed in a regular pattern on the surface of the sheet. The physical structure of each tag and the layout of the tags are not critical and the tags merely need to be at a sufficiently close spacing for the intended use and the capabilities of a sensing device used by the end user to detect the tags. Examples of suitable tag structures and layouts are found in our earlier applications, PCT specification No. PCT/US98/20597 and U.S. Pat. Nos. 5,625,412, 5,661,506, 5,477,012 and 5,852,434, the contents of which are included herein by reference. Suitable layouts include those in which the tags are centered on the vertices of triangles (regular, irregular, equilateral, isosceles etc), quadrilaterals (square, rectangle, parallelogram, rhombus etc), pentagons, hexagons and any other regular or irregular object having n vertices, where n is selected from 3 to infinity. It is not essential that the tags substantially cover the entire surface, although for convenience it is envisaged that most pre-printed or pre-formed sheets will have tags substantially covering all of both surfaces of each sheet.
Preferably the page and location Ids are merely numbers, but other coding methods may be used, such as use of letters or other symbols rather than numbers. However since computerized systems generally store all information as binary numbers, a simple numbering system is more efficient. The page ID needs to have a sufficient precision for the intended purpose to uniquely identify the page within the scope of the environment within which the page will be used. It is presently believed that a 90-bit binary number will provide a sufficient number of page Ids to enable unique identification of a page on a worldwide basis. However this does not preclude use of greater or smaller precision.
Where the paper will not be used in an interactive manner but the tags are merely used to identify a particular page, the printing of multiple tags over the entire page may be unnecessary. Theoretically, a page could carry a single tag but this leads to potential problems associated with damage of the single tag, the detecting of a single tag or both. To avoid such problems a small area of the page may be printed with tags; for example, a 5-by-5 square of tags could be printed in the corner or corners of the pages as shown in
The printer 1010 includes two sets of sensors 1018 and 1020 arranged such that the paper sheets pass between the two sets of sensors with the sensors positioned to sense any tag information pre-printed or pre-formed on the respective adjacent face of the paper. Each set may consist of a single sensor or two or more sensors arranged across the paper path. Use of two or more sensors provides redundancy. The sensors may be similar to that disclosed in relation to the netpage pen disclosed in our earlier application U.S. Ser. No. 09/575,174. Preferably the pre-printed or pre-formed information is printed using an infrared-absorptive ink and so the sensor may be a charge-coupled device (CCD) or a CMOS image sensor sensitive to infrared light. This may be achieved by using a CCD or CMOS image sensor which is responsive only to infrared light or by providing a filter for a broad-spectrum sensitive CCD or CMOS image sensor. However any suitable image sensor may be used.
The tags need not be sensed using optical methods. For example, the invention includes within its scope the use of magnetic inks for the pre-printing of the tags. It will be appreciated that the sensor sets 1018 and 1020 used need to be appropriate for the type of inks used and if magnetic inks are utilized then the sensors need to be sensitive to magnetism and not electromagnetic radiation. Sensing methods other than magnetic and electromagnetic sensing may be used as desired or required. Other sensing systems include the use of different compounds to encode information, e.g. chemical coding and sensing.
It will be appreciated that the sensors are fixed relative to the paper path and so the process of interpreting the tag images is much simpler compared to a movable sensing device, such as a pen type device. Preferably the sensors are positioned so the tag image is projected onto the image sensor substantially undistorted and corresponding to viewing the tag at 90° to the paper path. If this is not possible then the techniques disclosed in our earlier applications U.S. Ser. No. 09/575,154 and U.S. Ser. No. 09/575,174 for correcting viewing at an angle may be utilized.
Printing or forming tags on both sides and having two sensors means that if visible printing occurs on only one side, the side with visible printing will always have tags on that side irrespective of how the paper is inserted into the printer. If the printer is only capable of printing on one side and the orientation of the paper can be guaranteed, such as by the use of a manufacturer-supplied cartridge of paper, then pre-printing of tags on only one side and having a single sensor will still be feasible.
It is preferable that the page ID for each page is derived from tags on the relevant surface. However, if there is a known relationship between two or more page Ids then deriving the page ID of one page allows one to derive the associated page Ids. For example, a sheet of paper may be encoded with tags on both sides with the page Ids of the two surfaces on a page being 2n and 2n+1 where n is any number. It follows that, knowing the relationship, one may sense either surface and derive the page ID of the other surface. Of course any relationship may be used; examples are 2n−1 & 2n and 2n & 2n+36. Thus in a system where there is always a known and unambiguous relationship between surfaces, a single sensor may be sufficient.
The sensor sets 1018 & 1020 are located upstream of the print mechanism 1016 such that the tag information may be sensed and decoded prior to the paper entering the actual print mechanism 1016. If desired the decoded information may be utilized to determine what is printed on the paper sheets. For example, with a customized newspaper as envisaged in our earlier applications, the layout of the human-readable information depends on the paper size and, if desired, the printer may be capable of printing on different paper sizes. Thus the paper size needs to be determined before the layout of the information to be printed is determined. Of course this is only practical if the print mechanism 1016 is capable of changing what is printed on the fly, such as any print mechanism in which the information printed is dependent on data received. It will be appreciated that where the information or the layout of the information printed is dependent on the page ID there is a relatively small window of opportunity between sensing and printing. If the layout is only dependent on the page ID then it is possible for the document data to be downloaded to the printer in advance with the printer only adjusting the layout in response to the page ID.
The tag information for each surface sensed by the respective sensor set is passed to a decoder 1022 within the printer to determine the page ID. This page ID is passed to a transmitter 1024 which in turn transmits the page ID to a storage device 1026. Since the pages 1012 are cut each page will preferably have tags which all encode a single page ID. Thus it is not important which particular tag on the page is sensed and decoded. However for error checking, the first and last tags on a page may be sensed. The storage device 1026 may be a network server or a local computer which associates the page ID with data 1032 relating to the information printed by the printer 1010. It will be appreciated that the association need not be directly with the information printed. This is particularly so where a single item of information, such as an image, is printed on many different pages. For data storage efficiency a single instance of the image may be stored and the association data merely includes a reference to the image. It will be appreciated that a distributed storage system may be utilized where the association data is stored at a physically different location from the actual document data. Examples include a separate hard drive on the same computer or a separate computer system on another continent.
The storage device 1026 may be a source of print data 1030 which the printer 1010 utilizes to print information onto the sheets 1012. Alternatively another computer may be the source of the print data 1030 and the data 1032 may be transmitted to the storage device for association with the page ID data. It will be appreciated that in the netpage system envisaged in our earlier applications where all devices connected to the network have a unique identifier, a first computer may send print data to a specific printer and then send data to a server relating to both the information printed and the printer to which the data had been sent. The print data 1030 sent to the printer 1010 may be based at least on part of the data 1032. Alternatively the data 1032 may be created separately, such as by manual data entry, particularly where the printer repeatedly prints the same information.
The transmitter 1024 may be connected to the storage device 1026 by wire or wireless means or a combination of both using conventional techniques. Wireless methods include infrared, radio and acoustic transmission. The protocols used for the transmission of the data are unimportant. Examples of suitable protocols include TCP/IP, IPX/SPX, NetBios and NetBEUI. If the printer 1010 is connected to the source of print data via the Internet, the tag information may be transmitted to the storage device 1026 via the Internet. It is preferable to decode some or all of the tag information at the printer so as to reduce the amount of data required to be transmitted. However, the tag information may be transmitted from the sensor to the storage device 1026 in its raw state with all decoding being carried out by the network server. Alternatively the printer may include a decoder which interprets the tag image, extracts the page ID and merely passes the page ID to the network server.
The printer 1010 also includes a paper jam sensor 1028 for detecting paper jams. Many current printers already include such sensors such that when a page is not printed correctly, the data is reprinted on a new page. In the event of a paper jam, the printer may transmit a “void” signal to the network server. Alternatively, when a page is successfully printed the printer may send a “success” signal to the network server. Where the information printed on the paper is not dependent on the page ID, the printer may merely hold the tag information or page ID in a buffer until the page is successfully printed and then transmit the information to the network server after printing. In these circumstances receipt of the coded information or the page ID would, by itself, be an indication of a successful printing of the data. Alternatively the page ID and the “success” signal may be transmitted, either using a single transmission or using two separate transmissions.
The printer may be connected to a local computer that sends print jobs to the printer in addition to or as an alternative to a network server. With suitable software, information relating to local print jobs and page Ids may be transmitted to the network server such that the local print jobs may be used interactively at other locations without the need for the local computer to be turned on or to be connected to the network. The local computer may store information relating to local print jobs and page Ids etc. when offline and transmit such data to the server when next online.
Whilst the use of cut sheets of paper is the preferred method of implementing the invention, the invention includes within its scope use of uncut continuous paper. The use of continuous paper may be commercially necessary for the production of mass-produced items, such as lottery type tickets or merely the provision of an interactive newspaper which is produced and distributed in the current manner. Variations of the netpage printer utilize a roll of continuous paper together with a paper cutter and so such printers may be modified to include one or more sensors to detect pre-printed or pre-formed tags on continuous paper. Other applications which may utilize continuous paper with pre-printed or pre-formed tags include portable printers and cameras which include printers. Examples of these are discussed in our earlier applications U.S. Ser. No. 09/575,146 and U.S. Ser. No. 09/608,920. The devices of U.S. Ser. No. 09/575,146 and U.S. Ser. No. 09/608,920 may be modified to incorporate tag sensors and other hardware to enable derivation and transmittal of identity data or information for association with document data. In the case of a camera, the camera may transmit the image printed to a network server or it may store the association data in itself. The camera may include a user input to enable the user to input information relating to the images, such as a brief description or an audio annotation. This information may also be associated with the identity information.
The use of continuous paper presents problems in that the paper is usually printed and then cut and so the length of pages between print jobs may vary. In addition, if tags are printed over substantially all of a surface there is no certainty that a finished printed page will have tags that all encode the same page ID. In fact, it is extremely unlikely that this would be the case. As such, a single page ID, by itself, is insufficient to identify a page since the same page ID will probably be encoded in tags occurring on two or more pages. However the use of page Ids and location Ids together in a single tag or tag location, as proposed in our earlier applications together provide the ability to identify the finished printed pages.
Assuming that page Ids are pre-printed or pre-formed sequentially and location Ids follow a known sequence between each increment in page ID then recording or deriving the first and last page ID and location ID pairs for each page enables the system to record the extent of each of the printed pages. Thus it is possible to identify or derive the physical location of given any page ID and location ID pair. The physical dimensions on the continuous paper at which page Ids increment need not be fixed for all applications. The continuous paper may be supplied with page Ids incrementing at separations corresponding to A4 or A3 sizes, for example. However, since each page ID and location ID pair is a unique identifier, there is no need to match the location ID repeat dimension with the expected printed page length. If the repeat dimension is known, then a first page ID and location ID, together with a particular page length, are sufficient to determine the page ID and location ID “extent” of the page.
It will be appreciated that for continuous media the page ID and location ID have no significant meaning as separate items and only have significant meaning when combined together. The location Ids need not consist of a series of sequential numbers within the one page ID region. As an alternative, the location Ids may represent an offset in the X and Y dimensions of the surface. As such there may be jumps in the values of the location Ids, for example if the actual page width is less than the page width allowed for in the X dimension of the location Ids.
Located downstream of the print rollers are two sets of tag sensors 1212 & 1214, on either side of the paper. As in the other embodiments each set may be comprised of a single sensor or may be comprised of multiple sensors. The rollers 1208 and 1210 include one or more index points 1216 such that index sensors 1218 may sense the position of the rollers. Where a single index point is provided on each roller, the index sensor 1218 is only capable of sensing when the roller is at only one particular orientation; multiple index points spaced equally around the axis of rotation allow the sensors to determine when the roller is at one of many orientations. Use of a unique index point associated with the start of the page of information to be printed allows the system to associate the page Ids with the printed information.
As discussed above, use of continuous paper means that the start of each page is not known. The physical offset of the tag sensors 1212, 1214 and index sensors 1218 from the point of printing 1220 is known; use of the index point or points 1216 enables the start of each page printed to be known, which together with the known offsets allows the first page ID for the page to be derived. For example, assume the effect of tag sensor position and index sensor position is that the paper moves 10 rows of tags after the index sensor detects the start of the page before that point passes between the sensors. The system may derive the page ID and location ID of the first tag on the page by adding or subtracting the equivalent of 10 rows of tag numbers to the page ID and location ID combination sensed by the tag sensors when the index sensor senses the index point. Alternatively, the system may count 10 rows of tags passing between the tag sensors and then read the tag corresponding to the start of the page. It will be appreciated that with a rotary press, the end of a page immediately precedes the start of the subsequent page and so a single tag sensor reading may be used to delineate the start and ends of adjacent pages.
The printer 601 includes two sensors 950 & 951 which are mounted downstream of the print mechanisms 602 and 603. The two sensors are located such that paper passes between the sensors as it exits the print mechanisms and so that each sensor may sense appropriate tags on the paper. The sensors 950 & 951 are located adjacent the registration line of the printer such that if different width papers are used in the printer the paper will always pass between the sensors. The tags pre-printed or pre-formed on the paper are preferably printed in infrared-absorptive inks that are not visible to the unaided eye of a human. Accordingly the sensors 950 and 951 are optical image sensors sensitive to infrared light. It will be appreciated that sensing at other wavelengths of light may be used as desired or required by the substrate and ink combination. The use of inks that are visible to the aided or unaided human eye is not precluded.
The sensors 950 & 951 detect the page Ids downstream of the two print mechanisms 602 and 603 and pass the information detected to a decoder in the printer controller similar to the decoder utilized in the netpage pen, also discussed in U.S. applications U.S. Ser. No. 09/575,129 and U.S. Ser. No. 09/575,174. It will be appreciated that a separate transmitter is not required to return page Ids to the network server and that the data path used to receive data from the network may be used to return the page Ids to the network server.
The netpage system maintains association data between physical tagged pages and document data in the form of page instances maintained by a page server. For a full description of the netpage system, including the netpage printer and pen, reference is made to earlier U.S. application Ser. No. 09/575,129, U.S. Ser. No. 09/575,155 and U.S. Ser. No. 09/575,174.
In the netpage system, each blank is managed by a page server whose identity is determined from the blank ID 49 in the usual way via the DNS. When the blank is first produced its status is recorded as “not in use”. When graphic content is printed onto the blank, its status is changed to “in use”, and the page ID 50 of the corresponding page is recorded in the blank record maintained by the blank's page server.
A blank may be managed by a page server which is different from the page server which manages the page content printed onto the blank. The page server which manages the page content records the relationship between the page and the blank in a page-blank registration record 939 (in
The displacement and rotation of the page content with respect to the blank's tags need not be recorded if the blank production process guarantees that the tags have a known fixed relationship with the physical sheet. In this case the tag map alone is sufficient. This is only true, of course, if the printer also guarantees registration between the page content and the physical sheet.
When a user interacts with a page printed on a blank, the printer through which the user is interacting first identifies the blank's page server from the blank ID 49, and then, via the blank's page server, obtains the page ID 50 of the page content and thereby identifies the page content's page server. The printer caches the network address of the page content's page server, so that it only needs to communicate with the blank's page server when it first encounters the page.
When tags are printed on demand, a degenerate page-blank relationship can be thought of as existing where the blank ID and the page ID are identical and there is no displacement or rotation of the page content with respect to the tags.
Whilst the invention has been described mainly with reference to conventional paper with the identity data printed on the surface of the paper and the human-readable information being displayed using “ink” on the paper surface, it is to be appreciated that the invention is not limited to these implementations. For example, a single or multi-layered plastics sheet may be used as the substrate. The identity data or the human-readable information or both may be represented on the substrate by modifying the topography of the surface of the substrate. This may be by generating depressions in or protrusions on the general plane of the substrate. The identity data may be located within the body of the substrate rather than on the surface. For example the substrate may be constructed in a similar manner to CDs and DVDs in having one or more internal layers which encode information on or in the internal layer(s). The identity data may also be represented by apertures extending through the substrate.
As mentioned earlier it is possible to utilize substrates with “electronic” ink, in which the printer does not necessarily deposit any ink on the substrate but merely changes the state of elements of the substrate to change the visual appearance of the substrate. It will be appreciated that a printer may be capable of “printing” a substrate using conventional ink deposition type technologies together with non deposition type technologies, such as the electronic ink system or thermal printing.
The printer of the present invention may also be used as an eraser device to render information on a substrate unreadable, either by a user or by a machine, if it has an “erase” mode. When in the “erase” mode, upon insertion of a substrate carrying printed information and identity data, the printer senses the identity data. The system knows what is printed on the substrate due to the existing association of the identity information and the document data. Where the printer is an ink deposition type printer, all areas having no ink may be printed to render the entire surface of the substrate black. Where the substrate carries colored information, the printer may be caused to over-print all of the surface with various colors so the addition of the new ink and the existing ink results in a black image. Since the exact colored dot image of the page is known via the association data and the document information, the printer may be caused to print an exact dot-wise reverse of the current image to effect “erasure”. Alternatively the printer may overprint the entire surface with black ink or meaningless information to render the original information unreadable. A thermal type printer may heat all of the substrate to render the surface black.
Where the substrate carries electronic ink, erasure is merely a matter of switching the state of the elements to a single common state and so effectively removing the print information carried by the sheet.
The printer may have a number of erase modes. In the first mode, the printer may merely render the physical page unreadable whilst leaving the association data and document data on the network. In this case the document is reproducible from the network. In the second mode the system deletes the association data and optionally the document data. In these circumstances the document is not reproducible from the network. Use of the second mode will require authorization to prevent a permanent deletion of a document. In addition the document data may only be deleted if authorized and if there are no other associations with the particular document data. As an example, an image may be shared between multiple physical pages. Deletion of the image on the network system is not possible as this would destroy the effect of the association data for all pages which include the image.
The invention also includes within its scope a shredding device with a sensor for detecting identity data carried by a substrate and a shredding mechanism for physically shredding the actual substrate. On insertion of a sheet into the shredder, the identity data or identity information is derived and passed to the network, thereby enabling the network system to record destruction of the physical substrate, deletion of the association data and deletion of the association data and the document data. As with the printer, the shredder may have various modes.
Physically shredding a multi-page document need not necessarily require feeding of each page into the shredder separately. The system knows, for instance, that a twenty-page document is printed on twenty separate sheets. Sensing the identity data of a single one of those twenty sheets identifies the entire twenty-page document and it may be assumed that the entire twenty pages are being shredded. The twenty sets of association data may be accordingly modified.
Whilst the invention has been described with reference to devices which include a sensor device in a fixed position which automatically sense the identity data as a sheet or sheets passes through the device, it is within the scope of the invention for the devices to include a hand-held and -operated sensing device. Such a sensing device may be connected to the device directly or indirectly by wires or wireless means. In use the user swipes the sheet to be acted on, retrieving the identity information. The netpage pen as described in our earlier applications may be used as the sensing device.
The present invention has been described with reference to a preferred embodiment and number of specific alternative embodiments. However, it will be appreciated by those skilled in the relevant fields that a number of other embodiments, differing from those specifically described, will also fall within the spirit and scope of the present invention. Accordingly, it will be understood that the invention is not intended to be limited to the specific embodiments described in the present specification, including documents incorporated by cross-reference as appropriate. The scope of the invention is only limited by the attached claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| PQ4392 | Dec 1999 | AU | national |
This application is a continuation application of U.S. patent application Ser. No. 12/105,204 filed on Apr. 17, 2008, which is a continuation application of U.S. patent application Ser. No. 09/693,514 filed on Oct. 20, 2000, now issued U.S. Pat. No. 7,369,265, all of which are herein incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12105204 | Apr 2008 | US |
| Child | 12954900 | US | |
| Parent | 09693514 | Oct 2000 | US |
| Child | 12105204 | US |
