The present invention is related to Variable Data Printing (VDP) and more particularly to memory optimization techniques that provide single pass raster image processing in the page composition process.
Recent developments in the graphics arts industry has led to the development of Variable Data Printing (VDP) which allows for prints containing personalized data. VDP adds additional performance requirements to a Raster Image Processor (RIP) because the personalized data results in pages that need to be rendered individually.
Variable Data Printing is a modern form of printing that allows highly targeted content and information in an output. VDP combines graphical arts design with information technology to provide the utility to add variable content. Variable content is derived from data in databases that characterize the targeted audience. It is envisioned that the highly customized printed material will enable in the printing industry the success being seen today in Internet one-to-one marketing.
A problem that exists with a variable-data print job is that it will typically take longer to process than a similar, non-variable-data print job. Variable print data conventionally is sent to a Raster Image Processor (RIP) where code for text elements and graphic elements are processed into a format that can be used by the marking engine. Therefore, every page having variable data must have each and every code element RIPped (Raster Image Processed). This presents a substantial processing overhead compared to non-variable-data print jobs where the code for the text elements and graphic elements needed to be RIPped only once.
There is an ongoing desire within the graphic arts community to correct the shortcoming, as discussed above, within the prior art and to enable a faster form of VDP up to final print production and finishing. It is also desirable to use currently practiced methodology within the print engine. The graphic arts community has been in need, until recently, of a method for providing efficient and reliable exchange of variable data digital master data.
A new mark up language for variable data printing based on XML is the Personalized Print Markup Language (PPML) that makes variable-data jobs print faster by allowing a printer to store text elements and graphic elements and re-use them as needed. This eliminates the need to send the same code to the printer/RIP multiple times during the same print job.
PPML is a significant advancement for variable data printing because it allows a printer/RIP to understand at an object level rather than a page level. It allows a printer/RIP to have a certain degree of intelligence and manipulate the components (objects) that make up a page. It also provides code developers the ability to name objects, which permits their re-use as needed during printing of a variable-data job.
A further development that can be used with PPML is a recent standard that has developed called Variable Data Exchange (VDX), which has evolved as a means of producing variable data in the form of a VDX instance. A VDX instance can be looked at as a compilation of records that define the content and layout of many composite pages. These VDX instances can be used with PPML to create composite pages of PPML/VDX instance documents.
VDP adds additional performance requirements to a Raster Image Processor (RIP) because every instance of a document is unique and must be composed individually. In general, documents will contain both recurring elements that may have been prerasterized and also non-recurring elements that must be processed (RIPped) on the fly.
Composition of graphic elements into a sheet surface is traditionally done using a full frame buffer that represents all color separations of the surface. This buffer can become very large for large format, high resolution color images. There are numerous prior art references that deal with memory utilization problems. Prior art reference U.S. Pat. No. 6,134,018 issued to Dziesietnik et al. (Dziesietnik) teaches that variable data can be RIPped more efficiently by RIPping and compressing data simultaneously. Dziesietnik teaches that a system can use less memory (storage) by using compression techniques but the system of Dziesietnik still requires that a frame buffer be used to store the compressed master document. The variable data is then merged with the master document in the frame buffer. While providing some improvements in terms of processing efficiency and memory utilization, Dziesietnik does not provide a significantly efficient method of using recurring objects that obviates the use of a frame buffer.
Another traditional method of utilizing memory involves employing band buffers in a composer and requires all elements to be prerasterized. These elements can be appropriately sorted and placed onto the band buffers. While this method provides the use of memory bands instead of a frame buffer type of memory, the disadvantage of this method is that every element must be prerasterized and subsequently merged onto the band, regardless if the element is recurring or not. This creates an additional processing overhead since even non-recurring elements must first be rasterized into one memory region and subsequently copied into the final band.
Other compositions of graphic elements onto a sheet surface implementations provide simple alternatives by dictating that all objects must be rectangular and allow no overlap of the objects. Another simple version of rendering allows the objects to be layered but does not allow unmarked pixels within the objects, i.e. no pixels within the higher layers may be transparent. In this case the top object can be determined prior to RIPping and the appropriate clip paths may be set for variable objects.
From the foregoing discussion, it should be readily apparent that there remains a need within the art for a method and apparatus that can RIP variable data quickly and efficiently.
The present invention addresses the aforementioned shortcomings within the prior art. Variable Data Printing adds performance requirements to a raster image processor (RIP) because every instance of a document is unique and must be composed individually. The present invention details a method and apparatus of memory optimization that employs memory bands within the page composition process. Documents containing both recurring elements as well as non-recurring elements are sorted into element lists depending on their frequency of recurrence and their layering position. The recurring elements are retained in rasterized form, while the non-recurring elements are rasterized as they are used in output memory.
These and other objects of the invention are provided by a method and apparatus for one pass assembly in raster image processing of elements using a memory element by: forming a plurality of lists from elements within a job file including at least a first list for recurring elements and storing the first list in rasterized form, and at least a second list for variable elements and storing the second list in non-rasterized form; identifying placement within at least one memory area of recurring and variable elements; initializing the least one memory area with stored elements from the first list; and Raster Image Processing (RIPping) the memory area with elements from the second list.
The RIP may run in banded mode, which requires much less memory than a full frame buffer, enabling variable print optimization both on low-end systems and on systems with high output resolution. The majority of recurring elements can be intercepted prior to RIPping the variable page and merged with the variable page in a raster mode. Arbitrary layering of variable and recurring elements is supported.
a-3e are a graphical depiction of the rendering of a page using the present invention.
Variable Data Printing (VDP) adds performance requirements to a raster image processor (RIP) because every instance of a document is unique and must be composed individually. The present invention details a method and apparatus of memory optimization that employs memory bands within the page composition process. In general, documents used in variable data printing will contain both recurring elements that have been previously rasterized as well as non-recurring elements that should be raster image processed (RIPped) on the fly. The present invention sorts elements into lists depending on their frequency of recurrence and their layering position.
Pages of a personalized document employed in variable data printing as envisioned by the present invention are described in a markup context that includes meta-data about the individual elements, such as XML. The meta-data contains information on recurrence frequency, size, position and orientation of the respective element. Element layering is defined by the order of element occurrence in the markup file, i.e., earlier objects are below later objects in the markup file. Therefore, the background of an image is typically the earliest object within the markup file. The individual elements are described in a page description language, i.e., PDF, Adobe Postscript, etc. Accordingly, files that are used within variable data printing to render a page as envisioned by the present invention will contain both meta-data and page description language.
The present invention reads the meta-data within the file and sorts the individual graphic elements that describe a page into different categories.
Still referring to
Within the preferred embodiment of the invention, a fourth list of prerasterized elements that do not have any non-recurring elements layered on top of them is created. The elements within the fourth list, generally referred to herein as List#4 objects 34, are those recurring objects that have variable data objects beneath them. This may contain elements from the List#1 objects 31. The List#1 objects 31 are already rasterized and preferably in the cache. It should be noted, however, that the variable objects beneath the List#4 objects 34 need to be placed into the memory bands before the List#4 objects 34 that are going to be placed on top of them.
Calculate Overlap 21 interprets all the elements within a page in accordance with the meta-data from the markup portion of the document file to calculate the amount of overlap between the elements. Preferably, the overlap is only calculated if the result can potentially influence the list into which that element will potentially be placed. If two objects are both variable (members of List#3) their mutual overlap will not influence the choice of list. The overlap of recurring and variable elements is determined using the clip regions defined in the meta-data of the markup file. These clip regions can be either a bounding rectangle or a more complex outer path. Fill Lists 23 creates List#1 through List#4 according to the meta-data in the markup file and the calculated overlap. Fill Lists 23 will itemize the recurring objects that have variable objects both above and below these objects which are then moved to the list of variable elements. This should happen very rarely in a production scenario with well-designed templates.
Prerasterize 25 performs a program loop over all elements in List#1 and rasterizes them into the recurring element pool within the cache. These elements in List#1 are the recurring elements that have not yet been placed into the rasterized element pool. The recurring List#1 elements that have not been placed in the prerasterized element pool are rasterized and stored in the cache. This step may be completed before the actual print run starts in order to enhance processing speed at the cost of a longer start-up phase. In another implementation, an intelligent raster pool manager may optimize space usage by deleting elements that are no longer required.
Create imposed sheet 27 renders a single sheet that comprises the imposed objects from List#3 as detailed within the page description language used to describe the individual elements in the document file. The variable elements in list 3 are combined into one printable page in the primary page definition language of the RIP, i.e., Postscript/PDF. Placement of the elements is resolved in the context of the PDL using native PDL mechanisms, i.e., transformation matrices. The sheet is rasterized in the same manner as a “normal” sheet.
Rip the sheet 29 takes the imposed sheet as specified from List#3 in banded mode. For each band, this requires the following steps to be performed: The memory band is preset with elements from List#2 and a new band must be initialized. If no elements from List#2 are positioned on a specific pixel, it is set to white, or else the element from List#2 is placed onto the band. It should be understood, that this can be enhanced by various types of hardware such as dedicated processors with embedded firmware, or specifically designed processor, as well as by software alone. The appropriate memory band from List#3 is RIPped from the imposed sheet defined in List #3. The appropriate elements from List #4 are then merged into the memory band.
Dispatch the memory 28 takes the data arranged in the memory band and dispatches it to a print engine. After a band is completely RIPped, the elements from List #4 are copied opaquely onto the band at their respective positions. This may be enhanced by hardware. The band is now finalized and can be dispatched to the engine. In a preferred implementation, multiple bands will exist that can be dispatched and filled in a pipeline or ping-pong mode.
The above steps of Calculate Overlap, Fill all Lists, and Prerasterize can be performed in a pipelined fashion.
An illustration of the page rendering process as envisioned by the present invention is graphically shown in
a illustrates a single page 30 as it is intended to look after it has been rendered. List#1 objects 31 represent the items that will be placed into List#1, as previously stated constitute recurring elements that have not been placed into the cache and still must be prerasterized and stored in the rasterized element pool. List#2 objects 32 represent the items that will be placed into List#2 comprising prerasterized elements that do not have any non-recurring elements layered beneath them. List#2 objects 32 are already stored in the raster pool, which within the preferred embodiment is a cache. List#3a and List#3b objects (33a and 33b) are those elements that need to be raster image processed (RIPped) on the fly either because they are non-recurring elements or they are recurring elements having non-recurring elements both beneath and on top of them, “sandwich faults.” The List#4 objects 34 are those having non-recurring elements layered on top of them, which may contain elements from List#1.
b is an illustration of the two memory bands 41, 42 that are employed by the preferred embodiment of the present invention. The bands as envisioned by the present invention are generic bands as used in any common RIP. The actual number of lines within a band as envisioned by the invention is subject to performance tuning, or hardware considerations and the like. The maximum size of a band is envisioned to be ½ page; otherwise the bands would become a frame buffer. The minimum size of a band is one pixel. Although in practice, the typical size of a band as envisioned by the preferred embodiment of the present invention will be a given amount of data, such as 512 lines of the complete page scan line width. It should be noted that the bands may also be tiles, i.e., that the bands are in no way forced by this invention to span the complete scan line width.
The present invention employs bands 41, 42 as a means of providing an efficient use of memory resources compared with full frame buffers known within the prior art. The use of memory bands is not new to the art of computerized graphics. However, the manner in which the present invention ping-pongs bands 41, 42 is a novel concept that will be discussed below and is a unique form of ping-ponging memory devices that is not suggested by the prior art.
c illustrates the present invention initially interpreting the job file to the Calculate Overlap 21 in the objects that are contained in the job file. The overlap of recurring and variable elements is calculated using the clip regions defined in the meta-data of the markup file. Overlap is only calculated if the result may influence the choice of list for the element.
As envisioned by the present invention, an example of the overlap influencing the choice of a list is in the case of a “sandwich fault”, which is when a recurring object has variable data above and below it. An example of an overlap that will not influence the choice of a list is where a “sandwich fault” must be reripped after it is farther overlapped by additional objects.
Fill Elements List 23, as previously described, uses the results from the Calculate Overlap 21 to complete the four lists as previously defined. The Fill Element List 23 is performed in conjunction with filling the cache 50 and redefining elements in accordance with the results of the Calculate Overlap 21 function. Recurring objects that have been previously defined as List#2 objects 32, may already have been RIPped but have variable objects both above and below them, are then moved to be associated with the List#3b objects 33b and will be treated as variable elements. This should happen very rarely in a production scenario with well-designed templates. Calculated Overlap 21 identifies each junction between overlapping elements and assists in the presetting of the memory bands 41, 42 and filling the memory bands with data.
Prerasterize 25 operates on recurring elements that are not in the rasterized element pool. These recurring elements that have not yet been placed into the prerasterized element pool are therefore, rasterized and stored in the cache 50. This step may be completed before the actual print run starts in order to enhance processing speed at the cost of a longer start-up phase.
An alternative embodiment can, in another implementation, provide an intelligent raster pool manager that performs essentially the opposite function of prerasterize 25 and will optimize space within cache 50 by deleting elements that are no longer required.
Referring to
Still referring to
The band that was being initialized is now ready to have its contents dispatched to memory. The invention envisions using multiple memory bands allowing one band containing RIPped data to be read out to the print engine while another is being prepared as described above. In the preferred embodiment two memory bands 41, 42 are employed in essentially a ping-pong type of architecture. Other implementations using multiple bands will fill the bands in a pipeline type fashion.
The foregoing discussion describes the best mode for practicing the present invention. Variations of the best mode previously described will be readily apparent to those skilled in the art. One of these such variations can be using output tiles instead of output memory bands 41, 42. Additionally, the clip region can be non-rectangular. Also, the recurring elements can be prerasterized in a preset stage and save the processing overhead otherwise required to create List#1. The non-recurring elements in List#3 could be in varied formats, such as TIFF, OPI etc., allowing versatility in the RIP of List #3. As envisioned by the present invention, the software capabilities that the RIP is capable of processing are those that should be employed.
Additional features are envisioned by the present invention. One such additional feature is the use of image masks on the recurring images to allow for transparency. To make an image masks, a method is employed for selectively copying parts of prerasterized data as a mask forming image masks. This may affect performance, so a faster processor, or hardware support, is desirable to make up for the additional processing overhead required to make image masks.
Another feature envisioned is the RIPping of elements from List#1 on distributed computers. As envisioned; this distributed RIPping would be performed on the digital front end. Also, distributed RIPping could be performed on multiple computers or processors.
It is specifically envisioned that the storing of the rasterized version of recurring elements can be done in either a lossy or losslessly compressed mode. The present invention, also, specifically, stores the rasterized version of elements after RIPping and does not make any attempt at RIPping and compressing simultaneously. RIPping the variable data and compressing the variable data with the recurring data simultaneously as taught within U.S. Pat. No. 6,134,018, could potentially be beneficial; however, it is not the preferred method by the present invention. The present invention prefers to RIP completely and compress afterwards.
Allowing for elements in “raster-equivalent graphics” states to be reused, i.e., rotated by 90° or 180°. The system rotates to create the “raster-equivalent graphics” by way of transformation that is applied while copying from the pre-rasterized cache areas to the memory bands.
The present invention envisions pipelining the list processing over multiple CPUs within the RIP. The following processes may be performed independently on consecutive bands.
It is further envisioned by the present invention that hardware enhancements of the presetting and merging process (List#2 and List#4) could be accomplished generally by any hardware that assists in fast setting or moving of memory or that assists in decompression of compressed data such as JPEG.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
4826333 | Tanaka | May 1989 | A |
5104245 | Oguri et al. | Apr 1992 | A |
6049390 | Notredame et al. | Apr 2000 | A |
6064397 | Herregods et al. | May 2000 | A |
6246993 | Dreyer et al. | Jun 2001 | B1 |
6330071 | Vidyanand | Dec 2001 | B1 |
6441919 | Parker et al. | Aug 2002 | B1 |
6446100 | Warmus et al. | Sep 2002 | B1 |
6762855 | Goldberg et al. | Jul 2004 | B1 |
Number | Date | Country | |
---|---|---|---|
20030076535 A1 | Apr 2003 | US |