Patent Grant
6942312
Not applicable.
Not applicable.
Not applicable.
1. Technical Field
This disclosure relates generally to data packing, data alignment, data tracking, and data retrieval for informative data printed in association with visible images.
2. Description of Related Art
Commercially available still-image digital cameras are now provided with the capability of recording added data, such as audio data, at substantially the same time as the image is made, permitting the photographer to create informative data associated with each image; e.g., subject, time, and place, camera settings, personal notes, and the like. Such audio data may be played back when viewing the images, either on the camera itself, through a dedicated data retrieval device, or simply through the audio system of a separate viewer, such as a television to which the camera is attached by appropriate cabling. Exemplary systems are described by the Kodak company in European Patent Application no. 98204128.7, claiming priority of Dec. 18,1997, U.S. Ser. No. 09/994,000, “Recording audio and electronic images,” and European Patent Application no. 98293451.4, claiming priority of Oct. 28, 1997, U.S. Ser. No. 09/959,041, “Methods and apparatus for visually identifying an area on a photograph or image where digital data is stored;” both incorporated herein by reference. Kodak's systems prefer non-visible ink when printing data other than that of the image itself.
While digital photographic images are readily printed and shared, the added informative data, such as contemporaneously captured audio data, is much more difficult and cumbersome to share. Talking photograph albums are known in the art, but require inserting each photograph of interest, taken at a prior time, into the album and then recording a message for each in a digital audio recording apparatus built into the album. These devices do not permit substantially simultaneous recording of the image data and the added informative data.
The art of ink-jet technology is relatively well developed. Commercial products such as computer printers, graphics plotters, copiers, and facsimile machines employ ink-jet technology for producing hard copy. The basics of this technology are disclosed, for example, in various articles in the Hewlett-Packard Journal, Vol. 36, No. 5 (May 1985), Vol. 39, No. 4 (August 1988), Vol. 39, No. 5 (October 1988), Vol. 43, No. 4 (August 1992), Vol. 43, No. 6 (December 1992) and Vol. 45, No. 1 (February 1994) editions. Ink-jet devices are also described by W. J. Lloyd and H. T. Taub in Output Hardcopy [sic] Devices, chapter 13 (Ed. R. C. Durbeck and S. Sherr, Academic Press, San Diego, 1988). Scanning printhead ink-jet printing apparatus are commercially available. The scanning carriage may carry other sensors used for monitoring various parameters and characteristics related to ink-jet printing functions. For example, Steven Walker, in U.S. Pat. No. 6,036,298, issued Mar. 14, 2000, shows a “Monochromatic Optical Sensing System For Inkjet Printing” (referred to hereinafter as “Walker '298”), assigned to the common assignee hereof and incorporated herein by reference in its entirety, including all related continuation, continuation-in-part, and divisional applications.
There is a need for systems and methods for informative data packing, data alignment, data tracking, and data retrieval.
The basic aspects of the invention generally provides for methods and apparatus related to informative data accompanying printed visual image data.
One aspect is an image printing method including: receiving image data; receiving informative data associated with said image; generating data representative of at least one printable alignment indicator for said informative data; and during a single pass of a single print medium through a printing zone, printing thereon said image data and said informative data with said alignment indicator proximate thereto.
Another aspect is a graphical print including: an image area; and a data area containing data information associated with said image, wherein said data area includes at least one data block and at least one marker formed substantially concurrently therewith and providing alignment registration indicia for reading said data block from said print wherein said indicia are situated and constructed for calculating alignment of said data relative to a predetermined path of a read sensor traversing said data block.
Another aspect is scanning ink-jet print and read apparatus, having a printing zone, the apparatus including: controlling mechanisms for operating a plurality of functions of said apparatus; and connected to said controlling mechanisms, transport mechanisms for moving a printing medium through said printing zone, adjacent to said printing zone, carriage mechanisms for scanning in a first axis across said medium when transported in a second axis substantially perpendicular to said first axis through the printing zone, connected to said carriage mechanisms, encoding mechanisms for tracking position and velocity of said carriage mechanisms during said scanning, fixedly mounted to said carriage mechanisms, printhead mechanisms for printing images and alphanumeric characters on said medium, fixedly mounted to said carriage mechanisms, sensing mechanisms for reading pixels on said medium, and playback mechanisms for rendering digital audio data printed in predetermined ones of said pixels.
Another aspect is a method of aligning a data set to a data reader, the method including: printing a photographic image on a sheet of paper; concurrently to said printing a photographic image, printing on said sheet of paper as said data set, audio data recorded substantially concurrently with making said photographic image; concurrently to said printing audio data, printing alignment indicia proximate the data set wherein said indicia is at least one predetermined character having a geometric association to said data set such that a positional relationship of said data set to a predetermined path of said data reader is defined thereby; when subsequently reading said audio data, from said indicia, calculating offset, skew, or both, characteristics of said data set to said predetermined path; and compensating for said offset, said skew, or both.
Another aspect is a method for aligning a linear audio data track for a subsequent track scanning read head adapted for reading the track printed proximate a substantially contemporaneously recorded and printed graphical image, the method including: aligning an approximate mid-height point of the read head wherein the read head has span greater than a height dimension of said track with an approximate centerline of said track; dithering said read head while traversing a predetermined length said data track and recording any change in vertical location of top-of-track, bottom-of-track, or both; calculating track skew from said change; and adjusting path-of-scan said read head for said skew for said subsequent track scanning read head during a subsequent reading of said track.
Another aspect is a method for aligning a linear audio data track for a subsequent track scanning, linear array detector adapted for reading the track printed proximate a substantially contemporaneously recorded and printed graphical image, the method including: when the detector has a span less than a height dimension of said track, aligning an approximate mid-height point of said detector to a linear edge of said track, or, when the detector has a span greater than a height dimension of said track, aligning an approximate mid-height point of said detector to a centerline of said track; detecting changes of output characteristics of said detector while scanning said track related to one or both linear edges thereof, and calculating track skew from said changes of output characteristics.
Another aspect is a graphical image print including: an image region having a dot matrix array of colored pixels forming a graphical image; an informative data region, wherein digital code is formed as individual pixels wherein an non-printed pixel is representative of a digital one or zero and a colored pixel is representative of a complementary digital zero or digital one, respectively, and wherein combinations of single pixels in a one-dimensional or two-dimensional array for digitally coded audio information; and at least one informative data region alignment marker for aligning a read head to said data region.
Another aspect is a print and read ink-jet apparatus including: mechanisms for printing digital data including data representative of graphical images and at least one field of digital audio data associated with said graphical images, wherein said digital audio data is printed with alignment indicia proximate thereto; and mechanisms for reading and playing said digital audio data and alignment indicia, wherein said alignment indicia is read prior to or in conjunction with said digital audio data for maintaining reading alignment between said mechanisms for reading and playing and said at least one set of digital audio data.
Another aspect is a photographic imaging system, including a digital camera having an audio recording and playback subsystem; and a printer for printing image data and audio data associated with the images recorded using said camera on a sheet medium, wherein said digital audio data is printed on said medium without interfering with visibility of said image data and with alignment indicia data proximate said audio data for maintaining reading alignment thereof and such that said alignment indicia is readable by said digital camera.
The foregoing summary is not intended to be inclusive of all aspects, objects, advantages and features of the present invention nor should any limitation on the scope of the invention be implied therefrom. This Brief Summary is provided in accordance with the mandate of 37 C.F.R. 1.73 and M.P.E.P. 608.01(d) merely to apprise the public, and more especially those interested in the particular art to which the invention relates, of the nature of the invention in order to be of assistance in aiding ready understanding of the patent in future searches.
Like reference designations represent like features throughout the drawings. The drawings in this specification should be understood as not being drawn to scale unless specifically annotated as such.
Ink-jet printing apparatus scanning carriages which carry both ink-jet printheads and associated sensing devices are well-known in the art (see Background section and Walker '298 cited therein).
For convenience in describing the present invention, the ink-jet carriage 03 carrying both printheads 04-07 and a reading sensor 15 is referred to hereinafter as a Print-and-Read carriage, or more simply a “PnR carriage.” An ink-jet apparatus 01 incorporating the present invention is referred to hereinafter as a Print-and-Read apparatus, or “PnR apparatus.” The PnR carriage in accordance with the present invention may carry a specially adapted sensor or, “Read head,” device such as described in assignee's Walker '298 patent, or it may use adapted commercially available discrete sensors. Typical, adaptable sensors and detectors include for example, photodetector mechanisms like the Perkin Elmer model FFD-100 photodiode, model VTT1015 phototransistor, or line-scan imagers such as their P-series linear photodiode array imagers and their L-series CMOS photodiode arrays. In accordance with the present invention, additional functionality are incorporated in the ink-jet class of printers and digital cameras so that they can further operate as informative data recovery, or retrieval, systems for digitized informative data added onto a printed sheet bearing associated, printed, digital data forming graphical images.
Technology for making digital images and storing image data with accompanying additional informative data is known in the art, e.g., a digital camera; no further description is essential to an understanding of the present invention. Data retrieval for showing the stored image and playback of added informative data, such as a contemporaneously stored audio track, via a speaker, is also known in the art, e.g., connecting the camera to an audio-video apparatus; no further description is essential to an understanding of the present invention.
For the purpose of describing exemplary embodiments of the present invention, the visual image data printed by the PnR apparatus is said to be a “photograph;” no limitation on the scope of the invention is intended by the inventors, nor should any be implied therefrom (see also, Background section hereinabove). As the PnR carriage traverses across the width of the photographic paper, one or more blocks of informative data may sequentially printed or, at a later time, retrieved, also referred to as “playback.” The physical region where one linear segment of readable data is recorded will be called a “data track.”
The PnR carriage is known to return to a starting position, e.g., a carriage stop, edge of media or the like, dependent upon whether the printing is unidirectional or bidirectional, getting ready for the next line of data. The paper feed mechanism will advance the photograph to the next line of data. Any transverse return motion for unidirectional printing may occur coincidentally or non-coincidentally with respect to the photographic paper motion. The data track(s) may be printed visibly, such as in a non-image border region of the print medium, or invisibly in a known manner so as not to interfere with the aesthetics of the printed image (see e.g., Kodak patent applications describe in the Background section hereinabove). Additionally, given an appropriate printhead arrangement or a media transport which allows duplexing of media sheets, such data track(s) may be printed on the reverse side of the sheet from the image side. To get a higher data recording density, both the width of data tracks and the track-to-track center spacing (“track pitch density”) should be kept as small as possible. Narrow tracks at high track pitch density will make data recovery more difficult without some type of tracking mechanism. Alignment lines or marks described in accordance with the present invention will keep a Read head, or sensor, on-track during the retrieval process. The Read head may have a very small area of coverage, “field-of-view,” relative to the widths of the data track and the data bits. Thus, for some embodiments it is contemplated that each printed informative data bit may in fact be only single picture element (“pixel), namely, having a one pixel track height; each pixel can be paper white—namely, non-printed—or colored, and therefore represent a digital one or digital zero data bit. It can be recognized as an advantage of the present invention that single pixel data packing is made possible. Track pitch density may be reduced accordingly wherein, if the point detector has a field-of-view of less than one picture element (“pixel”), even adjacent tracks may be separate data tracks. Note that as another advantage of the present invention, invisible inks and the like need not necessarily be employed as current ink-jet printing technology can present ink dot density in excess of 2000 dots-per-inch, i.e., invisible to the naked eye even if a single pixel line of alternating black-and-white dots are printed as informative digital data. Alternatively, a data track height incorporating several pixels or superpixel clusters may be employed.
While it is recognized that the informative data on the photographic print may have been printed on a different PnR apparatus than the one used to recover it, even if using the same PnR apparatus for playback of recorded audio data tracks, it would not be expected that at a high track pitch density such as contemplated by the present invention that the PnR carriage would accurately retrace the data that was laid on the photograph paper previously once it had been already ejected from the printer. In other words, once the photograph is disengaged from the paper feed mechanism, misalignment is likely to happen when the photograph is fed back even into the same printer for an audio playback.
To determine the amount of misalignment so it can be corrected before or during data recovery, in accordance with exemplary embodiments of the present invention one or more of alignment indicators, or indicia, are printed on the photograph in conjunction with the informative data at the same time each data track is being printed. These alignment indicators will give information and act as tools so as to enable the PnR carriage to adjust to offset the skew during informative data recovery.
During informative data reading, while the PnR carriage is at or near the top of the vertical alignment lines and traversing with PnR Carriage Motion A, distance d, is determined as the sensor on the carriage moves across the page in one or more passes, where d, may be for instance the distance in the axis of carriage motion from the edge of the paper, or from the carriage stop, or from any fixed, known, carriage position determined from the encoder subsystem (see FIG. 12 and related description, hereinabove) to a predetermined one of the VAL indicators, e.g., line 203. Depending on the degree of accuracy desired and which may be related to the track pitch density, several determinations may be desirable, e.g., d1 from the paper edge to VAL 203, d1 from the paper edge to VAL 205, et seq. Similarly, after an appropriate paper advance and while scanning PnR Carriage Motion B at or near the bottom end of the VAL indicators 203, 205, 207, 209, distance(s) d2 is measured. The measured difference value(s), d1-d2, is a factor suitable for calculating the degree of skew in the paper feed direction, P. The skew in the paper feed direction in the measurement of the skew angle Θ is then:
Θ=tan−1(d2−d1/Dp), (Equation 1)
where Dp is the separation between the PnR carriage motions A, B in the paper feed directions P as shown in FIG. 2. In most cases, the skew in the PnR carriage direction is close to the skew in the paper feed direction since, by design, the paper feed direction is generally orthogonal to that of the PnR carriage motion. Manufacturing tolerance may case slight deviations from design specifications. Where more than one top of VAL distance, d1, and bottom of VAL distance, d2, is determined, an average, median, or other value may be used for skew determination. Once the skew is determined, a correction factor is calculated in a known manner and coordinated to the PnR carriage scan drive and paper feed as it moves across the page to retrieve the data on each data track of region 201. In other words, if skew is significant enough such that a specific informative data track will be lost to the field-of-view of the sensor as it is scanned across the Data Region 201, compensation is applied to adjust the paper position accordingly as the data is read, namely, reading the data and playing the audio in a seamless manner.
It may be recognized that nominally the PnR carriage motion A, B (x-axis) is perpendicular to the direction of the paper feed P (y-axis). If the actual angle between the direction of the paper feed and the PnR carriage on the printer that first produce the photograph is almost the same as that on the printer that performs data recovery, the above correction might be sufficient to minimize the PnR carriage skew in retrieving the informative data. If the skew correction is not adequate using this embodiment of VAL indicators method because the two angles differ too much, the following methods will overcome this further problem.
Looking to
Note that both VAL indicators 203, 205, 207, 209,
Note that if the data region is outside the visible spectrum, an illumination source (e.g., infrared, ultraviolet or the like) provided in the camera must be turned on to aid the data capture process. The illumination source would render the data region visible to the image sensor in the camera, which would in turn display the recovered image on its liquid crystal display (“LCD”) screen so the user could visualize the prerecorded but otherwise invisible data region.
In order to cover a larger data region to read in more data, and thus allow a longer audio data file, multiple exposures might be necessary. This is because the camera has a finite spatial resolution which must be overcome. The process starts with the user taking successive, overlapping images of the entire data region a section at a time. Once the entire data region has been captured piecemeal, data stitching software in the camera would piece the images together forming a much larger data file. To help the user making overlapping exposures, the data sections are delineated by some type of alignment indicators 1001, “Delineation Markers,” which are again as in previous embodiments laid down at the same time when the photograph is being printed. Note that alternatively, instead of just Markers at the corners, the data sections may be enclosed by delineation borders in which data section information, such as coordinate identification, may also be encoded and embedded, “Encoded Delineation Markers.” In other words, the markers themselves may have functional alignment data or information embedded therein. Such camera-readable section identification may help the data retrieval process. For example, the user does not need to retrieve the data sections in a particular sequential order, though that is a logical task. If for some reason any particular section is not correctly captured, e.g., out-of-focus, the camera could inform the user such data section needs to be re-captured. Besides the section coordinates, information about the data organization, e.g., array partitioning information, may be and preferably is included in the delineation border. “Coordinate Identifiers,” 1003, e.g., A, B, 1, 2, matrix designations, on the periphery of the macro data region made up of the annotated “Data Sections” would further help the user to keep track of and identify what data section to image and in what logical order. It is also possible to effectively accomplish the same goal of large area block data recovery by a slight variant. Instead of requiring the user to take one or more exposures of the data regions, the camera could be designed in ways that a series of shots will be automatically taken as the camera is moving over the data regions while the shutter is being depressed. In other words, the images are being captured in a motor drive, or stroboscopic, mode.
In accordance with
The fact that the camera is imaging an area at an instant in time, as opposed to sequentially retrieving data a line at a time, could be exploited advantageously in encoding the data. One-dimensional coding goes hand-in-hand with the conventional scanning scheme because it is very difficult and not cost-effective to spatially synchronize several data scans taken over some time interval. On the other hand, in imaging an area the spatial relationship between every pixel and its neighbors is precisely preserved within the limit of the resolution of the camera's optics and the image sensor. The pixels could be grouped in units of a predetermined two dimensional (“2-D”) array in which the data is eventually encoded and decoded. The advantages of a 2-D coding scheme are that it would result in a better SNR, higher data coding density, or both, in addition to the ability to produce a more robust code that is less prone to error. In such prints, because of the larger amount of room that may be taken up by extensive data, it may be preferable to print the informative data, Delineation markers 1001, and Coordinate Identifiers 1003 invisibly and to provide the camera with a mechanism for illuminating as described hereinbefore.
At some later time, whenever it is the user's desire to playback the informative data, the media is inserted, 1107, into the same, or a compatible, PnR apparatus. In accordance with known manner controls and programming of such apparatus, a “Playback Mode” is initiated, 1109.
Optionally (indicated by phantom line connection), if one of the embodiments requiring a centerline approximation is required to pre-position the informative data detector (see
Once appropriate compensation is programed into the PnR apparatus, playback is commenced, 1119. The playback should be seamless as any offset or skew of the informative data relative to the read head will be compensated.
It should also be recognized that since the data is coded digitally, it is possible to multiplex stereophonic signals into a single channel for higher fidelity, multichannel separation playback.
In general, certain options are preferred. Whenever possible, track alignment should be applied to every track as it is being read. The initial determination may be off by a certain amount by the time some distance from the initial tracks is achieved. As each track is scanned, track misalignment information should be collected and applied to the following scans. Moreover, it will be recognized that scanning and capturing all the data tracks, or at least filling the available buffer(s), before playback of audio is advantageous for a continuous, clean sound reproduction.
It should be noted that data retrieval may occur in a bi-directional process. Data format information may be included in a header field at the beginning of the data region, containing any pertinent information other than the audio data itself, such as date/time created, name of creator, whether the data is coded as stereophonic or monophonic, whether the data is bi-directional or uni-directional, data rate, length of the recording in time, length of the data in bytes, and the like.
In a variety of embodiments and implementations, the basic aspects of the present invention relate to a method and apparatus for data packing, including single pixel data bit forms, and playback tracking of informative data associated with graphics images. To maximize the signal-to-noise ratio (SNR) during data recovery, and hence minimize the Read error rate, the Read sensor is kept on-center of each data track throughout the reading process. During the data recovery process, a Print-and-Read ink-jet embodiment carriage mechanism in conjunction with the paper feed mechanism keeps the Read sensor on track center since the misalignment information has already been determined beforehand or in real time for active track servoing.
The foregoing Detailed Description of exemplary and preferred embodiments is presented for purposes of illustration and disclosure in accordance with the requirements of the law. It is not intended to be exhaustive nor to limit the invention to the precise form(s) described, but only to enable others skilled in the art to understand how the invention may be suited for a particular use or implementation. The possibility of modifications and variations will be apparent to practitioners skilled in the art. No limitation is intended by the description of exemplary embodiments which may have included tolerances, feature dimensions, specific operating conditions, engineering specifications, or the like, and which may vary between implementations or with changes to the state of the art, and no limitation should be implied therefrom. It will be recognized by those skilled in the art that this technology may also be employed in other graphics computing, e.g., digital art images wherein the computer artist similarly records associated non-visual information while creating a particular image. Applicant has made this disclosure with respect to the current state of the art, but also contemplates advancements during the term of the patent, and that adaptations in the future may take into consideration those advancements, in other word adaptations in accordance with the then current state of the art. It is intended that the scope of the invention be defined by the Claims as written and equivalents as applicable. Reference to a claim element in the singular is not intended to mean “one and only one” unless explicitly so stated. Moreover, no element, component, nor method or process step in this disclosure is intended to be dedicated to the public regardless of whether the element, component, or step is explicitly recited in the Claims. No claim element herein is to be construed under the provisions of 35 U.S.C. Sec. 112, sixth paragraph, unless the element is expressly recited using the phrase “means for . . . ” and no method or process step herein is to be construed under those provisions unless the step, or steps, are expressly recited using the phrase “comprising the step(s) of . . . .”
| Number | Name | Date | Kind |
|---|---|---|---|
| 3678220 | Luhrs | Jul 1972 | A |
| 5521663 | Norris, III | May 1996 | A |
| 5757468 | Patton et al. | May 1998 | A |
| 5917671 | Kaaden et al. | Jun 1999 | A |
| 6036298 | Walker | Mar 2000 | A |
| 6430008 | Trabert et al. | Aug 2002 | B1 |
| 6647369 | Silverbrook et al. | Nov 2003 | B1 |
| 20020141750 | Ludtke et al. | Oct 2002 | A1 |
| Number | Date | Country |
|---|---|---|
| 0913989A 2 | May 1999 | EP |
| 0926879A 2 | Jun 1999 | EP |
| 0730953 | Aug 2000 | EP |
| WO0235286A 1 | May 2002 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20050012771 A1 | Jan 2005 | US |
