Patent Application
20080007762
While the specification concludes with claims particularly pointing out and distinctly claiming the present invention, it is believed the same will be better understood from the following description taken in conjunction with the accompanying drawings in which:
The embodiments set forth in the drawings are illustrative in nature and not intended to be limiting of the invention defined by the claims. Moreover, the individual features of the drawings and the invention will be more fully apparent and understood in view of the detailed description.
Reference will not be made in detail to various embodiments which are illustrated in the accompanying drawings, wherein like numerals indicate similar elements throughout the views.
One embodiment of a hand-held printing apparatus of the present invention is illustrated in
In one exemplary embodiment of the present invention, the hand-held printer 10 comprises an optical encoder sensor. The optical encoder sensor is adapted to measure speed and distance across a page. In one exemplary embodiment, the optical encoder sensor comprises a charge-coupled device (CCD) camera image sensor that compares consecutive frames against one another to determine X and Y movement. CCD camera image sensors are well known to those skilled in the art.
The hand-held printer 10 comprises one or two CCD camera sensors 20 to navigate down the page much like a typical optical mouse. For instance, the image sensor may incorporate a small CCD of 16×16 pixels, one or more lenses and a processing unit to measure X and Y position. In another embodiment, multiple CCDs may be utilized.
In order to satisfactorily print, a handheld printer benefits from a sensor or other device to determine the position of the print element relative to the paper. In one embodiment, this sensor comprises one or more conventional optical sensors such as CD camera sensors.
An exemplary CD image sensor system 100 is illustrated in
The CCD sensors generate individual pixel values for the detected light. Individual pixel values can be downloaded for a particular frame at a particular point in time.
Since the CCD sensor can detect dark and light regions, the pixel data differs dramatically for white paper compared to a dark printed region as shown in corresponding image maps.
Dots on the paper can be measured by observing dark pixels.
In one exemplary embodiment, the sensor comprises an electronic shutter to compensate for brightness differences. This is similar to shutter speed on a conventional camera. The sensor encoder reads average pixel values, and/or maximum pixel values and then attempts to boost or dim the light hitting the sensor accordingly. For example, the shutter can return to a predetermined calibrated level from measuring light/dark regions and grain differences, and then the shutter speed can be optimized for optimal tracking over the surfaces. In one exemplary embodiment, the shutter can be switched within the printed page or just at the beginning of the page.
With one or more CCD image sensor which can detect light versus dark grains versus no grains in print media, the CCD image sensor can be utilized to perform additional print quality features. These additional features can be categorized in three main categories: 1) sensing non-printing elements, 2) sensing pre-printed elements, and 3) sensing print elements. Each of these additional functions will be explained in more detail below.
The type of media for the print out can be very important to know for several reasons which include color tables, ink saturation, dry time, navigation tracking, and print quality. The roughness of the paper will dictate the amount of ink to spray on the paper. Colors can bleed on plain paper using excess ink. However, photo paper uses different color tables than the rest.
In one embodiment of the present invention, the image sensor looks at the paper itself and not any printed features on the paper. Given the fact that the gap between the sensor and paper can be controlled, the media type can be calculated by utilizing the pixel values of the CCD and a predetermined shutter speed.
For instance, glossy paper typically has a higher reflectance value which not only causes the average pixel value to be higher (typically around 50 ADC units), but also results in the difference from pixel to pixel to be diminished.
In one exemplary embodiment, the shutter speed is set to a predetermined calibration level, calibrated either in the factory or during an active calibration routine. At this level, the average pixel value can be directly correlated with a specific media type. For instance, an average pixel level of 20 and 50 correlates to plain and photo paper respectively for a given shutter speed. It might take several different shutter speeds to calculate the appropriate media type in order to cover the possible range of values without reaching saturation points of the sensor. For instance, cardboard may produce a pixel level well below the optimal pixel level and the shutter speed typically needs to change. The combination of shutter speed and average pixel level allows the printer to detect the correct media type.
In another exemplary embodiment, measuring the difference between light and dark regions can help determine the grain level of the media. For instance, the difference between the maximum and minimum pixel values relate to the variability of grain level and held differentiate a low sheen photo paper from a bright white piece of plain paper as the photo paper will have very little variability across the page.
In yet another exemplary embodiment, after the media detection is finished, the shutter speed can be optimized for optimal tracking over the media surface. In other words, the CCD sensor parameters change from the factory presets for media detection to an automatic normal mode. In one exemplary embodiment, the shutter parameters can be switched within the printed page or just at the beginning of the page. Media tests usually work best as static tests where measurements are taken during a fixed short time without moving the printer on the paper. Also, the active calibration can be performed in a similar manner. In this embodiment, the printer would calibrate over some known media strip in the maintenance station.
In one exemplary embodiment of the present invention, the method comprises the steps of: collecting a first pixel map using a predetermined specified medium shutter speed; collecting additional pixel maps, wherein the frame rate is adjusted in small increments to compensate for slight hue shifts from pure white; and collecting additional pixel maps, wherein the shutter speed is ramped up and down until the average pixel value is at optimal range. Note that the shutter speed directly corresponds to the reflectivity of the surface. If the shutter speed is higher than a specified cutoff threshold calibrated from the factory then assume high sheen or photo paper. If the shutter speed is lower than the specified cutoff, then the shutter speed is set to optimal shutter speed and grain variability is examined to verify plain paper vs. rougher paper. The grain variability comes from the standard deviation of pixel values. In most cases, the consistent difference between the maximum and minimum pixel values will suffice and is much easier to calculate.
In one exemplary embodiment, if shutter speed is lower than a lower specified cutoff threshold, then printer logic assumes colored paper and either asks the user about color or tries to detect it. The hue of the paper can change the color tables.
One of the biggest challenges with hand printers from a usability point of view is that the print head is at the center of the large printer body. The top and sides of the printer prevent the user from seeing where the print head is on the page. For instance, when a user prints a signature into a box on a piece of paper, the user must guess where the print head is positioned on the page before they hit the print button. Since the navigation sensor comprises of a CCD, this sensor can actually detect pre-printed elements on the page. In this embodiment of the present invention, pre-printed elements on the page are detected, and the printer uses this information to start printing. The preprinted elements become start triggers for printing.
In one exemplary embodiment, the user starts scanning the page and the image sensor discovers the normal white values of the page. When darker elements are seen, the printer tires to perform matching against a set of predefined patterns to find any pre-printed elements. Illustrative examples of predefined patterns can include a line, a box, an oval and a checkbox. If there is a match, the element is considered a start print target. The distance from the start print target to the print head is calculated, then printing initiates at the correct location.
This embodiment differs from the previous embodiment (media type selection) as it looks at elements on the page while moving. In one particular embodiment, there is one automatic mode to detect printed features that puts no emphasis on position navigation, and a second automatic mode for measuring position that does not take into account printed elements.
In one exemplary embodiment, the method comprises the steps to set up a start of printing trigger/target using pre-printed features on a print media sampling the print media using the one or more optical sensors for a predetermined time to establish a base level for the print media; decreasing the shutter speed of one or more optical sensors, wherein the decreased shutter speed is configured to raise each pixel's signal and raise shadow levels on the print media. Wherein, if the shadows are detected, the signal from the sensor is manipulated to decrease contrast, so that black printed objects are not confused with shadows. Once the proper range is found, it is set constant until start of printing wherein simple pattern matching is performed to detect the target. If any pre-printed objects are found, simple pattern matching is performed to detect the target by looking for black grouped pixels that are under some pixel threshold. The target must also register for a certain amount of movement so printed features are not confused with shadows.
In a further exemplary embodiment, once the target is identified, a position from target to print head is established and the sensor's shutter speed and frame speed is set to automatic mode for optimal navigation control over the surface instead of finding printed features. Position can be lost up to the start of printing since the goal is to find the target that triggers printing. In one exemplary embodiment, the printer switches from target detection mode to navigation mode once the target or print start trigger is found. At the desired location, printing starts. This is based on measuring where the start of printing target is located and knowing the distance between the CCD and print head.
In one exemplary embodiment, if the printer circles around one spot without finding the target, the contrast is increased so the printed areas register as being darker. This helps to correct for unregistered targets.
In an alternative exemplary embodiment, the minimum and maximum pixel values can be utilized to set the shutter speed range. In this embodiment, a majority of the target is crossed while taking measurements. The maximum pixel values will correspond to the target and readjusting the shutter speed will spread the sensitivity range so the target has more edge clarity.
In normal operation, the user will quickly move the printer back and forth across the page. Due to the natural errors with hand movements, the user will not perfectly overlap printed swaths. This leads to either leaving voids in the picture in the case of not overlapping swaths enough, or in the opposite case, the swaths overlap too much, either of which leads to inefficient printing. The position sensor for the hand printer constantly computes a change in position based on surface features. Experimental tests have been shown that this type of encoder has drift where the calculated position can diverge away from the actual position. Therefore position error can grow as the printer transverses the page.
An aspect of the present invention in accordance with some embodiments includes a method to correct drift in print position. One way to correct for a drift in position is to reset measured position based on the previously printed swaths. In one particular embodiment, a CCD position sensor is disposed on either side of a print head in order to measure x,y, and yaw. The CCD sensor can be oriented such that it can detect any printed elements on the page that the print head will travel over. For example, if the sensor is aligned so the top of it is at the same height of the print head, then what ever black was detected in the sensor'page, the algorithm would know where the last swath is located and start printing immediately below it, such that the upper and lower swaths print without a gap between them. Affectively, the algorithm aligns the new swath right against the last swath printed. Having a sensor on each of two sides of a print head allows one sensor to monitor the page before the present swath is printed regardless of the direction of travel. In other words, one sensor examines the previously printed swath and the second sensor determines the placement of the to-be-printed swath.
One exemplary embodiment for aligning print swaths is to perform a vertical position reset when the previous swath is located. There might be some sort of delay so the old swath can only reset position in the middle of the page and not in the margin. Another exemplary embodiment emphasizes aligning adjacent swaths and puts less emphasis on position of the printer. This uses the fact that banding is easier to spot than an overlap shift in the picture. So even if the swaths are not parallel over the page, gaps are minimized.
Another exemplary embodiment of the present invention has a second CCD image sensor that is configured to perform additional functionality, such as monitoring a newly printed swath, verifying that adjacent swaths are aligned correctly, and/or making additional correction factors to the aligning algorithm. For example, if the previously printed swath overlapped the theoretical position of the print head by 3 pels, but the resulting printed swath after a position reset created a void of one pel as detected by the second CCD, then the theoretical position of the print head is shifted to compensate. Overlapping swaths by too much is generally preferable in terms of print quality to gaps or bands between printed swaths. Fortunately, the CCD sensors are adept at detecting the presence of banding.
Yet another exemplary embodiment of the invention involves switching sensor parameters. This embodiment varies from the previous embodiments, as it focuses on post printed objects. In this embodiment, the position sensor parameters are kept static for optimal navigation. When previously printed swaths are not detected, the printer functions normally, so there are no provisions accorded for changing the sensor parameters to detect printed elements.
In one exemplary embodiment, four conditions should be satisfied for optimally detecting a previously printed swath.
First, the previously printed swath should be sufficiently dense to be detectable by the sensor. The coverage of ink droplets on the page should be sufficiently dark that the sensor can differentiate printed swaths from sporadic shadows. If the coverage is not dark enough, the CCD will ignore any detected printed elements, treating them as low density regions that would otherwise confuse the identifying process. Printed elements that are isolated will typically not be used for target acquisition. Small objects and light parts in an image typically do not have sufficient ink on the page to be used in the alignment process.
Second, the previously printed swaths should be located in a predicted location within a predetermined tolerance. In this example, printed elements that are missing from an anticipated location of a previously printed swath are ignored to some degree. Because print elements reset the position, it is not unusual that some print elements can be several pels off of a predicted location. But if the error exceeds a predetermined tolerance, the process assumes an error has occurred, such as, for example, that the sensor is examining an incorrect set of printed elements, and the alignment is not changed.
Third, wet ink drops can appear different than drop ink drops. For instance, wet ink drops may have more shine than drop drops. Also, some wet drops have a different spectrum response than dry dots. With this in mine, detecting a previously printed swath may have to wait until reaching a dry part of the swath. This delay can be set based on experimental findings under different environmental conditions. The delay can be set at the factory.
Fourth, discontinuities should be avoided when resetting position. For instance, resetting position may not be allowed at the beginning or ending of swaths where a change in direction causes navigation errors. Also, the amount the position can change may be rate limited. So if the position is calculated to be 4 pels off, the algorithm would only correct the position by 2 pels, so the shift is not as noticeable.
By resetting the position based on previously printed swaths, the error grows at a smaller rate. Also, even if there is a significant error, the swaths are aligned and the position error does not affect print quality as previously stated.
In one exemplary embodiment, illustrated in
In one particular exemplary embodiment, the steps for detecting and aligning the swath comprise: scanning the page to find previously printed swaths after at least one swath has been printed, wherein if a previously printed swath is detected, analyzing the validity of the swath determination. And wherein if the validity is satisfactory, reset the position based on the discovered previously printed swath. In the case where the printed elements are found then the four conditions above are applied to compute the validity of the swath. If the conditions are passed, then the position is reset based on the discovered printed elements.
Yet another embodiment of the present invention comprises nozzle detection. One of the biggest factors behind print quality includes if the printer is working properly. If nozzles are clogged or the water in the ink evaporates at the nozzles, the printout will be noticeably streaked. Typically, a hand held printer does not perform automatic maintenance in the same way as a normal printer, so the change of nozzles problems is dramatically increased since the user is responsible for maintenance. For example, the user may never perform maintenance and just blame poor print quality on the printer. However, the CCD position sensor can monitor printed elements on the page. If the sensor sees a lack of printed dots on the paper during printing, the printer can alert the user than maintenance needs to be performed. Dot counting and other methods can detect an out of ink condition and therefore streaking after start of life or before the ink is out can be attributed to a lack of maintenance.
One exemplary embodiment of the present invention is to measure coverage of the printing. Due to small window of visibility with the present CCD, only a limited number of nozzles can be observed. Also, due to limitations in a CCD sensor's capacity to accurately detect wet ink, the measurement for success has more to do with percentage covered than which nozzles have fired. In other words, if the paper is only 25% covered where it should be 100%, this would imply that one or more nozzles have dried up or are malfunctioning due to improper maintenance. The printer could then suggest to the user to perform maintenance.
A larger field of view CCD sensor can see more of the printed page and therefore can verify more nozzles. Given a large field of view and the fact that the resolution of the CCD's pixels are smaller than the size of a drop, the printer could actually detect individual fires of each nozzles. Therefore, it can detect which nozzle is firing properly, and how the droplet is forming on the page. In some embodiments, the printer can compute how many adjacent nozzles are not firing which can cause noticeable print defects and alert of the user in such a case. In other embodiments, print head parameters, such as the fire pulse length or pre-fire, can be adjusted to optimize ink firing on a nozzle by nozzle basis.
One potential challenge with detecting newly printed or wet ink is that the ink can reflect the light source like a mirror in small areas. Therefore, the sensor might see a dark spot turn bright for a split second. In order to compensate for this affect, the sensor can either track the same location on the page for several frames or the printer can perform some method of pattern matching. IN the latter case, the sensor looks for groups of pixels and tries to compute the size of the pattern. If the shape is large with a few highlights, then the printer assumes the print head is working properly. If the pattern is small with just dark speckles then the print head needs to be maintained and the printer can send the user a signal for printer maintenance.
In terms of position sensor parameters, there is typically a tradeoff between navigation and detection. The printer must not get lost in terms of position, but also needs to detect dark regions. For this to happen, the sensor needs to increase the contrast on the pixel data going to the navigation unit while at the same time keeping contrast low for pixel data going to pattern tracking. IN one exemplary embodiment, the shutter speed/frame rate are selected based on seeing the printed features not navigation. In other words, operating conditions would be tolerable for navigation so changing the shutter speed to see the printed features must be within tolerable ranges based on surface characteristics of the page and experimental data. In the case where two sensors are utilized, one sensor can look for printed features while the other sensor keeps accurate position, and both can use unique settings optimized for their function. The amount of movement required to take measurements is small, so while position is important, yaw effects can be a lesser focus and only one sensor is needed.
Yet another embodiment of the present invention relates to the function that checks nozzle fires. If printing a nearly fully swath, the sensor can naturally detect the dot coverage on the paper. But in order to maintain proper position and yaw angle, the nozzle check function should be performed during an initial printing step. For instance, the printer might print a full swath for a fraction of inch at the top of each print out in order to start the print head and detect proper firing of the nozzles. For example, the printer can print a dark strip on a piece of paper for maintenance. This would be an optimal time to detect nozzle coverage.
It is known that each individual print head can have slight differences from each other. For instance, given the same first pulse, some print heads will produce dark lines while others may not even fire at all. Also, the print head may not be perfectly aligned in the printer due to mechanical tolerances. For these two reasons, normal printers perform an alignment page which computes the optimal fire pulse and bidirectional (bidi) alignment values to produce good print quality. The hand held printer needs to compute the same parameters but in a different and unique way that utilizes the position sensor.
Similar to the Velocity Optimization (VO) measurement in a normal printer, the hand printer will lay down blocks of dots at different energy levels. The CCD sensor then looks for the block with the proper intensity. The main difference is that the CCD has to recalibrate itself to detect the printed regions of the printout and not change once set until it needs to start a print job in which navigation is more important. The procedure is very similar to nozzle detection, but the sensor can not change characteristics as it is measuring specific levels. Either in the factory or in the maintenance station, the CCD sensor calibrates itself to a known value and stores this for VO detection. When the printer moves over a region of printed elements, it utilizes a known shutter speed, frame rate, and gain. Changing the firing energy of the print head will affect the drop size and velocity. Therefore, the VO measurement through the CCD must be compared to its calibrated state to calculate the optimal value. In one alternative embodiment, if the calibrated state of the CCD is not achievable due to the needs of navigation, appropriate offsets can be applied from experimental data to correlate a fire pulse with the VO measurement.
The same procedure can be preformed for bi-directional (bidi) alignment. However, the printer must see the same type of pattern from two different directions. The navigation system must work well enough to known when the CCD sensor is over the correct printed block and which direction it is traveling. For example, if the printer is traveling from left to right, the left sensor can detect where the drops have landed on the page relative to their fire time. Now the printer changes direction. The right sensor can detect where the ink drops landed in the opposite direction. By knowing the exact distance between the two sensors, the bidi alignment factor can be calculated. The distance between sensors can either be measured experimentally or mechanically controlled. This differs from the normal bidi-alignment procedure where the same block is measured from two different directions.
Furthermore, the hand printer typically does not automatically print an auto-alignment page. Either the user has to print something on a scratch piece of paper or the pattern is hid in the print out like the nozzle detection algorithm. This method does differ from previous methods since, the sensor has to detect edges not patterns. Also the sensor parameters for VO have to be pre-calibrated so the sensor can measure absolute values on the page correlating to different print densities.
The foregoing description of the various embodiments and principles of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many alternatives, modifications and variations will be apparent to those skilled in the art. For example, some of the principles of this invention may be used in different hand-held printer printhead configurations and technology such as piezo-electric printheads, etc. Moreover, although multiple inventive concepts have been presented, such aspects need not be utilized in combination, and various combinations of inventive aspects are possible in light of the various embodiments provided above. Accordingly, the above description is intended to embrace all possible alternatives, modifications, combinations, and variations that have been discussed or suggested herein, as well as all others that fall within the principles, spirit and broad scope of the invention as defined by the claims.
