This invention relates generally to mail processing systems and equipment used therein.
The U.S. Postal Service (USPS) has developed standards for the marking of mailpieces that facilitate the automatic sorting and processing of such items. Such mailpiece features include stamps, meter marks, information based indicia (IBI) barcodes (PDF417 and Data Matrix), facing identification marks (FIM), Postal Numeric Encoding Technique (POSTNET) codes, postal alphanumeric encoding technique (PLANET) codes, 4CB codes, and identification (ID) tags. The purpose and use of such features are well known in the art and thus will not be described in detail.
Line scan cameras have been implemented in numerous industrial and commercial settings, such as on high-speed mail sorting systems. An example of a prior art mail sorting system that employed such cameras, as well as several other components, is illustrated in
The singulation stage 4 included a feeder pickoff 22 and a fine cull 24. The feeder pickoff 22 would generally follow a mail stacker (not shown) and would attempt to feed one mailpiece at a time from the mail stacker to the fine cull 24, with a consistent gap between mailpieces. The fine cull 24 would remove mailpieces that were too tall, too long, or perhaps too stiff. When mailpieces 19 left the fine cull 24, they would ideally be in one of four possible orientations, as illustrated by mailpieces 19a-d.
Each of the first and second indicia detection stages 6, 10 included a pair of indicia detectors 26a-b, 26c-d positioned to check the lower edges (of approximately one inch) of the opposite faces of a passing mailpiece 19 for reactance to ultraviolet (UV) radiation and for FIM marks, and thereby detect indicia at such locations. As used herein, “indicia” refers to any marking on a mailpiece that represents a postage value. If the first indicia detection stage 6 failed to detect any indicia on either lower edge of a given mailpiece, that mailpiece would be inverted by an inverter 9 at the facing inversion stage 10 so as to allow the second indicia detection stage 10 to check the lower one inch edges of the other side of the mailpiece for indicia. As a result, each mailpiece 19 that had detectable indicia thereon ideally ended up positioned with the edge containing the indicia (the “top edge” of the mailpiece) facing downward after it left the second indicia detection stage 10, with at least one of the indicia detectors 26a-d having identified the face of the mailpiece that contained the indicia.
The cancellation stage 12 included a pair of cancellers 28a-b arranged to spray one side of the top edge of the mailpiece (i.e., the side determined to contain the indicia), and thereby cancel the indicia. Following the cancellation stage 12, each mailpiece would be inverted by an inverter 15 at the inversion stage 14 so that the top edge of the mailpiece was made to face upwards. The ID tag spraying stage 16 included a pair of ID tag sprayers 30a-b arranged to spray an ID tag, as needed, along an appropriate one of the two lower edges of the mailpiece, as determined by the facing decision made by the indicia detection stages 6, 10.
The image lifting stage 18 included a pair of line scanning cameras 32a-b that imaged the mailpiece. Each line scanning camera provided a two hundred and twelve pixel per inch (PPI) image for address recognition. An analysis of the accumulated images facilitated a determination of the one of several output bins 34a-g of the stacking stage 20 into which the mailpieces was to be stacked based on certain criteria.
In one aspect, the invention relates to a method of processing mailpieces. A surface of a mailpiece is illuminated with ultraviolet radiation. Light emanating from the mailpiece in response to the ultraviolet radiation is captured using an array of detectors. An image of the surface of the mailpiece is formed and analyzed to determine whether a feature on the surface of the mailpiece responds to ultraviolet radiation. The image analysis is used to control processing of the mailpiece.
In another aspect, the invention relates to a method of processing mailpieces. A mailpiece is moved past an array of detectors. Portions of a surface of the mailpiece are illuminated with ultraviolet radiation and the array of detectors is used to capture light emanating from the mailpiece in response to the ultraviolet radiation. A two-dimensional image of the surface of the mailpiece is formed using the captured light. The image is analyzed to detect a feature on the surface of the mailpiece that responds to ultraviolet radiation.
In yet a further aspect, the invention relates to a mail processing system that includes an ultraviolet imaging subsystem to form an image of a mailpiece in an imaging area. The ultraviolet imaging subsystem has a source of ultraviolet light directed toward the imaging area. An array of photodetectors is also directed at the imaging area. The subsystem includes an interface adapted to provide an image captured by the array of photodetectors to a data processing system.
We have appreciated that existing mail processing equipment could be improved with improved and differently organized system components. Improvements in the type and organization of components may, for example, increase the speed or accuracy with which mail is sorted. Additionally, improvements may reduce the overall cost and increase the reliability of mail processing equipment.
An illustrative example of a mail processing system embodying improved and differently organized components is shown in
Details concerning the structure and operation of mail processing systems according to some embodiments are provided in Application Ser. No. 60/819,136, entitled MULTIPLE ILLUMINATION SOURCES TO LEVEL SPECTRAL RESPONSE FOR MACHINE VISION CAMERA and bearing attorney docket nos. L0562.70061US00 and Application Ser. No. 60/819,084, entitled SYNCHRONIZATION OF STROBED ILLUMINATION WITH LINE SCANNING OF CAMERA and bearing attorney docket nos. L0562.70064US00. Both of which are filed on even date herewith and are incorporated herein by reference in their entireties.
As shown, mail sorting system 36 of
In operation, each of the camera assemblies 40a-b acquires both a low-resolution UV image and a high-resolution grayscale image of a respective one of the two faces of each passing mailpiece 19. Because the UV images are of the entire face of the mailpiece, rather than just the lower one inch edge, there is no need to invert the mailpiece when making a facing determination.
Each of the camera assemblies illustrated in
Further, it should be appreciated that UV and grayscale are representative of the types of image information that may be acquired rather than a limitation on the invention. For example, a color image may be acquired. As another example, an acquired image may be binarized for processing in some embodiments. In those embodiments, grayscale information need not be collected or retained and each image pixel may be simply represented by a single digital value. Consequently, any suitable imaging components may be included in system 36.
As shown, the system 36 may further include an item presence detector 42, a belt encoder 44, an image server 46, and a machine control computer 48. The item presence detector 42 (examples of an item presence detector are a “photo eye” or a “light barrier”) may be located, for example, five inches upstream of the trail camera assembly 40b, to indicate when a mailpiece is approaching. The belt encoder 44 may output pulses (or “ticks”) at a rate determined by the travel speed of the belt. For example, the belt encoder 44 may output two hundred and fifty six pulses per inch of belt travel. The combination of the item presence detector 42 and belt encoder 44 thus enables a relatively precise determination of the location of each passing mailpiece at any given time. Such location and timing information may be used, for example, to control the strobing of light sources in the camera assemblies 40a-b to ensure optimal performance independent of variations in belt speed.
Image information acquired with the camera assemblies 40a-b or other imaging components may be processed for control of the mail sorting system or for use in routing mailpieces passing through the system 36. Processing may be performed in any suitable way with one or more processors. In the illustrated embodiment, processing is performed by image server 46.
The image server 46 may receive image data from the camera assemblies 40a-b, and process and analyze such data to extract certain information about the orientation of and various markings on each mailpiece. In some embodiments, for example, images may be analyzed using a neural network, a pattern analysis algorithm, or a combination thereof. Either or both of the grayscale images and the UV images may be so processed and analyzed, and the results of such analysis may be used by other components in the system 36, or perhaps by components outside the system, for sorting or any other purpose.
In the embodiment shown, information obtained from processing images is used for control of components in the system 36 by providing that information to a separate processor that controls the system. The information obtained from the images, however, may additionally or alternatively be used in any other suitable way for any of a number of other purposes. In the pictured embodiment, control for the system 36 is provided by a machine control computer 48. Though not expressly shown, the machine control computer 48 may be connected to any or all of the components in the system 36 that may output status information or receive control inputs. The machine control computer 48 may, for example, access information extracted by the image server 46, as well as information from other components in the system, and use such information to control the various system components based thereupon.
Details concerning particular algorithms executed by the image server 46 and other hardware or firmware in the system are provided in application Ser. Nos. 11/482,386, 11/482,418, 11/482,421, 11/482,423, and 11/482,561, filed on even date herewith, respectively entitled DETECTION AND IDENTIFICATION OF POSTAL INDICIA, SYSTEM AN METHOD FOR REAL-TIME DETERMINATION OF THE ORIENTATION OF AN ENVELOPE, ARBITRATION SYSTEM FOR DETERMINING THE ORIENTATION OF AN ENVELOPE FROM A PLURALITY OF CLASSIFIERS, DETECTION AND IDENTIFICATION OF POSTAL METERMARKS, POSTAL INDICIA CATEGORIZATION SYSTEM, and bearing attorney docket nos., LM(F)8227, LM(F)8228, LM(F)8229, LM(F)8230, LM(F)8231. Each of the foregoing applications is incorporated herein by reference in its entirety.
In the example shown, the camera assembly 40a is called the “lead” assembly because it is positioned so that, for mailpieces in an upright orientation, the indicia (in the upper right hand corner) is on the leading edge of the mailpiece 19 with respect to its direction of travel. Likewise, the camera assembly 40b is called the “trail” assembly because it is positioned so that, for mailpieces in an upright orientation, the indicia is on the trailing edge of the mailpiece with respect to its direction of travel. Upright mailpieces themselves are also conventionally labeled as either “lead” or “trail” depending on whether their indicia is on the leading or trailing edge with respect to the direction of travel.
Following the last scan line of the lead camera assembly 40a, the image server 46 may determine an orientation of “flip” or “no-flip” for the inverter 9. In particular, the inverter 9 is controlled so that that each mailpiece 19 has its top edge down when it reaches the cancellation stage 12, thus enabling one of the cancellers 28a-b to spray a cancellation mark on any indicia properly affixed to a mailpiece by spraying only the bottom edge of the path (top edge of the mailpiece). The image server 46 may also make a facing decision that determines which canceller (lead 28a or trail 28b) should be used to spray the cancellation mark. Other information recognized by the image server 46, such as IBI, may also be used, for example, to disable cancellation of IBI postage since IBI would otherwise be illegible downstream.
After cancellation, all mailpieces may be inverted by the inverter 15, thus placing each mailpiece 19 in its upright orientation. Immediately thereafter, an ID tag may be sprayed using one of the ID tag sprayers 30a-b that is selected based on the facing decision made by the image server 46. In some embodiments, all mailpieces with a known orientation may be sprayed with an ID tag. In other embodiments, ID tag spraying may be limited to only those mailpieces without an existing ID tag (forward, return, foreign).
Following application of ID tags, the mailpieces 19 may ride on extended belts for drying before being placed in output bins or otherwise routed for further processing. In the example shown, there are seven output bins 34a-g. Except for rejects (bin 34g), the output bins 34a-f are in pairs to separate lead mailpieces from trail mailpieces. It is desirable for the mailpieces 19 in each output bin to face identically. The operator may thus rotate trays properly so as to orient lead and trail mailpieces the same way. The mail may be separated into four broad categories: (1) FIM A&C (FIM with POSTNET), (2) outgoing (destination is a different SCF), (3) local (destination is within this SCF), and (4) reject (detected double feeds, not possible to sort into other categories). The decision of outgoing vs. local, for example, may be based on the image analysis performed by the image server 46.
Another difference between the system 50 of
Because it is known that all mailpieces are in a lead orientation, there is also no need for separate bins for lead and trail mailpieces, like in the embodiment of
As illustrated by the embodiments of a mail processing system shown in
Several views of an illustrative embodiment of a camera assembly 40, and components thereof, are shown in
In the example shown, enclosed within the housing are an optical bench assembly 88, a camera interface board (CIB) 90, a connector 92 for the nose assembly 62, and a mirror assembly 94. The optical bench assembly may, for example, contain an imaging array, such as a charge coupled device (CCD) (not shown), that produces lines of a grayscale image representative of the intensity of light transmitted through a slit 96 in the front of the nose assembly 62 and reflected from the mirror 94 onto the CCD of the optical bench assembly 88. Since the structure and function of the optical bench assembly 88 is essentially the same as that described in United States Application Publication No. 2006/0120563 A1, which is incorporated herein by reference in its entirety, the details of that structure will not be further described. It should be appreciated, however, that any of the other features or functionality of the camera assemblies, components thereof, and systems described in that published application may additionally or alternatively be employed in connection with various embodiments of the camera assemblies and overall system described herein.
The CIB 90 may provide an electrical and communications link amongst the optical bench assembly 88, the nose assembly 62, and external devices (not shown in
As shown, the aluminum support member 104 may also support a source of UV radiation 112 and an array of phototransistors 114 arranged to receive light reflected from a mailpiece exposed to UV radiation from the source 112. In the example shown, the UV radiation source 112 is a florescent tube, but a set of UV generating diodes, or any other UV generating means, could alternatively be employed as the source of UV radiation 112. In some embodiments, the phototransistors 114 (or some other simple photon receptors) each contain an integrated lens, thus eliminating the need for focusing and calibration. Additional details concerning the structure and operation of the UV radiation source 112 and phototransistors 114 are provided below. Moreover, details concerning the control of the UV radiation source 112 so that it is shut off during periods of non-use of the system or when the housing assembly is opened or has been compromised are provided in Application Ser. No. 60/819,414, entitled MAIL IMAGING SYSTEM WITH UV ILLUMINATION INTERRUPT, bearing attorney docket number L0562.70062US00, and filed on even date herewith, which is incorporated herein by reference in its entirety. In the example shown, analog outputs of the phototransistors 114 are provided to an analog-to-digital converter (ADC) 116 where they are converted to a digital signal prior to being fed to the CIB 90 for further processing.
In the embodiment shown, the aluminum support members 102, 104 and associated components are covered by a platen 117 having a specialized configuration. The platen 117, in turn, is covered by a pair of wear plates 118, 120 also having a specialized design. Details concerning the specialized structure and function of the platen 117 and wear plates 118, 120 are provided in Application Ser. No. 60/819,217, entitled MAIL IMAGING SYSTEM WITH SECONDARY ILLUMINATION/IMAGING WINDOW, bearing attorney docket number L0562.70063US00, and filed on even date herewith, which is incorporated herein by reference in its entirety.
As shown, the UV radiation source 112 and array of phototransistors 114 may each be covered by a respective filter 122, 124 to enhance the accuracy of the UV image acquisition. In the embodiment shown, performance is enhance by placing a short pass filter 122 (allowing UV radiation to pass and blocking visible illumination) in front of the UV radiation source 112, and placing a long pass filter (allowing visible radiation to pass and blocking UV radiation) in front of the array of phototransistors 114. Additional details concerning the mechanisms and techniques used to filter the light generated by the UV radiation source 112 and received at the array of phototransistors 114 are provided in Application Ser. No. 60/819,132, entitled MAIL PROCESSING SYSTEM WITH RADIATION FILTERING, bearing attorney docket number L0562.70065US00 and filed on even date herewith, which is incorporated herein by reference in its entirety.
The radiation source 112 and array of phototransistors 114 may be arranged so that their operation does not interfere with the operation of optical bench assembly 88 in acquiring grayscale images. Advantageously, however, because they are acquired by components within the same camera assembly 40, the UV images and grayscale images acquired by the different components can be correlated with one another to facilitate the identification of the various markings on scanned mailpieces. Additional details concerning the acquisition and use of dual images by a camera assembly 40 and related components are provided in Application Ser. No. 60/819,137, entitled MAIL PROCESSING SYSTEM WITH DUAL CAMERA ASSEMBLY, bearing attorney docket number L0562.70066US00 and filed on even date herewith, which is incorporated herein by reference in its entirety.
Examples of UV and grayscale images acquired of mailpieces by one of the camera assemblies 40 are shown in
Additionally, regions 1110 and 1210 differ in resolution. The grayscale image of
Despite the difference in resolution, the UV image and the grayscale image both represent a relatively large field of view. In a mail processing system, the field of view may be sufficiently large that, as mailpieces of the size the machine is designed to accept pass through the mail processing system, any portion of a mailpiece that could contain information to be analyzed by imaging will pass through the field of view. A desired size of the field of view of a camera therefore may depend on the nature of the mailpieces that are to be processed. Nonetheless, in this context, a camera that has a field of view large enough to encompass the desired areas of a mailpiece of a size mail processing equipment is designed to process can be said to image an entire surface of the mailpieces. As depicted, both the UV and grayscale cameras image the entire surface of a mailpiece.
In an embodiment, the UV image is used only to identify the presence of a feature and determine its location. An image with the resolution of the image of
As another example,
Radiation from radiation source 112 interacts with features, such as barcode 1710, on the surface of mailpiece 19, which causes the feature to emit light. In some embodiments, radiation from UV radiation source 112 has a spectrum with predominate components between about 40 and 400 nm. However, radiation with any suitable spectrum may be used.
Barcode 1710 may be printed in fluorescent, phosphorescent or scintillating ink such that when it is radiated with UV light with a spectrum like that provided by UV radiation source 112 it emits visible light. However, UV imaging subsystem 1700 may be used in connection with any features that react to UV light, regardless of how formed. The light emitted from barcode 1710 is detected by detector array 1714. In the embodiment pictured, detector array 1714 is a linear array containing phototransistors 1141 . . . 1144. The phototransistors used to form detector array 1714 are described in greater detail below in conjunction with
Detector array 1714 is pictured with four phototransistors for simplicity. However, in embodiments, detector array 1714 may have a length approximately equal to the field of view of the UV camera. Accordingly, detector array 1714 also may have a length of 10 cm or more and in some embodiments may be about 15 cm or longer. More than four phototransistors may be present to span the desired field of view. In some embodiments, phototransistors may be approximately evenly spaced along the length of detector array 1714 at a pitch between about 3 mm and 8.2 mm. Images formed with detector array 1714 may have a low resolution, such as between about 1 and 3.5 pixels/cm.
Light emanating from mailpiece 19 may fall in the visible light spectrum, which in some embodiments may be between about 400 nm and 700 nm. Though, in embodiments, the light may be about 650 nm or be of any other suitable wavelength.
Regardless of the specific characteristics of the light, each of the detectors is sensitive to the light emanating from mailpiece 19.
As described above, one or more filters or other components may be used to enhance the sensitivity of UV subsystem 1700. In the embodiment of
Diffuser 1722 may in some embodiments additionally act as a filter to selectively pass radiation that interacts with barcode 1710. Alternatively, a separate source filter, such as filter 122, may be used instead of or in addition to diffuser 1722.
Filter 124 also may be used in conjunction with detector array 1714. Filter 124 may preferentially pass light that emanates from barcode 1710. Accordingly, light 1750 reaching detector array 1714 may have a different spectrum than light 1742 emanating from the surface of mailpiece 19.
Each of the phototransistors 1141 . . . 1144 outputs an electrical signal representative of the intensity of the light reaching it. In the described embodiment in which image information is processed in a digital computer, the outputs of phototransistors 1141 . . . 1144 are converted to digital form. In the embodiment pictured, the output of each phototransistor is coupled to a respective one of the analog-to-digital converters 17601 . . . 17604. Each analog-to-digital converter may produce a digital output of one or more bits. For a low resolution image, a small number of bits may be acceptable, which may simplify data collection and processing. However, any suitable number of bits may be used. Also, a one-to-one relationship is shown between phototransistors 1141 . . . 1144 and analog-to-digital converters 17601 . . . 17604. Such a depiction is shown for simplicity. Multiplexing or other approaches may be used so that the relationship between the phototransistors and analog-to-digital converters is other than one-to-one.
The digital outputs of the analog-to-digital converters 17601 . . . 17604 are routed to an image processing device, such as image server 46 (
One example of the processing that may be performed on a low resolution UV image in a mail processing system using a UV imaging subsystem 1700 is provided in
At block 1812, the surface of the mailpiece is illuminated with UV radiation.
At block 1814, radiation emanating from the surface of the mailpiece is captured. Though blocks 1810, 1812 and 1814 are shown to be sequential in
Motion of mailpiece 19 while an image is being captured may facilitate low cost formation of an image by scanning. In some embodiments, detector array 1714 may be a linear array. Though low cost, a linear array only can capture data on a relatively narrow, elongated region of mailpiece 19 at one time. The information captured in this fashion may be referred to as a “scan line” and by itself represents only a portion of the desired image. To image an entire surface of a mailpiece, the mailpiece may be moved relative to the UV camera to position another portion of the mailpiece in the field of view of the UV camera. In this new position, a subsequent scan line may be formed. By moving the mailpiece small amounts between the capture of scan lines, an entire surface of the mailpiece may be imaged.
At block 1816, a two dimensional image is formed from the captured radiation. In embodiments in which an image is captured by scanning, processing at block 1816 may include assembling the scan lines into an image. In some embodiments, the outputs of detector array 1714 for each scan line may be stored in computer memory in a way that organizes the data as a two-dimensional image as the data is captured. Accordingly, processing at step 1816 may be a part of other operations performed while acquiring image data. However, any suitable processing may be used to form a two-dimensional image.
At block 1820, the captured image is analyzed to identify features on the mailpiece under inspection. The specific processing performed at block 1820 may depend on the specific functions of the mail processing system in which the process is performed. For example, processing may involve detecting the orientation of the mailpiece based on the location of a scintillating, phosphorescent or fluorescent feature on the mailpiece. Such processing may be based on identifying an image of one or more of a stamp, a meter mark, an information-based indicia and an identification tag. Following such detection of a feature, the mailpiece may be reoriented to position the feature in the top, forward corner of the mailpiece. Having a two-dimensional image of an entire surface of the mailpiece available for analysis can greatly simplify locating features of interest on the surface of the mailpiece.
In some embodiments, processing at block 1820 will be based on a low resolution UV image of the mailpiece. For example, the image may be formed from a detector array having individual detectors spaced on a pitch between about 8.2 mm and 3 mm, with a resulting image resolution between about 1 and 3.5 pixels/cm. Such a low resolution allows rapid and accurate feature detection with low cost components. In other embodiments, the processing may be based on a grayscale image of the mailpiece having higher resolution, such as between about 50 and 150 pixels/cm. Such processing may result in the identification of the zip code or other portions of an address on a mailpiece, the amount of postage affixed to the mailpiece or any other information on the mailpiece.
In yet further embodiments, processing may be based on both a UV image and a grayscale image. Such processing, for example, may include use of the UV image to guide analysis of the grayscale image. For example, the UV image may be used to identify a stamp or other feature on the mailpiece. Because the location of a feature in the UV image can be readily correlated to a location in the grayscale image, processing requirements for analysis of the grayscale image may be reduced by using a correlated UV image and grayscale image formed by two imaging arrays in a single camera assembly.
Turning now to
The discrete photodetectors are held on a substrate. In the embodiment of
In the embodiment of
Each phototransistor contains an active element 1910 that reacts to light. That reaction to light produces a measurable electrical effect on the signals on leads 1912A and 1912B.
The active element 1910 is enclosed within a housing. At least a portion of the housing may be transparent to allow light to reach active element 1910. The transparent portion of the housing may be shaped to act as a lens 1920. Lens 1920 make focus light on active element 1910. Because each of the photodetectors 1141 . . . 1144 includes a lens, the need for a lens to focus light on the detector array may be avoided, reducing the number of components in the UV imaging subsystem and further reducing the cost of the assembly.
Having described several embodiments of the invention in detail, various modifications and improvements will readily occur to those skilled in the art. Such modifications and improvements are intended to be within the spirit and scope of the invention. Accordingly, the foregoing description is by way of example only, and is not intended as limiting. The invention is limited only as defined by the following claims and the equivalents thereto.
This application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application Ser. No. 60/819,136, filed Jul. 7, 2006, U.S. Provisional Application Ser. No. 60/819,414, filed Jul. 7, 2006, U.S. Provisional Application Ser. No. 60/819,217, filed Jul. 7, 2006, U.S. Provisional Application Ser. No. 60/819,084, filed Jul. 7, 2006, U.S. Provisional Application Ser. No. 60/819,132, filed Jul. 7, 2006, and U.S. Provisional Application Ser. No. 60/819,137, filed Jul. 7, 2006. Each of the above applications is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
60819136 | Jul 2006 | US | |
60819414 | Jul 2006 | US | |
60819217 | Jul 2006 | US | |
60819084 | Jul 2006 | US | |
60819132 | Jul 2006 | US | |
60819137 | Jul 2006 | US |