Patent Grant
8479992
1. Field of Invention
The present invention relates to area-type digital image capture and processing systems having diverse modes of digital image processing for reading one-dimensional (1D) and two-dimensional (2D) bar code symbols, as well as other forms of graphically-encoded intelligence, employing advances methods of automatic illumination and imaging to meet demanding end-user application requirements.
2. Brief Description of the State of the Art
The state of the automatic-identification industry can be understood in terms of (i) the different classes of bar code symbologies that have been developed and adopted by the industry, and (ii) the kinds of apparatus developed and used to read such bar code symbologies in various user environments.
In general, there are currently three major classes of bar code symbologies, namely: one dimensional (1D) bar code symbologies, such as UPC/EAN, Code 39, etc.; 1D stacked bar code symbologies, Code 49, PDF417, etc.; and two-dimensional (2D) data matrix symbologies.
One-dimensional (1D) optical bar code readers are well known in the art. Examples of such readers include readers of the Metrologic Voyager® Series Laser Scanner manufactured by Metrologic Instruments, Inc. Such readers include processing circuits that are able to read one dimensional (1D) linear bar code symbologies, such as the UPC/EAN code, Code 39, etc., that are widely used in supermarkets. Such 1D linear symbologies are characterized by data that is encoded along a single axis, in the widths of bars and spaces, so that such symbols can be read from a single scan along that axis, provided that the symbol is imaged with a sufficiently high resolution along that axis.
In order to allow the encoding of larger amounts of data in a single bar code symbol, a number of 1D stacked bar code symbologies have been developed, including Code 49, as described in U.S. Pat. No. 4,794,239 (Allais), and PDF417, as described in U.S. Pat. No. 5,340,786 (Pavlidis, et al.). Stacked symbols partition the encoded data into multiple rows, each including a respective 1D bar code pattern, all or most of all of which must be scanned and decoded, then linked together to form a complete message. Scanning still requires relatively high resolution in one dimension only, but multiple linear scans are needed to read the whole symbol.
The third class of bar code symbologies, known as 2D matrix symbologies offer orientation-free scanning and greater data densities and capacities than their 1D counterparts. In 2D matrix codes, data is encoded as dark or light data elements within a regular polygonal matrix, accompanied by graphical finder, orientation and reference structures. When scanning 2D matrix codes, the horizontal and vertical relationships of the data elements are recorded with about equal resolution.
In order to avoid having to use different types of optical readers to read these different types of bar code symbols, it is desirable to have an optical reader that is able to read symbols of any of these types, including their various subtypes, interchangeably and automatically. More particularly, it is desirable to have an optical reader that is able to read all three of the above-mentioned types of bar code symbols, without human intervention, i.e., automatically. This is turn, requires that the reader have the ability to automatically discriminate between and decode bar code symbols, based only on information read from the symbol itself. Readers that have this ability are referred to as “auto-discriminating” or having an “auto-discrimination” capability.
If an auto-discriminating reader is able to read only 1D bar code symbols (including their various subtypes), it may be said to have a 1D auto-discrimination capability. Similarly, if it is able to read only 2D bar code symbols, it may be said to have a 2D auto-discrimination capability. If it is able to read both 1D and 2D bar code symbols interchangeably, it may be said to have a 1D/2D auto-discrimination capability. Often, however, a reader is said to have a 1D/2D auto-discrimination capability even if it is unable to discriminate between and decode 1D stacked bar code symbols.
Optical readers that are capable of 1D auto-discrimination are well known in the art. An early example of such a reader is Metrologic's VoyagerCG® Laser Scanner, manufactured by Metrologic Instruments, Inc.
Optical readers, particularly hand held optical readers, that are capable of 1D/2D auto-discrimination and based on the use of an asynchronously moving 1D image sensor, are described in U.S. Pat. Nos. 5,288,985 and 5,354,977, which applications are hereby expressly incorporated herein by reference. Other examples of hand held readers of this type, based on the use of a stationary 2D image sensor, are described in U.S. Pat. Nos. 6,250,551; 5,932,862; 5,932,741; 5,942,741; 5,929,418; 5,914,476; 5,831,254; 5,825,006; 5,784,102, which are also hereby expressly incorporated herein by reference.
Optical readers, whether of the stationary or movable type, usually operate at a fixed scanning rate, which means that the readers are designed to complete some fixed number of scans during a given amount of time. This scanning rate generally has a value that is between 30 and 200 scans/sec for 1D readers. In such readers, the results the successive scans are decoded in the order of their occurrence.
Imaging-based bar code symbol readers have a number advantages over laser scanning based bar code symbol readers, namely: they are more capable of reading stacked 2D symbologies, such as the PDF 417 symbology; more capable of reading matrix 2D symbologies, such as the Data Matrix symbology; more capable of reading bar codes regardless of their orientation; have lower manufacturing costs; and have the potential for use in other applications, which may or may not be related to bar code scanning, such as OCR, security systems, etc
Prior art digital image capture and processing systems suffer from a number of additional shortcomings and drawbacks.
Most prior art hand held optical reading devices can be reprogrammed by reading bar codes from a bar code programming menu or with use of a local host processor as taught in U.S. Pat. No. 5,929,418. However, these devices are generally constrained to operate within the modes in which they have been programmed to operate, either in the field or on the bench, before deployment to end-user application environments. Consequently, the statically-configured nature of such prior art imaging-based bar code reading systems has limited their performance.
Prior art digital image capture and processing systems with integrated illumination subsystems also support a relatively short range of the optical depth of field. This limits the capabilities of such systems from reading big or highly dense bar code labels.
Prior art digital image capture and processing systems generally require separate apparatus for producing a visible aiming beam to help the user to aim the camera's field of view at the bar code label on a particular target object.
Prior art digital image capture and processing systems generally require capturing multiple frames of image data of a bar code symbol, and special apparatus for synchronizing the decoding process with the image capture process within such readers, as required in U.S. Pat. Nos. 5,932,862 and 5,942,741 assigned to Welch Allyn, Inc.
Prior art digital image capture and processing systems generally require large arrays of LEDs in order to flood the field of view within which a bar code symbol might reside during image capture operations, oftentimes wasting larges amounts of electrical power which can be significant in portable or mobile imaging-based readers.
Prior art digital image capture and processing systems generally require processing the entire pixel data set of capture images to find and decode bar code symbols represented therein. On the other hand, some prior art imaging systems use the inherent programmable (pixel) windowing feature within conventional CMOS image sensors to capture only partial image frames to reduce pixel data set processing and enjoy improvements in image processing speed and thus imaging system performance.
Many prior art digital image capture and processing systems also require the use of decoding algorithms that seek to find the orientation of bar code elements in a captured image by finding and analyzing the code words of 2-D bar code symbologies represented therein.
Some prior art digital image capture and processing systems generally require the use of a manually-actuated trigger to actuate the image capture and processing cycle thereof.
Prior art digital image capture and processing systems generally require separate sources of illumination for producing visible aiming beams and for producing visible illumination beams used to flood the field of view of the bar code reader.
Prior art digital image capture and processing systems generally utilize during a single image capture and processing cycle, and a single decoding methodology for decoding bar code symbols represented in captured images.
Some prior art digital image capture and processing systems require exposure control circuitry integrated with the image detection array for measuring the light exposure levels on selected portions thereof.
Also, many imaging-based readers also require processing portions of captured images to detect the image intensities thereof and determine the reflected light levels at the image detection component of the system, and thereafter to control the LED-based illumination sources to achieve the desired image exposure levels at the image detector.
Prior art digital image capture and processing systems employing integrated illumination mechanisms control image brightness and contrast by controlling the time that the image sensing device is exposed to the light reflected from the imaged objects. While this method has been proven for the CCD-based bar code scanners, it is not suitable, however, for the CMOS-based image sensing devices, which require a more sophisticated shuttering mechanism, leading to increased complexity, less reliability and, ultimately, more expensive bar code scanning systems.
Prior art digital image capture and processing systems generally require the use of tables and bar code menus to manage which decoding algorithms are to be used within any particular mode of system operation to be programmed by reading bar code symbols from a bar code menu.
Also, due to the complexity of the hardware platforms of such prior art digital image capture and processing systems, end-users are not permitted to modify the features and functionalities of such system to their customized application requirements, other than changing limited functions within the system by reading system-programming type bar code symbols, as disclosed in U.S. Pat. Nos. 6,321,989; 5,965,863; 5,929,418; and 5,932,862, each being incorporated herein by reference.
Also, dedicated image-processing based bar code symbol reading devices usually have very limited resources, such as the amount of volatile and non-volatile memories. Therefore, they usually do not have a rich set of tools normally available to universal computer systems. Further, if a customer or a third-party needs to enhance or alter the behavior of a conventional image-processing based bar code symbol reading system or device, they need to contact the device manufacturer and negotiate the necessary changes in the “standard” software or the ways to integrate their own software into the device, which usually involves the re-design or re-compilation of the software by the original equipment manufacturer (OEM). This software modification process is both costly and time consuming.
3. Prior Art Field of View (FOV) Aiming, Targeting, Indicating And Marking Techniques
The need to target, indicate and/or mark the field of view (FOV) of 1D and 2D image sensors within hand-held imagers has also been long recognized in the industry.
In U.S. Pat. No. 4,877,949, Danielson et a disclosed on Aug. 8, 1986 an digital image capture and processing system having a 2D image sensor with a field of view (FOV) and also a pair of LEDs mounted about a 1D (i.e. linear) image sensor to project a pair of light beams through the FOV focusing optics and produce a pair of spots on a target surface supporting a 1D bar code, thereby indicating the location of the FOV on the target and enable the user to align the bar code therewithin.
In U.S. Pat. No. 5,019,699, Koenck et al disclosed on Aug. 31, 1988 an digital image capture and processing system having a 2D image sensor with a field of view (FOV) and also a set of four LEDs (each with lenses) about the periphery of a 2D (i.e. area) image sensor to project four light beams through the FOV focusing optics and produce four spots on a target surface to mark the corners of the FOV intersecting with the target, to help the user align 1D and 2D bar codes therewithin in an easy manner.
In FIGS. 48-50 of U.S. Pat. Nos. 5,841,121 and 6,681,994, Koenck disclosed on Nov. 21, 1990, an digital image capture and processing system having a 2D image sensor with a field of view (FOV) and also apparatus for marking the perimeter of the FOV, using four light sources and light shaping optics (e.g. cylindrical lens).
In U.S. Pat. No. 5,378,883, Batterman et al disclosed on Jul. 29, 1991, a hand-held digital image capture and processing system having a 2D image sensor with a field of view (FOV) and also a laser light source and fixed lens to produce a spotter beam that helps the operator aim the reader at a candidate bar code symbol. As disclosed, the spotter beam is also used measure the distance to the bar code symbol during automatic focus control operations supported within the bar code symbol reader.
In U.S. Pat. No. 5,659,167, Wang et al disclosed on Apr. 5, 1994, an digital image capture and processing system comprising a 2D image sensor with a field of view (FOV), a user display for displaying a visual representation of a dataform (e.g. bar code symbol), and visual guide marks on the user display for indicating whether or not the dataform being imaged is in focus when its image is within the guide marks, and out of focus when its image is within the guide marks.
In U.S. Pat. No. 6,347,163, Roustaei disclosed on May 19, 1995, a system for reading 2D images comprising a 2D image sensor, an array of LED illumination sources, and an image framing device which uses a VLD for producing a laser beam and a light diffractive optical element for transforming the laser beam into a plurality of beamlets having a beam edge and a beamlet spacing at the 2D image, which is at least as large as the width of the 2D image.
In U.S. Pat. No. 5,783,811, Feng et al disclosed on Feb. 26, 1996, a portable imaging assembly comprising a 2D image sensor with a field of view (FOV) and also a set of LEDs and a lens array which produces a cross-hair type illumination pattern in the FOV for aiming the imaging assembly at a target.
In U.S. Pat. No. 5,793,033, Feng et al disclosed on Mar. 29, 1996, a portable imaging assembly comprising a 2D image sensor with a field of view (FOV), and a viewing assembly having a pivoting member which, when positioned a predetermined distance from the operator's eye, provides a view through its opening which corresponds to the target area (FOV) of the imaging assembly. for displaying a visual representation of a dataform (e.g. bar code symbol).
In U.S. Pat. No. 5,780,834, Havens et al disclosed on May 14, 1996, a portable imaging and illumination optics assembly having a 2D image sensor with a field of view (FOV), an array of LEDs for illumination, and an aiming or spotting light (LED) indicating the location of the FOV.
In U.S. Pat. No. 5,949,057, Feng et al disclosed on Jan. 31, 1997, a portable imaging device comprising a 2D image sensor with a field of view (FOV), and first and second sets of targeting LEDs and first and second targeting optics, which produces first and second illumination targeting patterns, which substantially coincide to form a single illumination targeting pattern when the imaging device is arranged at a “best focus” position.
In U.S. Pat. No. 6,060,722, Havens et al disclosed on Sep. 24, 1997, a portable imaging and illumination optics assembly comprising a 2D image sensor with a field of view (FOV), an array of LEDs for illumination, and an aiming pattern generator including at least a point-like aiming light source and a light diffractive element for producing an aiming pattern that remains approximately coincident with the FOV of the imaging device over the range of the reader-to-target distances over which the reader is used.
In U.S. Pat. No. 6,340,114, filed Jun. 12, 1998, Correa et al disclosed an imaging engine comprising a 2D image sensor with a field of view (FOV) and an aiming pattern generator using one or more laser diodes and one or more light diffractive elements to produce multiple aiming frames having different, partially overlapping, solid angle fields or dimensions corresponding to the different fields of view of the lens assembly employed in the imaging engine. The aiming pattern includes a centrally-located marker or cross-hair pattern. Each aiming frame consists of four corner markers, each comprising a plurality of illuminated spots, for example, two multiple spot lines intersecting at an angle of 90 degrees.
As a result of limitations in the field of view (FOV) marking, targeting and pointing subsystems employed within prior art digital image capture and processing systems, such prior art readers generally fail to enable users to precisely identify which portions of the FOV read high-density 1D bar codes with the ease and simplicity of laser scanning based bar code symbol readers, and also 2D symbologies, such as PDF 417 and Data Matrix.
Also, as a result of limitations in the mechanical, electrical, optical, and software design of prior art digital image capture and processing systems, such prior art readers generally: (i) fail to enable users to read high-density 1D bar codes with the ease and simplicity of laser scanning based bar code symbol readers and also 2D symbologies, such as PDF 417 and Data Matrix, and (iii) have not enabled end-users to modify the features and functionalities of such prior art systems without detailed knowledge about the hard-ware platform, communication interfaces and the user interfaces of such systems.
Also, control operations in prior art image-processing bar code symbol reading systems have not been sufficiently flexible or agile to adapt to the demanding lighting conditions presented in challenging retail and industrial work environments where 1D and 2D bar code symbols need to be reliably read.
Prior art digital imaging and laser scanning systems also suffering from a number of other problems as well.
Some prior art imaging systems have relied on IR-based object detection using the same image sensing array for detecting images of objects, and therefore, require that the decode microprocessor be powered up during the object detection state of operation, and consuming power which would be undesirable in portable digital imaging applications.
Thus, there is a great need in the art for an improved method of and apparatus for reading bar code symbols using image capture and processing techniques which avoid the shortcomings and drawbacks of prior art methods and apparatus.
Accordingly, a primary object of the present invention is to provide a novel method of and apparatus for enabling the reading of 1D and 2D bar code symbologies using image capture and processing based systems and devices, which avoid the shortcomings and drawbacks of prior art methods and apparatus.
Another object of the present invention is to provide a novel hand-supportable digital image capture and processing system capable of automatically reading 1D and 2D bar code symbologies using advanced illumination and imaging techniques, providing speeds and reliability associated with conventional laser scanning bar code symbol readers.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having an integrated LED-based linear targeting illumination subsystem for automatically generating a visible linear targeting illumination beam for aiming on a target object prior to illuminating the same during its area image capture mode of operation.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having a presentation mode which employs a hybrid video and snap-shot mode of image detector operation.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing automatic object presence detection to control the generation of a wide-area illumination beam during bar code symbol imaging operations.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a CMOS-type image detecting array with a band-pass optical filter subsystem integrated within the hand-supportable housing thereof, to allow only narrow-band illumination from the multi-mode illumination subsystem to expose the image detecting array during object illumination and imaging operations.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a multi-mode led-based illumination subsystem.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having 1D/2D auto-discrimination capabilities.
Another object of the present invention is to provide such an imaging-based bar code symbol reader having target applications at point of sales in convenience stores, gas stations, quick markets, and the like.
Another object of the present invention is to provide a digital image-processing based bar code symbol reading system that is highly flexible and agile to adapt to the demanding lighting conditions presented in challenging retail and industrial work environments where 1D and 2D bar code symbols need to be reliably read.
Another object of the present invention is to provide such an automatic imaging-based bar code symbol reading system, wherein an automatic light exposure measurement and illumination control subsystem is adapted to measure the light exposure on a central portion of the CMOS image detecting array and control the operation of the LED-based illumination subsystem in cooperation with the digital image processing subsystem.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing automatic object detection, and a linear targeting illumination beam generated from substantially the same plane as the area image detection array.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing hybrid illumination and imaging modes of operation employing a controlled complex of snap-shot and video illumination/imaging techniques.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a single PC board with imaging aperture, and image formation and detection subsystem and linear illumination targeting subsystem supported on the rear side of the board, using common FOV/Beam folding optics; and also, light collection mirror for collecting central rays along the FOV as part of the automatic light measurement and illumination control subsystem.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system, wherein the pair of LEDs, and corresponding aperture stops and cylindrical mirrors are mounted on opposite sides of the image detection array in the image formation and detection subsystem, and employs a common FOV/BEAM folding mirror to project the linear illumination target beam through the central light transmission aperture (formed in the PC board) and out of the imaging window of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system, wherein a single LED array is mounted above its imaging window and beneath a light ray blocking shroud portion of the housing about the imaging window, to reduce illumination rays from striking the eyes of the system operator or nearby consumers during system operation.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system, with improved menu-reading capabilities.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having an integrated band-pass filter employing wavelength filtering FOV mirror elements.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having multi-mode image formation and detection systems supporting snap-shot, true-video, and pseudo (high-speed repeated snap-shot) modes of operation.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having an image formation and detection system supporting high-repetition snap-shot mode of operation, and wherein the time duration of illumination and imaging is substantially equal to the time for image processing—and globally-exposure principles of operation are stroboscopically implemented.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing automatic object motion detection using IR sensing techniques (e.g. IR LED/photodiode, IR-based imaging, and IR-based LADAR—pulse doppler).
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing automatic linear illumination target beam, projected from the rear-side of the PC board, adjacent image sensing array, and reflecting off FOV folding mirror into the FOV.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with light transmission aperture having image detection array mounted thereon, with the optical axis of the image formation optics perpendicular to the said PC board and a double-set of FOV folding mirrors for projecting the FOV out through the light transmission aperture and the image window of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with light transmission aperture, wherein a pair of cylindrical optical elements proved for forming a linear illumination target beam, are disposed parallel to a FOV folding mirror used to project the linear illumination target beam out through the light transmission aperture and the image window of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with light transmission aperture, wherein an array of visible LED are mounted on the rear side of the PC board for producing a linear illumination target beam, and an array of visible LEDs are mounted on the front side of the PC board for producing a field of visible illumination within the FOV of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with a light transmission aperture, wherein a first array of visible LED are mounted on the rear side of the PC board for producing a linear illumination target beam, whereas a second array of visible LEDs are mounted on the front side of the PC board for producing a field of visible illumination within the FOV of the system, wherein said field of visible illumination being substantially coextensive with said linear illumination target beam.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with light transmission aperture, wherein a set of visible LEDs are mounted on opposite sides of an area-type image detection array mounted to the PC board, for producing a linear illumination target beam, that is substantially parallel to the optical axis of the image formation optics of the image detection array, as it is projected through the light transmission aperture and imaging window of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having single PC board with light transmission aperture, wherein an automatic light measurement and illumination control subsystem is provided employing a light collecting mirror disposed behind said light transmission aperture for collecting light from a central portion of the FOV of the system provided by image formation optics before an area-type image detection array on mounted on the PC board, and focusing the collected light onto photodetector mounted adjacent the image detection array, but independent of its operation; and wherein beyond the light transmission aperture, the optical axis of the light collecting mirror is substantially parallel to the optical axis of the image formation and detection subsystem.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a system control system that controls (i) an image formation and detection subsystem employing an area-type image detection array with image formation optics providing a field of view (FOV) and wherein one of several possible image detection array modes of operation are selectable, and (ii) a multi-mode illumination subsystem employing multiple LED illumination arrays for illuminating selected portions of the FOV.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a system control system that controls an image formation and detection subsystem employing an area-type image detection array with image formation optics providing a field of view (FOV) and in which one of several possible image detection array modes of operation are selectable, and a multi-mode illumination subsystem employing multiple LED illumination arrays for illuminating selected portions of said FOV; and wherein the system supports an illumination and imaging control process employing both snap-shot and video-modes of operation.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing linear target illumination beam to align programming-type bar code symbols prior to wide-area illumination and image capture and processing so as to confirm that such bar code symbol was intentionally read as a programming-type bar code symbol.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing linear target illumination beam to align programming-type bar code symbols and narrowly-confined active subregion in the FOV centered about the linear target illumination beam so as to confirm that bar code symbols region in this subregion was intentionally read as a programming-type bar code symbols.
Another object of the present invention is to provide a hand/countertop-supportable digital image capture and processing system which carries out a first method of hands-free digital imaging employing automatic hands-free configuration detection, automatic object presence motion/velocity detection in field of view (FOV) of system (i.e. automatic-triggering), automatic illumination and imaging of multiple image frames while operating in a snap-shot mode during a first time interval, and automatic illumination and imaging while operating in a video-mode during a second time interval.
Another object of the present invention is to provide a hand/countertop-supportable digital image capture and processing system which carries out a second method of hands-free digital imaging employing automatic hands-free configuration detection, automatic object presence detection in field of view (FOV) of system (i.e. automatic-triggering), automatic linear target illumination beam generation, and automatic illumination and imaging of multiple image frames while operating in a snap-shot mode within a predetermined time interval.
Another object of the present invention is to provide such a hand/countertop-supportable digital image capture and processing system which can be easily used during for menu-reading applications.
Another object of the present invention is to provide a hand/countertop-supportable digital image capture and processing system which carries out a third method of hands-free digital imaging employing automatic hands-free configuration detection, automatic object presence detection in field of view (FOV) of system (i.e. automatic-triggering), and automatic illumination and imaging while operating in a video mode within a predetermined time interval.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a first method of hand-held digital imaging employing automatic hand-held configuration detection, automatic object presence detection in field of view (FOV) of system (i.e. automatic-triggering), automatic linear target illumination beam generation (i.e. automatic object targeting), and automatic illumination and imaging of multiple digital image frames while operating in a snap-shot mode within a predetermined time interval.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a second method of hand-held digital imaging employing automatic hand-held configuration detection, automatic object presence detection in field of view (FOV) of system (i.e. automatic-triggering), automatic linear target illumination beam generation (i.e. automatic object targeting), and automatic illumination and imaging of video image frames while operating in a video-shot mode within a predetermined time interval.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a first method of hand-held digital imaging employing automatic hand-held configuration detection, manual trigger switching (i.e. manual-triggering), automatic linear target illumination beam generation (i.e. automatic object targeting), and automatic illumination and imaging of multiple image frames while operating in a snap-shot mode within a predetermined time interval.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a fourth method of hand-held digital imaging employing automatic hand-held configuration detection, manual trigger switching (i.e. manual-triggering), automatic linear target illumination beam generation (i.e. automatic object targeting), and automatic illumination and imaging of video image frames while operating in a video-shot mode within a predetermined time interval.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a fifth method of hand-held digital imaging employing automatic hand-held configuration detection, manual trigger switching (i.e. manual-triggering), automatic linear target illumination beam generation (i.e. automatic object targeting), and illumination and imaging of single image frame while operating in a snap-shot mode.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a pseudo-video illumination mode, enabling ½ the number of frames captured (e.g. 15 frame/second), with a substantially reduced illumination annoyance index (IAI).
Another object of the present invention is to provide a hand-supportable digital image capture and processing system, wherein a single array of LEDs are used to illuminate the field of view of system so as minimize illumination of the field of view (FOV) of human operators and spectators in the ambient environment.
Another object of the present invention is to provide such a hand-supportable digital image capture and processing system which further comprises a linear targeting illumination beam.
Another object of the present invention is to provide a hand/countertop-supportable digital image capture and processing system, employing a method of illuminating and capturing digital images at the point of sale using a digital image capture and processing system operating in a presentation mode of operation.
Another object of the present invention is to provide such a hand/countertop-supportable digital image capture and processing system, wherein a light ray blocking structure is arranged about upper portion of the imaging window.
Another object of the present invention is to provide such a hand-supportable digital image capture and processing system, wherein illumination rays are maintained below an illumination ceiling, above which the field of view of human operator and spectators are typically positioned.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which stores multiple files for different sets of system configuration parameters which are automatically implemented when one or multiple communication interfaces supported by the system is automatically detected and implemented, without scanning programming type bar code symbols.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which incorporates image intensification technology within the image formation and detection subsystem and before the image detection array so as to enable the detection of faint (i.e. low intensity) images of objects formed in the FOV using very low illumination levels, as may be required or desired in demanding environments, such as retail POS environments, where high intensity illumination levels are either prohibited or highly undesired from a human safety and/or comfort point of view.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a LED-driven optical-waveguide structure that is used to illuminate a manually-actuated trigger switch integrated within the hand-supportable housing of the system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing an acoustic-waveguide structure coupling sonic energy, produced from its electro-acoustic transducer, to the sound ports formed in the system housing.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system that is provided with an illumination subsystem employing prismatic illumination focusing lens structure integrated within its imaging window, for generating a field of visible illumination that is highly confined below the field of view of the system operator and customers who are present at the POS station at which the digital image capture and processing system is deployed.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a method of automatically programming multiple system configuration parameters within system memory of the digital image capture and processing system of present invention, without reading programming-type bar codes.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which carries out a method of unlocking restricted features embodied within the digital image capture and processing system of present invention of the third illustrative embodiment, by reading feature/functionality-unlocking programming-type bar code symbols.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system of present invention employing a single linear LED illumination array for providing full field illumination within the entire FOV of the system.
Another object of the present invention is to provide a method of reducing glare produced from an LED-based illumination array employed in a digital image capture and processing system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system employing a prismatic illumination-focusing lens component, integrated within the imaging window of the present invention.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system having a multi-interface I/O subsystem employing a software-controlled automatic communication interface test/detection process that is carried out over a cable connector physically connecting the I/O ports of the digital image capture and processing subsystem and its designated host system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system supporting a method of programming a set of system configuration parameters (SCPs) within system during the implementation of the communication interface with a host system.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system which once initially programmed, avoids the need read individual programming codes at its end-user deployment environment in order to change additional configuration parameters (e.g. symbologies, prefixes, suffixes, data parsing, etc.) for a particular communication interface supported by the host system environment in which it has been deployed.
Another object of the present invention is to provide such hand-supportable digital image capture and processing system offering significant advantages including, for example, a reduction in the cost of ownership and maintenance, with a significant improvement in convenience and deployment flexibility within an organizational environment employing diverse host computing system environments.
Another object of the present invention is to provide a hand-supportable digital image capture and processing system, which employs or incorporates automatic gyroscopic-based image stabilization technology within the image formation and detection subsystem, so as to enable the formation and detection of crystal clear images in the presence of environments characterized by hand jitter, camera platform vibration, and the like.
Another object of the present invention is to provide such a hand-supportable digital image capture and processing system, wherein the automatic gyroscopic-based image stabilization technology employs FOV imaging optics and FOV folding mirrors which are gyroscopically stabilized, with a real-time image stabilization system employing multiple accelometers.
These and other objects of the present invention will become more apparently understood hereinafter and in the Claims to Invention appended hereto.
For a more complete understanding of how to practice the Objects of the Present Invention, the following Detailed Description of the Illustrative Embodiments can be read in conjunction with the accompanying Drawings, briefly described below.
FIG. 5E1 is a schematic representation of transmission characteristics (energy versus wavelength) associated with the red-wavelength reflecting high-pass imaging window integrated within the hand-supportable housing of the digital image capture and processing system of the present invention, showing that optical wavelengths above 700 nanometers are transmitted and wavelengths below 700 nm are substantially blocked (e.g. absorbed or reflected);
FIG. 5E2 is a schematic representation of transmission characteristics (energy versus wavelength) associated with the low-pass optical filter element disposed after the high-pass optical filter element within the digital image capture and processing system, but before its CMOS image detection array, showing that optical wavelengths below 620 nanometers are transmitted and wavelengths above 620 nm are substantially blocked (e.g. absorbed or reflected);
FIG. 5E3 is a schematic representation of the transmission characteristics of the narrow-based spectral filter subsystem integrated within the hand-supportable image capture and processing system of the present invention, plotted against the spectral characteristics of the LED-emissions produced from the Multi-Mode LED-Based Illumination Subsystem of the illustrative embodiment of the present invention;
FIG. 14A1 is a perspective view of the hand-supportable digital image capture and processing system of the first illustrative embodiment, shown operated according to a method of hand-held digital imaging for the purpose of reading bar code symbols from a bar code symbol menu, involving the generation of a visible linear target illumination beam from the system, targeting a programming code symbol therewith, and then illuminating the bar code symbol with wide-field illumination during digital imaging operations over a narrowly-confined active region in the FOV centered about the linear targeting beam;
FIG. 14A2 is a perspective cross-sectional view of the hand-supportable digital image capture and processing system of the first illustrative embodiment in FIG. 14A1, shown operated according to the method of hand-held digital imaging used to read bar code symbols from a bar code symbol menu, involving the steps of (i) generating a visible linear target illumination beam from the system, (ii) targeting a programming-type code symbol therewithin, and then (iii) illuminating the bar code symbol within a wide-area field of illumination during digital imaging operations over a narrowly-confined active region in the FOV centered about the linear targeting beam;
FIGS. 15A1 through 15A3, taken together, show a flow chart describing the control process carried out within the countertop-supportable digital image capture and processing system of the first illustrative embodiment during its first hands-free (i.e. presentation/pass-through) method of digital imaging in accordance with the principles of the present invention, involving the use of its automatic object motion detection and analysis subsystem and both of its snap-shot and video (imaging) modes of subsystem operation;
FIGS. 17A1 and 17A2, taken together, shows a flow chart describing the control process carried out within the countertop-supportable digital image capture and processing system of the first illustrative embodiment during its third hands-free method of digital imaging in accordance with the principles of the present invention, involving the use of its automatic object motion detection and analysis subsystem and video imaging mode of subsystem operation;
FIGS. 19A1 through 19A2, taken together, show a flow chart describing the control process carried out within the hand-supportable digital image capture and processing system of the first illustrative embodiment during its second hand-held method of digital imaging in accordance with the principles of the present invention, involving the use of its automatic object motion detection and analysis subsystem and video imaging mode of subsystem operation;
FIG. 21A1 through 21A2, taken together, show a flow chart describing the control process carried out within the hand-supportable digital image capture and processing system of the first illustrative embodiment during its fourth hand-held method of digital imaging in accordance with the principles of the present invention, involving the use of its manually-actuatable trigger switch and video imaging mode of subsystem operation;
FIGS. 32B1 and 32B2 set forth a schematic block diagram representation of an exemplary implementation of the electronic and photonic aspects of the digital image capture and processing system of the third illustrative embodiment of the present invention, whose components are supported on the PC board assembly of the present invention;
FIG. 33C1 is a cross-sectional partially cut-away view of the digital image capture and processing system of the third illustrative embodiment, taken along lines 33C1-33C1 in
FIG. 33C2 is a cross-sectional view of the prismatic lens component integrated within the upper edge portion of the imaging window of the present invention, employed in the digital image capture and processing system of the third illustrative embodiment, and showing the propagation of light rays from an LED in the linear LED array, and through the prismatic lens component, into the FOV of the system;
FIG. 33G1 is a gray scale image of 1280 pixels by 768 pixels showing the spatial intensity profile of the field of illumination produced from the illumination system of the system at 50 mm from the imaging window, over an exposure duration of 0.5 milliseconds, wherein each pixel has an intensity value ranging from 0 to 255, and due to the illumination design scheme of the illustrative embodiment, the center portion of the intensity profile has a larger intensity value than the edge portion;
FIG. 33G2 is a graphical representation of the horizontal cross section of the spatial intensity profile of FIG. 33G1, taken at the center of the FOV, and showing a drop off in spatial intensity when moving from the center of the FOV to its edge, and wherein “noise-like” structures are gray scale values for the 1280 pixels in the grey scale image, whereas the solid smooth line is the curve fitted result of the fluctuation in grey scale image pixel values, showing the average intensity value drop off from the center of the image, to its edge;
FIG. 33H1 is a gray scale image of 1280 pixels by 768 pixels showing the spatial intensity profile of the field of illumination produced from the illumination system of the system at 75 mm from the imaging window, over an exposure duration of 0.5 milliseconds, wherein each pixel has an intensity value ranging from 0 to 255, and due to the illumination design scheme of the illustrative embodiment, the center portion of the intensity profile has a larger intensity value than the edge portion;
FIG. 33H2 is a graphical representation of the horizontal cross section of the spatial intensity profile of FIG. 33H1, taken at the center of the FOV, and showing a drop off in spatial intensity when moving from the center of the FOV to its edge, and wherein “noise-like” structures are gray scale values for the 1280 pixels in the grey scale image, whereas the solid smooth line is the curve fitted result of the fluctuation in grey scale image pixel values, showing the average intensity value drop off from the center of the image, to its edge;
FIG. 33I1 is a gray scale image of 1280 pixels by 768 pixels showing the spatial intensity profile of the field of illumination produced from the illumination system of the system at 100 mm from the imaging window, over an exposure duration of 0.5 milliseconds, wherein each pixel has an intensity value ranging from 0 to 255, and due to the illumination design scheme of the illustrative embodiment, the center portion of the intensity profile has a larger intensity value than the edge portion;
FIG. 33I2 is a graphical representation of the horizontal cross section of the spatial intensity profile of FIG. 33I1, taken at the center of the FOV, and showing a drop off in spatial intensity when moving from the center of the FOV to its edge, and wherein “noise-like” structures are gray scale values for the 1280 pixels in the grey scale image, whereas the solid smooth line is the curve fitted result of the fluctuation in grey scale image pixel values, showing the average intensity value drop off from the center of the image, to its edge;
FIG. 33J1 is a gray scale image of 1280 pixels by 768 pixels showing the spatial intensity profile of the field of illumination produced from the illumination system of the system at 125 mm from the imaging window, over an exposure duration of 0.5 milliseconds, wherein each pixel has an intensity value ranging from 0 to 255, and due to the illumination design scheme of the illustrative embodiment, the center portion of the intensity profile has a larger intensity value than the edge portion;
FIG. 33J2 is a graphical representation of the horizontal cross section of the spatial intensity profile of FIG. 33J1, taken at the center of the FOV, and showing a drop off in spatial intensity when moving from the center of the FOV to its edge, and wherein “noise-like” structures are gray scale values for the 1280 pixels in the grey scale image, whereas the solid smooth line is the curve fitted result of the fluctuation in grey scale image pixel values, showing the average intensity value drop off from the center of the image, to its edge;
FIG. 33K1 is a gray scale image of 1280 pixels by 768 pixels showing the spatial intensity profile of the field of illumination produced from the illumination system of the system at 50 mm from the imaging window, over an exposure duration of 0.5 milliseconds, wherein each pixel has an intensity value ranging from 0 to 255, and due to the illumination design scheme of the illustrative embodiment, the center portion of the intensity profile has a larger intensity value than the edge portion;
FIG. 33K2 is a graphical representation of the horizontal cross section of the spatial intensity profile of FIG. 33K1, taken at the center of the FOV, and showing a drop off in spatial intensity when moving from the center of the FOV to its edge, and wherein “noise-like” structures are gray scale values for the 1280 pixels in the grey scale image, whereas the solid smooth line is the curve fitted result of the fluctuation in grey scale image pixel values, showing the average intensity value drop off from the center of the image, to its edge;
FIGS. 43B1 and 43B2 set forth a schematic diagram for the interface switching module employed in the multi-interface I/O subsystem of
FIGS. 43C1 and 43C2 set forth a flow chart describing the automatic interface detection process carried out within the multi-interface I/O subsystem of
Referring to the figures in the accompanying Drawings, the various illustrative embodiments of the hand-supportable and countertop-supportable digital image capture and processing systems of the present invention will be described in great detail, wherein like elements will be indicated using like reference numerals.
Hand-Supportable/Countertop-Supportable Digital Image Capture and Processing System of the First Illustrative Embodiment of the Present Invention
Referring to
In alternative embodiments of the present invention, the form factor of the hand-supportable/countertop-supportable housing of the illustrative embodiments might be different. In yet other alternative embodiments, the housing need not be hand-supportable or countertop-supportable, as disclosed herein, but rather might be designed for stationary or permanent installation above a desktop or countertop surface, are a point-of-sale (POS) station, or a commercial or industrial environment requiring digital imaging for one or more particular applications.
Schematic Block Functional Diagram as System Design Model for the Digital Image Capture and Processing System of the Present Invention
As shown in the system design model of
In general, the primary function of the object motion detection and analysis subsystem 20 is to automatically produce an object detection field 32 within the FOV 33 of the image formation and detection subsystem 21, detect the presence of an object within predetermined regions of the object detection field 32, as well as motion and velocity information about the object therewithin, and generate control signals which are supplied to the system control subsystem 30 for indicating when and where an object is detected within the object detection field of the system.
In the first illustrative embodiment, the image formation and detection (i.e. camera) subsystem 21 includes image formation (camera) optics 34 for providing a field of view (FOV) 33 upon an object to be imaged and a CMOS area-type image detection array 35 for detecting imaged light reflected off the object during illumination and image acquisition/capture operations.
In the first illustrative embodiment, the primary function of the multi-mode LED-based illumination subsystem 22 is to produce a near-field wide-area illumination field 36 from the near field LED array 23A when an object is automatically detected within the near-field portion of the FOV, and a far-field wide-area illumination field 37 from the far-field LED array 23B when an object is detected within the far-field portion of the FOV. Notably, each such field of illumination has a narrow optical-bandwidth and is spatially confined within the FOV of the image formation and detection subsystem 21 during near and far field modes of illumination and imaging, respectively. This arrangement is designed to ensure that only narrow-band illumination transmitted from the illumination subsystem 22, and reflected from the illuminated object, is ultimately transmitted through a narrow-band transmission-type optical filter subsystem 40 within the system and reaches the CMOS area-type image detection array 35 for detection and processing, whereas all other components of ambient light collected by the light collection optics are substantially rejected at the image detection array 35, thereby providing improved SNR thereat, thus improving the performance of the system. In the illustrative embodiment, the narrow-band transmission-type optical filter subsystem 40 is realized by (1) high-pass (i.e. red-wavelength reflecting) filter element 40A embodied within at the imaging window 3, and (2) low-pass filter element 40B mounted either before the CMOS area-type image detection array 35 or anywhere after beyond the high-pass filter element 40A, including being realized as a dichroic mirror film supported on at least one of the FOV folding mirrors 74 and 75. FIG. 5E3 sets forth the resulting composite transmission characteristics of the narrow-band transmission spectral filter subsystem 40, plotted against the spectral characteristics of the emission from the LED illumination arrays employed in the LED-based illumination subsystem 22.
The primary function of the automatic light exposure measurement and illumination control subsystem 24 is two fold: (1) to measure, in real-time, the power density [joules/cm] of photonic energy (i.e. light) collected by the optics of the system at about its image detection array 35, and generate auto-exposure control signals indicating the amount of exposure required for good image formation and detection; and (2) in combination with illumination array selection control signal provided by the system control subsystem 30, automatically drive and control the output power of selected LED arrays 23A and 23B in the illumination subsystem 22, so that objects within the FOV of the system are optimally exposed to LED-based illumination and optimal images are formed and detected at the image detection array 35.
The primary function of the image capturing and buffering subsystem 25 is to (1) detect the entire 2-D image focused onto the 2D image detection array 35 by the image formation optics 34 of the system, (2) generate a frame of digital pixel data for either a selected region of interest of the captured image frame, or for the entire detected image, and then (3) buffer each frame of image data as it is captured. Notably, in the illustrative embodiment, a single 2D image frame (31) is captured during each image capture and processing cycle, or during a particular stage of a processing cycle, so as to eliminate the problems associated with image frame overwriting, and synchronization of image capture and decoding processes, as addressed in U.S. Pat. Nos. 5,932,862 and 5,942,741 assigned to Welch Allyn, and incorporated herein by reference.
The primary function of the digital image processing subsystem 26 is to process digital images that have been captured and buffered by the image capturing and buffering subsystem 25, during both far-field and near-field modes of illumination and operation. Such image processing operation includes image-based bar code decoding methods described in detail hereinafter and in U.S. Pat. No. 7,128,266, incorporated herein by reference.
The primary function of the input/output subsystem 27 is to support universal, standard and/or proprietary data communication interfaces with external host systems and devices, and output processed image data and the like to such external host systems or devices by way of such interfaces. Examples of such interfaces, and technology for implementing the same, are given in U.S. Pat. Nos. 6,619,549 and 6,619,549, incorporated herein by reference in its entirety.
The primary function of the System Control Subsystem is to provide some predetermined degree of control, coordination and/or management signaling services to each subsystem component integrated within the system, as shown. While this subsystem can be implemented by a programmed microprocessor, in the preferred embodiments of the present invention, this subsystem is implemented by the three-tier software architecture supported on microcomputing platform shown in
The primary function of the manually-activatable trigger switch 5 integrated with the hand-supportable/countertop-supportable housing is to enable the user to generate a control activation signal (i.e. trigger event signal) upon manually depressing the same (i.e. causing a trigger event), and to provide this control activation signal to the system control subsystem for use in carrying out its complex system and subsystem control operations, described in detail herein.
The primary function of the system configuration parameter table 29 in system memory is to store (in non-volatile/persistent memory) a set of system configuration and control parameters (i.e. SCPs) for each of the available features and functionalities, and programmable modes of system operation supported in any particular embodiment of the present invention, and which can be automatically read and used by the system control subsystem 30 as required during its complex operations. Notably, such SCPs can be dynamically managed as taught in great detail in copending U.S. patent application Ser. No. 11/640,814 filed Dec. 18, 2006, incorporated herein by reference.
The detailed structure and function of each subsystem will now be described in detail above.
Specification of the System Implementation Model for the Digital Image Capture and Processing System of the Present Invention
As shown in
During image acquisition operations, the image pixels are sequentially read out of the image detection array 35. Although one may choose to read column-wise or row-wise for some CMOS image sensors, without loss of generality, the row-by-row read out of the data is preferred. The pixel image data set is arranged in the SDRAM 48 sequentially, starting at address OXAOEC0000. To randomly access any pixel in the SDRAM is a straightforward matter: the pixel at row y ¼ column x located is at address (OXAOEC0000+y×1280+x). As each image frame always has a frame start signal out of the image detection array 35, that signal can be used to start the DMA process at address OXAOEC0000, and the address is continuously incremented for the rest of the frame. But the reading of each image frame is started at address OXAOEC0000 to avoid any misalignment of data. Notably, however, if the microprocessor 46 has programmed the CMOS image detection array 35 to have a ROI window, then the starting address will be modified to (OXAOEC0000+1280 X R1), where R1 is the row number of the top left corner of the ROI. Further details regarding memory access are described in Applicant's prior U.S. Pat. No. 7,128,266, incorporated herein by reference.
Specification of the Multi-Mode LED-Based Illumination Subsystem Employed in the Hand-Supportable Digital Image Capture and Processing System of the Present Invention
In the illustrative embodiment shown in
As shown in
As shown in
As shown in
During system operation, the far-field illumination mode of the multi-mode illumination subsystem 22 is automatically activated in response to detecting that an object resides within the far-field portion of the FOV by the IR object motion detection and analysis subsystem. In response thereto, the multi-mode illumination subsystem 22 drives the far-field illumination array 23B to illuminate the far-field portion of the FOV, as shown in
In general, the multi-mode illumination subsystem 22 is designed to cover the entire optical field of view (FOV) of the digital image capture and processing system with sufficient illumination to generate high-contrast images of bar codes located at both short and long distances from the imaging window.
As shown in
Notably, in the illustrative embodiment, the red-wavelength reflecting high-pass optical filter element 40A is embodied within the imaging window panel 3, whereas the low-pass optical filter element 40B is disposed before the image detection array 35 either disposed among the focusing lens elements of the image formation optics 34, or realized as a dichroic surface on one of the FOV folding mirrors 74 and 75. This forms the integrated narrow-band optical filter subsystem 40 which ensures that the object within the FOV is imaged at the image detection array 35 using only spectral components within the narrow-band of illumination produced from the illumination subsystem 22, while all other components of ambient light outside this narrow range (e.g. 15 nm) are substantially rejected.
Specification of the Digital Image Formation and Detection (i.e. IFD or Camera) Subsystem During its Wide-Area Mode of Digital Image Formation and Detection, Supported by Near and Far Fields of Narrow-Band Wide-Area Illumination
As shown in FIGS. 5A through 5G2 and 6A through 6C, the digital image formation and detection subsystem 21 of the illustrative embodiment has a wide-area 2D image capture mode of operation where either substantially all or a selected region of pixels in its CMOS image detection array 35 are enabled. However, the image formation and detection subsystem 21 can also be easily programmed to support other modes of image capture, namely: (i) a narrow-area image capture mode in which only a few central rows of pixels about the center of the image detection array are enabled, as disclosed in U.S. Pat. No. 7,128,266 and U.S. application Ser. No. 10/989,220, and incorporated herein by reference, and (ii) a wide-area image capture mode in which a predetermined region of interest (ROI) on the CMOS image sensing array is visibly marked as being a region in which its pixel data will be cropped and processed for reading information graphically encoded within the ROI region of captured images, as disclosed in U.S. application Ser. No. 10/989,220 supra.
As shown in
In
Specification of the Narrow-Band Optical Filter Subsystem Integrated within the Housing of the Digital Image Capture and Processing System of the Present Invention
As shown in FIGS. 5D through 5E3, the housing of the digital image capture and processing system of the present invention has integrated within its housing, narrow-band optical filter subsystem 40 for transmitting substantially only the very narrow band of wavelengths (e.g. 620-700 nanometers) of visible illumination produced from the narrow-band multi-mode illumination subsystem 22, and rejecting all other optical wavelengths outside this narrow optical band however generated (i.e. ambient light sources). As shown, narrow-band optical filter subsystem 40 comprises: (i) high-pass (i.e. red-wavelength reflecting) optical filter element 40A embodied within the plastic imaging window; and (ii) low-pass optical filter element 40B disposed before the CMOS image detection array 35. as described above. Alternatively, the high-pass (i.e. red-wavelength reflecting) optical filter element 40A can be embodied as a dichroic film applied to the surface of one of its FOV folding mirrors 74 or 75 employed in the image formation and detection subsystem. Preferably, the red-color window filter 40A will have substantially planar surface characteristics over its central planar region 3A to avoid focusing or defocusing of light transmitted therethrough during imaging operations. During system operation, these optical filter elements 40A and 40B optically cooperate to form a narrow-band optical filter subsystem 40 transmitting substantially only the very narrow band of wavelengths (e.g. 620-700 nanometers) of visible illumination produced from the LED-based illumination subsystem 22 and reflected/scattered off the illuminated object, while rejecting all other optical wavelengths outside this narrow optical band however generated (i.e. ambient light sources).
Alternatively, the band-pass optical filter subsystem 40 may also be realized as an integrated multi-layer filter structure disposed anywhere before its CMOS image detection array 35, or even within the imaging window 3 itself.
As shown in FIG. 5E1, the light transmission characteristics (energy versus wavelength) associated with the low-pass optical filter element 40B indicate that optical wavelengths below 620 nanometers are transmitted therethrough, whereas optical wavelengths above 620 nm are substantially blocked (e.g. absorbed or reflected).
As illustrated in FIG. 5E2, optical wavelengths greater than 620 nanometers are transmitted through the high-pass optical filter element 40B, while optical wavelengths less than 620 nm are substantially blocked (e.g. absorbed or reflected).
FIG. 5E3 shows the transmission characteristics of the narrow-based spectral filter subsystem 40, plotted against the spectral characteristics of the LED-emissions produced from the LED-arrays in the Multi-Mode LED-Based Illumination Subsystem of the illustrative embodiment of the present invention. Notably, the pass-bandwidth of the optical filtering subsystem 40 is slightly greater than the bandwidth of the laser illumination beam generated by the multi-mode illumination subsystem.
During system operation, spectral band-pass filter subsystem 40 greatly reduces the influence of the ambient light, which falls upon the CMOS image detection array 35 during the image capturing operations.
By virtue of the optical filter of the present invention, an optical shutter mechanism is eliminated in the system. In practice, the optical filter can reject more than 85% of incident ambient light, and in typical environments, the intensity of LED illumination is significantly more than the ambient light on the CMOS image detection array 35. Thus, while an optical shutter is required in nearly most conventional CMOS imaging systems, the digital image capture and processing system of the present invention effectively manages the time that the CMOS image detection array 35 is exposed to narrow-band illumination by controlling the time duration that LED-based illumination arrays 23A and 23B generate and project illumination into the FOV in which the object is detected. This method of illumination control is achieved using control signals generated by (i) the CMOS image detection array 35 and (ii) the automatic light exposure measurement and illumination control subsystem 24 in response to real-time measurements of light exposure within the central portion of the FOV, while the delivery of narrow-band illumination is controllably delivered to the object in the FOV by operation of the band-pass optical filter subsystem 40 described above. The result is a simple system design, without moving parts, and having a reduced manufacturing cost.
In
Details regarding a preferred method of designing the image formation (i.e. camera) optics within the image-based bar code reader of the present invention using the modulation transfer function (MTF) are described in Applicants' U.S. Pat. No. 2,270,272, incorporated herein by reference.
Specification of the Automatic Zoom/Focus Mechanism Integrated within the Image Formation and Detection Subsystem of the Digital Image Capture and Processing System of the Present Invention
As shown in
Specification of Modes of Operation of the Area-Type Image Sensing Array Employed in the Digital Image Formation and Detection Subsystem of the Present Invention
In the digital image capture and processing system 1 of the present invention, the CMOS area-type image detection array 35 supports several different modes of suboperation, namely: a Single Frame Shutter Mode (i.e. Snap-Shot Mode) of the operation illustrated in
The Single Frame Shutter Mode (i.e. Snap-Shot Mode) of the Operation
Referring to
The Real Video Mode of the Operation
Referring to
The Periodic Snap Shot (“Pseudo-Video”) Mode of the Operation
Referring to
Specification of the Automatic Object Motion Detection and Analysis Subsystem of the Present Invention: Various Ways to Realize Said Subsystem in Practice
As shown in
In general, automatic object motion detection and analysis subsystem 20 operates as follows. In system modes of operation requiring automatic object presence and/or range detection, automatic object motion detection and analysis subsystem 20 will be activated at system start-up and operational at all times of system operation, typically continuously providing the system control subsystem 30 with information about the state of objects within the object detection field 32 of the imaging-based system of the first illustrative embodiment. During such operation, the system control subsystem responds to such state information and generates control activation signals during particular stages of the system control process, such as, for example, control activation signals which are provided to system control subsystem 30 for (i) activating either the near-field and/or far-field LED illumination arrays, and (ii) controlling how strongly these LED illumination arrays 23A, 23B should be driven to ensure quality image exposure at the CMOS image detection array 35.
It is appropriate at this juncture to describe these different kinds of object motion detection and analysis subsystem hereinbelow.
Automatic Object Motion and Analysis Detection Subsystem Realized Using a Pair of Infra-Red (IR) Transmitting and Receiving Laser Diodes
As shown in
Automatic Object Motion and Analysis Detection Subsystem Realized Using an IR-Based Image Sensing and Processing Device
As shown in
Automatic Object Motion Detection and Analysis Subsystem Realized Using an IR-Based LADAR Pulse-Doppler Based Object Motion and Velocity Detection Device
As shown in
While several techniques have been detailed above for automatically detecting the motion and velocity of objects within the FOV of the digital image capture and processing system of the present invention, it understood that other methods may be employed, as disclosed, for example, in great detail in Applicants' copending application Ser. No. 11/489,259 filed Jul. 19, 2006 and Ser. No. 11/880,087 filed Jul. 19, 2007, both being incorporated herein by reference, in their entirety.
Specification of the Automatic Linear Targeting Illumination Subsystem of the Present Invention
Referring to
As shown in
Specification of the Automatic Light Exposure Measurement and Illumination Control Subsystem of the Present Invention
Referring to
As shown in
During object illumination and imaging operations, narrow-band light from the LED arrays 23A and/or 23B is reflected from the target object (at which the digital imager is aimed) and is accumulated by the CMOS image detection array 35. The object illumination process must be carried out for an optimal duration so that each acquired digital image frame has good contrast and is not saturated. Such conditions are required for consistent and reliable bar code decoding operation and performance.
In order to automatically control the brightness and contrast of acquired images, the automatic light exposure measurement and illumination control subsystem 24 carries out the following operations: (i) it automatically measures the amount of light reflected from the target object (i.e measured light exposure at the image plane of the CMOS imaging sensing array); (ii) it automatically calculates the maximum time that the CMOS image detection array 35 should be kept exposed to the actively-driven LED-based illumination array 23A (23B) associated with the multi-mode illumination subsystem 22; (iii) it automatically controls the time duration that the illumination subsystem 22 illuminates the target object with narrow-band illumination generated from the activated LED illumination array; and then (iv) it automatically deactivates the illumination array when the calculated time to do so expires (i.e. lapses).
By virtue of its operation, the automatic light exposure measurement and illumination control subsystem 24 eliminates the need for a complex shuttering mechanism for CMOS-based image detection array 35. This novel mechanism ensures that the digital image capture and processing system of the present invention generates non-saturated images with enough brightness and contrast to guarantee fast and reliable image-based bar code decoding in demanding end-user applications.
Specification of the System Control Subsystem of the Present Invention
Referring to
As shown in
Also, as illustrated, system control subsystem 30 controls the image detection array 35, the illumination subsystem 22, and the automatic light exposure measurement and illumination control subsystem 24 in each of the submodes of operation of the imaging detection array, namely: (i) the snap-shot mode (i.e. single frame shutter mode) of operation; (ii) the real-video mode of operation; and (iii) the pseudo-video mode of operation. Each of these modes of image detection array operation will be described in greater detail below.
Single Frame Shutter Mode (i.e. Snap-Shot Mode) of the Sub-Operation Supported by CMOS Image Detection Array
When the single frame shutter mode (i.e. snap-shot mode) of the sub-operation is selected, as shown in
Notably, during this single frame shutter mode (i.e. snap-shot mode) of the sub-operation, a novel exposure control method is used to ensure that all rows of pixels in the CMOS image detection array have a common integration time, thereby capturing high quality images even when the object is in a state of high speed motion, relative to the image sensing array. This novel exposure control technique shall be referred to as “the global exposure control method” of the present invention, which is described in great detail in the flow chart of
Real-Video Mode of the Sub-Operation Supported by CMOS Image Detection Array
When the real-video mode of sub-operation is selected, as shown in
Periodic Snap Shot (“Pseudo-Video”) Mode of the Operation Supported by the CMOS Image Detection Array
When the periodic snap shot (“pseudo-video”) mode of sub-operation is selected, as shown in
Specification of the Three-Tier Software Architecture of the Digital Image Capture and Processing System of the First Illustrative Embodiment of the Present Invention
As shown in
While the operating system layer of the digital image capture and processing system is based upon the Linux operating system, it is understood that other operating systems can be used (e.g. Microsoft Windows, Apple Mac OSX, Unix, etc), and that the design preferably provides for independence between the main Application Software Layer and the Operating System Layer, and therefore, enables of the Application Software Layer to be potentially transported to other platforms. Moreover, the system design principles of the present invention provides an extensibility of the system to other future products with extensive usage of the common software components, decreasing development time and ensuring robustness.
In the illustrative embodiment, the above features are achieved through the implementation of an event-driven multi-tasking, potentially multi-user, Application layer running on top of the System Core software layer, called SCORE. The SCORE layer is statically linked with the product Application software, and therefore, runs in the Application Level or layer of the system. The SCORE layer provides a set of services to the Application in such a way that the Application would not need to know the details of the underlying operating system, although all operating system APIs are, of course, available to the application as well. The SCORE software layer provides a real-time, event-driven, OS-independent framework for the product Application to operate. The event-driven architecture is achieved by creating a means for detecting events (usually, but not necessarily, when the hardware interrupts occur) and posting the events to the Application for processing in real-time manner The event detection and posting is provided by the SCORE software layer. The SCORE layer also provides the product Application with a means for starting and canceling the software tasks, which can be running concurrently, hence, the multi-tasking nature of the software system of the present invention.
Specification of Software Modules within the Score Layer of the System Software Architecture Employed in the Digital Image Capture and Processing System of the Present Invention
The SCORE layer provides a number of services to the Application layer.
The Tasks Manager provides a means for executing and canceling specific application tasks (threads) at any time during the product Application run.
The Events Dispatcher provides a means for signaling and delivering all kinds of internal and external synchronous and asynchronous events
When events occur, synchronously or asynchronously to the Application, the Events Dispatcher dispatches them to the Application Events Manager, which acts on the events accordingly as required by the Application based on its current state. For example, based on the particular event and current state of the application, the Application Events Manager can decide to start a new task, or stop currently running task, or do something else, or do nothing and completely ignore the event.
The Input/Output Manager provides a means for monitoring activities of input/output devices and signaling appropriate events to the Application when such activities are detected.
The Input/Output Manager software module runs in the background and monitors activities of external devices and user connections, and signals appropriate events to the Application Layer, which such activities are detected. The Input/Output Manager is a high-priority thread that runs in parallel with the Application and reacts to the input/output signals coming asynchronously from the hardware devices, such as serial port, user trigger switch 2C, bar code reader, network connections, etc. Based on these signals and optional input/output requests (or lack thereof) from the Application, it generates appropriate system events, which are delivered through the Events Dispatcher to the Application Events Manager as quickly as possible as described above.
The User Commands Manager provides a means for managing user commands, and utilizes the User Commands Table provided by the Application, and executes appropriate User Command Handler based on the data entered by the user.
The Input/Output Subsystem software module provides a means for creating and deleting input/output connections and communicating with external systems and devices
The Timer Subsystem provides a means of creating, deleting, and utilizing all kinds of logical timers.
The Memory Control Subsystem provides an interface for managing the multi-level dynamic memory with the device, fully compatible with standard dynamic memory management functions, as well as a means for buffering collected data. The Memory Control Subsystem provides a means for thread-level management of dynamic memory. The interfaces of the Memory Control Subsystem are fully compatible with standard C memory management functions. The system software architecture is designed to provide connectivity of the device to potentially multiple users, which may have different levels of authority to operate with the device.
The User Commands Manager, which provides a standard way of entering user commands, and executing application modules responsible for handling the same. Each user command described in the User Commands Table is a task that can be launched by the User Commands Manager per user input, but only if the particular user's authority matches the command's level of security.
The Events Dispatcher software module provides a means of signaling and delivering events to the Application Events Manager, including the starting of a new task, stopping a currently running task, or doing something or nothing and simply ignoring the event.
Specification of Software Modules within the Application Layer of the System Software Architecture Employed in the Digital Image Capture and Processing System of the Present Invention
The image processing software employed within the system hereof performs its bar code reading function by locating and recognizing the bar codes within the frame of a captured digital image comprising pixel data. The modular design of the image processing software provides a rich set of image processing functions, which can be utilized in future applications, related or not related to bar code symbol reading, such as: optical character recognition (OCR) and verification (OCV); reading and verifying directly marked symbols on various surfaces; facial recognition and other biometrics identification; etc.
The Area Image Capture Task, in an infinite loop, performs the following task. It illuminates the entire field-of-view (FOV) and acquires a wide-area (e.g. 2D) digital image of any objects in the FOV. It then attempts to read bar code symbols represented in the captured frame of image data using the image processing software facilities supported by the digital image processing subsystem 26 to be described in greater detail hereinafter. If a bar code symbol is successfully read, then subsystem 26 saves the decoded data in the special decode data buffer. Otherwise, it clears the decode data buffer. Then, it continues the loop. The Area Image Capture Task routine never exits on its own. It can be canceled by other modules in the system when reacting to other events. For example, when a user pulls the trigger switch 5, the event TRIGGER_ON is posted to the Application. The Application software responsible for processing this event, checks if the Area Image Capture Task is running, and if so, it cancels it and then starts the Main Task. The Area Image Capture Task can also be canceled upon OBJECT_DETECT_OFF event, posted when the user moves the digital imager away from the object, or when the user moves the object away from the digital imager. The Area Image Capture Task routine is enabled (with Main Task) when “semi-automatic-triggered” system modes of programmed operation are to be implemented on the digital image capture and processing platform of the present invention.
The Linear Targeting Illumination Task is a simple routine which is enabled (with Main Task) when manually or automatically triggered system modes of programmed are to be implemented on the illumination and imaging platform of the present invention.
Various bar code symbologies are supported by the digital image capture and processing system of the present invention. Supported bar code symbologies include: Code 128; Code 39; I2of5; Code93; Codabar; UPC/EAN; Telepen; UK-Plessey; Trioptic; Matrix 2of5; Ariline 2of5; Straight 2of5; MSI-Plessey; Code11; and PDF417.
Specification of Method of Reading a Programming-Type Bar Code Symbol Using the Hand-Supportable Digital Image Capture and Processing System of the Present Invention
Referring to FIGS. 14A1 and 14A2, a novel method of reading a “programmable bar code symbol” using the digital image capture and processing system of the present invention will now be described.
As shown in FIG. 14A1, when configured in the programming-type bar code reading mode of the present invention, the image capture and processing system of the present invention automatically generates a visible linear target illumination beam upon detection of the target menu, enabling the user/operator to target a programming-type code symbol with the visible targeting illumination beam. As shown in FIG. 14A2, with the programming bar code symbol aligned with the targeting illumination beam, the operator then manually actuates the trigger switch 5 and in response thereto, the system automatically generates a field of illumination within the FOV which illuminates the targeted programming-type bar code symbol, while (i) only an imaged subregion of the FOV, centered about the linear targeting illumination beam, is made decode-processing activated during illumination and imaging operations, and (ii) the linear targeting illumination beam is deactivated (i.e. turned off). This technique enables only a narrow-area image, centered about the reference location of the linear illumination targeting beam, to be captured and decode processed, for the purpose of decoding the targeted programming-type bar code symbol, which is typically a 1D symbology. By virtue of the present invention here, it is possible to avoid the inadvertent reading of multiple programming-type bar code symbols (i) printed on a bar code menu page or sheet, or (ii) displayed on a LCD display screen, as the case may be.
Specification of the Various Modes of Operation in the Digital Image Capture and Processing System of the Present Invention
The digital image capture and processing system of the illustrative embodiment supports many different methods and modes of digital image capture and processing. Referring to FIGS. 15A1 through 22D, a number of these methods will now be described in detail below.
First Illustrative Method of Hands-Free Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to FIGS. 15A1 through 15D, a first illustrative method of hands-free (i.e. presentation/pass-through) digital imaging will be described using the digital image capture and processing system of the first illustrative embodiment, wherein its image formation and detection subsystem is operated in either (i) snap-shot and real video modes of sub-operation of the CMOS image sensing array 35, illustrated in
The flow chart shown in FIGS. 15A1 through 15A3 describes the primary steps involved in carrying out the first illustrative method of hands-free (i.e. presentation/pass-through) digital imaging according to the present invention.
As shown at Block A in FIG. 15A1, the system is configured by enabling the automatic object presence detector, and the IFD subsystem (i.e. CMOS image sensing array) initialized in the snap-shot mode of suboperation. At this stage, this system is ready to be used as shown in
Then at Block B, the system control subsystem determines whether or not the object is detected in the FOV. If the object is not present in the FOV, the system continues to this check this condition about Block B. If the object is detected at Block B, then the system control subsystem proceeds to Block C and sets the operation of the Timer (0<t1<T1), configures the IFD subsystem in a video mode (e.g. real or pseudo video mode) as shown
If at Block E, the system control subsystem determines that image processing has not produced a successful decoded output within T2, then the system proceeds to Block H and determines whether or not a PDF codec symbol has been detected. If a PDF code symbol has been detected, then at Block I more time is allowed for the image processor to code the PDF code symbol.
Then at Block J, the system control subsystem determines whether or not a PDF code symbol is in fact decoded, and if so, then at Block K, the system generates symbol character data for the decoded PDF symbol. If a PDF code symbol has not been decoded with the extra time allowed, then the system proceeds to Block L and determines whether or not the object is still in the FOV of the system. If the object has move out of the FOV, then the system returns to Block G, where the IFD subsystem is reset to its snap-shot mode (e.g. for approximately 40 milliseconds).
If, at Block L in FIG. 15A2, the system control subsystem determines that the object is still present within the FOV, then the system control subsystem proceeds to Block M and determines whether or not the time allowed for the video mode (e.g. 300 milliseconds) has lapsed. If the time allowed for video mode operation has not elapsed, then the system proceeds to Block D, where the next frame of digital image data is detected, and next frame of image data processed in an attempt to decode a code symbol within the allowed time for decoding (e.g. less than 30 ms).
If at Block M the system control subsystem determines that the time for Video Mode operation has lapsed, then the system control subsystem proceeds to Block N and reconfigures the IFD subsystem to the snap-shot mode (shown in
At Block O in FIG. 15A3, the system control subsystem determines whether or not image processing has produced decoded output, and if so, then at Block P, symbol character data (representative of the read code symbol) is generated and transmitted to the host computer.
If at Block O in FIG. 15A3 the system control subsystem determines that image processing has not produced successful decoded output, then at Block Q the system control subsystem determines whether or not the object is still present within the FOV. If it is determined at Block Q that the object is no longer present in the FOV, then the system control subsystem returns to Block G, where the IFD subsystem is reset to its snap-shot mode. However, if at Block Q the system control subsystem determines that the object is still present in the FOV, then at Block R the system control subsystem determines whether the Timer set at Block D has run out of time (t1<T1). If the Timer has run out of time (t1>T1), then the system control subsystem proceeds to Block G, where the IFD subsystem is reset to its snap-shot mode and returns to Block B to determine whether an object is present within the FOV. However, if the system control subsystem determines at a Block R that the Timer has not yet run out of time (t1<T1), then the system control subsystem proceeds to Block N, and reconfigures the IFD Subsystem to its snap-shot mode, and then acquires and processes a single digital image of the object in the FOV, allowing up to approximately 500 milliseconds to do so.
Notably, during the video mode of sub-operation, then IFD subsystem can be running either the real or pseudo video modes illustrated in
Second Illustrative Method of Hands-Free Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to
The flow chart shown in
As shown at Block A in
Then at Block B in
If at Block F, the system control subsystem determines that image processing has not produced a successful decoded output within T2, then the system proceeds to Block H and determines whether or not an object is still present within the FOV. If the object has move out of the FOV, then the system returns to Block B, where automatic object detection operations resume. If, however, at Block H in
Third Illustrative Method of Hands-Free Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to FIGS. 17A1 through 17C, a third illustrative method of hands-free (i.e. presentation/pass-through) digital imaging will be described using the digital image capture and processing system of the first illustrative embodiment, wherein its image formation and detection subsystem is operated in its video mode of operation for a first predetermined time period (e.g. approximately 5000 milliseconds), to repeatedly attempt to read a bar code symbol within one or more digital images captured during system operation.
The flow chart shown in FIG. 17A1 describes the primary steps involved in carrying out the second illustrative method of hands-free (i.e. presentation/pass-through) digital imaging according to the present invention.
As shown at Block A in FIG. 17A1, the system is configured by enabling the automatic object presence detection subsystem, and initializing (i.e. configuring) the IFD subsystem (i.e. CMOS image sensing array) in the (real or pseudo) video mode of suboperation (illustrated in
Then at Block B in FIG. 17A1, the system control subsystem determines whether or not the object is detected in the FOV. If the object is not present in the FOV, then the system continues to this check this condition about Block B. If the object is detected at Block B, then the system control subsystem proceeds to Block C and sets the operation of the Timer (0<t1<T1) and starts continuous image acquisition (i.e. object illumination and imaging operations), as shown in
Then, as indicated at Block D in FIG. 17A1, the IFD subsystem detects the next image frame of the detected object in the FOV, and the image processing subsystem processes the digital image frame in an attempt to produce a successful decoded output (e.g. decode a bar code symbol), and allow time for decoding to be no more than the image frame acquisition (e.g. t<30 ms) within about T2<30 milliseconds.
At Block E in FIG. 17A2, the system control subsystem determines whether or not image processing has produced a successful decoded output (e.g. read bar code symbol) within T2 (e.g. T2=30 ms). If image processing has produced a successful output within T2, then at Block F, the system control subsystem generates symbol character data and transmits the data to the host system, and then proceeds to Block B, where the object present detection subsystem resumes its automatic object detection operations.
If at Block F, the system control subsystem determines that image processing has not produced a successful decoded output within T2, then the system proceeds to Block H and determines whether or not an object is still present within the FOV. If the object has moved out of the FOV, then the system returns to Block B, where automatic object detection operations resume.
If, however, at Block H in FIG. 17A2, the system control subsystem determines that the object is still present within the FOV, then the system control subsystem proceeds to Block I and determines whether or not the earlier set timer T1 has lapsed. If timer T1 has not elapsed, then the system returns to Block D, where the next frame of digital image data is detected and processed in an attempt to decode a code symbol within the allowed time T2 for decoding. If at Block I, the system control subsystem determines that timer T1 has lapsed, then the system control subsystem proceeds to Block B, where automatic object detection resumes.
First Illustrative Method of Hand-Held Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to
The flow chart shown in
As shown at Block A in
Then at Block B in
If at Block F in
Second Illustrative Method of Hand-Held Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to FIGS. 19A1 through 19C, a second illustrative method of hand-held digital imaging will be described using the digital image capture and processing system of the first illustrative embodiment, wherein its image formation and detection subsystem is operated in its video mode of operation for a first predetermined time period (e.g. approximately 5000 milliseconds), to repeatedly attempt to read a bar code symbol within one or more digital images captured during system operation.
The flow chart shown in FIG. 19A1 describes the primary steps involved in carrying out the second illustrative method of hand-held digital imaging according to the present invention.
As shown at Block A in FIG. 19A1, the system is configured by enabling the automatic object presence detection subsystem, and initializing (i.e. configuring) the IFD subsystem (i.e. CMOS image sensing array) in the (real or pseudo) video mode of suboperation (illustrated in
Then at Block B in FIG. 19A1, the system control subsystem determines whether or not the object is detected in the FOV. If the object is not detected in the FOV, then the system control subsystem continues to this check this condition about Block B. If the object is detected at Block B, then the system control subsystem proceeds to Block C and sets the operation of the Timer (0<t1<T1) and starts continuous image acquisition (i.e. object illumination and imaging operations), as shown in
Then, as indicated at Block D in FIG. 19A1, the IFD subsystem detects the next image frame of the detected object in the FOV, and the image processing subsystem processes the digital image frame in an attempt to produce a successful decoded output (e.g. decode a bar code symbol), and allow time for decoding to be no more than the image frame acquisition (e.g. t<30 ms) within about T2<30 milliseconds.
At Block E in FIG. 19A2, the system control subsystem determines whether or not image processing has produced a successful decoded output (e.g. read bar code symbol) within T2 (e.g. T2=30 ms). If image processing has produced a successful output within T2, then at Block F, the system control subsystem generates symbol character data and transmits the data to the host system, and then proceeds to Block B, where the object presence detection subsystem resumes its automatic object detection operations.
If at Block E, the system control subsystem determines that image processing has not produced a successful decoded output within T2, then the system proceeds to Block H and determines whether or not a PDF code symbol has been detected within the FOV. If so, then at Block I the system control subsystem allows more time for the image processor to decode the detected PDF code symbol. Then if the system control subsystem determines, at Block J, that a PDF code symbol has been decoded at Block J, then at Block K, the image processor generates symbol character data for the decoded PDF symbol. If, at Block J, a PDF code symbol has not been decoded with the extra time allowed, then the system control subsystem proceeds to Block L and determines whether or not the object is still in the FOV of the system. If the object has moved out of the FOV, then the system returns to Block B, where the object detection subsystem resumes its automatic object detection operations.
If, at Block L in FIG. 19A2, the system control subsystem determines that the object is still present within the FOV, then the system control subsystem proceeds to Block M, where it determines whether or not the allowed time for the video mode (e.g. T1=5000 milliseconds) has elapsed the time for video mode operation has lapsed. If timer T1 has elapsed, then the system control subsystem returns to Block B, where the object detection subsystems resumes its automatic object detection operations. If timer T1 has not elapsed at Block M, then the system control subsystem returns to Block D, where the IFD subsystem detects the next image frame, and the image processor attempts to decode process a code symbol graphically represented in the captured image frame, allowing not more than frame acquisition time (e.g. less than 30 milliseconds) to decode process the image.
Third Illustrative Method of Hand-Held Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to
The flow chart shown in
As shown at Block A in
Then at Block B in
If at Block F in
Fourth Illustrative Method of Hand-Held Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to FIGS. 21A1 through 21C, a fourth illustrative method of hand-held digital imaging will be described using the hand-supportable digital image capture and processing system of the first illustrative embodiment, wherein its image formation and detection subsystem is operated in its video mode of operation for a first predetermined time period (e.g. approximately 5000 milliseconds), to repeatedly attempt to read a bar code symbol within one or more digital images captured during system operation.
The flow chart shown in FIG. 21A1 describes the primary steps involved in carrying out the second illustrative method of hand-held digital imaging according to the present invention, involving the use of its manually-actuatable trigger switch 5 and video imaging mode of subsystem operation.
As shown at Block A in FIG. 21A1, the system is configured by enabling the automatic object presence detection subsystem, and initializing (i.e. configuring) the IFD subsystem (i.e. CMOS image sensing array) in the (real or pseudo) video mode of suboperation (illustrated in
Then at Block B in FIG. 21A1, the system control subsystem determines whether or not the trigger switch 5 is manually actuated. If the object is not manually actuated at Block B, then the system control subsystem continues to this check this condition about Block B. If the trigger switch is manually actuated at Block B, then the system control subsystem proceeds to Block C and sets the operation of the Timer (0<t1<T1) and starts continuous image acquisition (i.e. object illumination and imaging operations), as shown in
Then, as indicated at Block D in FIG. 21A1, the IFD subsystem detects the next image frame of the object in the FOV, and the image processing subsystem processes the digital image frame in an attempt to produce a successful decoded output (e.g. decode a bar code symbol), and allow time for decoding to be no more than the image frame acquisition (e.g. t<30 ms) within about T2<30 milliseconds.
At Block E in FIG. 21A2, the system control subsystem determines whether or not image processing has produced a successful decoded output (e.g. read bar code symbol) within T2 (e.g. T2=30 ms). If image processing has produced a successful output within T2, then at Block F, the system control subsystem generates symbol character data and transmits the data to the host system, and then proceeds to Block B, where the system control subsystem resumes its trigger switch actuation detection operations.
If at Block E, the system control subsystem determines that image processing has not produced a successful decoded output within T2, then the system proceeds to Block H and determines whether or not a PDF code symbol has been detected within the FOV. If so, then at Block I the system control subsystem allows more time for the image processor to decode the detected PDF code symbol. Then if the system control subsystem determines, at Block J, that a PDF code symbol has been decoded at Block J, then at Block K, the image processor generates symbol character data for the decoded PDF symbol. If, at Block J, a PDF code symbol has not been decoded with the extra time allowed, then the system control subsystem proceeds to Block L and determines whether or not the object is still within the FOV. If the object is no longer in the FOV, then the system returns to Block B, where the system control subsystems resumes trigger switch actuation detection operations.
If, at Block L in FIG. 21A2, the system control subsystem determines that the object is still present within the FOV, then the system control subsystem proceeds to Block M, where it determines whether or not the allowed time for the video mode (e.g. T1=5000 milliseconds) has elapsed the time for video mode operation has lapsed. If timer T1 has elapsed, then the system control subsystem returns to Block B, where the system control subsystem resumes its detection of trigger switch actuation. If timer T1 has not elapsed at Block M, then the system control subsystem returns to Block D, where the IFD subsystem detects the next image frame, and the image processor attempts to decode process a code symbol graphically represented in the captured image frame, allowing not more than frame acquisition time (e.g. less than 30 milliseconds) to decode process the image.
Fifth Illustrative Method of Hand-Held Digital Imaging Using the Digital Image Capture and Processing System of the Present Invention
Referring to
The flow chart shown in
As shown at Block A in
When the manual trigger switch 5 is actuated at Block B, then the system control subsystem proceeds to Block C and sets the operation of the Timer (0<t1<T1). For illustrative purposes, consider T1=5000 milliseconds. Then at Block D in
If at Block F in
Specification of the Second Illustrative Embodiment of the Digital Image Capture and Processing System of Present Invention Employing Single Linear LED Illumination Array to Illuminate the Field of View (FOV) of the System
Referring to
In
As shown in
As shown in
Specification of the Three-Tier Software Architecture of the Digital Image Capture and Processing System of the Second Illustrative Embodiment of the Present Invention
As shown in
While the operating system layer of the digital image capture and processing system is based upon the Linux operating system, it is understood that other operating systems can be used (e.g. Microsoft Windows, Apple Mac OSX, Unix, etc), and that the design preferably provides for independence between the main Application Software Layer and the Operating System Layer, and therefore, enables of the Application Software Layer to be potentially transported to other platforms. Moreover, the system design principles of the present invention provides an extensibility of the system to other future products with extensive usage of the common software components, decreasing development time and ensuring robustness.
In the illustrative embodiment, the above features are achieved through the implementation of an event-driven multi-tasking, potentially multi-user, Application layer running on top of the System Core software layer, called SCORE. The SCORE layer is statically linked with the product Application software, and therefore, runs in the Application Level or layer of the system. The SCORE layer provides a set of services to the Application in such a way that the Application would not need to know the details of the underlying operating system, although all operating system APIs are, of course, available to the application as well. The SCORE software layer provides a real-time, event-driven, OS-independent framework for the product Application to operate. The event-driven architecture is achieved by creating a means for detecting events (usually, but not necessarily, when the hardware interrupts occur) and posting the events to the Application for processing in real-time manner The event detection and posting is provided by the SCORE software layer. The SCORE layer also provides the product Application with a means for starting and canceling the software tasks, which can be running concurrently, hence, the multi-tasking nature of the software system of the present invention.
Specification of the Third Illustrative Embodiment of the Digital Image Capture and Processing System of the Present Invention, Employing Single Linear LED Illumination Array for Full Field Illumination
Referring now to
In some important respects, the third illustrative embodiment of the digital image capture and processing system 1″ is similar to the second illustrative system embodiment 1′, namely: both systems employ a single linear array of LEDs to illuminate its field of view (FOV) over the working range of the system, in a way to illuminate objects located within the working distance of the system during imaging operations, while minimizing annoyance to the operator, as well as others in the vicinity thereof during object illumination and imaging operations.
However, the third illustrative embodiment has many significant advancements over the second illustrative embodiment, relating particularly to its: (i) prismatic illumination-focusing lens structure 130 illustrated in
As shown in
As show in
As shown in
As shown in
When the front and rear housing panels 2B″ and 2A″ are joined together, with the PC board 8 disposed therebetween, the prismatic illumination-focusing lens panel 3″ will sit within the slanted cut-aways 133E and 133F formed in the top surface of the side panels, and illumination rays produced from the linear array of LEDs will be either directed through the rear surface of the prismatic illumination-focusing lens panel 3″ or absorbed by the black colored interior surface of the optically-opaque light ray containing structure 133. In alternative embodiments, the interior surface of the optically-opaque light ray containing structure may be coated with a light reflecting coating so as to increase the amount of light energy transmitted through the prismatic illumination-focusing lens panel, and thus increasing the light transmission efficiency of the LED-based illumination subsystem employed in the digital image capture and processing system of the present invention.
As shown in
As shown in
The System Architecture of the Third Illustrative Embodiment of the Digital Image Capture and Processing System
In
Implementing the System Architecture of the Third Illustrative Embodiment of the Digital Image Capture and Processing System
The subsystems employed within the digital image capture and processing system of the third illustrative embodiment are implemented with components mounted on the PC board assembly shown in
Specification of the Three-Tier Software Architecture of the Digital Image Capture and Processing System of the Third Illustrative Embodiment of the Present Invention
As shown in
While the operating system layer of the digital image capture and processing system is based upon the Linux operating system, it is understood that other operating systems can be used (e.g. Microsoft Windows, Apple Mac OSX, Unix, etc), and that the design preferably provides for independence between the main Application Software Layer and the Operating System Layer, and therefore, enables of the Application Software Layer to be potentially transported to other platforms. Moreover, the system design principles of the present invention provides an extensibility of the system to other future products with extensive usage of the common software components, decreasing development time and ensuring robustness.
In the illustrative embodiment, the above features are achieved through the implementation of an event-driven multi-tasking, potentially multi-user, Application layer running on top of the System Core software layer, called SCORE. The SCORE layer is statically linked with the product Application software, and therefore, runs in the Application Level or layer of the system. The SCORE layer provides a set of services to the Application in such a way that the Application would not need to know the details of the underlying operating system, although all operating system APIs are, of course, available to the application as well. The SCORE software layer provides a real-time, event-driven, OS-independent framework for the product Application to operate. The event-driven architecture is achieved by creating a means for detecting events (usually, but not necessarily, when the hardware interrupts occur) and posting the events to the Application for processing in real-time manner The event detection and posting is provided by the SCORE software layer. The SCORE layer also provides the product Application with a means for starting and canceling the software tasks, which can be running concurrently, hence, the multi-tasking nature of the software system of the present invention.
Specification of the Illumination Subsystem of the Present Invention Employing Prismatic Illumination Focusing Lens Structure Integrated within the Imaging Window
Referring to FIGS. 33A through 33K2, the prismatic illumination-focusing lens structure 130 of the illustrative embodiment will now be described in greater detail.
FIG. 33C1 shows several LEDs 62N, 62M (from the linear LED array) transmitting illumination through the rear surface 130A of the prismatic illumination lens component 130 of the imaging window, in a controlled manner, so that a focused field of illumination emerging from the front recessed surface 130D and illuminates the FOV of the system in a substantially uniform manner, without objectionally projecting light rays into the eyes of consumers and/or operators who happen to be present at the point of sale (POS). Most light rays which emerge from the recessed surface section 130D project into the FOV, while a small percentage of the transmitted light rays strike the top wall surface 3A1 formed in the rectangular opening formed about the imaging window, and reflect/scatter off the mirrored surface 160 and into the FOV according to the optical design of the present invention. Light rays that illuminate objects within the FOV of the system scatter off the surface of illuminated objects within the FOV of the system, and are transmitted back through the imaging window panel 3″ and collected by FOV optics 34 and focused onto the area-type image sensing array 35 in the image formation and detection subsystem 21. The light transmission characteristics of the planar panel portion of the imaging window panel 3″ can be selected so that the cooperate with another optical filtering element 40 located near or proximate the image detection array 35 to form an optical band-pass filter system 40 that passes only a narrow band of optical wavelengths (e.g. a narrow band optical spectrum) centered about the characteristic wavelength of the illumination beam, thereby rejecting ambient noise to a significant degree and improving image contrast and quality.
By virtue of the imaging window design of the present invention, particularly its integrated prismatic illumination lens, it is now possible to uniformly illuminate the FOV of a 2D digital imaging system using a single linear array of LEDs that generates and project a field of visible illumination into the FOV of the system, without projecting light rays into the eyes of cashiers, sales clerks, customers and other humans present at the POS station where the digital imaging system of the illustrative embodiment can be installed.
Description of Operation of the Prismatic Illumination-Focusing Lens Component, Integrated within the Imaging Window of the Present Invention
Referring to FIGS. 33C2 through 33K2, operation of the prismatic illumination-focusing lens component, integrated within the imaging window of the present invention, will now be described in greater detail below.
FIG. 33C2 illustrates the propagation of a central light ray which is generated from an LED in the linear LED array 23, and passes through the central portion of the prismatic illumination-focusing lens component of the imaging window panel, and ultimately into the FOV of the system.
FIGS. 33G1 through 33K2 describe the spatial intensity profile characteristics achieved over the working range of the digital imaging system (e. from 50 mm to 150 mm from the imaging window) using the optical design employed in a particular illustrative embodiment of the present invention. In this illustrative embodiment showing in FIGS. 33G1 through 33K2, there is an average spatial intensity value drop off, measured from the center of the image, to its edge, and at each of the five different illumination regions. Notably, this optical design works very well in POS-based digital imaging applications; however, in other illustrative embodiments of the system, different spatial intensity profile characteristics may be desired or required to satisfy the needs of a different classes of digital imaging applications.
Specification of the Optical Function of the Prismatic Illumination-Focusing Lens Structure within the Illumination Subsystem of the Digital Image Capture and Processing System of the Third Illustrative Embodiment
Referring to
Specification of the Linear Visible Illumination Targeting Subsystem Employed in the Hand-Supportable Digital Image Capture and Processing System of the Third Illustrative Embodiment of the Present Invention
As shown in
Specification of the Image Formation and Detection Subsystem Employed in the Hand-Supportable Digital Image Capture and Processing System of the Third Illustrative Embodiment of the Present Invention
Specification of the LED-Driven Optical-Waveguide Structure Used to Illuminate the Manually-Actuated Trigger Switch Integrated in the Housing of the Digital Image Capture and Processing System of the Third Illustrative Embodiment of the Present Invention
Referring to
As shown in
Specification of the Acoustic-Waveguide Structure Used to Couple Sonic Energy, Produced from an Electro-Transducer, to the Sound Output Ports Formed in the Housing of the Digital Image Capture and Processing System of the Third Illustrative Embodiment of the Present Invention
Referring to
In cutaway views of
The acoustic-waveguide structure 172 of the present invention is shown in greater detail in
By way of the acoustic-waveguide structure, sound signals generated from the electro-acoustic transducer 171 are efficiently conducted through the waveguide channel and exit out through sound ports 170 formed in the optical-waveguide structure 165, and corresponding sound ports 170′ formed in the front housing portion 2B, as shown in
As shown in
Specification of the Multi-Interface I/O Subsystem Employed in the Digital Image Capture and Processing System of Present Invention of the Third Illustrative Embodiment
Referring now to
As shown in
As shown in
In
As shown in
The USB microcontroller (from Sci-Labs) supports software which carries out a square-wave signal (i.e. Wiggle) test, using the driver circuits and the interface (I/F) switching circuit 150 described above. This software-controlled automatic interface test/detection process can be summarized as follows. First, the CTS (Clear To Send) (i.e. Pin 2) is set to High and the RS-232 pull down resistor is allowed to go Low. The line which follows the CTS during the wiggle test signal is then checked; if no lines follow the CTS, then the RS-232 interface is determined or indicated. The line that follows CTS pin is tested multiple times. After passing the test, the interface is detected for operation.
The software-based automatic interface test/detection process employed by the multi-interface I/O subsystem 27 will now be described in greater detail with reference to the flow chart of
As shown at Block A in
As indicated at Block B in
As indicated at Block C in
As indicated at Block D in
As indicated at Block E in
As indicated at Block F in
As indicated at Block H in
As indicated at Block I in
As indicated at Block J in
In no tested port levels have gone LOW at Block J, then at Block Q the USB microcontroller releases the Decoder Reset Line, sets interface switches for the RS-232 interface and interface type, and then loads stored RS-232 configuration parameters into memory, so as to implement the RS-232 communication interface with the host system. At Block R, the scanner/imager is ready to run or operate.
If at Block J, any of the tested ports have gone LOW, then at Block K the USB microcontroller stores as possible interfaces, the remaining ports which have gone LOW.
As indicated at Block L in
If at Block L there is only one interface (I/F) candidate on the list of stored possible communication interfaces, the USB microcontroller toggles the EEPROM WP (wiggle) test line multiple (N) times to verify that the port pin for the sole interface candidate tracks the wiggle test signal.
If at Block N, the port pin for the sole interface candidate does not track the wiggle test signal, then the USB microcontroller returns to Block D, as shown in
The multi-interface I/O subsystem design described above has a number of other features which makes it very useful in POS application, namely: it does not require electronic circuitry to be embodied in the connector cables; it supports the option for 12 Volt to 5 Volt power conversion, and 12 Volt to 3.3 Volt power conversion; and its Keyboard Wedge (KW) interface allows for signals to pass therethrough without use of a power adapter.
In the illustrative embodiment, the power requirements for the multi-interface I/O subsystem are as follows: satisfy specification requirements for the USB Mode; consume less than 500 uA during its Sleep Mode; consume less than 100 mA before re-numeration; disable the decode section before USB I/F detection; consume less than 500 mA during operation; verify there is adapter power before switching to the higher power, Imaging Mode; keep the KeyBoard Wedge pass through mode operational without a/c adapter; and maintain the keyboard power fuse limit at about 250 mA for PC.
Specification of Method of Programming a Set of System Configuration Parameters (SCPs) within the Digital Image Capture and Processing System of the Present Invention, During Implementation of the Communication Interface Detected with a Host System
Oftentimes, end-user customers (e.g. retailers) employing multiple digital imaging systems of the present invention will support different-types of host systems within their operating environment. This implies that digital imaging systems of the present invention must be interfaced to at least one host system within such diverse operating environments, Also, typically, these different types of host systems will require different communication methods (e.g. RS232, USB, KBW, etc.). Also, depending on the interface connection, oftentimes the system configuration parameters (SCPs) for these different host system environments (e.g. supporting particular types of decode symbologies, prefixes, suffixes, data parsing, etc.) will be different within each digital imaging system. In general, the term SCP and SCPs as used herein, and in the claims, are intended to cover a broad range of parameters that control features and functions supported within any digital imaging system according to the present invention, and such features and functions include the parameters disclosed herein as well as those that are clearly defined and detailed in Applicants' copending U.S. application Ser. No. 11/640,814 filed Dec. 18, 2006, which is incorporated herein by reference in its entirety.
In order to eliminate the need to scan or read individual programming codes to change system configuration parameters required to interface within an assigned host system, it is an objective of the present invention to provide each digital imaging system of the present invention with the capacity to programmably store, its system memory (e.g. EPROM), a different set of system configuration parameters (SCPs) for each supported communication interface (e.g. RS232, USB, Keyboard Wedge (KBW), and IBM 46xx RS485), as illustrated in
In the flow chart of
As indicated at Block A in
One SCP/CI programming method would be to electronically load a SCP/CI data file into the system memory of each digital imaging system to be deployed within an organization's enterprise typically having diverse types of host systems, to which the digital imaging systems must establish a communication interface. This programming method might take place at the factory where the digital imaging systems are manufactured, or by a technician working at the user's enterprise before the digital imaging systems are deployed for their end use applications.
Another SCP/CI programming method might be to first cause the digital imaging system to enter a SCP/CI programming mode, whereupon a technician reads programming-type bar codes from a programming manual, following a predetermined code reading sequence, e.g. before the digital imaging system is ultimately programmed and deployable for end use.
When programming SCP/CI parameter settings in the system memory of the digital imaging system using a PC-based software application running on a host or client system, the PC-based software application can be designed to provide system configuration specialists with the option of selecting the communication interface (CI) for the set of system configuration parameters that are to be associated therewithin in system memory. Also, upon changing system configuration parameters associated with a particular communication interface (i.e. changing SCP/CI parameter settings within system memory), such users can also be provided with the option of selecting whether updated changes to a full set of system configuration parameters (SCPs) should be applied to (i) a single communication interface (e.g. RS-232 or USB), or (ii) all available communication interfaces (CIs) supported by the digital imaging system, and thereafter programmed into the memory banks of the system memory of the digital imaging system. Notably, selection of option (ii) above would serve as a global programming change within the digital imaging systems.
As indicated at Block B in
As indicated at Block C in
At indicated at Block D in
As indicated at Block E in
By virtue of the present invention, a digital image capture and processing system once initially programmed, avoids the need read individual programming-type codes at its end-user deployment environment in order to change additional configuration parameters (e.g. symbologies, prefix, suffix, data parsing, etc.) for a particular communication interface supported by the host system environment in which it has been deployed. This feature of the present invention offers significant advantages including, for example. a reduction in cost of ownership and maintenance, with a significant improvement in convenience and deployment flexibility within an organizational environment employing diverse host computing systems.
Specification of Method of Unlocking Restricted Features Embodied within the Digital Image Capture and Processing System of Present Invention of the Third Illustrative Embodiment, by Reading Feature-Unlocking Programming Bar Code Symbols
Often times, end-users of digital imaging systems do not want to pay extra for digital image capture and processing capabilities that far exceed any code capture and decode processing challenge that might be foreseeably encountered within a given end-user deployment environment. Also, manufacturers and value-added retailers (VARs) of digital imaging systems do not want to procure the necessary license fees, or incur the necessary software and/or hardware development costs associated with the provision of particular kinds of digital image capture and processing capabilities unless the end-user sees value in purchasing such digital imaging systems based on a real-world need. Examples of such kinds of digital image capture and processing capabilities, which customers may not require in many end-user applications might include, for example: (i) the capacity for decoding particular types of symbologies (i.e, PDF417, Datamstrix, QR code, etc.); (ii) the capacity for performing optical character recognition (OCR) on particular types of fonts; (iii) the capacity for performing digital image transfer to external systems and devices; (iv) the capacity for reading documents bearing machine readable code as well as handwriting (e.g. signatures); etc.
In order to more efficiently deliver value to end-user customers, it is an object of the present invention to provide manufacturers with a way of and means for providing their customers with digital imaging products having features and functions that truly serve their needs at the time of purchase procurement, and at less cost to the customer. This objective is achieved by providing a digital imaging system as shown in
Examples of predetermined classes of features and functions in the “baseline” model of the digital imaging system of
Also, an example of a first “extended” class of features and functions might include, for example: (i) the capacity for decoding particular types of symbologies (i.e PDF417, Datamstrix, and QR code); and (ii) the capacity for performing optical character recognition (OCR) on particular types of fonts. A second extended class of features and functions might include, for example: (iii) the capacity for performing digital image transfer to external systems and devices. Also, a third extended class of features and functions might include, for example: (iv) the capacity for reading documents bearing machine readable code as well as handwriting (e.g. signatures). Typically, each of these extended classes of feature and functionalies are locked and unaccessible to end-users unless authorized to do so after purchasing a license to access the extended class of features and functionalities.
Therefore, in accordance with the principle of the present invention, a unique “license key” is assigned to each extended class of features and functionalities, and it is stored in system memory along with the SCPs that implement the extended class of features and functionalities. This license key is required to unlock or activate the extended class of features and functionalities. This license key must be properly loaded into the system memory in order for the SCPs associated with the corresponding extended class of features and functionalities to operate properly, after the license has been procured by the customer or end-user, as the case may be.
As will be explained below, the license key can be loaded into the digital imaging system by way of reading a uniquely encrypted “extended feature class” activating bar code symbol which is based on the license key itself, as well as the serial # of the digital imaging system/unit. In the case of desiring to activate a number of digital imaging systems by reading the same uniquely encrypted “extended feature class” activating bar code symbol, the single uniquely encrypted “extended feature class” activating bar code symbol can be generated using the license key and the range of serial numbers associated with a number of digital imaging systems/units which are to be functionally upgraded in accordance with the principles of the present invention.
The method of unlocking restricted “extended” classes of features and functionalities embodied within the digital image capture and processing system of present invention is illustrated in the flow chart of
As indicated at Block A thereof, the first step involves (i) providing the system architecture of digital imaging system with all necessary hardware resources, SCPs programmably stored in system memory, and software resources for implementing the predefined baseline classes of features and functions for the digital imaging system, and (ii) assigning a unique license key that can be used to generate a uniquely encrypted “baseline feature class” activating bar code symbol which, when read by the digital imaging system while its is operating in “feature class extension programming” mode of operation, automatically unlocks the baseline class of features, and programs the digital imaging system to operate in its baseline feature and functionality configuration.
As indicated at Block B, the second step involves (ii) providing the system architecture of digital imaging system with all necessary hardware resources, SCPs programmably stored in system memory, and software resources for implementing the predefined “extended” classes of features and functions for the digital imaging system, and (ii) assigning a unique license key that can be used to generate a uniquely encrypted “extended feature class” activating bar code symbol which, when read by the digital imaging system while its is operating in “feature class extension programming” mode of operation, automatically unlocks the corresponding extended class of features, and programs the digital imaging system to operate with the corresponding extended class of features and functionalities, in addition to its baseline class of features and functionalities.
Notably, Steps A and B above can be performed either at the time of manufacturer of the digital imaging system, or during a service-upgrade at the factory or authorized service center.
As indicated at Block C, the third step involves (iii) activating such extended features and functionalities latent within the system by doing the following: (a) contacting the manufacturer, or its agent or service representative and procuring a license(s) for the desired extended class or classes of features and functionalies supported on the purchased digital image; (b) using the assigned license keys stored in system memory of the digital imaging systems to be feature upgraded (and their manufacturer-assigned serial numbers) to generate uniquely encrypted “extended feature class” activating bar code symbols corresponding to the purchased extended class licenses or license keys; (c) using the manufacturer-assigned serial numbers on the digital imaging systems to be feature upgraded to access and display corresponding uniquely encrypted “extended feature class” activating bar code symbols (either on the display screen of computer running a Web-browser programmed connected to a Web-based site supporting the procurement of extended class licenses for the digital imaging system of the customer, or by way of printing such programming bar code symbols by some way and/or means); (iv) inducing the system to enter its “feature class extension programming” mode of operation, by scanning a predetermined programming bar code symbol, and/or generating a hardware-originated signal (e.g. depressing a switch on the unit); and (v) reading the uniquely encrypted “extended feature class” activating bar code symbols, either being displayed on the display screen of the Web-enabled computer system, or printed on paper or plastic substrate material, so as to automatically unlock restricted “extended” classes of features and functionalities embodied within the digital imaging system and to activate such latent extended features and functionalities therewithin.
By virtue of the present invention, it is now possible to economically purchase digital imaging systems as disclosed in
Specification of the Fourth Illustrative Embodiment of the Digital Image Capture and Processing System of The Present Invention, Employing an Electro-Mechanical Optical Image Stabilization Subsystem that is Integrated with the Image Formation and Detection Subsystem
Referring now to
The system shown in
As shown in the system diagram of
Also, image intensification panel can also be incorporated into the image formation and detection subsystem immediately before the image detection array 35 to enable the detection of faint (i.e. low intensity) images of objects in the FOV when using low intensity illumination levels required in demanding environments where high intensity illumination levels are prohibited or undesired from the human safety or comfort point of view.
Specification of Method of Reducing Stray Light Rays Produced from LED-Based Illumination Array Employed in the Digital Image Capture and Processing System of the Present Invention
Referring to
In
Some Modifications which Readily Come to Mind
In alternative embodiments of the present invention, the linear illumination array 23 employed within the illumination subsystem 22″ may be realized using solid-state light sources other than LEDs, such as, for example, visible laser diode (VLDs) taught in great detail in WIPO Publication No. WO 02/43195 A2, published on May 30, 2002, and copending U.S. application Ser. No. 11/880,087 filed Jul. 19, 2007, assigned to Metrologic Instruments, Inc., and incorporated herein by reference in its entirety. However, when using VLD-based illumination techniques in the digital image capture and processing system of the present invention, great care must be taken to eliminate or otherwise substantially reduce speckle-noise generated at the image detection array 35 when using coherent illumination source during object illumination and imaging operations. WIPO Publication No. WO 02/43195 A2, and U.S. patent application Ser. No. 11/880,087 filed Jul. 19, 2007, supra, disclose diverse methods of and apparatus for eliminating or substantially reducing speckle-noise during image formation and detection when using VLD-based illumination arrays.
Also, the linear illumination array can be realized using a combination of both visible and invisible illumination sources as taught in great detail in Applicants' copending U.S. application Ser. No. 11/880,087 filed Jul. 19, 2007, incorporated herein by reference in its entirety. The use of such spectral mixing techniques will enable the capture of images of bar code labels having high contract, while using minimal levels of visible illumination.
While CMOS image detection array technology was described as being used in the preferred embodiments of the present invention, it is understood that in alternative embodiments, CCD-type image detection array technology, as well as other kinds of image detection technology, can be used.
The digital image capture and processing system design described in great detail hereinabove can be readily adapted for use as an industrial or commercial fixed-position bar code reader/imager, having the interfaces commonly used in the industrial world, such as Ethernet TCP/IP for instance. By providing such digital imaging systems with an Ethernet TCP/IP port, a number of useful features will be enabled, such as, for example: multi-user access to such bar code reading systems over the Internet; management control over multiple systems on a LAN or WAN from a single user application; web-servicing of such digital imaging systems; upgrading of software, including extended classes of features and benefits, as disclosed hereinabove; and the like.
While the illustrative embodiments of the present invention have been described in connection with various types of bar code symbol reading applications involving 1-D and 2-D bar code structures, it is understood that the present invention can be use to read (i.e. recognize) any machine-readable indicia, dataform, or graphically-encoded form of intelligence, including, but not limited to bar code symbol structures, alphanumeric character recognition strings, handwriting, and diverse dataforms currently known in the art or to be developed in the future. Hereinafter, the term “code symbol” shall be deemed to include all such information carrying structures and other forms of graphically-encoded intelligence.
Also, digital image capture and processing systems of the present invention can also be used to capture and process various kinds of graphical images including photos and marks printed on driver licenses, permits, credit cards, debit cards, or the like, in diverse user applications.
It is understood that the digital image capture and processing technology employed in bar code symbol reading systems of the illustrative embodiments may be modified in a variety of ways which will become readily apparent to those skilled in the art of having the benefit of the novel teachings disclosed herein. All such modifications and variations of the illustrative embodiments thereof shall be deemed to be within the scope and spirit of the present invention as defined by the Claims to Invention appended hereto.
This application is a Continuation of U.S. application Ser. No. 12/012,222 filed Jan. 31, 2008, now U.S. Pat. No. 8,517,175; which is a Continuation of U.S. application Ser. No. 12/005,150 filed Dec. 21, 2007, now U.S. Pat. No. 7,980,471; which is a Continuation of U.S. application Ser. No. 12/001,758 filed Dec. 12, 2007, now U.S. Pat. No. 7,841,533; which is a Continuation-in-Part of the following: U.S. application Ser. No. 11/640,814 filed Dec. 18, 2006, now U.S. Pat. No. 7,708,205; Ser. No. 11/880,087 filed Jul. 19, 2007, now U.S. Pat. No. 8,042,740; Ser. No. 11/305,895 filed Dec. 16, 2005, now U.S. Pat. No. 7,607,581; Ser. No. 10/989,220 filed Nov. 15, 2004, now U.S. Pat. No. 7,490,774; Ser. No. 10/712,787 filed Nov. 13, 2008, now U.S. Pat. No. 7,128,266; Ser. No. 10/893,800 filed Jul. 16, 2004, now U.S. Pat. No. 7,273,180; Ser. No. 10/893,797 filed Jul. 16, 2004, now U.S. Pat. No. 7,188,770; Ser. No. 10/893,798 filed Jul. 16, 2004, now U.S. Pat. No. 7,185,817; Ser. No. 10/894,476 filed Jul. 16, 2004, now U.S. Pat. No. 7,178,733; Ser. No. 10/894,478 filed Jul. 19, 2004, now U.S. Pat. No. 7,357,325; Ser. No. 10/894,412 filed Jul. 19, 2004, now U.S. Pat. No. 7,213,762; Ser. No. 10/894,477 filed Jul. 19, 2004, now U.S. Pat. No. 7,360,706; Ser. No. 10/895,271 filed Jul. 20, 2004, now U.S. Pat. No. 7,216,810; Ser. No. 10/895,811 filed Jul. 20, 2004, now U.S. Pat. No. 7,225,988; Ser. No. 10/897,390 filed Jul. 22, 2004, now U.S. Pat. No. 7,237,722; Ser. No. 10/897,389 filed Jul. 22, 2004, now U.S. Pat. No. 7,225,989; Ser. No. 10/901,463 filed Jul. 27, 2004, now U.S. Pat. No. 7,086,595; Ser. No. 10/901,426 filed Jul. 27, 2004, now U.S. Pat. No. 7,278,575; Ser. No. 10/901,446 filed Jul. 27, 2004, now U.S. Pat. No. 7,428,998; Ser. No. 10/901,461 filed Jul. 28, 2004, now U.S. Pat. No. 7,320,431; Ser. No. 10/901,429 filed Jul. 28, 2004, now U.S. Pat. No. 7,243,847; Ser. No. 10/901,427 filed Jul. 28, 2004, now U.S. Pat. No. 7,267,282; Ser. No. 10/901,445 filed Jul. 28, 2004, now U.S. Pat. No. 7,240,844; Ser. No. 10/901,428 filed Jul. 28, 2004, now U.S. Pat. No. 7,293,714; Ser. No. 10/902,709 filed Jul. 29, 2004, now U.S. Pat. No. 7,270,272; Ser. No. 10/901,914 filed Jul. 29, 2004, now U.S. Pat. No. 7,325,738; Ser. No. 10/902,710 filed Jul. 29, 2004, now U.S. Pat. No. 7,281,661; Ser. No. 10/909,270 filed Jul. 30, 2004, now U.S. Pat. No. 7,284,705; and Ser. No. 10/909,255 filed Jul. 30, 2004, now U.S. Pat. No. 7,299,986; Ser. No. 10/903,904 filed Jul. 30, 2004, now U.S. Pat. No. 7,255,279. Each said patent application is assigned to and commonly owned by Metrologic Instruments, Inc. of Blackwood, N.J., and is incorporated herein by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3418437 | Munich | Dec 1968 | A |
| 3812347 | Cunningham et al. | May 1974 | A |
| 4338514 | Bixby | Jul 1982 | A |
| 4375058 | Bouma et al. | Feb 1983 | A |
| 4427286 | Bosse | Jan 1984 | A |
| 4471228 | Nishizawa et al. | Sep 1984 | A |
| 4528444 | Hara et al. | Jul 1985 | A |
| 4538060 | Sakai et al. | Aug 1985 | A |
| 4602245 | Yang et al. | Jul 1986 | A |
| 4628528 | Bose et al. | Dec 1986 | A |
| 4766300 | Chadima, Jr. et al. | Aug 1988 | A |
| 4794239 | Allais | Dec 1988 | A |
| 4805026 | Oda | Feb 1989 | A |
| 4816916 | Akiyama | Mar 1989 | A |
| 4818847 | Hara et al. | Apr 1989 | A |
| 4835615 | Taniguchi et al. | May 1989 | A |
| 4894523 | Chadima, Jr. et al. | Jan 1990 | A |
| 4952966 | Ishida et al. | Aug 1990 | A |
| 4996413 | McDaniel et al. | Feb 1991 | A |
| 5019714 | Knowles | May 1991 | A |
| 5025319 | Mutoh et al. | Jun 1991 | A |
| 5034619 | Hammond, Jr. | Jul 1991 | A |
| 5063460 | Mutze et al. | Nov 1991 | A |
| 5063462 | Nakagawa et al. | Nov 1991 | A |
| 5111263 | Stevens | May 1992 | A |
| 5124537 | Chandler et al. | Jun 1992 | A |
| 5142684 | Perry et al. | Aug 1992 | A |
| 5144119 | Chadima, Jr. et al. | Sep 1992 | A |
| 5150437 | Gfeller | Sep 1992 | A |
| 5221956 | Patterson et al. | Jun 1993 | A |
| 5231293 | Longacre, Jr. | Jul 1993 | A |
| 5233169 | Longacre | Aug 1993 | A |
| 5233415 | French et al. | Aug 1993 | A |
| 5262871 | Wilder et al. | Nov 1993 | A |
| 5272538 | Homma et al. | Dec 1993 | A |
| 5274358 | Janis | Dec 1993 | A |
| 5281800 | Pelton et al. | Jan 1994 | A |
| 5286960 | Longacre, Jr. et al. | Feb 1994 | A |
| 5288985 | Chadima, Jr. et al. | Feb 1994 | A |
| 5291008 | Havens et al. | Mar 1994 | A |
| 5291009 | Roustaei | Mar 1994 | A |
| 5294783 | Hammond, Jr. et al. | Mar 1994 | A |
| 5296689 | Reddersen et al. | Mar 1994 | A |
| 5304786 | Pavlidis et al. | Apr 1994 | A |
| 5304787 | Wang | Apr 1994 | A |
| 5308962 | Havens et al. | May 1994 | A |
| 5309243 | Tsai | May 1994 | A |
| 5319181 | Shellhammer et al. | Jun 1994 | A |
| 5319182 | Havens et al. | Jun 1994 | A |
| 5331118 | Jensen | Jul 1994 | A |
| 5340786 | Tsutsui et al. | Aug 1994 | A |
| 5340973 | Knowles et al. | Aug 1994 | A |
| 5349172 | Roustaei | Sep 1994 | A |
| 5352884 | Petrick et al. | Oct 1994 | A |
| 5354977 | Roustaei | Oct 1994 | A |
| 5378883 | Batterman et al. | Jan 1995 | A |
| 5396054 | Krichever et al. | Mar 1995 | A |
| 5399846 | Pavlidis et al. | Mar 1995 | A |
| 5410141 | Koenck et al. | Apr 1995 | A |
| 5416463 | Higgins, Jr. et al. | May 1995 | A |
| 5418357 | Inoue et al. | May 1995 | A |
| 5420409 | Longacre, Jr. et al. | May 1995 | A |
| 5420665 | Tagawa | May 1995 | A |
| 5430285 | Karpen et al. | Jul 1995 | A |
| 5430286 | Hammond, Jr. et al. | Jul 1995 | A |
| 5450291 | Kumagai | Sep 1995 | A |
| 5457309 | Pelton | Oct 1995 | A |
| 5463214 | Longacre et al. | Oct 1995 | A |
| 5468951 | Knowles et al. | Nov 1995 | A |
| 5479515 | Longacre, Jr. | Dec 1995 | A |
| 5484994 | Roustaei | Jan 1996 | A |
| 5489771 | Beach et al. | Feb 1996 | A |
| 5491330 | Sato et al. | Feb 1996 | A |
| 5495097 | Katz et al. | Feb 1996 | A |
| 5519496 | Borgert et al. | May 1996 | A |
| 5521366 | Wang et al. | May 1996 | A |
| 5532467 | Roustaei | Jul 1996 | A |
| 5541419 | Arackellian | Jul 1996 | A |
| 5550366 | Roustaei | Aug 1996 | A |
| 5572006 | Wang et al. | Nov 1996 | A |
| 5572007 | Aragon et al. | Nov 1996 | A |
| 5588063 | Edgar | Dec 1996 | A |
| 5591952 | Krichever et al. | Jan 1997 | A |
| 5621203 | Swartz et al. | Apr 1997 | A |
| 5623137 | Powers et al. | Apr 1997 | A |
| 5635697 | Shellhammer et al. | Jun 1997 | A |
| 5637851 | Swartz et al. | Jun 1997 | A |
| 5646390 | Wang et al. | Jul 1997 | A |
| 5659167 | Wang et al. | Aug 1997 | A |
| 5659761 | Dearras et al. | Aug 1997 | A |
| 5661291 | Ahearn et al. | Aug 1997 | A |
| 5677522 | Rice et al. | Oct 1997 | A |
| 5702059 | Chu et al. | Dec 1997 | A |
| 5710417 | Joseph et al. | Jan 1998 | A |
| 5717195 | Feng et al. | Feb 1998 | A |
| 5717221 | Li et al. | Feb 1998 | A |
| 5719384 | Ju et al. | Feb 1998 | A |
| 5723853 | Longacre et al. | Mar 1998 | A |
| 5723868 | Hammond, Jr. et al. | Mar 1998 | A |
| 5736724 | Ju et al. | Apr 1998 | A |
| 5739518 | Wang | Apr 1998 | A |
| 5747796 | Heard | May 1998 | A |
| 5754227 | Fukuoka | May 1998 | A |
| 5756981 | Roustaei et al. | May 1998 | A |
| 5773806 | Longacre | Jun 1998 | A |
| 5773810 | Hussey et al. | Jun 1998 | A |
| 5777314 | Roustaei | Jul 1998 | A |
| 5780834 | Havens et al. | Jul 1998 | A |
| 5783811 | Feng et al. | Jul 1998 | A |
| 5784102 | Hussey et al. | Jul 1998 | A |
| 5786582 | Roustaei et al. | Jul 1998 | A |
| 5786583 | Maltsev | Jul 1998 | A |
| 5786586 | Pidhirny et al. | Jul 1998 | A |
| 5793033 | Feng et al. | Aug 1998 | A |
| 5793967 | Simciak et al. | Aug 1998 | A |
| 5797015 | Daniels, Jr. et al. | Aug 1998 | A |
| 5808286 | Nukui et al. | Sep 1998 | A |
| 5811774 | Ju et al. | Sep 1998 | A |
| 5811784 | Tausch et al. | Sep 1998 | A |
| 5815200 | Ju et al. | Sep 1998 | A |
| 5821518 | Sussmeier et al. | Oct 1998 | A |
| 5825006 | Longacre et al. | Oct 1998 | A |
| 5825010 | Charych et al. | Oct 1998 | A |
| 5831254 | Karpen et al. | Nov 1998 | A |
| 5831674 | Ju et al. | Nov 1998 | A |
| 5834754 | Feng et al. | Nov 1998 | A |
| 5837985 | Karpen | Nov 1998 | A |
| 5838495 | Hennick | Nov 1998 | A |
| 5841121 | Koenck | Nov 1998 | A |
| 5867594 | Cymbalski | Feb 1999 | A |
| 5883375 | Knowles et al. | Mar 1999 | A |
| 5900613 | Koziol et al. | May 1999 | A |
| 5914476 | Gerst, III et al. | Jun 1999 | A |
| 5914477 | Wang | Jun 1999 | A |
| 5920061 | Feng | Jul 1999 | A |
| 5929418 | Ehrhart et al. | Jul 1999 | A |
| 5932741 | Heckmann et al. | Aug 1999 | A |
| 5932862 | Hussey et al. | Aug 1999 | A |
| 5942741 | Longacre et al. | Aug 1999 | A |
| 5949052 | Longacre, Jr. et al. | Sep 1999 | A |
| 5949054 | Karpen et al. | Sep 1999 | A |
| 5949057 | Feng | Sep 1999 | A |
| 5953534 | Romer et al. | Sep 1999 | A |
| 5965863 | Parker et al. | Oct 1999 | A |
| 5970245 | Poteat et al. | Oct 1999 | A |
| 5979763 | Wang et al. | Nov 1999 | A |
| 5986705 | Shibuya et al. | Nov 1999 | A |
| 5992744 | Smith et al. | Nov 1999 | A |
| 5992750 | Chadima, Jr. et al. | Nov 1999 | A |
| 6000612 | Xu | Dec 1999 | A |
| 6005959 | Mohan et al. | Dec 1999 | A |
| RE36528 | Roustaei | Jan 2000 | E |
| 6015088 | Parker et al. | Jan 2000 | A |
| 6016612 | Kruwinus | Jan 2000 | A |
| 6019286 | Li et al. | Feb 2000 | A |
| 6027023 | Nada | Feb 2000 | A |
| 6044231 | Soshi et al. | Mar 2000 | A |
| 6045047 | Pidhirny et al. | Apr 2000 | A |
| 6060722 | Havens et al. | May 2000 | A |
| 6062475 | Feng | May 2000 | A |
| 6064763 | Maltsev | May 2000 | A |
| 6075600 | Nagano et al. | Jun 2000 | A |
| 6075882 | Mullins et al. | Jun 2000 | A |
| 6095422 | Ogami | Aug 2000 | A |
| 6097839 | Liu | Aug 2000 | A |
| 6097856 | Hammond, Jr. | Aug 2000 | A |
| 6098887 | Figarella et al. | Aug 2000 | A |
| 6108100 | Mcvey et al. | Aug 2000 | A |
| 6119941 | Katsandres et al. | Sep 2000 | A |
| 6123261 | Roustaei | Sep 2000 | A |
| 6123263 | Feng | Sep 2000 | A |
| 6128414 | Liu | Oct 2000 | A |
| 6141046 | Roth et al. | Oct 2000 | A |
| 6149063 | Reynolds et al. | Nov 2000 | A |
| 6152371 | Schwartz et al. | Nov 2000 | A |
| 6158661 | Chadima, Jr. et al. | Dec 2000 | A |
| 6161760 | Marrs et al. | Dec 2000 | A |
| 6164544 | Schwartz et al. | Dec 2000 | A |
| 6173893 | Maltsev et al. | Jan 2001 | B1 |
| 6177926 | Kunert | Jan 2001 | B1 |
| 6179208 | Feng | Jan 2001 | B1 |
| 6188381 | Van der Wal et al. | Feb 2001 | B1 |
| 6208237 | Saiki et al. | Mar 2001 | B1 |
| 6209789 | Amundsen et al. | Apr 2001 | B1 |
| 6223988 | Batterman et al. | May 2001 | B1 |
| 6234395 | Chadima, Jr. et al. | May 2001 | B1 |
| 6244512 | Koenck et al. | Jun 2001 | B1 |
| 6250551 | He et al. | Jun 2001 | B1 |
| 6254003 | Pettinelli et al. | Jul 2001 | B1 |
| 6264105 | Longacre, Jr. et al. | Jul 2001 | B1 |
| 6266685 | Danielson et al. | Jul 2001 | B1 |
| 6275388 | Hennick et al. | Aug 2001 | B1 |
| 6298175 | Longacre, Jr. et al. | Oct 2001 | B1 |
| 6298176 | Longacre, Jr. et al. | Oct 2001 | B2 |
| 6321989 | Wilz, Sr. et al. | Nov 2001 | B1 |
| 6330974 | Ackley | Dec 2001 | B1 |
| 6336587 | He et al. | Jan 2002 | B1 |
| 6340114 | Correa et al. | Jan 2002 | B1 |
| 6345765 | Wiklof | Feb 2002 | B1 |
| 6347163 | Roustaei | Feb 2002 | B2 |
| 6357659 | Kelly et al. | Mar 2002 | B1 |
| 6360947 | Knowles et al. | Mar 2002 | B1 |
| 6367699 | Ackley | Apr 2002 | B2 |
| 6370003 | Hennick | Apr 2002 | B1 |
| 6371374 | Schwartz et al. | Apr 2002 | B1 |
| 6373579 | Ober et al. | Apr 2002 | B1 |
| 6385352 | Roustaei | May 2002 | B1 |
| 6390625 | Slawson et al. | May 2002 | B1 |
| 6398112 | Li et al. | Jun 2002 | B1 |
| 6419157 | Ehrhart et al. | Jul 2002 | B1 |
| 6421703 | Steinmetz et al. | Jul 2002 | B1 |
| 6431452 | Feng | Aug 2002 | B2 |
| 6435411 | Massieu et al. | Aug 2002 | B1 |
| 6469289 | Scott-Thomas et al. | Oct 2002 | B1 |
| 6473519 | Pidhirny et al. | Oct 2002 | B1 |
| 6478223 | Ackley | Nov 2002 | B1 |
| 6489798 | Scott-Thomas et al. | Dec 2002 | B1 |
| 6491223 | Longacre, Jr. et al. | Dec 2002 | B1 |
| 6497368 | Friend et al. | Dec 2002 | B1 |
| 6499664 | Knowles et al. | Dec 2002 | B2 |
| 6527182 | Chiba et al. | Mar 2003 | B1 |
| 6547139 | Havens et al. | Apr 2003 | B1 |
| 6550679 | Hennick et al. | Apr 2003 | B2 |
| 6561428 | Meier et al. | May 2003 | B2 |
| 6565003 | Ma | May 2003 | B1 |
| 6575367 | Longacre, Jr. | Jun 2003 | B1 |
| 6575369 | Knowles et al. | Jun 2003 | B1 |
| 6578766 | Parker et al. | Jun 2003 | B1 |
| 6585159 | Meier et al. | Jul 2003 | B1 |
| 6601768 | Mccall et al. | Aug 2003 | B2 |
| 6607128 | Schwartz et al. | Aug 2003 | B1 |
| 6616046 | Barkan et al. | Sep 2003 | B1 |
| 6619547 | Crowther et al. | Sep 2003 | B2 |
| 6619549 | Zhu et al. | Sep 2003 | B2 |
| 6628445 | Chaleff et al. | Sep 2003 | B2 |
| 6637655 | Hudrick et al. | Oct 2003 | B1 |
| 6637658 | Barber et al. | Oct 2003 | B2 |
| 6637659 | Wilz, Sr. et al. | Oct 2003 | B2 |
| 6655595 | Longacre, Jr. et al. | Dec 2003 | B1 |
| 6659350 | Schwartz et al. | Dec 2003 | B2 |
| 6669093 | Meyerson et al. | Dec 2003 | B1 |
| 6679848 | Arling et al. | Jan 2004 | B2 |
| 6681994 | Koenck | Jan 2004 | B1 |
| 6685095 | Roustaei et al. | Feb 2004 | B2 |
| 6689998 | Bremer | Feb 2004 | B1 |
| 6695209 | La | Feb 2004 | B1 |
| 6698656 | Parker et al. | Mar 2004 | B2 |
| 6708883 | Krichever | Mar 2004 | B2 |
| 6722569 | Ehrhart et al. | Apr 2004 | B2 |
| 6736320 | Crowther et al. | May 2004 | B1 |
| 6752319 | Ehrhart et al. | Jun 2004 | B2 |
| 6758402 | Check et al. | Jul 2004 | B1 |
| 6758403 | Keys et al. | Jul 2004 | B1 |
| 6763395 | Austin | Jul 2004 | B1 |
| 6789157 | Lilja et al. | Sep 2004 | B1 |
| 6814290 | Longacre | Nov 2004 | B2 |
| 6814292 | Good | Nov 2004 | B2 |
| 6832725 | Gardiner et al. | Dec 2004 | B2 |
| 6834807 | Ehrhart et al. | Dec 2004 | B2 |
| 6856440 | Chaleff et al. | Feb 2005 | B2 |
| 6863217 | Hudrick et al. | Mar 2005 | B2 |
| 6865742 | Khare et al. | Mar 2005 | B1 |
| 6871993 | Hecht | Mar 2005 | B2 |
| 6899273 | Hussey et al. | May 2005 | B2 |
| 6912076 | Chaleff et al. | Jun 2005 | B2 |
| 6918540 | Good | Jul 2005 | B2 |
| 6940998 | Garoutte | Sep 2005 | B2 |
| 6942151 | Ehrhart | Sep 2005 | B2 |
| 6947612 | Helms et al. | Sep 2005 | B2 |
| 6951304 | Good | Oct 2005 | B2 |
| 6959865 | Walczyk et al. | Nov 2005 | B2 |
| 6969003 | Havens et al. | Nov 2005 | B2 |
| 6991169 | Bobba et al. | Jan 2006 | B2 |
| 6999802 | Kim | Feb 2006 | B2 |
| 7025272 | Yavid et al. | Apr 2006 | B2 |
| 7044378 | Patel et al. | May 2006 | B2 |
| 7050600 | Saiki et al. | May 2006 | B2 |
| 7055747 | Havens et al. | Jun 2006 | B2 |
| 7059525 | Longacre et al. | Jun 2006 | B2 |
| 7069562 | Kushnirskiy et al. | Jun 2006 | B2 |
| 7073178 | De Bonet et al. | Jul 2006 | B2 |
| 7077317 | Longacre, Jr. et al. | Jul 2006 | B2 |
| 7077321 | Longacre, Jr. et al. | Jul 2006 | B2 |
| 7077327 | Knowles et al. | Jul 2006 | B1 |
| 7080786 | Longacre, Jr. et al. | Jul 2006 | B2 |
| 7086596 | Meier et al. | Aug 2006 | B2 |
| 7086597 | Good | Aug 2006 | B2 |
| 7097101 | Kogan et al. | Aug 2006 | B2 |
| 7100832 | Good | Sep 2006 | B2 |
| 7129961 | Samra | Oct 2006 | B1 |
| 7148923 | Harper et al. | Dec 2006 | B2 |
| 7195164 | Patel | Mar 2007 | B2 |
| 7225430 | Eatough et al. | May 2007 | B2 |
| 7240059 | Bayliss et al. | Jul 2007 | B2 |
| 7245404 | Bushey et al. | Jul 2007 | B2 |
| 7246872 | Park | Jul 2007 | B2 |
| 7257816 | Kulp et al. | Aug 2007 | B2 |
| 7261238 | Carlson et al. | Aug 2007 | B1 |
| 7262783 | Kramer et al. | Aug 2007 | B2 |
| 7263196 | Aubauer et al. | Aug 2007 | B2 |
| 7296748 | Good | Nov 2007 | B2 |
| 7302462 | Kulp et al. | Nov 2007 | B2 |
| 7320075 | Sotoodeh et al. | Jan 2008 | B2 |
| 7331523 | Meier et al. | Feb 2008 | B2 |
| 7350201 | Ferri et al. | Mar 2008 | B2 |
| 7403707 | Raskar et al. | Jul 2008 | B2 |
| 7426280 | Aylward | Sep 2008 | B2 |
| 7577460 | Kim et al. | Aug 2009 | B2 |
| 7594609 | Kotlarsky et al. | Sep 2009 | B2 |
| 7607581 | Kotlarsky et al. | Oct 2009 | B2 |
| 7637432 | Kotlarsky et al. | Dec 2009 | B2 |
| 7654461 | Kotlarsky et al. | Feb 2010 | B2 |
| 7697722 | Itou | Apr 2010 | B2 |
| 7708205 | Kotlarsky et al. | May 2010 | B2 |
| 7712666 | Kotlarsky et al. | May 2010 | B2 |
| 7735731 | Skaaksrud et al. | Jun 2010 | B2 |
| 7770798 | Kotlarsky et al. | Aug 2010 | B2 |
| 7789309 | Kotlarsky et al. | Sep 2010 | B2 |
| 7798284 | Wada | Sep 2010 | B2 |
| 7815121 | Kotlarsky et al. | Oct 2010 | B2 |
| 7830417 | Liu et al. | Nov 2010 | B2 |
| 7841533 | Kotlarsky et al. | Nov 2010 | B2 |
| 7870999 | Skaaksrud et al. | Jan 2011 | B2 |
| 7883013 | Skaaksrud et al. | Feb 2011 | B2 |
| 7922089 | Kotlarsky et al. | Apr 2011 | B2 |
| 7950583 | Kotlarsky et al. | May 2011 | B2 |
| 8052057 | Smith et al. | Nov 2011 | B2 |
| 8131322 | Sethuraman et al. | Mar 2012 | B2 |
| 8157174 | Kotlarsky et al. | Apr 2012 | B2 |
| 8175311 | Aylward | May 2012 | B2 |
| 8208618 | Bae et al. | Jun 2012 | B2 |
| 20020008968 | Hennick et al. | Jan 2002 | A1 |
| 20020096566 | Schwartz et al. | Jul 2002 | A1 |
| 20020150309 | Hepworth et al. | Oct 2002 | A1 |
| 20020170970 | Ehrhart | Nov 2002 | A1 |
| 20020171745 | Ehrhart | Nov 2002 | A1 |
| 20020179713 | Pettinelli et al. | Dec 2002 | A1 |
| 20020191830 | Pidhirny et al. | Dec 2002 | A1 |
| 20030062418 | Barber et al. | Apr 2003 | A1 |
| 20030062419 | Ehrhart et al. | Apr 2003 | A1 |
| 20030085282 | Parker et al. | May 2003 | A1 |
| 20030197063 | Longacre | Oct 2003 | A1 |
| 20030209603 | Schwartz et al. | Nov 2003 | A1 |
| 20030213847 | Mccall et al. | Nov 2003 | A1 |
| 20030218069 | Meier et al. | Nov 2003 | A1 |
| 20040000592 | Schwartz et al. | Jan 2004 | A1 |
| 20040004125 | Havens et al. | Jan 2004 | A1 |
| 20040094627 | Parker et al. | May 2004 | A1 |
| 20040177361 | Bernhard et al. | Sep 2004 | A1 |
| 20040195328 | Barber et al. | Oct 2004 | A1 |
| 20050167504 | Meier et al. | Aug 2005 | A1 |
| 20050218231 | Massieu | Oct 2005 | A1 |
| 20050246718 | Erlingsson et al. | Nov 2005 | A1 |
| 20050274801 | Harding et al. | Dec 2005 | A1 |
| 20060180670 | Acosta et al. | Aug 2006 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20120168511 A1 | Jul 2012 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12012222 | Jan 2008 | US |
| Child | 13226554 | US | |
| Parent | 12005150 | Dec 2007 | US |
| Child | 12012222 | US | |
| Parent | 12001758 | Dec 2007 | US |
| Child | 12005150 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11880087 | Jul 2007 | US |
| Child | 12001758 | US | |
| Parent | 11640814 | Dec 2006 | US |
| Child | 11880087 | US | |
| Parent | 11305895 | Dec 2005 | US |
| Child | 11640814 | US | |
| Parent | 10989220 | Nov 2004 | US |
| Child | 11305895 | US | |
| Parent | 10909270 | Jul 2004 | US |
| Child | 10989220 | US | |
| Parent | 10909255 | Jul 2004 | US |
| Child | 10909270 | US | |
| Parent | 10903904 | Jul 2004 | US |
| Child | 10909255 | US | |
| Parent | 10902709 | Jul 2004 | US |
| Child | 10903904 | US | |
| Parent | 10901914 | Jul 2004 | US |
| Child | 10902709 | US | |
| Parent | 10902710 | Jul 2004 | US |
| Child | 10901914 | US | |
| Parent | 10901461 | Jul 2004 | US |
| Child | 10902710 | US | |
| Parent | 10901429 | Jul 2004 | US |
| Child | 10901461 | US | |
| Parent | 10901427 | Jul 2004 | US |
| Child | 10901429 | US | |
| Parent | 10901445 | Jul 2004 | US |
| Child | 10901427 | US | |
| Parent | 10901428 | Jul 2004 | US |
| Child | 10901445 | US | |
| Parent | 10901463 | Jul 2004 | US |
| Child | 10901428 | US | |
| Parent | 10901426 | Jul 2004 | US |
| Child | 10901463 | US | |
| Parent | 10901446 | Jul 2004 | US |
| Child | 10901426 | US | |
| Parent | 10897390 | Jul 2004 | US |
| Child | 10901446 | US | |
| Parent | 10897389 | Jul 2004 | US |
| Child | 10897390 | US | |
| Parent | 10895271 | Jul 2004 | US |
| Child | 10897389 | US | |
| Parent | 10895811 | Jul 2004 | US |
| Child | 10895271 | US | |
| Parent | 10894478 | Jul 2004 | US |
| Child | 10895811 | US | |
| Parent | 10894412 | Jul 2004 | US |
| Child | 10894478 | US | |
| Parent | 10894477 | Jul 2004 | US |
| Child | 10894412 | US | |
| Parent | 10893800 | Jul 2004 | US |
| Child | 10894477 | US | |
| Parent | 10893797 | Jul 2004 | US |
| Child | 10893800 | US | |
| Parent | 10893798 | Jul 2004 | US |
| Child | 10893797 | US | |
| Parent | 10894476 | Jul 2004 | US |
| Child | 10893798 | US | |
| Parent | 10712787 | Nov 2003 | US |
| Child | 10894476 | US |
