Patent Application
20110101102
The present invention relates to optical reading devices, and more particularly to an optical reading device having programmable aimer and/or illumination control.
Optical reading devices typically read data represented by symbols. For instance a bar code symbol is an array of rectangular bars and spaces that are arranged in a specific way to represent elements of data in machine readable form. Optical reading devices typically transmit light onto a symbol and receive light reflected off of the symbol. The received light is interpreted by an image processor to extract the data represented by the symbol.
One-dimensional (1D) optical bar code readers are characterized by reading data that is encoded along a single axis, in the widths of bars and spaces, so that such symbols can be read from a single scan along that axis, provided that the symbol is imaged with a sufficiently high resolution along that axis.
In order to allow the encoding of larger amounts of data in a single bar code symbol, a number of 1D stacked bar code symbologies have been developed which partition encoded data into multiple rows, each including a respective 1D bar code pattern, all or most all of which must be scanned and decoded, then linked together to form a complete message. Scanning still requires relatively high resolution in one dimension only, but multiple linear scans are needed to read the whole symbol.
A class of bar code symbologies known as two dimensional (2D) matrix symbologies have been developed which offer orientation-free scanning and greater data densities and capacities than 1D symbologies. 2D matrix codes encode data as dark or light data elements within a regular polygonal matrix, accompanied by graphical finder, orientation and reference structures. When scanning 2D matrix codes, the horizontal and vertical relationships of data elements are recorded with about equal resolution.
Often times a bar code reader may be portable and wireless in nature thereby providing added flexibility. In these circumstances, such portable bar code readers form part of a wireless network in which data collected within the terminals is communicated to a host computer situated on a hardwired backbone via a wireless link. For example, the portable bar code readers may include a radio or optical transceiver for communicating with a host computer via a base station.
Conventionally, a bar code reader, whether portable or otherwise, includes a central processor which directly controls the operations of the various electrical components housed within the bar code reader. For example, the central processor controls detection of keyboard entries, display features, wireless communication functions, trigger detection, and bar code read and decode functionality.
Efforts regarding such systems have led to continuing developments to improve their versatility, practicality and efficiency.
a is a schematic diagram of an imager processor in accordance with the present invention.
b is a schematic diagram of a aimer and illumination control circuit in accordance with the present invention.
a illustrates the operation of an image sensor employing a rolling shutter architecture in accordance with the present invention.
b is a timing diagram used in the rolling shutter architecture presented with respect to
a and 10b are flow charts of processes for collecting image data in accordance with the invention.
Reference will now be made to exemplary embodiments of the invention which are illustrated in the accompanying drawings. This invention, however, may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these representative embodiments are described in detail so that this disclosure will be thorough and complete, and will fully convey the scope, structure, operation, functionality, and potential of applicability of the invention to those skilled in the art. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
An optical reader in accordance with the invention may be adapted for reading symbol indicia for numerous functions. A detailed description of transaction terminals and their operation is disclosed in commonly owned published United States Patent Application Publication No. 20030029917 entitled OPTICAL READER FOR IMAGING MODULE, which is hereby incorporated herein in it's entirety.
The description of the optical reader in said publication is broken down into the eight subheadings:General Imaging Module Architectures and Assembly; Illumination Systems; Aiming Systems, Illumination Device Architectures; Illumination/Aiming Color Emission Control and Coordination; Receive Optics, Packaging of Electronics; and Applications, Operating Environment, and Control Circuit Functionality.
Block diagrams of electrical circuit control configurations which may be wholly or partially incorporated in reader 10 or used in combination with circuitry of reader 10 are now described.
Referring to
Aiming illumination pattern generator 155 is adapted to generate a 2D aiming pattern which is defined, and aligned or coincident with the field of view of imaging subassembly 143. A number of representative 2D aiming patterns are possible and not limited to any particular pattern or type of pattern, such as any combination of rectilinear, linear, circular, elliptical, etc. figures, whether continuous or discontinuous, i.e., defined by sets of discrete dots, dashes and the like.
To this end, the patterns may be generated by an aiming pattern generator 155 which takes the form of a module or cartridge one embodiment of which is shown in assembled, cross-sectional form in
The light source of aiming generator 155 may comprise a surface emitting visible laser diode such as those available from Rohm, or a non-laser light source such as a light emitting diode (LED). More generally, the light source may comprise any light source which is sufficiently small to approximate a thin source and sufficiently bright to provide the desired intensity illumination at the target. Coherency of the light is not essential for purposes of the present invention.
To the end, a collimated light beam may be used to generate an aiming pattern of the desired type and shape, aiming pattern generator 155 may include an interference pattern generating element, such as a holographic element, diffractive optic element that includes one or more diffractive gratings, or a Fresnel type optic element which has been fabricated with the desired pattern in mind. Examples of each of these types of elements are known, commercially available items and may be purchased, for example, from Digital Optics Corp. of Charlotte, N.C. among others. Elements of some of these types and methods for making them are also described in U.S. Pat. Nos. 4,895,790 (Swanson); 5,170,269 (Lin et al) and 5,202,775 (Feldman et al), which are hereby incorporated herein by reference. Accordingly, the structure and operation of these devices will be described only generally herein.
Referring to the block diagram of
In another example, imaging assembly 133′ may include image sensor 32, processors 135, 150, and ND 136. To this end, one or more of these components may be combined into a single chip or integrated circuit.
Features and advantages associated with incorporating a color image sensor in an imaging device, and other control features which may be incorporated in a control circuit are discussed in greater detail in U.S. Pat. No. 6,832,725 entitled “An Optical Reader Having a Color Imager” incorporated herein by reference. The array-based imaging assembly may be replaced by a laser array based imaging assembly comprising one or more laser sources, a scanning mechanism, emit and receive optics, at least one photodetector and accompanying signal processing circuitry. It is to be noted that the image sensor 32 may read images without the illumination from illumination assembly 121, such as by ambient light.
Imaging device processor assembly 14a may include a programmable control circuit or imager processor 150. Imager processor 150 controls the amount of illumination provided by LEDs 16, 18 by controlling the output power provided by LED power supply 19. Imager processor 150 may also control other functions and devices of the imager. Image processor may be a CY8C24223A made by Cypress Semiconductor Corporation, which is a Mixed-Signal Array with On-Chip Controller devices designed to replace multiple traditional MCU-based system components with one single-chip programmable device. The processor may include configurable blocks of analog and digital logic, as well as programmable interconnects. Processor 150 includes a predetermined amount of memory 152 for storing data.
The components in imaging device processor assembly 14a may be connected by bus 192, such as an Inter-IC bus such as an I2C bus, which is a control bus that provides a communications link between integrated circuits in a system. Typically this bus would connect to a host computer in relatively close proximity, but not necessarily on the same printed circuit board as used by the imaging device processor assembly 14a. I2C is a two-wire serial bus with a software-defined protocol and used to link components such as the image sensor 32, temperature sensors, voltage level translators, EEPROMs, general-purpose I/O, AID and D/A converters, CODECs, and microprocessors.
The functional operation of the host processor 193 involves the performance of a number of related steps, the particulars of which may be determined by or based upon certain parameters, some or all of which may be stored in memory 152 provided as part of the imager processor 150. Included among these steps is a scanning subroutine which specifies the address buffer space or spaces in which scan data will be stored and whether scanning is to be continuous (e.g., at a full video rate, such as 30 frames per second), or discontinuous (e.g., with pauses related to the current state of the trigger). The operation of the decoding routine, which is executed in a user or factory selectable relationship to the scanning routine, is governed by parameters which control the codes which are enabled for processing as a part of an autodiscrimination process, whether decoding is to be continuous or discontinuous, etc. Permitted combinations of scanning and decoding parameters together define the scanning-decoding relationships or modes which the reader will use.
Memory 152 may also be used to store other parameters. For example, the decoder functions best if it knows the aiming pattern 74 center coordinates or other position in order to decode the symbol that is closest to the aiming center parameter, or the symbol that is in some position relative to the aiming center. The aiming center is based on a number of mechanical tolerances and will generally be different for every device produced. One could choose a center coordinate based on a statistical sampling of data, but the center may move over time as the manufacturing process is changed. The aiming center x- and y-coordinate can be measured during the manufacturing process and stored in the processor memory 152. The distance D at which the measurement was made may also be stored. One could measure the coordinates at two different distances and then apply a mathematical translation to determine what the coordinates would be at a third distance. The center coordinates and the distance could be read out at a later point in time. Knowledge of aimer location may be used for turning the aiming pattern on and off as is described herein.
During the manufacture of a scanner, the different tolerances of the different parts have a tendency to “stack up”, or add together. Such a tolerance stack may result in problematic performance. For instance, it may lead to a situation where the aimer pattern 74 does not intersect the center pixel area of the sensor 32. This misalignment due to tolerance will give poor results unless such an aiming pattern “offset” is compensated for by the signal processor in a calibration step. Storing the aiming pattern offset or position in the processor memory will facilitate such calibration at future times, such as repairs or customer locations. Aimer pattern location may also be used in controlling the aimer on and off during exposure of the image sensor.
Another exemplary parameter to be stored for the scan driver to utilize is the type of aiming system that is employed in order to control the aimer. Examples of aiming systems are LED and laser aimer options, which may require different control methods.
Another exemplary parameter to be stored is image module, engine part number or serial number, or other manufacturing specific information which may be used for a number of tracking purposes, such as software control, sales tracking or warranty tracking.
Another exemplary parameter to be stored is the number of pixels in the image to be used for initializing buffers and for software control.
Another exemplary parameter to be stored is the orientation that the engine will be mounted in its final implementation for decoding algorithms that are direction-dependent, or for ensuring that images are displayed and stored in the proper orientation from the operator's point of view.
Another exemplary parameter to be stored is information about the field illumination flatness of the engine with and without on-board illumination activated, for instance for purposes of applying compensation algorithms that either improve decoding or improve the visual quality of the image. Field illumination flatness may be defined as a profile saved as a function of radius from the imager optical centerline.
Another exemplary parameter to be stored is information regarding lens distortions across the active image field that may be used to improve decoding or to improve the visual quality of the image.
Other exemplary parameters to be stored may include dead or bad pixel identification for image correction, noise characterization of the image sensor so that the image algorithms can correct for and function appropriately.
Other exemplary parameters to be stored may include max LED current and receiving lens prescription or parameters functionally related thereto.
Another exemplary parameter to be stored is information regarding a parameter representative of the operative power output of the laser diode aiming system, such as operating current or a parameter related to the operating current.
In the present invention for instance, if the image scan engine 110, 110a is replaced, the scanner has the ability to automatically read out certain parameter information in processor memory and can thus sense when an engine has been replaced and allow the software to adapt and use different methods of control, or different methods of decoding, or different methods of displaying and saving images, etc.
Another exemplary application for the present invention is to compare run time parameter data of the image scan engine with the stored parameters for diagnostic evaluation. This may be done locally or remotely by connecting the optical reader either directly or through a network 194 (such as the internet) to a remote network computer 171 and having the network computer provide appropriate diagnostics.
Another exemplary application for the present invention is to store information about the scanner capabilities, such as whether the imager is enabled for image capture, what type of decoder level is enabled, or what types of symbology decoding is enabled. To this end, the user may update or replace one or more stored parameters or parameter data utilizing a remote updating system. This may be done by connecting the optical reader either directly or through a network 194 (such as the internet) to a remote network computer 171. With the appropriate software, the network computer can be programmed to read certain parameters from the optical reader, such as software configuration. The network computer 171 could read the parameter data and utilize that data for downloading updates or new software. For instance, an operator may request from the network computer for a software update. The request would be received by either computer, which could read the current software configuration resident on the optical reader and determine the appropriate update or replacement software.
An operator may have the ability to acquire through a purchase or otherwise new or updated software following the flow chart provided in
a-b, are schematics of an imager processor 150 and LED control circuit 123 for an optical reading device in accordance with the present invention. It can be seen that imager processor 150 controls the power to the illumination LEDs via a line ILL_CTL and the power to the aimer LEDs via a line AIM_CTL. Feedback for the amount of LED current is provided on a line LED_CURRENT. Through the control lines ILL_CTL and AIM_CTL, the image field illumination and aiming pattern illumination can be independently controlled.
An example of a laser aimer power supply 122 circuit is shown in
An embodiment in accordance with the present invention is shown in
As herein described, image sensor 32 may comprise a two-dimensional CMOS based image sensor array. The illumination LEDs shine light on the target so that reflected light can be collected and processed by the image sensor array. The Aimer LEDs shine light on the target to aid an operator of the image reader to accurately aim the reader at the target.
The CMOS sensor array may employ a “rolling shutter” architecture to expose the pixels, wherein rows of pixels are activated or exposed and read in sequence. The exposure or integration time for a pixel is the time between a pixel being reset and its value being read-out. This concept is presented in
An exemplary image reader 110 is described with reference to
The time during which the target is illuminated is referred to as the illumination period. The time during which the aimer LEDs are on is referred to as the aiming period. The time during which the pixels are collectively activated to photo-convert incident light into charge defines the exposure period for the sensor array. The exposure period for each row is controlled by a timing signal referred to as a row exposure timing signal. At the end of the exposure period, collected charge is read out.
The timing of the exposure period and the illumination period may be under the control of the control module or imager processor 152, which causes at least a portion of the exposure period to occur during the illumination period. The imager processor also organizes and processes the reading out of data from the sensor array in a rolling shutter mode capable of sequentially exposing and reading out the lines of pixels in the image sensor array. The time during which the pixels are collectively activated to photo-convert incident light into charge defines the exposure period for the sensor array. At the end of the exposure period, the collected charge is transferred to a shielded storage area until the data is read out. Imager processor 152 controls the process to collect the pixel matrix information utilizing an illumination signal and a row reset signal. The illumination (or beginning of frame) signal indicates the beginning of data collection for the frame F (pixel matrix). Among other things, the imager processor 152 uses this signal to know when the image capture begins and ends with the complete frame or image being stored in system memory. The row exposure timing signal is a train of pulses used to time the collection of data for each row Ra-Rn (or data block) in the frame. Imager processor 152 generates an aimer control signal (AIM_CTL) to turn the aimer LEDs on and off.
An aspect of the present invention is to control the on/off sequence of the illumination of the aiming pattern so that the aiming pattern is turned off during predetermined times of image collection, such as when data is being collected from the pixel matrix in areas where the aiming pattern is being projected or superimposed onto the target. It may be desirable to produce a digital image of the target without the aiming pattern superimposed on the picture. A technique which may be utilized to accomplish this objective is to use the row read-out pulses to calculate when data is being collected in the pixel matrix rows that include the superimposed aiming pattern. For example as shown in
a is a flow chart depicting the aiming pattern operation. A illumination sync pulse is generated to begin image capture of the frame in a step 710. A row exposure pulse train is then generated in a step 712. The image pixel data from each row is iteratively collected coincident with the following row exposure pulses. Each row exposure pulse is counted by the imager processor 150 and a query is made in a step 714 to determine when the appropriate row is encountered (in the example of
Alternatively, the aimer may be left on for a predetermined amount of time after a predetermined row exposure pulse.
Also, the aimer may be controlled utilizing any of a number of sync signals or pulses provided by the image sensor for providing information with regard to when pixel data is available for read out. For instance, in addition to the exposure sync signal, the vertical sync signal (Vsync) the horizontal sync signal (Hsync), the pixel clock signal (Pixel clock), etc.
b is a flow chart depicting the aiming pattern operation. A illumination sync pulse is generated to begin image capture of the frame in a step 710′. A row exposure pulse train is then generated in a step 712′. The image pixel data from each row is iteratively collected coincident with the following row exposure pulses. Time is counted by the imager processor 150 and a query is made in a step 714′ to determine whether a first predetermined amount of time has elapsed. When the appropriate time is reached, the aimer is turned off in a step 716′. The aimer remains off until, in a query in step 718′, for a second predetermined amount of time at which time the aimer may be turned back on in a step 720′. In this manner, the aimer pattern will not be included in the pixel data collected in rows Rd and Re. It is to be noted that other rows before and after the aiming pattern may be chosen as the predetermined signal switching rows to, for example, provide a wider tolerance to ensure the aiming pattern is turned off and on outside of the image capture frame coincident with the rows superimposed with the aiming pattern. Also, as noted previously, other aiming patterns may be utilized.
The image reader may be capable of operating in either the rolling shutter mode or a global electronic shutter mode. In the global electronic shutter operational mode, the image reader 32 collects a full frame of image data wherein all image reader pixels are exposed nearly simultaneously and the data is stored and subsequently processed to, for example, decode a barcode contained in the image data.
A process 300 for collecting target image data in the global electronic shutter operational mode is presented with respect to
In an exemplary embodiment, the image reader utilizes the exposure control timing pulse 324 to generate the aimer control timing pulse 320. For example, an image sensor manufactured by Micron Technology, Inc. having a product number MT9V022 provides a control signal output, labeled IMG_LED_OUT (see
In an exemplary embodiment, the image processor 150 provides a timing control signal which is utilized to control the aiming pattern (AIM_ON), illumination (ILL_ON), exposure IMG_EXP) and readout control timing signals, as exemplified in
In one embodiment the target is illuminated by overdriving the illumination sources, such as LEDs, to generate illumination several times brighter than standard operation. According to this embodiment, the overdriven illumination sources in combination with the electronic global shutter allows for short exposure periods. That is, the bright illumination allows for a short integration time for each pixel and the global electronic shutter allows for all of the pixels in the image sensor to be simultaneously exposed. With a short exposure period for a brightly illuminated target, an image reader of the present invention is able to collect a sharp non-distorted image even when the target is moving relative to the image reader. In one embodiment, the exposure period is less than 3.7 milliseconds. In one embodiment in which the light sources are overdriven, light sources with different colors are employed. For example, in one such embodiment the image reader includes white and red LEDs, red and green LEDs, white, red, and green LEDs, or some other combination chosen in response to, for example, the color of the symbols most commonly imaged by the image reader. In this embodiment, the different colored LEDs are each alternatively pulsed at a level in accordance with the overall power budget. In another such embodiment, both colored LEDs are pulsed each time but each at a relatively lower power level so that the over all power budget is again maintained. In a further embodiment, red, green, and blue LED's can be interleaved to simulate white light.
As noted, the process 300 includes processing the photoconversion generated electric charge to produce image data which can include amplifying the data generated from the incident radiation and converting the generated data into a digital signal. The processing further includes storing the generated image data values in a shielded portion of each of the plurality of pixels. The process 300 additionally includes reading out the stored image data values from the plurality of pixels. The reading out of the plurality of pixels may be controlled by a readout timing control pulse which may include a plurality of pulses transmitted to each of the plurality of pixels.
In an exemplary embodiment, the exposure control timing pulse begins after and finishes before the illumination control timing pulse. The readout control timing pulse begins at the conclusion of the illumination control timing pulse. In another embodiment, the illumination control timing pulse begins after and finishes before the exposure control timing pulse. In this embodiment, the readout control timing pulse begins at the conclusion of the exposure control timing pulse. In further embodiments the exposure control timing pulse and the illumination control timing pulse overlap each other while occurring sequentially. In one such embodiment, this sequential operation can include the illumination control timing pulse starting, the exposure control timing pulse starting, the illumination control timing signal pulse ending, and then the exposure control timing pulse ending. In this embodiment, the readout control timing pulse begins at the conclusion of the exposure control timing pulse.
In an embodiment, the illumination source illumination control timing signal pulse is coincident with the exposure control timing pulse, so that the illumination LEDs are on only during the exposure period. Operating the illumination source in this manner reduces power consumption since the illumination source is on only during the exposure period thereby increasing battery life.
It should be understood that the programs, processes, methods and apparatus described herein are not related or limited to any particular type of computer or network apparatus (hardware or software). Various types of general purpose or specialized computer apparatus may be used with or perform operations in accordance with the teachings described herein. While various elements of the preferred embodiments have been described as being implemented in software, in other embodiments hardware or firmware implementations may alternatively be used, and vice-versa. The illustrated embodiments are exemplary only, and should not be taken as limiting the scope of the present invention. For example, the steps of the flow diagrams may be taken in sequences other than those described, and more, fewer or other elements may be used in the block diagrams. Also, unless applicants have expressly disavowed any subject matter within this application, no particular embodiment or subject matter is considered to be disavowed herein.
The claims should not be read as limited to the described order or elements unless stated to that effect. In addition, use of the term “means” in any claim is intended to invoke 35 U.S.C. §112, paragraph 6, and any claim without the word “means” is not so intended. Therefore, all embodiments that come within the scope and spirit of the following claims and equivalents thereto are claimed as the invention.
This application is a continuation of and claims priority of copending U.S. patent application Ser. No. 11/405,964 filed Apr. 18, 2007, entitled “Optical Reading Device with Programmable LED Control.” The priority of the above application is claimed, and the disclosure of the above application is incorporated herein by reference in its entirety. This application is a continuation-in-part of and claims priority of co-pending U.S. patent application Ser. No. 10/842,851 filed May 11, 2004, entitled “Picture Taking Optical Reader.” The priority of the above application is claimed, and the disclosure of the above application is incorporated herein by reference in its entirety, which application claims priority of Provisional Application No. 60/470,016 filed May 12, 2003, entitled “Picture Taking Optical Reader.” The priority of the above application is claimed, and the disclosure of the above application is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 60470016 | May 2003 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11405964 | Apr 2006 | US |
| Child | 12167080 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10842851 | May 2004 | US |
| Child | 11405964 | US |
