Patent Grant
9224023
The invention relates to an optical apparatus in general and particularly to an optical apparatus having an image sensor.
Decodable indicia such as bar codes and OCR decodable characters are finding increased use in an ever expanding variety of applications. Bar codes are being applied not only to paper substrate surfaces but other surfaces as well such as plastic bags, glass, and directly on finished articles. The affixing of a decodable indicia directly to an article is referred to as “direct part marking” Where decodable symbols or characters have been applied to particularly reflective “shiny” surfaces (glass, plastic, metallic surfaces), “specular reflection” decode failures have been observed.
“Specular reflection” occurs where a light ray incident on a highly reflective (mirror) surface is reflected substantially at an angle measured from the surface that is substantially normal with respect to the incident ray. In optical readers, light sources are positioned to emit light along a path closely adjacent a centrally located imaging axis. An optical reader light is directed at a reflective target and, therefore, the illumination light tends to be reflected specularly in the direction of the reader's photodetector elements. Specular reflection can result in the captured image data failing to exhibit adequate contrast between dark and light markings of a decodable indicia. With the increased miniaturization of optical readers, light sources for illuminating a target are being positioned in closer proximity with a photodetector element of the reader, thereby rendering the modern reader more susceptible to specular reflection read failures.
The proliferation of the use of decodable markings has brought to light additional problems with presently available optical readers. It has become more common to encode more information into single decodable indicia, e.g. with use of “high density” bar codes, to affix more than one decodable indicia onto an article or package in need of decoding, and to make bar codes wider so that they can encode more information. “High density” bar codes are best decoded with the use of a high resolution optical reader which is configured to have a short “best focus” position. Extra wide code bar codes and scenes having more than one bar code are best decoded with use of readers having a longer best focus position. Commercially available optical readers cannot easily read high density extra wide decodable symbols or multiple symbols from a scene which are encoded in high density.
There is a need for an optical reader which is impervious to decode failures resulting from specular reflection, and which is adapted to read large or multiple high density decodable symbols formed on a target.
There is set forth an apparatus for capture of image data. In one embodiment an apparatus is operative for capture of a first frame of image data and a second frame of image data. In one embodiment, an apparatus is operative for processing the first frame of image data and the second frame of image data.
These and other details and advantages will become apparent from the detailed description of the preferred embodiment herein below.
For a further understanding of these and objects of the invention, reference will be made to the following detailed description of the invention which is to be read in connection with the accompanying drawing, wherein:
a-1n show various physical views of optical readers incorporating a plurality of imaging modules while
a and 2b are electrical block diagrams of electrical circuits which may be utilized with a reader incorporating a single imaging module;
c-2f show block diagrams of various electrical circuits which may be utilized with readers according to the invention incorporating a plurality of imaging modules;
g is a timing diagram for illustrating control of aiming LEDs;
h and 2i are electrical block diagrams illustrating exemplary embodiments of an FPGA as shown in the block diagram of
j is an electrical block diagram illustrating an FPGA as shown in
a and 3b show, respectively, front and rear perspective views of a 2D optical reader according to the invention;
c is an exploded perspective view of the imaging module of
d illustrates a perspective view of an exemplary 2D support assembly for an exemplary 2D imaging module according to the invention;
e illustrates a perspective view of a 1D imaging module according to the invention;
a-4c are flow diagrams illustrating exemplary control methods which may be incorporated in a multiple imaging assembly reader according to the invention;
d-4e are image frame diagrams illustrating various image combination methods which may be incorporated in a multiple imaging module reader according to the invention;
a is a physical schematic view of a compact flash card incorporating a 2D imaging module;
b is an electrical block diagram illustrating a system comprising a device as shown in
c and 5d are physical views of a the device shown in
e is a physical view illustrating a device as shown in
There is set forth an apparatus for capture of image data. In one embodiment an apparatus is operative for capture of a first frame of image data and a second frame of image data. In one embodiment, an apparatus is operative for processing the first frame of image data and the second frame of image data.
The invention in one major aspect relates to an optical reader having more than one imaging module, wherein each imaging module typically includes a combination of a support assembly, an image sensor, imaging optics, and at least one illumination light source.
In one embodiment the reader includes a gun style housing which houses a pair of 2D imaging modules. In another embodiment, the reader includes a gun style housing having three 2D imaging modules. The modules may have imaging axes that are in parallel, diverging or converging relation. One or more of the 2D imaging modules can be replaced with a 1D imaging module.
In another embodiment the reader module may include a “dumbbell” style housing having a central handle portion and a pair of laterally disposed head portions, each of the head portions housing an imaging module. The head portions can be made adjustable so that the relative position of the imaging axes of the two imaging modules can be adjusted. The dumbbell reader can be mounted on a presentation stand which further includes a third head portion which houses a third imaging module.
In another aspect, an optical reader of the invention can be operated using a control circuit which comprises a multi-functional processor IC chip which, in addition to having a central processing unit (CPU) includes a programmable integrated frame grabber block.
A control circuit of the invention can be adapted to carry out a variety of routines involving coordinated capture of image data utilizing more than one imaging module. In one example of the invention, a frame of image data is captured by actuation of a first imaging module and light sources from a first imaging module. The frame is then subjected to a decoding attempt. If the decoding attempt involving the first captured frame fails, a second frame of image data is captured by actuation of an image sensor of the first imaging module and actuation of a light source from a second imaging module and subjected to decoding. The second frame of image data captured utilizing a spaced apart illumination light source and image sensor from two spaced apart imaging modules can be expected to be free of image degradation problems attributable to specular reflection.
In another aspect of the invention, a control circuit can be configured to combine image data captured by a reader of the invention having more than one imaging module. Because the relative positions of imaging modules in a multiple imaging module reader of the invention are known, first and second frames of image data captured via actuation of first and second imaging modules of a reader of the invention can readily be combined according to an image frame combination method.
In a still further aspect of the invention, various imaging modules of a multiple imaging module optical reader can be configured to have different best focus positions. Configuring different imaging modules of a multiple imaging module optical reader to have different best focus positions improves the overall depth of field of the multiple imaging module optical reader.
These and other details and advantages will become apparent from the detailed description of the preferred embodiment herein below.
Embodiments of optical readers having more than one imaging module are shown in
Imaging module 10 can be screw mounted on any rigid member within housing 7 in the manner described in application Ser. No. 10/092,789 filed Mar. 7, 2002, entitled “Optical Reader Imaging Module,” incorporated herein by reference hereinabove. Module 10 can include screw holes 810 for facilitating mounting of module 10 on a rigid member. As indicated by support assembly 80 of
Module 10a and module 10b are disposed in a common cavity 6. A wall 8 formed in housing 7 dividing cavity 6 into two spaces would not create two separate cavities since cavity 6 of reader 5-1 would still be delimited by the common outer peripheral wall of housing 7.
Incorporating more than one imaging module 10 in an optical reader housing 7 yields a number of advantages. For example, if an attempt to decode a decodable indicia by capturing and subjecting to decoding an image captured via actuation of first module 10a fails, a second decoding an attempt can be made by capturing and subjecting to decoding image captured via actuation of second imaging module 10b. Further, reader 5 can be actuated to capture and subject to decoding a frame of image data captured by actuation of an image sensor 32 of a first module 10a and illumination LEDs 16 of a second imaging module 10b. The spacing between illumination LEDs 16 of a second module 10b and an image sensor 32 of a first imaging module 10a renders the frame of image data capture by the described method substantially impervious to specular reflection image degradation.
In addition, image data of several frames captured by actuation of several different imaging modules can be combined, by one of several possible image frame combination methods, to yield a larger frame of image data. The larger image representation is yielded by combining multiple frames of image data and can be subjected to decoding, thereby facilitating decoding of larger decodable indicia or multiple decodable indicia printed over a large area of a target substrate. Specular reflection avoidance and frame image combination methods will be described in greater detail herein.
In the embodiment of
In
In the embodiment of
Referring now to
Dumbbell reader 5-5 is a reader including three housing portions 7 and each defining a cavity 6. Reader 5-5 of
In the embodiment of
A dumbbell style reader e.g. 5-5 and 5-6 is particularly well suited for use in applications wherein specular reflection read failures can be expected. In the example of
The multiple imaging module optical readers as shown in
Referring now to reader 5-9 of
One-dimensional bar code symbols are more common than 2D bar code symbols. Further, 1D bar code symbols are generally decoded more quickly and more accurately by capturing and processing 1D slice image data captured via actuation of a 1D image sensor than capturing and processing 2D image data captured via actuation of a 2D image sensor. Still further, an imaging axis 11c of center imaging module 10c disposed in a gun-style housing 7 can more readily be aligned with an indicia of a target, T, than lateral imaging modules 10a and 10b. Accordingly, it can be seen that reader 5-9 programmed in accordance with the above-described decode program is a reader which is both mechanically configured and programmed for optimization of the decoding of 1D symbols, while still having the capacity to decode matrix 2D symbols where matrix 2D symbols are present within a target, T.
Referring to
In one variation of the embodiment of
In another variation of the embodiment of
In another variation of the embodiment of
Various electrical circuits 100, 101, 102, 103, 104, and 105 which can be utilized to control optical readers are shown and described with reference to
In
In the specific embodiment of
In the embodiment shown in
Frame grabber block 148 of IC chip 180 replaces the function of a frame grabbing field programmable gate array (FPGA) as discussed in commonly assigned application Ser. No. 09/954,081, filed Sep. 17, 2001, entitled “Imaging Device Having Indicia-Controlled Image Parsing Mode,” incorporated herein by reference and application Ser. No. 09/904,697, filed Jul. 13, 2001, entitled “An Optical Reader Having a Color Imager” incorporated herein by reference. More particularly, frame grabber block 148 is specifically adapted collection of hardware elements programmed to carry out, at video rates or higher, the process of receiving digitized image data from image sensor chip 182 and writing digitized image data to system RAM 142 which in the embodiment shown is provided on a discreet IC chip. Frame grabber block 148 includes hardware elements preconfigured to facilitate image frame capture. Frame grabber block 148 can be programmed by a user to capture images according to a user's system design requirements. Programming options for programming frame grabber block 148 include options enabling block 148 to be customized to facilitate frame capture that varies in accordance with image sensor characteristics such as image sensor resolution, clockout rating, and fabrication technology (e.g. CCD, CMOS, CID), dimension (1D or 2D) and color (monochrome or color).
Aspects of the operation of circuit 100 when circuit 100 captures image data into RAM 140 are now described. When trigger 13t is pulled, CPU 141, under the operation of a program stored in system ROM 143, writes an image capture enable signal to image sensor chip 182 via communication line 151. Line 151, like the remainder of communication lines described herein represents one or more physical communication lines. In the embodiment shown, wherein image sensor chip 182 is of a type available from IC Media Corp., I2C interface 115 of chip 180 is utilized to facilitate communication with chip 182 (if another image sensor chip is selected another type of interface e.g. interface 116 may be utilized). Other types of signals may be sent over line 151 during the course of image capture. Line 151 may carry, for example, timing initialization, gain setting and exposure setting signals.
When control block 135 of image sensor chip 182 receives an image capture enable instruction, control block 135 sends various signals to frame grabber block 148. Image sensor control block 135 typically sends various types of synchronization signals to frame grabber block 148 during the course of capturing frames of image data. In particular, control block 135 may send to frame grabber block 148 “start of frame signals” which inform frame grabber block 148 that chip 182 is ready to transmit a new frame of image data, “data valid window” signals which indicate periods in which a row of image data is valid and “data acquisition clock” signals as established by clock 137 controlling the timing of image data capture operations. In the embodiment described, line 152 represents three physical communication lines, each carrying one of the above types of signals. In an alternative embodiment, vertical and horizontal synchronization signals are processed by frame grabber 148 to internally generate a data valid window signal. Frame grabber block 148 appropriately responds to the respective synchronization signals, by establishing buffer memory locations within integrated RAM 149 of block 148 for temporary storage of the image data received from image sensor chip 182 over data line 159. At any time during the capture of a frame of image data into system RAM 142, buffer RAM 149 of frame grabber block 148 may store a partial (e.g., about 0.1 to 0.8) or a full line of image data.
Referring to further aspects of electrical circuit 100, circuit 100 includes a system bus 150. Bus 150 may be in communication with CPU 141 via a memory interface such as EIM interface 117 of IC chip 180. System RAM 142 and system ROM 143 are also connected to bus 150 and in communication with CPU 141 via bus 150. In the embodiment shown, RAM 142 and ROM 143 are provided by discreet IC chips. System RAM 142 and system ROM 143 could also be incorporated into processor chip 180.
In addition to having system RAM 142, sometimes referred to as “working” RAM, electrical circuit 100 may include one or more long term storage devices. Electrical circuit 100 can include for example a “flash” memory device 120. Several standardized formats are available for such flash memory devices including: “Multimedia” (MMC), “Smart Media,” “Compact Flash,” and “Memory Stick.” Flash memory devices are conveniently available in card structures which can be interfaced to CPU 141 via an appropriate “slot” electromechanical interface in communication with IC chip 180. Flash memory devices are particularly useful when reader 5 must archive numerous frames of image data. Electrical circuit 100 can also include other types of long term storage such as a hard drive which may be interfaced to bus 150 or to an appropriate I/O interface of processor IC chip 180.
In a further aspect of electrical circuit 100, control circuit 140 is configured to control the turning off and turning on of LEDs 16, 18 of illumination block 160. Control circuit 140 preferably controls illumination block 160 in a manner that is coordinated with the capturing of the frames of image data. Illumination LEDs 16 are typically on during at least a portion of frame capture periods. Configuring circuit 140 so that LEDs 16, 18 have off periods significantly reduces the power consumption of circuit 100.
In a further aspect of the electrical circuit 100, electrical circuit 100 can be configured so that PWM output interface 114 of IC chip 180 controls illumination LEDs of an imaging module such as illumination LEDs 16 of module 10-1 or aiming/illumination LEDs 18 of module 10-2.
In one embodiment, illumination block 160 is in communication with PWM output interface 114 and configured in such manner that LEDs 16 are turned on at a leading edge of PWM pulses output at PWM interface 114, and are turned off at falling edges of PWM pulses output at PWM interface 114. PWM interface 114 should be configured so that several pulses are generated and sent over communication line 153i during the time that a single row of pixels of image data are exposed to light prior to clocking out of pixel values corresponding to that row. Thus, illumination LEDs 16 would be turned on and off several times during the exposure period for exposing a row of pixels to light. Further, the number of pulses output by PWM output 114 during the time that a single row of pixels are exposed should not vary substantially from row to row. The pixel clock signal received at frame grabber block 148 of IC chip 180 can be utilized to generate the PWM output. It can be seen, therefore, that multifunctional IC chip 180 including frame grabber block 148 and PWM output 114 greatly simplifies the task of developing PWM signals for use in controlling illumination LEDs 16 of module 10.
In another embodiment, PWM output 114 and illumination block 160 are configured so that PWM output 114 controls the intensity of illumination, not the on time/off time of illumination. Illumination LED block 160 in such an embodiment can include a power supply circuit which is interfaced to PWM output 114 such that the PWM signal output at PWM output 114 varies the voltage or current supplied to LEDs 16.
In a further aspect of electrical circuit 100, aiming LEDs 18 of circuit 100 can be controlled by a signal transmitted by a general purpose I/O port 116 of IC chip 180 over communication line 153a. Multifunctional processor IC chip 180 can be programmed so that an aiming LED control signal 168, as is shown in the timing diagram of
Referring now to
Referring to aspects of electrical circuit 101 in detail, electrical circuit 101 includes a control circuit 140 which, like control circuit 140 of circuit 100 is partially incorporated in a multifunctional processor IC chip 180 including CPU 141 and a frame grabber block 148. Control circuit 140 of circuit 101 further includes system RAM 142 system ROM 143 and supplementary central processor unit (CPU) 147, integrated on processor IC chip 179. System RAM 142 and system RAM 143 are in communication with EIM interface 117 of IC chip 180 via bus 150.
Processor IC chip 179 provides control and timing operations similar to that provided by electrical block 134 of image sensor chip 182 described in
Aspects of the operation of IC chip 179 in during the course of capturing slice image data will now be described in detail. When trigger 13t is pulled, CPU 141 transmits enable image capture instructions over communication line 151. In response to receipt of an image capture enable instructions received from chip 180, processor IC chip 179 performs a variety of operations. Via communication line 152, processor IC chip 179 may send synchronization signals, such as “start of scan,” “data valid window,” and “data acquisition clock” signals to frame grabber block 148. Processor IC chip 179 may also send timing signals and digital clocking signals (e.g. master clock, integration clear gate, and shift gate pulse) to image sensor 32. Processor IC chip 179 typically also transmits a master clock signal to A/D conversion circuit 136. Referring to further aspects of IC chip 180 of circuit 101, CPU 141 of chip 180, may also send e.g. gain setting, exposure setting, and timing initialization signals via line 151 to IC chip 179. Communication between IC chip 180 and IC chip 179 may be made via an SPI interface or I/O interface 116 of chip 180 and chip 179.
As will be explained with reference to circuit 104, shown in
Processor IC chip 179 also controls LED bank 160. LED bank 160 of a 1D image sensor reader typically includes a single bank of LEDs which simultaneously illuminates a target area and provides an aiming pattern facilitating aligning of the reader with a target indicia. LEDs 18 of 1D imaging module 10-2 like LEDs 16 of module 10-1 can be pulsed so as to reduce energy consumption by LEDs 18.
Electrical circuit 100 and electrical circuit 101 form a family of 1D and 2D optical readers electrical circuits, which may be manufactured by a single manufacturing entity wherein both of the 1D and 2D readers include the same main processor chip, namely, multifunctional processor IC chip 180. Multifunctional processor IC chip 180 of circuit 100 and circuit 101 can both be provided by e.g. a Dragonball IC chip or an Anaconda IC chip of the type available from Motorola, Inc. Multifunctional processor IC chip 180 of electrical circuit 101 includes far more processing power than is necessary to provide the functionality of a 1D optical reader. Nevertheless, the inventors discovered that the overall cost of electrical circuit 101 would be reduced by incorporating frame grabbing multifunctional IC chip 180 in circuit 101 in that such incorporation reduces overall engineering cost relative to that which would ensue from the development of two different 1D and 2D electrical circuits comprising two different main processor types.
Various electrical circuit architectures for operating a reader having more than one imaging module 10 are shown in
In the architecture of
Referring to the operation of electrical circuit 102 in further detail, processor IC chip 180 sends an image capture enable signal to FPGA 161 via line 170 when trigger 13t is actuated and to an appropriate one of modules 10a and 10b via one of lines 151a, 151b. The selected module, 10a or 10b, then sends synchronization signals, and the digital clocking signals as described previously to FPGA 161 and IC chip 180, over the appropriate one of lines 152a, 152b.
FPGA 161 transmits image data to multifunctional processor IC Chip 180 over data line 171 which in turn transmits image data to RAM 142 over system bus 150. Lines 151a, 151b may carry PWM interface illumination control signals as described previously in connection with electrical circuit 100.
In the architecture of
Various embodiments of FPGA 162 are described with reference to
In the embodiment of FPGA 162 illustrated in
Referring to further aspects of electrical circuit 103, of
Referring now to
For capture of a 2D image, processor IC chip 180 in response to actuation of trigger 13t sends an image capture enable signal to module 10-1 via a communication line 151. During image capture, 2D imaging module 10-1 sends synchronization and digital clocking signals to frame grabber block 148 via communication line 152 which as explained previously and like all lines represented herein may represent a plurality of physical lines. Further, 2D imaging module 10-1 sends digitized image data to frame grabber block 148 via data line 159a. Processor IC chip 180 stores image data in RAM 142 by writing image data stored in buffer memory locations of frame grabber block 148 to RAM 142 via system bus 150. An illumination control signal communication line is also typically interposed between IC chip 180 and module 10-1. An illumination signal communication line can be considered to be represented by line 151.
For capture of a 1D “slice” image representation, processor IC chip 180 sends a 1D image capture enable signal to FPGA 164 via system bus 150. Processor IC chip 180 and FPGA 164 are further in communication via communication line 167 which carries bus handshaking (e.g. bus request and bus grant) signals. On receipt of an image capture enable signal from processor IC chip 180, FPGA 164 sends digital clocking signals to A/D converter 136 via line 156, to image sensor 32 via line 154, and illumination control signals to illumination LEDs 18 as shown in the physical form view of
As indicated by the block diagram of
Another electrical circuit for controlling a plurality of imaging modules is described with reference to
Control circuit 140 of electrical circuit 105 includes CPU 141 which may be incorporated on a general purpose 32 bit processor IC chip 179, frame grabbing FPGAs 165 and 166, system RAM 142 and system ROM 143. Processor IC chip 179 may transmit image capture enable instruction via communication lines 151a and 151b. Processor IC chip 179 may also send illumination control signals via lines 151a and 151b. For example, in a mode of operation that will be described herein processor IC chip may send an image capture enable signal to module 10a over line 151a (and an illumination disabling signal over line 151a), and an illumination control signal to module 10b over line 151b with use of a specific image capture method wherein images are captured in such a manner so as to be substantially impervious to specular reflection decode failures.
In a further aspect of electrical circuit 105, imaging modules 10a and 10b send synchronization and digital clocking signals to FPGAs 165 and 166 respectively, via lines 152a and 152b, and image data to FPGAs 165 and 166 respectively over, data lines 159a and 159b. Processor IC chip 179 is in communication with frame grabbing FPGAs 165 and 166 via system bus 150 and via bus arbitration communication lines 167a and 167b over which bus handshaking signals (e.g. bus request, bus grant) are sent. While the invention in a major aspect relates to optical readers having multiple imaging modules, another commercial optical product according to another aspect of the invention is described with reference to
In
As best seen in
Various features of compact flash card 510 incorporating module 10 are described with reference to
Compact flash card 510 including electrical circuit 100 as indicated by block diagram
Referring to further aspects of the block diagram of
FPGA 520 can be connected via a communication line 504 to UART interface 108 of multifunctional processor IC chip 180. UART interface 108 may transmit data in e.g. an RS 232 format while FPGA 520, appropriately programmed, converts that data into a compact flash format. Further connected to FPGA 520 via line 526 is a compact flash female connector 530, which is formed on an edge of compact flash card 510, and comprises a plurality of sockets 530s as indicated in the exploded section view of
Compact flash card 510 including an electrical circuit 100 having imaging module 10 can operate in a first integrated mode or a second “free-standing” which in one specific embodiment can be considered a “tethered” mode. An integrated mode of operation of card 510 is described with reference to
A free-standing mode of operation is illustrated with reference to
The multiple-module electrical circuits 102, 103, 104, and 105 described herein can be implemented for operation of imaging modules spread out over several housings or for operation of imaging modules incorporated in a housing 7 of multiple imaging module reader 5-1, 5-2, 5-3, 5-4, 5-5, 5-6, and 5-7, 5-8 and 5-9 as shown in physical form views 1a-1m.
Additional aspects of electrical circuits which may be used with the invention are describe in U.S. Patent Application No. 60/470,016, filed May 12, 2003, incorporated by reference and U.S. application Ser. No. 10/339,439, filed Jan. 9, 2003 is also incorporated by reference.
Methods for operating a multiple imaging module optical reader according to the invention will now be described in greater detail. Flow diagrams of
In the reader methods described herein “actuation of an image sensor” generally refers to at least one step in the process of sending appropriate signals to an image sensor 32 to cause exposure of image sensor pixels image sensor to light and to cause clocking out of electrical signals corresponding to light received at pixels of the array. These steps are described in greater detail in for example, U.S. application Ser. No. 09/766,922, filed Jan. 22, 2001, entitled “Optical Reader Having Reduced Parameter Determination Delay,” incorporated herein by reference. “Actuation of illumination” herein generally refers to the step of sending electrical current to a light source e.g. 16, 18 to turn on the light source.
Referring to the reader operating method of
A “wait for trigger pull” control loop, as described in connection with block 402,
In one possible variation of the invention, first and second imaging modules 10a, 10b, and possibly all N modules of an N imaging module optical reader are configured so that each module has a different best focus distance. For example, module 10c of reader 5-2 can be configured to a best focus distance of about 3 inches, module 10a can be configured to have a best focus distance of about 6 inches, while module 10b can be configured to have a best focus distance of about 9 inches. In another example, one dimensional imaging module 10a of reader 5-10 (
A multiple module reader of the invention wherein each module has a different best focus distance can be operated in accordance with the flow diagram of
While block 404 of the flow diagram of
Another method for operating a multiple imaging module optical reader is described with reference to the flow diagram of
A still further method for operating an optical reader having a plurality of imaging modules is described with reference to the flow diagram of
At several stages of the operating methods described herein, multiple imaging module reader 5 executes the steps of attempting to decode decodable indicia and branching control of an operating program if the decoding attempt is not successful. In a further aspect of the invention, the step of attempting to decode in any one of the operating programs described with reference to
The step of preliminarily evaluating image data to determine whether decoding will be successful can take on a variety of forms. In one example of the preliminary image data evaluating step, a preliminary image data evaluating step can include the step of examining gray scale values of a frame of image data to determine if the image data has become saturated. If a saturation condition (sometimes referred to as a “white out” condition) is present there is a substantial likelihood of specular reflection misread or other type of misread attributable to excessive illumination. A saturated condition can be considered to be present for example if a sum total of all gray scale values exceeds a predetermined value, or if an average gray scale value exceeds a predetermined threshold white level. All pixel values may be evaluated during the preliminary evaluation step. More typically, however, a sample of pixel values comprising less than all pixel values of a frame are evaluated to speed processing. The sampling of pixels may be predetermined and/or adaptive.
The step of preliminarily evaluating image data to determine whether decoding will be successful can also include the step of estimating a module-to-target distance. If an estimated module-to-target distance exceeds a best focus distance by a threshold amount (which may be a predetermined threshold), control circuit 140 may preliminarily determine that decoding will likely not be successful without actually subjecting image data of a frame to a decode attempt. A method for generating a signal that varies with module to target distance is described in commonly assigned U.S. Pat. No. 5,773,810, entitled “Method of Generating Real Time Degree of Focus Signal For Hand Held Imaging Device,” incorporated herein by reference.
Referring to the operating method described with reference to
In one method for combining a first frame and a second frame of image data, cross correlation image combination methods can be utilized. In a cross correlation image combination method statistical analyses are executed to compare two or more frames of image data and frames of image data are shifted relative to one another until correlation is optimized.
In another method for combining first and second frames of image data, areas of overlap between two frames of image data e.g. 610, 614 are determined and then the image data contribution from one of the frames corresponding to the overlapping area is deleted or modified in a manner depending on the overlapping region image data of the other frame to generate a third image representation 630. In the example of
The area of overlap between frames of image data captured via actuation of the image sensors of neighboring imaging modules can be determined based on known characteristics of the neighboring imaging modules 10 of reader 5, such as the spacing between imaging modules of reader 5 (e.g. modules 10a and 10c of reader 5-3), power of imaging optics 40 of the particular imaging module 10, and the respective module-to-target distances of the neighboring modules. A distance of a module to a target can be estimated via analysis of captured image data, for example by a method for developing a degree of focus signal as is described in commonly assigned U.S. Pat. No. 5,773,810, entitled “Method For Generating Real Time Degree of Focus Signal For Hand Held Imaging Device,” incorporated herein by reference. It can be seen that the image frame diagram of
Referring to the frame diagram of
Still further, graphical feature analysis can be utilized in combining frames of image data. If a common graphical feature (e.g., a straight line, a bulls eye, a circle, a character) is found in two frames of image data, the common graphical feature can be utilized to establish a common orientation, spacing, and skew basis between the frames of image data to be combined.
A small sample of systems methods and apparatus that are described herein is as follows:
A1. An optical reader comprising:
a housing defining at least one cavity;
a first imaging module mounted in said at least one cavity;
a second imaging module mounted in said at least one cavity;
wherein each of said first and second modules includes an image sensor, a support assembly, and at least one illumination LED;
a control circuit in communication with each of said first and second imaging modules;
wherein said control circuit is programmed, in response to receipt of a trigger signal, to:
(a) capture a first frame of image data via actuation of said at least one illumination LED and said image sensor of said first imaging module;
(b) determine whether said first frame of image data includes decodable indicia;
(c) automatically subject to a decode attempt a second frame of image data if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first frame of image data, wherein said second frame of image data is captured via actuation of said at least one LED and said image sensor of said second imaging module.
A2. The reader of A1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data attempts to decode decodable indicia represented in said first frame of image data.
A3. The reader of A1, wherein said control circuit 140 captures said second frame of image data contemporaneously while capturing said first frame of image data.
A4. The reader of A1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data preliminarily evaluates image data of said first frame without attempting to decode decodable indicia represented therein.
A5. The reader of A4, wherein said control circuit in preliminarily evaluating said image data evaluates said image data to determine whether a saturation condition is present.
A6. The reader of A1, wherein said first imaging module is a 1D imaging module and wherein said second imaging module is a 2D imaging module.
A7. The reader of A1, wherein said first and second imaging modules are configured to have first and second best focus distances, wherein said first best focus distance is at least 1 inch apart from said second best focus distance.
A8. The reader of A1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
A9. The reader of A1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
B1. An optical reader comprising:
a housing defining at least one cavity;
a first imaging module mounted in said at least one cavity,
a second imaging module mounted in said at least one cavity;
wherein each of said first and second modules includes an image sensor, a support assembly, and at least one illumination LED;
a control circuit in communication with each of said first and second imaging modules;
wherein said control circuit is programmed, in response to receipt of a trigger signal to:
(a) capture a first frame of image data via actuation of said illumination LED and said image sensor of said first imaging module;
(b) determine whether said first frame of image data includes decodable indicia;
(c) automatically subject to a decode attempt a second frame of image data if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first frame, wherein said second frame of image data is captured via actuation of said at least one LED of said second imaging module and said image sensor of said first imaging module, wherein no illumination LED of said first imaging module is actuated when said second frame of image data is captured.
B2. The reader of B1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data attempts to decode decodable indicia represented in said first frame of image data.
B3. The reader of B1, wherein said control circuit captures said second frame of image data contemporaneously while capturing said first frame of image data.
B4. The reader of B1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data preliminarily evaluates image data of said first frame without attempting to decode decodable indicia represented therein.
B5. The reader of B4, wherein said control circuit in preliminarily evaluating said image data evaluates said image data to determine whether a saturation condition is present.
B6. The reader of B1, wherein said first imaging module is a 1D imaging module and wherein said second imaging module is a 2D imaging module.
B7. The reader of B1, wherein said first and second imaging modules are configured to have first and second best focus distances, wherein said first best focus distance is at least 1 inch apart from said second best focus distance.
B8. The reader of B1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
B9. The reader of B1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
C1. An optical reader comprising:
a housing defining a cavity;
a first imaging module mounted in said cavity;
a second imaging module mounted in said cavity;
wherein each of said first and second imaging modules includes an image sensor, a support assembly, and at least one illumination LED;
a control circuit in communication with each of said first and second imaging modules;
wherein said control circuit is programmed, in response to receipt of a trigger signal, to:
(a) capture a first and second frame of image data, wherein said first frame of image data is captured via actuation of said at least one LED and said image sensor of said first imaging module, and said second frame of image data is captured via actuation of said at least one LED and said image sensor of said second imaging module;
(b) determine whether said first and second frames include decodable indicia;
(c) automatically combine said first frame and said second frame to generate a third image representation if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first and second frames of image data; and to
(d) subject said third image representation to a decode attempt.
C2. The reader of C1, wherein said control circuit in determining whether decodable indicia is represented in said first and second frames of image data attempts to decode decodable indicia represented in said first and second frames of image data.
C3. The reader of C1, wherein said control circuit captures said second frame of image data contemporaneously while capturing said first frame of image data.
C4. The reader of C1, wherein said control circuit in determining whether decodable indicia is represented in said first and second frames of image data preliminarily evaluates image data of said first and second frames of image data without attempting to decode decodable indicia represented therein.
C5. The reader of C4, wherein said control circuit in preliminarily evaluating said image data evaluates gray scale pixel values of said image data to determine whether a saturation condition is present.
C6. The reader of C1, wherein said control circuit in combining said first and second frames of image data determines an area of overlap between said first and second frames of image data.
C7. The reader of C1, wherein said control circuit in combining said first and second frames of image data generates a signal indicative of a module-to-target distance of at least one of said modules.
C8. The reader of C1, wherein said control circuit in combining said first and second frames of image data combines said first and second frames in a manner dependent on an angle between imaging axes of said first and second imaging modules.
C9. The reader of C1, wherein said control circuit in combining said first and second frames of image data identifies a common graphical element commonly represented in said first and second frames of image data.
C10. The reader of C1, wherein said first and second imaging modules are configured to have first and second best focus distances, wherein said first best focus distance is at least 1 inch apart from said second best focus distance.
C11. The reader of C1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
C12. The reader of C1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
D1. An optical reader comprising:
a first imaging module having a first imaging axis and a first best focus distance;
a second imaging module having a second imaging axis and a second best focus distance, said second best focus distance being at least one inch apart from said first best focus distance;
wherein each of said first and second imaging modules includes an image sensor having an array of photosensitive elements, a support assembly, and at least one illumination LED;
wherein one of said imaging modules is a one dimensional imaging module including a linear array of photosensitive elements and one of said imaging modules is a two dimensional imaging module including a two dimensional array of photosensitive elements;
a control circuit in communication with each of said first and second imaging modules;
a hand held housing encapsulating said first imaging module, said second imaging module, and said control circuit;
wherein said control circuit is programmed, in response to receipt of a trigger signal, to:
(a) capture a first frame of image data via actuation of said at least one illumination LED and said image sensor of said first imaging module;
(b) determine whether said first frame of image data includes decodable indicia;
(c) automatically subject to a decode attempt a second frame of image data if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first frame of image data, wherein said second frame of image data is captured via actuation of said at least one LED and said image sensor of said second imaging module.
D2. The reader of D1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data attempts to decode decodable indicia represented in said first frame of image data.
D3. The reader of D1, wherein said first and second imaging modules are disposed in vertical relation to one another.
D4. The reader of D1, wherein said first and second imaging modules are disposed in horizontal relation to one another.
D5. The reader of D1, wherein said imaging modules are disposed so that said first and second imaging axes converge toward one another forward of said reader.
D6. The reader of D1, wherein said imaging modules are disposed so that said first and second imaging axes diverge apart from one another forward of said reader.
D7. The reader of D1, wherein said control circuit captures said second frame of image data contemporaneously while capturing said first frame of image data.
D8. The reader of D1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data preliminarily evaluates image data of said first frame without attempting to decode decodable indicia represented therein.
D9. The reader of D8, wherein said control circuit in preliminarily evaluating said image data evaluates said image data to determine whether a saturation condition is present.
D10. The reader of D1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
D11. The reader of D1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
D12. The reader of D1, wherein said housing is a gun-style housing.
E1. An optical reader comprising:
a first imaging module having a first imaging axis;
a second imaging module having a second imaging axis;
wherein each of said first and second imaging modules includes an image sensor having an array of photosensitive elements, a support assembly, and at least one illumination LED;
a control circuit in communication with each of said first and second imaging modules;
a hand held housing encapsulating said first imaging module, said second imaging module, and said control circuit;
wherein said control circuit is programmed, in response to receipt of a trigger signal, to:
(a) capture a first frame of image data via actuation of said at least one illumination LED and said image sensor of said first imaging module;
(b) determine whether said first frame of image data includes decodable indicia;
(c) automatically subject to a decode attempt a second frame of image data if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first frame of image data, wherein said second frame of image data is captured via actuation of said at least one LED and said image sensor of said second imaging module.
E2. The reader of E1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data attempts to decode decodable indicia represented in said first frame of image data.
E3. The reader of E1, wherein said first and second imaging modules are disposed in vertical relation to one another.
E4. The reader of E1, wherein said first and second imaging modules are disposed in horizontal relation to one another.
E5. The reader of E1, wherein said imaging modules are disposed so that said first and second imaging axes converge toward one another forward of said reader.
E6. The reader of E1, wherein said imaging modules are disposed so that said first and second imaging axes diverge apart from one another forward of said reader.
E7. The reader of E1, wherein said control circuit captures said second frame of image data contemporaneously while capturing said first frame of image data.
E8. The reader of E1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data preliminarily evaluates image data of said first frame without attempting to decode decodable indicia represented therein.
E9. The reader of E7, wherein said control circuit in preliminarily evaluating said image data evaluates said image data to determine whether a saturation condition is present.
E10. The reader of E1, wherein said first imaging module is a 1D imaging module and wherein said second imaging module is a 2D imaging module.
E11. The reader of E1, wherein said first and second imaging modules are configured to have first and second best focus distances, wherein said first best focus distance is at least 1 inch apart from said second best focus distance.
E12. The reader of E1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
E13. The reader of E1, wherein said housing is a gun-style housing.
E14. The reader of E1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
F1. An optical reader comprising:
a portable housing;
a first imaging module having a first imaging axis;
a second imaging module having a second imaging axis, wherein said first and second imaging modules are disposed so that said first and second imaging axes converge toward one another;
wherein each of said first and second modules includes an image sensor having an array of photosensitive elements, a support assembly, and at least one illumination LED;
a control circuit in communication with each of said first and second imaging modules;
wherein said first and second imaging modules are encapsulated in said portable gun style housing, and
wherein said control circuit is programmed, in response to receipt of a trigger signal to:
(a) capture a first frame of image data via actuation of said illumination LED and said image sensor of said first imaging module;
(b) determine whether said first frame of image data includes decodable indicia;
(c) automatically subject to a decode attempt a second frame of image data if said determination step (b) indicates that decodable indicia is not or is likely not represented in said first frame, wherein said second frame of image data is captured via actuation of said at least one LED of said second imaging module and said image sensor of said first imaging module, wherein no illumination LED of said first imaging module is actuated when said second frame of image data is captured.
F2. The reader of F1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data attempts to decode decodable indicia represented in said first frame of image data.
F3. The reader of F1, wherein said control circuit captures said second frame of image data contemporaneously while capturing said first frame of image data.
F4. The reader of F1, wherein said control circuit in determining whether decodable indicia is represented in said first frame of image data preliminarily evaluates image data of said first frame without attempting to decode decodable indicia represented therein.
F5. The reader of F1, wherein said control circuit in preliminarily evaluating said image data evaluates said image data to determine whether a saturation condition is present.
F6. The reader of F1, wherein said first imaging module is a 1D imaging module and wherein said second imaging module is a 2D imaging module.
F7. The reader of F1, wherein said first and second imaging modules are configured to have first and second best focus distances, wherein said first best focus distance is at least 1 inch apart from said second best focus distance.
F8. The reader of F1, wherein said trigger signal is an automatically generated trigger signal generated by decodable indicia being moved in a field of view of said reader.
F9. The reader of F1, further comprising a trigger, wherein said trigger signal is generated when said trigger is pulled.
F10. The reader of F1, wherein said first portable housing is a gun-style housing.
While the present invention has been explained with reference to the structure disclosed herein, it is not confined to the details set forth and this invention is intended to cover any modifications and changes as may come within the scope of the following claims.
The present application claims the benefit of U.S. patent application Ser. No. 13/323,147 for an Apparatus Operative for Capture of Image Data, filed Dec. 12, 2011 (and published Jun. 21, 2012, as U.S. Patent Application Publication No. 2012/0153022), now U.S. Pat. No. 8,596,542, which is a division of U.S. patent application Ser. No. 11/187,608 for an Optical Reader Having A Plurality Of Imaging Modules, filed Jul. 22, 2005 (and published Dec. 22, 2005 as U.S. Patent Application Publication No. 2005/0279836), now U.S. Pat. No. 8,074,887, which is a continuation of U.S. patent application Ser. No. 10/453,796 for an Optical Reader Having A Plurality Of Imaging Modules, filed Jun. 3, 2003 (and published Feb. 5, 2004, as U.S. Patent Application Publication No. 2004/0020990), now U.S. Pat. No. 7,219,843, which is a continuation-in-part of U.S. patent application Ser. No. 10/161,950 for an Optical Reader Having A Plurality Of Imaging Modules, filed Jun. 4, 2002 (and published Dec. 4, 2003, as U.S. Patent Application Publication No. 2003/0222147), now abandoned. The aforementioned U.S. patent application Ser. No. 10/453,796 is also a continuation-in-part of U.S. patent application Ser. No. 10/252,484 for a Long Range Optical Reader, filed Sep. 23, 2002 (and published Dec. 11, 2003, as U.S. Patent Application Publication No. 2003/0226895), now U.S. Pat. No. 7,055,747, which claims priority to U.S. Patent Application No. 60/387,842 for a Long Range Optical Reader, filed Jun. 11, 2002. The aforementioned U.S. patent application Ser. No. 10/453,796 also claims priority to U.S. Patent Application No. 60/387,842. The aforementioned U.S. patent application Ser. No. 11/187,608 is also a continuation-in-part of U.S. patent application Ser. No. 10/782,569 for an Optical Reader Having A Plurality Of Imaging Modules, filed Feb. 19, 2004 (and published Aug. 26, 2004, as U.S. Patent Application Publication No. 2004/0164165), now abandoned, which is a continuation of aforementioned U.S. patent application Ser. No. 10/161,950. Each of the foregoing patent applications, patent publications, and patents is hereby incorporated by reference in its entirety. The present application is also related to U.S. patent application Ser. No. 10/440,729 for a Long Range Optical Reader, filed May 19, 2003 (and published Feb. 26, 2004, as U.S. Patent Application Publication No. 2004/0035933), now U.S. Pat. No. 7,090,132, which is a continuation-in-part of aforementioned U.S. patent application Ser. No. 10/252,484. The aforementioned U.S. patent application Ser. No. 10/440,729 also claims priority to the aforementioned U.S. Patent Application No. 60/387,842. Each of the foregoing patent applications, patent publication, and patent is hereby incorporated by reference in its entirety. The present application is also related to International Application No. PCT/US03/17564 for an Optical Reader Having A Plurality Of Imaging Modules, filed Jun. 4, 2003 (and published Dec. 11, 2003, as International Publication No. WO 2003/102859) claims priority to the aforementioned U.S. patent application Ser. No. 10/440,729, U.S. patent application Ser. No. 10/252,484, U.S. Patent Application No. 60/387,842, and U.S. patent application Ser. No. 10/161,950. Each of the foregoing patent applications and patent publication is hereby incorporated by reference in its entirety. The present application is also related to International Application No. PCT/US03/18557 for a Long Range Optical Reader, filed Jun. 11, 2003 (and published Dec. 18, 2003, as International Publication No. WO 2003/10485) claims priority to the aforementioned U.S. patent application Ser. No. 10/440,729, U.S. patent application Ser. No. 10/252,484, and U.S. Patent Application No. 60/387,842. Each of the foregoing patent applications and patent publication is hereby incorporated by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3262023 | Boyle | Jul 1966 | A |
| 3978317 | Yamaguchi et al. | Aug 1976 | A |
| 4057784 | Tafoya | Nov 1977 | A |
| 4085423 | Tsunoda et al. | Apr 1978 | A |
| 4330583 | Datta et al. | May 1982 | A |
| 4333187 | Schuler | Jun 1982 | A |
| 4542528 | Sanner et al. | Sep 1985 | A |
| 4721849 | Davis et al. | Jan 1988 | A |
| 4758717 | Shepard et al. | Jul 1988 | A |
| 4760248 | Swartz et al. | Jul 1988 | A |
| 4774715 | Messenger | Sep 1988 | A |
| 4818847 | Hara et al. | Apr 1989 | A |
| 4841132 | Kajitani et al. | Jun 1989 | A |
| 4847490 | Nishikama | Jul 1989 | A |
| 4866257 | Elliott et al. | Sep 1989 | A |
| 4877949 | Danielson et al. | Oct 1989 | A |
| 4900907 | Matusima et al. | Feb 1990 | A |
| 4918297 | Kurimoto | Apr 1990 | A |
| 4920255 | Gabeler | Apr 1990 | A |
| 4945216 | Tanabe et al. | Jul 1990 | A |
| 4964167 | Kunizawa et al. | Oct 1990 | A |
| 5010241 | Butterworth | Apr 1991 | A |
| 5019699 | Koenck | May 1991 | A |
| 5034619 | Hammond | Jul 1991 | A |
| 5046066 | Messenger | Sep 1991 | A |
| 5059778 | Zouzoulas et al. | Oct 1991 | A |
| 5059779 | Krichever et al. | Oct 1991 | A |
| 5101406 | Messenger | Mar 1992 | A |
| 5132525 | Swartz et al. | Jul 1992 | A |
| 5140142 | Atsushi | Aug 1992 | A |
| 5140143 | Nakazawa | Aug 1992 | A |
| 5149948 | Chisholm | Sep 1992 | A |
| 5157248 | Barkan | Oct 1992 | A |
| 5177346 | Chisholm | Jan 1993 | A |
| 5206881 | Messenger et al. | Apr 1993 | A |
| 5208449 | Eastman et al. | May 1993 | A |
| 5233171 | Baldwin | Aug 1993 | A |
| 5235167 | Dvorkis et al. | Aug 1993 | A |
| 5254977 | MacDonald | Oct 1993 | A |
| 5280161 | Niwa | Jan 1994 | A |
| 5280164 | Barkan | Jan 1994 | A |
| 5286960 | Longacre | Feb 1994 | A |
| 5291008 | Havens et al. | Mar 1994 | A |
| 5294783 | Hammond et al. | Mar 1994 | A |
| 5296689 | Reddersen et al. | Mar 1994 | A |
| 5308962 | Havens et al. | May 1994 | A |
| 5317136 | Hasegawa et al. | May 1994 | A |
| 5319182 | Havens et al. | Jun 1994 | A |
| 5331176 | Sant' Anselmo et al. | Jul 1994 | A |
| 5340971 | Rockstein et al. | Aug 1994 | A |
| 5340972 | Sandor | Aug 1994 | A |
| 5347113 | Reddersen et al. | Sep 1994 | A |
| 5347114 | Tanaka | Sep 1994 | A |
| 5367151 | Dvorkis et al. | Nov 1994 | A |
| 5378883 | Batterman et al. | Jan 1995 | A |
| 5389917 | LaManna et al. | Feb 1995 | A |
| 5396054 | Krichever et al. | Mar 1995 | A |
| 5404002 | Tang | Apr 1995 | A |
| 5406062 | Hasegawa et al. | Apr 1995 | A |
| 5406063 | Jelen | Apr 1995 | A |
| 5410141 | Koenck et al. | Apr 1995 | A |
| 5420411 | Salatto et al. | May 1995 | A |
| 5430286 | Hammond, Jr. et al. | Jul 1995 | A |
| 5440111 | Eastman et al. | Aug 1995 | A |
| 5449892 | Yamada | Sep 1995 | A |
| 5473149 | Miwa et al. | Dec 1995 | A |
| 5504316 | Bridgelall et al. | Apr 1996 | A |
| 5504317 | Takahashi | Apr 1996 | A |
| 5504367 | Arackellian et al. | Apr 1996 | A |
| 5510606 | Worthington et al. | Apr 1996 | A |
| 5532692 | Tatsuya | Jul 1996 | A |
| 5534684 | Danielson | Jul 1996 | A |
| 5541419 | Arackellian | Jul 1996 | A |
| 5550364 | Rudeen | Aug 1996 | A |
| 5550367 | Plesko | Aug 1996 | A |
| 5557095 | Clark et al. | Sep 1996 | A |
| 5572006 | Wang et al. | Nov 1996 | A |
| 5576529 | Koenck et al. | Nov 1996 | A |
| 5579487 | Meyerson et al. | Nov 1996 | A |
| 5585616 | Roxby et al. | Dec 1996 | A |
| 5591955 | Laser | Jan 1997 | A |
| 5597997 | Obata et al. | Jan 1997 | A |
| 5598007 | Bunce et al. | Jan 1997 | A |
| 5602376 | Coleman et al. | Feb 1997 | A |
| 5610595 | Garrabrant et al. | Mar 1997 | A |
| 5612530 | Sanders et al. | Mar 1997 | A |
| 5623137 | Powers et al. | Apr 1997 | A |
| 5635700 | Fazekas | Jun 1997 | A |
| 5637854 | Thomas | Jun 1997 | A |
| 5638115 | Imai | Jun 1997 | A |
| 5640001 | Danielson et al. | Jun 1997 | A |
| 5640684 | Konosu et al. | Jun 1997 | A |
| 5644601 | Kawaguchi | Jul 1997 | A |
| 5646389 | Bravman et al. | Jul 1997 | A |
| 5646390 | Wang et al. | Jul 1997 | A |
| 5648650 | Sugifune et al. | Jul 1997 | A |
| 5659778 | Gingold et al. | Aug 1997 | A |
| 5668803 | Tymes et al. | Sep 1997 | A |
| 5672858 | Li et al. | Sep 1997 | A |
| 5684104 | Funk et al. | Nov 1997 | A |
| 5684290 | Arackellian et al. | Nov 1997 | A |
| 5696607 | Yamana et al. | Dec 1997 | A |
| 5697699 | Seo et al. | Dec 1997 | A |
| 5701001 | Sugifune et al. | Dec 1997 | A |
| 5703349 | Meyerson et al. | Dec 1997 | A |
| 5714745 | Ju et al. | Feb 1998 | A |
| 5714746 | Dvorkis et al. | Feb 1998 | A |
| 5717195 | Feng et al. | Feb 1998 | A |
| 5717221 | Li et al. | Feb 1998 | A |
| 5723868 | Hammond, Jr. et al. | Mar 1998 | A |
| 5734153 | Swartz et al. | Mar 1998 | A |
| 5736726 | Van Horn et al. | Apr 1998 | A |
| 5739518 | Wang | Apr 1998 | A |
| 5743633 | Chau et al. | Apr 1998 | A |
| 5744788 | Metlitsky et al. | Apr 1998 | A |
| 5744815 | Gurevich et al. | Apr 1998 | A |
| 5745176 | Lebens | Apr 1998 | A |
| 5754587 | Kawaguchi | May 1998 | A |
| 5756981 | Roustaei et al. | May 1998 | A |
| 5763864 | O'Hagan et al. | Jun 1998 | A |
| 5773810 | Hussey et al. | Jun 1998 | A |
| 5777743 | Bacchi et al. | Jul 1998 | A |
| 5780034 | Cohen et al. | Jul 1998 | A |
| 5780831 | Seo et al. | Jul 1998 | A |
| 5780834 | Havens et al. | Jul 1998 | A |
| 5783811 | Feng et al. | Jul 1998 | A |
| 5784102 | Hussey et al. | Jul 1998 | A |
| 5786586 | Pidhirny et al. | Jul 1998 | A |
| 5793903 | Lopresti et al. | Aug 1998 | A |
| 5794145 | Milam | Aug 1998 | A |
| 5801371 | Kahn et al. | Sep 1998 | A |
| 5802179 | Yamamoto | Sep 1998 | A |
| 5804802 | Card et al. | Sep 1998 | A |
| 5804805 | Koenck et al. | Sep 1998 | A |
| 5804809 | Eastman et al. | Sep 1998 | A |
| 5811784 | Tausch et al. | Sep 1998 | A |
| 5814827 | Katz | Sep 1998 | A |
| 5815200 | Ju et al. | Sep 1998 | A |
| 5815811 | Pinard et al. | Sep 1998 | A |
| 5818528 | Roth et al. | Oct 1998 | A |
| 5821518 | Sussmeier et al. | Oct 1998 | A |
| 5825006 | Longacre, Jr. et al. | Oct 1998 | A |
| 5831254 | Karpen et al. | Nov 1998 | A |
| 5834749 | Durbin | Nov 1998 | A |
| 5834754 | Feng et al. | Nov 1998 | A |
| 5837986 | Barile et al. | Nov 1998 | A |
| 5837987 | Koenck et al. | Nov 1998 | A |
| 5838720 | Morelli | Nov 1998 | A |
| 5841121 | Koenck | Nov 1998 | A |
| 5848064 | Cowan | Dec 1998 | A |
| 5850078 | Giordano et al. | Dec 1998 | A |
| 5859417 | Dvorkis et al. | Jan 1999 | A |
| 5859970 | Pleso | Jan 1999 | A |
| 5872354 | Hanson | Feb 1999 | A |
| 5877487 | Tani et al. | Mar 1999 | A |
| 5886338 | Arackellian et al. | Mar 1999 | A |
| 5894348 | Bacchi et al. | Apr 1999 | A |
| 5905251 | Knowles | May 1999 | A |
| 5912921 | Warren et al. | Jun 1999 | A |
| 5914478 | Bridgelall | Jun 1999 | A |
| 5920061 | Feng | Jul 1999 | A |
| 5924040 | Trompower | Jul 1999 | A |
| 5926581 | Pritt | Jul 1999 | A |
| 5929418 | Ehrhart et al. | Jul 1999 | A |
| 5932139 | Oshima et al. | Aug 1999 | A |
| 5932862 | Hussey et al. | Aug 1999 | A |
| 5942741 | Longacre, Jr. et al. | Aug 1999 | A |
| 5942762 | Hecht | Aug 1999 | A |
| 5945660 | Nakasuji et al. | Aug 1999 | A |
| 5946344 | Warren et al. | Aug 1999 | A |
| 5949052 | Longacre, Jr. et al. | Sep 1999 | A |
| 5949054 | Karpen et al. | Sep 1999 | A |
| 5949056 | White | Sep 1999 | A |
| 5949057 | Feng | Sep 1999 | A |
| 5955720 | He et al. | Sep 1999 | A |
| 5962836 | Tani et al. | Oct 1999 | A |
| 5965863 | Parker et al. | Oct 1999 | A |
| 5973681 | Tanigawa et al. | Oct 1999 | A |
| 5975419 | Dickson et al. | Nov 1999 | A |
| 5984188 | Dvorkis et al. | Nov 1999 | A |
| 5988506 | Schaham et al. | Nov 1999 | A |
| 5992744 | Smith et al. | Nov 1999 | A |
| 5992746 | Suzuki | Nov 1999 | A |
| 6000612 | Xu | Dec 1999 | A |
| 6010070 | Mizuochi et al. | Jan 2000 | A |
| 6015088 | Parker et al. | Jan 2000 | A |
| 6019286 | Li et al. | Feb 2000 | A |
| 6027024 | Knowles | Feb 2000 | A |
| 6029893 | Tan et al. | Feb 2000 | A |
| 6034379 | Bunte et al. | Mar 2000 | A |
| 6036096 | Evers et al. | Mar 2000 | A |
| 6039255 | Seo | Mar 2000 | A |
| 6045047 | Pidhirny et al. | Apr 2000 | A |
| 6045048 | Wilz, Sr. et al. | Apr 2000 | A |
| 6052236 | Nakasuji et al. | Apr 2000 | A |
| 6053408 | Stoner | Apr 2000 | A |
| 6060722 | Havens et al. | May 2000 | A |
| 6062475 | Feng | May 2000 | A |
| 6066857 | Fantone et al. | May 2000 | A |
| 6068188 | Knowles | May 2000 | A |
| 6072401 | Kumar | Jun 2000 | A |
| 6092728 | Li et al. | Jul 2000 | A |
| 6098887 | Figarella et al. | Aug 2000 | A |
| 6119939 | Schwartz et al. | Sep 2000 | A |
| 6119944 | Mulla et al. | Sep 2000 | A |
| 6123261 | Roustaei | Sep 2000 | A |
| 6123263 | Feng | Sep 2000 | A |
| 6123264 | Li et al. | Sep 2000 | A |
| 6129283 | Imade et al. | Oct 2000 | A |
| 6141046 | Roth et al. | Oct 2000 | A |
| 6147358 | Hecht | Nov 2000 | A |
| 6152371 | Schwartz et al. | Nov 2000 | A |
| 6155491 | Dueker et al. | Dec 2000 | A |
| 6164544 | Schwartz et al. | Dec 2000 | A |
| 6164546 | Kumagai et al. | Dec 2000 | A |
| 6178426 | Klein et al. | Jan 2001 | B1 |
| 6179208 | Feng | Jan 2001 | B1 |
| 6182897 | Knowles et al. | Feb 2001 | B1 |
| 6186404 | Ehrhart et al. | Feb 2001 | B1 |
| 6191406 | Nelson et al. | Feb 2001 | B1 |
| 6199044 | Ackley et al. | Mar 2001 | B1 |
| 6213397 | Rando | Apr 2001 | B1 |
| 6223988 | Batterman et al. | May 2001 | B1 |
| 6230975 | Colley et al. | May 2001 | B1 |
| 6254003 | Pettinelli et al. | Jul 2001 | B1 |
| 6283374 | Fantone et al. | Sep 2001 | B1 |
| 6298176 | Longacre, Jr. et al. | Oct 2001 | B2 |
| 6303929 | Oshima et al. | Oct 2001 | B1 |
| 6318635 | Stoner | Nov 2001 | B1 |
| 6318637 | Stoner | Nov 2001 | B1 |
| 6321989 | Wilz, Sr. et al. | Nov 2001 | B1 |
| 6321991 | Knowles | Nov 2001 | B1 |
| 6321992 | Knowles et al. | Nov 2001 | B1 |
| 6323503 | Hecht | Nov 2001 | B1 |
| 6328213 | He et al. | Dec 2001 | B1 |
| 6330973 | Bridgelall et al. | Dec 2001 | B1 |
| 6340114 | Correa et al. | Jan 2002 | B1 |
| 6345764 | Knowles | Feb 2002 | B1 |
| 6347163 | Roustaei | Feb 2002 | B2 |
| 6347743 | Wilz, Sr. et al. | Feb 2002 | B2 |
| 6352204 | Hattersley et al. | Mar 2002 | B2 |
| 6352517 | Flock et al. | Mar 2002 | B1 |
| 6360949 | Shepard et al. | Mar 2002 | B1 |
| 6371374 | Schwartz et al. | Apr 2002 | B1 |
| 6375074 | Dickson et al. | Apr 2002 | B1 |
| 6389010 | Kubler et al. | May 2002 | B1 |
| 6398112 | Li et al. | Jun 2002 | B1 |
| 6412699 | Russell et al. | Jul 2002 | B1 |
| 6412700 | Blake et al. | Jul 2002 | B1 |
| 6431452 | Feng | Aug 2002 | B2 |
| 6439462 | Dickson et al. | Aug 2002 | B1 |
| 6507864 | Klein et al. | Jan 2003 | B1 |
| 6535493 | Lee et al. | Mar 2003 | B1 |
| 6539360 | Kadaba | Mar 2003 | B1 |
| 6539422 | Hunt et al. | Mar 2003 | B1 |
| 6540140 | Knowles et al. | Apr 2003 | B1 |
| 6547139 | Havens et al. | Apr 2003 | B1 |
| 6561428 | Meier et al. | May 2003 | B2 |
| 6578767 | Barkan et al. | Jun 2003 | B1 |
| 6585159 | Meier et al. | Jul 2003 | B1 |
| 6595422 | Doljack | Jul 2003 | B1 |
| 6598798 | Kashi et al. | Jul 2003 | B1 |
| 6601768 | McCall et al. | Aug 2003 | B2 |
| 6607128 | Schwartz et al. | Aug 2003 | B1 |
| 6629641 | Tsikos et al. | Oct 2003 | B2 |
| 6637658 | Barber et al. | Oct 2003 | B2 |
| 6651888 | Gurevich et al. | Nov 2003 | B1 |
| 6655595 | Longacre, Jr. et al. | Dec 2003 | B1 |
| 6661521 | Stern | Dec 2003 | B1 |
| 6669093 | Meyerson et al. | Dec 2003 | B1 |
| 6681994 | Koenck | Jan 2004 | B1 |
| 6688523 | Koenck | Feb 2004 | B1 |
| 6695209 | La | Feb 2004 | B1 |
| 6722569 | Ehrhart et al. | Apr 2004 | B2 |
| 6732929 | Good et al. | May 2004 | B2 |
| 6749120 | Hung et al. | Jun 2004 | B2 |
| 6786414 | Tsikos et al. | Sep 2004 | B2 |
| 6808114 | Palestini et al. | Oct 2004 | B1 |
| 6817525 | Piva et al. | Nov 2004 | B2 |
| 6830184 | Tsikos et al. | Dec 2004 | B2 |
| 6832725 | Gardiner et al. | Dec 2004 | B2 |
| 6834807 | Ehrhart et al. | Dec 2004 | B2 |
| 6837437 | Tsikos et al. | Jan 2005 | B2 |
| 6843417 | Philyaw et al. | Jan 2005 | B1 |
| 6877661 | Webb et al. | Apr 2005 | B2 |
| 6888566 | Larkin et al. | May 2005 | B2 |
| 7055747 | Havens | Jun 2006 | B2 |
| 7061395 | Bromer | Jun 2006 | B1 |
| 7077321 | Longacre, Jr. et al. | Jul 2006 | B2 |
| 7083097 | Toyama et al. | Aug 2006 | B2 |
| 7083098 | Joseph et al. | Aug 2006 | B2 |
| 7086596 | Meier et al. | Aug 2006 | B2 |
| 7090132 | Havens et al. | Aug 2006 | B2 |
| 7185817 | Zhu et al. | Mar 2007 | B2 |
| 7195164 | Patel | Mar 2007 | B2 |
| 7204420 | Barkan et al. | Apr 2007 | B2 |
| 7219843 | Havens et al. | May 2007 | B2 |
| 7234641 | Olmstead | Jun 2007 | B2 |
| 7240844 | Zhu et al. | Jul 2007 | B2 |
| 7255279 | Zhu et al. | Aug 2007 | B2 |
| 7268924 | Hussey et al. | Sep 2007 | B2 |
| 7270274 | Hennick et al. | Sep 2007 | B2 |
| 7303126 | Patel et al. | Dec 2007 | B2 |
| 7308375 | Jensen et al. | Dec 2007 | B2 |
| 7320431 | Zhu et al. | Jan 2008 | B2 |
| 7336197 | Ding et al. | Feb 2008 | B2 |
| 7357326 | Hattersley et al. | Apr 2008 | B2 |
| 7387250 | Mani | Jun 2008 | B2 |
| 7387253 | Parker et al. | Jun 2008 | B1 |
| 7398927 | Olmstead et al. | Jul 2008 | B2 |
| 7490778 | Zhu et al. | Feb 2009 | B2 |
| 7503499 | Zhu et al. | Mar 2009 | B2 |
| 7513430 | Zhu et al. | Apr 2009 | B2 |
| 7516899 | Laser | Apr 2009 | B2 |
| 7527207 | Acosta et al. | May 2009 | B2 |
| 7533824 | Hennick et al. | May 2009 | B2 |
| 7568628 | Wang et al. | Aug 2009 | B2 |
| 7611060 | Wang et al. | Nov 2009 | B2 |
| 7619617 | Morrison et al. | Nov 2009 | B2 |
| 7646943 | Wober | Jan 2010 | B1 |
| 7656556 | Wang | Feb 2010 | B2 |
| 7693744 | Forbes | Apr 2010 | B2 |
| 7705309 | Jin et al. | Apr 2010 | B1 |
| 7735737 | Kotlarsky et al. | Jun 2010 | B2 |
| 7755672 | Pertsel | Jul 2010 | B2 |
| 7762464 | Goren et al. | Jul 2010 | B2 |
| 7770799 | Wang | Aug 2010 | B2 |
| 7775436 | Knowles et al. | Aug 2010 | B2 |
| 7780089 | Wang | Aug 2010 | B2 |
| 7809407 | Oshima et al. | Oct 2010 | B2 |
| 7810720 | Lovett | Oct 2010 | B2 |
| 7813047 | Wang et al. | Oct 2010 | B2 |
| 7909257 | Wang et al. | Mar 2011 | B2 |
| 7918398 | Li et al. | Apr 2011 | B2 |
| 7995178 | Suguro et al. | Aug 2011 | B2 |
| 8074887 | Havens et al. | Dec 2011 | B2 |
| 8152069 | Kearney et al. | Apr 2012 | B2 |
| 8544737 | Gomez et al. | Oct 2013 | B2 |
| 8596542 | Havens et al. | Dec 2013 | B2 |
| 8608071 | Liu et al. | Dec 2013 | B2 |
| 8636215 | Ding et al. | Jan 2014 | B2 |
| 8640960 | Wang | Feb 2014 | B2 |
| 20010021224 | Larkin et al. | Sep 2001 | A1 |
| 20020043561 | Tsikos et al. | Apr 2002 | A1 |
| 20030029917 | Hennick et al. | Feb 2003 | A1 |
| 20030034394 | Gannon et al. | Feb 2003 | A1 |
| 20030062413 | Gardiner et al. | Apr 2003 | A1 |
| 20030085284 | Bremer et al. | May 2003 | A1 |
| 20030206150 | Hussey et al. | Nov 2003 | A1 |
| 20030222144 | Meier et al. | Dec 2003 | A1 |
| 20030222147 | Havens et al. | Dec 2003 | A1 |
| 20040020990 | Havens et al. | Feb 2004 | A1 |
| 20040133376 | Uffenkamp et al. | Jul 2004 | A1 |
| 20040164165 | Havens et al. | Aug 2004 | A1 |
| 20040171915 | Glukhovsky et al. | Sep 2004 | A1 |
| 20050001035 | Hawley et al. | Jan 2005 | A1 |
| 20050023356 | Wiklof et al. | Feb 2005 | A1 |
| 20050103854 | Zhu et al. | May 2005 | A1 |
| 20050103858 | Zhu et al. | May 2005 | A1 |
| 20050103866 | Zhu et al. | May 2005 | A1 |
| 20050151759 | Gonzalez-Banos et al. | Jul 2005 | A1 |
| 20050236485 | Wang et al. | Oct 2005 | A1 |
| 20050263599 | Zhu et al. | Dec 2005 | A1 |
| 20050279836 | Havens et al. | Dec 2005 | A1 |
| 20060011724 | Joseph et al. | Jan 2006 | A1 |
| 20060043187 | He et al. | Mar 2006 | A1 |
| 20060043194 | Barkan et al. | Mar 2006 | A1 |
| 20060113386 | Olmstead | Jun 2006 | A1 |
| 20060146340 | Szwaykowski et al. | Jul 2006 | A1 |
| 20060155174 | Glukhovsky et al. | Jul 2006 | A1 |
| 20060163355 | Olmstead et al. | Jul 2006 | A1 |
| 20060202036 | Wang et al. | Sep 2006 | A1 |
| 20060209015 | Feldmeier et al. | Sep 2006 | A1 |
| 20060255144 | Meier et al. | Nov 2006 | A1 |
| 20060283952 | Wang | Dec 2006 | A1 |
| 20070040035 | Kotlarsky et al. | Feb 2007 | A1 |
| 20070058164 | Shibata et al. | Mar 2007 | A1 |
| 20070103436 | Kong | May 2007 | A1 |
| 20070138293 | Zhu et al. | Jun 2007 | A1 |
| 20070164115 | Joseph et al. | Jul 2007 | A1 |
| 20070181692 | Barkan et al. | Aug 2007 | A1 |
| 20070241192 | McQueen et al. | Oct 2007 | A1 |
| 20070284447 | McQueen | Dec 2007 | A1 |
| 20080011856 | Bremer et al. | Jan 2008 | A1 |
| 20080023556 | Vinogradov et al. | Jan 2008 | A1 |
| 20080105746 | Lei | May 2008 | A1 |
| 20080191127 | Fine et al. | Aug 2008 | A1 |
| 20080212838 | Frigerio | Sep 2008 | A1 |
| 20080223933 | Smith | Sep 2008 | A1 |
| 20080296393 | Jovanovski et al. | Dec 2008 | A1 |
| 20090001173 | Sevier et al. | Jan 2009 | A1 |
| 20090001174 | Barkan et al. | Jan 2009 | A1 |
| 20090001175 | Goren et al. | Jan 2009 | A1 |
| 20090026267 | Wang et al. | Jan 2009 | A1 |
| 20090057413 | Vinogradov et al. | Mar 2009 | A1 |
| 20090072038 | Li et al. | Mar 2009 | A1 |
| 20090140050 | Liu et al. | Jun 2009 | A1 |
| 20090237662 | Chang et al. | Sep 2009 | A1 |
| 20090247294 | Silverbrook | Oct 2009 | A1 |
| 20100044436 | Powell et al. | Feb 2010 | A1 |
| 20100044440 | Wang et al. | Feb 2010 | A1 |
| 20100078477 | Wang et al. | Apr 2010 | A1 |
| 20100090007 | Wang et al. | Apr 2010 | A1 |
| 20100108769 | Wang et al. | May 2010 | A1 |
| 20100133345 | Havens et al. | Jun 2010 | A1 |
| 20100140356 | Hawley et al. | Jun 2010 | A1 |
| 20100147956 | Wang et al. | Jun 2010 | A1 |
| 20100172545 | Lim et al. | Jul 2010 | A1 |
| 20100187310 | Meier et al. | Jul 2010 | A1 |
| 20100201943 | Pohjanen | Aug 2010 | A1 |
| 20100324381 | Glukhovsky et al. | Dec 2010 | A1 |
| 20110090476 | Van De Kerkhof et al. | Apr 2011 | A1 |
| 20110163165 | Liu et al. | Jul 2011 | A1 |
| 20110174880 | Li et al. | Jul 2011 | A1 |
| 20120000981 | Meier et al. | Jan 2012 | A1 |
| 20120000982 | Gao et al. | Jan 2012 | A1 |
| 20120111944 | Gao et al. | May 2012 | A1 |
| 20120138684 | Van Volkinburg et al. | Jun 2012 | A1 |
| 20120153022 | Havens et al. | Jun 2012 | A1 |
| 20120193429 | Van Volkinburg et al. | Aug 2012 | A1 |
| 20130001312 | Kearney et al. | Jan 2013 | A1 |
| 20130026235 | Gurevich et al. | Jan 2013 | A1 |
| 20130146665 | Havens et al. | Jun 2013 | A1 |
| 20130248604 | Coyle | Sep 2013 | A1 |
| 20140076974 | Havens et al. | Mar 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 1233038 | Jan 1967 | DE |
| 1240149 | May 1967 | DE |
| 0516927 | Dec 1992 | EP |
| 0690404 | Jan 1996 | EP |
| 0818750 | Jan 1998 | EP |
| 0910032 | Apr 1999 | EP |
| 0974924 | Jan 2000 | EP |
| 0999514 | May 2000 | EP |
| 1079466 | Feb 2001 | EP |
| 1128315 | Aug 2001 | EP |
| 2128549 | May 1984 | GB |
| 3228193 | Sep 1991 | JP |
| 4330583 | Nov 1992 | JP |
| 2002150215 | May 2002 | JP |
| 4333187 | Sep 2009 | JP |
| 9708647 | Mar 1997 | WO |
| 9728512 | Aug 1997 | WO |
| 0126036 | Apr 2001 | WO |
| 02073953 | Sep 2002 | WO |
| 03102859 | Dec 2003 | WO |
| 2004064382 | Jul 2004 | WO |
| Entry |
|---|
| U.S. Appl. No. 60/437,959, filed Jan. 3, 2003, [priority of which is claimed in U.S. Appl. No. 10/425,694, filed Apr. 29, 2003, now U.S. Pat. No. 7,195,164]; previously submitted. |
| John H. Day, Optical ICs Look to Enterprise-Metro link, Electronic Engineering Times, Apr. 2002, 4 pages, http://www.eet.com/story/OEG20020418S0065. |
| International Search Report for PCT Appl. No. PCT/US02/07161, Published as WO02073953, dated Dec. 20, 2002; 9 pages. |
| International Search Report for PCT Appl. No. PCT/US03/17564, Published as WO0310289, dated Sep. 18, 2003; 4 pages. |
| International Search Report for PCT Appl. No. PCT/US03/18557, Published as WO03104854, dated Feb. 25, 2004; 3 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20140076974 A1 | Mar 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11187608 | Jul 2005 | US |
| Child | 13323147 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13323147 | Dec 2011 | US |
| Child | 14093624 | US | |
| Parent | 10453796 | Jun 2003 | US |
| Child | 11187608 | US | |
| Parent | 10161950 | Jun 2002 | US |
| Child | 10782569 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10161950 | Jun 2002 | US |
| Child | 10453796 | US | |
| Parent | 10782569 | Feb 2004 | US |
| Child | 11187608 | US |
