1. Technical Field
This invention generally relates to three-dimensional imaging of a physical object, and in particular to a high-speed multi-line triangulation for three-dimensional digitization of a physical object.
2. Related Art
Imaging techniques provide a three-dimensional visualization of a physical object on a video terminal or monitor. The three-dimensional visualization may illustrate surface characteristics of the physical object. Data associated with the surface characteristics are generated and processed by a processor to generate the three-dimensional visualization.
Data associated with the surface characteristics are generated by capturing images of the object from various perspectives. The perspectives are mapped or combined to produce a set of data points that represent the various surfaces of the object. The data points are processed to generate the three-dimensional visual display of the object. The data points also may be processed to represent the object in a dimensionally correct manner in the computer. However, the time to generate the data points is longer than the display rate for the digital camera.
Imaging systems that use a triangulation technique emanate a single point or a single line on the object to determine relative surface characteristics of the object. Multiple line systems are limited by the maximum number of simultaneous lines that may image the object and require a large number of images to obtain a final image of the object.
A Moiré technique may use multiple lines to compute a relative height map of the surface characteristics. Each point has a known or predetermined relative relationship to a neighboring point on a neighboring line. A sinusoidal variation of the lines provides a trigonometric solution to estimate the relative relationships or equivalently extracting the phase. Such technique requires either multiple images or substantial processing time to provide a three-dimensional image.
Accordingly, there is a need for a high-speed three dimensional imaging system that minimizes the number of images and amount of computation to provide a three-dimensional image.
By way of introduction only, a high speed multiple line three-dimensional digitization may include imaging a physical object to provide a visualization or virtualization of the object that may be viewed and manipulated by using a processor. The high speed multiple line three-dimensional digitization may be achieved by one or more apparatuses, devices, systems, methods, and/or processes.
In an embodiment, the high-speed multiple-line digitization generates a full frame of three-dimensional data of a surface of a physical object that is acquired in substantially the same order as a frame rate of a camera used to acquire or capture the three-dimensional image. For example, a camera used to capture a three-dimensional image has a frame rate of N frames per second. A full frame of three-dimensional data is obtained in a time frame of m/N seconds where m different patterns are projected. For example, where two patterns are projected, a full frame of three-dimensional data is obtained in a time frame f 2/N seconds. The full frame of three-dimensional data includes multiple data points represented by multiple floating point numbers.
The foregoing summary is provided only by way of introduction. The features and advantages of the high speed multiple line three-dimensional digitization may be realized and obtained by means of the instrumentalities and combinations particularly pointed out in the claims. Nothing in this section should be taken as a limitation on the claims, which define the scope of the invention. Additional features and advantages of the present invention will be set forth in the description that follows, and in part will be obvious from the description, or may be learned by practice of the present invention.
The invention can be better understood with reference to the following drawings and description. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating principles of the invention. Moreover, in the figures, like referenced numerals designate corresponding parts throughout the different views.
Hereinafter exemplary embodiments are discussed with reference to accompanied figures.
Light reflected from the surface 108 is captured by the camera 106. Based on the reflected light pattern, three-dimensional data representative of the illuminated surface 108 may be generated. The three-dimensional data may be processed to generate a three-dimensional image of the illuminated surface 108. The camera 106 may be characterized by a local coordinate system XY, and the projector 104 characterized by a local coordinate system X′Y′.
Referring to
In an embodiment, camera 206 is a high-speed camera that images general patterns or multiple line patterns. The camera 206 may also capture multiple line patterns during a read period. The relationship shown in
A line projected by projector 204 represents a connected series of points or curvilinear segments where a normal vector n at any point along the curve obeys the following equation or rule:
According to Equation (1), the angle between a point on the curve and the triangulation axis R is greater than or equal to about 45 degrees. The line may have a cross-sectional intensity characterized by a function that is independent of Equation 1. The cross-sectional intensity may have a sinusoidal variation, a Gaussian profile, or any other function for cross-sectional intensity.
The local coordinate system XY of the camera 206 may be further characterized by a coordinate system XYZ, where the XY coordinate system defined by the camera include axis Z, which is substantially perpendicular to both the X-axis and the Y-axis. The axis Z includes a range of values for Z based on optics limitations. The values for Z may be based on distances d1 and d2 such that d1≦z≦d2. A single point from a projected line incident on a plane perpendicular to Z will appear to be displaced in the X direction by ΔX. Based on a triangulation angle, the following condition exists:
In a projected line pattern having multiple lines L1-Ln, a given line Li may be characterized by a unique function θ(x). For a given line Li, the location of line Li with respect to the coordinate system XYZ of the camera 206 for various values of z where d1≦z≦d2 may be determined through calibration or similar process.
For an observed line Lc, a closest calibrated line position may be selected, and the x and z coordinates (xc, zc) of the calibrated line determined. The camera 206 may observe multiple lines during projected on an object 102. For each observed point on the line, as captured or observed by the camera 206, the XY coordinates of that surface point may be directly observed as (xobserved, yobserved). A point zobserved may be determined by observing the displaced Δx (where Δx=xobserved−xc), to compute Δz. The z coordinate may then be computed as:
zobserved=zc+Δz. (3)
The maximum displacement for any line in the volume may be determined by:
Δx=(d1-d2) Tan θ (4)
A maximum number of simultaneously distinguishable lines nmax may be determined as:
The maximum number of simultaneously distinguishable lines nmax increases with a decreasing depth of field d1-d2. The maximum number of simultaneously distinguishable lines nmax also increases with as θmax decreases. The accuracy of the determination also may also decrease with smaller θmax values. Also, decreasing a depth of field may result in a less useful volume for digitizing.
Multiple patterns of lines L1-Ln may be projected toward the object 302 during a capture period. The light patterns may be referred to as Ai where I=1, 2, . . . x, where the first light pattern having L1-Ln lines is referred to as A1 and subsequent line patterns are referred to as A2 to Ax. The number of lines n in pattern Ai may be selected so that n≦nmax. In
According to Equation (4), each line in pattern A1 incident on the surface 308 may be uniquely labeled or identified. For each line pattern A1, the x, y and z coordinates may be determined for each point on the line using the above equations. For each line Li, data-points representative of characteristics of the surface 308 along the line Li may be generated. From the data points, a three-dimensional representation of the surface 302 along the line Li is formed. From all the lines of pattern A1, an approximation of the surface of the object being digitized may be determined.
For the subsequent patterns Ai, where i=2, . . . x, let ni represent the number of lines for the pattern Ai. For i<j the condition ni≦nj holds. Also, ni>nmax for each i. Because equation (4) no longer holds, labeling or identifying lines for Ai may be resolved during a prior calibration step.
In a calibration step, each line in Ai is characterized on a flat plane for different Z values. Based on the characterization, and an approximation surface, the approximate locations of each labeled line in Ai is estimated by intersecting a known light plane corresponding with each labeled line with the approximation surface 308. The estimation may be compared to the observed line pattern for Ai incident on the surface 302, and observed lines accordingly labeled.
An embodiment for a projector for a high speed multiple line three-dimensional digitization system may include a modulated laser source having a two-axis orthogonal mirror scanner. The scanner may have a single two axis mirror, two orthogonally mounted single axis mirrors, or the equivalents. The scanner may project a two-dimensional light pattern having multiple lines L1-Ln through optics toward a surface of an object. The light pattern illuminates the surface. Light reflected from the surface may be captured by a camera. The patterns incident on the object may be viewed through additional optics, a CCD, CMOS digital camera, or similar device. The line patterns are analyzed and converted to three-dimensional coordinates representative of the illuminated surface.
Referring to
Referring to
In an embodiment for a high speed multiple line three-dimensional digitization system, a scanner and camera may be configured as described according to co-pending U.S. patent application Ser. No. 10/749,579, entitled LASER DIGITIZER SYSTEM FOR DENTAL APPLICATIONS, filed on Dec. 30, 2003, the description of which is incorporated herein in its entirety. The scanner may be a modulated laser source, coupled to a two axis orthogonal mirror scanner. An embodiment for a high speed multiple line three-dimensional digitization system may include a modulated laser source, coupled to a two axis orthogonal mirror scanner. The scanner may have a single two axis mirror, two orthogonally mounted single axis mirrors, or the equivalents. By varying the rotation of the mirror(s), and by modulating the laser beam, a two-dimensional pattern may be traced. The pattern may be projected through optics onto the physical object, and the patterns incident on the object viewed through additional optics, a CCD, CMOS digital camera, or similar device. The line patterns are analyzed and converted to three-dimensional coordinates for the surface.
It is intended in the appended claims to cover all such changes and modifications which fall within the true spirit and scope of the invention. Therefore, the invention is not limited to the specific details, representative embodiments, and illustrated examples in this description. Accordingly, the invention is not to be restricted except in light as necessitated by the accompanying claims and their equivalents.
This application claims the benefit under 35 U.S.C. § 119(e) of co-pending provisional application No. 60/503,666 filed Sep. 17, 2003 for High Speed Multiple Line Three-Dimensional Digitization, which is incorporated in its entirety herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
4411626 | Becker et al. | Oct 1983 | A |
4478580 | Barrut | Oct 1984 | A |
4486842 | Hermann | Dec 1984 | A |
4575805 | Moermann et al. | Mar 1986 | A |
4611288 | Duret et al. | Sep 1986 | A |
4615678 | Moermann et al. | Oct 1986 | A |
4663720 | Duret et al. | May 1987 | A |
4687326 | Corby, Jr. | Aug 1987 | A |
4742464 | Duret et al. | May 1988 | A |
4752964 | Okada et al. | Jun 1988 | A |
4766704 | Brandestini et al. | Aug 1988 | A |
4798534 | Breads | Jan 1989 | A |
4816920 | Paulsen | Mar 1989 | A |
4837732 | Brandestini et al. | Jun 1989 | A |
4856991 | Breads et al. | Aug 1989 | A |
4935635 | O'Harra | Jun 1990 | A |
4936862 | Walker et al. | Jun 1990 | A |
4952149 | Duret et al. | Aug 1990 | A |
4964770 | Steinbichler et al. | Oct 1990 | A |
4970032 | Rotsaert | Nov 1990 | A |
5027281 | Rekow et al. | Jun 1991 | A |
5035613 | Breads et al. | Jul 1991 | A |
5055039 | Abbatte et al. | Oct 1991 | A |
5059118 | Breads et al. | Oct 1991 | A |
5092022 | Duret | Mar 1992 | A |
5106303 | Oden et al. | Apr 1992 | A |
5139419 | Andreiko et al. | Aug 1992 | A |
5151044 | Rotsaert | Sep 1992 | A |
5186623 | Breads et al. | Feb 1993 | A |
5224049 | Mushabac | Jun 1993 | A |
5257184 | Mushabac | Oct 1993 | A |
5266030 | Van Der Zel | Nov 1993 | A |
5273429 | Rekow et al. | Dec 1993 | A |
5338198 | Wu et al. | Aug 1994 | A |
5340309 | Robertson | Aug 1994 | A |
5342202 | Deshayes | Aug 1994 | A |
5342696 | Eidenbenz et al. | Aug 1994 | A |
5347454 | Mushabac | Sep 1994 | A |
5368478 | Andreiko et al. | Nov 1994 | A |
5372502 | Massen et al. | Dec 1994 | A |
5378154 | Van Der Zel | Jan 1995 | A |
5382164 | Stern | Jan 1995 | A |
5383752 | Rheinberger et al. | Jan 1995 | A |
5386292 | Massen et al. | Jan 1995 | A |
5395238 | Andreiko et al. | Mar 1995 | A |
5417572 | Kawai et al. | May 1995 | A |
5431562 | Andreiko et al. | Jul 1995 | A |
5440393 | Wenz | Aug 1995 | A |
5440496 | Andersson et al. | Aug 1995 | A |
5447432 | Andreiko et al. | Sep 1995 | A |
5448472 | Mushabac | Sep 1995 | A |
5452219 | Dehoff et al. | Sep 1995 | A |
5454717 | Andreiko et al. | Oct 1995 | A |
5474448 | Andreiko et al. | Dec 1995 | A |
RE35169 | Lemchen et al. | Mar 1996 | E |
5497336 | Andersson et al. | Mar 1996 | A |
5533895 | Andreiko et al. | Jul 1996 | A |
5545039 | Mushabac | Aug 1996 | A |
5549476 | Stern | Aug 1996 | A |
5562448 | Mushabac | Oct 1996 | A |
5569578 | Mushabac | Oct 1996 | A |
5587912 | Andersson et al. | Dec 1996 | A |
5604817 | Massen et al. | Feb 1997 | A |
5607305 | Andersson et al. | Mar 1997 | A |
5652709 | Andersson et al. | Jul 1997 | A |
5683243 | Andreiko et al. | Nov 1997 | A |
5691905 | Dehoff et al. | Nov 1997 | A |
5725376 | Poirier | Mar 1998 | A |
RE35816 | Schulz | Jun 1998 | E |
5788498 | Wohlwind | Aug 1998 | A |
5800174 | Andersson | Sep 1998 | A |
5812269 | Svetkoff et al. | Sep 1998 | A |
5813859 | Hajjar et al. | Sep 1998 | A |
5818587 | Devaraj et al. | Oct 1998 | A |
5823778 | Schmitt et al. | Oct 1998 | A |
5851115 | Carlsson et al. | Dec 1998 | A |
5857853 | Van Nifterick et al. | Jan 1999 | A |
5870220 | Migdal et al. | Feb 1999 | A |
5879158 | Doyle et al. | Mar 1999 | A |
5880962 | Andersson et al. | Mar 1999 | A |
5882192 | Bergersen | Mar 1999 | A |
5938446 | Andersson et al. | Aug 1999 | A |
5975893 | Chishti et al. | Nov 1999 | A |
6015289 | Andreiko et al. | Jan 2000 | A |
6044170 | Migdal et al. | Mar 2000 | A |
6049743 | Baba | Apr 2000 | A |
6062861 | Anderson | May 2000 | A |
6068482 | Snow | May 2000 | A |
6099314 | Kopelman et al. | Aug 2000 | A |
6102696 | Osterwalder et al. | Aug 2000 | A |
6115114 | Berg et al. | Sep 2000 | A |
6135774 | Hack et al. | Oct 2000 | A |
6152731 | Jordan et al. | Nov 2000 | A |
6200135 | Hultgren | Mar 2001 | B1 |
6205240 | Pietrzak et al. | Mar 2001 | B1 |
6206693 | Hultgren | Mar 2001 | B1 |
6210162 | Chishti et al. | Apr 2001 | B1 |
6217325 | Chishti et al. | Apr 2001 | B1 |
6227850 | Chishti et al. | May 2001 | B1 |
6227851 | Chishti et al. | May 2001 | B1 |
6244861 | Andreiko et al. | Jun 2001 | B1 |
6250918 | Sachdeva et al. | Jun 2001 | B1 |
6287119 | van Nifterick et al. | Sep 2001 | B1 |
6287121 | Guiot et al. | Sep 2001 | B1 |
6315553 | Sachdeva et al. | Nov 2001 | B1 |
6318995 | Sachdeva et al. | Nov 2001 | B1 |
6322359 | Jordan et al. | Nov 2001 | B1 |
6334773 | Ahlen et al. | Jan 2002 | B1 |
6350120 | Sachdeva et al. | Feb 2002 | B1 |
6359680 | Rubbert | Mar 2002 | B1 |
6364660 | Durbin et al. | Apr 2002 | B1 |
6382975 | Poirier | May 2002 | B1 |
6386867 | Durbin et al. | May 2002 | B1 |
6386878 | Pavlovskaia et al. | May 2002 | B1 |
6394801 | Chishti et al. | May 2002 | B2 |
6398548 | Muhammad et al. | Jun 2002 | B1 |
6398554 | Perot et al. | Jun 2002 | B1 |
6402707 | Ernst | Jun 2002 | B1 |
6406292 | Chishti et al. | Jun 2002 | B1 |
6409504 | Jones et al. | Jun 2002 | B1 |
6413084 | Rubbert et al. | Jul 2002 | B1 |
6414708 | Carmeli et al. | Jul 2002 | B1 |
6431870 | Sachdeva | Aug 2002 | B1 |
6431871 | Luthardt | Aug 2002 | B1 |
6457972 | Chishti et al. | Oct 2002 | B1 |
6463344 | Pavlovskaia et al. | Oct 2002 | B1 |
6464496 | Sachdeva et al. | Oct 2002 | B1 |
6471512 | Sachdeva et al. | Oct 2002 | B1 |
6482284 | Reidt et al. | Nov 2002 | B1 |
6497574 | Miller | Dec 2002 | B1 |
6499997 | Chishti et al. | Dec 2002 | B2 |
6506054 | Shoher et al. | Jan 2003 | B2 |
6512994 | Sachdeva | Jan 2003 | B1 |
6514074 | Chishti et al. | Feb 2003 | B1 |
6532299 | Sachdeva et al. | Mar 2003 | B1 |
6540512 | Sachdeva et al. | Apr 2003 | B1 |
6554611 | Chishti et al. | Apr 2003 | B2 |
6554613 | Sachdeva et al. | Apr 2003 | B1 |
6568936 | MacDougald et al. | May 2003 | B2 |
6594539 | Geng | Jul 2003 | B1 |
20020143506 | D'Aligny et al. | Oct 2002 | A1 |
20030045798 | Hular et al. | Mar 2003 | A1 |
Number | Date | Country |
---|---|---|
0 600 800 | Jun 1994 | EP |
Number | Date | Country | |
---|---|---|---|
20050099638 A1 | May 2005 | US |
Number | Date | Country | |
---|---|---|---|
60503666 | Sep 2003 | US |