The present invention relates to a displacement sensor for measuring a displacement such as a dimension of an object according to a light section image or the like.
The displacement sensor for measuring a displacement such as a dimension of an object according to a light section image (image obtained by using a light section method) is known in the art. Typically, a displacement sensor of this type automatically extracts a coordinate of a measuring point from an image obtained by using an imaging device in a sensor head according to a prescribed measuring point extraction algorithm, and computes a desired displacement from the automatically extracted measuring point coordinate.
The sensor head is incorporated with a laser diode for emitting a spot beam (beam having an extremely small circular cross section) or a line beam (beam having a linear cross section), and an imaging device (one-dimensional CCD, two-dimensional CCD or the like) for monitoring a region containing a radiation point of the beam from a different angle, and producing an image containing a variation corresponding to a displacement of the monitored object.
The main unit automatically extracts a measuring point coordinate from the image obtained from each sensor head according to a measuring point extraction algorithm designated by the user. Then, the actual displacement is computed from the automatically extracted measuring point coordinate by using a triangular computation or the like. If a range of variation tolerance (threshold value) is defined for the displacement, a tolerance determination process is performed, and a binary signal indicating the acceptability of the object can be obtained.
According to such a conventional displacement sensor, if the measuring point extraction algorithm or the like is designated in advance, a measuring point coordinate can be automatically extracted from the image obtained, and the desired displacement can be computed in the end so that no effort is required for the user.
However, it does not provided any means for verifying the data (such as the raw image from the imaging device, the automatically extracted measuring point coordinate and various automatically defined threshold values or the like) which is used during the entire process of obtaining the image and computing the displacement.
Therefore, when the measured displacement turns out to be abnormal or when an unacceptable measurement result is obtained, it is not possible to distinguish for the user if it is due to the abnormal condition of the object or due to the abnormal operation of the sensor, possibly due to the influences of external light or the like.
Furthermore, the conventional displacement sensor is not capable of defining the field of view of the imaging device at will, for example, to extract a measuring point at will. This is a particularly significant problem of a displacement sensor with two-dimensional imaging devices (such as two-dimensional CCD or the like). Specifically, because, in normal cases, there are a plurality (typically in the order of tens) of columns of pixels extending in the direction of the displacement in a mutually parallel relationship, the need for finding a peak point and a bottom point from each of these columns creates a serious difficulty when implementing the sensor as a commercial product.
In view of such problems of the prior art, a primary object of the present invention is to provide such a displacement sensor which is easy to use.
A more specific object of the present invention is to provide a displacement sensor which allows the data used from the time of obtaining the image until the time of computing the displacement to be easily verified.
A more specific object of the present invention is to provide a displacement sensor which allows the filed of view of the imaging device to be selected, and the measuring point to be extracted at will.
These and other objects and effects of the present invention will become more apparent to a person skilled in the art from the following description.
The present invention provides a displacement sensor for automatically extracting a coordinate of a measuring point from an image obtained by using an imaging device according to a prescribed measuring point extraction algorithm, and computing a desired displacement from the automatically extracted measuring point coordinate.
The “imaging device” means any imaging device which has a plurality of pixels in the direction of displacement measurement, and allows the address of each light receiving position corresponding to a displacement to be identified. Therefore, imaging devices such as PSD which would not allow the address of each light receiving position to be identified are excluded from the concept of the present invention. The imaging device as used herein include one-dimensional CCDs and two-dimensional CCDs among other possibilities.
The “measuring point extraction algorithm” may comprise any one of a number of known algorithms. Such known algorithms may include peak value searching algorithms, bottom value searching algorithms, average value searching algorithms and most proximate value searching algorithms, among other possibilities.
The “measuring point coordinate” means coordinate data on which the computation of the displacement is based. This coordinate data can be determined at the precision level of pixels or sub-pixels. When the imaging device consists of a two-dimensional imaging device, each measuring point coordinate will have a two-dimensional value. However, the basis for the displacement computation will be typically found in the coordinate values in the direction of the displacement.
The “automatic extraction” means that there is no human intervention. However, it does not exclude the possibility of dialog processes such as the one inquiring the user of the selection of modes during the course of extracting the measuring point coordinate.
The “computation formula based on a measuring point coordinate” may vary depending on the optical arrangement of the sensor head. It typically consists of obtaining a displacement from a measuring point coordinate according to the principle of triangulation.
The output from the displacement sensor is not limited to the computed displacement data as can be readily appreciated. For instance, a threshold level for a tolerable range may be designated by the user so that the determination result indicating if the particular product is acceptable or not may be produced.
In addition to the above mentioned structure, the displacement sensor of the present invention may comprise display data editing means for editing the data used from the time of obtaining the image until the time of computing the displacement for use as display data for an image monitor.
The “data used from the time of obtaining the image until the time of computing the displacement” may include any conceivable data such as the raw image obtained by the imaging device, the automatically extracted measuring point coordinate and various threshold values that are automatically defined, as well as data of other kinds that can be automatically and erroneously defined due to external light or the like because of the automatic nature of the algorithm.
The “display data editing means” implies that the image monitor is not an indispensable element of the displacement sensor of the present invention. In other words, it suffices for the displacement sensor of the present invention to be provided with display data editing means. The displacement sensor of the present invention may be originally provided with an image monitor as an integral part thereof, or, alternatively, it may be optionally fitted with a commercially available image monitor when such a need arises.
According to the present invention having the above described structure, the data used from the time of obtaining the image until the time of computing the displacement can be readily verified via the display on the image monitor, and it allows any abnormal value of the measured displacement to be distinguished if the object for measurement is indeed abnormal or if it is a result of the abnormal operation of the sensor due to external light or the like.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to a raw image obtained by the imaging device.
The “raw image” as used herein means an image of an object to be measured which is obtained by the imaging device.
According to this structure, it is possible to readily verify where on the surface of the object to be measured the measuring light (section light) is being impinged, if external light is being impinged upon the surface of the object to be measured, and how much is the brightness of the illuminating light image of the measuring light.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to a raw image obtained by the imaging device, and a graphic image indicating a coordinate of a measuring point placed over the raw image.
According to this structure, by comparing the image such as a mark indicating the automatically extracted measuring point with the image of the surface of the object to be measured one over the other, one can readily verify if the measuring point has been properly determined at a position on which the measuring light impinges, or if the measuring point has been improperly determined at a position on which external light impinges.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to a raw image obtained by the imaging device, and a graphic image indicating a measurement value tolerance range in the direction of displacement measurement shown over the raw image.
According to this structure, by showing the graphic image such as a boundary line indicating the measurement tolerance range and the image of the surface of the object to be measured one over the other, one can readily verify the relationship between the position of the illuminating light image of the measuring light and the measurement tolerance range.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to a raw image obtained by the imaging device, and a graphic image indicating a coordinate of a measuring point and a measurement value tolerance range in the direction of displacement measurement shown over the raw image.
According to this structure, by comparing the graphic image such as a boundary line indicating the measurement tolerance range and the graphic image such as a mark indicating the automatically extracted coordinate of the measuring point with the image of the surface of the object to be measured, one can readily verify the relationship between the automatically extracted measuring point coordinate, the position of the illuminating light image of the measuring light and the measurement tolerance range.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data can be expanded in the direction of displacement measurement.
According to this structure, one can verify the relationship between the automatically extracted measuring point coordinate, the measurement value tolerance range and the image of the surface of the object to be measured even more closely.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to the image of a line bright waveform.
The “line bright waveform” means a curve which indicates the distribution of the brightness of the received light along the row of pixels. For instance, it can be represented in a graph having the displacement on the abscissa and the brightness of the received light (gradation) on the ordinate.
According to this structure, the distribution of the brightness along the direction of displacement measurement on the surface of the object to be measured can be verified in an accurate manner.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to the line bright waveform and a graphic image indicating a measuring point coordinate shown over the line bright waveform.
According to this structure, by comparing the line bright waveform and the measuring point coordinate, one can readily verify if the measuring point is properly determined on the spot which is illuminated by the measuring light and if the measuring point is improperly determined on the spot which is illuminated by external light.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to the line bright waveform and a graphic image indicating a threshold value for extracting the measuring point coordinate shown over the line bright waveform.
According to this structure, by comparing the peak of the line bright waveform and the graphic image such as a line indicating a threshold value, one can verify the process of automatically extracting the measuring point coordinate. If the automatically extracted measuring point coordinate is displayed at the same time, one can verify if the measuring point extraction algorithm has been properly executed or not.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to the line bright waveform and a graphic image indicating a measurement value tolerance range in the direction of displacement measurement.
According to this structure, by comparing the peak of the line bright waveform with the graphic image such as a boundary line indicating the measurement tolerance range, one can verify the process of determining the acceptability of each product.
According to a preferred embodiment of the present invention, the display data on the image monitor corresponds to the line bright waveform and graphic images indicating a measuring point coordinate and a measurement value tolerance range in the direction of displacement measurement shown over the line bright waveform.
According to this structure, by comparing the graphic image such as a mark for indicating the automatically extracted measuring point and the graphic image such as a boundary line indicating the measurement value tolerance range with the line bright waveform, one can readily verify the relationship between the peak of the line bright waveform, the automatically extracted measuring point coordinate, and the measurement value tolerance range.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data can be enlarged in the direction for displacement measurement.
According to this structure, one can verify the relationship between the automatically extracted measuring point coordinate, the measurement value tolerance range, and the line bright of the surface of the object to be measured even more closely.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to a raw image obtained by the imaging device and the line bright waveform which are shown one over the other or one next to the other.
According to this structure, one can readily verify the relationship between the visually observed distribution of the brightness on the surface of the object to be measured with the distribution of the brightness on the surface of the object to be measured as represented by the peak of the line bright waveform.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to an image combining the raw image obtained from the imaging device and the line bright waveform which are placed one next to the other or one over the other, and the combined image additionally combines an image indicating a measuring point coordinate shown over the raw image and/or the line bright waveform.
According to this structure, one can verify the process of automatically extracting the measuring point coordinate by using both the image of the surface of the object to be measured and the line bright waveform.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to an image combining the raw image obtained from the imaging device and the line bright waveform which are placed one next to the other or one over the other, and the combined image additionally combines an image indicating a tolerance range for a measurement value in a direction for measuring the displacement shown over the raw image and/or the line bright waveform.
According to this structure, one can verify the process of determining the acceptability of each product by using both the image of the surface of the object to be measured and the line bright waveform.
According to a preferred embodiment of the present invention, the display data for the image monitor corresponds to an image combining the raw image obtained from the imaging device and the line bright waveform which are placed one next to the other or one over the other, and the combined image additionally combines an image indicating a measuring point coordinate and an image indicating a tolerance range for a measurement value in a direction for measuring the displacement shown over the raw image and/or the line bright waveform.
According to this structure, one can verify the process of automatically extracting the measuring point coordinate and the process of determining the acceptability of each product by using both the image of the surface of the object to be measured and the line bright waveform.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data can be enlarged in the direction for displacement measurement.
According to this structure, one can verify the process of automatically extracting the measuring point coordinate and the process of determining the acceptability of each product more precisely by using both the image of the surface of the object to be measured and the line bright waveform.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data corresponds to a raw image obtained from the imaging device and a graphic image indicating a measuring point extracting range defined in a direction perpendicular to the direction of displacement measurement which is placed over the raw image.
According to this structure, one can verify the contents of the measuring point extracting algorithm by comparing the image of the surface of the object to be measured with the graphic image such as a boundary line defining the range of extracting the measuring point.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data corresponds to a raw image obtained from the imaging device and a graphic image indicating a measuring point extracting range defined in a direction perpendicular to the direction of displacement measurement and an automatically extracted measuring point coordinate which are placed over the raw image.
according to this structure, one can verify if the measuring point extracting algorithm has been properly executed by comparing the image of the surface of the object to be measured with the graphic image such as a boundary line defining the range of extracting the measuring point and the graphic image indicating the automatically extracted measuring point coordinate.
According to a preferred embodiment of the present invention, the image displayed on the image monitor according to the display data corresponds to a trend graph image which shows computed displacements in a time sequence.
According to this structure, one can identify the increasing or decreasing trend of the currently measuring values by comparing the time history of a series of measured values included in the trend graph.
According to another aspect of the present invention, the present invention provides a displacement sensor for automatically extracting a coordinate of a measuring point from an image obtained by using an imaging device according to a prescribed measuring point extraction algorithm, and computing a desired displacement from the automatically extracted measuring point coordinate, further comprising: means for defining a measuring point extraction range on the image obtained by the imaging device; and means for automatically extracting a measuring point coordinate from a part of the image within the measuring point extraction range according to a prescribed measuring point extraction algorithm.
According to a preferred embodiment of the present invention, the measuring point extraction range is defined in the direction for displacement measurement.
According to a preferred embodiment of the present invention, the imaging device consists of a two-dimensional imaging device, and the measuring point extraction range is defined in a direction perpendicular to the direction for displacement measurement.
According to this structure, because the range for extracting the measuring point can be defined over the image obtained from the imaging device, improper extraction due to external light can be avoided. Furthermore, when a two-dimensional imaging device is used, by liming the width of the columns of pixels for measurement to a minimum value, the time required for extracting the measuring point can be minimized.
According to this structure, the convenience of the displacement sensor consisting of a two-dimensional imaging device can be improved. Specifically, because, typically, a plurality (typically tens or more) of columns of pixels extend in the direction of displacement in parallel with one another, the need for extracting a peak point and a bottom point from each column would make the sensor system highly inconvenient to use.
According to another aspect of the present invention, the present invention provides a displacement sensor, comprising: one or a plurality of sensor head each incorporated with a light source for generating a light section beam and an imaging device for imaging an object to be measured which is illuminated by the light section beam; a main unit connected to the sensor head or the sensor heads with an electric cord; a console unit formed integrally with or separately from the main unit for supplying various commands to the main unit; and an image monitor driven by a monitor output obtained from the main unit; the main unit being adapted to automatically extract a coordinate of a measuring point from an image obtained by the sensor head or sensor heads by using a prescribed measuring point extraction algorithm.
The main unit is further adapted to compute a displacement according to the automatically extracted coordinate of the measuring point; the main unit further comprising display data editing means for editing data used from the time of obtaining the image until the time of computing the displacement for use as display data for the image monitor.
According to a preferred embodiment of the present invention, the light section beam consists of a line beam, and the imaging device consists of a two-dimensional imaging device.
According to a preferred embodiment of the present invention, the main unit further comprises means for defining a measuring range on the image obtained by the sensor head according to a prescribed manipulation of a control variable, and means for automatically extracting a coordinate of a measuring point from the image in the measuring range according to a prescribed measuring point extracting algorithm.
According to this structure, the improper operation due to the influences of external light and improper adjustment of various parts can be avoided, and a highly convenient displacement sensor can be provided.
Now the present invention is described in the following with reference to the appended drawings, in which:
As mentioned earlier, the displacement sensor of the present invention consists of a displacement sensor for automatically extracting a coordinate of a measuring point from an image obtained by using an imaging device according to a prescribed measuring point extraction algorithm, and computing a desired displacement from the automatically extracted measuring point coordinate, characterized by that: the sensor further comprises display data editing means for editing data used from the time of obtaining the image until the time of computing the displacement for use as display data for an image monitor.
As shown in the drawing, this displacement sensor 1 comprises a main unit 10, a pair of sensor heads 20A and 20B, an image monitor 30 and a console unit 40. The reference numeral 50 denotes external equipment such as PLC. The main unit 10 is a central part of the displacement sensor, and essentially consists of a microprocessor. The main unit 10 is internally incorporated with various processing functions by using software as described in the following with reference to
The sensor heads 20A and 20B each detect a displacement and convert it into information on a position on a light receiving surface. An exemplary sensor head 20A or 20B is shown in
The slit of the slit plate 202 is linear so that the light beam which impinges upon the object 60 consists of a line beam (beam having a linear cross section). In this example, the axial direction (direction perpendicular to the cross section of the line beam) of the line beam is perpendicular to the sheet of the paper.
The imaging device 205 in this case consists of a two-dimensional CCD device. In particular, this two-dimensional CCD device has a field of view in the shape of an elongated rectangle. For example, the light receiving surface of the CCD device has 1077 pixels along the long side, and 68 pixels along the short side. The direction of the line beam impinging upon the light receiving surface extends in a direction perpendicular to the long side of the light receiving surface of the CCD device.
Referring to
The image monitor 30 receives a monitor output (display data) from the main unit 10, and displays a corresponding image on its screen. The image monitor 30 may consist of any commercially available monitors such as CRT displays and LCDs.
The external equipment 50 corresponds to a programable controller (PLC) or the like, and receives a displacement data output D1 and a determination result output D2 from the main unit 10. The main unit 10 is a central part of the present invention which automatically extracts a measuring point coordinate from the image obtained by the sensor head 20A or 20B according to a measuring point extraction algorithm designated by the user, computes the actual displacement from the automatically extracted measuring point coordinate by using a triangulation computation or the like, and, if a tolerance range (threshold value) for the displacement is defined, executes a tolerance range determination process, for producing a binary signal which indicates if the object is acceptable or not. The obtained displacement data output D1 and determination result output D2 consisting of a binary signal are forwarded to the external equipment 50.
The control unit 120 is incorporated with a GUI unit 121 serving as an interface for the image monitor 30 and console unit 40, an image processing unit 122 for suitably processing the image data obtained from the measurement unit 110 and forwarding the image data to the GUI unit 121, an external output interface 124 for forwarding the displacement data output D1 and determination result output D2 which were mentioned earlier to the external equipment, and a control processing unit 123 for generally controlling the overall system.
The data flow in this system is described in the following. A sensor head control unit 111B incorporated in the interface unit 111 controls the intensity of the light emitted from the laser diode 201 (see
The image data forwarded to the measurement unit 110 is then forwarded to an image transfer unit 112A and a measurement processing unit 112B in the image computing unit 112. The image transfer unit 112A forwards the image data D3 received from the image capturing unit 111A to the image processing unit 122 of the control unit 120.
The process of extracting the measurement point coordinate and the process of measuring the displacement which are essential features of the present invention are achieved mainly by this measurement processing unit 112B.
The control processing unit 123 in the control unit 120 computes the measuring point coordinate (in the direction of the line beam) data D8 from the data D7 received from the measurement processing unit 112B, and forwards it to the image processing unit 112. The image processing unit 122 forwards data D4 including both image data and line bright data to the GUI unit 121. The GUI unit 121 receives various commands from the console unit 40, and edits the display data which is then forwarded to the image monitor 30 as a monitor output D5.
The process of editing the display data which is an essential feature of the present invention is achieved mainly by this image process unit 122 and the GUI (graphic user interface) unit 121.
The mode of operation of the displacement sensor described above in measuring the displacement is now described in the following with reference to the flow chart of
The image obtained by the CCDs in the sensor heads is illustrated in
Referring to
Referring to
Referring to
TH=Vp×a %.
The process of extracting the measuring point coordinate is illustrated in
Referring to
(displacement Z)=A×B/(C×X),
where X is the coordinate in the direction of the displacement, and A, B and C are constants that are determined by the optical system.
Referring to
The determination result is HIGH when the displacement is larger than the HIGH reference value.
The determination result is PASS when HIGH reference value≧displacement≧LOW reference value (the object is found acceptable).
The determination result is LOW when the displacement is smaller than the LOW reference value.
The determination result is ERROR when the sensor is unable to measure.
The process of generating the images on the monitor display is illustrated in
Examples of a display on the image monitor 30 are described in the following with reference to FIGS. 11 to 15.
The image display area 77 displays a raw image (gradation image) obtained from the imaging device consisting of a two-dimensional CCD. In the drawing, the reference numeral 81 denotes a line beam image, and the reference numeral 82 denotes a cross symbol for indicating the measuring point coordinate on the raw image.
The graph display area 78 displays the line bright waveform along with vertical and horizontal grid lines. The reference numeral 83 denotes the line bright waveform, and the reference numeral 84 denotes the vertical and horizontal grid lines. The two dotted lines extending in the vertical direction are determination reference values for LOW and HIGH.
The number display area 79 shows a number indicating the displacement, and a symbol indicating the determination result. In the drawing, the numeral 88 denotes a value (+101.5345) indicating the measured value, and the numeral 89 denotes a symbol (PASS) indicating the determination result.
The process of defining the measuring range 73 which was described in connection with the previously described exemplary measurement process is now more fully described. As mentioned earlier, the two sensors 20A and 20B are connected to the system in this embodiment. Also, as shown in
The process of extracting characteristic points (measuring point) in the measuring range according to three different modes (normal mode, peak mode and bottom mode) following the process of defining the measuring range is described in the following.
As can be appreciated from the foregoing description, this displacement sensor enables the user not only to verify the result of displacement measurement but also to display various items of data (raw image, line bright waveform and various threshold values) which are used from the time the raw image is obtained until the time the displacement is measured on the monitor screen. Therefore, even when an abnormal displacement measurement result is obtained, one can readily determine if it is due to the abnormal state of the object to be measured or due to the faulty operation of the system caused by external light, and appropriate measures against such situations can be taken without any delay, for instance when applied to a production line.
In particular, because the raw image and line bright waveform are placed one next to the other on the monitor screen, if an abnormal measurement result is produced due to external light, one can readily discover the cause in an accurate manner by comparing the raw image with the line bright waveform.
Also, because the measuring range is defined not only in the direction of displacement measurement but also in the perpendicular direction, when the image of the line beam is offset in the field of view of the two-dimensional CCD or the measuring point on the object to be measured is offset in the field of view of the CCD, it is possible to more finely define the measuring point by taking into account such an offsetting, and this contributes to an even more accurate displacement measurement.
It is also possible to display the two outputs from the two sensors which operate at the same time on the monitor screen one over the other or one next to the other. Therefore, when a step is desired to be measured by using the two sensor heads, even in case of an error, it can be immediately and accurately determined which of the sensors is faulty.
When a plurality of objects are carried by a belt conveyor, the displacement of each object can be displayed on the monitor screen in a time sequence, and this feature is highly convenient for use in a testing process in a production line.
As can be appreciated from the foregoing description, according to the present invention, the data which is used from the time the raw image is obtained until the time the displacement is computed can be easily verified. Therefore, when the measured displacement is found to be abnormal, it can be determined if the object to be measured is indeed abnormal or if it is due to the faulty operation of the sensor due to external light. Also, according to the present invention, the measuring point can be extracted by freely limiting the field of view of the imaging device. Thus, according to the present invention, the convenience of such a displacement sensor can be substantially enhanced.
Although the present invention has been described in terms of preferred embodiments thereof, it is obvious to a person skilled in the art that various alterations and modifications are possible without departing from the scope of the present invention which is set forth in the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2000-27429 | Jan 2000 | JP | national |
2000-382665 | Dec 2000 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | 09770379 | Jan 2001 | US |
Child | 11252614 | Oct 2005 | US |