The present invention relates generally to a correction and capture technology of capture devices, and more particularly to a correction and capture method for a biological particle capture device.
With the advancement of biomedical detection technology, nowadays biomedical detection technology generally uses an automatic capture device to automatically sort specific biological particles in Petri dishes to enhance the accuracy of detection.
Specifically, the automatic capture device has a mechanical arm that could drive a pipette tip to move, wherein the pipette tip is used to sort the specific biological particles in the Petri dishes. However, in practice, due to a tolerance between the mechanical arm and the pipette tip, a relative position of the mechanical arm and the pipette tip is deviated. Moreover, a relative position of the pipette tip and the Petri dishes might has a slight deviation, so that the mechanical arm could not accurately move the pipette tip to a correct position during a sorting process. As a result, the automatic capture device is likely to have a lower accuracy in the sorting process of the biological particles.
Accordingly, there is a need for a correction and capture method for a biological particle capture device to address a longstanding technical problem in traditional detection methods.
In view of the above, the primary objective of the present invention is to provide a correction and capture method for a biological particle capture device, which could improve the accuracy of a particle capture tool in capturing biological particles by using multi-point correction.
In order to achieve the above objective, the present invention provides a correction and capture method for a biological particle capture device, including: providing an image observation unit, which faces a side of a carrier platform, on an observation platform and orientating a view region of the image observation unit towards a carrier region of the carrier platform for taking images; performing a fixed point displacement on the observation platform by the image observation unit based on a plurality of observation basic coordinates set on an observation platform coordinate system and defining a correction point in an image of the view region when the image observation unit is positioned at one of the plurality of observation basic coordinates and takes the image; controlling, by a terminal device, a particle capture tool on a capture platform to move relative to the carrier region on another side of the carrier platform based on a relative position of the image observation unit positioned at one of the plurality of observation basic coordinates, wherein a capture portion of the particle capture tool enters the image of the view region; adjusting the capture portion of the particle capture tool to align with the correction point and recording, by the terminal device, a capture correction coordinate of the capture portion located in a capture platform coordinate system of the capture platform; placing a carrier in the carrier region, and taking, by the terminal device, the plurality of observation basic coordinates previously recorded in the observation platform coordinate system in correspondence with a periphery of a particle and calculating, by the terminal device, a position of the image observation unit located at the correction point recorded in each of the plurality of observation basic coordinates when the image observation unit discovers the particle on the carrier, so that the terminal device acquires a plurality of correction basic coordinates around the particle on the carrier; simulating, by the terminal device, a virtual correction region in the view region of the image observation unit based on the plurality of correction basic coordinates, wherein a position of the particle correspondingly falls into the virtual correction region; simulating a first extension axis and a second extension axis based on the position of the particle by the terminal device, wherein the first extension axis and a first absolute X coordinate axis in the virtual correction region perpendicularly intersect to acquire a first joint X coordinate; the first extension axis and a second absolute X coordinate axis in the virtual correction region perpendicularly intersect to acquire a second joint X coordinate; the second extension axis and a first absolute Y coordinate axis in the virtual correction region perpendicularly intersect to acquire a first joint Y coordinate; the second extension axis and a second absolute Y coordinate axis in the virtual correction region perpendicularly intersect to acquire a second joint Y coordinate; and controlling the particle capture tool to correspondingly move to the position of the particle, wherein the terminal device takes the first joint X coordinate, the second joint X coordinate, the first joint Y coordinate, and the second joint Y coordinate, and uses a specific conditional formula to calculate and obtain a relative capture coordinate that the particle capture tool is required to correspondingly move.
In one embodiment, the plurality of correction basic coordinates are respectively located at four corners of the virtual correction region; the plurality of correction basic coordinates include a first correction basic coordinate, a second correction basic coordinate, a third correction basic coordinate, and a fourth correction basic coordinate; the first correction basic coordinate corresponds to an intersection of the first absolute X coordinate axis and the first absolute Y coordinate axis; the second correction basic coordinate corresponds to an intersection of the second absolute X coordinate axis and the first absolute Y coordinate axis; the third correction basic coordinate corresponds to an intersection of the first absolute X coordinate axis and the second absolute Y coordinate axis; the fourth correction basic coordinate corresponds to an intersection of the second absolute X coordinate axis and the second absolute Y coordinate axis.
In one embodiment, the specific conditional formula is as follows: ((x2−x)/(x2−x1))*Px11+((x−x1)/(x2−x1))*Px21=Px1; ((x2−x)/(x2−x1))*Px12+((x−x1)/(x2−x1))*Px22=Px2; x1 is a X coordinate value of the first joint X coordinate in the first absolute X coordinate axis; x2 is a X coordinate value of the second joint X coordinate in the second absolute X coordinate axis; x is a X-axis coordinate value of the particle in the observation platform coordinate system; Px11 is an X-axis relative coordinate value of the capture platform coordinate system corresponding to the first correction basic coordinate; Px12 is an X-axis relative coordinate value of the capture platform coordinate system corresponding to the second correction basic coordinate; Px21 is an X-axis relative coordinate value of the capture platform coordinate system corresponding to the third correction basic coordinate; Px22 is an X-axis relative coordinate value of the capture platform coordinate system corresponding to the fourth correction basic coordinate; Px1 is a first X-axis relative capture coordinate of the capture platform coordinate system corresponding to the first joint X coordinate; Px2 is a second X-axis relative capture coordinate of the capture platform coordinate system corresponding to the second joint X coordinate.
In one embodiment, the specific conditional formula further includes: ((y2−y)/(y2−y1))*Px1+((y−y1)/(y2−y1))*Px2=Px; y1 is a Y coordinate value of the first joint Y coordinate in the first absolute Y coordinate axis; y2 is a Y coordinate value of the second joint Y coordinate in the second absolute Y coordinate axis; y is a Y-axis coordinate value of the particle in the observation platform coordinate system; Px1 is a first X-axis relative capture coordinate of the capture platform coordinate system corresponding to the first joint X coordinate; Px2 is a second X-axis relative capture coordinate of the capture platform coordinate system corresponding to the second joint X coordinate; Px is a X coordinate value of the relative capture coordinate corresponding to the position of the particle.
In one embodiment, the specific conditional formula further includes: ((x2−x)/(x2−x1))*Py11+((x−x1)/(x2−x1))*Py21=Py1; ((x2−x)/(x2−x1))*Py12+((x−x1)/(x2−x1))*Py22=Py2; y1 is a Y coordinate value of the first joint Y coordinate in the first absolute Y coordinate axis; y2 is a Y coordinate value of the second joint Y coordinate in the second absolute Y coordinate axis; y is a Y-axis coordinate value of the particle in the observation platform coordinate system; Py11 is a Y-axis relative coordinate value of the capture platform coordinate system corresponding to the first correction basic coordinate; Py12 is a Y-axis relative coordinate value of the capture platform coordinate system corresponding to the second correction basic coordinate; Py21 is a Y-axis relative coordinate value of the capture platform coordinate system corresponding to the third correction basic coordinate; Py22 is a Y-axis relative coordinate value of the capture platform coordinate system corresponding to the fourth correction basic coordinate; Py1 is a first Y-axis relative capture coordinate of the capture platform coordinate system corresponding to the first joint Y coordinate; Py2 is a second Y-axis relative capture coordinate of the capture platform coordinate system corresponding to the second joint Y coordinate.
In one embodiment, the specific conditional formula further includes: ((y2−y)/(y2−y1))*Py1+((y−y1)/(y2−y1))*Py2=Py; y1 is a Y coordinate value of the first joint Y coordinate in the first absolute Y coordinate axis; y2 is a Y coordinate value of the second joint Y coordinate in the second absolute Y coordinate axis; y is a Y-axis coordinate value of the particle in the observation platform coordinate system; Py1 is a first Y-axis relative capture coordinate of the capture platform coordinate system corresponding to the first joint Y coordinate; Py2 is a second Y-axis relative capture coordinate of the capture platform coordinate system corresponding to the second joint Y coordinate; Py is a Y coordinate value of the relative capture coordinate corresponding to the position of the particle.
In one embodiment, the particle capture tool is controlled by a mechanical arm to move relative to the carrier platform within an area covered by the capture platform in accordance with the capture platform coordinate system; the terminal device controls the mechanical arm to move the particle capture tool to the relative capture coordinate, so that the capture portion of the particle capture tool is aligned with the particle on the carrier.
In one embodiment, when the particle capture tool has completed a particle capture operation, the mechanical arm moves the particle capture tool to a waste collection area for disposal and the mechanical arm is then moved to a capture tool area to install a new particle capture tool.
In one embodiment, a transparent bottom of the carrier faces the observation platform and the carrier is filled with a transparent liquid; a camera path of the image observation unit is projected on the transparent bottom from a bottom of the transparent bottom and penetrates the transparent liquid.
In one embodiment, the image observation unit is selected from the group consisting of a charge-coupled device (CCD), a complementary metal-oxide-semiconductor device (CMOS), and combinations thereof; the image observation unit uses a magnification ratio of 5 times to 100 times, and the image observation unit is controlled by the terminal device to move.
With the aforementioned design, the image observation unit faces the carrier platform to take an image, and the image observation unit performs the fixed point displacement on the observation platform corresponding to each of the observation basic coordinates. The terminal device defines the correction point based on the image of the view region of the image observation unit, controls the capture portion of the particle capture tool to enter the view region of the image observation unit, adjusts the capture portion of the particle capture tool to align with the correction point, and records the capture correction coordinate of the capture portion. In this way, the image observation unit on the observation platform and the particle capture tool on the capture platform have completed the relative position correction, and the capture correction coordinates on the capture platform coordinate system are established, so that when a biological particle at a certain position on the carrier in the image is detected by the image observation unit, the capture portion could be quickly moved to the view region where the image observation unit could take the image, which reduces the deviation of the relative position between the particle capture tool and the carrier and improves the accuracy of the particle capture tool in capturing the biological particles.
Then, the terminal device uses the aforementioned conditional formula to calculate the relative capture coordinate of the capture platform coordinate system that is required to capture the particle, and then the mechanical arm is accurately controlled to drive the particle capture tool to move to the particle and capture the particle, thereby achieving the effect that the particle capture tool accurately captures the biological particles.
The present invention will be best understood by referring to the following detailed description of some illustrative embodiments in conjunction with the accompanying drawings, in which
A correction and capture method for a biological particle capture device according to an embodiment of the present invention is illustrated in
The carrier platform 10 is provided with a first image correction unit 11a and a plurality of second image correction units. The first image correction unit 11a and the plurality of second image correction units respectively are selected from the group consisting of a charge-coupled device (CCD), a complementary metal-oxide-semiconductor device (CMOS), and combinations thereof. In the current embodiment, the plurality of second image correction units includes two second image correction units 11b, 11c as an example. In the current embodiment, the first image correction unit 11a and the two second image correction units 11b, 11c are respectively set up on the carrier platform 10 by a support (not shown) for taking images. Referring to
In addition, referring to
The observation platform 20 is disposed on a side of the carrier platform 10. In the current embodiment, the observation platform 20 is located below the carrier platform 10, wherein the observation platform 20 is provided with a control device 21 and an image observation unit 22. The control device 21 is connected to the image observation unit 22 and could control the image observation unit 22 to translate or move at a predetermined angle relative to the carrier platform 10. The image observation unit 22 on the observation platform 20 is adapted to observe a biological particle on the carrier platform 10. The image observation unit 22 is selected from the group consisting of a charge-coupled device (CCD), a complementary metal-oxide-semiconductor device (CMOS), and combinations thereof.
However, a displacement relationship between the image observation unit 22 and the carrier platform 10 is not limited to the above description. For example, in other embodiments, the control device 21 is immobile and the carrier platform 10 is connected to a movement device 13 (as shown in
In addition, an observation platform coordinate system A is defined at the observation platform 20. The observation platform coordinate system A includes a first X axis a1, a first Y axis a2, and a first Z axis a3 that are perpendicular to one another. After the observation platform coordinate system A is established, any point coordinate of the observation platform coordinate system A could be defined as (Xa, Ya, Za). The observation platform 20 uses the control device 21 to drive the image observation unit 22 to move arbitrarily relative to the carrier platform 10 within an area covered by the observation platform 20 in accordance with the observation platform coordinate system A. A plurality of observation basic coordinates is provided on the observation platform coordinate system A, wherein the observation basic coordinates are position coordinates that are predetermined and correspond to the movement of the image observation unit 22 relative to the carrier platform 10, so that the image observation unit 22 could perform continuously fixed point displacement among the observation basic coordinates to thoroughly take images of the carrier platform 10.
The capture platform 30 is opposite to the observation platform 20 and is provided on the other side of the carrier platform 10. In the current embodiment, the capture platform 30 is located above the carrier platform 10. The capture platform 30 is provided with a mechanical arm 31 and a particle capture tool 32. Both the mechanical arm 31 and the control device 21 could be defined to include any mechanical devices capable of moving in a space without being limited in directions. As shown in
In addition, a capture platform coordinate system B is defined at the capture platform 30. The capture platform coordinate system B includes a second X axis b1, a second Y axis b2, and a second Z axis b3 that are perpendicular to one another. Any point coordinate of the capture platform coordinate system B could be defined as (Xb, Yb, Zb). The mechanical arm 31 on the capture platform 30 is driven by a driving device (not shown). The driving device could be an electric motor, a pneumatic cylinder, or other power devices. In this way, the particle capture tool 32 could be controlled by the mechanical arm 31 to move arbitrarily relative to the carrier platform 10 within an area covered by the capture platform 30 in accordance with the capture platform coordinate system B.
The terminal device 40 is electrically connected to the mechanical arm 31 of the capture platform 30 and the control device 21 of the observation platform 20 respectively. The terminal device 40 could respectively control the mechanical arm 31 and the control device 21 to move. The terminal device 40 is electrically connected to the first image correction unit 11a, the second image correction units 11b, 11c, and the image observation unit 22 and is adapted to acquire and analyze image signals.
Therefore, based on the aforementioned hardware structure, the correction and capture method for the biological particle capture device is further explained below and includes the following steps:
Step S1: as shown in
In addition, the image observation unit 22 could use a magnification ratio of 5 times to 100 times, wherein the magnification ratio of the image observation unit 22 could be adjusted according to demand. In the current embodiment, the image observation unit 22 is an objective with a magnification ratio of 10 times, so that a view of the transparent bottom 121 of the carrier 12 could be accurately imaged and detected by the high magnification ratio. In other embodiments, the carrier 12 could be filled with a transparent liquid 122, and a light of the camera path of the image observation unit 22 is projected on the transparent bottom 121 of the carrier 12 from a bottom of the transparent bottom 121 and penetrates the transparent liquid 122 to simulate an actual situation that the carrier 12 has a nutrient fluid therein.
Step S2: the terminal device 40 controls the control device 21 of the observation platform 20 to drive the image observation unit 22 to move according to the observation basic coordinates predetermined on the observation platform coordinate system A, so that the image observation unit 22 performs the fixed point displacement on the observation platform 20 in correspondence with a position of the observation basic coordinates; the image observation unit 22 faces the transparent bottom 121 of the carrier 12 for taking an image and the image observation unit 22 transmits the image of the carrier 12 to the terminal device 40. In the current embodiment, a distance between two of the observation basic coordinates, which are adjacent, on the observation platform coordinate system A is set between 1 mm and 7 mm, wherein the distance between the two adjacent observation basic coordinates basically includes a distance of an X-axis coordinate value, a distance of a Y-axis coordinate value, or a distance of a Z-axis coordinate value; when a mechanical deviation occurs on the observation platform 20 during a mechanical operation and the observation platform 20 is in a non-horizontal condition, the distance between the two adjacent observation basic coordinates on the observation platform coordinate system A should take into account the distance of the Z-axis coordinate value. In the current embodiment, the distance between the two adjacent observation basic coordinates on the observation platform coordinate system A is set to be 1 mm; assuming that one of the observation basic coordinates is (1, 1, 0) on the observation platform coordinate system A, the two adjacent observation basic coordinate could be (2, 1, 0) or (1, 2, 0); the distance between the two adjacent observation basic coordinates on the observation platform coordinate system A is used for positioning and correction and could be adjusted according to demand. However, in the present invention, the distance between the two adjacent observation base coordinates does not constitute a limitation of the present invention. If the distance between the two adjacent observation basic coordinates is smaller, the time taken for correction is longer. In other embodiments, the distance between the two adjacent observation basic coordinates could also be set at 3 mm for faster correction.
Furthermore, as shown in
In addition, the view region 221 generated by the image observation unit 22 located in one of the observation basic coordinates and the view region 221 generated by the image observation unit 22 after the image observation unit 22 is shifted to one of the adjacent observation basic coordinates could be partially overlapped. Referring to
Step S3: the terminal device 40 controls the particle capture tool 32 on the capture platform 30 to move above the carrier platform 10 and relative to the carrier region according to a relative position of the image observation unit 22 that is positioned at one of the observation basic coordinates, such that the capture portion 321 of the particle capture tool 32 is shifted on a surface of the carrier 12, and the capture portion 321 of the particle capture tool 32 enters the image of the view region 221 of the image observation unit 22; in this way, the image observation unit 22 could detect a relative position of the capture portion 321 of the particle capture tool 32 that is located in the view region 221. In particular, the capture portion 321 of the particle capture tool 32 could move regularly on the surface of the carrier 12 along a movement path. For example, the movement path of the particle capture tool 32 could start from a fixed center of the carrier 12 and move outward; the movement path could also repetitively move back and forth from left to right on the surface of the carrier 12; alternatively, the movement path of the particle capture tool 32 could be adjusted to move randomly with a non-repetitive trajectory, so that the capture portion 321 of the particle capture tool 32 finally enters into the image of the view region 221 of the image observation unit 22. In another embodiment, a moving position or an angle of the capture portion 321 of the particle capture tool 32 could be adjusted manually, so that the capture portion 321 of the particle capture tool 32 enters into the image of the view region 221 of the image observation unit 22.
Step S4: when the image observation unit 22 detects that the capture portion 321 of the particle capture tool 32 enters the view region 221, the terminal device 40 adjusts the capture portion 321 of the particle capture tool 32 to align with the correction point 41 in the view region 221. When the image observation unit 22 determines that the capture portion 321 of the particle capture tool 32 is indeed aligned with the correction point 41 in the view region 221, the terminal device 40 records a capture correction coordinate of the capture portion 321 of the particle capture tool 32 that is located in the capture platform coordinate system B of the capture platform 30. In other words, when the terminal device 40 records the capture correction coordinate of the capture portion 321 of the particle capture tool 32, the terminal device 40 then controls the image observation unit 22 to shift to a position of another one of the observation basic coordinates on the observation platform 20; the terminal device 40 defines another correction point 41 in another image of the view region 221 generated by the image observation unit 22 and controls the capture portion 321 of the particle capture tool 32 to enter the another image of the view region 221 generated by the image observation unit 22 according to the position of the another observation basic coordinate; the terminal device 40 then controls the capture portion 321 of the particle capture tool 32 to align with the another correction point 41 in the view region 221 generated by the image observation unit 22, and the terminal device 40 records another capture correction coordinate of the capture portion 321 of the particle capture tool 32.
The relative position correction of the image observation unit 22 on the observation platform 20 and the particle capture tool 32 on the capture platform 30 has already been completed on the carrier platform 10 and the capture correction coordinates have been established and recorded on the capture platform coordinate system B. In this way, when the image observation unit 22 detects the biological particles at a certain position on the carrier 12, the capture portion 321 could quickly reach the view region 221 that the image observation unit 22 could take images. After replacing the particle capture tool 32 due to operational requirements, an angle between the particle capture tool 32 and the mechanical arm 31 might not be the same every time when the particle capture tool 32 is connected to the mechanical arm 31; alternatively, when a deviation caused by the mechanical deviation occurs during the mechanical operation or due to a vibration of the hardware, a discrepancy exists between the position where the particle capture tool 32 reaches the predetermined capture correction coordinate and the position where the image observation unit 22 moves in correspondence with the capture correction coordinate; nevertheless, the discrepancy is still within the view region 221 that the image observation unit 22 could take images; therefore, in the current embodiment, the position correction between the particle capture tool 32 and the image observation unit 22 is achieved by performing steps S1 to S4, so that the discrepancy of the relative position between the particle capture tool 32 and the carrier 12 is reduced, and the accuracy of the particle capture tool 32 in capturing the biological particles is improved.
More specifically, the image observation unit 22 monitors the capture portion 321 from a bottom perspective. The terminal device 40 judges the position of the capture portion 321 relative to the correction point 41 in the view region 221 in accordance with the images taken by the image observation unit 22, and the terminal device 40 adjusts the position of the capture portion 321 on the carrier 12 by controlling the mechanical arm 31, so that an axis of the capture portion 321 is aligned with the correction point 41 to correct the position of the particle capture tool 32. A correction way of the capture portion 321 is to control the capture portion 321 to move along the second X axis b1 of the capture platform coordinate system B and to move along the second Y axis b2 of the capture platform coordinate system B, so that the axis or a tip of the capture portion 321 is aligned with the correction point 41. In other embodiments, when the capture portion 321 is non-polygon (e.g., circular or spherical, etc.), a center axis of the capture portion 321 is aligned with the correction point 41; at that time, a focus of the image observation unit 22 falls on the surface of the carrier 12, that is, the focus of the image observation unit 22 is located on a side of the transparent bottom 121 of the carrier 12 facing the particle capture tool 32.
In one embodiment, the focus of the image observation unit 22 might slightly adjusted to be away from the surface of the carrier 12, or the focus of the image observation unit 22 might just fall on the surface of the carrier 12, and the mechanical arm 31 repetitively moves the capture portion 321 along the second Z axis b3 of the capture platform coordinate system B in accordance with the control of the terminal device 40. When the image observation unit 22 looks up to monitor that an acutance of the capture portion 321 reaches the highest, the terminal device 40 judges that the capture portion 321 falls on the focus of the image observation unit 22, and the terminal device 40 defines a coordinate position of the capture portion 321 on the second Z axis b3 of the capture platform coordinate system B as a corrected position of the capture portion 321 in relation to the image observation unit 22; when the capture portion 321 actually falls on the correction point 41, the terminal device 40 defines a coordinate position of the capture portion 321 on the second X axis b1 and the second Y axis b2 of the capture platform coordinate system B as a corrected position of the capture portion 321 in relation to the correction point 41; finally, a correction information of the capture portion 321 in the capture platform coordinate system B is recorded by the terminal device 40.
The present invention is to control the image observation unit 22 in a predetermined sequence to perform the fixed point displacement on the observation platform 20 in correspondence with each of the observation basic coordinates; then the terminal device 40 controls the capture portion 321 of the particle capture tool 32 to move and align with the position of the correction point 41 in the image of the view region 221 in accordance with the relative position of the image observation unit 22 located at one of the observation basic coordinates, so that the terminal device 40 records a relative position relationship between the observation platform coordinate system A and the capture platform coordinate system B, and at the same time the terminal device 40 records a relative coordinate z that the mechanical arm 31 drives the capture portion 321 of the particle capture tool 32 to move to each of the correction points 41. In this way, by calculating the relative coordinates z between the correction point 41 and the capture portion 321 of the particle capture tool 32 relative to the capture platform coordinate system B, an absolute position of the correction points 41 and the relative coordinate z that the particle capture tool 32 is required to correspondingly move could be obtained.
Referring to
In the current embodiment, the first magnification ratio used by the first image correction unit 11a is 2 times, and the second magnification ratio used by the second image correction units 11b, 11c is 10 times. A purpose of the first magnification ratio used by the first image correction unit 11a being less than the second magnification ratio used by each of the second image correction units 11b, 11c is to enable the first image correction unit 11a to have a larger image-capture region during in a process of initially taking images. It should be noted that the magnification ratio of the first image correction unit 11a, the magnification ratio of the second image correction unit 11b, and the magnification ratio of the other second image correction unit 11c could be respectively adjusted according to the demand, that is, the first image correction unit 11a, the second image correction unit 11b, and the other second image correction unit 11c are not limited to have the above mentioned magnification ratios.
Step S6: referring to
When the particle capture tool 32 is actually activated and operated, the particle capture tool 32 is controlled to move to a position coordinate pre-set in the capture platform coordinate system B, wherein the position coordinate is pre-set to correspond to the positioning reference point P where the capture portion 321 of the capture tool 32 correspondingly falls onto and which is formed by the camera focus of the first image correction unit 11a overlapping with the camera focus of each of the second image correction units 11b, 11c. However, in other embodiments, when a position of the mechanism is deviated due to the human factors or machine vibration and hence the particle capture tool 32 is not parallel to the second Z axis b3 of the capture platform coordinate system B or the capture platform 30 could not maintain the horizontal due to other possible conditions, the axis of the particle capture tool 32 would be caused to be not perpendicular to the second X axis b1 of the capture platform coordinate system B and second Y axis b2 of the capture platform coordinate system B, so that the capture portion 321 would not fall exactly on the positioning reference point P, and thus a corresponding relationship between the position coordinate of the particle capture tool 32 driven by the capture platform 30 and an actual position of the capture portion 321 would be deviated; when the particle capture tool 32 is shifted to the position coordinate and the capture portion 321 is deviated from the positioning reference point P, at that time the terminal device 40 could determine a deviation distance between the capture portion 321 and the positioning reference point P of each of the images of the first image correction unit 11a and the second image correction units 11b, 11c and calculate the deviation distance to form a deviation compensation value, so that the terminal device 40 could correspondingly adjust the position coordinate of the particle capture tool 32 in accordance with the deviation compensation value. In one embodiment, the terminal device 40 controls the mechanical arm 31 to move the particle capture tool 32, so that the capture portion 321 of the particle capture tool 32 is aligned with the positioning reference point P.
Referring to
But in other embodiments, the particle capture tool 32 might also be adjusted respectively through the images of the first image correction unit 11a and the second image correction units 11b, 11c so that the capture portion 321 of the particle capture tool 32 is positioned at the positioning reference point P. Referring to
The aforementioned correction for the capture platform coordinate system B and the actual position of the capture portion 321 is further described in the following. As shown in
In short, the mechanical arm 31 drives the capture portion 321 to shift, so that the capture portion 321 first falls onto the camera focus of the first image correction unit 11a, thereby causing the image of the capture portion 321 taken by the first image correction unit 11a to be located at the center and causing the acutance of the capture portion 321 to reach the maximum. The terminal device 40 records the coordinate position, which corresponds to the second X axis b1, of the capture portion 321 in the capture platform coordinate system B. By focusing the capture portion 321, an initial aligning and correction of the capture platform coordinate system B and the actual position of the capture portion 321 is completed.
Next, the second image correction unit 11b is used to take the image of the capture portion 321 in detail, i.e., the mechanical arm 31 is used to drive the capture portion 321 to shift, so that the capture portion 321 falls onto the camera focus of the second image correction unit 11b, thereby causing the image of the capture portion 321 taken by the second image correction unit 11b to be located at the center and causing the acutance of the capture portion 321 to reach the maximum. The terminal device 40 records the coordinate position, which corresponds to the second Y axis b2, of the capture portion 321 in the capture platform coordinate system B.
Then, the other second image correction unit 11c is used to take the image of the capture portion 321 in detail, i.e., the mechanical arm 31 is also used to drive the capture portion 321 to shift, so that the capture portion 321 falls onto the camera focus of the second image correction unit 11c, thereby causing the image of the capture portion 321 taken by the other second image correction unit 11c to be located at the center and causing the acutance of the capture portion 321 to reach the maximum. The terminal device 40 records the coordinate position of the capture portion 321 on the second X axis b1, the coordinate position the capture portion 321 on the second Y axis b2, and the coordinate position of the capture portion 321 on the second Z axis b3 in the capture platform coordinate system B. By focusing the capture portion 321 in detail, the correction of the capture platform coordinate system B and the actual position of capture portion 321 is completed to achieve a purpose of platform correction.
Hence, if when discrepancy occurs in the carrier platform 10 or the capture platform 30 of the biological particle capture device as a result of installation or other factors, regression, aligning, and correction could be completed at any time by using the correction way of the capture platform coordinate system B and the actual position of the capture portion 321 in the current embodiment. Furthermore, by the correction way of the capture platform coordinate system B and the actual position of the capture portion 321 in the current embodiment, when the particle capture tool 32 is replaced, the particle capture function would not be affected by the capture platform coordinate system B being not in correspondence with the actual position of the capture portion 321, which is caused by different thicknesses of different materials used or by a tolerance of the materials due to production, In the current embodiment, the terminal device 40 could also record a first spatial vector in the second X axis b1, a second spatial vector in the second Y axis b2, and a third spatial vector in the second Z axis b3 that the particle capture tool 32 moves in the capture platform coordinate system B.
In one embodiment, the capture platform coordinate system B correspondingly moves to an area where the first image correction unit 11a and the second image correction units 11b, 11c could take the images by the mechanical arm 31 driving the capture portion 321 of the particle capture tool 32; in other words, the relative position between the mechanical arm 31 and the particle capture tool 32 could be corrected when the capture portion 321 falls on the positioning reference point P.
In other embodiments, Step S5 and Step S6 could be adjusted as needed to precede the aforementioned Step S1, that is, a positional relationship between the capture portion 321 of the particle capture tool 32 and the positioning reference point P of the first image correction unit 11a and the second image correction units 11b, 11c could be adjusted first; a positional relationship between the capture portion 321 of the particle capture tool 32 and the image observation unit 22 would be corrected later.
Referring to
Step S8: the terminal device 40 simulates a virtual correction region 42 in the view region of the image observation unit 22 based on the correction basic coordinates t1˜t4, wherein a position of the particle G correspondingly falls into the virtual correction region 42. Referring to
Step S9: the terminal device 40 simulates a first extension axis g1 and a second extension axis g2 based on the position of the particle G, wherein the first extension axis g1 and the first absolute X coordinate axis x1 in the virtual correction region 42 perpendicularly intersect to acquire a first joint X coordinate; the first extension axis g1 and the second absolute X coordinate axis x2 in the virtual correction region 42 perpendicularly intersect to acquire a second joint X coordinate; the second extension axis g2 and the first absolute Y coordinate axis y1 in the virtual correction region 42 perpendicularly intersect to acquire a first joint Y coordinate; the second extension axis g2 and the second absolute Y coordinate axis y2 in the virtual correction region 42 perpendicularly intersect to acquire a second joint Y coordinate.
Step S10: the mechanical arm 31 is controlled to drive the particle capture tool 32 to correspondingly move to the position of the particle G, wherein the terminal device 40 takes the first joint X coordinate, the second joint X coordinate, the first joint Y coordinate, and the second joint Y coordinate, and uses a specific conditional formula to obtain a relative capture coordinate (Px,Py) that the particle capture tool 32 is required to correspondingly move. The specific conditional formula is as follows:
Calculation of Px coordinate value:
Calculation of Py coordinate value:
The denotations in the above mentioned conditional formula are as follows:
For example, when the image observation unit 22 discovers a particle G in the virtual correction region 42 of the carrier 12, each of the correction points 41 of the virtual correction region 42 at the corresponding correction basic coordinates t1˜t4 and the capture portion 321 relatively located at the relative coordinates z1˜z4 of the capture platform coordinate system B are recorded in the terminal device 40 as shown in the table below:
In addition, the position of the particle G in the virtual correction region 42, i.e., a coordinate value (x,y) of the particle G on the carrier 12, calculated through simulating the first extension axis g1 and the second extension axis g2 is (16,18), so that the Px coordinate value and the Py coordinate value could be calculated by using the above mentioned conditional formula as follows:
Calculation of Px coordinate value:
Calculation of Py coordinate value:
In this way, the terminal device 40 could drive the mechanical arm 31 to move the particle capture tool 32 to the relative capture coordinate (37.8, 37.4) of the capture platform coordinate system B to capture the particle G at the correction basic coordinate (x,y) of (16, 18) through the (Px,Py) calculated by the above mentioned conditional formula.
In other words, in the present invention, the terminal device 40 records the correction basic coordinates t1˜t4 of the carrier 12 and then takes the image through the image observation unit 22 to obtains the relative coordinates z1˜z4 of the capture platform coordinate system B. The terminal device 40 could use the aforementioned conditional formula to calculate the relative capture coordinate (Px,Py) of the capture platform coordinate system B that is required to capture the particle G, and then the terminal device 40 accurately controls the mechanical arm 31 to drive the particle capture tool 32 to capture the particle G. It should be noted in particular that the current embodiment is illustrated with one virtual correction region 42 and four correction points 41 as an example, but not limited thereto. The more the virtual correction region 42 and the more the corresponding correction points 41 are provided, the more accurate the correction is, but the longer the correction time is. In order to ensure the correction accuracy and the time cost, the number of different virtual correction regions 42 and a spacing distance between the virtual correction regions 42 could be adjusted based on demand during each correction process to achieve the best correction result.
When the particle capture tool 32 has completed a particle capture operation, the mechanical arm 31 moves the particle capture tool 32 to a waste collection area (not shown) for disposal. The mechanical arm 31 is then moved to a capture tool area (not shown) to install a new particle capture tool 32, and Steps S1 to S4 are repeated for correction. More specifically, after the particle capture tool 32 has completed the particle capture operation and the mechanical arm 31 moves the particle capture tool 32 to the waste collection area (not shown) for disposal, the relative position between the observation platform coordinate system A and the capture platform coordinate system B remain unchanged, so that there is no need to carry out the corrections of steps S3 to S4 again.
With the design of the present invention, the image observation unit 22 faces the carrier platform 10 to take the image, and the image observation unit 22 performs the fixed point displacement on the observation platform 20 in correspondence with each of the observation basic coordinates. The terminal device 40 defines the correction point 41 based on the image of the view region 221 of the image observation unit 22, controls the capture portion 321 of the particle capture tool 32 to enter the view region 221 of the image observation unit 22 and adjusts the capture portion 321 of the particle capture tool 32 to align with the correction point 41, and records the capture correction coordinate of the capture portion 321. Thus the relative position correction between the image observation unit 22 on the observation platform 20 and the particle capture tool 32 on the capture platform 30 is completed, and the capture correction coordinates are established on the capture platform coordinate system B. Then, in Steps S5 and S6, the positional relationship between the capture portion 321 of the particle capture tool 32 and the positioning reference point P is corrected by the first image correction unit 11a and second image correction units 11b, 11c with different magnification ratios.
In Step S4, the capture portion 321 of the particle capture tool 32 is repeatedly aligned with each of the correction points 41 to complete the relative position correction between the observation platform coordinate system A and the capture platform coordinate system B. In this way, when the image observation unit 22 detects a biological particle at a certain position of the carrier 12, the terminal device 40 could control the mechanical arm 31 to drive the particle capture tool 32 to an accurate position according to the capture platform coordinate system B to accurately capture the detected the biological particle on the carrier 12.
In this way, the method of the current embodiment could reduce the deviation of the relative position between the particle capture tool 32 and the carrier 12 by using the multi-point correction way, thereby improving the accuracy of the particle capture tool 32 in capturing the biological particles. At the same time, in the mechanism design in the current technical field, it is extremely difficult to ensure that the carrier platform 10 and the capture platform 30 are completely parallel, that is, there might exist a certain deviated angle between the carrier platform 10 and the capture platform 30, so that the capture portion 321 would not fall exactly onto the positioning reference point P and hence a deviation of the corresponding relationship between the position coordinate of the particle capture tool 32 driven by the capture platform 30 and the actual position of the capture portion 321 would be resulted. With Steps S5 and S6 of the correction method of the current embodiment, the terminal device 40 integrally determines the deviation distance between the positioning reference point P among the images of the first image correction unit 11a and the second image correction units 11b, 11c and the capture portion 321 and calculates the deviation distance as the deviation compensation value, so that the terminal device 40 could correspondingly adjust the position coordinate of the particle capture tool 32 according to the deviation compensation value. Furthermore, if the accuracy of capturing the biological particles by the particle capture tool 32 of the capture platform 30 is lower due to machine transportation or human collision, a relationship between the observation platform 20 and the capture platform 30 could be automatically corrected through the correction method of the current embodiment, so that the problem of disassembling the machine or manually adjusting the machine could be avoided, thereby increasing the correction efficiency.
It must be pointed out that the embodiments described above are only some preferred embodiments of the present invention. All equivalent structures which employ the concepts disclosed in this specification and the appended claims should fall within the scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 112139790 | Oct 2023 | TW | national |