Patent Application
20100079757
The present application claims priority from a Japanese Patent Application No. 2008-255585 filed on Sep. 30, 2008.
1. Technical Field
The present invention relates to an unevenness detecting apparatus, a method, and a computer readable medium.
2. Related Art
Japanese Patent Application Publication No. 10-165357 discloses a technique for enabling a user to judge whether an uneven portion is present by shadows generated from light emitted to be diagonally incident to the uneven portion.
With the technology disclosed in JP 10-165357, a judgment as to the degree of unevenness and a judgment as to which portions are convex or concave are made by a user based on shadows, and so there is a concern that an uneven portion might go unnoticed if the user has poor judging ability.
Therefore, it is an object of an aspect of the innovations herein to provide an unevenness detecting apparatus, a method, and a computer readable medium, which is capable of overcoming the above drawbacks accompanying the related art. The above and other objects can be achieved by combinations described in the independent claims. The dependent claims define further advantageous and exemplary combinations of the innovations herein.
According to a first aspect related to the innovations herein, one exemplary unevenness detecting apparatus may comprise a determining section that determines a polarization state of returned light obtained from radiated light; an uneven portion judging section that judges whether an uneven portion is present based on the polarization state determined by the determining section; a convex/concave identifying section that identifies whether the uneven portion is convex or concave based on image data, captured by an image capturing element, of the uneven portion; and an output section that outputs information identifying whether the uneven portion is convex or concave.
According to a second aspect related to the innovations herein, one exemplary method may include a method for judging presence of an uneven portion using a computer, comprising: determining a polarization state of returned light obtained from radiated light; judging whether the uneven portion is present based on the determined polarization state; identifying whether the uneven portion is convex or concave based on image data, captured by an image capturing element, of the uneven portion; and outputting information that identifies whether the uneven portion is convex or concave.
According to a second aspect related to the innovations herein, one exemplary computer readable medium may include a computer readable medium storing thereon a program that, when executed, causes a computer to function as a determining section that determines a polarization state of returned light obtained from radiated light; an uneven portion judging section that judges whether an uneven portion is present based on the polarization state determined by the determining section; a convex/concave identifying section that identifies whether the uneven portion is convex or concave based on image data, captured by an image capturing element, of the uneven portion; and an output section that outputs information identifying whether the uneven portion is convex or concave.
The summary clause does not necessarily describe all necessary features of the embodiments of the present invention. The present invention may also be a sub-combination of the features described above. The above and other features and advantages of the present invention will become more apparent from the following description of the embodiments taken in conjunction with the accompanying drawings.
Hereinafter, some embodiments of the present invention will be described. The embodiments do not limit the invention according to the claims, and all the combinations of the features described in the embodiments are not necessarily essential to means provided by aspects of the invention.
The endoscope 101 includes a clamp port 111, an image capturing section 112, a light guide 113, and a light guide 114. The tip 121 of the endoscope 101 includes a lens 131 as a portion of the image capturing section 112 on a tip surface 130 thereof. The tip 121 includes an irradiation aperture 132 as a portion of the light guide 113 on the tip surface 130 thereof. The light guide 114 is a portion of the endoscope 101, and the tip of the light guide 114 is provided inside a separable section 122 that can be separated from the tip 121 of the endoscope 101.
One end of the separable section 122 is rotatably mounted on the tip 121 of the endoscope 101, and the other end of the separable section 122 has the irradiation aperture 134 as a portion of the light guide 114. The separable section 122 has the irradiation aperture 134 on a side surface thereof. The separable section 122 is provided with the irradiation aperture 134 such that light emitted from the second irradiating section 104 is radiated toward the tip 121 of the endoscope 101. The separable section 122 is usually in a closed state, that is, a state in which the angle between the separable section 122 and the tip 121 is 0 degrees.
The first irradiating section 103 generates the light emitted from the tip 121 of the endoscope 101. The first irradiating section 103 includes a light source for generating the light. The light guide 113 may be made of optical fiber, for example. The light guide 113 guides the light emitted from the first irradiating section 103 to the tip 121 of the endoscope 101. The light generated by the first irradiating section 103 is emitted from the irradiation aperture 132. The first irradiating section 103 generates circularly polarized light. The light guide 113 maintains the polarized state of the light generated by the first irradiating section 103 to emit circularly polarized light from the irradiation aperture 132. Instead, the first irradiating section 103 may generate non-polarized light and a circular polarization filter that passes circularly polarized light may be provided to the irradiation aperture 132, so that the irradiation aperture 132 emits circularly polarized light. Here, unless explicitly stated otherwise, the first irradiating section 103 is assumed to emit light perpendicular to a subject, which is at an observed position.
The second irradiating section 104 generates the light emitted from the separable section 122 of the endoscope 101. The second irradiating section 104 includes a light source for generating the light. The light guide 114 may be made of optical fiber, for example. The light guide 114 guides the light emitted from the second irradiating section 104 to the separable section 122 of the endoscope 101. The light generated by the second irradiating section 104 is emitted from the irradiation aperture 134. The second irradiating section 104 controls the opening angle of the separable section 122. The second irradiating section 104 also controls the length of the separable section 122. More specifically, the separable section 122 includes a motor for changing the opening angle, and the second irradiating section 104 includes a motor control section for controlling this motor. Accordingly, this motor control section controls the opening angle. The separable section 122 has a structure that allows for length extension, and includes a motor for changing the length. The second irradiating section 104 includes a motor control section that controls this motor. The motor control section may be formed from an information processing apparatus such as a CPU. In this way, the second irradiating section 104 can irradiate the uneven portion with light that is diagonally incident thereto.
A clamp 106 is inserted into the clamp port 111, and the clamp port 111 guides the clamp 106 to the tip 121. The clamp 106 may be shaped as any type of tip. In addition to the clamp 106, various other tools for performing processes on an organism may be inserted into the clamp port 111. The nozzle 133 ejects water or air.
The image capturing section 112 includes an image capturing element and an optical system. The optical system includes the lens 131 and a polarizing section. The polarizing section includes a plurality of first polarization filters and second polarization filters, which linearly polarize light in directions orthogonal to each other. These first and second polarization filters are arranged in a lattice formation. The polarizing section may also include polarization filters with a polarization direction different from the linear polarization of the first and second polarization filters. The first and second polarization filters may be provided to correspond respectively to pixels in the image capturing element. In other words, the light passing through one polarization filter may be received by one pixel. The image capturing element captures an image based on the light passed by the polarizing section. The image capturing section 112 also includes an image capturing element driver for driving the image capturing element, an AD converter, and the like. The image data captured by the image capturing element is read by the image capturing element driver and converted into a digital signal by the AD converter.
The image capturing section 112 captures returned light, which is light emitted from the irradiation aperture 132 and/or the irradiation aperture 134 and reflected at the observed position. The image processing section 102 processes the image captured by the image capturing section 112. The image processing section 102 identifies a region of the uneven portion or the like in the captured image, and displays this region in the display section 105. The display section 105 includes a display, such as a liquid crystal display.
Here, when the angle of incidence of the circularly polarized light relative to a flat surface is 90 degrees, the returned light becomes circularly polarized light. When the angle of incidence is not 90 degrees, the returned light becomes elliptically polarized light. The smaller the angle of incidence of the circularly polarized light to the flat surface, the greater the ellipticity of the elliptically polarized returned light. Accordingly, the polarization state of the returned light can be determined using the first and second polarization filters having polarization directions orthogonal to each other. For example, when the amount of light passed by the first polarization filter is equal to the amount of light passed by the second polarization filter, the polarization state of the returned light is circular. On the other hand, when the amount of light passed by the first polarization filter is not equal to the amount of light passed by the second polarization filter, the polarization state of the returned light is elliptical. The greater the difference between the amount of light passed by the first polarization filter and the amount of light passed by the second polarization filter, the greater the ellipticity of the elliptically polarized returned light.
The uneven portion judging section 142 judges whether there is an uneven portion based on the polarization state of the returned light determined by the determining section 141. The uneven portion judging section 142 may also judge whether a certain region has an uneven portion, based on the polarization state of the returned light from each region determined by the determining section 141. Since the polarization state of the returned light changes according to the inclination angle of the observed position relative to the incidence of the circularly polarized light, when circularly polarized light is perpendicularly incident to the observed position, an incline is judged to be present in a region from which the returned light is elliptically polarized, and so this region is judged to contain an uneven portion. Here, if the a region is judged to be uneven when the returned light differs only slightly from the circular polarization, there is a concern that substantially flat portions may be mistakenly judged to be uneven portions, and so a region is judged to be uneven only if the ellipticity for that region is greater than a set value. Here, an “uneven portion” refers to a portion with a depressed portion or with a protruding portion.
The uneven portion judging section 142 may store a table that associates polarization states with angles, and use this table to obtain the inclination angle of the observed position based on the polarization state determined by the determining section 141. Instead, the uneven portion judging section 142 may calculate the inclination angle of the observed position based on the determined polarization state. In this way, the uneven portion judging section 142 can obtain the inclination angle of the surface. The degree of unevenness of the uneven portion can be obtained from the polarization state of the returned light or the inclination angle of the observed position, and so, in the present embodiment, the polarization state of the returned light, the ellipticity of the polarization of the returned light, and the inclination angle of the observed position are all referred to as the degree of unevenness. The degree of unevenness represents the degree to which the surface protrudes or recedes. The uneven portion judging section 142 outputs, to the second irradiating section 104, the degree of unevenness of a region that is judged to be an uneven portion. The uneven portion judging section 142 outputs the region judged to be the uneven portion to the convex/concave identifying section 143 and the display control section 144.
The second irradiating section 104 irradiates the uneven portion with light at an angle according to the degree of unevenness of the uneven portion as judged by the uneven portion judging section 142. The angle according to the degree of unevenness is a relative measurement using the angle of incidence relative to a flat portion as a standard. In other words, the opening angle and length of the separable section 122 are controlled based on the unevenness of the region judged to be uneven by the uneven portion judging section 142, in order to diagonally irradiate this uneven portion with light. The second irradiating section 104 may store the table in which is recorded the length and opening angle corresponding to the degree of unevenness, and control the length and opening angle of the separable section 122 based on the degree of unevenness received from the uneven portion judging section 142. The second irradiating section 104 may instead calculate the length and opening angle of the separable section 122 based on the degree of unevenness received from the uneven portion judging section 142, and control the length and opening angle to be the calculated values. The image capturing section 112 captures an image based on the returned light resulting from the second irradiating section 104 diagonally radiating light to the portion judged to be uneven by the uneven portion judging section 142, and the captured image is then sent to the convex/concave identifying section 143. At this time, the image capturing may be performed with the polarizing section provided to the image capturing element being removed from the path of the light incident to the image capturing element. In this case, the polarizing section of the image capturing section 112 is configured to be able to move from the path of the light. In this way, non-polarized light is incident to the image capturing element.
The convex/concave identifying section 143 identifies whether the portion judged to be uneven by the uneven portion judging section 142 is convex or concave, based on the image captured when the second irradiating section 104 diagonally radiates light to the uneven portion. More specifically, the convex/concave identifying section 143 identifies whether the uneven portion is convex or concave based on a light-dark state of the uneven portion in the image. The convex/concave identifying section 143 can make this identification because the formation of shadows is different for a concave portion than for a convex portion when diagonally irradiated with light. The convex/concave identifying section 143 outputs the convex or concave identification to the display control section 144. The display control section 144 is one example of an output section that outputs information identifying whether the uneven portion is convex or concave. The output section may output the information identifying whether the uneven portion is convex or concave to the outside of the image processing section 102. The output section may output information identifying whether the uneven portion is convex or concave to the outside of the unevenness detecting apparatus 100. The output section may output a signal indicating whether the uneven portion is convex or concave.
The display control section 144 displays the image captured by the image capturing section 112 in the display section 105. If the uneven portion judging section 142 judges that there is an uneven portion, the display control section 144 may display the image such that the uneven portion is identifiable. In this way, a user can easily see where an uneven portion is. If the convex/concave identifying section 143 identifies the uneven portion as being convex or concave, the display control section 144 may display whether the identified uneven portion is convex or concave. In this way, the user can easily know whether the uneven portion is convex or concave.
However, since the polarization state only changes depending on the angle of incidence of the light to the observed position, a judgment can be made based on the polarization state as to whether there is an uneven portion, but it cannot be ascertained whether this uneven portion is convex or concave. That is, by simply radiating circularly polarized light, the returned light for the convex portion and the returned light for the concave portion shown in
The convex or concave identification may indicate a convex portion when a portion closer to the irradiation aperture 134 of the separable section 122 is light and a portion further from the irradiation aperture 134 is dark. The convex or concave identification may indicate a concave portion when a portion closer to the irradiation aperture 134 of the separable section 122 is dark and a portion further from the irradiation aperture 134 is light.
Depending on the form of the recess or protrusion in the uneven portion, it might be impossible to create shadows merely by radiating the light diagonally. For example, in the case of a very small recess or protrusion, shadows might not be formed if the light has an angle of incidence of approximately 45 degrees. As another example, in the case of a very large recess or protrusion, radiating the light to have an angle of incidence of approximately 25 degrees might result in the shadowy region being too large, which is unsuitable for the judgment. To solve this problem, the second irradiating section 104 changes the length and opening angle of the separable section 122 to diagonally radiate light at an angle according to the degree of unevenness of the portion judged to be uneven by the uneven portion judging section 142, so that an image with suitable light and dark portions can be obtained.
When the first irradiating section 103 radiates light and the image capturing section 112 captures the image used by the uneven portion judging section 142 to judge whether an uneven portion is present, the second irradiating section 104 need not radiate light. When the second irradiating section 104 radiates light and the image capturing section 112 captures the image used by the convex/concave identifying section 143 to judge whether the uneven portion is convex or concave, the first irradiating section 103 need not radiate light. When the image capturing section 112 captures the image used by the convex/concave identifying section 143 to judge whether the uneven portion is convex or concave, the first irradiating section 103 may radiate less light than the second irradiating section 104. As a result, it is easier to form shadows in the uneven portion.
After the convex/concave identifying section 143 judges whether the uneven portion is convex or concave, the second irradiating section 104 may stop radiating light. In this case, the first irradiating section 103 radiates light. Instead of stopping light radiation, the second irradiating section 104 may radiate less light than the first irradiating section 103. Causing the irradiating section 104 to radiate less or no light is beneficial because it prevents the shadows formed on the uneven portion from becoming too weak, which would cause precise observation to become more difficult. When the convex/concave identifying section 143 identifies whether the uneven portion is convex or concave, the first irradiating section 103 may radiate non-polarized light. As an example of a configuration for radiating polarized and non-polarized light, the light source in the first irradiating section 103 may be provided with a polarization filter that passes circularly polarized light. The polarizing filter may positioned in the path of the light emitted by the light source to generate circularly polarized light, and may be removed from the path of the light emitted by the light source to generate non-polarized light.
As shown in
The display control section 144 may reproduce the shape of the uneven portion based on the angle of incidence at the uneven portion determined by the uneven portion judging section 142 and the convex/concave identification by the convex/concave identifying section 143, and display the reproduced shape in the display section 105. In this way, the user can see the shape of the uneven portion.
As described above, the present embodiment can easily determine whether an uneven portion is present based on the polarization of returned light obtained from radiated circularly polarized light. The present embodiment can easily identify whether the uneven portion is convex or concave based on shadows formed by diagonally radiating light on the uneven portion. The present embodiment can generate suitable shadows in the uneven portion by diagonally radiating the light at an angle corresponding to the unevenness of the uneven portion. The present invention enables a user to easily identify a region containing an uneven portion by displaying the uneven portion in an identifiable manner in the captured image. The present embodiment enables the user to easily identify whether the uneven portion is convex or concave by displaying information indicating whether the uneven portion is convex or concave. Each component described in the present embodiment, such as the image capturing section 112 and the like, may be controlled by a computer or an information processing apparatus such as a CPU or the like. The image processing section 102 may be realized as an electronic circuit, or may be realized as an information processing apparatus such as a CPU.
The embodiment described above may be modified in the following ways.
(1) In a first modification, light may be emitted from a side of the tip 121 of the endoscope 101, without providing the separable section 122.
(2) A second modification is not provided with the separable section 122 or the second irradiating section 104.
More specifically, the second modification acquires the polarization state of the returned light from each region. A range over which regions are gathered having returned light with substantially identical polarization states is judged to be flat, and a region for which the polarization state of the returned light differs from that of the returned light from a flat region is judged to contain an uneven portion. Since the angle of incidence is known based on the polarization state of the returned light in each region, a region including the uneven portion may be determined based on the overall angle of incidence. In other words, a range over which regions are gathered having substantially identical angles of incidence may be judged to be flat, and a region for which the angle of incidence differs from that of the flat region may be judged to contain an uneven portion. The uneven portion can be identified as being convex or concave based on the light-dark state of the region determined to contain an uneven portion. For example, the uneven portion may be identified as convex when the region containing the uneven portion has a distribution that changes from light to dark, in the stated order, in a direction of the path of the diagonally radiated light. The uneven portion may be identified as concave when the region containing the uneven portion has a distribution that changes from dark to light, in the stated order, in a direction of the path of the diagonally radiated light. In this way, the second modification has a simpler configuration, resulting in lower manufacturing cost.
(3) A third modification addresses a problem that, when the area of the uneven portion irradiated with light by the second irradiating section 104 is small relative to the total area of the uneven portion, it is difficult to identify whether the uneven portion is convex or concave based on a single image captured using light irradiating a certain position. The third modification may move the irradiated position, capture a plurality of images at different irradiated positions, and use the plurality of images to identify whether the uneven portion is convex or concave. In other words, the irradiated position, which the position in the observed position at which the second irradiating section 104 radiates light, is moved, and the convex/concave identification is then made based on the light-dark state in a plurality of images captured at different irradiated positions. When the area of the uneven portion irradiated with light by the first irradiating section 103 is small relative to the total area of the uneven portion, it is difficult to identify whether the uneven portion is convex or concave based on a single image captured using light irradiating a certain position. Therefore, the third modification moves the irradiated position and identifies whether the uneven portion is convex or concave based on a plurality of images captured at different irradiated positions.
(4) In the above embodiments, the first irradiating section 103 radiates circularly polarized light, but in a fourth modification, the first irradiating section 103 may radiate light with different polarization. In other words, the first irradiating section 103 may radiate any one type of light from among non-polarized light, elliptically polarized light, and linearly polarized light. The uneven portion judging section 142 may determine whether an uneven portion is present based on the polarization state of the returned light obtained from the light radiated by the first irradiating section 103. That is, the uneven portion judging section 142 may determine whether an uneven portion is present based on the polarization state of the returned light obtained from the non-polarized light, elliptically polarized light, or linearly polarized light radiated by the first irradiating section 103.
(5) A fifth modification may be a combination of the first and third modifications, or of the second and third modifications. The fifth modification may be a combination of (i) any one of the first through third modifications and (ii) the fourth modification.
While the embodiments of the present invention have been described, the technical scope of the invention is not limited to the above described embodiments. It is apparent to persons skilled in the art that various alterations and improvements can be added to the above-described embodiments. It is also apparent from the scope of the claims that the embodiments added with such alterations or improvements can be included in the technical scope of the invention.
The operations, procedures, steps, and stages of each process performed by an apparatus, system, program, and method shown in the claims, embodiments, or diagrams can be performed in any order as long as the order is not indicated by “prior to,” “before,” or the like and as long as the output from a previous process is not used in a later process. Even if the process flow is described using phrases such as “first” or “next” in the claims, embodiments, or diagrams, it does not necessarily mean that the process must be performed in this order.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2008-255585 | Sep 2008 | JP | national |
