This U.S. Patent Application claims Priority under 35 U.S.C. § 119 to: Indian Provisional Patent Application No. 202121061180, filed on Dec. 28, 2021. The entire contents of the aforementioned application are incorporated herein by reference.
The disclosure herein generally relates to the field of characterization of transparent objects, and, more particularly, to a method and system for Mueller Matrix polarimetric characterization of transparent objects based on polarization properties and optical properties.
Objects made from transparent materials, such as glass and clear fiber, are commonly referred as transparent objects. These transparent objects, such as glass panels, lenses, fluorescent light bulbs, reflective surfaces are quite useful in everyday life. Further the transparent objects are extremely crucial in a wide range of scientific and manufacturing applications, and new ways to leverage them are being developed consistently. Various types of defects can occur during production of the transparent objects, which can adversely impact on its function and use. Defects or failures in products that appear during customer application are also undesirable because they spoil the products image. These defects are unacceptable because they have significant economic impact, as they reduce yield of manufacturing articles, resulting revenue loss. Hence it is important to identify any defects in the transparent objects. Characterization of the transparent objects is a process to identify and localize defects, such as manufacturing defect, aberration, inclusion of an impurity such as bubble or dust, thickness differences, and thereof in the transparent objects.
Existing techniques for the characterization of the transparent objects using simple intensity-based imaging techniques, such as RGB cameras is highly challenging. The characterization of the transparent object is performed by illuminating light on to the transparent object and further processing the reflected light from the transparent object. Properties of the reflected light captured by the RGB cameras are not significant enough to characterize the transparent objects. Besides this, the transparent objects are characterized using Mueller Matrix polarization techniques. When a polarization light passes through the transparent objects, the transparent objects polarization properties get effected. Furthermore, these polarization properties are used to characterize the transparent objects. However, the existing Mueller Matrix polarization techniques that rely only on the fundamental polarization properties are insufficient for characterizing the transparent objects.
Embodiments of the present disclosure present technological improvements as solutions to one or more of the above-mentioned technical problems recognized by the inventors in conventional systems. For example, in one embodiment, a method for Mueller Matrix polarimetric characterization of transparent objects based on polarization properties and optical properties is provided. The method comprises receiving a plurality transformed polarization states for a transparent object to be characterized, wherein the plurality transformed polarization states are recorded by a polarization camera when a polarized light of a plurality of known polarization states is incident onto the transparent object. Further, the method comprises estimating a plurality of Mueller Matrix image elements by observing a change in the plurality of transformed polarization states while the polarized light propagates through the transparent object to form a Mueller Matrix. Furthermore, the method comprises computing a plurality of polarization properties of the transparent object by decomposing the Mueller Matrix as product of three elementary matrices comprising, a depolarizer (MΔ), a retarder (MR), and a diattenuator (MD), wherein the plurality of polarization properties comprising a diattenuation (δ), a retardance (r), a depolarization (Δ), and an optical birefringence (ΔN). Furthermore, the method comprises computing a plurality of optical properties, of the transparent object from the decomposed Mueller Matrix, wherein the plurality of the optical properties comprise a material refractive index (n) and a material attenuation index (µa). The material refractive index (n) is determined from a first element of the Mueller Matrix M(1,1) using Fresnel’s law-based analysis, which represents a total intensity of the polarization light; and the material attenuation index (µa) is determined by processing the first element M (1,1) representing the total intensity of the polarization light by using a reverse Monte Carlo technique. Further, the method comprises characterizing the transparent object via an Artificial Intelligence (AI) model executed by the one or more hardware processors, during inferencing stage, wherein the characterizing of the transparent object is based on the computed plurality of polarization properties and the computed plurality of optical properties, and wherein to the AI model is pretrained with gold standard polarization properties and gold standard optical properties of transparent objects.
In another aspect, a system for Mueller Matrix polarimetric characterization of transparent objects based on polarization properties and optical properties is provided. The system comprises a memory storing instructions; one or more Input/Output (I/O) interfaces; and one or more hardware processors coupled to the memory via the one or more I/O interfaces, wherein the one or more hardware processors are configured by the instructions receive a plurality transformed polarization states for a transparent object to be characterized, wherein the plurality transformed polarization states are recorded by a polarization camera when a polarized light of a plurality of known polarization states is incident onto the transparent object. Further, the one or more hardware processors are configured to estimate a plurality of Mueller Matrix image elements by observing a change in the plurality of transformed polarization states while the polarized light propagates through the transparent object to form a Mueller Matrix. Furthermore, the one or more hardware processors are configured to compute a plurality of polarization properties of the transparent object by decomposing the Mueller Matrix as product of three elementary matrices comprising, a depolarizer (MΔ), a retarder (MR), and a diattenuator (MD), wherein the plurality of polarization properties comprising a diattenuation (δ), a retardance (r), a depolarization (Δ), and an optical birefringence (ΔN). Furthermore, the one or more hardware processors are configured to compute a plurality of optical properties, of the transparent object from the decomposed Mueller Matrix, wherein the plurality of the optical properties comprise a material refractive index (n) and a material attenuation index (µa). The material refractive index (n) is determined from a first element of the Mueller Matrix M(1,1) using Fresnel’s law-based analysis, which represents a total intensity of the polarization light; and the material attenuation index (µa) is determined by processing the first element M (1,1) representing the total intensity of the polarization light by using a reverse Monte Carlo technique. Further, the one or more hardware processors are configured to characterize the transparent object via an Artificial Intelligence (AI) model executed by the one or more hardware processors, during inferencing stage, wherein the characterizing of the transparent object is based on the computed plurality of polarization properties and the computed plurality of optical properties, and wherein to the AI model is pretrained with gold standard polarization properties and gold standard optical properties of transparent objects.
In yet another aspect, there are provided one or more non-transitory machine-readable information storage mediums comprising one or more instructions, which when executed by one or more hardware processors causes a method for Mueller Matrix polarimetric characterization of transparent objects based on polarization properties and optical properties is provided. The method comprises receiving a plurality transformed polarization states for a transparent object to be characterized, wherein the plurality transformed polarization states are recorded by a polarization camera when a polarized light of a plurality of known polarization states is incident onto the transparent object. Further, the method comprises estimating a plurality of Mueller Matrix image elements by observing a change in the plurality of transformed polarization states while the polarized light propagates through the transparent object to form a Mueller Matrix. Furthermore, the method comprises computing a plurality of polarization properties of the transparent object by decomposing the Mueller Matrix as product of three elementary matrices comprising, a depolarizer (MΔ), a retarder (MR), and a diattenuator (MD), wherein the plurality of polarization properties comprising a diattenuation (δ), a retardance (r), a depolarization (Δ), and an optical birefringence (ΔN). Furthermore, the method comprises computing a plurality of optical properties, of the transparent object from the decomposed Mueller Matrix, wherein the plurality of the optical properties comprise a material refractive index (n) and a material attenuation index (µa). The material refractive index (n) is determined from a first element of the Mueller Matrix M(1,1) using Fresnel’s law-based analysis, which represents a total intensity of the polarization light; and the material attenuation index (µa) is determined by processing the first element M (1,1) representing the total intensity of the polarization light by using a reverse Monte Carlo technique. Further, the method comprises characterizing the transparent object via an Artificial Intelligence (AI) model executed by the one or more hardware processors, during inferencing stage, wherein the characterizing of the transparent object is based on the computed plurality of polarization properties and the computed plurality of optical properties, and wherein to the AI model is pretrained with gold standard polarization properties and gold standard optical properties of transparent objects.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and, together with the description, serve to explain the disclosed principles:
It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems and devices embodying the principles of the present subject matter. Similarly, it will be appreciated that any flow charts, flow diagrams, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Exemplary embodiments are described with reference to the accompanying drawings. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. Wherever convenient, the same reference numbers are used throughout the drawings to refer to the same or like parts. While examples and features of disclosed principles are described herein, modifications, adaptations, and other implementations are possible without departing from the scope of the disclosed embodiments. It is intended that the following detailed description be considered as exemplary only, with the true scope being indicated by the following claims.
Existing Mueller Matrix polarization techniques that rely only on the fundamental polarization properties are insufficient for accurate characterization of transparent objects. Polarization parameters give the orientation of the electric and magnetic field components which may not change with the defects in the transparent object such as density deformity, crystal structure defect etc. which additionally need optical analysis to accurately characterize the object with corresponding defects. The embodiments of the present disclosure provide a method and system for Mueller Matrix polarimetric characterization of a transparent object using optical properties along with the polarization properties to accurately characterize the transparent object. The polarization properties are derived from a decomposed Mueller matrix element, well known in the art. The polarization properties includes, a diattenuation (δ), a retardance (r), a depolarization (Δ), an optical birefringence (Δn). Additionally. the method derives the optical properties by further subjecting the decomposed Mueller matrix element to Fresnel’s law-based analysis and a reverse Monte Carlo analysis to extract optical properties such as a material refractive index and a material attenuation index respectively. The material refractive index and the material attenuation index vary with changes in the material property caused due to several factors such as manufacturing defect, aberration, inclusion of an impurity such as bubble or dust etc. Attenuation index is an indicative of the attenuation of light while passing through the object. Defects present in the coating change the structural characteristics of the sample, causing the light to travel in different speed than normal. For example, if there is a crack present in the transparent object, there will be air present in that cracked region. In usual case, light would travel only through the object whereas in the cracked one, light also will travel through air. The speed of light is different in air and the sample object that would result in different attenuation of light. This attenuation is directly measured by the material attenuation index or coefficient by the method disclosed herein, reflecting the presence of the defect. Thus, considering the optical properties along with the polarization properties enables accurate characterization of the transparent object with enhance reliability in process on material characterization.
There are references in literature to derive refractive index from Mueller Matrix for material characterization, however, the method discloses a new approach to derive the material refractive index from Mueller Matrix. No other work has derived the refractive index directly from one of the Mueller matrix elements as in the method disclosed herein. Furthermore, use of the material attenuation index introduced by the method has not been identified in works in the art.
Further, the extracted polarization properties and the optical properties are further compared against an Artificial Intelligence (AI) model to get appropriate inferences of the transparent object, wherein the AI model is pretrained with gold standard polarization properties and gold standard optical properties (material refractive index and material attenuation index) of the transparent objects.
Referring now to the drawings, and more particularly to
In an embodiment, the system 100 includes a processor(s) 104, communication interface device(s), alternatively referred as input/output (I/O) interface(s) 106, and one or more data storage devices or a memory 102 operatively coupled to the processor(s) 104. The system 100 with one or more hardware processors is configured to execute functions of one or more functional blocks of the system 100.
Referring to the components of system 100, in an embodiment, the processor(s) 104, can be one or more hardware processors 104. In an embodiment, the one or more hardware processors 104 can be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, and/or any devices that manipulate signals based on operational instructions. Among other capabilities, the one or more hardware processors 104 are configured to fetch and execute computer-readable instructions stored in the memory 102. In an embodiment, the system 100 can be implemented in a variety of computing systems including laptop computers, notebooks, handheld devices such as mobile phones, personal digital assistants and the like.
The I/O interface(s) 106 can include a variety of software and hardware interfaces, for example, a web interface, a graphical user interface and can facilitate multiple communications within a wide variety of networks N/W and protocol types such as the m-UDP, including wired networks, for example, LAN, cable, etc., and wireless networks, such as WLAN, cellular, or satellite. In an embodiment, the I/O interface (s) 106 can include one or more ports for connecting a polarization camera 112 (described in conjunction with
The memory 102 may include any computer-readable medium known in the art including, for example, volatile memory, such as static random access memory (SRAM) and dynamic random access memory (DRAM), and/or non-volatile memory, such as read only memory (ROM), erasable programmable ROM, flash memories, hard disks, optical disks, and magnetic tapes. In an embodiment, the memory 102 includes a plurality of modules 110 that includes the AI model, a polarization property computation module, an optical property computation module and the like as depicted in
Further, the memory 102 may comprise information pertaining to input(s)/output(s) of each step performed by the processor(s) 104 of the system100 and methods of the present disclosure. Further, the memory 102 includes a database 108. The database 108 may a plurality of transformed polarization states recorded by the polarization camera 112, and 16 Mueller Matrix image elements of a Mueller Matrix generated for each transparent object by observing change in the plurality of transformed polarization states (later explained in conjunction with
Although the database 108 is shown internal to the system 100, it will be noted that, in alternate embodiments, the database 108 can also be implemented external to the system 100, and communicatively coupled to the system 100. The data contained within such external database may be periodically updated. For example, new data may be added into the database (not shown in
In an embodiment, the system 100 comprises one or more data storage devices or the memory 102 operatively coupled to the processor(s) 104 and is configured to store instructions for execution of steps of the method 200 by the processor(s) or one or more hardware processors 104. The steps of the method 200 of the present disclosure will now be explained with reference to the components or blocks of the system 100 as depicted in
Referring to the steps of the method 200, at step 202, the one or more hardware processors 104 receive the plurality transformed polarization states recorded by the polarization camera for the transparent object to be characterized when the polarized light of the plurality of known polarization states is incident onto the transparent object as depicted in
At step 204, the polarization property computation module executed by the one or more hardware processors 104 estimates the plurality of Mueller Matrix image elements (typically the 16 Mueller Matrix image elements) by observing the change in the plurality of transformed polarization states while the polarized light propagates through the transparent object to form the Mueller Matrix. As understood by a person skilled in the art, Mueller matrix describes the linear relationship between the polarization states of incident light beam and the transformed light beam after passing through the transparent objects.
At step 206, the polarization property computation module executed by the one or more hardware processors 104 computes the plurality of polarization properties of the transparent object by decomposing the Mueller Matrix as product of three elementary matrices. Typically16 Mueller Matrix image elements of the Mueller Matrix are decomposed into product of three elementary matrices based on standard Mueller Matrix decomposition using Lu-Chipman formalism. The decomposition generates fundamental polarization namely, a depolarizer (MΔ), a retarder (MR), and a diattenuator (MD), represented as
Where M is the decomposed Mueller Matrix.
Further the plurality of polarization properties are extracted from the decomposed Mueller Matrix. The plurality of polarization properties includes, the diattenuation (δ), the retardance (r), the depolarization (Δ), the optical birefringence (ΔN). The plurality of polarization properties are referred to as fundamental polarization properties.
At step 208, the optical property computation module executed by the one or more hardware processors 104 computes the plurality of optical properties that include the material attenuation index (µa) and the material refractive index (n). The material refractive index (n) is determined from a first element of the Mueller Matrix M(1,1) using Fresnel’s law-based analysis, which represents a total intensity of the polarization light. The material refractive index (n) is calculated from total intensity M (1,1) element of the Mueller Matrix using the equation with refractive index of the external medium and air = 1, the M (1,1) is the first element of the Mueller Matrix, which represents total intensity of the polarization light using the Fresnel’s law-based analysis is given by:
The material refractive index is calculated as follows:
Where n is the material refractive index.
The material attenuation index (µa) is calculated, by further processing the total intensity M (1,1) of the Mueller matrix by using the reverse Monte Carlo method. In the reverse Monte Carlo method, material attenuation coefficient (i.e., attenuation of light due to travelling through the sample material) is calculated from the reflectance, i.e., the total light intensity M11.
The material refractive index and the material attenuation index are optical properties of the transparent object, which vary with changes in the transparent object properties caused due to several factors like manufacturing defect, aberration, inclusion of an impurity such as bubble or dust, thickness differences, and thereof. The material attenuation index is calculated using the reverse Monte Carlo algorithm. In this algorithm, there is a forward Monte Carlo model which is a statistical model that generates the profile of optical reflectance with the transparent object using an approximate attenuation coefficient value. The experimentally measured reference signal is provided, and the reflectance is compared, and the attenuation coefficient is optimized and adjusted.
At step 210, during inferencing stage, the Artificial Intelligence (AI) model executed by the one or more hardware processors 104 characterizes the transparent object. The characterizing of the transparent object is based on the computed plurality of polarization properties and the computed plurality of optical properties. The AI model is pretrained with gold standard polarization properties and gold standard optical properties of transparent objects. The inference of the AI model on characterization of the transparent object is provided or displayed to an end user to decide upon quality/ presence of defects of the material. The AI model can identify the deviations from the inferences, which includes, identifying manufacturing defect, aberration, inclusion of an impurity such as bubble or dust and thereof in the transparent objects.
The written description describes the subject matter herein to enable any person skilled in the art to make and use the embodiments. The scope of the subject matter embodiments is defined by the claims and may include other modifications that occur to those skilled in the art. Such other modifications are intended to be within the scope of the claims if they have similar elements that do not differ from the literal language of the claims or if they include equivalent elements with insubstantial differences from the literal language of the claims.
It is to be understood that the scope of the protection is extended to such a program and in addition to a computer-readable means having a message therein; such computer-readable storage means contain program-code means for implementation of one or more steps of the method, when the program runs on a server or mobile device or any suitable programmable device. The hardware device can be any kind of device which can be programmed including e.g., any kind of computer like a server or a personal computer, or the like, or any combination thereof. The device may also include means which could be e.g., hardware means like e.g., an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination of hardware and software means, e.g., an ASIC and an FPGA, or at least one microprocessor and at least one memory with software processing components located therein. Thus, the means can include both hardware means, and software means. The method embodiments described herein could be implemented in hardware and software. The device may also include software means. Alternatively, the embodiments may be implemented on different hardware devices, e.g., using a plurality of CPUs.
The embodiments herein can comprise hardware and software elements. The embodiments that are implemented in software include but are not limited to, firmware, resident software, microcode, etc. The functions performed by various components described herein may be implemented in other components or combinations of other components. For the purposes of this description, a computer-usable or computer readable medium can be any apparatus that can comprise, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The illustrated steps are set out to explain the exemplary embodiments shown, and it should be anticipated that ongoing technological development will change the manner in which particular functions are performed. These examples are presented herein for purposes of illustration, and not limitation. Further, the boundaries of the functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternative boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope of the disclosed embodiments. Also, the words “comprising,” “having,” “containing,” and “including,” and other similar forms are intended to be equivalent in meaning and be open ended in that an item or items following any one of these words is not meant to be an exhaustive listing of such item or items or meant to be limited to only the listed item or items. It must also be noted that as used herein and in the appended claims, the singular forms “a,” “an,” and “the” include plural references unless the context clearly dictates otherwise.
Furthermore, one or more computer-readable storage media may be utilized in implementing embodiments consistent with the present disclosure. A computer-readable storage medium refers to any type of physical memory on which information or data readable by a processor may be stored. Thus, a computer-readable storage medium may store instructions for execution by one or more processors, including instructions for causing the processor(s) to perform steps or stages consistent with the embodiments described herein. The term “computer-readable medium” should be understood to include tangible items and exclude carrier waves and transient signals, i.e., be non-transitory. Examples include random access memory (RAM), read-only memory (ROM), volatile memory, nonvolatile memory, hard drives, CD ROMs, DVDs, flash drives, disks, and any other known physical storage media.
It is intended that the disclosure and examples be considered as exemplary only, with a true scope of disclosed embodiments being indicated by the following claims.
Number | Date | Country | Kind |
---|---|---|---|
202121061180 | Dec 2021 | IN | national |