This application claims priority from Korean Patent Application No. 10-2020-0060703, filed on May 21, 2020, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
The present invention relates to a method and device for estimating a magnetic parameter value from a magnetic domain image using deep learning.
A low-dimensional magnetic system is a subject that has been importantly researched due to scientific importance and potential application in next-generation electronic devices. For quantitative comprehension of the characteristics of such a magnetic structure, various theoretical methods including numerical analysis as well as experimental methods have been used. In general, all experimental factors cannot be considered in theoretical calculation, and therefore numerical analysis or an analytical approach cannot be directly compared with experimental results. Therefore, development of a method for directly converting data resulting from experimentation into various parameters that can be used in a theoretical approach is a problem that is important not only in magnetic research but also in other kinds of scientific research.
In contrast, machine learning, which appeared several decades ago for the first time, showed more improved performance and possibility than conventional techniques and thus has been adopted in various fields for various purposes. In particular, machine learning using a deep neural network, referred to as “deep learning,” has been used in order to solve various scientific challenges, for example, in order to calculate ab initio of a many-electron system, to predict a protein structure, to solve a quantum many-body problem, and to investigate the ground state of a magnetic system.
The present invention has been made in view of the above problems, and it is an object of the present invention to provide a method and device for estimating a magnetic parameter value from a magnetic domain image using deep learning.
In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of a magnetic parameter value estimation method using deep learning, the magnetic parameter value estimation method including creating a simulated magnetic domain image corresponding to a spin configuration of a two-dimensional magnetic system created through computer simulation, modeling a deep neural network using the simulated magnetic domain image, and estimating a magnetic parameter value of an observed magnetic domain image using the modeled deep neural network.
The magnetic parameter value may be at least one of Dzyaloshinskii-Moriya interaction (DMI) strength ({right arrow over (β)}ij), perpendicular magnetic anisotropy strength (Kz), and dipole interaction strength (D) of magnetic Hamiltonian H defined by the following equation.
(In the above equation, J indicates exchange interaction strength,
i and j indicate two arbitrary positions in a two-dimensional magnetic system represented as a lattice structure,
{right arrow over (S)}i indicates a normalized classical spin vector located at position i,
{right arrow over (S)}j indicates a normalized classical spin vector located at position j,
{right arrow over (S)}i,z indicates a component vector in an out-of-plane direction of a normalized classical spin vector located at position i, and
{right arrow over (r)}ij indicates a non-dimensional displacement vector between position i and position j.)
The magnetic domain image creation step may include creating a spin configuration of the two-dimensional magnetic system through an annealing process using a Monte Carlo method and creating a magnetic domain image corresponding to the simulated spin configuration.
The annealing process using the Monte Carlo method may decrease temperature from a temperature higher than Curie temperature to a temperature at which there is no thermal fluctuation of spin.
The modeling step may model the deep neural network based on the difference between an estimated magnetic parameter value obtained by inputting the simulated magnetic domain image to the deep neural network and a true magnetic parameter value of the input simulated magnetic domain image.
In accordance with another aspect of the present invention, there is provided a magnetic parameter value estimation device using deep learning, the magnetic parameter value estimation device including an image creation unit configured to create a simulated magnetic domain image corresponding to a spin configuration of a two-dimensional magnetic system, a modeling unit configured to model a deep neural network using the simulated magnetic domain image, and an estimation unit configured to estimate a magnetic parameter value corresponding to an observed magnetic domain image using the modeled deep neural network.
The magnetic parameter value may be at least one of Dzyaloshinskii-Moriya interaction (DMI) strength ({right arrow over (β)}ij), perpendicular magnetic anisotropy strength (Kz), and dipole interaction strength (D) of magnetic Hamiltonian H defined by the following equation.
(In the above equation, J indicates exchange interaction strength,
i and j indicate two arbitrary positions in a two-dimensional magnetic system represented as a lattice structure,
{right arrow over (S)}i indicates a normalized classical spin vector located at position i,
{right arrow over (S)}j indicates a normalized classical spin vector located at position j,
{right arrow over (S)}i,z indicates a component vector in an out-of-plane direction of a normalized classical spin vector located at position i, and
{right arrow over (r)}ij indicates a non-dimensional displacement vector between position i and position j.)
The image creation unit may be configured to create a spin configuration of the two-dimensional magnetic system through an annealing process using a Monte Carlo method and to create a magnetic domain image corresponding to the simulated spin configuration.
The annealing process using the Monte Carlo method may decrease temperature from a temperature higher than Curie temperature to a temperature at which there is no thermal fluctuation of spin.
The modeling unit may be configured to model the deep neural network based on the difference between an estimated magnetic parameter value obtained by inputting the simulated magnetic domain image to the deep neural network and a true magnetic parameter value of the input simulated magnetic domain image.
In accordance with a further aspect of the present invention, there is provided a computer-readable nonvolatile recording medium having the respective steps of the magnetic parameter value estimation method using deep learning recorded therein.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee. The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
In this specification, a “two-dimensional magnetic system” includes not only a two-dimensional system composed of Van der Waals materials having magnetic properties but also a quasi-two-dimensional (2D-like) system, such as a thin film structure, i.e. the case in which the magnetic properties of an upper surface and the magnetic properties of a lower surface are closely related with each other in the thickness direction (the perpendicular direction).
Referring to
The magnetic parameter value may be at least one of Dzyaloshinskii-Moriya interaction (DMI) strength {right arrow over (β)}ij (simply referred to as β), perpendicular magnetic anisotropy strength Kz (simply referred to as K), and dipole interaction strength D of magnetic Hamiltonian H defined by the following equation.
(In the above equation, J indicates exchange interaction strength,
i and j indicate two arbitrary positions in a two-dimensional magnetic system represented as a lattice structure,
{right arrow over (S)}i indicates a normalized classical spin vector located at position i,
{right arrow over (S)}j indicates a normalized classical spin vector located at position j,
{right arrow over (S)}i,z indicates indicates a component vector in an out-of-plane direction of a normalized classical spin vector located at position i, and
{right arrow over (r)}ij indicates a non-dimensional displacement vector between position i and position j.)
Hereinafter, estimation of three values, such as DMI strength β, perpendicular magnetic anisotropy strength Kz, and dipole interaction strength D, as magnetic parameter values will be described.
Referring to
The annealing process using the Monte Carlo method means setting a spin direction using random numbers while gradually decreasing temperature in order to create a magnetic domain structure. Specifically, instead of precisely aligning each spin to a specific direction minimizing its local energy, a random number can be used to make the spin select a direction deviating from the specific direction. Using this method, we can control the thermal fluctuations of spins by varying the temperature of the system; the directions of spins changes randomly if the temperature of the system is above than Curie temperature, and they are aligned to the direction minimizing local energy in the case of low temperature. It is possible to obtain a simulated energy minimum state by an annealing process which the temperature slowly decreases from Curie temperature (random alignment of the spin direction by temperature fluctuations) to a low temperature (no fluctuation due to temperature). During the annealing process, a magnetic texture is formed due to spontaneous symmetry breaking, and therefore a magnetic domain and a magnetic domain wall have various morphological characteristics in the simulated spin configuration.
As indicated by a color wheel at the right upper end of
Since the magnetic Hamiltonian parameters used to create the spin configuration have different ranges, normalized parameters pN, KN, and DN were defined using the relationship of
(where Yi indicates all of β, K, and D). Subscripts min and max indicate the minimum value and the maximum value of each magnetic Hamiltonian parameter range used to create the magnetic domain image.
A huge dataset including the magnetic domain structure and various spin configurations indicating magnetic Hamiltonian parameters corresponding thereto was created. In order to obtain a spin configuration that has appeared in a 100×100 square lattice system, an annealing process simulated using a Monte Carlo method was performed based on magnetic Hamiltonian of Equation (1)
Other parameters were scaled at ratios to J in the state in which J is fixed to 1. Other Hamiltonian parameters were changed when β=−3D to 3D, K=Kshape to 1.2×Kshape (where Kshape=2πD), and D=0.05 to 0.13, and therefore various magnetic domain sets were created in the 100×100 square lattice system. Step sizes used to change β, K, and D were 0.3D, 0.02×Kshape, and 0.005, respectively. 20 spin configurations were created using each magnetic Hamiltonian parameter set, and the total number of created spin configurations was about 80,000.
Since a magnetic domain shape is decided due to spontaneous symmetry breaking during the simulated annealing process, 20 spin configurations created using an identical magnetic Hamiltonian parameter set exhibit different magnetic domain shapes. This means that duplicate data are not essentially included in the entire dataset.
The temperature annealing speed of the simulated annealing process was intentionally adjusted such that a simulated spin configuration did not necessarily need to be a ground-state magnetic domain construction. A ground-state spin configuration is useful to extract the characteristics of a magnetic domain structure by training a network; however, a problem in that some structural features of a magnetic domain are overfit in a ground state may be caused. That is, when only the ground state is used, the network may not learn structural variety of the magnetic domain in the local energy minimum state.
Referring to
As shown in
As shown in
In the training step (S210), parameters in a deep neural network are decided for an input simulated magnetic domain image.
In the validation step (S220), the deep neural network is verified using data different from the input data used in the training step (S210). Consequently, it is possible to perform control such that the deep neural network is not overfit on the input simulated magnetic domain image in the training step (S210).
In the training step (S210) and the validation step (S220), the deep neural network may be modeled based on the difference between a estimated magnetic parameter value obtained from the simulated magnetic domain image created in step S100 to the deep neural network and an actual magnetic parameter value, i.e. a magnetic parameter value of a spin configuration corresponding to the input simulated magnetic domain image.
The test step (S230) is a step of testing the operation of the deep neural network modeled through the training step (S210) and the validation step (S220). It is possible to determine whether the deep neural network is normally operated through this step.
Referring to
The feature extraction unit 610 may include at least one convolution layer and at least one subsampling layer. The feature extraction unit 610 performs convolutional calculation for an input magnetic domain image to extract a feature value of the input image.
For example, in order to estimate a magnetic Hamiltonian parameter from the magnetic domain image, a feature extraction unit having a ResNet50 network structure, which is a deep neural network structure capable of effectively extracting a feature from an image, may be used as the feature extraction unit 610.
The dense layer 620, which may also be referred to as a fully-connected layer, estimates a magnetic parameter value from the feature value extracted by the feature extraction unit 610.
Depending on embodiments, the feature extraction unit 610 and the dense layer 620 may decide a network parameter in the feature extraction unit 610 and the dense layer 620 based on the difference between a estimated magnetic parameter value obtained from the magnetic domain image to the deep neural network and a magnetic parameter value of the spin configuration created in the magnetic domain image creation step (S100).
For example, the feature extraction unit 610 and the dense layer 620 may decide a network parameter therein such that cost is minimized. The cost may be defined by the following equation.
In the above cost calculation equation, yi indicates a estimated magnetic parameter value obtained through the deep neural network, and Yi indicates a true magnetic parameter value of the spin configuration created in the magnetic domain image creation step (S100).
In order to avoid results from biased training due to the scale difference between the parameters at the time of cost calculation described above, normalized actual parameters βN, KN, and DN may be used as Yi of the above cost calculation equation. A normalization relationship that appears in the result part enables all normalized parameters to be changed from 0 to 1.
In an experimental example, the 20 spin configurations created using each magnetic Hamiltonian parameter set were divided into 14, 4, and 2 spin configurations for training, validation, and testing. The entire training, validation, and test dataset includes 56000, 16000, and 8000 spin configurations. One complete execution of a training process using the entire training dataset is defined as one epoch. A total of 1000 epochs were executed. The validation dataset was used to monitor the training process at the end of each epoch. After the entire training process, a trained neural network model having the smallest validation error value for the test process was selected.
For direct comparison in the relationship between the characteristics of the input spin configuration and the estimated error amount,
In order to investigate whether there is a specific relationship between estimated error values of each parameter, pre-normalized estimated error values are provided in a three-dimensional space, as shown in
A trained network was applied to an experimentally observed magnetic domain image in order to prove propriety and effectiveness of the network.
The original experimental image was converted into a color image using the same color configuration table as the simulation results of
Referring to
The magnetic parameter value estimation device 1 may further include an image storage unit 110 configured to store a plurality of simulated magnetic domain images created by the image creation unit 100 and a neural network storage unit 210 configured to store a deep neural network.
Functions of the image creation unit 100, the modeling unit 200, and the estimation unit 300 correspond to the magnetic domain image creation step (S100), the modeling step (S200), and the magnetic parameter value estimation step (S300), respectively, and therefore a detailed description thereof will be omitted.
As is apparent from the above description, according to an embodiment of the present invention, it is possible to derive a magnetic parameter from a magnetic domain image.
Although the present invention has been described in detail based on preferred embodiments, those skilled in the art will appreciate that the present invention is not limited thereto and that various modifications, additions, and substitutions are possible without departing from the scope and spirit of the invention as disclosed in the accompanying claims. Consequently, the true technical protection scope of the present invention should be interpreted by the following claims, and all technical concepts included in a range equivalent thereto should be interpreted as falling within the scope of right of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
10-2020-0060703 | May 2020 | KR | national |
This invention was made with government support under Project No. CAP-16-01-KIST awarded by Creative Allied Project (CAP) through the National Research Council of Science & Technology (NST) funded by the Ministry of Science and ICT. The government support was made at a contribution rate of 50/100 for the research period of Jul. 1, 2019 through Jun. 30, 2020. The supervising institute was KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY. This invention was additionally made with government support under Project No. NRF-2019R1A6A3A01091209 awarded by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education. The government support was made at a contribution rate of 40/100 for the research period of Sep. 1, 2019 through Aug. 31, 2020. The supervising institute was KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY. This invention was additionally made with government support under Project No. 2E30600 awarded by the KIST Institutional Program funded by the Ministry of Science and ICT. The government support was made at a contribution rate of 10/100 for the research period of Jan. 1, 2020 through Dec. 31, 2020. The supervising institute was KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY.
Number | Name | Date | Kind |
---|---|---|---|
20210311146 | Keenan | Oct 2021 | A1 |
Entry |
---|
Salcedo-Gallo, J. S., C. C. Galindo-González, and E. Restrepo-Parra. “Deep learning approach for image classification of magnetic phases in chiral magnets.” Journal of magnetism and magnetic materials 501 (2020): 166482. pp. 1-6. (Year: 2022). |
Number | Date | Country | |
---|---|---|---|
20210365615 A1 | Nov 2021 | US |