The present disclosure relates generally to materials discovery, and particularly to using machine learning for material discovery.
The discovery of new materials and/or unknown properties of existing materials is desirable for continued technological developments in industries such as automotive, aerospace, energy production, chemical processing, and semiconductor manufacturing, among others. Also, the desire for such discoveries has fueled first-principle computational research in an effort to reduce the time and cost associated with materials development. And while first-principle computational research has led to the development of new alloys and semiconductors, computation time needed first-principle calculations can be longer than desired and/or not practical.
The present disclosure addresses issues related to computational discovery of new materials, and other issues related to material discovery.
This section provides a general summary of the disclosure, and is not a comprehensive disclosure of its full scope or all of its features.
In one form of the present disclosure, a system includes a processor and a memory communicably coupled to the processor. The memory stores machine-readable instructions that, when executed by the processor, cause the processor to select a dataset representing at least a portion of a material space and train a machine learning model to learn a convex function approximating the dataset in a primal space. In some variations, the machine-readable instructions, when executed by the processor, cause the processor to duality transform hyperplanes of the learned convex function from the primal space to a dual space, learn a convex hull of the duality transformed convex function hyperplanes in the dual space, and duality transform at least one hyperplane of the learned convex hull back to the primal space. And in at least one variation, the machine-readable instructions, when executed by the processor, cause the processor to predict, based on the at least one duality transformed hyperplane of the learned convex hull, at least one optimized material composition within the material space.
In another form of the present disclosure, a system includes a processor and a memory communicably coupled to the processor. The memory stores machine-readable instructions that, when executed by the processor, cause the processor to select a dataset representing at least a portion of a material space, train a machine learning model to learn a convex function approximating the dataset in a first space, learn a first minimum of learned convex function in the first space, transform a subspace of the learned convex function from the first space to a second space, the learned minimum in the first space being an endpoint in the second space, learn a second minimum of the subspace of the learned convex function in the second space. And in at least one variation, the machine-readable instructions, when executed by the processor, cause the processor to predict, based on the first learned minimum and the second learned minimum, a first optimized material composition and a second optimized material composition different than the first optimized material composition within the material space.
In still another form of the present disclosure, a method includes selecting a dataset from a candidate dataset representing at least a portion of a material space, training a machine learning model to learn a convex function approximating the dataset in a primal space, and duality transforming hyperplanes of the learned convex function from the primal space to a dual space. In some variations, the method also includes learning a convex hull of the duality transformed convex function hyperplanes in the dual space and duality transforming at least one hyperplane of the learned convex hull back to the primal space. And in at least one variation, the method includes predicting, based on the at least one duality transformed hyperplane of the learned convex hull, at least one optimized material composition within the material space.
Further areas of applicability and various methods of enhancing the above technology will become apparent from the description provided herein. The description and specific examples in this summary are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
The present teachings will become more fully understood from the detailed description and the accompanying drawings, wherein:
The present disclosure provides a machine learning (ML) system and a ML method for predicting an optimized material composition with respect to one or more material properties. As used herein, the phrase “optimized material composition” refers to a previously unknown stable single-phase material composition or a known stable single-phase material composition with a previously unknown crystal structure. Also, the term “stable” refers to a single-phase compound or crystal structure of a single-phase compound that does not change when the single-phase compound is being used as a functional material (i.e., while being used for its intended purpose). In one form of the present disclosure, the ML system and ML method train a ML model to learn a convex function of a data set, find a minimum of the learned convex function, and a minimum of any protrusions of the learned convex function such that one or more optimized material compositions is/are predicted. In another form of the present disclosure, the ML system and ML method train a ML model to learn a convex function of a data set, duality transform a plurality of hyperplanes of the convex function to a dual space, learn a convex hull of the duality transformed convex function hyperplanes, and then duality transform at least a portion of a plurality of hyperplanes of the convex hull back to the original space such that one or more optimized material compositions is/are predicted. As used herein, the term “hyperplane” as used herein refers to a subspace whose dimension is one less than the dimension of the ambient or primal space.
Referring now to
The memory 120 is configured to store an acquisition module 122 and a ML module 124. In some variations, the memory 120 is configured to also store a convex function module 125, a minimization module 126, a transform module 127 and/or a data grouping module 128. The memory 120 is a random-access memory (RAM), read-only memory (ROM), a hard-disk drive, a flash memory, or other suitable memory for storing the acquisition module 122 and the ML module 124, and for storing the convex function module 125, the minimization module 126, the transform module 127 and/or the data grouping module 128. Also, the acquisition module 122, ML module 124, convex function module 125, minimization module 126, transform module 127, and data grouping module 128 (collectively referred to herein as “modules 122-128”) are, for example, computer-readable instructions that when executed by the processor 100 cause the processor(s) to perform the various functions disclosed herein.
In some variations the data store 140 is a database, e.g., an electronic data structure stored in the memory 120 or another data store. Also, in at least one variation the data store 140 in the form of a database is configured with routines that can be executed by the processor 100 for analyzing stored data, providing stored data, organizing stored data, and the like. Accordingly, in some variations the data store 140 stores data used by one or more of the modules 122-128. For example, and as shown in
Material systems that can be in the candidate dataset 142 include metallic and ceramic systems for which material discovery is desired. For example, and without limitation, material systems in the candidate dataset 142 include materials such as alloys, intermetallics, semiconductors, semimetals, and dielectrics, among others. Material properties that can be in the properties dataset 144 include any property that is experimentally known and/or can be calculated for a materials system in the candidate dataset 142. For example, and without limitation, material properties in the properties dataset 144 include formation energy, electronic bandgap, electrical conductivity, thermal conductivity, acoustical absorption, acoustoelastic effect, surface energy, surface tension, capacitance, dielectric constant, dielectric strength, thermoelectric effect, permittivity, piezoelectricity, pyroelectricity, Seebeck coefficient, curie temperature, diamagnetism, hall coefficient, magnetic hysteresis, electrical hysteresis, magnetoresistance, maximum energy product, permeability, piezomagnetism, Young's modulus, viscosity, Poisson's ratio and density, among others.
The acquisition module 122 can include instructions that function to control the processor 100 to select a dataset including a plurality of material compositions from a predefined material system (e.g., the A-B material system) from the candidate dataset 142 and corresponding material property values for at least one predefined material property from the properties dataset 144. It should be understood that the material property values in the properties dataset 144 are properly tagged and/or associated with the plurality of material compositions in the candidate dataset 142. In some variations, acquisition module 122 includes instructions that function to control the processor 100 to select the dataset from the training dataset 143.
In one form of the present disclosure, the ML module 124, convex function module 125, minimization module 126, and the transform module 127 can include instructions that function to control the processor 100 to perform or execute one or more of the following: select a convex function from the convex function module 125; train the selected convex function to approximate (fit) at least a portion of the dataset in a first or primal space; select a minimization function from the minimization module 126; learn a minimum of the trained convex function in the first space using the minimization function; select a transform function from the transform module 127; transform a subspace of the trained convex function to a second or dual space using the transform function; learn a minimum of the transformed subspace in the second space; and predict one or more stable material compositions, based at least in part, on the learned minimums in the first space and the second space.
In another form of the present disclosure, the ML module 124, convex function module 125, minimization module 126, the transform module 127 and/or data grouping module 128 can include instructions that function to control the processor 100 to perform or execute one or more of the following: select a convex function from the convex function module 125; train the selected convex function to approximate (fit) at least a portion of the dataset; select a duality transform function from the transform module 127; duality transform one or more hyperplanes of the trained convex function from a primal space to a dual space using the transform module 127; select a grouping function from the data grouping module 128; train the grouping function such that a plurality of hyperplanes of the grouping function bound the duality transformed hyperplanes of the trained convex function; and duality transform at least one of the hyperplanes of the grouping function back to the primal space; and predict one or more optimized material compositions, based at least in part, on the and duality transform of at least one of the hyperplanes of the grouping function back to the primal space.
Non-limiting examples of the ML model include supervised ML models such as nearest neighbor models, Naïve Bayes models, decision tree models, linear regression models, support vector machine (SVM) models, and neural network models, among others. In at least one variation, the ML model is a Gaussian Process regression model. Also, training of the ML model provides a prediction of an optimized material composition with respect to a predefined material property to within a desired value (i.e., less than or equal to a desired value) of a cost function.
In some variations, the convex function is a Softmax-affine function, the minimization function is a gradient descent function, the transform function is a re-plotting function and/or a duality transform function, among others, and the grouping function is a convex hull function. In at least one variation the duality transform function is a line-to-point and point-to-line duality transform function in which a line obeying the equation y=ax−b in an x,y primal space (two dimension material space) is duality transformed to a point with coordinates [a, b] in an a,b dual space, and a line obeying the equation b=xa−y in the a,b dual space is duality transformed to a point with coordinates [x, y] in the x,y primal space. In other variations, the ML system 10 is configured for material discovery in n-dimensional material space where n is an integer greater than 2. For example, in some variations the material space is a three dimension material space, the hyperplanes of the learned convex function are planes, the duality transformed hyperplanes of the learned convex function in the dual space are lines, the hyperplanes of the convex hull are planes, and the at least one duality transformed hyperplane of the convex hull in the primal space is at least two lines that intersect with each other.
Referring to
Referring to
Referring now to
A second learned minimum of the learned convex function cf2 is also shown in
Referring to
A third learned minimum of the learned convex function cf3 is also shown in
Referring now to
where ƒSMA(x) is the property value for a given material property, x is material composition, and α, bk, and akT are fitting parameters. It should be understood that hyperplanes of the two dimensional surface or plane for the plot shown in
It should also be understood that the method of predicting an optimized material composition illustrated in
Referring now to
Referring now to
Referring to
The preceding description is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses. Work of the presently named inventors, to the extent it may be described in the background section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present technology.
As used herein, the phrase at least one of A, B, and C should be construed to mean a logical (A or B or C), using a non-exclusive logical “or.” It should be understood that the various steps within a method may be executed in different order without altering the principles of the present disclosure. Disclosure of ranges includes disclosure of all ranges and subdivided ranges within the entire range.
The headings (such as “Background” and “Summary”) and sub-headings used herein are intended only for general organization of topics within the present disclosure, and are not intended to limit the disclosure of the technology or any aspect thereof. The recitation of multiple variations or forms having stated features is not intended to exclude other variations or forms having additional features, or other variations or forms incorporating different combinations of the stated features.
As used herein the term “about” when related to numerical values herein refers to known commercial and/or experimental measurement variations or tolerances for the referenced quantity. In some variations, such known commercial and/or experimental measurement tolerances are +/−10% of the measured value, while in other variations such known commercial and/or experimental measurement tolerances are +/−5% of the measured value, while in still other variations such known commercial and/or experimental measurement tolerances are +/−2.5% of the measured value. And in at least one variation, such known commercial and/or experimental measurement tolerances are +/−1% of the measured value.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments. In this regard, a block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
The systems, components and/or processes described above can be realized in hardware or a combination of hardware and software and can be realized in a centralized fashion in one processing system or in a distributed fashion where different elements are spread across several interconnected processing systems. Any kind of processing system or another apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware and software can be a processing system with computer-usable program code that, when being loaded and executed, controls the processing system such that it carries out the methods described herein. The systems, components and/or processes also can be embedded in a computer-readable storage, such as a computer program product or other data programs storage device, readable by a machine, tangibly embodying a program of instructions executable by the machine to perform methods and processes described herein. These elements also can be embedded in an application product which comprises the features enabling the implementation of the methods described herein and, which when loaded in a processing system, is able to carry out these methods.
Furthermore, arrangements described herein may take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied, e.g., stored, thereon. Any combination of one or more computer-readable media may be utilized. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The phrase “computer-readable storage medium” means a non-transitory storage medium. A computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: a portable computer diskette, a hard disk drive (HDD), a solid-state drive (SSD), a ROM, an EPROM or flash memory, a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Generally, modules as used herein include routines, programs, objects, components, data structures, and so on that perform particular tasks or implement particular data types. In further aspects, a memory generally stores the noted modules. The memory associated with a module may be a buffer or cache embedded within a processor, a RAM, a ROM, a flash memory, or another suitable electronic storage medium. In still further aspects, a module as envisioned by the present disclosure is implemented as an ASIC, a hardware component of a system on a chip (SoC), as a programmable logic array (PLA), or as another suitable hardware component that is embedded with a defined configuration set (e.g., instructions) for performing the disclosed functions.
Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber, cable, radio frequency (RF), etc., or any suitable combination of the foregoing. Computer program code for carrying out operations for aspects of the present arrangements may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java™, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
As used herein, the terms “comprise” and “include” and their variants are intended to be non-limiting, such that recitation of items in succession or a list is not to the exclusion of other like items that may also be useful in the devices and methods of this technology. Similarly, the terms “can” and “may” and their variants are intended to be non-limiting, such that recitation that a form or variation can or may comprise certain elements or features does not exclude other forms or variations of the present technology that do not contain those elements or features.
The broad teachings of the present disclosure can be implemented in a variety of forms. Therefore, while this disclosure includes particular examples, the true scope of the disclosure should not be so limited since other modifications will become apparent to the skilled practitioner upon a study of the specification and the following claims. Reference herein to one variation, or various variations means that a particular feature, structure, or characteristic described in connection with a form or variation or particular system is included in at least one variation or form. The appearances of the phrase “in one variation” (or variations thereof) are not necessarily referring to the same variation or form. It should be also understood that the various method steps discussed herein do not have to be carried out in the same order as depicted, and not each method step is required in each variation or form.
The foregoing description of the forms and variations has been provided for purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure. Individual elements or features of a particular form or variation are generally not limited to that particular form or variation, but, where applicable, are interchangeable and can be used in a selected form or variation, even if not specifically shown or described. The same may also be varied in many ways. Such variations should not be regarded as a departure from the disclosure, and all such modifications are intended to be included within the scope of the disclosure.