This application is based upon and claims priority to Chinese Patent Application No. 202110617849.3, filed on Jun. 3, 2021, the entire contents of which are incorporated herein by reference.
The present invention belongs to the technical field of welding, and in particular to a method for constructing a body-in-white (BiW) spot welding deformation prediction model based on a graph convolutional network (GCN).
The body-in-white (BiW) is a steel structure with supporting parts as the carrier, and is formed by welding hundreds of sheet metal parts. Spot welding, also known as electrical resistance welding, has become the most important welding method for connecting the sheet metal parts of the BiW because of its stability and easy automation. During spot welding, a large current of several hundred to tens of thousands of amperes is applied between two electrodes and the workpiece, and the interface of the workpiece is melted through the combined action of pressure and Joule heating to form a spot weld. The whole welding process involves very complex force and heat transfer, which has a significant effect on the deformation of the sheet material. A BiW has more than 5,000 spot welds with different process parameters and welding quality. These spot welds are intended to achieve the overall deformation of the BiW under the complex combined action, which brings great difficulty in the precision control of the BiW. The deformation mechanism of the BiW is unknown for a long time, and there is a lack of effective deformation prediction and control methods, such that car companies are hindered from improving production quality and reaping economic benefits.
At present, the automated production lines of Chinese automobile manufacturers are becoming increasingly developed. In recent years, with the rapid development of industrial big data (BD), massive data in the entire cycle of automobile production, including process parameters of spot welds and online coordinate measurement data for the deformation of the BiW, are acquired and stored conveniently and quickly. As massive data are acquired quickly, driven by the rapid development of current intelligent manufacturing and artificial intelligence (AI) technology, intelligent systems integrating BD-based intelligent diagnosis algorithms and intelligent decision-making predictions are expected to tap potential laws in massive manufacturing data. This brings a new opportunity to achieve predictive control of spot welding deformation accuracy of automobiles.
In view of this, an objective of the present invention is to provide a method for constructing a body-in-white (BiW) spot welding deformation prediction model based on a graph convolutional network (GCN), so as to quickly predict a final deformation caused by spot welding in the production of a BiW.
In order to achieve the above objective, the present invention provides the following technical solution.
A method for constructing a BiW spot welding deformation prediction model based on a GCN includes the following steps:
1) acquiring each spot weld and a three-dimensional (3D) coordinate measurement point thereof of a BiW in a production process; extracting a welding feature and 3D coordinates of each spot weld wi to form an eigenvector xi; and extracting designed 3D coordinates at the 3D coordinate measurement point;
2) inputting eigenvectors of all spot welds into a deep neural network (DNN) MLP_1, and encoding, by an encoder_1 of the DNN MLP_1, the eigenvectors into hidden space vectors of the spot welds; inputting designed 3D coordinate vectors of all 3D coordinate measurement points into a DNN MLP_2, and encoding, by an encoder_2 of the DNN MLP_2, the designed 3D coordinate vectors into hidden space vectors of the coordinate measurement points; and adding edges to the hidden space vectors of the spot welds and the hidden space vectors of the coordinate measurement points through a k-nearest neighbors (KNN) algorithm to construct a graph topology G;
3) decomposing a Laplacian eigenvector of the constructed graph topology G to acquire frequency domain components, and linearly transforming eigenvalues corresponding to the frequency domain components to construct a multi-layer GCN, where each layer of the GCN has a different frequency domain filter to adaptively extract thermodynamic and kinetic information in a neighborhood of each coordinate measurement point of the BiW;
4) inputting the thermodynamic and kinetic information of each coordinate measurement point into a DNN MLP_3; encoding, by an encoder of the DNN MLP_3, the thermodynamic and kinetic information into a 3D coordinate space, and decoding a final deformation at each coordinate measurement point; and outputting a predicted 3D vector of the deformation at each coordinate measurement point; and
5) optimizing the BiW spot welding deformation prediction model.
Further, in step 1), the welding feature may include:
a process signal's local peak, local valley, peak moment, valley-to-peak time, rise rate, end value, sag value, and sag rate, where the process signal may include a dynamic resistance, an electrode displacement, and an electrode pressure; and an acoustic emission signal's maximum vibration amplitude, event energy, ringing number, and rise time.
Further, step 2) specifically may include: inputting the eigenvectors x1˜xm of all the spot welds into the DNN MLP_1, and encoding, by the encoder 1, the eigenvectors into the hidden space vectors h1˜hni of the spot welds; and inputting the designed 3D coordinate vectors p1˜pn-m of all the coordinate measurement points into the DNN MLP_2, and encoding, by the encoder_2, the designed 3D coordinate vectors into the hidden space vectors hm+1˜k of the coordinate measurement points, where h1˜hm and hm+1˜hn are located in a same vector space to form n discrete vectors h1˜hn;
adding, based on a metric space of a global coordinate system where h1˜hn are located, edges to the vectors h1˜hn through the KNN algorithm to construct the graph topology G=(H, E), where for an arbitrary i-th node, hi ∈H, H being a k-dimensional real vector space Rk, that is, H⊆Rk; and
an edge connecting two nodes i and j is eij ∈E, where E denotes an edge space of the graph topology G, E⊆{(x, y)|(x, y)∈H2}, meaning an arbitrary pair of connected nodes in the graph topology.
Further, in step 3), the decomposing a Laplacian eigenvector of the constructed graph topology G may include:
31) constructing an adjacency matrix A of the graph topology G, where the adjacency matrix A is a 0-1 square matrix of n×n, and an element of the square matrix expresses whether two nodes are adjacent; if the two nodes i, j are adjacent, then aij=1; otherwise, aij=0; and aij is an element of the adjacency matrix, that is, aij ∈A;
32) constructing a symmetric normalized Laplacian matrix Lsys of the graph topology G:
L
sys
=D
−1/2
LD
−1/2
where, D denotes a degree matrix of the graph topology G; and L denotes the Laplace matrix of the graph topology G;
L=D−A
33) subjecting the symmetric normalized Laplacian matrix Lsys of the graph topology G to eigendecomposition (spectral decomposition):
where, U=({right arrow over (u1)}, {right arrow over (u2)}, . . . , {right arrow over (un)}); {right arrow over (ul)} denotes a column vector, which belongs to the vector space H, that is, {right arrow over (ul)}∈Rk, l=1, 2, . . . , n; and
denotes an eigenvalue matrix of the symmetric normalized Laplacian matrix Lsys; and λ1˜λh denote eigenvalues of the symmetric normalized Laplacian matrix Lsys of the graph topology G.
Further, a method for constructing a graph convolutional layer based on the graph topology G may include: setting an i-th graph convolutional layer with an input feature Xi and an output feature Xi+1, where X∈Rn×k; Rn×k denotes a n×k-dimensional real matrix space; n denotes a number of graph nodes; and k denotes a dimension of the hidden space vector;
34) designing a set of filter parameters gθ(Λ) for each channel of the input feature, which is a k-channel graph topology, and convolving each channel of the k-channel graph topology to acquire an eigenmatrix {tilde over (X)}i:
where, ĥ(λ1)˜ĥ(λn) denote parameters of a graph filter; and ĥ(λi) denotes a nonlinear function of λi, i={1, 2, . . . , n};
35) linearly transforming each channel in the eigenmatrix acquired by convolution to acquire an eigen transformation matrix W∈Rk×k and acquiring an output data λi+1 through an element-level nonlinear activation function ReLu:
where, Rk×k denotes a k×k-dimensional real matrix space.
Further, in step 3), the extracting thermodynamic and kinetic information in a neighborhood of each coordinate measurement point of the BiW may include:
36) connecting the constructed graph convolutional layer by a residual into a deep residual graph convolutional network (DRGCN), where the DRGCN includes L basic residuals, each of which forms the GCN by the graph convolutional layer; and outputting, by an L-th basic residual of the DRGCN, final thermodynamic and kinetic information on all the spot welds and coordinate measurement points of the BiW.
Further, in step 5), the optimizing the BiW spot welding deformation prediction model may include: processing, by a L2-norm loss function, actual and predicted 3D vectors of the deformation at each coordinate measurement point; and optimizing, by an adaptive movement estimation algorithm (Adam), L2-norm Loss_Avg of each coordinate measurement point as an optimization target to acquire the BiW spot welding deformation prediction model based on the GCN.
The present invention has the following beneficial effects:
In the present invention, the constructed BiW spot welding deformation prediction model based on the GCN can learn the thermodynamic and kinetic representation and propagation mode implied by the process parameter features of the spot welds on the BiW. The present invention enables rapid prediction of BiW deformations on a computer with GPU acceleration, and the present invention can quickly predict the future overall deformation of the BiW by simply inputting the process parameter features of the spot welds.
In order to make the objectives, technical solutions and beneficial effects of the present invention clearer, the present invention provides the following drawings:
The present invention is described in further detail below in combination with the drawings and specific embodiments in order to enable those skilled in the art to better understand and implement the present invention. The illustrated embodiments should not be construed as a limitation to the present invention.
1) Acquire each spot weld and a three-dimensional (3D) coordinate measurement point thereof of a BiW in a production process; extract a welding feature and 3D coordinates of each spot weld w1 to form an eigenvector xi; and extract designed 3D coordinates at the coordinate measurement point. Specifically, it is assumed that the BiW has a total of m spot welds, and an i-th spot weld is denoted as wi. First, a typical welding feature of each spot weld wi is extracted, which includes but is not limited to:
a process signal's local peak, local valley, peak moment, valley-to-peak time, rise rate, end value, sag value, and sag rate, where the process signal includes a dynamic resistance, an electrode displacement, and an electrode pressure; and
an acoustic emission signal's maximum vibration amplitude, event energy, ringing number, and rise time.
The 3D coordinates of all the spot welds in a physical space of a welding global coordinate system are extracted, and all the extracted welding features and the 3D coordinates form eigenvectors xi of the spot welds i.
2) Input eigenvectors of all spot welds into a deep neural network (DNN) MLP_1, and encode, by an encoder_1 of the DNN MLP_1, the eigenvectors into hidden space vectors of the spot welds; input designed 3D coordinate vectors of all 3D coordinate measurement points into a DNN MLP_2, and encode, by an encoder_2 of the DNN MLP_2, the designed 3D coordinate vectors into hidden space vectors of the coordinate measurement points; and add edges to the hidden space vectors of the spot welds and the hidden space vectors of the coordinate measurement points through a k-nearest neighbors (KNN) algorithm to construct a graph topology G. The coordinate space where the ideal 3D coordinates of the spot welds and the coordinate measurement points are located is used as a distance measurement space of the KNN algorithm, that is, a spatial linear distance between the spot welds and the coordinate measurement points is used as the clustering basis of the KNN algorithm. The hidden space vector characterizes the thermodynamic and kinetic information implied by each spot weld and can be propagated through the GCN.
This step specifically includes: input the eigenvectors x1˜xm of all the spot welds into the DNN MLP_1, and encode, by the encoder_1, the eigenvectors into the hidden space vectors h1˜hm of the spot welds; and input the designed 3D coordinate vectors p1˜pn-m of all the coordinate measurement points into the DNN MLP_2, and encode, by the encoder_2, the designed 3D coordinate vectors into the hidden space vectors hm+1˜hn of the coordinate measurement points, where h1˜hm and hm+1˜hn are located in a same vector space to form n discrete vectors h1˜hn; and add, based on a metric space of a global coordinate system where h1˜hn are located, edges to the vectors h1˜hn through the KNN algorithm to construct the graph topology G=(H, E), where for an arbitrary i-th node, hi∈H, H being a k-dimensional real vector space Rk, that is, H⊆Rk; and an edge connecting two nodes i and j is eij∈E, where E denotes an edge space of the graph topology G, E⊆{(x, y)|(x, y)∈H2}, meaning an arbitrary pair of connected nodes in the graph topology.
3) Decompose a Laplacian eigenvector of the constructed graph topology G to acquire frequency domain components, and linearly transform eigenvalues corresponding to the frequency domain components to construct a multi-layer GCN, where each layer of the GCN has a different frequency domain filter to adaptively extract thermodynamic and kinetic information in a neighborhood of each coordinate measurement point of the BiW and simulate a transfer process of the implicit thermodynamic and kinetic information on the whole BiW by the multi-layer GCN.
Specifically, as shown in
31) Construct an adjacency matrix A of the graph topology G, where the adjacency matrix A is a 0-1 square matrix of n×n, and an element of the square matrix expresses whether two nodes are adjacent; if the two nodes i, j are adjacent, then aij=1; otherwise, aij=0; and aij is an element of the adjacency matrix, that is, aij ∈A.
32) Construct a symmetric normalized Laplacian matrix Lsys of the graph topology G:
L
sys
=D
−1/2
LD
−1/2
where, D denotes a degree matrix of the graph topology G; and L denotes the Laplace matrix of the graph topology G.
L=D−A
33) Subject the symmetric normalized Laplacian matrix Lsys of the graph topology G to eigendecomposition (spectral decomposition):
where, U=({right arrow over (u1)}, {right arrow over (u2)}, . . . , {right arrow over (un)}); {right arrow over (ul)} denotes a column vector, which belongs to the vector space H, that is, {right arrow over (ul)}∈Rk, l=1, 2, . . . , n; and
denotes an eigenvalue matrix of the symmetric normalized Laplacian matrix Lsys; and λ1˜λh denote eigenvalues of the symmetric normalized Laplacian matrix Lsys of the graph topology G.
Further, a method for constructing a graph convolutional layer based on the graph topology G includes: subject the symmetric normalized Laplacian matrix of the graph topology G to eigendecomposition to acquire the eigenvectors {right arrow over (u1)}, {right arrow over (u2)}, . . . {right arrow over (un)}; and set an i-th graph convolutional layer with an input feature Xi and an output feature Xi+1, where X∈Rn×k; Rn×k denotes a n×k-dimensional real matrix space n denotes a number of graph nodes; and k denotes a dimension of the hidden space vector.
34) Design a set of filter parameters gθ(Λ) for each channel of the input feature, which is a k-channel graph topology and convolve each channel of the k-channel graph topology to acquire an eigenmatrix:
where, ĥ(λ1)˜ĥ(λn) denote parameters of a graph filter; and {right arrow over (h)}(λi) denotes a nonlinear function of λi, i={1, 2, . . . n}. Since λi is an invariant value for a fixed graph, ĥ(λi) is not represented as a function but is represented as an arbitrary real number that is not fixed. In this way, the model can learn the optimal ĥ(λi) during the optimization process.
35) Linearly transform each channel in the eigenmatrix acquired by convolution to acquire an eigen transformation matrix W∈Rk×k, and acquire an output data Xi+1 through an element-level nonlinear activation function ReLu:
where, Rk×k denotes a k×k-dimensional real matrix space.
The eigenvectors {right arrow over (u1)}, {right arrow over (u2)}, . . . , {right arrow over (un)} are equivalent to a basis function of a graph signal after decomposition in the frequency domain. In order to realize the time domain convolution operation of the graph signal, the eigenvectors {right arrow over (ui)} are multiplied by corresponding filtered eigenvalues ĥ(λi), and all the eigenvectors acquired by the multiplication operation are superimposed to form a new graph signal, thereby realizing the convolution process of the graph signal, as shown in
Further, the extracting thermodynamic and kinetic information in a neighborhood of each coordinate measurement point of the BiW includes:
36) Connect the constructed graph convolutional layer by a residual into a deep residual graph convolutional network (DRGCN), where the DRGCN includes L basic residuals (
4) Input the thermodynamic and kinetic information of each coordinate measurement point into a DNN MLP_3; encode, by an encoder of the DNN MLP_3, the thermodynamic and kinetic information into a 3D coordinate space; and decode a final deformation at each coordinate measurement point; and output a predicted 3D vector of the deformation at each coordinate measurement point.
5) Optimize the BiW spot welding deformation prediction model. Specifically, in this embodiment, the optimizing the BiW spot welding deformation prediction model includes: process, by a L2-norm loss function, actual and predicted 3D vectors of the deformation at each coordinate measurement point; and optimize, by an adaptive movement estimation algorithm (Adam), L2-norm Loss_Avg of each coordinate measurement point as an optimization target for multiple times to acquire the BiW spot welding deformation prediction model based on the GCN.
In the present invention, the GCN is effectively optimized, such that it can learn the thermodynamic and kinetic representation and propagation mode implied by the process parameter features of the spot welds on the BiW and can realize rapid prediction of BiW deformations on a computer with GPU acceleration. The present invention can quickly predict the future overall deformation of the BiW by simply inputting the process parameter features of the spot welds.
The above described are only preferred embodiments illustrated for fully explaining the present invention, and the claimed scope of the present invention is not limited thereto. Equivalent substitutions or transformations made by those skilled in the art on the basis of the present invention are both within the claimed scope of the present invention. The claimed scope of the present invention shall be determined by the claims.
Number | Date | Country | Kind |
---|---|---|---|
202110617849.3 | Jun 2021 | CN | national |