Supplementation of deep neural networks with simplified physics-based features to increase model prediction accuracy

Clinkinbeard, Nicholus R.; Hashemi, Nicole

Supplementation of deep neural networks with simplified physics-based features to increase model prediction accuracy

File

2022-HashemiNicole-SupplementationDeep.pdf (1.49 MB)

Date

2022

Authors

Clinkinbeard, Nicholus R.

Hashemi, Nicole

Publisher

arXiv

Authors

Person

Hashemi, Nicole

Associate Professor

Organizational Units

Organizational Unit

Mechanical Engineering

The Department of Mechanical Engineering at Iowa State University is where innovation thrives and the impossible is made possible. This is where your passion for problem-solving and hands-on learning can make a real difference in our world. Whether you’re helping improve the environment, creating safer automobiles, or advancing medical technologies, and athletic performance, the Department of Mechanical Engineering gives you the tools and talent to blaze your own trail to an amazing career.

Organizational Unit

Biomedical Sciences

Organizational Unit

Ames National Laboratory

Organizational Unit

Bioeconomy Institute

Department

Mechanical EngineeringBiomedical SciencesAmes National LaboratoryBioeconomy Institute

Abstract

To improve predictive models for STEM applications, supplemental physics-based features computed from input parameters are introduced into single and multiple layers of a deep neural network (DNN). While many studies focus on informing DNNs with physics through differential equations or numerical simulation, much may be gained through integration of simplified relationships. To evaluate this hypothesis, a number of thin rectangular plates simply-supported on all edges are simulated for five materials. With plate dimensions and material properties as input features and fundamental natural frequency as the sole output, predictive performance of a purely data-driven DNN-based model is compared with models using additional inputs computed from simplified physical relationships among baseline parameters, namely plate weight, modulus of rigidity, and shear modulus. To better understand the benefit to model accuracy, these additional features are injected into various single and multiple DNN layers, and trained with four different dataset sizes. When these physics-enhanced models are evaluated against independent data of the same materials and similar dimensions to the training sets, supplementation with simplified physics-based parameters provides little reduction in prediction error over the baseline for models trained with dataset sizes of 60 and greater, although small improvement from 19.3% to 16.1% occurs when trained with a sparse size of 30. Conversely, notable accuracy gains occur when the independent test data is of material and dimensions not conforming to the training set. Specifically, when physics-enhanced data is injected into multiple DNN layers, reductions in error from 33.2% to 19.6%, 34.9% to 19.9%, 35.8% to 22.4%, and 43.0% to 28.4% are achieved for training dataset sizes of 261, 117, 60, and 30, respectively, demonstrating attainment of a degree of generalizability.

Comments

"This is a pre-print of the article Clinkinbeard, Nicholus R., Prof Hashemi, and N. Nicole. "Supplementation of deep neural networks with simplified physics-based features to increase model prediction accuracy." arXiv preprint arXiv:2204.06764 (2022). DOI: 10.48550/arXiv.2204.06764. Copyright 2022 The Authors. Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0). Posted with permission.