High Dimensional Model Representation With Principal Component Analysis
- 17 October 2013
- journal article
- Published by Wiley in Journal of Mechanical Design
- Vol. 136 (1) , 011003
Abstract
In engineering design, spending excessive amount of time on physical experiments or expensive simulations makes the design costly and lengthy. This issue exacerbates when the design problem has a large number of inputs, or of high dimension. High dimensional model representation (HDMR) is one powerful method in approximating high dimensional, expensive, black-box (HEB) problems. One existing HDMR implementation, random sampling HDMR (RS-HDMR), can build an HDMR model from random sample points with a linear combination of basis functions. The most critical issue in RS-HDMR is that calculating the coefficients for the basis functions includes integrals that are approximated by Monte Carlo summations, which are error prone with limited samples and especially with nonuniform sampling. In this paper, a new approach based on principal component analysis (PCA), called PCA-HDMR, is proposed for finding the coefficients that provide the best linear combination of the bases with minimum error and without using any integral. Several benchmark problems of different dimensionalities and one engineering problem are modeled using the method and the results are compared with RS-HDMR results. In all problems with both uniform and nonuniform sampling, PCA-HDMR built more accurate models than RS-HDMR for a given set of sample points.Keywords
This publication has 19 references indexed in Scilit:
- Global response approximation with radial basis functionsEngineering Optimization, 2006
- Ratio control variate method for efficiently determining high‐dimensional model representationsJournal of Computational Chemistry, 2006
- Review of Metamodeling Techniques in Support of Engineering Design OptimizationJournal of Mechanical Design, 2006
- Random Sampling-High Dimensional Model Representation (RS-HDMR) and Orthogonality of Its Different Order Component FunctionsThe Journal of Physical Chemistry A, 2006
- Multicut‐HDMR with an application to an ionospheric modelJournal of Computational Chemistry, 2004
- A recursive algorithm for finding HDMR terms for sensitivity analysisComputer Physics Communications, 2004
- Practical Approaches To Construct RS-HDMR Component FunctionsThe Journal of Physical Chemistry A, 2002
- High Dimensional Model RepresentationsThe Journal of Physical Chemistry A, 2001
- Multivariate Adaptive Regression SplinesThe Annals of Statistics, 1991
- Test examples for nonlinear programming codesJournal of Optimization Theory and Applications, 1980