Generalized least‐squares parameter estimation from multiequation implicit models
Author:
- 1 October 2003
- journal article
- process systems-engineering
- Published by Wiley in AIChE Journal
- Vol. 49 (10) , 2577-2594
Abstract
Maximum likelihood fit of nonlinear, implicit, multiple‐response models to data containing normally distributed random errors can be carried out by a combination of the Gauss‐Newton generalized nonlinear least‐square algorithm first described by Britt and Luecke in 1973, with a Fletcher‐Reeves conjugate gradient search for initial parameter estimates. The convergence of the algorithm is further improved by adding a step‐limiting procedure that ensures a reduction in the objective function for each iteration. Multiple‐equation regression methods appropriate to the solution of explicit fixed‐regressor models are derived from this general treatment as special cases. These include weighted nonlinear least squares (where the covariance matrix of the response is known), and uniformly weighted nonlinear least squares (where the responses are uncorrelated and characterized by a single common variance). Alternative methods for fixed‐regressor fits of explicit multiequation models with an unknown covariance matrix of the responses are also considered. The moment‐matrix determinant criterion appropriate in such situations is also efficiently minimized by use of the conjugate‐gradient algorithm, which is considerably less sensitive to the accuracy of the initial parameter estimate than the more usual Gauss‐Newton methods. The performance of the new algorithm for models defined by one, two, and three implicit functional constraints per point is illustrated by random‐regressor fits of isothermal p−X and p−X−Y vapor–liquid equilibrium data, and ternary liquid–liquid equilibrium data, respectively.Keywords
This publication has 66 references indexed in Scilit:
- Nonlinear Regression1989
- Nonlinear Regression Analysis and Its Applications1988
- Applicability and power of complex nonlinear least squares for the analysis of impedance and admittance dataJournal of Electroanalytical Chemistry and Interfacial Electrochemistry, 1982
- Evaluation of parameters for nonlinear thermodynamic modelsAIChE Journal, 1978
- A Rapidly Convergent Iterative Method for the Solution of the Generalised Nonlinear Least Squares ProblemThe Computer Journal, 1972
- LEAST-SQUARES FITTING OF A STRAIGHT LINECanadian Journal of Physics, 1966
- A Simplex Method for Function MinimizationThe Computer Journal, 1965
- `` Direct Search'' Solution of Numerical and Statistical ProblemsJournal of the ACM, 1961
- IV.—On Least Squares and Linear Combination of ObservationsProceedings of the Royal Society of Edinburgh, 1936
- LIII. On lines and planes of closest fit to systems of points in spaceJournal of Computers in Education, 1901