Fitting multilevel models with ordinal outcomes: Performance of alternative specifications and methods of estimation.
Authors:
- Daniel J. BauerDBDaniel J. Bauer
- Sonya K. SterbaSSSonya K. Sterba
- 1 January 2011
- journal article
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 16 (4) , 373-390
Abstract
Previous research has compared methods of estimation for fitting multilevel models to binary data, but there are reasons to believe that the results will not always generalize to the ordinal case. This article thus evaluates (a) whether and when fitting multilevel linear models to ordinal outcome data is justified and (b) which estimator to employ when instead fitting multilevel cumulative logit models to ordinal data, maximum likelihood (ML), or penalized quasi-likelihood (PQL). ML and PQL are compared across variations in sample size, magnitude of variance components, number of outcome categories, and distribution shape. Fitting a multilevel linear model to ordinal outcomes is shown to be inferior in virtually all circumstances. PQL performance improves markedly with the number of ordinal categories, regardless of distribution shape. In contrast to binary data, PQL often performs as well as ML when used with ordinal data. Further, the performance of PQL is typically superior to ML when the data include a small to moderate number of clusters (i.e., ≤ 50 clusters).Keywords
Funding Information
- National Institute on Drug Abuse (DA013148)
- National Science Foundation (SES-0716555)
This publication has 9 references indexed in Scilit:
- People are variables too: Multilevel structural equations modeling.Psychological Methods, 2005
- Recommended effect size statistics for repeated measures designsBehavior Research Methods, 2005
- Have Multilevel Models Been Structural Equation Models All Along?Multivariate Behavioral Research, 2003
- Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs.Psychological Methods, 2003
- A simple method for converting an odds ratio to effect size for use in meta-analysisStatistics in Medicine, 2000
- Empirical Bayes Estimation of Random Effects Parameters in Mixed Effects Logistic Regression ModelsBiometrics, 1999
- Collapsing Ordered Outcome Categories: A Note of ConcernAmerican Journal of Epidemiology, 1996
- A Random-Effects Ordinal Regression Model for Multilevel Analysis1994
- A Study of the Sampling Variability and z-Values of Parameter Estimates From Misspecified Structural Equation ModelsMultivariate Behavioral Research, 1989