This study was designed to investigate the reliability of classification decisions in the fundamental motor skill domain using the Objectives-Based Motor Skill Assessment Instrument. Nonhandicapped (n = 80) and mentally retarded (n = 40) students in the age range of 3 through 10 were assessed on two separate days. Two likely domain mastery criterion levels were used (85 and 70% of the total test score). The proportion of agreement (P) and Kappa (K) were the reliability indices employed. The reliability estimates for the nonhandicapped group were P = .89 and K = .78 using the 85% mastery criterion and P = .92 and K = .84 for the 70% criterion. The reliability estimates obtained for the mentally retarded group using an 85% criterion were P = .87 and K = .62 and for the 70% criterion P = .93 and K = .83. Based on these results the criterion-referenced test appears to consistently classify students on two occasions as masters or non-masters of fundamental motor skills using either cut-off score.