This paper re-examined the validity of the content coverage measure, which is a proxy for opportunity to learn (OTL), by employing a confirmatory factor analysis (CFA) on five multiply-imputed datasets. Data for this study were drawn from the PISA 2012 Malaysian sample. Specifically, we used a sample of 4247 students from 135 Malaysian national secondary schools. The PISA 2012 content coverage measure comprised four constructs, namely experience with applied mathematics tasks at school, experience with pure mathematics tasks at school, familiarity with mathematical concepts and experience with various types of problems at school. Prior to conducting the CFA, missing data resulted from student questionnaire rotation design were multiply-imputed using predictive mean matching (PMM) estimation via R-package Multivariate Imputation by Chained Equations (MICE). Subsequently, we conducted the CFA using R-package lavaan.survey that incorporates multiply-imputed data and survey weights as well as non-normality of data through its Maximum Likelihood Robust (MLR) estimation. After a few cycles of theory-guided model specification involving deletion of several items with low factor loadings, examination of various fit indices, and inspections of Composite Reliability (CR) and Average Variance Extracted (AVE) values, results showed that the final congeneric CFA model for the content coverage measure provided good fit to the data.
Adams, R. J., Lietz, P., & Berezner, A. (2013). On the use of rotated context questionnaires in conjunction with multilevel item response models. Large-Scale Assessments in Education, 1(5), 1–27.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. In D. A. Kenny (Ed.), Methodology in the social sciences. New York, USA: The Guilford Press.
Chang, L. C. (1984). The effects of teacher and student perceptions of opportunity to learn on achievement in beginning algebra in five countries. University of Illinois.
Gearhart, M., Saxe, G. B. G. B., Seltzer, M., Schlackman, J., Ching, C. C. C., Nasir, N., Rhine, S., Sloan, T. F. (1999). Opportunities to learn fractions in elementary mathematics classrooms. Journal for Research in Mathematics Education, 30(3), 286–315.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. . (2010). Multivariate analysis (7th ed.). Pearson Prentice Hall.
Herman, J. L., & Klein, D. C. D. (1997). Assessing opportunity to learn: a California example (Vol. 453). Los Angeles, CA.
International Association for the Evaluation of Educational, & Achievement. (2011). TIMSS 2011 Assessment Frameworks. Trends in International Mathematics and Science Study 2011.
Jaafar, S. B. (2006). An alternative approach to measuring opportunity-to-learn in high school classes. Alberta Journal of Educational Research, 52(2), 107–126.
Kaplan, D., & Su, D. (2016). On matrix sampling and imputation of context questionnaires with implications for the generation of plausible values in large-scale assessments. Journal of Educational and Behavioral Statistics, 41(1), 57–80.
Kurz, A., Elliott, S. N., Wehby, J. H., & Smithson, J. L. (2010). Alignment of the intended, planned, and enacted curriculum in general and special education and its relation to student achievement. The Journal of Special Education.
Martinez, J. F., Bailey, A. L., Kerr, D., Huang, B. H., & Beaurgard, S. (2010). Measuring opportunity to learn and academic language exposure for english language learners in elementary science classrooms. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing (CRESST).
McDonnell, L. M. (1995). Opportunity to learn as a research concept and a policy instrument. Educational Evaluation and Policy Analysis.
Oberski, D. L. (2014). lavaan.survey: An R package for complex survey analysis of structural equation models. Journal of Statistical Software, 57(1), 1–27.
OECD. (2012). PISA 2012 technical report. Paris, Perancis: OECD Publishing.
Pornprasertmanit, S., Lee, J., & Preacher, K. J. (2014). Ignoring clustering in confirmatory factor analysis: some consequences for model fit and standardized parameter estimates. Multivariate Behavioral Research, 49, 518–543.
Reeves, C., Carnoy, M., & Addy, N. (2013). Comparing opportunity to learn and student achievement gains in southern african primary schools: a new approach. International Journal of Educational Development, 33(5), 426–435.
Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581–292.
Schmidt, W. H., Alexander, T. J., & Zoido, P. (2014). Schooling matters: opportunity to learn in PISA 2012 (No. 95). Michigan State, USA: OECD and Michigan State University.
Sellin, N., & Keeves, J. P. (1997). Path analysis with latent variables. In Educational Research, Methdology And Measurement: An International Handbook. Oxford: Pergamon Press.
Stevens, F. I. (1993). Applying an opportunity-to-learn conceptual framework to the investigation of the effects secondary analyses of multiple-case-study data summary. The Journal of Negro Education, 62(3), 232–248.
Stevens, F. I. (1996). The need to expand the opportunity to learn conceptual framework: should students, parents and school resources be included? In The Annual Meeting of the American Educational Research Association. New York: American Educational Research Association.
Wang, J. (1998). Opportunity to learn: the impacts and policy implications. Educational Evaluation and Policy Analysis.
Winfield, L. F. (1993). Investigating test content and curriculum content overlap to assess opportunity to learn. The Journal of Negro Education, 62(3), 288–310.
Ayob, A., Yasin, R. M., Shuhaimi, H., & Yatin, S. F. M. (2017). A Confirmatory Factor Analysis of Content Coverage Measure Using Multiply Imputed Datasets. International Journal of Academic Research in Business and Social Sciences, 7(4), 1072-1082.
Copyright: © 2017 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode
