Verification of the Measurement Properties of an MST Test: An Alternative Ex-Post Approach

Emanuela Botta

doi:10.24018/ejedu.2022.3.3.337

Emanuela Botta

Abstract Views
127

Downloads
150

Citations

Share

This article briefly describes the research (Botta, 2021) that led to the construction and field administration of the first multilevel adaptive test (MST Test) in Italy and reports the results of a new research project that aimed at verifying ex-post the measurement properties of the constructed test. The test was designed for the estimation of students' abilities in mathematics in grade 10 and was administered to a sample of 4,132 students. In the paper, we analyze with two paired-samples t-tests the changes in the mean of the students' ability estimation and the changes in the relative standard error of the mean as they move from the first to the last level of the test. The results demonstrate the validity of the adaptive algorithm underlying the implementation of the test. The results obtained are also a further empirical verification that in an MST test the calculation of the true score is sufficiently accurate for the purpose of selecting the next testlet, as stated by Luecht and Nungester (1998).

Keywords: Adaptive Test, Mathematics Ability, Measurement Accuracy, MST Test

Botta, E. (2021) a. Sperimentazione di un modello adattativo multilivello per la stima delle abilità in matematica nelle rilevazioni su larga scala, Roma: Nuova Cultura | Google Scholar
Hambleton, R. K., Zaal, J. N., e Pieters, P. (1991). Computerized adaptive testing: Theory, applications, and standards. In R. K. Hambleton e J. N. Zaal (Eds.), Advances in educational and psychological testing, Norwell, MA: Kluwer, pp. 341–366 | Google Scholar
Luecht, R., Brumfield, T., e Breithaupt, K. (2006). A testlet assembly design for adaptive multistage tests. Applied Measurement in Education, 19(3), pp. 189-202. | Google Scholar
Luecht, R. M., e Nungester, R. (1998). Some practical examples of computer-adaptive sequential testing. Journal of Educational Measurement, 35, 229-249. | Google Scholar
Rasch G. (1960), Probabilistic Models for Some Intelligence and Attainment Tests. Danish Institute for Educational Research, Copenhagen | Google Scholar
Sireci, S. G. (2004). Computerized-adaptive testing: An introduction. In J. Wall e G. Walz (Eds). Measuring up: Assessment issues for teachers, counselors, and administrators. Greensboro, NC: CAPS Press, pp. 685-694. | Google Scholar
Weiss, D. J. (1985). Adaptive testing by computer. Journal of consulting and clinical psychology, 53(6), p. 774 | Google Scholar
Zheng Y., Wang C., Culbertson M. J. e Chang H.H. (2014). Overview of Test As-sembly Methods in Multistage Testing. In D. Yan, A.A. von Davier, e Lewis C., Computerized multistage testing: Theory and applications (pp. 87-99). New York: CRC Press | Google Scholar

How to Cite

Botta, E. (2022). Verification of the Measurement Properties of an MST Test: An Alternative Ex-Post Approach. European Journal of Education and Pedagogy, 3(3), 7–11. https://doi.org/10.24018/ejedu.2022.3.3.337