Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination

July 25, 2019

Mathematical programming has been widely used by professionals in testing agencies as a tool to automatically construct equivalent test forms. This study introduces the linear programming capabilities (modeling language plus solvers) of SAS Operations Research as a platform to rigorously engineer tests on specifications in an automated manner. To that end, real items from a medical licensing test are used to demonstrate the simultaneous assembly of multiple parallel test forms under two separate linear programming scenarios: (a) constraint satisfaction (one problem) and (b) combinatorial optimization (three problems). In the four problems from the two scenarios, the forms are assembled subjected to various content and psychometric constraints. Assembled forms are next assessed using psychometric methods to ensure equivalence about all test specifications. Results from this study support SAS as a reliable and easy-to-implement platform for form assembly. Annotated codes are provided to promote further research and operational work in this area.

To read this article as it was initially published in Applied Psychological Measurement click here.

Contributed by:

Can Shao | Research Scientist | Curriculum Associates

Hongwei “Patrick” Yang | Assistant Professor | The University of West Florida

 Silu Liu | Epidemiological Research Manager | DCHealth Technology

Tsung-Hsun “Edward” Tsai, PhD | Associate Vice President of Assessment Services and Research | NBOME