NBOME Research

The NBOME works to accelerate research focusing on the validity and fairness of the COMLEX-USA series, and how it can evolve to meet the changing needs of the profession. Here you will find all of the NBOME's published and presented research, as well as research that has helped shape the formation and development of the NBOME's assessment tools.

Recently Published Research

"How the Quadruple Aim Widens the Lens on the Transition to Residency"

Journal of Graduate Medical Education | December 2022

"The Predictive Value of the Residency AOBFP In-Service Exam, Produced and Administered by ACOFP"

Family Medicine | September 2022

"UGRC 2021 recommendations on GME transition: pros and cons, opportunities and limitations"

Journal of Osteopathic Medicine | September 2022

Published Research:
Research on COMLEX-USA Computer-Based Examinations

• A Validity Study of COMLEX-USA Level 3 with the New Test Design

  Mao X, Boulet JR, Sandella JM, Oliverio M, Smith LM. A Validity Study of COMLEX-USA Level 3 with New Test Design. Journal of Osteopathic Medicine. In press. · October 2023

• A Concordance Study of COMLEX-USA and USMLE Scores

  Barnum S, Craig B, Wang X, Sandella JM, Tsai T-H, Boulet JR, Wang Y. A Concordance Study of COMLEX-USA and USMLE Scores. Journal of Graduate Medical Education. 2022;14(1):53-59. doi:10.4300/JGME-D-21-00499.1 · February 2022

• An Exploration of an Integrated Approach for Enemy Item Identification

  Mao X, Zhang Q, Clem A. An Exploration of an Integrated Approach for Enemy Item Identification. International Journal of Intelligent Technologies and Applied Statistics. 2021:14(2):123-134. doi:10.6148/IJITAS.202106_14(2).0004 · August 2021

• Examining Concurrent Validity Between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation

  Craig B, Wang X, Sandella JM, Tsai T-H, Kuo D, Finch C. Examining concurrent validity between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation. Journal of Osteopathic Medicine. 2021. doi:10.1515/jom-2021-0007 · May 2021

• Meaningful Use of COMSAE Phase 1 in Preparation for COMLEX-USA Level 1

  Wang X, Maeda H, Craig B, Tsai T-H, Sandella JM, Fleury M. Meaningful use of COMSAE Phase 1 in preparation for COMLEX-USA Level 1. Journal of Osteopathic Medicine. 2021. doi:0.1515/jom-2020-0190 · April 2021

• A Validity Study of COMLEX-USA Level 2-CE and COMAT Clinical Subjects: Concurrent and Predictive Evidence

  Hudson KM, Tsai T-H, Finch C, Dickerman JL, Liu S, Shen L. A Validity Study of COMLEX-USA Level 2-CE and COMAT Clinical Subjects: Concurrent and Predictive Evidence. Journal of Graduate Medical Education. 2019;11(5):521-526. doi:10.4300/JGME-D-19-00157.1 · November 2019

• Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination

  Shao C, Liu S, Yang H, Tsai T-H. Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination. Applied Psychological Measurement. 2020;44(3):219-233. doi:10.1177/0146621619847169 · May 2019

• Association between performance on COMLEX-USA and the American College of Osteopathic Family Physicians in-service examination

  Hudson KM, Feinberg G, Hempstead L, Zipp C, Gimpel JR, Wang Y. Association between performance on COMLEX-USA and the American College of Osteopathic Family Physicians in-service examination. Journal of Graduate Medical Education. 2018;10(5):543-547. doi:10.4300/JGME-D-17-00997.1 · October 2018

• The predictive validity of the National Board of Osteopathic Medical Examiners' COMLEX-USA examinations with regard to outcomes on American Board of Family Medicine examinations

  O’Neill TR, Peabody MR, Song H. The predictive validity of the National Board of Osteopathic Medical Examiners' COMLEX-USA examinations with regard to outcomes on American Board of Family Medicine examinations. Academic Medicine. 2016;91(11):1568-1575. doi:10.1097/ACM.0000000000001254 · November 2016

• The use of COMLEX-USA and USMLE for residency applicant selection

  Sandella JM, Gimpel JR, Smith LL, Boulet JR. The use of COMLEX-USA and USMLE for residency applicant selection. Journal of Graduate Medical Education. 2016;8(3):358-363. doi:10.4300/JGME-D-15-00246.1 · March 2016

• Relationships between the Comprehensive Osteopathic Medical Achievement Test (COMAT) subject examinations and the COMLEX-USA level 2-cognitive evaluation

  Li F, Kalinowski K, Song H, Bates B. Relationships between the Comprehensive Osteopathic Medical Achievement Test (COMAT) subject examinations and the COMLEX-USA level 2-cognitive evaluation. Journal of Osteopathic Medicine. 2014;114(9):714-721. doi:10.7556/jaoa.2014.140 · September 2014

• The relationship between COMLEX-USA scores and performance on the AOBEM Part I certifying exam

  Li F, Gimpel JR, Arenson E, Song H, Bates BP, Ludwin F. The relationship between COMLEX-USA scores and performance on the AOBEM Part I certifying exam. Journal of Osteopathic Medicine. 2014;114(4):260-266. doi:10.7556/jaoa.2014.051 · April 2014

• Summary of ACOP (American College of Osteopathic Pediatricians) program directors’ annual reports for first-year residents and relationships between resident competency performance ratings and COMLEX-USA test scores

  Langenau EE, Pugliano G, Roberts BR, Hostoffer R. Summary of ACOP (American College of Osteopathic Pediatricians) program directors’ annual reports for first-year residents and relationships between resident competency performance ratings and COMLEX-USA test scores. Electronic Journal of the American College of Osteopathic Physicians. 2010;2(7). https://eric.ed.gov/?id=ED514030 · February 2010

• Student performance on levels 1 and 2-CE of COMLEX-USA: Do elective upper-level undergraduate science courses matter?

  Wong SK, Ramirez J, Helf SC. Student performance on levels 1 and 2-CE of COMLEX-USA: Do elective upper-level undergraduate science courses matter? Journal of Osteopathic Medicine. 2009;109(11):592-598. doi:10.7556/jaoa.2009.109.11.592 · November 2009

• COMLEX-USA and in-service examination scores: Tools for evaluating medical knowledge among residents

  Sevensma SC, Navarre G, Richards RK. COMLEX-USA and in-service examination scores: Tools for evaluating medical knowledge among residents. Journal of Osteopathic Medicine. 2008;108(12):713-716. doi:10.7556/jaoa.2008.108.12.713 · December 2008

• Does the medical college admission test predict global academic performance in osteopathic medical school?

  Evans P, Wen FK. Does the medical college admission test predict global academic performance in osteopathic medical school? Journal of Osteopathic Medicine. 2007;107(4):157-162. doi:10.7556/jaoa.2007.107.4.157 · April 2007

• Relation between variables of preadmission, medical school performance, and COMLEX–USA levels 1 and 2 performance

  Dixon D. Relation between variables of preadmission, medical school performance, and COMLEX–USA levels 1 and 2 performance. Journal of Osteopathic Medicine. 2004;4(8):332-336. doi:10.7556/jaoa.2004.104.8.332 · April 2004

• Relations between academic performance by medical students and COMLEX–USA level 2: A multisite analysis

  Evans P, Goodson LB, Schoffman SI, Baker HH. Relations between academic performance by medical students and COMLEX–USA level 2: A multisite analysis. Journal of Osteopathic Medicine. 2003;103(11):551-556. doi:10.7556/jaoa.2003.103.11.551 · November 2003

• Predictive validity of osteopathic medical licensing examinations for osteopathic medical knowledge measured by graduate written examinations

  Cavalieri TA, Shen L, Slick GL. Predictive validity of osteopathic medical licensing examinations for osteopathic medical knowledge measured by graduate written examinations. Journal of Osteopathic Medicine. 2003;103(7):337-342. doi:10.7556/jaoa.2003.103.7.337 · July 2003

• Relationship of osteopathic medical licensure examinations with undergraduate admission measures and predictive value of identifying future performance in osteopathic principles and practice/osteopathic manipulative medicine courses and rotations

  Meoli FG, Wallace WS, Kaiser-Smith J, Shen L. Relationship of osteopathic medical licensure examinations with undergraduate admission measures and predictive value of identifying future performance in osteopathic principles and practice/osteopathic manipulative medicine courses and rotations. Journal of Osteopathic Medicine. 2002;102(11):615-620. doi:10.7556/jaoa.2002.102.11.615 · November 2002

• Correlation of scores for the comprehensive osteopathic medical licensing examination with osteopathic medical school grades

  Hartman SE, Bates BP, Sprafka SA. Correlation of scores for the comprehensive osteopathic medical licensing examination with osteopathic medical school grades. Journal of Osteopathic Medicine. 2001;101(6):347-349. doi:10.7556/jaoa.2001.101.6.347 · June 2001

• Relationship between academic achievement and COMLEX-USA level 1 performance: A multisite study

  Baker HH, Foster RW, Bates BP, et al. Relationship between academic achievement and COMLEX-USA level 1 performance: A multisite study. Journal of Osteopathic Medicine. 2000;100(4):238-242. doi:10.7556/jaoa.2000.100.4.238 · April 2000

• Relationship of preadmission variables and first- and second-year course performance to performance on the National Board of Osteopathic Medical Examiners’ COMLEX–USA level 1 examination

  Baker HH, Cope MK, Fisk R, Gorby JN, Foster RW. Relationship of preadmission variables and first- and second-year course performance to performance on the National Board of Osteopathic Medical Examiners’ COMLEX–USA level 1 examination. Journal of Osteopathic Medicine. 2000;100(3):153-161. doi:10.7556/jaoa.2000.100.3.153 · March 2000

• The credibility and comparability of standards. Applied Measurement in Education

  Norcini JJ, Shea JA. The credibility and comparability of standards. Applied Measurement in Education. 1997;10(1):39–59. doi: 10.1207/s15324818ame1001_3 · January 1997