NBOME Research

The NBOME works to accelerate research focusing on the validity and fairness of the COMLEX-USA series, and how it can evolve to meet the changing needs of the profession. Here you will find all of the NBOME's published and presented research, as well as research that has helped shape the formation and development of the NBOME's assessment tools.

Recently Published Research

"The predictive validity of MCAT scores and undergraduate GPA for COMLEX-USA licensure exam performance of students enrolled in osteopathic medical schools"

Journal of Osteopathic Medicine | July 2024

"A validity study of COMLEX-USA Level 3 with the new test design"

Journal of Osteopathic Medicine | March 2024

"How the Quadruple Aim Widens the Lens on the Transition to Residency"

Journal of Graduate Medical Education | December 2022

Published Research:
All NBOME Published Research

• The Predictive Validity of MCAT Scores and Undergraduate GPA for COMLEX-USA Licensure Exam Performance of Students Enrolled in Osteopathic Medical Schools

  Royal KD, Meyer C, Guercio E, Speicher M, Flamini J, Sandella JM, Tsai TH, Searcy C. The Predictive Validity of MCAT Scores and Undergraduate GPA for COMLEX-USA Licensure Exam Performance of Students Enrolled in Osteopathic Medical Schools. Journal of Osteopathic Medicine. · July 2024

• A Validity Study of COMLEX-USA Level 3 with the New Test Design

  Mao X, Boulet JR, Sandella JM, Oliverio M, Smith LM. A Validity Study of COMLEX-USA Level 3 with New Test Design. Journal of Osteopathic Medicine. 2024. doi:10.1515/jom-2023-0011 · March 2024

• How the Quadruple Aim Widens the Lens on the Transition to Residency

  Barone MA, Bienstock JL, Lovell E, Gimpel JR, Lin GL, Swails F, Mejicano GC. How the Quadruple Aim Widens the Lens on the Transition to Residency. Journal of Graduate Medical Education. 2022;14(6):634-638. doi:10.4300/JGME-D-22-00026.1 · December 2022

• The Predictive Value of the Residency AOBFP In-Service Exam, Produced and Administered by ACOFP

  Torres JW, Bowling JR, Zipp C, Williams N, Sandella JM, Martinez L, Moore B. The Predictive Value of the Residency AOBFP In-Service Exam, Produced and Administered by ACOFP. Family Medicine. 2022;54(8):615-620. doi:10.22454/FamMed.2022.156954 · September 2022

• UGRC 2021 recommendations on GME transition: pros and cons, opportunities and limitations

  Gimpel JR, Swails JL, Bienstock JL, Lin GL, Roett MA, Patel JK, Giang DW. UGRC 2021 recommendations on GME transition: pros and cons, opportunities and limitations. Journal of Osteopathic Medicine. 2022;122(9):461-464. doi:10.1515/jom-2021-0285 · September 2022

• The Use of Patient Simulations to Teach and Assess Clinical Competencies in Colleges of Podiatric Medicine: A Survey of US Podiatric Medical Schools

  Errichetti AM, Eckles R, Beto J, Gross GA, Lorion AE. The Use of Patient Simulations to Teach and Assess Clinical Competencies in Colleges of Podiatric Medicine: A Survey of US Podiatric Medical Schools. Journal of the American Podiatric Medical Association. 2022;112(2):20-077. doi:10.7547/20-077. · April 2022

• A Concordance Study of COMLEX-USA and USMLE Scores

  Barnum S, Craig B, Wang X, Sandella JM, Tsai T-H, Boulet JR, Wang Y. A Concordance Study of COMLEX-USA and USMLE Scores. Journal of Graduate Medical Education. 2022;14(1):53-59. doi:10.4300/JGME-D-21-00499.1 · February 2022

• An Exploration of an Integrated Approach for Enemy Item Identification

  Mao X, Zhang Q, Clem A. An Exploration of an Integrated Approach for Enemy Item Identification. International Journal of Intelligent Technologies and Applied Statistics. 2021:14(2):123-134. doi:10.6148/IJITAS.202106_14(2).0004 · August 2021

• Examining Concurrent Validity Between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation

  Craig B, Wang X, Sandella JM, Tsai T-H, Kuo D, Finch C. Examining concurrent validity between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation. Journal of Osteopathic Medicine. 2021. doi:10.1515/jom-2021-0007 · May 2021

• Meaningful Use of COMSAE Phase 1 in Preparation for COMLEX-USA Level 1

  Wang X, Maeda H, Craig B, Tsai T-H, Sandella JM, Fleury M. Meaningful use of COMSAE Phase 1 in preparation for COMLEX-USA Level 1. Journal of Osteopathic Medicine. 2021. doi:0.1515/jom-2020-0190 · April 2021

• An Investigation of the Relationship Between COMLEX-USA Licensure Examination Performance and State Licensing Board Disciplinary Actions

  Roberts W, Gross GA, Gimpel JR, Smith LL, Arnhart K, Pei X, Young A. An Investigation of the Relationship Between COMLEX-USA Licensure Examination Performance and State Licensing Board Disciplinary Actions. Academic Medicine. 2020;95(6):925-930. doi:10.1097/ACM.0000000000003046 · June 2020

• CATALYST: Piloting a Longitudinal Assessment and Learning Program for Board Recertification and Continuous Professional Development

  Horber DT, Flamini J, Gimpel JR, Tsai T-H, Shrum K, Hudson K. CATALYST: Piloting a Longitudinal Assessment and Learning Program for Board Recertification and Continuous Professional Development. Journal of Osteopathic Medicine. 2020;120(3):190-200. doi:10.7556/jaoa.2020.031 · March 2020

• 2019 United States Osteopathic Medical Regulatory Summit: Consensus, Recommendations, and Next Steps in Defining Osteopathic Distinctiveness

  Gimpel JR, Belanger SI, Knebl JA, LaBaere RJ, Shaffer DC, Shannon SC, Shears T, Steingard SA, Turner M, Williams DG. 2019 United States Osteopathic Medical Regulatory Summit: Consensus, Recommendations, and Next Steps in Defining Osteopathic Distinctiveness. Journal of Osteopathic Medicine. 2020;120(1):35-44. doi:10.7556/jaoa.2020.005 · January 2020

• A Validity Study of COMLEX-USA Level 2-CE and COMAT Clinical Subjects: Concurrent and Predictive Evidence

  Hudson KM, Tsai T-H, Finch C, Dickerman JL, Liu S, Shen L. A Validity Study of COMLEX-USA Level 2-CE and COMAT Clinical Subjects: Concurrent and Predictive Evidence. Journal of Graduate Medical Education. 2019;11(5):521-526. doi:10.4300/JGME-D-19-00157.1 · November 2019

• Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination

  Shao C, Liu S, Yang H, Tsai T-H. Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination. Applied Psychological Measurement. 2020;44(3):219-233. doi:10.1177/0146621619847169 · May 2019

• Enhancing COMLEX-USA: Evidence-based redesign of the osteopathic medical licensure examination program

  Horber DT, Gimpel JR. Enhancing COMLEX-USA: Evidence-based redesign of the osteopathic medical licensure examination program. Journal of Medical Regulation. 2018;104(3):11-18. doi:10.30770/2572-1852-104.3.11 · November 2018

• Association between performance on COMLEX-USA and the American College of Osteopathic Family Physicians in-service examination

  Hudson KM, Feinberg G, Hempstead L, Zipp C, Gimpel JR, Wang Y. Association between performance on COMLEX-USA and the American College of Osteopathic Family Physicians in-service examination. Journal of Graduate Medical Education. 2018;10(5):543-547. doi:10.4300/JGME-D-17-00997.1 · October 2018

• Evidence-based redesign of the COMLEX-USA series

  Gimpel JR, Horber DT, Sandella JM, Knebl JA, Thornburg JE. Evidence-based redesign of the COMLEX-USA series. Journal of the American Osteopathic Association. 2017;117(4):253-261. doi:10.7556/jaoa.2017.043 · April 2017

• The predictive validity of the National Board of Osteopathic Medical Examiners' COMLEX-USA examinations with regard to outcomes on American Board of Family Medicine examinations

  O’Neill TR, Peabody MR, Song H. The predictive validity of the National Board of Osteopathic Medical Examiners' COMLEX-USA examinations with regard to outcomes on American Board of Family Medicine examinations. Academic Medicine. 2016;91(11):1568-1575. doi:10.1097/ACM.0000000000001254 · November 2016

• Osteopathic manipulative technique scores on the COMLEX-USA Level 2-PE: An analysis of the skills assessed

  Smith LL, Xu W, Sandella JM, Dowling DJ. Osteopathic manipulative technique scores on the COMLEX-USA Level 2-PE: An analysis of the skills assessed. Journal of Osteopathic Medicine. 2016;116(6):392-397. doi:10.7556/jaoa.2016.080 · June 2016

• Preparation strategies of osteopathic medical students for the COMLEX-USA Level 2-PE

  Sandella JM, Peters A, Smith LL, Gimpel JR. Preparation strategies of osteopathic medical students for the COMLEX-USA Level 2-PE. Journal of Osteopathic Medicine. 2016;116(4):234-242. doi: 10.7556/jaoa.2016.048 · April 2016

• The use of COMLEX-USA and USMLE for residency applicant selection

  Sandella JM, Gimpel JR, Smith LL, Boulet JR. The use of COMLEX-USA and USMLE for residency applicant selection. Journal of Graduate Medical Education. 2016;8(3):358-363. doi:10.4300/JGME-D-15-00246.1 · March 2016

• Redefining competency domains for osteopathic medical practice

  Gimpel, JR. Redefining competency domains for osteopathic medical practice. Journal of Osteopathic Medicine. 2016;116(9):568-570. doi:10.7556/jaoa.2016.113 · January 2016

• Relationships between the Comprehensive Osteopathic Medical Achievement Test (COMAT) subject examinations and the COMLEX-USA level 2-cognitive evaluation

  Li F, Kalinowski K, Song H, Bates B. Relationships between the Comprehensive Osteopathic Medical Achievement Test (COMAT) subject examinations and the COMLEX-USA level 2-cognitive evaluation. Journal of Osteopathic Medicine. 2014;114(9):714-721. doi:10.7556/jaoa.2014.140 · September 2014

• Stratified item selection and exposure control in unidimensional adaptive testing in the presence of 2D data

  Kalinowski KE, Natesan P, Henson RK. Stratified item selection and exposure control in unidimensional adaptive testing in the presence of 2D data. Applied Psychological Measurement. 2014;38(7):563-576. doi:10.1177/0146621614536768 · July 2014

• Patterns of misrepresentation of clinical findings on patient notes during the COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Gallagher LA, Langenau EE. Patterns of misrepresentation of clinical findings on patient notes during the COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2014;114(1):22-29. doi:10.7556/jaoa.2014.004 · April 2014

• Consistency of interrater scoring of student performances of osteopathic manipulative treatment on COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Dowling DJ. Consistency of interrater scoring of student performances of osteopathic manipulative treatment on COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2014;114(4):253-258. doi:10.7556/jaoa.2014.050 · April 2014

• The relationship between COMLEX-USA scores and performance on the AOBEM Part I certifying exam

  Li F, Gimpel JR, Arenson E, Song H, Bates BP, Ludwin F. The relationship between COMLEX-USA scores and performance on the AOBEM Part I certifying exam. Journal of Osteopathic Medicine. 2014;114(4):260-266. doi:10.7556/jaoa.2014.051 · April 2014

• Keyboard data entry use among osteopathic medical students and residents

  Helstrom JM, Langenau EE, Sandella JM, Mote BL. Keyboard data entry use among osteopathic medical students and residents. Journal Osteopathic Medicine. 2014;114(4):274-82. doi:10.7556/jaoa.2014.053 · April 2014

• Investigation of standardized patient ratings of humanistic competence on a medical licensure examination using Many-Facet Rasch Measurement and generalizability theory

  Zhang X, Roberts WL. Investigation of standardized patient ratings of humanistic competence on a medical licensure examination using Many-Facet Rasch Measurement and generalizability theory. Advances in Health Sciences Education: Theory and Practice. 2013;18(5):929-944. doi:10.1007/s10459-012-9433-5 · December 2013

• Frequency of specific osteopathic manipulative treatment modalities used by candidates while taking COMLEX-USA level 2-PE

  Langenau EE, Dowling DJ, Dyer C, Roberts WL. Frequency of specific osteopathic manipulative treatment modalities used by candidates while taking COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2012;112(8):509-513. doi:10.7556/jaoa.2012.112.8.509 · August 2012

• Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors

  Langenau EE, Zhang X, Roberts WL, De Champlain AF, Boulet JR. Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors. Medical Education Online. 2012;17(1). doi:10.3402/meo.v17i0.18812 · July 2012

• An evaluation of cost and appropriateness of care as recommended by candidates on a national clinical skills examination

  Sandella JM, Boulet JR, Langenau EE. An evaluation of cost and appropriateness of care as recommended by candidates on a national clinical skills examination. Teaching and Learning in Medicine. 2012;24(4):303-308. doi:10.1080/10401334.2012.715259 · April 2012

• An investigation of construct validity of humanistic clinical skills on a medical licensure examination

  Roberts WL, Solomon M, Langenau E. An investigation of construct validity of humanistic clinical skills on a medical licensure examination. Patient Education and Counseling. 2011;82(2):214-221. doi:10.1016/j.pec.2010.03.016 · February 2012

• Fairness to students top priority

  Langenau EE, Sandella JM, Gimpel JR. Fairness to students top priority. Family Medicine. 2012;44(1):53-54. PMID:22241343 · January 2012

• Modeling relationships between traditional preadmission measures and clinical skills performance on a medical licensure examination

  Roberts WL, Pugliano G, Langenau EE, Boulet JR. Modeling relationships between traditional preadmission measures and clinical skills performance on a medical licensure examination. Advances in Health Sciences Education. 2011;17(3):403–417. doi:10.1007/s10459-011-9321-4 · August 2011

• Pass/fail patterns of candidates who failed COMLEX-USA level 2-PE because of misrepresentation of clinical findings on postencounter notes

  Langenau EE, Sandella JM. Pass/fail patterns of candidates who failed COMLEX-USA level 2-PE because of misrepresentation of clinical findings on postencounter notes. Journal of Osteopathic Medicine. 2011;111(7):432-436. doi:10.7556/jaoa.2011.111.7.432 · July 2011

• Relationship between standardized patient checklist item accuracy and performing arts experience

  Langenau EE, Dyer C, Roberts WL, De Champlain AF, Montrey DP, Sandella JM. Relationship between standardized patient checklist item accuracy and performing arts experience. Simulation in Healthcare. 2011;6(3):150-154. doi:10.1097/SIH.0b013e31821687b3 · June 2011

• Relationship between encounter time and candidate performance on COMLEX-USA level 2-PE

  Sandella JM, Roberts WL, Langenau EE. Relationship between encounter time and candidate performance on COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2011;111(1):38-43. doi:10.7556/jaoa.2011.111.1.38 · January 2011

• Relationships between high stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents

  Langenau EE, Pugliano G, Roberts WL. Relationships between high stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents. Medical Education Online. 2011;16(1). doi:10.3402/meo.v16i0.7362 · January 2011

• Quality assurance best practices for simulation-based examinations

  Furman GE, Smee S, Wilson C. Quality assurance best practices for simulation-based examinations. Simulation in Healthcare. 2010;5(4):226-231. doi:10.1097/SIH.0b013e3181da5c93 · April 2010

• Five-year summary of COMLEX-USA level 2-PE examinee performance and survey data

  Langenau E, Dyer C, Roberts WL, Wilson C, Gimpel JR. Five-year summary of COMLEX-USA level 2-PE examinee performance and survey data. Journal of Osteopathic Medicine. 2010;110(3):114-125. doi:10.7556/jaoa.2010.110.3.114 · March 2010

• Summary of ACOP (American College of Osteopathic Pediatricians) program directors’ annual reports for first-year residents and relationships between resident competency performance ratings and COMLEX-USA test scores

  Langenau EE, Pugliano G, Roberts BR, Hostoffer R. Summary of ACOP (American College of Osteopathic Pediatricians) program directors’ annual reports for first-year residents and relationships between resident competency performance ratings and COMLEX-USA test scores. Electronic Journal of the American College of Osteopathic Physicians. 2010;2(7). https://eric.ed.gov/?id=ED514030 · February 2010

• Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examination

  Roberts WL, McKinley DW, Boulet JR. Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examination. Advances in Health Sciences Education: Theory and Practice. 2010;15(2):219-227. doi:10.1007/s10459-009-9193-z · February 2010

• Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE)

  Weidner AC, Gimpel JR, Boulet JR, Solomon M. Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE). Teaching and Learning in Medicine. 2010;22(1):8-15. doi:10.1080/10401330903445604 · January 2010

• Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examination

  Sandella JM, Roberts WL, Gallagher LA, Gimpel JR, Langenau EE, Boulet JR. Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examination. Academic Medicine. 2009;84(10 Suppl):S70-73. doi:10.1097/ACM.0b013e3181b37e36 · October 2009

• The use of standardized patient assessments for certification and licensure decisions

  Boulet JR, Smee SM, Dillon GF, Gimpel JR. The use of standardized patient assessments for certification and licensure decisions. Simulation in Healthcare.2009;4(1):35-42. doi:10.1097/SIH.0b013e318182fc6c · January 2009

• Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicine

  Gimpel JR, Weidner AC, Boulet JR, Wilson C, Errichetti AM. Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicine. Journal of Osteopathic Medicine. 2007;107(12):557-561. doi:10.7556/jaoa.2007.107.12.557 · December 2007

• Relationships between scores on the COMLEX-USA level 2-performance evaluation and selected school-based performance measures

  Baker HH, Cope MK, Adelman MA, Schuler S, Foster RW, Gimpel JR. Relationships between scores on the COMLEX-USA level 2-performance evaluation and selected school-based performance measures. Journal of Osteopathic Medicine. 2006;109(5):290-295. doi:10.7556/jaoa.2006.106.5.290 · May 2006

• Survey on the clinical skills of osteopathic medical students

  Gimpel JR, Boulet JR, Weidner AC. Survey on the clinical skills of osteopathic medical students. Journal of Osteopathic Medicine. 2006;106(5):296-301. doi:10.7556/jaoa.2006.106.5.296 · May 2006

• Assessing the ability of medical students to perform osteopathic manipulative treatment techniques

  Boulet JR, Gimpel JR, Dowling DJ, Finley M. Assessing the ability of medical students to perform osteopathic manipulative treatment techniques. Journal of Osteopathic Medicine. 2004;104(5):203-211. doi:10.7556/jaoa.2004.104.5.203 · May 2004

• Predictive validity of osteopathic medical licensing examinations for osteopathic medical knowledge measured by graduate written examinations

  Cavalieri TA, Shen L, Slick GL. Predictive validity of osteopathic medical licensing examinations for osteopathic medical knowledge measured by graduate written examinations. Journal of Osteopathic Medicine. 2003;103(7):337-342. doi:10.7556/jaoa.2003.103.7.337 · July 2003

• Evaluating the clinical skills of osteopathic medical students

  Gimpel JR, Boulet DO, Errichetti AM. Evaluating the clinical skills of osteopathic medical students. Journal of Osteopathic Medicine. 2003;103(6):267-279. doi:10.7556/jaoa.2003.103.6.267 · June 2003

• Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians

  JR Boulet, JR Gimpel, AM Errichetti, FG Meoli. Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians. Journal of Osteopathic Medicine. 2003;103(5):225-231. doi:10.7556/jaoa.2003.103.5.225 · May 2003

• Relationship of osteopathic medical licensure examinations with undergraduate admission measures and predictive value of identifying future performance in osteopathic principles and practice/osteopathic manipulative medicine courses and rotations

  Meoli FG, Wallace WS, Kaiser-Smith J, Shen L. Relationship of osteopathic medical licensure examinations with undergraduate admission measures and predictive value of identifying future performance in osteopathic principles and practice/osteopathic manipulative medicine courses and rotations. Journal of Osteopathic Medicine. 2002;102(11):615-620. doi:10.7556/jaoa.2002.102.11.615 · November 2002

• State of the art in standardized patient programs: A survey of osteopathic medical schools

  Errichetti AM, Gimpel JR, Boulet JR. State of the art in standardized patient programs: A survey of osteopathic medical schools. Journal of Osteopathic Medicine. 2002;102(11):627-631. doi:10.7556/jaoa.2002.102.11.615 · November 2002