NBOME Research

The NBOME works to accelerate research focusing on the validity and fairness of the COMLEX-USA series, and how it can evolve to meet the changing needs of the profession. Here you will find all of the NBOME's published and presented research, as well as research that has helped shape the formation and development of the NBOME's assessment tools.

Recently Published Research

"The predictive validity of MCAT scores and undergraduate GPA for COMLEX-USA licensure exam performance of students enrolled in osteopathic medical schools"

Journal of Osteopathic Medicine | July 2024

"A validity study of COMLEX-USA Level 3 with the new test design"

Journal of Osteopathic Medicine | March 2024

"How the Quadruple Aim Widens the Lens on the Transition to Residency"

Journal of Graduate Medical Education | December 2022

Published Research:
Research on COMLEX-USA Level 2-PE

• Examining Concurrent Validity Between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation

  Craig B, Wang X, Sandella JM, Tsai T-H, Kuo D, Finch C. Examining concurrent validity between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation. Journal of Osteopathic Medicine. 2021. doi:10.1515/jom-2021-0007 · May 2021

• An Investigation of the Relationship Between COMLEX-USA Licensure Examination Performance and State Licensing Board Disciplinary Actions

  Roberts W, Gross GA, Gimpel JR, Smith LL, Arnhart K, Pei X, Young A. An Investigation of the Relationship Between COMLEX-USA Licensure Examination Performance and State Licensing Board Disciplinary Actions. Academic Medicine. 2020;95(6):925-930. doi:10.1097/ACM.0000000000003046 · June 2020

• Comparison study of judged clinical skills competence from standard setting ratings generated under different administration conditions

  Roberts WL, Boulet JR, Sandella JM. Comparison study of judged clinical skills competence from standard setting ratings generated under different administration conditions. Advances in Health Sciences Education. 2017;22:1279-1292. doi:10.1007/s10459-017-9766-1 · February 2017

• Osteopathic manipulative technique scores on the COMLEX-USA Level 2-PE: An analysis of the skills assessed

  Smith LL, Xu W, Sandella JM, Dowling DJ. Osteopathic manipulative technique scores on the COMLEX-USA Level 2-PE: An analysis of the skills assessed. Journal of Osteopathic Medicine. 2016;116(6):392-397. doi:10.7556/jaoa.2016.080 · June 2016

• Preparation strategies of osteopathic medical students for the COMLEX-USA Level 2-PE

  Sandella JM, Peters A, Smith LL, Gimpel JR. Preparation strategies of osteopathic medical students for the COMLEX-USA Level 2-PE. Journal of Osteopathic Medicine. 2016;116(4):234-242. doi: 10.7556/jaoa.2016.048 · April 2016

• Patterns of misrepresentation of clinical findings on patient notes during the COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Gallagher LA, Langenau EE. Patterns of misrepresentation of clinical findings on patient notes during the COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2014;114(1):22-29. doi:10.7556/jaoa.2014.004 · April 2014

• Consistency of interrater scoring of student performances of osteopathic manipulative treatment on COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Dowling DJ. Consistency of interrater scoring of student performances of osteopathic manipulative treatment on COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2014;114(4):253-258. doi:10.7556/jaoa.2014.050 · April 2014

• Keyboard data entry use among osteopathic medical students and residents

  Helstrom JM, Langenau EE, Sandella JM, Mote BL. Keyboard data entry use among osteopathic medical students and residents. Journal Osteopathic Medicine. 2014;114(4):274-82. doi:10.7556/jaoa.2014.053 · April 2014

• Investigation of standardized patient ratings of humanistic competence on a medical licensure examination using Many-Facet Rasch Measurement and generalizability theory

  Zhang X, Roberts WL. Investigation of standardized patient ratings of humanistic competence on a medical licensure examination using Many-Facet Rasch Measurement and generalizability theory. Advances in Health Sciences Education: Theory and Practice. 2013;18(5):929-944. doi:10.1007/s10459-012-9433-5 · December 2013

• Frequency of specific osteopathic manipulative treatment modalities used by candidates while taking COMLEX-USA level 2-PE

  Langenau EE, Dowling DJ, Dyer C, Roberts WL. Frequency of specific osteopathic manipulative treatment modalities used by candidates while taking COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2012;112(8):509-513. doi:10.7556/jaoa.2012.112.8.509 · August 2012

• Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors

  Langenau EE, Zhang X, Roberts WL, De Champlain AF, Boulet JR. Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors. Medical Education Online. 2012;17(1). doi:10.3402/meo.v17i0.18812 · July 2012

• An evaluation of cost and appropriateness of care as recommended by candidates on a national clinical skills examination

  Sandella JM, Boulet JR, Langenau EE. An evaluation of cost and appropriateness of care as recommended by candidates on a national clinical skills examination. Teaching and Learning in Medicine. 2012;24(4):303-308. doi:10.1080/10401334.2012.715259 · April 2012

• An investigation of construct validity of humanistic clinical skills on a medical licensure examination

  Roberts WL, Solomon M, Langenau E. An investigation of construct validity of humanistic clinical skills on a medical licensure examination. Patient Education and Counseling. 2011;82(2):214-221. doi:10.1016/j.pec.2010.03.016 · February 2012

• Fairness to students top priority

  Langenau EE, Sandella JM, Gimpel JR. Fairness to students top priority. Family Medicine. 2012;44(1):53-54. PMID:22241343 · January 2012

• Pass/fail patterns of candidates who failed COMLEX-USA level 2-PE because of misrepresentation of clinical findings on postencounter notes

  Langenau EE, Sandella JM. Pass/fail patterns of candidates who failed COMLEX-USA level 2-PE because of misrepresentation of clinical findings on postencounter notes. Journal of Osteopathic Medicine. 2011;111(7):432-436. doi:10.7556/jaoa.2011.111.7.432 · July 2011

• Relationship between standardized patient checklist item accuracy and performing arts experience

  Langenau EE, Dyer C, Roberts WL, De Champlain AF, Montrey DP, Sandella JM. Relationship between standardized patient checklist item accuracy and performing arts experience. Simulation in Healthcare. 2011;6(3):150-154. doi:10.1097/SIH.0b013e31821687b3 · June 2011

• Relationship between encounter time and candidate performance on COMLEX-USA level 2-PE

  Sandella JM, Roberts WL, Langenau EE. Relationship between encounter time and candidate performance on COMLEX-USA level 2-PE. Journal of Osteopathic Medicine. 2011;111(1):38-43. doi:10.7556/jaoa.2011.111.1.38 · January 2011

• Relationships between high stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents

  Langenau EE, Pugliano G, Roberts WL. Relationships between high stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents. Medical Education Online. 2011;16(1). doi:10.3402/meo.v16i0.7362 · January 2011

• Quality assurance best practices for simulation-based examinations

  Furman GE, Smee S, Wilson C. Quality assurance best practices for simulation-based examinations. Simulation in Healthcare. 2010;5(4):226-231. doi:10.1097/SIH.0b013e3181da5c93 · April 2010

• Five-year summary of COMLEX-USA level 2-PE examinee performance and survey data

  Langenau E, Dyer C, Roberts WL, Wilson C, Gimpel JR. Five-year summary of COMLEX-USA level 2-PE examinee performance and survey data. Journal of Osteopathic Medicine. 2010;110(3):114-125. doi:10.7556/jaoa.2010.110.3.114 · March 2010

• Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examination

  Roberts WL, McKinley DW, Boulet JR. Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examination. Advances in Health Sciences Education: Theory and Practice. 2010;15(2):219-227. doi:10.1007/s10459-009-9193-z · February 2010

• Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE)

  Weidner AC, Gimpel JR, Boulet JR, Solomon M. Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE). Teaching and Learning in Medicine. 2010;22(1):8-15. doi:10.1080/10401330903445604 · January 2010

• Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examination

  Sandella JM, Roberts WL, Gallagher LA, Gimpel JR, Langenau EE, Boulet JR. Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examination. Academic Medicine. 2009;84(10 Suppl):S70-73. doi:10.1097/ACM.0b013e3181b37e36 · October 2009

• The use of standardized patient assessments for certification and licensure decisions

  Boulet JR, Smee SM, Dillon GF, Gimpel JR. The use of standardized patient assessments for certification and licensure decisions. Simulation in Healthcare.2009;4(1):35-42. doi:10.1097/SIH.0b013e318182fc6c · January 2009

• Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicine

  Gimpel JR, Weidner AC, Boulet JR, Wilson C, Errichetti AM. Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicine. Journal of Osteopathic Medicine. 2007;107(12):557-561. doi:10.7556/jaoa.2007.107.12.557 · December 2007

• Relationships between scores on the COMLEX-USA level 2-performance evaluation and selected school-based performance measures

  Baker HH, Cope MK, Adelman MA, Schuler S, Foster RW, Gimpel JR. Relationships between scores on the COMLEX-USA level 2-performance evaluation and selected school-based performance measures. Journal of Osteopathic Medicine. 2006;109(5):290-295. doi:10.7556/jaoa.2006.106.5.290 · May 2006

• Survey on the clinical skills of osteopathic medical students

  Gimpel JR, Boulet JR, Weidner AC. Survey on the clinical skills of osteopathic medical students. Journal of Osteopathic Medicine. 2006;106(5):296-301. doi:10.7556/jaoa.2006.106.5.296 · May 2006

• Assessing the ability of medical students to perform osteopathic manipulative treatment techniques

  Boulet JR, Gimpel JR, Dowling DJ, Finley M. Assessing the ability of medical students to perform osteopathic manipulative treatment techniques. Journal of Osteopathic Medicine. 2004;104(5):203-211. doi:10.7556/jaoa.2004.104.5.203 · May 2004

• Evaluating the clinical skills of osteopathic medical students

  Gimpel JR, Boulet DO, Errichetti AM. Evaluating the clinical skills of osteopathic medical students. Journal of Osteopathic Medicine. 2003;103(6):267-279. doi:10.7556/jaoa.2003.103.6.267 · June 2003

• Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians

  JR Boulet, JR Gimpel, AM Errichetti, FG Meoli. Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians. Journal of Osteopathic Medicine. 2003;103(5):225-231. doi:10.7556/jaoa.2003.103.5.225 · May 2003

• State of the art in standardized patient programs: A survey of osteopathic medical schools

  Errichetti AM, Gimpel JR, Boulet JR. State of the art in standardized patient programs: A survey of osteopathic medical schools. Journal of Osteopathic Medicine. 2002;102(11):627-631. doi:10.7556/jaoa.2002.102.11.615 · November 2002