Published Research:
All Topics

• An Investigation of the Relationship Between COMLEX-USA Licensure Examination Performance and State Licensing Board Disciplinary Actions

  Roberts, William L. EdD; Gross, Gretta A. DO, MEd; Gimpel, John R. DO, MEd; Smith, Larissa L. PhD; Arnhart, Katie PhD; Pei, Xiaomei PhD; Young, Aaron PhD. Academic Medicine. June 2020; 95(6):925-930. doi.org/10.1097/ACM.0000000000003046. · June 2020

• CATALYST: Piloting a Longitudinal Assessment and Learning Program for Board Recertification and Continuous Professional Development.

  Horber DT, Flamini J, Gimpel JR, Tsai TH, Shrum K, Hudson K. The Journal of the American Osteopathic Association, March 2020, Vol. 120, 190-200. doi:https://doi.org/10.7556/jaoa.2020.031 · March 2020

• Selected Presentations

  NBOME Presentations · March 2020

• 2019 United States Osteopathic Medical Regulatory Summit: Consensus, Recommendations, and Next Steps in Defining Osteopathic Distinctiveness

  Gimpel JR, Belanger SI, Knebl JA, LaBaere RJ, Shaffer DC, Shannon SC, Shears T, Steingard SA, Turner MD, Williams DG, The Journal of the American Osteopathic Association: Vol. 120, 35-44. January 2020. · January 2020

• A Validity Study of COMLEX-USA Level 2-CE and COMAT Clinical Subjects: Concurrent and Predictive Evidence

  Hudson K, Tsai T-H, Finch C Dickerman, JL, Liu S, Shen L. Journal of Graduate Medical Education: October 2019, Vol. 11, No. 5, pp. 521-526. https://doi.org/10.4300/JGME-D-19-00157.1 · November 2019

• Automated Test Assembly Using SAS Operations Research Software in a Medical Licensing Examination

  Shao C, Liu S, Yang H, & Tsai T-H. Applied Psychological Measurement : May 2019. https://doi.org/10.1177/0146621619847169 · May 2019

• Enhancing COMLEX-USA: Evidence-based redesign of the osteopathic medical licensure examination program

  Horber D, Gimpel JR, Program. Journal of Medical Regulation · 2018;104(3) · 11-18 · November 2018

• Association between performance on COMLEX-USA and the American College of Osteopathic Family Physicians in-service examination

  Hudson KM, Feinberg G, Hempstead L, Zipp C, Gimpel JR, Wang Y, · Journal of Graduate Medical Education 2018;10(5) · 543-547 · October 2018

• Evidence-based redesign of the COMLEX-USA series

  Gimpel JR, Horber D, Sandella JM, Knebl JA, Thornburg JE · Journal of the American Osteopathic Association · 2017;117(4) · 253-261 · April 2017

• Comparison study of judged clinical skills competence from standard setting ratings generated under different administration conditions

  Roberts, W.L., Boulet, J., Sandella, J. · Advances in Health Sciences Education 22, 1279–1292 (2017). https://doi.org/10.1007/s10459-017-9766-1 · February 2017

• The predictive validity of the National Board of Osteopathic Medical Examiners' COMLEX-USA examinations with regard to outcomes on American Board of Family Medicine examinations

  O’Neill TR, Peabody MR, Song H · Academic Medicine · 2016;91(11) · 1568-1575 · November 2016

• Osteopathic manipulative technique scores on the COMLEX-USA Level 2-PE: An analysis of the skills assessed

  Smith LL, Xu W, Sandella JM, Dowling D · Journal of the American Osteopathic Association · 2016;116(6) · 392-397 · June 2016

• Preparation strategies of osteopathic medical students for the COMLEX-USA Level 2-PE

  Sandella JM, Peters A, Smith LL, Gimpel JR · Journal of the American Osteopathic Association · 2016;116(4) · 234-242 · April 2016

• The use of COMLEX-USA and USMLE for residency applicant selection

  Sandella JM, Gimpel JR, Smith LL, Boulet JR · Journal of Graduate Medical Education · 2016;8(3) · 358-363 · March 2016

• Redefining competency domains for osteopathic medical practice

  Gimpel, JR · Journal of the American Osteopathic Association · 2016;116(9) · 568-570 · January 2016

• Relationships between the Comprehensive Osteopathic Medical Achievement Test (COMAT) subject examinations and the COMLEX-USA level 2-cognitive evaluation

  Li F, Kalinowski K, Song H, Bates B · Journal of the American Osteopathic Association · 2014;114(9) · 714-721 · September 2014

• Stratified item selection and exposure control in unidimensional adaptive testing in the presence of 2D data

  Kalinowski KE, Natesan P, Henson RK · Applied Psychological Measurement · 2014;38(7) · 563-576 · July 2014

• Reliability and Validity of Conversion Formulas Between Comprehensive Osteopathic Medical Licensing Examination of the United States Level 1 and United States Medical Licensing Examination Step 1

  Lee AS, Chang L, Feng E, Helf S · Journal of Graduate Medical Education · 2014;6(2) · 280-283 · June 2014

• Patterns of misrepresentation of clinical findings on patient notes during the COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Gallagher LA, Langenau EE · Journal of the American Osteopathic Association · 2014;114(1) · 22-29 · April 2014

• Consistency of interrater scoring of student performances of osteopathic manipulative treatment on COMLEX-USA level 2-PE

  Sandella JM, Smith LA, Dowling DJ · Journal of the American Osteopathic Association · 2014;114(4) · 253-258 · April 2014

• The relationship between COMLEX-USA scores and performance on the AOBEM Part I certifying exam

  Li F, Gimpel JR, Arenson E, Song H, Bates BP, Ludwin F · Journal of the American Osteopathic Association · 2014;114(4) · 260-266 · April 2014

• Keyboard data entry use among osteopathic medical students and residents

  Helstrom JM, Langenau EE, Sandella JM, Mote BL · Journal of the American Osteopathic Association · 2014;114(4) · 274-82 · April 2014

• Investigation of standardized patient ratings of humanistic competence on a medical licensure examination using Many-Facet Rasch Measurement and generalizability theory

  Zhang X, Roberts WL · Advances in Health Sciences Education: Theory and Practice · 2013;18(5) · 929-944 · December 2013

• Performance on COMLEX-USA exams predicts performance on EM residency in-training exams

  Pierce DL, Mirre-Gonzalez MA, Carter MA, Nug D, Salamanca Y · Academic Emergency Medicine · 2013;20(5) Suppl 1. · S219 · May 2013

• Frequency of specific osteopathic manipulative treatment modalities used by candidates while taking COMLEX-USA level 2-PE

  Langenau EE, Dowling DJ, Dyer C, Roberts WL · Journal of the American Osteopathic Association · 2012;112(8) · 509-513 · August 2012

• Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors

  Langenau EE, Zhang X, Roberts WL, DeChamplain AF, Boulet JR · Medical Education Online · 2012;17 · July 2012

• Prediction of osteopathic medical school performance on the basis of MCAT score, GPA, sex, undergraduate major, and undergraduate institution

  Dixon D · Journal of the American Osteopathic Association · 2012;112(4) · 175-181 · April 2012

• An evaluation of cost and appropriateness of care as recommended by candidates on a national clinical skills examination

  Sandella JM, Boulet JR, Langenau EE · Teaching and Learning in Medicine · 2012;24(4) · 303-308 · April 2012

• An investigation of construct validity of humanistic clinical skills on a medical licensure examination

  Roberts WL, Solomon M, Langenau E · Patient Education and Counseling · 2011;82(2) · 214-221 · February 2012

• Fairness to students top priority

  Langenau E, Sandella J, Gimpel JR · Family Medicine · 2012;44(1) · 53-54 · January 2012

• Modeling relationships between traditional preadmission measures and clinical skills performance on a medical licensure examination

  Roberts WL, Pugliano G, Langenau E, Boulet JR · Advances in Health Sciences Education · 2011;17(3) · 403–417 · August 2011

• Pass/fail patterns of candidates who failed COMLEX-USA level 2-PE because of misrepresentation of clinical findings on postencounter notes

  Langenau EE, Sandella JM · Journal of the American Osteopathic Association · 2011;111(7) · 432-436 · July 2011

• Relationship between standardized patient checklist item accuracy and performing arts experience

  Langenau EE, Dyer C, Roberts WL, De Champlain AF, Montrey DP, Sandella JM · Simulation in Healthcare · 2011;6(3) · 150-154 · June 2011

• A primer on how to select osteopathic applicants to an allopathic general surgery residency

  Schenarts PJ, Termuhlen PM, Pasley J, Rose JS, Friedell ML · Journal of Surgical Education · 2011;68(3) · 239-245 · March 2011

• Relationship between encounter time and candidate performance on COMLEX-USA level 2-PE

  Sandella JM, Roberts WL, Langenau EE · Journal of the American Osteopathic Association · 2011;111(1) · 38-43 · January 2011

• Relationships between high stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents

  Langenau EE, Pugliano G, Roberts WL · Medical Education Online · 2011;16(1) · January 2011

• Quality assurance best practices for simulation-based examinations

  Furman GE, Smee S, Wilson C · Simulation in Healthcare · 2010;5(4) · 226-231 · April 2010

• Five-year summary of the Comprehensive Osteopathic Medical Licensing Examination level 2-performance evaluation (COMLEX-USA level 2-PE): Candidate performance and survey data.

  Langenau E, Dyer C, Roberts WL, Wilson C, Gimpel J. · March 2010. The Journal of the American Osteopathic Association · March 2010

• Summary of ACOP (American College of Osteopathic Pediatricians) program directors’ annual reports for first-year residents and relationships between resident competency performance ratings and COMLEX-USA test scores

  Langenau EE, Pugliano G, Roberts BR, Hostoffer R · Electronic Journal of the American College of Osteopathic Physicians · 2010;2(7) · February 2010

• Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examination

  Roberts WL, McKinley DW, Boulet JR. · Advances in Health Sciences Education: Theory and Practice · 2010;15(2) · 219-227 · February 2010

• Relationship between COMLEX and USMLE scores among osteopathic medical students who take both examinations

  Chick DA, Friedman HP, Young VB, Solomon DE · Teach Learn Med · 2010;22(1) · 42801 · January 2010

• Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE)

  Weidner AC, Gimpel JR, Boulet JR, Solomon M · Teaching and Learning in Medicine · 2010;22(1) · pp 8-15 · January 2010

• Student performance on levels 1 and 2-CE of COMLEX-USA: Do elective upper-level undergraduate science courses matter?

  Wong SK, Ramirez J, Helf SC · Journal of the American Osteopathic Association · 2009;109(11) · 592-598 · November 2009

• Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examination

  Sandella JM, Roberts WL, Gallagher LA, Gimpel JR, Langenau EE, Boulet JR · Academic Medicine · 2009;84(10Suppl) · S70-73 · October 2009

• The use of standardized patient assessments for certification and licensure decisions

  Boulet JR, Smee SM, Dillon GF, Gimpel JR · Simulation in Healthcare · 2009;4(1) · 35-42 · January 2009

• COMLEX-USA and in-service examination scores: Tools for evaluating medical knowledge among residents

  Sevensma SC, Navarre G, Richards RK · Journal of the American Osteopathic Association · 2008;108(12) · 713-716 · December 2008

• Setting standards for passing scores on medical licensure and credentialing examinations

  Roberts WL, Boulet JR, Gimpel JR · Paper presented at the American Educational Research Association · 2008 · April 2008

• Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicine

  Gimpel JR, Weidner AC, Boulet JR, Wilson C, Errichetti AM · Journal of the American Osteopathic Association · 2007;107(12) · 557-561 · December 2007

• Relationships between clinical rotation subscores, COMLEX-USA examination results, and school-based performance measures

  Cope MK, Baker HH, Foster RW, Boisvert CS · Journal of the American Osteopathic Association · 2007;107(11) · 502-510 · November 2007

• Does the medical college admission test predict global academic performance in osteopathic medical school?

  Evans P, Wen FK · Journal of the American Osteopathic Association · 2007;107(4) · 157-162 · April 2007

• Relationships between scores on the COMLEX-USA level 2-performance evaluation and selected school-based performance measures

  Baker HH, Cope MK, Adelman MA, Schuler S, Foster RW, Gimpel JR · Journal of the American Osteopathic Association · 2006;109(5) · 290-295 · May 2006

• Survey on the clinical skills of osteopathic medical students

  Gimpel JR, Boulet JR, Weidner AC · Journal of the American Osteopathic Association · 2006;106(5) · 296-301 · May 2006

• Research methodology: Procedures for establishing defensible absolute passing scores on performance examinations in health professions education

  Downing SM, Tekian A, Yudkowsky R · Teaching and Learning in Medicine · 2006;18(1) · 50–57 · January 2006

• A work-centered approach for setting passing scores on performance-based assessments

  McKinley DW, Boulet JR, Hambleton RK · Evaluation & the Health Professions · 2005;28(3) · 349–369 · March 2005

• Assessing the ability of medical students to perform osteopathic manipulative treatment techniques

  Boulet JR, Gimpel JR, Dowling DJ, Finley M · Journal of the American Osteopathic Association · 2004;104(5) · 203-211 · May 2004

• Relation between variables of preadmission, medical school performance, and COMLEX–USA levels 1 and 2 performance

  Dixon D · Journal of the American Osteopathic Association · 2004;4(8) · 332-336 · April 2004

• Relations between academic performance by medical students and COMLEX–USA level 2: A multisite analysis

  Evans P, Goodson LB, Schoffman SI, Baker HH · Journal of the American Osteopathic Association · 2003;103(11) · 551-556 · November 2003

• Predictive validity of osteopathic medical licensing examinations for osteopathic medical knowledge measured by graduate written examinations

  Cavalieri TA, Shen L, Slick GL · Journal of the American Osteopathic Association · 2003;103(7) · 337-42 · July 2003

• Evaluating the clinical skills of osteopathic medical students

  Gimpel JR, Boulet DO, Errichetti AM · Journal of the American Osteopathic Association · 2003;103(6) · 267-279 · June 2003

• Setting defensible performance standards on OSCEs and standardized patient examinations

  Boulet JR, De Champlain AF, McKinley DW · Medical Teacher · 2003;25(3) · 245–249 · May 2003

• Relationship of osteopathic medical licensure examinations with undergraduate admission measures and predictive value of identifying future performance in osteopathic principles and practice/osteopathic manipulative medicine courses and rotations

  Meoli FG, Wallace WS, Kaiser-Smith J, Shen L · Journal of the American Osteopathic Association · 2002;102(11) · 615-620 · November 2002

• State of the art in standardized patient programs: A survey of osteopathic medical schools

  Errichetti AM, Gimpel JR, Boulet JR · Journal of the American Osteopathic Association · 2002;102(11) · 627-631 · November 2002

• Correlation of scores for the comprehensive osteopathic medical licensing examination with osteopathic medical school grades

  Hartman SE, Bates BP, Sprafka SA · Journal of the American Osteopathic Association · 2001;101(6) · 347-349 · June 2001

• Setting performance standards on complex educational assessments

  Hambleton RK, Jaeger RM, Plake BS, Mills C · Applied Psychological Measurement · 2000;24(4) · 355–366 · December 2000

• Relationship between academic achievement and COMLEX-USA level 1 performance: A multisite study

  Baker HH, Foster RW, Bates BP, et al · Journal of the American Osteopathic Association · 2000;100(4) · 238-242 · April 2000

• Relationship of preadmission variables and first- and second-year course performance to performance on the National Board of Osteopathic Medical Examiners’ COMLEX–USA level 1 examination

  Baker HH, Cope MK, Fisk R, Gorby JN, Foster RW · Journal of the American Osteopathic Association · 2000;100(3) · 153-161 · March 2000

• A generalized examinee-centered method for setting standards on achievement tests

  Cohen AS, Kane MT, Crooks TJ · Applied Measurement in Education · 1999;12(4) · 343–366 · April 1999

• Designing and evaluating standard-setting procedures for licensure and certification tests

  Kane MT, Crooks TJ, Cohen AS · Advances in Health Sciences Education · 1999;4(3) · 195-207 · March 1999

• The credibility and comparability of standards

  Norcini JJ, Shea JA · Applied Measurement in Education · 1997;10(1) · 39–59 · January 1997

• A contrasting-groups approach to standard setting for performance assessments of clinical skills

  Clauser BE, Clyman SG · Academic Medicine · 1994;69(10) · S42–S44 · October 1994

• Guidelines for assessing clinical competence

  Newble D, Dauphinee WD, Macdonald M, Dawson B, Page G, Swanson DB, et al · Teaching and Learning in Medicine · 1994;6(3) · 213-220 · March 1994

• Passing Scores: A Manual for Setting Standards of Performance on Education and Occupational Tests

  Livingston SA, Zieky MJ · Educational Testing Service · 1982 · January 1982

• Scales, Norms and Equivalent Scores

  Thorndike RL, editor, Angoff WH. · American Council on Education · 1971 · 508-600 · January 1971