Selected Research Presentations

NBOME Research Presentations

Gimpel JR, LaBaere, R, Sandella JM, Boulet JR. Core Competency Capstone for DOs (C3DO) Assessment: Assuring that Doctors can Demonstrate Fundamental Osteopathic Clinical Skills. Presentation at: Ottawa Conference 2024; February 2024; Melbourne, Queensland, Australia.

Boulet J. Simulation-Based Assessment to ensure that Medical School Graduates can Demonstrate Fundamental Osteopathic Clinical Skills. Presentation at: Society for Simulation in Healthcare Annual Meeting, Standardized Patient Special Interest Group Collaboration Forum; January 2024; San Diego, CA.

Long Y, Mao X. An Exploration of Using Natural Language Processing Technique to Analyze Candidate Comments. Presentation at: Ideas in Testing Research Seminar; November 2023.

Errichetti AM, Lorion A. Identifying and Reducing Standardized Patient Explicit Bias When Assessing Interpersonal Communication. Workshop at: APHC; June 2023.

Errichetti AM, Lorion A. Identifying and Mitigating Bias in SP Assessment of Learners. Workshop at: Association of Standardized Patient Educators Annual Conference; June 2023.

Errichetti AM, Lorion A, Drda G. Developing SP Core Competencies Through Narrative Medicine. Workshop at: Association of Standardized Patient Educators Annual Conference; June 2023.

Lorion A, Walsh E, Peterson K. Evaluating Respect in a Culturally-Inclusive Manner. Workshop at: Association of Standardized Patient Educators Annual Conference; June 2023.

Guercio E, Royal K, Sandella JM, Speicher MR, Flamini J, Meyer C, Searcy C, Tsai T-H. Predictive Validity of MCAT Scores and Undergraduate GPA for COMLEX-USA Licensure Exam Performance. Presentation at: Educating Leaders 2023; April 2023; Baltimore, MD.

Jin R, Clem AS, Sandella JM, Tsai T-H, Wang Y. COMSAE Phase 2: Patterns, Preparation and Expectations for COMLEX-USA Level 2-CE. Poster presented at: Educating Leaders 2023; April 2023; Baltimore, MD.

Mao X, Sandella JM, Zhao M. A Study on the COMSAE Phase 3 Usage. Poster presented at: Educating Leaders 2023; April 2023; Baltimore, MD.

Mao X. An Exploration of Automated Scoring of Short Answer Questions in Medical Examinations. Presentation at: National Council on Measurement in Education 2023 Meeting; April 2023; Chicago, IL.

Mao X, Smith L. Equating in the Context of Medical Licensure Examinations. Presentation at: National Council on Measurement in Education 2023 Meeting; April 2023; Chicago, IL.

Mao X, Smith L, Kao S, Davis J. Harmonize Tradition and Innovation: Scaling, Linking, and Equating in Technology-Enhanced Measurement. Presentation at: National Council on Measurement in Education 2023 Meeting; April 2023; Chicago, IL.

Dawley M. Caring For Candidates: Revising Score Reporting for a High Stakes Examination. Presentation at: 2023 Innovations in Testing Conference; Dallas, TX; March 2023.

Dawley M. An Empirical Evaluation of the Pandemic’s Impact on the Credentialing Industry. Presentation at: 2023 Innovations in Testing Conference; Dallas, TX; March 2023.

Errichetti AM, Lorion A, Sandella JM. Defining Professionalism: Lessons learned from COMLEX-USA Level 2-PE. Presentation at: Educating Leaders 2022; April 2022; Denver, CO.

Boulet JR, Lorion A, Sandella JM. Assessing the Clinical Skills of Osteopathic Medical Students/Graduates without a National Licensing Examination. Presentation at: Educating Leaders 2022; April 2022; Denver, CO.

Mao X. A Validity Study of COMLEX-USA Level 3 With New Test Design. Presentation at: Educating Leaders 2022; April 2022; Virtual.

Mao X. Using a Data-driven Approach to Guide Item Development in Medical Examinations. Presentation at: 2022 Annual NCME Meeting; April 2022; San Diego, CA.

Peterson K, Lorion A. SP Assessments: A Thing of the Future as well as the Past. Presentation at: 2021 Association for Standardized Patient Educators Annual Virtual Conference; June 2021; Virtual.

Lorion A, Mirigliani L. In-Person High-Stakes Testing During a Pandemic. Presentation at: 2021 Association for Standardized Patient Educators Annual Virtual Conference; June 2021; Virtual.

Peterson K, Mirigliani L. Analyzing the SP Recruitment Process. Presentation at: 2021 Association for Standardized Patient Educators Annual Virtual Conference; June 2021; Virtual.

Maeda H, Barnum S. Comparison of Proctored and Self-Proctored COMAT Clinical Subject Examination Scores. Presented at: AACOM Educating Leaders 2021; April 2021; Virtual

Mao X, Zhang Q. An Exploration of an Integrated Approach for Enemy Item Identification. Paper presented at: American Educational Research Association annual conference; April 2021; Virtual.

Peterson K. Inclusion and Diversity in SP Recruitment. Presentation at: EMS Webinar; January 2021; Virtual.

2020 Archives

Peterson K. Defining and Utilizing Health Literacy in SP Portrayal. Presentation at: 2020 Association for Standardized Patient Educators Annual Virtual Conference; June 2020; Virtual.

Mao X, Dickerman J, Tsai T-H, Wang Y. Exploring the psychometric properties of CDM items. Paper presented at: American Educational Research Association annual meeting; 2020.

Mao X. A comparison of methods for deriving composite scores for mixed-format test. Paper presented at: National Council on Measurement in Education annual meeting; 2020.

Maeda H, Wang X, Barnum S, Dawley M, Tsai T-H. Score Relationship of COMLEX-USA Level 1, COMSAE Phase 1, and COMAT FBS Comprehensive Examinations. Paper presented at: 2020 American Association of Colleges of Osteopathic Medicine Annual Conference; March 2020; Virtual.

2019 Archives

Browne M, Wojnakowski M, Horber DT. Choosing Wisely: So Many Options for Assessment Administration. Which will Enhance Your Exam’s Validity and Fairness? Paper presented at: 2019 Innovations in Testing Conference; March 2019; Orlando, FL.

Castaneda R, Hudson KM, Wang X. Uncovering Hidden Response Time Patterns of COMLEX-USA Level 3 Examination. Poster presented at: 2019 American Association of Colleges of Osteopathic Medicine Annual Conference; April 2019; Washington, DC.

Errichetti AM. Standardizing Judgment: A Qualitative Study of How SPs Co-Construct Meaning. Presentation at: 2019 Association for Standardized Patient Educators Annual Conference; June 2019; Orlando, FL.

Errichetti AM. Debriefing Residents with Good Judgment. Presentation at: New York Colleges of Osteopathic Medicine Educational Consortium; April 2019; New York City, NY.

Horber DT, Waters S. CATALYST: Transforming Physicians’ Assessment into Learning. Presentation at: 2019 Meeting of the American Board of Medical Specialties; September 2019; Chicago, IL.

Hudson KM, Yin Y, Tsai T-H. Transitioning to Automated Test Assembly: A Comparison of Equating Methods. Paper presented at: 2019 National Council of Measurement in Education Conference; April 2019; Toronto, CAN.

Maeda H, Wang X. The effects of test familiarity on person-fit and aberrant behavior. Paper presented at: 2019 National Council of Measurement in Education Conference; April 2019; Toronto, CAN.

Mirigliani L, Lorion A. When Life Gets in the Way: Getting SPs out of Their Heads and into the Role. Presentation at: 2019 Association for Standardized Patient Educators Annual Conference; June 2019; Orlando, FL.

Parshall C, Julian E, Parikh S, Horber DT. Using Nudges for More Effective Exam Programs. Paper presented at: 2019 Innovations in Testing Conference; March 2019; Orlando, FL.

Ronkowksi E. “Collaborative Cognitive Item Mapping” as part of Innovations in Assessment, Learning, and Improvement: Lightning Round Part 1. Presentation at: 2019 Meeting of the American Board of Medical Specialties; September 2019; Chicago, IL.

Shaffer D, Waters S. Ensuring Ongoing Physician Competency with CATALYST. Presentation at: 2019 Meeting of the International Association of Medical Regulatory Authorities; September 2019; Chicago, IL.

2018 Archives

Errichetti AM, Fancher S. Standardized Patient Communication Assessment in Medical and Advanced Practice Nursing Education: Two Perspectives. Podium presentation at: 18th International Meeting on Simulation in Healthcare; January 13-17, 2018; Los Angeles, CA.

Errichetti AM, Drda V, Kachur E. Using the ORID Framework to Conduct Difficult Conversations with SPs. Presentation at: International Meeting of Simulation in Healthcare; January 13-17, 2018; Los Angeles, CA

Gimpel JR, Shaffer DC. Use of COMLEX-USA Examination Program in ACGME Programs. Presented at the Accreditation Council for Graduate Medical Education’s Annual Educational Conference, Orlando, FL, March 3, 2018.

Roberts WL. An investigation of a rater-mediated licensing performance examination equating quality with the Rasch model. Paper presented at: American Educational Research Association Conference, April 2018, New York.

Horber DT, Flamini J. CATALYST: the continuous assessment platform for physician learning. Presented at the American Association of Osteopathic Medical Colleges (AACOM), Washington DC, April 18, 2018.

Shao C, Wang Y, Liu S, Tsai T-H. Investigation of Differential Item Functioning on COMLEX-USA Examination Series. Poster presented at: American Association of Osteopathic Medical Colleges; April 18, 2018; Washington, DC.

Gallagher LA. A Comparative Review of the Factors Which May Influence Residency Program Interviews & Ranking. Poster presented at: American Association of Osteopathic Medical Colleges; April 18, 2018; Washington, DC.

Lorion A, Mirigliani L. When Grief Isn’t Simulated: SPs Dealing with Real-life Death. Presentation at: Association of Standardized Patient Educators; June 18, 2018; Kansas City, MO.

Errichetti AM, Drda V, Kachur E. Lank A, Lorion A. Using the ORID Framework to Conduct Difficult Conversations with SPs. Presentation at: International Meeting of Simulation in Healthcare, Association of Standardized Patient Educators Annual Conference; June 20, 2018.

Murphy J, Errichetti AM. Training Standardized Patients in a Flipped Classroom. Presentation at: Association of Standardized Patient Educators Annual Conference; June 20, 2018.

Castaneda R, Zhang Q. Automated Item Generation Using Medical Diagnostic Information. Poster presented at: International Meeting of the Psychometric Society; New York, NY, July 2018.

Bruel L, Errichetti AM, Kachur E, Novak D, Jiraeviijinda. Linking Professionalism and Communication Skills in OCSE Stations. Presentation at: EACH International Association for Communication in Healthcare; September 2, 2018; University of Porto, Portugal.

Ferris M, Horber DT. Examinee References and Resources: Steps toward Open-Book Testing and Innovative Item Development. Presentation at: 2018 American Board of Medical Specialties Conference; September 2018; Las Vegas, NV.

Parshall C, Horber DT, Julian E. Improve Your Candidate Experience with Action Design. Presentation at: 2018 Institute for Credentialing Excellence (ICE) Exchange; November 2018; Austin, TX.