An OSCE With a Twist of RIME: How to Create a Valid and Reliable Assessment Tool

Course Overview

Using an Observed Standardized Clinical Encounter (OSCE) as an objective assessment for a clerkship is complex. The OSCE must have high fidelity and high interrater reliability. When executed successfully it can differentiate students' clinical knowledge and skills. At our institution, the tri-campus Internal Medicine 3rd year clerkship utilized the RIME (Reporter, Interpreter, Manager, Educator) framework created by Pangaro in 1999 to develop a multimodal summative examination. The RIME model has been widely utilized amongst internal medicine faculty to describe levels of students' clinical abilities. A recent publication by Ryan et. al supported the use of RIME as a framework for assessment. Using RIME to shape content of OSCE stations provided indispensable guardrails throughout the creative process. In six months' time we constructed a five-station OSCE, successfully funded skills lab costs via an educational grant, administered a pilot session and executed a successful go-live date with our first block of learners across campuses. This session will guide you through the steps needed to take the desired elements of a RIME-framed OSCE by providing a roadmap to ensure each station meets the objectives of your course and the mission of your institution. You will help create an OSCE assessment that can differentiate your students based on skill while minimizing subjectivity. The session will include an interactive grading exercise of a sample student to demonstrate reduction of interrater variability. Our hope is that this workshop and content will streamline the process of OSCE-creation and inspire attendees to consider implementation for their own learners.

Learning Objectives

Define and apply the elements of the RIME (Reporter, Interpreter, Manager, Educator) framework of learners to an Observed Standardized Clinical Encounter (OSCE)
Design a novel OSCE case through an interactive group session using the RIME framework as scaffolding.
Score and refine a sample OSCE evaluation checklist to standardize interrater variability.

Speakers

Jennifer L. Fink MD
University of Kansas School of Medicine

David W. Becker MD
University of Kansas School of Medicine

Michael Rouse DO, FACP
University of Kansas School of Medicine

Jessica R. Newman DO
University of Kansas School of Medicine

Additional Information

Year Published: 2022 - AIMW