Professional Development

Conference Presentation: Destination: Patient Outcomes – Our Journey to Improving Patient Care

Question Writing for Assessment Exams: Using Item Response Theory to Avoid Tricky Questions

Monday, January 22
3:30 PM - 4:30 PM
Location: Palazzo A

Physician Credits: 1.0

Nursing CE Credits: 1.0

Pharmacy Credits: 1.0

ACPE UAN: 0809-9999-18-084-L04-P (Knowledge)

CHCP Exam Designation: CPD Associate & CHCP Professional Exams

Session Description
This learning session extends the knowledge and skills provided in the Question Writing for CME Assessments session at the Alliance in 2015 and 2016. Traditionally, Classical Test Theory was used to used to  develop and anaylze continuing medical education questions (Hambleton, 2000). However, CTT was replaced by Item Response Theory as the dominant paradigm for developing high-stakes test. The RAsch model of assessment development, a common framework in Multiple Choice Question development, requires attention to the development of questions and responses.

In this session, partcipants will work together to evaluate an assessment tool using provided program descriptions and learning objectives from a sample CME program. Utilizing elements of IRT, participants will work in teams to create and critique the short assessments. The workshop will include tips and tricks to avoide tricky questions and improving question compoents, improving question formatting, and developing effective distractors. Participants will leave the session with a model for signing an effective CME questionnaire based on sound design methods and provided learning objectives.

Learning Objectives:

Asma Ali

Director, Evaluation, Measurement & Assessment
American Society of Clinical Pathology
Oak Park, Illinois

Asma M. Ali PhD ERM is a Health Professions Education Evaluator at the National Center for Patient Safety in the U.S. Department of Veteran Affairs. In this role, she works to incoporate user-centric design thinking principals in the development of evaluators. Asma was formerly the Director of Evaluation, Measurement, and Assessment at a medical specailty society. A five year CME veteran, she works to incoprate desing thinking in the development of CME outcomes.

Presentation(s):

Send Email for Asma Ali


Assets

Question Writing for Assessment Exams: Using Item Response Theory to Avoid Tricky Questions

Slides

Attendees who have favorited this

Please enter your access key

The asset you are trying to access is locked. Please enter your access key to unlock.

Send Email for Question Writing for Assessment Exams: Using Item Response Theory to Avoid Tricky Questions