To examine the Urology residency application process, particularly the interview. Historically, the residency interview has been vulnerable to bias and not determined to be a predictor of future residency performance. Our goal is to determine the relationship between pre-interview metrics and post-interview ranking using best practices for Urology resident selection including holistic review, blinded interviews, and structured behaviorally anchored questions.
Applications were assessed on cognitive (Alpha Omega Alpha [AOA], class rank [CR], junior year clinical clerkship [JYCC] grades) and noncognitive attributes (letters of recommendation [LOR], personal statement [PS], demographics, research, personal characteristics) by reviewers blinded to USMLE scores and photograph. Interviewers were blinded to the application other than PS and LORs. Interviews consisted of a structured behaviorally anchored question (SBI) and an unstructured interview (UI). Odds ratios were determined comparing pre-interview (PI) and interview impressions.
51 applicants were included in analysis. USMLE Step 1 score (avg 245) was associated with AOA, CR, JYCC, and PS. The UI score was associated with the LOR (p=0.04) whereas SBI scores were not (p=0.5). Faculty rank was associated with SBI, UI, and overall interview (OI) scores (p<0.001). Faculty rank was also associated with LOR. Resident impression of interviewees were associated with faculty interview scores (p=0.001) and faculty rank (p<0.001).
Traditional interviews may be biased toward application materials and may be balanced with behavioral questions. While Step 1 score does not offer additional information over other PI metrics, blinded interviews may offer discriminant validity over a pre-interview rubric.

Copyright © 2023. Published by Elsevier Inc.