Performance assessment and clinical experience (PACE) scorecards for anesthesiology residents: a post-implementation phy

  • PDF / 333,846 Bytes
  • 3 Pages / 595.276 x 790.866 pts Page_size
  • 9 Downloads / 185 Views

DOWNLOAD

REPORT


CORRESPONDENCE

Performance assessment and clinical experience (PACE) scorecards for anesthesiology residents: a post-implementation physician survey Alexander J. Lingley, MSc . Ryan McGinn, MD, MSc . Christopher L. Pysyk, MD . Gregory L. Bryson, MD, MSc . Daniel G. Dubois, MD

Received: 7 July 2020 / Revised: 9 July 2020 / Accepted: 10 July 2020 Ó Canadian Anesthesiologists’ Society 2020

To the Editor, Paralleling adoption of competency-based medical education and electronic health records (EHRs) has spurred interest in developing novel tools for the evaluation of physician performance. The use of EHRs allows multiple process and patient outcome metrics to be employed for educational improvement initiatives. The objective nature of automated performance analysis stands to provide a valuable adjunct to subjective feedback, the current predominant form of evaluation in clinical education. Self-documented logs are commonly employed to audit resident learning experiences and infer progression towards competency. Nevertheless, a pilot project at our institution revealed disparity in cumulative clinical exposure tracked between logbooks and an EHR.1 To explore the utility of EHRs in clinical evaluation, we provided a scorecard summarizing annual clinical activities and performance of anesthesiology residents at the University of Ottawa (Figure). Data were extracted from the Anesthesia Information Management System (AIMS). A similar scorecard was previously developed for staff anesthesiologists at The Ottawa Hospital.2

Electronic supplementary material The online version of this article (https://doi.org/10.1007/s12630-020-01766-6) contains supplementary material, which is available to authorized users. A. J. Lingley, MSc Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada R. McGinn, MD, MSc  C. L. Pysyk, MD  G. L. Bryson, MD, MSc  D. G. Dubois, MD (&) Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, ON, Canada e-mail: [email protected]

An existing post-implementation survey, which assessed staff anesthesiologists’ perceptions of performance scorecards, was modified for this study.2 Our survey comprised 11 items including seven Likert scales (ranging from strongly disagree to strongly agree) and four qualitative questions (eAppendix in the Electronic Supplementary Material). Four volunteers validated the survey using the Burns clinical sensibility tool. Scorecards and survey invitations were distributed via email to all enrolled anesthesiology residents in June 2019 (n = 42). This study was approved on 22 July 2019 by The Ottawa Health Science Network Research Ethics Board (OHSNREB; 20,190,124-01H); participation was voluntary and responses were anonymized. Using a modified Dillman method,3 we obtained a response rate of (17/42; 40%). Most residents agreed/ strongly agreed that the scorecards were personally interesting (15/17; 88%), valuable for professional development (13/17; 76%), an effective measure of clinical experience (12/17; 71%), and influential for future practice (1