Association between leniency of anesthesiologists when evaluating certified registered nurse anesthetists and when evalu
- PDF / 478,433 Bytes
- 9 Pages / 595.276 x 790.866 pts Page_size
- 79 Downloads / 208 Views
Association between leniency of anesthesiologists when evaluating certified registered nurse anesthetists and when evaluating didactic lectures Franklin Dexter 1
&
Johannes Ledolter 2
&
Cynthia A. Wong 1
&
Bradley J. Hindman 1
Received: 2 December 2019 / Accepted: 3 August 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract Daily evaluations of certified registered nurse anesthetists’ (CRNAs’) work habits by anesthesiologists should be adjusted for rater leniency. The current study tested the hypothesis that there is a pairwise association by rater between leniencies of evaluations of CRNAs’ daily work habits and of didactic lectures. The historical cohorts were anesthesiologists’ evaluations over 53 months of CRNAs’ daily work habits and 65 months of didactic lectures by visiting professors and faculty. The binary endpoints were the Likert scale scores for all 6 and 10 items, respectively, equaling the maximums of 5 for all items, or not. Mixed effects logistic regression estimated the odds of each ratee performing above or below average adjusted for rater leniency. Bivariate errors in variables least squares linear regression estimated the association between the leniency of the anesthesiologists’ evaluations of work habits and didactic lectures. There were 29/107 (27%) raters who were more severe in their evaluations of CRNAs’ work habits than other anesthesiologists (two-sided P < 0.01); 34/107 (32%) raters were more lenient. When evaluating lectures, 3/81 (4%) raters were more severe and 8/81 (10%) more lenient. Among the 67 anesthesiologists rating both, leniency (or severity) for work habits was not associated with that for lectures (P = 0.90, unitless slope between logits 0.02, 95% confidence interval −0.34 to 0.30). Rater leniency is of large magnitude when making daily clinical evaluations, even when using a valid and psychometrically reliable instrument. Rater leniency was context dependent, not solely a reflection of raters’ personality or rating style. Keywords Anesthesiologists . Certified registered nurse anesthetists . Peer review . Rater leniency . Work habits
Highlights
&
&
&
&
Daily professional evaluations should be adjusted for rater leniency. We tested if leniency of ratings in one setting applies to another setting.
Electronic supplementary material The online version of this article (https://doi.org/10.1007/s10729-020-09518-0) contains supplementary material, which is available to authorized users. * Franklin Dexter [email protected]; https://FranklinDexter.net 1
Department of Anesthesia, University of Iowa, 200 Hawkins Drive, 6-JCP, Iowa City, IA, USA
2
Department of Business Analytics, University of Iowa, Iowa City, USA
&
Data used were anesthesiologists’ evaluations of nurse anesthetists and of lectures. Leniency (or severity) of ratings were not associated with one another. The implications are that rater leniency is context dependent.
1 Introduction Health care managers’ jobs include evaluation of healthcare providers. For exam
Data Loading...
