Discrepancies Between Explicit and Implicit Review: Physician and Nurse Assessments of Complications and Quality

Objective

To identify and characterize discrepancies between explicit and implicit medical record review of complications and quality of care.

Setting

Forty‐two acute‐care hospitals in California and Connecticut in 1994.

Study Design

In a retrospective chart review of 1,025 Medicare beneficiaries age ≥65, we compared explicit (nurse) and implicit (physician) reviews of complications and quality in individual cases. To understand discrepancies, we calculated the kappa statistic and examined physicians' comments.

Data Collection

With Medicare discharge abstracts, we used the Complications Screening Program to identify and then select a stratified random sample of cases flagged for 1 of 15 surgical complications, 5 medical complications, and unflagged controls. Peer Review Organization nurses and physicians performed chart reviews.

Principal Findings

Agreement about complications was fair ( κ=0.36) among surgical and was moderate ( κ=0.59) among medical cases. In discordant cases, physicians said that complications were insignificant, attributable to a related diagnosis, or present on admission. Agreement about quality was poor among surgical and medical cases ( κ=0.00 and 0.13, respectively). In discordant cases, physicians said that quality problems were unavoidable, small lapses in otherwise satisfactory care, present on admission, or resulted in no adverse outcome.

Conclusions

We identified many discrepancies between explicit and implicit review of complications and quality. Physician reviewers may not consider process problems that are ubiquitous in hospitals to represent substandard quality.