Intended for healthcare professionals

Papers

Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery

BMJ 1998; 316 doi: https://doi.org/10.1136/bmj.316.7146.1697 (Published 06 June 1998) Cite this as: BMJ 1998;316:1697

This article has a correction. Please see:

  1. J Poloniecki, lecturer in statistics (j.poloniecki{at}sghms.ac.uk)a,
  2. O Valencia, research fellowb,
  3. P Littlejohns, director, Health Care Evaluation Unita
  1. aPublic Health Sciences, St George's Hospital Medical School, London SW17 0RE,
  2. bRegional Cardiothoracic Unit, St George's Hospital, London SW17 0RE
  1. Correspondence to: Dr Poloniecki
  • Accepted 13 January 1998

Abstract

Objective: To detect changes in mortality after surgery, with allowance being made for variations in case mix.

Design: Observational study of postoperative mortality from January 1992 to August 1995.

Setting: Regional cardiothoracic unit.

Subjects: 3983 patients aged 16 and over who had open heart operations.

Main outcome measures: Preoperative risk factors and postoperative mortality in hospital within 30 days were recorded for all surgical heart operations. Mortality was adjusted for case mix using a preoperative estimate of risk based on additive Parsonnet factors. The number of operations required for statistical power to detect a doubling of mortality was examined, and control limits at a nominal significance level of P=0.01 for detection of an adverse trend were determined.

Results: Total mortality of 7.0% was 26% below the Parsonnet predictor (P<0.0001). There was a highly significant variation in annual case mix (Parsonnet scores 8.7-10.6, P<0.0001). There was no significant variation in mortality after adjustment for case mix (odds ratio 1-1.5, P=0.18) with monitoring by calendar year. With continuous monitoring, however, nominal 99% control limits based on 16 expected deaths were crossed on two occasions.

Conclusions: Hospital league tables for mortality from heart surgery will be of limited value because year to year differences in death rate can be large (odds ratio 1.5) even when the underlying risk or case mix does not change. Statistical quality control of a single series with adjustment for case mix is the only way to take into account recent performance when informing a patient of the risk of surgery at a particular hospital. If there is an increase in the number of deaths the chances of the next patient surviving surgery can be calculated from the last 16 deaths.

Key messages

  • Changes in the patient population affect a hospital's annual death rate

  • Year to year differences in death rate can be large even when there is no change in the underlying risk or case mix

  • It takes surprisingly many operations before an increase in death rate can be distinguished from random fluctuation

  • A formal inquiry should take place in a hospital if the death rate rises above control limits

  • The chances of the next patient surviving surgery should be calculated using the surgeon's most recent results

Footnotes

  • Accepted 13 January 1998
View Full Text