BMJ  2008;336:876-880 (19 April), doi:10.1136/bmj.39517.495764.25 (published 25 March 2008)

Research

Internal and external validity of cluster randomised trials: systematic review of recent trials

¹ Centre for Health Sciences, Barts and The London School of Medicine and Dentistry, London E1 2AT, ² Wolfson Institute of Preventive Medicine, Barts and The London School of Medicine and Dentistry, London EC1M 6BQ

Objectives To assess aspects of the internal validity of recently published cluster randomised trials and explore the reporting of information useful in assessing the external validity of these trials.

Design Review of 34 cluster randomised trials in primary care published in 2004 and 2005 in seven journals (British Medical Journal, British Journal of General Practice, Family Practice, Preventive Medicine, Annals of Internal Medicine, Journal of General Internal Medicine, Pediatrics).

Data sources National Library of Medicine (Medline) via PubMed.

Data extraction To assess aspects of internal validity we extracted data on appropriateness of sample size calculations and analyses, methods of identifying and recruiting individual participants, and blinding. To explore reporting of information useful in assessing external validity we extracted data on cluster eligibility, cluster inclusion and retention, cluster generalisability, and the feasibility and acceptability of the intervention to health providers in clusters.

Results 21 (62%) trials accounted for clustering in sample size calculations and 30 (88%) in the analysis; about a quarter were potentially biased because of procedures surrounding recruitment and identification of patients; individual participants were blind to allocation status in 19 (56%) and outcome assessors were blind in 15 (44%). In almost half the reports, information relating to generalisability of clusters was poorly reported, and in two fifths there was no information about the feasibility and acceptability of the intervention.

Conclusions Cluster randomised trials are essential for evaluating certain types of interventions. Issues affecting their internal validity, such as appropriate sample size calculations and analysis, have been widely disseminated and are now better addressed by researchers. Blinding of those identifying and recruiting patients to allocation status is recommended but is not always carried out. There may be fewer barriers to internal validity in trials in which individual participants are not recruited. External validity seems poorly addressed in many trials, yet is arguably as important as internal validity in judging quality as a basis for healthcare intervention.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Relevant Articles

Assessment of generalisability in trials of health interventions: suggested framework and systematic review

C Bonell, A Oakley, J Hargreaves, V Strange, and R Rees
BMJ 2006 333: 346-349. [Full Text] [PDF]

Process evaluation in randomised controlled trials of complex interventions

Ann Oakley, Vicki Strange, Chris Bonell, Elizabeth Allen, Judith Stephenson RIPPLE Study Team
BMJ 2006 332: 413-416. [Full Text] [PDF]

CONSORT statement: extension to cluster randomised trials

Marion K Campbell, Diana R Elbourne, and Douglas G Altman
BMJ 2004 328: 702-708. [Extract] [Full Text] [PDF]

Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals

Suezann Puffer, David Torgerson, and Judith Watson
BMJ 2003 327: 785-789. [Abstract] [Full Text] [PDF]

Framework for design and evaluation of complex interventions to improve health

Michelle Campbell, Ray Fitzpatrick, Andrew Haines, Ann Louise Kinmonth, Peter Sandercock, David Spiegelhalter, and Peter Tyrer
BMJ 2000 321: 694-696. [Extract] [Full Text] [PDF]

Cluster randomised trials: time for improvement

Marion K Campbell and Jeremy M Grimshaw
BMJ 1998 317: 1171-1172. [Extract] [Full Text] [PDF]

Statistics notes: Sample size in cluster randomisation

Sally M Kerry and J Martin Bland
BMJ 1998 316: 549. [Abstract] [Full Text] [PDF]

Rapid Responses:

Read all Rapid Responses

How far is between clinical trials and clinical practice?

Hongcai Shang, et al.
bmj.com, 27 Mar 2008 [Full text]