BMJ 1998;317:273-276 ( 25 July )

Education and debate

Getting research findings into practice

Barriers and bridges to evidence based clinical practice

This is the fourth in a series of eight articles analysing the gap between research and practice

Brian Haynes, professor of clinical epidemiology and medicinea Andrew Haines, professor of primary health careb

a Faculty of Health Sciences, McMaster University, 1200 Main St West, Hamilton, Ontario, Canada L8N 3Z5, b Department of Primary Care and Population Sciences, Royal Free and University College London Schools of Medicine, London NW3 2PF

Correspondence to: Professor Haynes bhaynes{at}fhs.mcmaster.ca

Series editors: Andrew Haines and Anna Donald

Clinicians and healthcare planners who want to improve the quality and efficiency of healthcare services will find help in research evidence. This evidence is increasingly accessible through information services that combine high quality evidence with information technology. However, there are several barriers to the successful application of research evidence to health care. We discuss both the prospects for harnessing evidence to improve health care and the problems that readers---clinicians, planners, and patients---will need to overcome to enjoy the benefits of research (box).

Problems in implementing evidence based medicine and possible solutions
Problem Solution
 bullet The size and complexity of the research Use services that abstract and synthesise information
 bullet Difficulties in developing evidence based clinical policy Produce guidelines for how to develop evidence based clinical guidelines
Use information systems that integrate evidence and guidelines with patient care
 bullet Difficulties in applying evidence in practice because of the following factors: Develop facilities and incentives to encourage effective care and better disease management systems
 bullet Poor access to best evidence and guidelines Improve effectiveness of educational and quality
improvement programmes for practitioners
 bullet Organisational barriers Develop more effective strategies to encourage patients to follow healthcare advice
 bullet Ineffectual continuing education programmes
 bullet Low patient adherence to treatments

The aim of evidence based health care is to provide the means by which current best evidence from research can be judiciously and conscientiously applied in the prevention, detection, and care of health disorders.1 This aim is decidedly ambitious given how slowly important new treatments are disseminated into practice2-4 and how resistant practitioners are to withdrawing established treatments from practice even once their utility has been disproved.5

Summary points


The aim of evidence based practice is to integrate current best evidence from research with clinical policy and practice

Practitioners have difficulty finding, assessing, interpreting, and applying current best evidence

New evidence based services (such as electronic databases, systematic reviews, and journals that summarise evidence) make accessing current best evidence feasible and easy in clinical settings

Progress is slow in creating evidence based clinical policy and in ensuring that evidence and policy are applied at the right time

The barriers to the dissemination and timely application of research findings in the making of decisions about health care are complex and have been little studied. They include many factors beyond the control of the practitioner and patient (such as being in the wrong place when illness occurs) as well as factors that might be modified to advantage (such as doing the wrong thing at the right time). Rather than attempting to dissect all these barriers, we present a simple model of the path (figure) along which evidence might travel to assist practitioners in making timely healthcare decisions. We will consider some barriers along this path and some bridges that are being constructed over the barriers.

    Generating research evidence

The path begins with biomedical research: the shape of the wedge symbolises the process of testing innovations in health care and eliminating those that lack merit (figure). The broad edge of the wedge represents the initial testing of innovations, which usually occurs in laboratories; many new products and processes are discarded early in the testing process. Products or processes with merit then undergo field trials; these initial studies aim to assess toxicity and to estimate efficacy. Many innovations fail, but a few merit more definitive testing in large controlled trials with important clinical endpoints. It is only when studies are successful that serious efforts at dissemination and application are warranted. Increasingly, behavioural interventions, surgical procedures, and alternative approaches to the organisation and delivery of care are being subjected to similarly rigorous evaluation.

The biomedical and applied research enterprise represented by the wedge is vigorous, with an annual investment of over $55bn (£34.4bn) worldwide.6 The amount of money spent on research provides hope that healthcare services can be improved despite cutbacks in spending that are occurring in many countries. Unfortunately, many loose connections exist between research efforts and clinical practice, not the least of which is that preliminary studies far outnumber definitive ones, and all compete in the medical literature for the attention of readers.7


View larger version (16K):
[in this window]
[in a new window]
 
The path from the generation of evidence to the application of evidence

    Steps from research to practice

The boxes to the right of the wedge (figure) represent the three steps that are needed to harness research evidence for healthcare practice. These steps include synthesising the evidence; developing clinical policy from the evidence; and applying the policy at the right place, in the right way, and at the right time. All three steps must be negotiated to form a valid connection between evidence and practice.

Synthesising the evidence
Most results from research appear first in peer reviewed journals, but the small number of clinically important studies are spread thinly through a vast number of publications; readers are bound to be overwhelmed. Models for critically appraising evidence have been developed and disseminated,8 but applying these is time consuming. The newest bridges that can be used to overcome this barrier include abstracting services that critically appraise studies in which the results are ready to be applied to clinical settings; these appraisals are then summarised in a journal. 9 10 Many more of these new types of journals are being developed so that eventually most clinical specialties will have their own. More importantly, the Cochrane Collaboration has pledged to summarise all randomised controlled trials of healthcare interventions, and The Cochrane Library is now a robust resource.11

Along with these new services, advances in information technology can provide quick and often inexpensive access to high quality research evidence at the patient's bedside, in the clinician's office, or at the clinician's home. 8 12 Computerised decision support systems are maturing and allowing research findings to be taken one step further by fitting the evidence into patient specific reminders and aids to decision making embedded in clinical information systems.13 These innovations are making the practice of evidence based health care much more feasible.

Creating evidence based clinical policies
To be both evidence based and clinically useful, clinical policy must balance the strengths and limitations of all relevant research evidence with the practical realities of the healthcare and clinical settings.14 This is a problematic step because of limitations in both the evidence that is available and in policy making. Clinical practice guidelines developed by national groups may help individual practitioners but the expertise, will, resources, and effort required to ensure that they are scientifically sound as well as clinically helpful are in short supply, as witnessed by the conflicting guidelines issued by various professional bodies.15 National healthcare policies are often moulded by a range of non-evidence based factors including historical, cultural, and ideological influences. Moreover, when national guidelines or healthcare policies encourage clinicians to perform procedures that are not evidence based, the unnecessary work acts as a barrier to the implementation of other well founded knowledge.

"Guidelines for guidelines" have been developed that will help if followed.16 Evidence and guidelines must be understood by practitioners if they are to be applied well; understanding new material is a slow process that is not aided by traditional continuing education offerings.17 Additionally, local and individual circumstances of clinical practice often affect the delivery of care, and national guidelines must be tailored to local circumstances by local practitioners; this tailoring of guidelines to local circumstances is a process that is only just beginning to occur.18 Evidence can be used by individual practitioners to make policies, but few practitioners have the time and skill to derive policies from research evidence. The difficulties in developing sound policies are perhaps the greatest barriers to the implementation of research findings. Clinicians are in the best position to be able to balance research evidence with clinical circumstances, and must think and act as part of the team planning for change if progress is to be made.

Applying evidence based policy in practice
The next step in getting from research to practice is to apply evidence based policy at the right time, in the right place, and in the right way. Again, there are barriers at the local and individual levels. For example, for thrombolysis for acute myocardial infarction to be delivered within the brief time in which it is effective, the patient must recognise the symptoms, get to the hospital (avoiding a potentially delaying call to the family physician), and be seen right away by a health professional who recognises the problem and initiates treatment. For many people in many places this is still not happening. 19 20

In some cases, particularly for surgery and other skilled procedures such as invasive diagnostic testing, a lack of training may constitute a barrier to implementing research findings. The complexity of guidelines may also thwart their application.21 Organisational barriers to change must also be dealt with, for example, by ensuring that general practitioners have access to echocardiography to diagnose heart failure before starting treatment with angiotensin converting enzyme inhibitors.22 Changes in the organisation of care (including in disease management), improvements in continuing education, interventions to improve quality among practitioners,17 and improvements in computerised decision support systems,13 are beginning to make inroads into the last steps that connect research evidence with practice. Unfortunately, these may all be undermined by limitations in the resources available for health services. Additionally, inappropriate economic measures may be used to evaluate healthcare programmes23 though cost effective interventions may require considerable initial investment and have delayed benefits (this is especially true in the implementation of preventive procedures).

    Making clinical decisions

Once the evidence has been delivered to the practitioner and the practitioner has recalled the evidence correctly and at the right place and time, there are still steps to be taken. Firstly, the practitioner must define each patient's unique circumstances; this includes determining what is wrong with the patient and assessing how it is affecting the patient. For example, the cost effectiveness of lowering cholesterol concentrations with statins is highly dependent on the patient's own risk of adverse outcomes.24 Secondly, the practitioner must then ask if the patient has any other problems that might influence the decision of which treatment is likely to be safe and effective. For example, carotid endarterectomy is highly effective for symptomatic carotid stenosis25 but patients must be physically fit enough to have surgery. Evaluating the patient's clinical circumstances requires clinical expertise, without which no amount of research evidence will suffice.

Also, and increasingly, the patient's preferences, values, and rights are entering into the process of deciding on appropriate management. Thus, patients who are averse to immediate risk or cost may decline surgical procedures, such as endarterectomy, that offer longer term benefits even if they are physically fit to have surgery. Research evidence must be integrated with the patient's clinical circumstances and wishes to derive a meaningful decision about management, a process that no cookbook can describe. Indeed, everyone is still ignorant about the art of clinical practice. Although there is some evidence that exploring patients' experiences of illness may lead to improvements in their outcomes,26 more research is needed into how to improve communication between clinicians and patients if we are to enhance progress in achieving evidence based health care. Additionally, there is a growing body of information available to patients that is both scientifically sound and intelligible, and many consumer and patient groups have made such material widely available.27 Interactive media are being used (but not widely) to provide information to assist patients in making decisions about options for diagnosis and treatment.28

Finally, patients must follow the prescribed treatment plan; increasingly they are doing this independently because of the availability of effective treatments that allow ambulatory, self administered care, and also because of cutbacks in health services that necessitate more self care. We can help patients continue their care, but we are not so successful in helping them to follow our prescriptions closely, which dissipates much of the benefit of treatment.29

    Conclusion

Successfully bridging the barriers between research evidence and clinical decision making will not ensure that patients receive optimal treatment; there are many other factors that might prevail, for example, the underfunding of health services and the maldistribution of resources. Nevertheless, incorporating current best evidence into clinical decision making promises to decrease the traditional delay between the generation of evidence and its application, and to increase the proportion of patients to whom current best treatment is offered. Quick access to accurate summaries of the best evidence is rapidly improving. The means for creating evidence based clinical policy and applying this policy judiciously and conscientiously are under development with help from health services research and information research.

The articles in this series are adapted from Getting Research Findings into Practice, edited by Andrew Haines and Anna Donald and published by the BMJ Publishing Group
    References
  1. Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB. Evidence based medicine: what it is and what it isn't. BMJ 1996; 312: 71-72[Free Full Text].
  2. Mair F, Crowley T, Bundred P. Prevalence, aetiology and management of heart failure in general practice. Br J Gen Pract 1996; 46: 77-79[Medline].
  3. Mashru M, Lant A. Interpractice audit of diagnosis and management of hypertension in primary care: educational intervention and review of medical records. BMJ 1997; 314: 942-946[Abstract/Free Full Text].
  4. Sudlow M, Rodgers H, Kenny R, Thomson R. Population based study of use of anticoagulants among patients with atrial fibrillation in the community. BMJ 1997; 314: 1529-1530[Free Full Text].
  5. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of experts. JAMA 1992; 268: 240-248[Abstract].
  6. Michaud C, Murray CJL. Resources for health research and development in 1992: a global overview. Investing in health research and development: report of the ad hoc committee on health research relating to future intervention options. Geneva: World Health Organisation, 1996:217.
  7. Haynes RB. Loose connections between peer reviewed clinical journals and clinical practice. Ann Intern Med 1990; 113: 724-728.
  8. Sackett DL, Richardson SR, Rosenberg W, Haynes RB. Evidence-based medicine: how to practice and teach EBM. London: Churchill Livingstone , 1997.
  9. Haynes RB. The origins and aspirations of ACP Journal Club. Ann Intern Med 1991; 114 (suppl 1): A18. (ACP Journal Club.)
  10. Sackett DL, Haynes RB. On the need for evidence-based medicine. Evidence-Based Med 1995; 1: 5.
  11. The Cochrane Library [database on disk and CD ROM]. Cochrane Collaboration. Oxford: Update Software; 1996-. Updated quarterly.
  12. Hersh W. Evidence-based medicine and the internet. ACP J Club July-Aug 1996;125:A14-6.
  13. Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med 1994; 120: 135-142[Abstract/Free Full Text].
  14. Gray JAM, Haynes RB, Sackett DL, Cook DJ, Guyatt GH. Transferring evidence from health care research into medical practice. 3. Developing evidence-based clinical policy. Evidence-Based Med 1997; 2: 36-38.
  15. Krahn M, Naylor CD, Basinski AS, Detsky AS. Comparison of an aggressive (US) and a less aggressive (Canadian) policy for cholesterol screening and treatment. Ann Intern Med 1991; 115: 248-255.
  16. Carter A. Background to the "guidelines for guidelines" series. Can Med Assoc J 1993; 148: 383.
  17. Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance: a systematic review of the effect of educational strategies. JAMA 1995; 274: 700-705[Abstract].
  18. Karuza J, Calkins E, Feather J, Hershey CD, Katz L, Majeroni B. Enhancing physician adoption of practice guidelines: dissemination of influenza vaccination guideline using a small-group consensus process. Arch Intern Med 1995; 155: 625-632[Abstract].
  19. Doorey AJ, Michelson EL, Topol EJ. Thrombolytic therapy of acute myocardial infarction. JAMA 1992; 268: 3108-3114[Abstract].
  20. Ketley D, Woods KL. Impact of clinical trials on clinical practice: example of thrombolysis for acute myocardial infarction. Lancet 1993; 342: 891-894[Medline].
  21. Grilli R, Lomas J. Evaluating the message: the relationship between compliance rate and the subject of a practice guideline. Med Care 1994; 132: 202-213.
  22. Aszkenasy OM, Dawson D, Gill M, Haines A, Patterson DLH. Audit of direct access cardiac investigations: experience in an inner London health district. J R Soc Med 1994; 87: 588-590[Medline].
  23. Sutton M. How to get the best health outcome for a given amount of money. BMJ 1997; 315: 47-49[Free Full Text].
  24. Pharoah PD, Hollingworth W. Cost effectiveness of lowering cholesterol concentration with statins in patients with and without pre-existing coronary heart disease: life table method applied to health authority population. BMJ 1996; 312: 1443-1448[Abstract/Free Full Text].
  25. European Carotid Surgery Trialists' Collaborative Group. MRC European carotid surgery trial: interim results for symptomatic patients with severe (70-99%) or with mild (0-29%) carotid stenosis. Lancet 1991; 337: 1235-1243[Medline].
  26. Stewart M. Studies of health outcomes and patient-centred communication. In: Stewart M, Brown JB, Weston WW, McWhinney IR, McWilliam CL, Freeman TR, eds. . Patient centred medicine. Thousand Oaks, CA: Sage Publications, 1995:185-190.
  27. Stocking B. Implementing the findings of effective care in pregnancy and childbirth. Milbank Q 1993; 71: 497-522[Medline].
  28. Shepperd S, Coulter A, Farmer AU. Using interactive videos in general practice to inform patients about treatment choices. Family Pract 1995; 12: 443-447[Abstract/Free Full Text].
  29. Haynes RB, McKibbon KA, Kanani R. Systematic review of randomised controlled trials of the effects on patient adherence and outcomes of interventions to assist patients to follow prescriptions for medications. The Cochrane Library [database on disk and CD ROM]. Cochrane Collaboration; 1997, Issue 2. Oxford: Update Software; 1997. Updated quarterly.


© BMJ 1998

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

This article has been cited by other articles:

  • Owen, P. S, Golightly, L. K, MacLaren, R., Ferretti, K. A, Badesch, D. B (2008). Formulary Management of Recombinant Factor VIIa at an Academic Medical Center. The Annals of Pharmacotherapy 42: 771-776 [Abstract] [Full text]  
  • Kerr, E. A., Zikmund-Fisher, B. J., Klamerus, M. L., Subramanian, U., Hogan, M. M., Hofer, T. P. (2008). The Role of Clinical Uncertainty in Treatment Decisions for Diabetic Patients with Uncontrolled Blood Pressure. ANN INTERN MED 148: 717-727 [Abstract] [Full text]  
  • Mulvaney, S. A., Bickman, L., Giuse, N. B., Lambert, E. W., Sathe, N. A., Jerome, R. N. (2008). A Randomized Effectiveness Trial of a Clinical Informatics Consult Service: Impact on Evidence-based Decision-making and Knowledge Implementation. J. Am. Med. Inform. Assoc. 15: 203-211 [Abstract] [Full text]  
  • Hewson, P. (2007). Evidence-based practice in road casualty reduction. Inj. Prev. 13: 291-292 [Full text]  
  • Bourgault, A. M., Ipe, L., Weaver, J., Swartz, S., O'Dea, P. J. (2007). Development of Evidence-Based Guidelines and Critical Care Nurses ' Knowledge of Enteral Feeding. Crit Care Nurse 27: 17-29 [Full text]  
  • Aittasalo, M., Miilunpalo, S., Stahl, T., Kukkonen-Harjula, K. (2007). From innovation to practice: initiation, implementation and evaluation of a physician-based physical activity promotion programme in Finland. HEALTH PROMOT INT 22: 19-27 [Abstract] [Full text]  
  • Kernick, D. (2006). Wanted--new methodologies for health service research. Is complexity theory the answer?. Fam Pract 23: 385-390 [Abstract] [Full text]  
  • Marchetti, F., Ronfani, L., Nibali, S. C., Tamburlini, G., for the Italian Study Group on Acute Otitis Media, (2005). Delayed Prescription May Reduce the Use of Antibiotics for Acute Otitis Media: A Prospective Observational Study in Primary Care. Arch Pediatr Adolesc Med 159: 679-684 [Abstract] [Full text]  
  • Burkiewicz, J. S, Zgarrick, D. P (2005). Evidence-Based Practice by Pharmacists: Utilization and Barriers. The Annals of Pharmacotherapy 39: 1214-1219 [Abstract] [Full text]  
  • Giuse, N. B., Koonce, T. Y., Jerome, R. N., Cahall, M., Sathe, N. A., Williams, A. (2005). Evolution of a Mature Clinical Informationist Model. J. Am. Med. Inform. Assoc. 12: 249-255 [Abstract] [Full text]  
  • Cooper, T. (2005). Delivering an infection control link nurse programme: an exploration of the experiences of the link nurses. British Journal of Infection Control 6: 20-23 [Abstract]  
  • Cooper, T. (2004). Delivering an infection control link nurse programme: implementation and evaluation of a flexible teaching approach. British Journal of Infection Control 5: 24-26 [Abstract]  
  • Maher, C. G, Sherrington, C., Elkins, M., Herbert, R. D, Moseley, A. M (2004). Challenges for Evidence-Based Physical Therapy: Accessing and Interpreting High-Quality Evidence on Therapy. ptjournal 84: 644-654 [Abstract] [Full text]  
  • Jette, D. U, Bacon, K., Batty, C., Carlson, M., Ferland, A., Hemingway, R. D, Hill, J. C, Ogilvie, L., Volk, D. (2003). Evidence-Based Practice: Beliefs, Attitudes, Knowledge, and Behaviors of Physical Therapists. ptjournal 83: 786-805 [Abstract] [Full text]  
  • Wahlstrom, R., Hummers-Pradier, E., Lundborg, C. S., Muskova, M., Lagerlov, P., Denig, P., Oke, T., de Saintonge, D M. C. (2002). Variations in asthma treatment in five European countries--judgement analysis of case simulations. Fam Pract 19: 452-460 [Abstract] [Full text]  
  • Brown, J. B., Harris, S. B, Webster-Bogaert, S., Wetmore, S., Faulds, C., Stewart, M. (2002). The role of patient, physician and systemic factors in the management of type 2 diabetes mellitus. Fam Pract 19: 344-349 [Abstract] [Full text]  
  • Haynes, R B., Devereaux, P J, Guyatt, G. H (2002). Physicians' and patients' choices in evidence based practice. BMJ 324: 1350-1350 [Full text]  
  • Closs, S. J., Bryar, R. M. (2001). The BARRIERS scale: Does it 'fit' the current NHS research culture?. Journal of Research in Nursing 6: 853-865 [Abstract]  
  • Cranney, M., Warren, E., Barton, S., Gardner, K., Walley, T. (2001). Why do GPs not implement evidence-based guidelines? A descriptive study. Fam Pract 18: 359-363 [Abstract] [Full text]  
  • McQueen, M. J. (2001). Overview of Evidence-based Medicine: Challenges for Evidence-based Laboratory Medicine. Clin. Chem. 47: 1536-1546 [Abstract] [Full text]  
  • Powell, C V E, Maskell, G R, Marks, M K, South, M, Robertson, C F, LENNEY, W. (2001). Successful implementation of spacer treatment guideline for acute asthma. Arch. Dis. Child. 84: 142-146 [Abstract] [Full text]  
  • Lipman, T. (2000). Power and influence in clinical effectiveness and evidence-based medicine. Fam Pract 17: 557-563 [Abstract] [Full text]  
  • McCray, A. T. (2000). Better Access to Information about Clinical Trials. ANN INTERN MED 133: 609-614 [Abstract] [Full text]  
  • Wu, C. L., Fleisher, L. A. (2000). Outcomes Research in Regional Anesthesia and Analgesia. Anesth. Analg. 91: 1232-1242 [Full text]  
  • Campbell, M., Fitzpatrick, R., Haines, A., Kinmonth, A. L., Sandercock, P., Spiegelhalter, D., Tyrer, P. (2000). Framework for design and evaluation of complex interventions to improve health. BMJ 321: 694-696 [Full text]  
  • Montgomery, A. A, Fahey, T., Peters, T. J, MacIntosh, C., Sharp, D. J (2000). Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial. BMJ 320: 686-690 [Abstract] [Full text]  
  • Jones, R. (2000). Primary care research: ends and means. Fam Pract 17: 1-4 [Full text]  
  • Keenan, E., Barry, J., van Teijlingen, E., Ryan, M., Matheson, C., Bond, C. (1999). Managing drug misuse in general practice. BMJ 319: 1497-1497 [Full text]  
  • VENINGA, C. C. M., ØV, P. L., WAHLSTRÖM, R., MUSKOVA, M., DENIG, P., BERKHOF, J., KOCHEN, M. M., HAAIJER-RUSKAMP, F. M., the Drug Education Project Gro, (1999). Evaluating an Educational Intervention to Improve the Treatment of Asthma in Four European Countries. Am. J. Respir. Crit. Care Med. 160: 1254-1262 [Abstract] [Full text]  
  • Kernick, D., Stead, J., Dixon, M. (1999). Moving the research agenda to where it matters. BMJ 319: 206-207 [Full text]  
  • Bauchner, H. (1999). Evidence-based Medicine: A New Science or an Epidemiologic Fad?. Pediatrics 103: 1029-1031 [Full text]  
  • Fahey, T. (1998). Assessing heart disease risk in primary care. BMJ 317: 1093-1094 [Full text]  



Student BMJ

Risk of surgery for inflammatory bowel disease: record linkage studies

What can you learn from this BMJ paper? Read Leanne Tite's Paper+

www.student.bmj.com

Listen to the latest BMJ Interview