BMJ No. 7064 Volume 313 Saturday 26 October 1996
This is the first article in a new section on managing clinical information that will appear regularly in the journal. This week, Richard Smith considers the information needs of doctors. He reviews existing research and draws conclusions about what information doctors need, what they think they need, how they try to find it, and how they determine its value
The aims of this section are:
| Summary points |
|
|
The primary focus of this review is on how to connect the rapidly expanding knowledge base of medicine with the doctor treating an individual patient. The review is aimed at ordinary doctors, not at informatics experts, but attempts to review comprehensively and critically what we know about doctors' information needs. A secondary objective is to identify where further research is required.
| Table 1 - Categories of in formation needed by doctors | ||
| Type of information | Source | Comments |
| On particular patients | Patient Patient's family Referring doctor Rest of health team Patient record Laboratory data | Much of the art of medicine lies in gathering this information |
| Data on health and sickness within local population | Public health departments | Often not available on a sufficiently
local scale Time sensitive |
| Medical knowledge | Textbooks Journals Electronic databases Many sources | Problem is to match the knowledge to the individual patient |
| Local information on doctors available for referral, etc | Local sources | Rapidly changing |
| Information on local social influences and expectations | Local sources | Often not made explicit |
| Information on scientific, political, legal, social, management, and ethical changes that will affect both how medicine is practised in a society and how doctors will interact with individual patients | Diverse sources - local, national, and international | Information is diffuse, often comes from non-medical disciplines, and is often jargon ridden |
I identified 13 studies that collected original data on the information needs and wants of doctors. Table 2 summarises the studies in chronological order.(8-22) Many of the studies are of only moderate quality, and all but one is American. The studies use different methods, and most are on small populations of doctors. It would not be sensible to try to combine the studies' results, but I have used all of them to try to identify what we do and do not know. I have summarised in the text studies that illustrate how the study of doctors' information needs has developed.
| Table 2 - Summary of studies that have investigated the in formation needs of doctors | |||||||
| Study | Method | Subjects | Setting | Question rate per patient encounter | Percentage answered | Type of information needed | Source of answers |
| Strasser 1978(8) | Questionnaire | 258 Practising doctors | Upstate New York | NA | NA | New
developments in specialty 1st Drug information 2nd Cancer 3rd |
Papers in journals 1st Colleagues 2nd Books 3rd |
| Stinson et al 1980(9) | Administered questionnaire | 402 Health professionals (309 physicians) | Alabama | NA | NA | NA | Medical literature regularly or often 93% Colleagues regularly or often 77% |
| Northup et al 1983(10) | Critical incident technique | 293 Medical students and doctors | New Mexico | NA | NA |
Disease related 49% Drug related 23% Procedure related 19% |
Book 36% Colleagues 33% |
| Covell et al 1985(11) | After visit interview | 47 Primary care doctors | Office | 0.66 | NA |
Treatment 31% Diagnosis 25% Drug related 14% | Another doctor
29% Other health professionals 24% |
| Timpka et al 1989(12) | Questionnaire, including critical incident question | 84 General practitioners | Sweden | NA | 51% | General medicine 48% Dermatology 11% |
Colleagues 38% Textbooks 37% Library 12% |
| Williamson et al | Telephone survey | 492 Primary care doctors, 90 opinion leaders | United States | NA | NA | Drug related 38% Laboratory tests 25% | NA |
| Woolf et al 1989(14) | Administered questionnaire | 42 Professors, 25 house staff | Academic centre, paediatrics and internal medicine | NA | NA | Treatment 77% Differential diagnosis 75% Drug related 64% | Textbooks 64% Colleagues 60% |
| Timpka et al 1990(15) | Video recordings of consultations | 12 General practitioners | Four Swedish health centres | 1.85 | NA | Diagnosis 55% Treatment 33% Orthopaedics 29% Internal medicine 26% | NA |
| Osheroff et al 1991(16) | Anthropological observation | 24 Doctors and medical students | University based internal medicine | 5.77 | NA | Specific patient
61% Treatment 25% | Patient record 42% Hospital information system 39% |
| Ely et al 1992(18) | Observation | 34 Family physicians | Accessible to Columbia, Missouri | 0.07 | All, implied |
Treatment 73% Drug related 49% Diagnosis 27% | Colleagues 29%
Physicians' desk reference 27% |
| Gorman et al 1994(19) | Interview after patient visit | 49 Doctors | Office | 0.57 | 80% | NA |
Colleagues 46% Textbooks 41% |
| Bowden et al 1994(21) | Questionnaire | 442 Doctors | Five Texas counties | NA | NA | Treatment 34% Diagnosis 28% Drug related 18% | Books and journals 85% Colleagues 75% |
| Guise et at 1994(22) | Record review | 7 Health professionals | AIDS outpatient clinic | 2.22 | NA |
Treatment 24% Drug related 18% | Electronic online 87% Paper sources 13% |
| NA = Not available. | |||||||
Nearly two thirds of the respondents from both samples said that the current volume of scientific information was unmanageable, and more than a third said that "most physicians find the effort to get information from the literature to be a major problem." The researchers asked about "markers" of knowledge selected by a consensus of advisory panels and found severe deficiencies: half the respondents did not know that digoxin should be withdrawn in elderly patients with uncomplicated congestive heart failure (interestingly, later papers have disputed this medical "fact"(23)); more than a third of all doctors (and two thirds of those in general practice) did not know that glycated haemoglobin was a good measure of diabetic control; and more than a third of obstetricians did not know that experts advised a trial of labour in patients who had undergone previous caesarean sections.
The biggest problem with this study is that it reports self perceived estimates and opinions, but doctors are perhaps unlikely to be biased to reporting the picture as even worse than it is - and it seems bad. Doctors face a serious problem in keeping up to date. They do not know about important advances, feel overwhelmed by new scientific information, are not good at finding new information, and do not know how to evaluate it when it is found. "Science information management," conclude the authors, "is a critical professional skill that is not adequately taught in undergraduate medical education." Too often practitioners "don't know what they don't know."(13)
The physicians answered the questionnaire by saying that they needed information about once a week, but 269 questions were raised during the interviews after 409 patient visits - about two questions for every three patients seen. Of these questions, 107 (40%) were questions of fact ("What are the side effects of bromocriptine?"), 120 (45%) were questions of medical opinion ("How do you manage a patient with labile hypertension?"), and 42 (16%) were questions of non-medical information ("How do you arrange home care for a patient?"). About a third of the questions were about treatment of specific conditions, a quarter about diagnosis, and 14% about drugs. For the subspecialists, about a third of their questions related to their own specialties and about two thirds to other subapecialties.
One important finding was that the questions were asked in a "non-generalised but practice related fashion" that would make it hard to find the answers. Thus doctors would ask "Should I test the serum procainamide level in this patient?" rather than "What are the indications for measuring serum procainamide?"
Table 3 shows the sources of information that the doctors claimed they used on the questionnaire and those that they reported using when interviewed immediately after the patients' visits. The doctors believed that they used print sources a lot, but in fact they were most likely to consult other doctors. Most of the doctors thought that they could find answers to their questions, more often from books than from journals. Although the doctors thought that they could answer their questions, only a third were answered while the interviewer was present. Each doctor had an average from one half day - of four questions that were not answered immediately. Lack of time, cost, poor organisatiom and non-availability of sources, and "a glut of sources of differing reliability" were seen as the barriers to finding information.(11)
| Table 3 - Reported and observed use of information sources (from Covell et al(11)) | |||
| Percentage use | |||
| Information source | Reported (n = 182) | Observed (n = 80) | |
| Print sources: | 62 | 27 | |
| General and specialty textbooks | 25 | 3 | |
| Pharmaceutical textbooks | 14 | 9 | |
| Journals | 18 | 7 | |
| Drug company information | 1 | 1 | |
| Self made compendia | 4 | 7 | |
| Human sources: | 33 | 53 | |
| Specialist doctors | 18 | 24 | |
| Generalist doctors | 1 | 1 | |
| Office partner | 3 | 4 | |
| Pharmacist | 8 | 3 | |
| Other | 5 | 21 | |
This study generally produces a bleak picture: all but one of the 47 doctors had a question relating to a patient during the half day, and on average doctors had four; most of the questions were not answered, but the doctors thought that they were able to answer their questions. "In a typical half day of office practice," conclude Covell et al, "four management decisions might have been altered if needed information had been available at the time of the patient visit."(11) We do not, of course, know how important the questions were or whether the patients would have done any better if these questions had been answered. The interviewers may also have prompted doctors to ask questions that they would not normally have asked.
The doctors conducting the study anticipated that 42% of the questions would be answered by patients' records, 39% by a hospital information system, and a quarter by the library. About a quarter of the 337 questions asked about patient care that the doctors anticipated could be answered via a library, a textbook, a journal, or Medline. A quarter of the questions required a synthesis of patient data and medical knowledge - for example, "Why do you think this patient has had three deep vein thromboses?" The researchers did not investigate how many of the questions could actually be answered.
A second paper from the same study - this time on 35 hours of observation - produced a more complicated picture of doctors' information needs.(17) Firstly, Forsythe and others observed that many information needs were not expressed as grammatical questions: indeed, they might not even be verbalised. Secondly, information needs might be hard to identify, and "the information seeking messages" might be interpretable only within the particular context. Thirdly, the needs might be for much more than specific clinical information. Doctors and students might be asking for support, guidance, and approval of what they are doing. Thus, one doctor asked "What do you do for the treatment of breast cancer?" about a patient who had exhausted all known treatments. The doctor was asking how she as a doctor could cope with being able to offer no further treatment to a woman dying of breast cancer. Such "information needs" are never likely to be met by a computer - or by books or journals - and may be one explanation why doctors tend to turn first to colleagues for information.
The doctors were interviewed immediately after each patient for half a day of practice and asked "Do you have any questions about the diagnosis or management of this patient's problems?" The researchers asked doctors to state "all the questions which occur to you during patient care, no matter whether you would pursue them or not, nor what source you might consult for an answer." At the end of the half day doctors were asked about 12 factors that might motivate them to seek answers to the questions (see table 4), and two to five days after the interview they were phoned to ask if they had pursued the questions. In addition, seven medical librarians conducted online searches to try to answer a random sample of 60 of the questions. The librarians then selected the "best" evidence they had found (such as meta-analyses and randomised controlled trials) and sent it back to the doctors, who were asked about the usefulness and relevance of the material. Sadly, there was a 6-12 month delay.
| Table 4 - Usefulness of information sources commonly used by doctors | ||||
| Information source | Relevance | Validity | Work | Usefulness |
| Evidence based, regularly updated textbook | High | High | Low | High |
| Systematic journal review | High | High | Low | High |
| Portable summary of systematic reviews | High | High | Low | High |
| Internet in 10 years' time | High | High | Low | High |
| Drug reference book | High | Moderate | Low | High or moderate |
| ACP Journal Club, Evidence-Based Medicine - forerunners of systematic abstract journals | Moderate | High | Low | High or moderate |
| Colleagues | Moderate | High | Low | High or moderate |
| Standard textbook | High | Low | Low | Moderate |
| Standard journal review | High | Moderate | Low | Moderate |
| Collections of systematic reviews - such as Cochrane library | Moderate but rising rapidly | High | High but should fall | Moderate |
| Free medical newspapers | High | Low | Low | Moderate |
| Continuing medical education - lectures | Moderate | Moderate | Low | Moderate |
| Continuing medical education - small groups | High | Moderate | Moderate | Moderate |
| Consensus statements | Moderate | Moderate | Low | Moderate |
| Clinical guidelines | Moderate | Moderate | Low | Moderate |
| Online searching | Moderate | High | High | Moderate |
| Journal articles | Low | High | High | Low |
| Drug advertising | Moderate | Low | Low | Low |
| Drug company representatives | High | Low | Low | Low |
| Mass media | Low | Low | Low | Low |
| Internet now | Low | Low | High | Low |
Complete data were gathered for 49 doctors, who had cared for 514 patients and asked 295 questions about diagnosis or management. The doctors had pursued less than a third of the questions and found answers for less than a quarter. A multiple logistic regression model showed that, of the 12 factors that might prompt doctors to pursue questions, only two were statistically significant predictors - the doctor's belief that a definitive answer existed and the urgency of the patient's problem. Doctors most commonly used colleagues to answer the questions. The librarians succeeded in answering most questions, but the mean cost for each question was $27 and the mean time taken was 43 minutes. The doctors thought that the information retrieved was would have had an impact on the patient in 40% of cases and on them in about half.
| Examples of unanswered questions of primary care doctors (from Gorman(6)) |
|
The limitations of this study are that it was small, had low participation and response rates, used volunteers, and depended on self reporting. Nevertheless, it shows yet again that many questions are generated during consultations, many remain unanswered that could be answered, the answers that are generated seem relevant and important for patient care, and the ones most likely to be answered are those which the doctors think they will find an answer to and when the patient's needs are urgent. The unanswered questions are an important missed opportunity to educate doctors and improve medical practice. But, conclude Gorman and Helfand, "reducing the cost of using medical information systems is, by itself, insufficient to increase their use by practismg physicians. New medical information systems, no matter how fast, inexpensive, and easy to use, will not be used more widely until it has been demonstrated to practitioners that these systems provide answers that help solve the problems of patient care."(20)
Guise and others asked seven health professionals to look through the medical records of 10 patients who had died of AIDS to "Identify questions (for example, points you would like more information about) that you think could be answered through information sources in printed or electronic form, such as journal articles, medical textbooks, printed abstracts, treatment protocols, etc."(22) The health professionals collected their questions, and then two of the paper's authors trained in library and information science tried to answer them. In the first phase of their search they searched standard textbooks and then four electronic databases. In the second phase they tried to answer questions that remained unanswered by reading printed material specifically related to AIDS and conducting additional online searches. The authors stopped their search as soon as they found an answer.
The 10 medical records covered 120 patient encounters. The health professionals identified 266 questions, an average of 38 each or 3.8 per patient. A quarter of the questions were about treatment. The authors were able to answer three quarters of the questions in phase one in an average time of 10 minutes and 18% in phase two in an average time of 22 minutes; 8% of questions could not be answered. Of the questions answered in phase one, 87% were answered from online sources.
Again this was a small study, and the questions were not generated by actual consultations of health professionals with patients. The health professionals were not invited to judge the correctness or the usefulness of the "answers," and the results cannot be generalised to other health care settings. However, the results show - as in most of the other studies - that large numbers of questions are generated by caring for this set of patients. Most of the questions can be answered, but it is time consuming and expensive to do so. Something better than present information systems is needed.
Firstly, all the studies show that information needs do arise regularly when doctors see patients. The doctors are generally aware of the needs themselves, but questior'ing the doctors immediately after they have seen patients shows that these needs are greater than doctors admit to in general surveys. Observing the doctors suggests that the needs are still greater. Only one of the studies considered information needs that the doctors themselves did not identify,(16)(17) and it found a much higher rate of questions for each patient encounter than any other study. There is an urgent need to repeat a study along these lines in other settings. I think that it is conservative to conclude that every interaction between a patient and a doctor is likely on average to generate at least one question. The real need is likely to be higher.
| Studies of information needs that still need to be done |
|
|
Secondly, these questions are most likely to be about treatment, and many of these are likely to be about drugs.
Thirdly, the questions are often complex and multidimensional. They are often questions about both particular patients and different areas of medical knowledge - for example, "In an octogenarian with anaemia, angina, and a history of transient ischaemic attacks, with a normal creatinine, iron, and mean corpuscular volume, who refuses a bone marrow exam, what diagnostic and therapeutic options are there?"
Fourthly, the need for information is often much more than a question about medical knowledge. Doctors are looking for guidance, psychological support, affirmation, commiseration, sympathy, judgment, and feedback. This "information need" is particularly poorly explored, and yet it may well be the most important need and the biggest stumbling block to a technical solution.
Fifthly, most of the questions generated in consultations go unanswered. We do not know from any of these studies whether answering the questions would lead to better patient outcomes or better doctors, but surely it would. We do know that many surveys of how much doctors know about important developments show severe deficiencies.(2)(15)
Sixthly, doctors are most likely to seek answers to their questions from other doctors. Weinberg et al found that 81 American doctors in a discrete geographical area consulted 23 experts, logging 11 calls to experts each month. Six experts received over 90% of the calls, about 90 each a month.(26) Doctors consult experts presumably because it is a quick, cheap, and easy method and because other doctors can also provide the psychological benefits that are not available from books, journals, and computers. One problem is that the doctors ''answering'' the questions may sometimes not be much more knowledgeable than the doctors seeking answers.
Seventhly, most of the questions generated by doctors can be answered, usually from electronic sources, but it is time consuming and expensive to do so - and demands information skills that many doctors do not have.
Eighthly, doctors in developed countries seem to be overwhelmed by the information provided for them. The amount of information is enormous and disorganised, and it is hard to find the answers to questions that arise in consultations.
| Usefulness of medical information = | |
| relevance x validity | |
| work to access |
The relevance of any information is based on the frequency of your exposure to the problem being addressed and the type of evidence being presented. Validity is the likelihood of the information being true, and the work to access the information is the time and effort that must be spent extracting the information. The ideal information source will be directly relevant, contain valid information, and be accessed with a minimal amount of work. Table 4 shows my judgment of how existing information sources score against these criteria. Seven sources score highly: colleagues and drug reference books, both of which are widely used; journals like ACP Journal Club or Evidence-Based Medicine, which scan medical journals and select abstracts of those that are clinically relevant and scientifically sound; evidence based, regularly updated textbooks, which are not yet available; systematic journal reviews, which are only just becoming available; a portable and comprehensive summary of systematic reviews, which is planned but does not yet exist; and the Internet in 10 years' time, which is pure speculation.
The deficiencies in current information sources make it clear that something more is required, and new sources are beginning to emerge. Nobody knows the form of the information tool that may transform medicine, but we can begin to discern some of its characteristics. The tool must be able to answer highly complex questions and so will have to be connected to a large valid database. Inevitably, it will be electronic, but it must be portable, fast, and easy to use. Almost certainly the tool will have to prompt doctors rather than simply answer questions, but it will have to do so in ways that doctors find helpful rather than demeaning. It will probably be connected to the patient record, and perhaps it will be as much a servant of patients as doctors, possibly changing fundamentally the doctorpatient relationship. A successful information tool will also meet the information needs of doctors that go beyond the need for answers to questions and begin to be a need for psychological support and affirmation.
"The big challenge for the next decade," writes Nicholas Negroponte, guru of the information age, "is to make computers that know you, learn about your needs, and understand verbal and non-verbal languages... [We need computers that] exhibit intelligence to such a degree that the physical interface almost goes away. Therein lies the secret to interface design: make it go away.(28) The doctor's information tool of the future might be some sort of combination between the patient record and the Internet, with the doctor and the patient positioned together at the intersection but not having to pay attention to the technology. Probably there will be no single tool but a family of tools, and I suspect that, whatever sophisticated tools may be developed, the major source of information will remain colleagues.
I thank Brian Haynes, Jerry Osheroff, John Roberts, Jane Smith, Alison Tonks, and Jeremy Wyatt for reading this paper and making many suggestions for improvement. I also thank Margaret Thompson for supplying references.
REFERENCES
1 Pauker S D, Gorry G, Kassirer J, Schwartz W. Towards the simulation of clinical cognition: taking a present illness by computer. Am J Med 1976;65:981-96.
2 Wyatt J. Uses and sources of medical knowledge. Lancet 1991;335:1365-72.
3 Wyatt J C. Medical informatics: artefacts or science? Methods Inf Med 1996;35:314-7.
4 Hersch W R, Lunin L F. Perspectives on medical informatics: information technology in health care. Introduction and overview. J Am Soc Inf Sci 1995;46:726-7.
5 Tannenbaum S J. Knowing and acting in medical practice: the epidemiological politics of outcomes research. J Health Polit 1994;59:27-44.
6 Gorman P N. Information needs of physicians. J Am Soc Inf Sci 1995;46:729-36.
7 Hersch W R, Lonin L F. Perspectives on medical informatics: information technology in health care. J Am Soc Inf Sci 1995;46:726-90.
8 Strasser T C. The information needs of practising physicians in Northeastern New York State. Bull Med Libr Assoc 1978;66:200-9.
9 Stinson E R, Mueller D A. Survey of health professionals' information habits and needs. JAMA 1950;243:140-3.
10 Northup D E, Moore-West M, Skipper B, Teaf S R. Characteristics of clinical information searching: investigation using critical incident technique. J Med Educ 1983;58:573-81.
11 Covell D G, Uman G C, Manning P R. Information needs in office practice: are they being met? Ann Intern Med 1985;103:596-9.
12 Timpka T, Ekstrom M, Bjurulf P. Information needs and information seeking behaviour in primary health care. Scand J Prim Health Care 1989;7:105-9.
13 Williamson J W, German P S, Weiss R, Skinner E A, Bowes F. Health science information management and continuing education of physicians. A survey of US primary care practitioners and their opinion leaders. Ann Intern Med 1989;110:151-60.
14 Woolf S H, Benson D A. The medical information needs of internists and paediatricians at an academic medical centre. Bull Med Libr Assoc 1989;77:372-80.
15 Timpka T, Arborelius E. The GP's dilemmas: a study of knowledge need and use during health care consultations. Methods Inf Med 199O;29:23-R
16 Osheroff J A, Forsythe D E, Buchanan B G, Bankowitz R A, Blumenfeld B H, Miller R A. Physicians' information needs: analysis of questions asked during clinical teaching. Ann Intern Med 1991;514:576-81.
17 Forsythe D E, Buchanan B G, Osheroff J A, Miller R A. Expanding the concept of medical information: an observational study of physicians' information needs. Comput Biomed Res 1992;25:181-200.
18 Ely J W, Burch R J, Vinson D C. The information needs of family physicians: case specific clinical questions. J Fam Pract 1992;38:265-9.
19 Gorman P N, Ash J, Wykoff L. Can primary care physicians' questions be answered using the medical journal literature? Bull Med Libr Assoc 1994;82:140-6.
20 Gorman P N, Helfand M. Information seeking in primary care: How physicians choose which clinical questions to pursue and which to leave unanswered. Med Decis Making 1995;15:113-9.
21 Bowden V M, Kromer M E, Tobia R C. Assessment of physicians' information needs in five Texas counties. Bull Med Libr Assoc 1994;82:189-96.
22 Guise N B, Huber J T, Giuse D A, Brown C W, Bankowitz B A, Hunt S. Information needs of health care professionals in an AIDS outpatient clinic as determined by chart review. J Am Med Inf Assoc 1994;1:395-4O3.
23 Packer M, Gheorghiade M, Young J B, Constantine P J, Adams K S, Codey R J, et al. Withdrawal of digoxin from patients with chronic heart failure treated with angiotensin converting enzyme inhibitors. N Engl J Med 1993;329:l-7.
24 Self P C, Filardo T W, Lancaster F W. Acquired immunodeficiency syndrome (AIDS) and the epidemic growth of its literature. Scientometrics 1989;17:49-60.
25 Sengupta I N, Kumari L. Bibliametric analysis of AIDS literature. Scientometrics 1991;20:297-315.
26 Weinberg A D, Ullian L, Richards W D, Cooper C. Informal advice and information seeking between physicians. J Med Educ 1981;56:174-80.
27 Shaughnessy A F, Slawson D C, Bennett J H. Becoming an information master: a guidebook to the medical information jungle. J Fam Pract 1994;39:489-99.
28 Negroponte N. Being digital. London: Hodder and Stoughton, 1995: 92-3.
BMJ,
London WC1H 9JR
Richard Smith, editor
Please include your email address with your comments