BMJ  2003;326:1167-1170 (31 May), doi:10.1136/bmj.326.7400.1167

Paper

Pharmaceutical industry sponsorship and research outcome and quality: systematic review

Joel Lexchin, associate professor1, Lisa A Bero, professor2, Benjamin Djulbegovic, associate professor3, Otavio Clark, chief of clinical oncology section4

1 School of Health Policy and Management, York University, Toronto, ON, Canada M3J 1P3, 2 Department of Clinical Pharmacy and Institute for Health Policy Studies, University of California at San Francisco, San Francisco, CA 94118, USA, 3 Interdisciplinary Oncology Program, H Lee Moffitt Cancer Center and Research Institute, University of South Florida, Tampa, FL 33612, USA, 4 Instituto do Radium de Campinas 13075-460 Campinas-SP, Brazil

Correspondence to: J Lexchin joel.lexchin{at}utoronto.ca

Abstract

Objective To investigate whether funding of drug studies by the pharmaceutical industry is associated with outcomes that are favourable to the funder and whether the methods of trials funded by pharmaceutical companies differ from the methods in trials with other sources of support.

Methods Medline (January 1966 to December 2002) and Embase (January 1980 to December 2002) searches were supplemented with material identified in the references and in the authors' personal files. Data were independently abstracted by three of the authors and disagreements were resolved by consensus.

Results 30 studies were included. Research funded by drug companies was less likely to be published than research funded by other sources. Studies sponsored by pharmaceutical companies were more likely to have outcomes favouring the sponsor than were studies with other sponsors (odds ratio 4.05; 95% confidence interval 2.98 to 5.51; 18 comparisons). None of the 13 studies that analysed methods reported that studies funded by industry was of poorer quality.

Conclusion Systematic bias favours products which are made by the company funding the research. Explanations include the selection of an inappropriate comparator to the product being investigated and publication bias.

Introduction

Clinical research sponsored by the pharmaceutical industry affects how doctors practise medicine.1 An increasing number of clinical trials at all stages in a product's life cycle are funded by the pharmaceutical industry,2 3 probably reflecting the fact that the pharmaceutical industry now spends more on medical research than the National Institutes of Health in the United States.4 Most pharmacoeconomic studies are either done in-house by the drug companies or externally by consultants who are paid for by the company.5 6

Results that are unfavourable to the sponsor—that is, trials that find a drug is less clinically effective or cost effective or less safe than other drugs used to treat the same condition—can pose considerable financial risks to companies. Pressure to show that the drug causes a favourable outcome may result in biases in design, out-come, and reporting of industry sponsored research.7 We reviewed the relation between the source of funding of the research and the reported outcomes and investigated the quality of the methods in trials funded by pharmaceutical companies compared with other studies.

Methods

Study selection
We included only studies that specifically stated that they analysed research sponsored by a pharmaceutical company, compared methodological quality or out-comes with studies with other sources of funding, and reported the results in quantitative terms. Outcomes of interest were conclusions about differences in drug effectiveness, adverse effects, cost outcomes, or publication status between industry funded trials and other trials. Work published in any language was eligible for inclusion.

Search strategy
We searched Medline from January 1966 to December 2002 and Embase from January 1980 to December 2002 using a combination of terms as both MESH subject headings and key words (see bmj.com). We scanned the reference lists from each of the articles and searched the Cochrane methodology register. We placed messages on two email drug discussion groups, contacted content experts, and searched our libraries. In cases where the reported results were incomplete, the lead author was asked for further details.

Data collection
From each study, we extracted the study design, type of research assessed in the study, design of research assessed in the study, search strategy used to locate research, time period covered, drug or drug class, disease, number of industry and non-industry funded articles analysed in each study, how industry funding was defined, criteria used to assess methodological quality of the research, results with respect to methodological quality or outcome of the research, and primary purpose of study.

We provide a critical description of each included study on bmj.com (see table 1), but did not assess methods. Using a Mantel-Haenszel test, we constructed a pooled odds ratio.8


View this table:
[in this window]
[in a new window]
 
Relation between source of funding and methodological quality of research*

 

Results

Search results
The combined searches and other data sources found 3351 potential titles. We scanned titles and abstracts (where available) for mention of the pharmaceutical industry in either the title or the abstract or any suggestion that the study would deal with industry funding. We read 103 articles in full (eight in languages other than English); we retained 30 articles for analysis (these are fully referenced on bmj.com).

Characteristics of included studies
The characteristics of the 30 studies included in this analysis are given on bmj.com. Six were reviews of pharmacoeconomic reports, two reviewed meta-analyses and systematic reviews, and the remaining 22 analysed groups of clinical trials. A total of 15 papers mentioned that some trials were funded by industry but offered no further definition of industry funding. In the other 15 papers the definition varied from a statement acknowledging industry funding in the article to a more comprehensive definition.

Relationship between source of funding and outcome
A total of 26 of the 30 studies reported results on the association of the outcome of the research and the source of funding: six examined the effects on publication, five looked at the outcome of pharmacoeconomic studies, and 16 analysed the outcome of clinical trials and meta-analyses of clinical trials (see bmj.com).

Funding source and publication status
Research funded by drug companies was less likely to be published or presented than research funded by other sources. Three studies looked at time to publication, and two of these found that company sponsored research took longer to be published than research with other sources of funding. Research funded by drug companies was also more likely to be published in the proceedings of symposiums than non-industry sponsored research.

Funding source and economic outcomes
Pharmacoeconomic studies sponsored by the drug industry were more likely to report results favouring the sponsor's product than studies with other sources of funding in all five articles that examined this question. In three cases, however, the bias in favour of industry funded research depended on the particular question being posed or on where the pharmacoeconomic analyses were published.

Funding source and outcomes of clinical trials and meta-analyses
Sixteen studies investigated the relationship between funding source and the outcomes of clinical trials and meta-analyses. Of these, 13 found that clinical trials and meta-analyses sponsored by drug companies favoured the product produced by the funder. Statistical significance for this finding was reported in eight of the 13 studies and in another two there was a trend towards statistical significance. These studies covered a wide range of diseases, such as osteoarthritis of the knee, multiple myeloma, various psychiatric problems, Alzheimer's disease, and venous thromboembolism, and a wide range of drugs, such as tacrine, clozapine, third generation oral contraceptives, erythropoietin, antidepressants, and topical glucocorticosteroids. One study that found no difference looked at the outcome of trials of treatment for HIV and associated complications and in this case the trials were monitored by the National Institutes of Health. In one meta-analysis of third generation oral contraceptives, the risk of venous thromboembolism for non-industry funded research was higher than that for industry sponsored trials, although the increased risk for thromboembolic disease was significant in both cases. One study found no difference in outcomes in research published in five leading medical journals. The summary odds ratio for 18 different comparisons (15 studies) of the outcomes of industry and non-industry funded studies was 4.05 (95% confidence interval 2.98 to 5.51) (figure).



View larger version (34K):
[in this window]
[in a new window]
 
Source of funding and outcome in pharmacoeconomic analyses, clinical trials, and meta-analyses of clinical trials of drug treatments; for references see bmj.com (*Favourable qualitative results; {dagger}Overstatement of quantitative results; {ddagger}Reporting possibility of cost effectiveness or cost savings of prophylaxis in entire high risk infant population either in point estimates or sensitivity analysis; §Reporting cost effectiveness or cost savings in either entire high risk populations or specific infant subgroups compared across studies; ¶Analyses reported in general medical journals; **Analyses reported in Pharmacoeconomics)

 

Relationship between source of funding and methodologic quality
A total of 13 studies examined the relationship between the source of funding and the methodological quality of the research (table). None of the 13 reported that industry funded studies had poorer methodological quality. Of the nine that provided statistical analyses, four found that drug company sponsored research had better quality scores.

Nine of the studies on clinical trials used well established methods of assessing quality. The single study that reported on the methods of pharmacoeconomic analyses used commonly accepted criteria for assessing cost effectiveness.12

One study evaluated the appropriateness of the comparators in clinical trials and found that a greater proportion of industry sponsored studies compared innovative treatment to either placebo or no therapy than did studies sponsored by public resources (60% v 21%; P < 0.001).

Discussion

Research sponsored by the drug industry was more likely to produce results favouring the product made by the company sponsoring the research than studies funded by other sources. The results apply across a wide range of disease states, drugs, and drug classes, over at least two decades and regardless of the type of research being assessed—pharmacoeconomic studies, clinical trials, or meta-analyses of clinical trials. All the evidence reported in our meta-analysis of a subset of homogeneous studies suggests that there is some kind of systematic bias to the outcome of published research funded by the pharmaceutical industry.

Other systematic reviews
Our results confirm and extend those reported by Bekelman et al.13 They identified only five studies that compared outcomes in research funded by pharmaceutical companies and other sources and our study adds another 16 studies. We are also supported by Rochon and coworkers (we excluded this paper because all of the trials were sponsored by drug companies and were, therefore, not comparable with trials lacking company funding).14 They found that trials supported by the manufacturers of non-steroidal anti-inflammatory agents almost always reported that the sponsor's drug was as effective or more and less toxic than the comparison drug.

Possible explanations
At least four possible explanations exist for favourable results seen in industry sponsored research. Firstly, pharmaceutical companies may selectively fund trials on drugs that they consider to be superior to the competition. Data collected so far, however, indicate that researchers cannot predict results of trials in advance.15

Secondly, positive results could be the consequence of poor quality research conducted by industry. For example, low quality trials exaggerate the benefits of treatment by an average of 34%.16 17 We found that the research methods in research sposored by drug companies are at least as good as the methods in non-industry funded research. This does not guarantee the absence of bias in studies sponsored by the industry since outcome could be influenced by factors left out of quality scores, such as the question asked or the conduct or reporting of the study.7 18


What is already known on this topic

When a pharmaceutical company funds research into drugs, studies are likely to produce results favourable to the sponsoring company's product

What this study adds

Research funded by drug companies was more likely to have outcomes that favour the sponsor's product than research funded by other sources

This cannot be explained by the reported quality of the methods in research sponsored by industry

The result may be due to inappropriate comparators or to publication bias


Thirdly, selecting an appropriate comparator is a key issue in planning a clinical trial.7 10 15 In one study, when most cases in which the doses of the study and comparator drugs were not equivalent, the drug given at the higher dose was that of the supporting manufacturer. As the authors saw, higher doses may bias the results in favour of effectiveness of the manufacturer's product. Safer reports that in trials of psychiatric drugs the comparator drug is often given in doses outside the usual range or there is a rapid and substantial dose increase in the drug not manufactured by the sponsoring company.16 In another instance, research funded by the company marketing fluconazole compared it to oral amphotericin B, a drug known to be poorly absorbed, thereby creating a bias in favour of fluconazole.17 We did not consider who is finally responsible for the selection of the comparator—investigators, regulatory agencies, or sponsors.

Finally, our results suggest that publication bias may explain our finding of bias in favour of outcomes of research funded by industry. Although research sponsored by industry was less likely to be published than research with other sources of funding, the two studies with this finding did not specifically examine whether non-publication applied just to research with non-significant outcomes.18 19 In the past few years, manufacturers have attempted to prevent studies which are unfavourable to their products from being published, in several high profile cases.2022

Massie and colleagues raise another possible source of publication bias; research which was industry funded appears more often in symposiums.11 Studies in symposiums are known to lack peer review and to favour the sponsor's product.9 23 Although the methods of industry funded trials are at least equal to those in studies funded by other sources, the absence of peer review may result in an overly favourable interpretation of the results of a trial. Rochon and colleagues noted that claims of superiority for the sponsor's product were often not supported by the data.14

Leading medical journals recently decided to establish more rigorous criteria for the acceptance of research sponsored by industry; this is a step in the right direction towards increasing the credibility of studies paid for by drug companies.24 The revised CONSORT statement should also help improve the quality of clinical research.25 In addition, authors and editors should consider including a statement concerning prior beliefs of the investigators about the uncertainty of the treatments that are reported. Finally, all clinical trials should be registered prospectively as the only way to prevent publication bias.26


This is an abridged version; the full version is on bmj.com

We thank Jiri Chard, David Liebeskind, Paula Rochon, and José Sacristan for additional information and data about their studies.

Contributors: see bmj.com

Funding: No additional funding.

Competing interests: BD has been funded by several pharmaceutical companies to perform research and has received speaking honorariums.

References

  1. Wyatt J. Use and sources of medical knowledge. Lancet 1991;338: 1368-73.[CrossRef][ISI][Medline]
  2. Anderson JJ, Felson DT, Meenan RF. Secular changes in published clinical trials of second-line agents in rheumatoid arthritis. Arthritis Rheum 1991;34: 1304-9.[ISI][Medline]
  3. Dorman PJ, Counsell C, Sandercock P. Reports of randomized trials in acute stroke, 1955 to 1995: what proportions were commercially sponsored? Stroke 1999;30: 1995-8.[Abstract/Free Full Text]
  4. Pharmaceutical Research and Manufacturers of America. 2001 industry profile. Washington, DC: PhRMA, 2003. www.phrma.org/publications/publications/profile02/index.cfm (accessed 6 May 2003).
  5. Anis AH, Gagnon Y. Using economic evaluations to make formulary coverage decisions: so much for guidelines. Pharmacoeconomics 2000;18: 55-62.[CrossRef][ISI][Medline]
  6. Hill SR, Mitchell AS, Henry DA. Problems with the interpretation of pharmacoeconomic analyses: a review of submissions to the Australian Pharmaceutical Benefits Scheme. JAMA 2000;283: 2116-21.[Abstract/Free Full Text]
  7. Bero LA, Rennie D. Influences on the quality of published drug studies. Int J Tech Assess Health Care 1996;12: 209-37.
  8. Hennekens CH, Buring JE. Epidemiology in medicine. Boston: Little, Brown, and Company, 1987.
  9. Cho MK, Bero LA. The quality of drug studies published in symposium proceedings. Ann Intern Med 1996;124: 485-9.[Abstract/Free Full Text]
  10. Djulbegovic B, Lacevic M, Cantor A, Fields KK, Bennett CL, Adams JR, et al. The uncertainty principle and industry-sponsored research. Lancet 2000;356: 635-8.[CrossRef][ISI][Medline]
  11. Massie BM, Rothenberg D. Publication of sponsored symposiums in medical journals. N Engl J Med 1993;328:1 196-7.[Free Full Text]
  12. Neumann PJ, Sandberg EA, Bell CM, Stone PW, Chapman RH. Are pharmaceuticals cost-effective? A review of the evidence. Health Affairs 2000;19(2): 92-109.[Abstract]
  13. Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA 2003;289: 454-65.[Abstract/Free Full Text]
  14. Rochon PA, Gurwitz JH, Simms RW, Fortin PR, Felson DT, Minaker KL, et al. A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med 1994;154: 157-63.[Abstract]
  15. Djulbegovic B. Acknowledgment of uncertainty: a fundamental means to ensure scientific and ethical validity in clinical research. Cur Oncol Rep 2001;3: 389-95.
  16. Safer DJ. Design and reporting modifications in industry-sponsored comparative psychopharmacology trials. J Nerv Ment Dis 2002;190: 583-92.[CrossRef][ISI][Medline]
  17. Johansen HK, Gotzsche PC. Problems in the design and reporting of trials of antifungal agents encountered during meta-analysis. JAMA 1999;282: 1752-9.[Abstract/Free Full Text]
  18. Dickersin K, Min Y-I, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA 1992;267: 374-8.[Abstract]
  19. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991;337: 867-72.[CrossRef][ISI][Medline]
  20. Rennie D. Thyroid storm. JAMA 1997;277: 1238-43.[CrossRef][ISI][Medline]
  21. Nathan DG, Weatherall DJ. Academia and industry: lessons from the unfortunate events in Toronto. Lancet 1999;353: 771-2.[CrossRef][ISI][Medline]
  22. McCarthy M. Company sought to block paper's publication. Lancet 2000;356: 1659.[CrossRef]
  23. Bero LA, Galbraith A, Rennie D. The publication of sponsored symposiums in medical journals. N Engl J Med 1992;327: 1135-40.[Abstract]
  24. Davidoff F, DeAngelis CD, Drazen JM, Højgaard L, Kotzin S, Nicholls MG, et al. Sponsorship, authorship, and accountability. N Engl J Med 2001;345: 825-6.[Free Full Text]
  25. Moher D, Schultz KF, Altman D, Lepage L. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA 2001;285: 1987-91.[Abstract/Free Full Text]
  26. Horton R, Smith R. The time to register randomized trials. BMJ 1999;319: 865-6.[Free Full Text]
(Accepted April 15, 2003)


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Related Articles

Improving access to research data in Europe
Philipa Mladovsky, Elias Mossialos, and Martin McKee
BMJ 2008 336: 287-288. [Extract] [Full Text] [PDF]

Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study
Veronica Yank, Drummond Rennie, and Lisa A Bero
BMJ 2007 335: 1202-1205. [Abstract] [Full Text] [PDF]

Long term pharmacotherapy for obesity and overweight: updated meta-analysis
Diana Rucker, Raj Padwal, Stephanie K Li, Cintia Curioni, and David C W Lau
BMJ 2007 335: 1194-1199. [Abstract] [Full Text] [PDF]

Should patient groups accept money from drug companies? No
Barbara Mintzes
BMJ 2007 334: 935. [Extract] [Full Text] [PDF]

Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review
Anders W Jørgensen, Jørgen Hilden, and Peter C Gøtzsche
BMJ 2006 333: 782. [Abstract] [Full Text] [PDF]

Origin and funding of the most frequently cited papers in medicine: database analysis
Nikolaos A Patsopoulos, John P A Ioannidis, and Apostolos A Analatos
BMJ 2006 332: 1061-1064. [Abstract] [Full Text] [PDF]

Bias in published cost effectiveness studies: systematic review
Chaim M Bell, David R Urbach, Joel G Ray, Ahmed Bayoumi, Allison B Rosen, Dan Greenberg, and Peter J Neumann
BMJ 2006 332: 699-703. [Abstract] [Full Text] [PDF]

Behavioural medicine: changing our behaviour
Theresa Marteau, Paul Dieppe, Robbie Foy, Ann-Louise Kinmonth, and Neil Schneiderman
BMJ 2006 332: 437-438. [Extract] [Full Text] [PDF]

Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study
Giuseppe G L Biondi-Zoccai, Marzia Lotrionte, Antonio Abbate, Luca Testa, Enrico Remigi, Francesco Burzotta, Marco Valgimigli, Enrico Romagnoli, Filippo Crea, and Pierfrancesco Agostoni
BMJ 2006 332: 202-209. [Abstract] [Full Text] [PDF]

In praise of uncertainty
Fiona Godlee
BMJ 2005 331: 0. [Extract] [Full Text] [PDF]

Are experimental treatments for cancer in children superior to established treatments? Observational study of randomised controlled trials by the Children's Oncology Group
Ambuj Kumar, Heloisa Soares, Robert Wells, Mike Clarke, Iztok Hozo, Archie Bleyer, Gregory Reaman, Iain Chalmers, and Benjamin Djulbegovic
BMJ 2005 331: 1295. [Abstract] [Full Text] [PDF]

Randomised controlled trials in Africa of HIV and AIDS: descriptive study and spatial distribution
Nandi Siegfried, Mike Clarke, and Jimmy Volmink
BMJ 2005 331: 742. [Abstract] [Full Text] [PDF]

Doctors and the drug industry
Marcus Müllner
BMJ 2003 326: 1220. [Extract] [Full Text]

Food, flattery, and friendship
Jane Smith
BMJ 2003 326: 0. [Extract] [Full Text] [PDF]

Research sponsored by drug companies is biased
BMJ 2003 326: 0. [Full Text] [PDF]

This article has been cited by other articles:

  • Bastawrous, A, Smith, M C F (2008). We are part of the problem. Br. J. Ophthalmol. 92: 1010-1010 [Full text]  
  • Salanti, G., Higgins, J. P., Ades, A., Ioannidis, J. P. (2008). Evaluation of networks of randomized trials. Stat Methods Med Res 17: 279-301 [Abstract]  
  • Whitlock, E. P., Lin, J. S., Chou, R., Shekelle, P., Robinson, K. A. (2008). Using Existing Systematic Reviews in Complex Systematic Reviews. ANN INTERN MED 148: 776-782 [Abstract] [Full text]  
  • Deshauer, D. MD MSc, Moher, D. PhD, Fergusson, D. PhD, Moher, E. BA, Sampson, M. MLIS, Grimshaw, J. MD PhD (2008). Selective serotonin reuptake inhibitors for unipolar depression: a systematic review of classic long-term randomized controlled trials. CMAJ 178: 1293-1301 [Abstract] [Full text]  
  • Djulbegovic, B., Kumar, A., Soares, H. P., Hozo, I., Bepler, G., Clarke, M., Bennett, C. L. (2008). Treatment Success in Cancer: New Cancer Treatment Successes Identified in Phase 3 Randomized Controlled Trials Conducted by the National Cancer Institute-Sponsored Cooperative Oncology Groups, 1955 to 2006. Arch Intern Med 168: 632-642 [Abstract] [Full text]  
  • Noble, J. H. Jr, Sharav, V. H. (2008). Protecting People With Decisional Impairments and Legal Incapacity Against Biomedical Research Abuse. Journal of Disability Policy Studies 18: 230-244 [Abstract]  
  • Rosenheck, R.A., Leslie, D.L., Busch, S., Rofman, E. S., Sernyak, M. (2008). Rethinking Antipsychotic Formulary Policy. Schizophr Bull 34: 375-380 [Abstract] [Full text]  
  • Mladovsky, P., Mossialos, E., McKee, M. (2008). Improving access to research data in Europe. BMJ 336: 287-288 [Full text]  
  • Dartnell, J., Hemming, M., Collier, J., Ollenschlaeger, G. (2008). Putting evidence into context: some advice for guideline writers. Evid. Based Nurs. 11: 6-8 [Full text]  
  • Rucker, D., Padwal, R., Li, S. K, Curioni, C., Lau, D. C W (2007). Long term pharmacotherapy for obesity and overweight: updated meta-analysis. BMJ 335: 1194-1199 [Abstract] [Full text]  
  • Yank, V., Rennie, D., Bero, L. A (2007). Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ 335: 1202-1205 [Abstract] [Full text]  
  • Claxton, L. (2007). A review of conflict of interest, competing interest, and bias for toxicologists. Toxicol Ind Health 23: 557-571 [Abstract]  
  • Lubowitz, J. H., Appleby, D., Centeno, J. M., Woolf, S. K., Reid, J. B. III (2007). The Relationship Between the Outcome of Studies of Autologous Chondrocyte Implantation and the Presence of Commercial Funding. Am J Sports Med 35: 1809-1816 [Abstract] [Full text]  
  • Nieto, A., Mazon, A., Pamies, R., Linana, J. J., Lanuza, A., Jimenez, F. O., Medina-Hernandez, A., Nieto, F. J. (2007). Adverse Effects of Inhaled Corticosteroids in Funded and Nonfunded Studies. Arch Intern Med 167: 2047-2053 [Abstract] [Full text]  
  • Vandenbroucke, J. P., Elm, E. v., Altman, D. G., Gotzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., for the STROBE initiative, (2007). Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. ANN INTERN MED 147: W-163-W-194 [Abstract] [Full text]  
  • Riechelmann, R. P., Wang, L., O'Carroll, A., Krzyzanowska, M. K. (2007). Disclosure of Conflicts of Interest by Authors of Clinical Trials and Editorials in Oncology. JCO 25: 4642-4647 [Abstract] [Full text]  
  • Dartnell, J., Hemming, M., Collier, J., Ollenschlaeger, G. (2007). Putting evidence into context: some advice for guideline writers. Evid. Based Med. 12: 130-132 [Full text]  
  • Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., Wright, S. M. (2007). Association Between Funding and Quality of Published Medical Education Research. JAMA 298: 1002-1009 [Abstract] [Full text]  
  • Coleman, M. (2007). Not credible: a subversion of science by the pharmaceutical industry. Commentary on A global comparison regarding patient access to cancer drugs (Ann Oncol 2007; 18 Suppl 3: pp 1 75). Ann Oncol 18: 1433-1435 [Full text]  
  • Gogol, M. (2007). Standards in dementia care. Age Ageing 36: 599-600 [Full text]  
  • Rosenheck, R. A. (2007). Evaluating the cost-effectiveness of reduced tardive dyskinesia with second-generation antipsychotics. Br. J. Psychiatry 191: 238-245 [Abstract] [Full text]  
  • Djulbegovic, B., Angelotta, C., Knox, K. E., Bennett, C. L. (2007). The Sound and the Fury: Financial Conflicts of Interest in Oncology. JCO 25: 3567-3569 [Full text]  
  • Gray, S. W., Hlubocky, F. J., Ratain, M. J., Daugherty, C. K. (2007). Attitudes Toward Research Participation and Investigator Conflicts of Interest Among Advanced Cancer Patients Participating in Early Phase Clinical Trials. JCO 25: 3488-3494 [Abstract] [Full text]  
  • Tungaraza, T., Poole, R. (2007). Influence of drug company authorship and sponsorship on drug trial outcomes. Br. J. Psychiatry 191: 82-83 [Abstract] [Full text]  
  • Mintzes, B. (2007). Should patient groups accept money from drug companies? No. BMJ 334: 935-935 [Full text]  
  • Moher, D. (2007). Reporting research results: a moral obligation for all researchers/Presenter les resultants de recherche : une obligation morale pour tous les chercheurs. Canadian J. Anesthesia 54: 331-335 [Full text]  
  • Hall, R., de Antueno, C., Webber, A. (2007). Publication bias in the medical literature: a review by a Canadian Research Ethics Board: [Biais de publication dans la litterature medicale : un compte rendu d'un Comite d'ethique de recherche canadien]. Canadian J. Anesthesia 54: 380-388 [Abstract] [Full text]  
  • Lynch, J. R., Cunningham, M. R.A., Warme, W. J., Schaad, D. C., Wolf, F. M., Leopold, S. S. (2007). Commercially Funded and United States-Based Research Is More Likely to Be Published; Good-Quality Studies with Negative Outcomes Are Not. JBJS 89: 1010-1018 [Abstract] [Full text]  
  • ROSENHECK, R., STROUP, T. S., SWARTZ, M., McEVOY, J., DAVIS, S. M., KEEFE, R. S.E., HSIAO, J. K., LIEBERMAN, J. (2007). Dr. Rosenheck and Colleagues Reply. Am. J. Psychiatry 164: 678-680 [Full text]  
  • Irwin, R. S. (2007). Clinical Trial Registration Promotes Patient Protection and Benefit, Advances the Trust of Everyone, and Is Required. Chest 131: 639-641 [Full text]  
  • Biondi-Zoccai, G. G.L., Abbate, A., Valgimigli, M., Agostoni, P. (2007). Keeping a high standard in quantitative analyses, meta-analyses, and systematic reviews. Eur Heart J 0: ehl502v1-1 [Full text]  
  • Ligthart, S., Vlemmix, F., Dendukuri, N., Brophy, J. M. (2007). The cost-effectiveness of drug-eluting stents: a systematic review. CMAJ 176: 199-205 [Abstract] [Full text]  
  • Martell, B. A., O'Connor, P. G., Kerns, R. D., Becker, W. C., Morales, K. H., Kosten, T. R., Fiellin, D. A. (2007). Systematic Review: Opioid Treatment for Chronic Back Pain: Prevalence, Efficacy, and Association with Addiction. ANN INTERN MED 146: 116-127 [Abstract] [Full text]  
  • Bastian, H. (2006). 'They would say that, wouldn't they?' A reader's guide to author and sponsor biases in clinical research. JRSM 99: 611-614 [Full text]  
  • Bero, L A (2006). Clinical trial registration at Tobacco Control. Tobacco Control 15: 417-418 [Full text]  
  • Jorgensen, A. W, Hilden, J., Gotzsche, P. C (2006). Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ 333: 782- [Abstract] [Full text]  
  • MICHAELS, D. (2006). Manufactured uncertainty: protecting public health in the age of contested science and product defense.. Ann. N. Y. Acad. Sci. 1076: 149-162 [Abstract] [Full text]  
  • Chalmers, I. (2006). From optimism to disillusion about commitment to transparency in the medico-industrial complex. JRSM 99: 337-341 [Full text]  
  • Psaty, B. M., Rennie, D. (2006). Clinical Trial Investigators and Their Prescribing Patterns: Another Dimension to the Relationship Between Physician Investigators and the Pharmaceutical Industry. JAMA 295: 2787-2790 [Full text]  
  • MONTGOMERY, J. H. (2006). Industry Funding and Author-Industry Affiliation in Clinical Trials in Psychiatry. Am. J. Psychiatry 163: 1110-1111 [Full text]  
  • Brown, S. D., Daly, J. C., Kalish, L. A., McDaniel, S. A. (2006). Financial Disclosures of Scientific Papers Presented at the 2003 RSNA Annual Meeting: Association with Reporting of Non-Food and Drug Administration-approved Uses of Industry Products. Radiology 239: 849-855 [Abstract] [Full text]  
  • Patsopoulos, N. A, Ioannidis, J. P A, Analatos, A. A (2006). Origin and funding of the most frequently cited papers in medicine: database analysis. BMJ 332: 1061-1064 [Abstract] [Full text]  
  • Tarrier, N. (2006). Negative Symptoms in Schizophrenia: Comments From a Clinical Psychology Perspective. Schizophr Bull 32: 231-233 [Abstract] [Full text]  
  • Bell, C. M, Urbach, D. R, Ray, J. G, Bayoumi, A., Rosen, A. B, Greenberg, D., Neumann, P. J (2006). Bias in published cost effectiveness studies: systematic review. BMJ 332: 699-703 [Abstract] [Full text]  
  • Gluud, L. L. (2006). Bias in Clinical Intervention Research. Am J Epidemiol 163: 493-501 [Abstract] [Full text]  
  • Littlejohns, P., Chalkidou, K. (2006). Evidence for health policy. Journal of Research in Nursing 11: 110-117  
  • Marteau, T., Dieppe, P., Foy, R., Kinmonth, A.-L., Schneiderman, N. (2006). Behavioural medicine: changing our behaviour.. BMJ 332: 437-438 [Full text]  
  • Delgado-Rodriguez, M. (2006). Systematic reviews of meta-analyses: applications and limitations. J. Epidemiol. Community Health 60: 90-92 [Full text]  
  • Heres, S., Davis, J., Maino, K., Jetzinger, E., Kissling, W., Leucht, S. (2006). Why Olanzapine Beats Risperidone, Risperidone Beats Quetiapine, and Quetiapine Beats Olanzapine: An Exploratory Analysis of Head-to-Head Comparison Studies of Second-Generation Antipsychotics. Am. J. Psychiatry 163: 185-194 [Abstract] [Full text]  
  • Biondi-Zoccai, G. G L, Lotrionte, M., Abbate, A., Testa, L., Remigi, E., Burzotta, F., Valgimigli, M., Romagnoli, E., Crea, F., Agostoni, P. (2006). Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study. BMJ 332: 202-209 [Abstract] [Full text]  
  • Bryan-Brown, C. W., Dracup, K. (2006). Disentangling The Web. Am J Crit Care 15: 7-9 [Full text]  
  • Glasmacher, A., Prentice, A., Gorschluter, M., Engelhart, S., Hahn, C., Djulbegovic, B., Schmidt-Wolf, I. G.H. (2005). In Reply:. JCO 23: 9429-9432 [Full text]  
  • Godlee, F. (2005). In praise of uncertainty. BMJ 331: 245- [Full text]  
  • Kumar, A., Soares, H., Wells, R., Clarke, M., Hozo, I., Bleyer, A., Reaman, G., Chalmers, I., Djulbegovic, B. (2005). Are experimental treatments for cancer in children superior to established treatments? Observational study of randomised controlled trials by the Children's Oncology Group. BMJ 331: 1295- [Abstract] [Full text]  
  • Dursun, S., Dinan, T. G., Bushe, C., Thakore, J. (2005). Challenges in advancing mental and physical health of patients with serious mental illness. J Psychopharmacol 19: 3-5  
  • Holt, R. I. G., Bushe, C., Citrome, L. (2005). Diabetes and schizophrenia 2005: are we any closer to understanding the link?. J Psychopharmacol 19: 56-65 [Abstract]  
  • Perlis, R. H., Perlis, C. S., Wu, Y., Hwang, C., Joseph, M., Nierenberg, A. A. (2005). Industry Sponsorship and Financial Conflict of Interest in the Reporting of Clinical Trials in Psychiatry. Am. J. Psychiatry 162: 1957-1960 [Abstract] [Full text]  
  • Siegfried, N., Clarke, M., Volmink, J. (2005). Randomised controlled trials in Africa of HIV and AIDS: descriptive study and spatial distribution. BMJ 331: 742- [Abstract] [Full text]  
  • Genuis, S. J. (2005). The Proliferation of Clinical Practice Guidelines: Professional Development or Medicine-by-Numbers?. J Am Board Fam Med 18: 419-425 [Abstract] [Full text]  
  • Mirowski, P., Van Horn, R. (2005). The Contract Research Organization and the Commercialization of Scientific Research. Social Studies of Science 35: 503-548 [Abstract]  
  • Kuruppuarachchi, K. A. L. A., Lawrence, T. S. (2005). Psychiatry and the pharmaceutical industry. Psychiatr. Bull. 29: 315-316 [Full text]  
  • Chapman, S (2005). Research from tobacco industry affiliated authors: need for particular vigilance. Tobacco Control 14: 217-219 [Full text]  
  • Hartling, L., McAlister, F. A., Rowe, B. H., Ezekowitz, J., Friesen, C., Klassen, T. P. (2005). Challenges in Systematic Reviews of Therapeutic Devices and Procedures. ANN INTERN MED 142: 1100-1111 [Abstract] [Full text]  
  • Brodkey, A. C. (2005). The Role of the Pharmaceutical Industry in Teaching Psychopharmacology: A Growing Problem. Acad. Psychiatry 29: 222-229 [Abstract] [Full text]  
  • Thomas, D (2005). Laboratory animals and the art of empathy. J. Med. Ethics 31: 197-202 [Abstract] [Full text]  
  • Grigg, J (2005). Good research conduct. Arch. Dis. Child. 90: 229-232 [Full text]  
  • Ioannidis, J P A (2005). Large scale evidence and replication: insights from rheumatology and beyond. Ann Rheum Dis 64: 345-346 [Full text]  
  • Cooper, R. J., Schriger, D. L. (2005). The availability of references and the sponsorship of original research cited in pharmaceutical advertisements. CMAJ 172: 487-491 [Abstract] [Full text]  
  • Holloway, R. G., French, J. A., Kanner, A., Gronseth, G., Krauss, G. L., French, J. A., Panayiotopoulos, C. P., Benbadis, S. R., Covanis, A., Dulac, O., Duncan, J. S., Eeg-Olofsson, O., Ferrie, C. D., Grunewald, R. A., Kasteleijn-Nolst Trenite, D. G.A., Koutroumanidis, M., Martinovic, Z., Newton, R. W., Parker, A. P. J., Salas-Puig, J., Sander, J. W., Shorvon, S., Watanabe, K., Whitehouse, W. P., Youroukos, S., French, J. A. (2005). Efficacy and tolerability of the new antiepileptic drugs I: Treatment of new onset epilepsy: Report of the Therapeutics and Technology Assessment Subcommittee and Quality Standards Subcommittee of the American Academy of Neurology and the American Epilepsy Society. Neurology 64: 172-174 [Full text]  
  • Miners, A H, Garau, M., Fidan, D., Fischer, A J (2005). Comparing estimates of cost effectiveness submitted to the National Institute for Clinical Excellence (NICE) by different organisations: retrospective study. BMJ 330: 65- [Abstract] [Full text]  
  • van de Laar, F. A., Lucassen, P. L., Akkermans, R. P., van de Lisdonk, E. H., Rutten, G. E., van Weel, C. (2005). {alpha}-Glucosidase Inhibitors for Patients With Type 2 Diabetes: Results from a Cochrane systematic review and meta-analysis. Diabetes Care 28: 154-163 [Abstract] [Full text]  
  • Lexchin, J. R (2005). Implications of Pharmaceutical Industry Funding on Clinical Research. The Annals of Pharmacotherapy 39: 194-197 [Abstract] [Full text]  
  • Montori, V. M, Jaeschke, R., Schunemann, H. J, Bhandari, M., Brozek, J. L, Devereaux, P J, Guyatt, G. H (2004). Users' guide to detecting misleading claims in clinical research reports. BMJ 329: 1093-1096 [Full text]  
  • Taylor, R S, Drummond, M F, Salkeld, G, Sullivan, S D (2004). Inclusion of cost effectiveness in licensing requirements of new drugs: the fourth hurdle. BMJ 329: 972-975 [Full text]  
  • Hooper, L., Brown, T. J, Elliott, R., Payne, K., Roberts, C., Symmons, D. (2004). The effectiveness of five strategies for the prevention of gastrointestinal toxicity induced by non-steroidal anti-inflammatory drugs: systematic review. BMJ 329: 948- [Abstract] [Full text]  
  • Ferris, L. E., Naylor, C. D. (2004). Physician remuneration in industry-sponsored clinical trials: the case for standardized clinical trial budgets. CMAJ 171: 883-886 [Full text]  
  • Smith, G. C., Pell, J. P. (2004). Parachute Use to Prevent Death and Major Trauma Related to Gravitational Challenge: Systematic Review of [randomized] Controlled Trials. J Int Assoc Physicians AIDS Care (Chic Ill) 3: 108-109  
  • Wheatley, K, Ives, N, Gray, R, Clarke, C (2004). Role of entacapone in later Parkinson's disease not yet established. J. Neurol. Neurosurg. Psychiatry 75: 1081-1081 [Full text]  
  • Buchkowsky, S. S, Jewesson, P. J (2004). Industry Sponsorship and Authorship of Clinical Trials Over 20 Years. The Annals of Pharmacotherapy 38: 579-585 [Abstract] [Full text]  
  • Wang, C.-T., Lin, J., Chang, C.-J., Lin, Y.-T., Hou, S.-M. (2004). Therapeutic Effects of Hyaluronic Acid on Osteoarthritis of the Knee. A Meta-Analysis of Randomized Controlled Trials. JBJS 86: 538-545 [Abstract] [Full text]  
  • Boyd, E. A., Lipton, S., Bero, L. A. (2004). Implementation Of Financial Disclosure Policies To Manage Conflicts Of Interest. Health Aff (Millwood) 23: 206-214 [Abstract] [Full text]  
  • Zaccai, J H (2004). How to assess epidemiological studies. Postgrad. Med. J. 80: 140-147 [Abstract] [Full text]  
  • Bhandari, M., Busse, J. W., Jackowski, D., Montori, V. M., Schunemann, H., Sprague, S., Mears, D., Schemitsch, E. H., Heels-Ansdell, D., Devereaux, P.J. (2004). Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials. CMAJ 170: 477-480 [Abstract] [Full text]  
  • Hirsch, L. (2004). Randomized clinical trials: What gets published, and when?. CMAJ 170: 481-483 [Full text]  
  • Lewis, S C, Warlow, C P (2004). How to spot bias and other potential problems in randomised controlled trials. J. Neurol. Neurosurg. Psychiatry 75: 181-187 [Full text]  
  • Schafer, A (2004). Biomedical conflicts of interest: a defence of the sequestration thesis--learning from the cases of Nancy Olivieri and David Healy. J. Med. Ethics 30: 8-24 [Abstract] [Full text]  
  • Jorgensen, K. J., Gotzsche, P. C (2004). Presentation on websites of possible benefits and harms from screening for breast cancer: cross sectional study. BMJ 328: 148- [Abstract] [Full text]  
  • Bryan-Brown, C. W., Dracup, K. (2004). Evidence-Based Pandemonium. Am J Crit Care 13: 10-12 [Full text]  
  • Smith, G. C S, Pell, J. P (2003). Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials. BMJ 327: 1459-1461 [Abstract] [Full text]  
  • Lo, G. H., LaValley, M., McAlindon, T., Felson, D. T. (2003). Intra-articular Hyaluronic Acid in Treatment of Knee Osteoarthritis: A Meta-analysis. JAMA 290: 3115-3121 [Abstract] [Full text]  
  • Moynihan, R. (2003). Cochrane at crossroads over drug company sponsorship. BMJ 327: 924-926 [Full text]  
  • Als-Nielsen, B., Chen, W., Gluud, C., Kjaergard, L. L. (2003). Association of Funding and Conclusions in Randomized Drug Trials: A Reflection of Treatment Effect or Adverse Events?. JAMA 290: 921-928 [Abstract] [Full text]  
  • (2003). Bias in Pharmaceutical-Sponsored Research?. Journal Watch Cardiology 2003: 4-4 [Full text]  
  • (2003). Bias in Pharmaceutical-Sponsored Research?. JWatch General 2003: 4-4 [Full text]  
  • (2003). Effects of Drug Company Sponsorship on Published Research. JWatch Emergency Med. 2003: 10-10 [Full text]  

Rapid Responses:

Read all Rapid Responses

Bias ?
David T Parry
bmj.com, 30 May 2003 [Full text]
whose is the bias?
Rowena H Cave
bmj.com, 30 May 2003 [Full text]
Not just pharmaceutical industry
Ian L. .
bmj.com, 1 Jun 2003 [Full text]
Uneasy interactions just around the corner
Konstantinos E. Paparounas
bmj.com, 3 Jun 2003 [Full text]
Biases in articles about biases
Jose A. Sacristan, et al.
bmj.com, 20 Jun 2003 [Full text]
Misleading Meta-Metaanalysis
Charlotte Ford, et al.
bmj.com, 3 Jul 2003 [Full text]
Industry-funded German Women Cohort Predictably Shows Cancer Prevention by Oral Contraceptives
Eberhard M. Greiser
bmj.com, 12 Jul 2003 [Full text]



Student BMJ

Risk of surgery for inflammatory bowel disease: record linkage studies

What can you learn from this BMJ paper? Read Leanne Tite's Paper+

www.student.bmj.com

Listen to the latest BMJ Interview