Remove industry bias from clinical trials before it’s too late

A study published today shows that clinical trials with industry sponsorship report greater benefits and fewer harmful side effects. In the discussion, the authors note that most reviews and guidelines don’t report the funding sources for the included trials. The systematic review adds to a growing…

R5yxb9yb-1355270189
Roche has refused to share clinical trial data for Tamiflu, which is used to relieve symptoms and reduce complications of influenza. AAP/Joe Castro

A study published today shows that clinical trials with industry sponsorship report greater benefits and fewer harmful side effects. In the discussion, the authors note that most reviews and guidelines don’t report the funding sources for the included trials.

The systematic review adds to a growing body of evidence that industry sponsorship of research influences the results of that research. This new work is consistent with previous systematic reviews on the effects of industry sponsorship conducted over the past 20 years. The evidence is clear – industry can obtain results favourable to their products by influencing how trials are designed and reported.

And there are many stories about bad behaviour from Big Pharma. The drug oseltamivir (Tamiflu), which is used to relieve symptoms and reduce the complications of influenza, for instance, is stockpiled by governments around the world at the cost of billions of dollars. There’s currently an open data campaign to get Roche to share data from its clinical trials of the drug. It’s suspected that the data that have not been released may reveal both serious side effects and less-than-stellar effectiveness.

Enough evidence to show that the arthritis drug rofecoxib (Vioxx) was unsafe was available for several years before the drug was withdrawn globally. Between that time and its eventual withdrawal, Vioxx is believed to have caused tens of thousands of extra cardiovascular events in the United States alone.

And the benefits of rosiglitazone (Avandia), a drug used in the treatment of type 2 diabetes, were purposefully exaggerated by the manufacturer – GlaxoSmithKline – by concealing negative trial data and by the extensive use of ghost-written papers. The company was eventually fined US$3 billion for withholding the results of clinical trials relating to Avandia and other drugs.

The mandatory registration of trials and conflicts of interest policies have arguably helped reduce the chance of this happening again, but industry’s influence clearly persists.

Perhaps most importantly, the impact of commercial interests on the results of clinical trials extends well beyond the trial itself. It becomes more sustained and pernicious when industry-sponsored research is incorporated into systematic reviews or forms the basis of clinical practice guidelines. And in both of these settings, the role of industry sponsorship may be less apparent than it is in the publication of individual studies.

Worryingly, previous studies (including work by the co-authors of today’s Cochrane review) have demonstrated that only 30% of Cochrane reviews included information about conflicts of interest for trials included in meta-analyses. It’s clear, therefore, that there’s no part of research, research translation and clinical practice that’s now independent of commercial influence.

One of the authors of both papers, Lisa Bero, says,

If we agree that industry sponsorship is an important source of bias then we need to think about developing better methods for reporting, assessing and handling industry bias in systematic reviews that evaluate the effects of drugs and devices.

While measures such as these are clearly needed, the limitations of policies for disclosure and transparency and the extent to which industry has become incorporated within the very body of science and medicine make it unlikely that they will have much of an effect.

Central to this issue is fact that of the 83,482 trials registered with ClinicalTrials.gov between 2007 and the start of 2012, 42% were at least partially funded by industry. When counting publications, over 60% of trials had industry sponsorship in the late 1990s.

Since we can’t (and arguably shouldn’t) simply exclude or ignore data derived from industry trials, our efforts should be directed in three ways. First, systematic reviews and clinical practice guidelines should both explicitly acknowledge and evaluate the impact of industry sponsorship as an independent and confounding variable.

Second, more effort should be spent assessing the design of clinical trials, to ensure that they’re designed to genuinely contribute to the quality use of medicines in an unbiased way. And finally, we need to come up with innovative approaches for funding clinical trials to try and counter some of the impact that commercial interests have on the scientific record.

Another author on both papers, Joel Lexchin, said he would

like to see a clear separation between the source of the money and the conduct of the trial. Industry could supply the money but it shouldn’t have any role in choosing who runs the studies or how they are analysed.

The efforts by some countries, such as Italy, to provide a clinical trial resource drawn from a levy on industry marketing deserves serious consideration. We now know that the evidence that drives clinical practice is contaminated. And we suspect that transparency alone has limited impact; on its own, forcing clinical trial data into the open is unlikely to solve the problem of industry bias.

The challenge for medicine, government and the research community is to develop strategies that restore integrity and critical independence to research. And to place the interests of the community above the interests of industry.

Join the conversation

10 Comments sorted by

  1. Comment removed by moderator.

  2. Matt Stevens

    Senior Research Fellow/Statistician/PhD

    Excellent discussion of the systemic problems in the health research pharmaceuticals relationship. Most journals as far i as i remember always ask for disclosure of any conflict of interest. I wonder has legal action been taken or could it?

    report
    1. Adam Dunn

      Research Fellow at University of New South Wales

      In reply to Matt Stevens

      When publishing a systematic review or writing guidelines, authors must still report any conflicts of interest but I don't think there has been any requirement to include the funding or conflicts of interest of the clinical trials when reviewing them (I suppose the 30% is proof of that).

      There have been some interesting examples of where conflicts of interest have clearly had an impact - which has been met with considerable (and understandable) repercussions. From memory, tamiflu and the WHO panel might have been one of those, and of course the Wakefield/MMR thing may be the most famous.

      report
  3. John Kerr

    IT Education

    For a good (and frightening) background on this subject may I suggest Ben Goldacre's book Bad Pharma. Goldacre is a doctor and understands the situation from both sides. His book shows that we are being let down by big pharma getting drugs through in a hurry and also that the regulators are simply not doing their job. Many of the unfavourable reports just disappear. We need a better system, this one is broken. There's too much money at stake to leave this in the hands of industry sponsored research, especially when the people who will be making the money can decide which pieces of research are used. I don't mind industry paying for the research as long as they don't do the research and influence the results.

    report
  4. Mia Masters

    pensioner

    Any trial, not just those assessing drugs (and influenced by drug companies) should be registered and the research/trial protocol, the questions that are going to be asked/followed up, should be published BEFORE undertaking the research/trial, so that they can not be 'scaled down' to suit ...self-interest or prove a desired point/procedure.
    It is not just greedy drug companies one should question...
    Medical procedures assessed by those who perform them....are open to bias (fraud?). Trials financed by entrepreneurial surgeons seeking 'scientific' support for their procedures are open to bias.
    Systematic reviews are done based on self-reporting, (a.k.a. vanity publishing), poor quality evidence, uncontrolled studies and personal experience. They tend to report phenomenal successes.... Even procedures that only have level IV evidence according to the NHMRC criteria, can end up on MBS if there is a strong entrepreneurial 'spirit' behind them.

    report
    1. Adam Dunn

      Research Fellow at University of New South Wales

      In reply to Mia Masters

      On systematic reviews - you are right that they rely on what is publised - and negative or inconclusive results often go unpublished. The key point in this new publication is that the current evaluations that are done for detecting biases in trial design were found to be unable to detect the biases associated with the trial funding. It's an important point and one that we need to deal with quickly.

      I have to admit that I tend to concentrate on drugs rather than procedures but I know that for at least the last few years it has been mandatory that clinical trials be registered prior to recruiting the first patient. That has been really helpful for monitoring research agendas across the funding spectrum. However, for many trials there are often differences between what was registered and what was reported in the publication.

      report
  5. Sean Lamb

    Science Denier

    I am guessing people can come up with all the rational ideas in the world but they won't be implemented because of the enormous wealth generating machine of the present system. Lord love a duck, we can't even take on the pokies industry so forget about big pharma. But its OK to dream...

    Just to restate a point I think you have already made, I think design of the clinical trial is as important or even more important than who runs them. Pharmaceutical companies will have a vested influence in…

    Read more
    1. Adam Dunn

      Research Fellow at University of New South Wales

      In reply to Sean Lamb

      Maybe we'll sort out the pokies and gambling one day too... I hope. Don't forget that we've seen some quite big changes in the last month with the GSK and EMA decisions on releasing patient level data. The culture and the technology are changing at a fast pace.

      As for the herceptin story, you can always check out the clinical trials that are currently underway in a few clicks: There are currently 192 studies that are open to recruiting, over 500 registered in total: http://clinicaltrials.gov/ct2/results?term=herceptin&recr=Open&submit_fld_opt=

      It won't tell you the answers, but it will tell you what evidence we expect to see in the next few years.

      report
  6. Stephen Lehocz

    Stephen Lehocz is a Friend of The Conversation.

    Interested public.

    It’s amazing to think such common sense suggestions that you are calling for would produce such a heated responce, that their comment had to be removed by the moderator. It would seem some people are not entirely sane.
    An implementation of your suggestions would undoubtably save many lives, remove a tremendous amount of misery and save untold money.
    Heart problems (in your Vioxx example) on top of the agony of arthritis would be to me, one version of hell, which would undoubtably cause depression…

    Read more