Friday, October 14, 2011

High crimes, deceit, and piracy in international health research


By Prathap Tharyan
Posted on October 14, 2011

The menace of piracy on the high seas, involving modern-day Somali-based seafaring pirates, continues to plague the nautical world. 

What is puzzling is that an apparently motley crew of ill-equipped brigands could hold the combined naval and coast guard fleets of regional and global super-powers at bay, and their governments and people to ransom.

Even more spine-chilling are the tales, increasingly heard, of high crimes, deceit and piracy involving international drug cartels that use sophisticated, and often subtle, methods to deceive and avoid deception; as well as individual fraudsters whose methods, in retrospect, were sometimes clumsy. 

Equally puzzling is the ineptitude of the world in deterring, detecting or dealing with research fraud, even though it affects the lives of many more people than piracy on the high seas does.

Exposing research fraud

In July 2005, a series of articles in the BMJ chronicled the perseverance of its previous editor, Richard Smith, who over a period of more than 10 years had attempted to investigate and publicly expose as fraudulent, the 1992 publication by Dr. Ram B. Singh, a private practitioner from Moradabad, India, and six co-authors. Singh had claimed that patients randomized to take a low-fat, fiber-rich diet had nearly half the risk of dying from any cause over a year’s follow-up, compared to those on a reduced fat diet alone.1  

The journal’s actions included an editorial,2 a detailed account of its failed attempt to find a legitimate authority in India to investigate its concerns and adjudicate,3 a forensic-statistical investigation that concluded that the data from this paper were strongly indicative of fabrication,4 and an “expression of concern” about the validity of the paper.5 

By then, this fraudulent article had already been cited 225 times in other research publications.3

In January 2006, the dean of research affairs at Seoul National University announced that the research reports published in 2004 and 2005 in the prestigious journal Science by Woo Suk Hwang and his co-workers were fabricated. 

These reports, purporting to the production of the first stem cell line produced from a cloned human embryo, and the creation of 11 stem cell lines that genetically matched people with spinal cord injury, diabetes, and an immune system disorder, had been hailed at publication as seminal scientific breakthroughs in stem cell research.6 

What was heralded as the dawn of a new age of novel treatments for a host of hitherto untreatable conditions, dramatically culminated in the international  disgrace of one of South Korea’s national heroes.

 

Scientists behaving abysmally

These, and many other, high-profile and scandalous instances of fraudulent research have blighted the image of health science researchers as objective and respected scientists in search of the truth. 

While many scientists are above reproach and their work is laudable, scientific fraud appears to be on the rise. This is evidenced by a sharp increase in papers retracted in PubMed over the past decade due to research misconduct.7 

Research misconduct (fabrication, falsification and plagiarism) is not restricted to the usual suspects, such as researchers from India or China, but involves virtually every country where research is undertaken. In one survey, papers identified as retracted in PubMed due to research misconduct, rather than errors, involved more US authors than from other countries.8 This startling revelation could merely reflect the North American preponderance of journals indexed in PubMed, and, perhaps, greater alertness by their peer-reviews, editors, and readers in suspecting and confirming research fraud. 

 

Repeat offenders or isolated offenses?

The BMJ editorial and related articles also raised suspicions about many of Singh’s previous publications. 

In the same month and year as the BMJ exposed Dr. Ram B. Singh, the Lancet published an “expression of concern” by its editor, Richard Horton, with details of the investigations and findings that indicted Dr. Singh of fabricating a previous Lancet paper.9

Earlier in February 2005, the editor of Nutrition retracted as fraudulent, a 2001 paper by a Canadian researcher who now lives and works in India, Ranjit Kumar Chandra.10 

In this publication, Chandra claimed that elderly people randomized to physiological amounts of vitamins and trace elements had improved cognitive functions compared to those given a placebo. This paper had been earlier rejected by the BMJ due to concerns about data fabrication during peer review.  


Serious doubts were also expressed in 2003 about another similar study by Chandra published in in 1992 in the Lancet that had been cited more than 300 times.10 In 2006, the Canadian Broadcasting Corporation aired serious doubts about several of Dr. Chandra’s other previous publications.10

From 2000 to 2010, PubMed identified 788 research studies in the English language as having being retracted by journals, mostly due to errors or for ambiguous reasons. However, 27% of these retractions were for data fabrication, falsification, or data plagiarism, and less commonly due to plagiarism of the ideas or the words of others. 

As in the cases of Singh and Chandra, approximately 53% of these fraudulent retracted papers were by repeat offenders with prior retracted publications.8 

Investigating previous publications by fraudulent authors is necessary, but proving fraud is often difficult. When an detailed investigation does occur, as it did with John Darsee, a one-time protégé of the eminent Harvard cardiologist Eugene Braunwald, over 100 of his previous studies were also found be fabricated.10

 

The impact of fraudulent research

Fraudulent research is often published in prestigious journals with high Impact Factors. Fraud is difficult to prove as fabricated or falsified papers are often indistinguishable from non-fraudulent ones. 

Even if suspicions of fabrication are substantiated, over a third of fraudulent papers are either never retracted, or are slow in being retracted; particularly when senior researchers are implicated. 

Such retractions are also not readily evident, as the statement of concern or retraction appears in subsequent issues of the journal, and the fraudulent article continues to be available unaltered. The PubMed abstract for the fraudulent paper carries a citation and link to the journal’s statement of retraction, or concern; but this is usually identified as a comment rather than a retraction. Even if these links are checked, access to the content of the comment may be limited by access to the journals, if they are not open access publications.

Fraudulent papers, even if retracted, continue to be cited and influence subsequent research.  

One conservative estimate identified over 5000 citations in 851 secondary studies to 180 primary studies involving clinical research in humans that were identified as retracted due to fraud in PubMed. The 180 retracted fraudulent primary studies enrolled 28,000 people, 9189 of whom were in the treatment arms; the 851 secondary studies which cited a retracted paper enrolled 400,000 people, of whom 70,501 patients were allocated to the dubious experimental interventions.11 

In another example, a retracted paper continued to be cited in high impact journals even as long as 24 years after retraction.12

Given the likelihood that many fraudsters were repeat offenders, it is worrying that these numbers reflect only a fraction of the actual number of fraudulent primary research publications. 

Also inestimable is the number of secondary publications that cite them or test the effects of supposedly effective and safe treatments on unsuspecting research subjects.  

Even if not evaluated in further research, using the results of fraudulent research may result in harm, or deny people the benefits of alternative and better proven interventions. 

 

Dealing with research misconduct

Investigating and dealing firmly with research misconduct is important, but the question of who should investigate is far from clear. 

Richard Smith and the BMJ served as whistle-blowers in the Singh case but, as Smith argues, while journals do have a duty to inform its readers, they do not have sufficient legitimacy to investigate or to initiate due process.10 

Journals are well advised to have an ethics committee to provide independent guidance regarding the complex ethical issues journals and editors’ face. This  helped the BMJ decide on making public the dismal saga involving Singh.13
 
The organization ideally placed to initiate investigations when fraudulent research is suspected or reported is the employing institution, often a medical college, university, or hospital.2 

Unfortunately, it is highly doubtful whether most such institutions in India, or in other resource constrained countries, have established processes or mechanisms, or the will, to deal with issues pertaining to breaches of research integrity. The situation becomes more complex when the accused is also part of the management, or the head as in the case of Singh, of a private institution. 

Regulatory bodies such as the Office of the Drug Controller General of India, and the Medical Council of India, as well government agencies such as the Indian Council of Medical Research (ICMR), and its parent organization, the Department of Health Research, could promulgate measures to investigate and deal with allegations of research misconduct. 

However, unless the many draft bills currently languishing in parliament that pertain to these agencies include effective statutory provisions to deal with such allegations, it is inconceivable that these bodies will be empowered effectively to deal with allegations of research misconduct. 

The Medical Council of India, in its current and future avatars, needs to consider dealing with researchers accused of misconduct as a legitimate activity within its purview; but even if that unlikely event does miraculously happen, mechanisms to deal with fraudulent research by non-medical researchers are also needed.

 
Research misconduct and violation of human rights

The National Human Rights Commission (NHRC) has the powers of a civil court and can summon records in the public domain. It can initiate investigations into allegations of violations of human rights or their abetment, or negligence by a public servant in preventing such violations. 

In the investigations into the allegations against Singh, the NHRC forwarded the complaint from the BMJ to the Indian Council of Medical Research that in turn pleaded inability to take disciplinary action against a person not employed by the ICMR.3 

If the study in question was funded by the ICMR, or another funding agency, then the funding agency could initiate the request for an investigation, but would require the full cooperation of the accused researcher and implicated co-researchers, as well as the host institution(s). 

Hopefully, the NHRC will see it fit to initiate investigations, should allegations of misconduct be received in the future, since it appears that no other organization in India is willing, or equipped, to deal with allegations of this nature.  

Undertaking research on human subjects and falsifying results, or publishing fraudulent research in the public domain that can harm others, is surely a violation of the human rights of numerous people. 

However, Chapter VII, 36 (2) of the Protection of Human Rights Act, 1993 [As amended by the Protection of Human Rights (Amendment) Act, 2006–No. 43 of 2006] limits the period of enquiry that the NHRC or a state commission is empowered to deal with, to within a year of commitment of the violation. 

Greater clarity is needed in determining what exactly this means in the context of investigating allegations of research misconduct.  

The NHRC is also mandated in Chapter III, 12 (g) of the above Act to “undertake and promote research in the field of human rights.” 


The link to “Research Studies and Projects” in the website of the NHRC details the many completed research studies and those in progress. However, none deal with any aspect of research misconduct.

 

Can you help?

Are you concerned about the issues raised in this blog-post?

Are there legal experts out there who are willing to provide advice on what legal mechanisms one can employ to deal with allegations of research misconduct, should institutional mechanisms fail? 

Are there young researchers interested in approaching the NHRC or the ICMR to seek sponsorship to undertake qualitative and quantitative research regarding research misconduct in India? 

Are you aware of any initiatives to prevent research misconduct and if such initiatives have had any measured outcomes or impact? 

Is anyone interested in registering a title and undertaking a systematic review (perhaps jointly undertaken by the Cochrane Collaboration and the Campbell Collaboration) on “Interventions to prevent research misconduct”? Neither The Cochrane Library nor The Campbell Library currently contains such a systematic review. 

If the answer to any of the above questions is affirmative, do post a comment.

Also do watch this space for more blog-posts on: Deception in international health research, and on a hitherto unknown international detective agency that is working tirelessly to expose high crimes, deceit, and piracy in international health research.


About the author: 
Prathap Tharyan is Professor of Psychiatry at the Christian Medical College, Vellore, Tamil Nadu, India. He is also Director of the South Asian Cochrane Network & Centre, an independent Centre of the Cochrane Collaboration. Evidence-Informed Musings is an activity of the Effective Health Care Research Consortium

The views expressed in this blog-post are those of the author and are not necessarily shared by any of the organizations named herein, their partners, or any funding agency. 

E-mail the author at: prathap@cmcvellore.ac.in

References:

1.      Singh RB, Rastogi SS, Verma R, Laxmi B, Singh R, Ghosh S, et al. Randomised controlled trial of cardioprotective diet in patients with recent acute myocardial infarction: results of one year follow up. BMJ. 1992 Apr 18;304(6833):1015-9.

2.      Smith J, Godlee F. Investigating allegations of scientific misconduct. BMJ. 2005 Jul 30;331(7511):245-6.

3.      White C. Suspected research fraud: difficulties of getting at the truth. BMJ. 2005 Jul 30;331(7511):281-8.

4.      Al-Marzouki S, Evans S, Marshall T, Roberts I. Are these data real? Statistical methods for the detection of data fabrication in clinical trials. BMJ. 2005 Jul 30;331(7511):267-70.

5.      Expression of concern. BMJ 2005;331:266.

6.      Smith R. Research misconduct: the poisoning of the well. J R Soc Med. 2006 May;99(5):232-7.

7.      Steen RG. Retractions in the scientific literature: is the incidence of research fraud increasing? J Med Ethics. 2010 Apr;37(4):249-53.

8.      Steen RG. Retractions in the scientific literature: do authors deliberately commit research fraud? J Med Ethics. 2010 Feb;37(2):113-7.

9.      Horton R. Expression of concern: Indo-Mediterranean Diet Heart Study. Lancet. 2005 Jul 30-Aug 5;366(9483):354-6.

10.  Smith R. Investigating the previous studies of a fraudulent author. BMJ. 2005 Jul 30;331(7511):288-91.

11.  Steen RG. Retractions in the medical literature: how many patients are put at risk by flawed research? J Med Ethics. 2011 May 17. [epub ahead of print].

12.  Korpela KM. How long does it take for the scientific literature to purge itself of fraudulent material?: the Breuning case revisited. Curr Med Res Opin.  Apr;26(4):843-7.

13.  Wager E. Experiences of the BMJ ethics committee. BMJ. 2004 Aug 28;329(7464):510-2.

12 comments:

  1. Yes, Dr Prathap.... this is truly an area of concern.... We need to think of probable solutions... An SR could be a start...

    Suma

    ReplyDelete
  2. Pratap,
    I'm afraid we have reached a stage in ?civilisation where there seems to be only one pertinent question........
    TO TRUST OR NOT TO TRUST?

    Frightening indeed for coming generations.

    Thanks for the blog, but I do not need it to trust you.
    roopa

    ReplyDelete
  3. Well then, you might be interested in this....http://www.economist.com/node/21528593

    ReplyDelete
  4. Hello Pratap,

    You have described the dismal scenario with painful clarity. It is the lack of recourse to audits and justice in this area that is frustrating and allows for repeat transgressions.

    I would like to offer to be part of the solution, in my limited capacity. I can see that your credentials and leadership role in this field have placed a burden on you to attempt to make some change.

    Warm regards

    ReplyDelete
  5. Great to hear of your offer to help.Lets see if we can get the Forum for Research Ethics Committees in India (FERCI)and the Journal Editors into this conversation.
    Prathap

    ReplyDelete
  6. I thought I had posted earlier... but it seems to have got lost :(
    Would love to work on a systematic review for this. Much needed!

    ReplyDelete
  7. Richard Smith hasn't proved beyond doubt that Dr. Singh's research was fraudulent. It may well be - but while one may have a high index of suspicion, these things can be impossible to prove OR disprove.

    You make a judegmental and unfair assumption when you conclude that Singh's work was fraudulent, just because the BMJ thought it was. This isn't the basis of good fraud prevention - it is demonising a researcher based purely on the suspicions (founded or unfounded) of his peers.

    ReplyDelete
  8. Putting one's name to a published work to which one has NOT contributed substantially is also fraud. Scores of so-called "researchers" commit this kind of fraud daily and get away with it. Simply being the boss or "guide" does not entitle one to authorship. But if you look at many papers today, they have an absurd number of authors on them - clearly it is not possible for so many individuals to be intimately involved in such research. What's happening is that people in senior positions in acamedic institutions inevitably intimidate their juniors into adding their names onto papers the juniors have actually written up - and thus get the credit for original research conducted by the junior and not themselves. Of course they may have given "advice" and "guidance", as a good senior should - but that doesn't qualify them for authorship of original works. This kind of fraud is global - even researchers at the MRC (in Cambridge) and Harvard are guilty. What hope then for the rest of Academia.

    ReplyDelete
    Replies
    1. Thanks for your insightful comments, Peter,

      I agree it is difficult to definitely prove fraud but in the Singh case, both Richard Smith and Richard Horton provide detailed information in their journals of the efforts that were instituted to resolve the matter and the lack of help from Indian authorities to conduct a detailed investigation. Their published investigations leave little doubt that things were not well in the town of Moradabad.

      You may be interested to read a more detailed version of this issue titled, "Criminals in the citadel and deceit all along the watchtower: Irresponsibility, fraud, and complicity in the search for scientific truth" that also addresses some of your other concerns. Ajai Singh, editor of the journal, invited me to write this article after reading this blog-post. The link to the pre-print version is provided below:
      http://www.msmonographs.org/preprintarticle.asp?id=91426

      There are also other related articles in this journal. I hope you can access them from where you are.

      There is also an editorial I wrote in the Indian Journal of Medical Ethics, "Evidence-Based Medicine- can the evidence be trusted" that complements the above article:
      http://www.issuesinmedicalethics.org/194ed203.html

      Facilitating the responsible conduct of relevant research requires everyone to be informed, and also involved in the debate, and in efforts to reclaim the research agenda.

      Many thanks for your comments.

      Best wishes,

      Prathap

      Delete
  9. Fraudulent research is so common that it is becoming the norm in many places. I have seen first-hand research being published that is false. With the importance being placed on papers nowadays, I think this problem is not going to go away. It is really difficult for peer-reviewers to cross-check research data. I think in the long-run, there needs to be a country-wide association of researchers who act as a governing body to regulate research. Then one by one, institutions will have to get accreditation from this body. A team will come to the institution, spend some time and examine the research published in the last year. This way, we can at least give credit to the few Indian institutions that actually publish proper research. Right now, with the huge amount of falsification of data, any Indian paper is in danger of being discredited and not without cause. Maybe, Cochrane can take up this cause.....

    ReplyDelete
    Replies
    1. Mathew,
      You are right in that the gatekeepers of research need to show more leadership and they also need to be facilitated by the efforts of institutions and researchers. The links to the articles I provided Peter in my reply to my post might be of interest.

      Also, of interest might be the following article in press that in the Journal of Clinical Epidemiology that reflects on the role of gatekeepers and other methods to facilitate better research, such as prospective trials registration:

      http://www.sciencedirect.com/science/article/pii/S0895435611003830

      Prathap

      Delete

Please find the muse in you and post a comment below: