Discussing study limitations in reports of biomedical studies- the need for more transparency
- PDF / 107,575 Bytes
- 4 Pages / 595.28 x 793.7 pts Page_size
- 68 Downloads / 179 Views
COMMENTARY
Open Access
Discussing study limitations in reports of biomedical studies- the need for more transparency Milo A Puhan1*, Elie A Akl2, Dianne Bryant3, Feng Xie4, Giovanni Apolone5 and Gerben ter Riet6
Abstract Unbiased and frank discussion of study limitations by authors represents a crucial part of the scientific discourse and progress. In today’s culture of publishing many authors or scientific teams probably balance ‘utter honesty’ when discussing limitations of their research with the risk of being unable to publish their work. Currently, too few papers in the medical literature frankly discuss how limitations could have affected the study findings and interpretations. The goals of this commentary are to review how limitations are currently acknowledged in the medical literature, to discuss the implications of limitations in biomedical studies, and to make suggestions as to how to openly discuss limitations for scientists submitting their papers to journals. This commentary was developed through discussion and logical arguments by the authors who are doing research in the area of hedging (use of language to express uncertainty) and who have extensive experience as authors and editors of biomedical papers. We strongly encourage authors to report on all potentially important limitations that may have affected the quality and interpretation of the evidence being presented. This will not only benefit science but also offers incentives for authors: If not all important limitations are acknowledged readers and reviewers of scientific articles may perceive that the authors were unaware of them. Authors should take advantage of their content knowledge and familiarity with the study to prevent misinterpretations of the limitations by reviewers and readers. Articles discussing limitations help shape the future research agenda and are likely to be cited because they have informed the design and conduct of future studies. Instead of perceiving acknowledgment of limitations negatively, authors, reviewers and editors should recognize the potential of a frank and unbiased discussion of study limitations that should not jeopardize acceptance of manuscripts. Introduction The physicist Richard Feynman argued, during his commencement address at the California Institute of Technology in 1974, that utter honesty must be a cornerstone of scientific integrity. He cautioned researchers from fooling themselves by saying: “We’ve learned from experience that the truth will come out. Other experimenters will repeat your experiment and find out whether you were wrong or right. Nature’s phenomena will agree or they’ll disagree with your theory. And, although you may gain some temporary fame and excitement, you will not gain a good reputation as a
* Correspondence: [email protected] 1 Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, 615 North Wolfe Street, Mail room E6153, Baltimore, MD 21205, USA Full list of author information is available at the end of the article
scientist if you haven’t tried t
Data Loading...