Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simp

  • PDF / 1,162,982 Bytes
  • 10 Pages / 595.276 x 790.866 pts Page_size
  • 37 Downloads / 184 Views

DOWNLOAD

REPORT


(2020) 20:217

RESEARCH ARTICLE

Open Access

Searching for Programme theories for a realist evaluation: a case study comparing an academic database search and a simple Google search Susanne Coleman1* , Judy M. Wright1, Jane Nixon1, Lisette Schoonhoven2, Maureen Twiddy3 and Joanne Greenhalgh4

Abstract Background: Realist methodologies are increasingly being used to evaluate complex interventions in health and social care. Programme theory (ideas and assumptions of how a particular intervention works) development is the first step in a realist evaluation or a realist synthesis, with literature reviews providing important evidence to support this. Deciding how to search for programme theories is challenging and there is limited guidance available. Using an example of identifying programme theories for a realist evaluation of Pressure Ulcer Risk Assessment Instruments in clinical practice, the authors explore and compare several different approaches to literature searching and highlight important methodological considerations for those embarking on a programme theory review. Methods: We compared the performance of an academic database search with a simple Google search and developed an optimised search strategy for the identification primary references (i.e. documents providing the clearest examples of programme theories) associated with the use of Pressure Ulcer Risk Assessment Instruments (PU-RAIs). We identified the number of primary references and the total number of references retrieved per source. We then calculated the number needed to read (NNR) expressed as the total number of titles and abstracts screened to identify one relevant reference from each source. Results: The academic database search (comprising CINAHL, The Cochrane Library, EMBASE, HMIC, Medline) identified 2 /10 primary references with a NNR of 1395.The Google search identified 7/10 primary references with a NNR of 10.1. The combined NNR was 286.3. The optimised search combining Google and CINAHL identified 10/10 primary references with a NNR of 40.2. (Continued on next page)

* Correspondence: [email protected] 1 Leeds Institute of Clinical Trials Research, University of Leeds, Leeds LS2 9JT, UK Full list of author information is available at the end of the article © The Author(s). 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.