Show simple item record

dc.contributor.authorDavidson, Rosemaryen
dc.contributor.authorRandhawa, Gurchen
dc.contributor.authorCash, Stephanieen
dc.date.accessioned2019-11-19T15:12:25Z
dc.date.available2019-11-19T15:12:25Z
dc.date.issued2019-03-05
dc.identifier.citationDavidson R, Randhawa G, Cash S (2019) 'Identification of complex health interventions suitable for evaluation: development and validation of the 8-step scoping framework', JMIR Research Protocols, 8 (3), e10075.en
dc.identifier.issn1929-0748
dc.identifier.pmid30835240
dc.identifier.doi10.2196/10075
dc.identifier.urihttp://hdl.handle.net/10547/623597
dc.description.abstractBackground: There is extensive literature on the methodology of evaluation research and the development and evaluation of complex interventions but little guidance on the formative stages before evaluation and how to work with partner organizations that wish to have their provision evaluated. It is important to be able to identify suitable projects for evaluation from a range of provision and describe the steps required, often with academic institutions working in partnership with external organizations, in order to set up an evaluation. However, research evaluating programs or interventions rarely discusses these stages. Objective: This study aimed to extend work on evaluability assessment and pre-evaluation planning by proposing an 8-Step Scoping Framework to enable the appraisal of multiple programs in order to identify interventions suitable for evaluation. We aimed to add to the literature on evaluability assessment and more recent evaluation guidance by describing the processes involved in working with partner organizations. Methods: This paper documents the steps required to identify multiple complex interventions suitable for process and outcome evaluation. The steps were developed using an iterative approach by working alongside staff in a local government organization, to build an evidence base to demonstrate which interventions improve children’s outcomes. The process of identifying suitable programs for evaluation, thereby establishing the pre-evaluation steps, was tested using all Flying Start provision. Results: The 8-Step Scoping Framework was described using the example of the local government organization Flying Start to illustrate how each step contributes to finding projects suitable for process and outcome evaluation: (1) formulating overarching key questions that encompass all programs offered by an organization, (2) gaining an in-depth understanding of the work and provision of an organization and engaging staff, (3) completing a data template per project/program offered, (4) assessing the robustness/validity of data across all programs, (5) deciding on projects suitable for evaluation and those requiring additional data, (6) negotiating with chosen project leads, both within and outside the organization, (7) developing individual project evaluation protocols, and (8) applying for ethical approval from the university and partner organization. Conclusions: This paper describes the processes involved in identifying suitable projects for evaluation. It adds to the existing literature on the assessment of specific programs suitable for evaluation and guidance for conducting evaluations by establishing the formative steps required to identify suitable programs from a range of provision. This scoping framework particularly relates to academic partners and organizations tasked with delivering evidence-based services designed to meet local needs. The steps identified have been described in the context of early years provision but can be applied to a range of community-based evaluations, or more generally, to cases where an academic partner is working with external stakeholders to identify projects suitable for academic evaluation.
dc.language.isoenen
dc.publisherJMIR Publicationsen
dc.relation.urlhttps://www.researchprotocols.org/2019/3/e10075/en
dc.rightsGreen - can archive pre-print and post-print or publisher's version/PDF
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.subjectcomplex interventionsen
dc.subjectearly yearsen
dc.subjectevaluationen
dc.subjectmultistakeholder provisionen
dc.subjectL431 Health Policyen
dc.titleIdentification of complex health interventions suitable for evaluation: development and validation of the 8-step scoping frameworken
dc.typeArticleen
dc.identifier.eissn1929-0748
dc.contributor.departmentUniversity of Bedfordshireen
dc.contributor.departmentFlying Starten
dc.identifier.journalJMIR Research Protocolsen
dc.identifier.pmcidPMC6423464
dc.date.updated2019-11-19T15:09:32Z
dc.description.notegold OA article with cc licence
html.description.abstractBackground: There is extensive literature on the methodology of evaluation research and the development and evaluation of complex interventions but little guidance on the formative stages before evaluation and how to work with partner organizations that wish to have their provision evaluated. It is important to be able to identify suitable projects for evaluation from a range of provision and describe the steps required, often with academic institutions working in partnership with external organizations, in order to set up an evaluation. However, research evaluating programs or interventions rarely discusses these stages. Objective: This study aimed to extend work on evaluability assessment and pre-evaluation planning by proposing an 8-Step Scoping Framework to enable the appraisal of multiple programs in order to identify interventions suitable for evaluation. We aimed to add to the literature on evaluability assessment and more recent evaluation guidance by describing the processes involved in working with partner organizations. Methods: This paper documents the steps required to identify multiple complex interventions suitable for process and outcome evaluation. The steps were developed using an iterative approach by working alongside staff in a local government organization, to build an evidence base to demonstrate which interventions improve children’s outcomes. The process of identifying suitable programs for evaluation, thereby establishing the pre-evaluation steps, was tested using all Flying Start provision. Results: The 8-Step Scoping Framework was described using the example of the local government organization Flying Start to illustrate how each step contributes to finding projects suitable for process and outcome evaluation: (1) formulating overarching key questions that encompass all programs offered by an organization, (2) gaining an in-depth understanding of the work and provision of an organization and engaging staff, (3) completing a data template per project/program offered, (4) assessing the robustness/validity of data across all programs, (5) deciding on projects suitable for evaluation and those requiring additional data, (6) negotiating with chosen project leads, both within and outside the organization, (7) developing individual project evaluation protocols, and (8) applying for ethical approval from the university and partner organization. Conclusions: This paper describes the processes involved in identifying suitable projects for evaluation. It adds to the existing literature on the assessment of specific programs suitable for evaluation and guidance for conducting evaluations by establishing the formative steps required to identify suitable programs from a range of provision. This scoping framework particularly relates to academic partners and organizations tasked with delivering evidence-based services designed to meet local needs. The steps identified have been described in the context of early years provision but can be applied to a range of community-based evaluations, or more generally, to cases where an academic partner is working with external stakeholders to identify projects suitable for academic evaluation.


Files in this item

Thumbnail
Name:
IdentificationofComplexHealthI ...
Size:
284.2Kb
Format:
PDF

This item appears in the following Collection(s)

Show simple item record

Green - can archive pre-print and post-print or publisher's version/PDF
Except where otherwise noted, this item's license is described as Green - can archive pre-print and post-print or publisher's version/PDF