open access publication

Article, 2022

A comprehensive monitoring and evaluation framework for evidence to policy networks

Evaluation and Program Planning, ISSN 1873-7870, 0149-7189, Volume 91, Page 102053, 10.1016/j.evalprogplan.2022.102053

Contributors

Kuchenmüller, Tanja 0000-0002-9021-981X (Corresponding author) [1] Chapman, Evelina Maria Gracia 0000-0001-5979-6718 [1] Takahashi, Ryoko [1] Lester, Louise [2] Reinap, Marge 0000-0001-5836-7516 [1] Ellen, Moriah Esther 0000-0001-7127-7283 [3] Haby, Michelle M 0000-0001-6203-9195 [4] [5]

Affiliations

  1. [1] World Health Organization Regional Office for Europe
  2. [NORA names: Miscellaneous; Denmark; Europe, EU; Nordic; OECD];
  3. [2] Nottinghamshire County Council
  4. [NORA names: United Kingdom; Europe, Non-EU; OECD];
  5. [3] Ben-Gurion University of the Negev
  6. [NORA names: Israel; Asia, Middle East; OECD];
  7. [4] Universidad de Sonora
  8. [NORA names: Mexico; America, Central; OECD];
  9. [5] University of Melbourne
  10. [NORA names: Australia; Oceania; OECD]

Abstract

OBJECTIVE: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. METHOD: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. RESULTS: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. CONCLUSION: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

Keywords

IV, KT activities, KT capacity, KT experts, KT procedures, Secretariat, TOC, accounts, activity, building, capacity, chain, collection methods, comprehensive monitoring, comprehensive theory, consultation, countries, culture, data, data collection methods, development, domain, evaluating knowledge translation, evaluation, evaluation framework, evidence, expert consultation, experts, framework, gap, health, health outcomes, increased accountability, indicator domains, indicators, knowledge translation, lessons, literature review, maturation, member countries, members, method, monitoring, multipartner, network, network maturation, outcomes, phase, policy, policy networks, policy value, procedure, results, results chain, review, skill building, skills, stage, targeted literature review, theory, translation, values

Funders

  • International Development Research Centre
  • World Health Organization - Denmark
  • World Health Organization

Data Provider: Digital Science