Annex 2 : evaluation methodology

World Bank Institute (WBI) commissioned this review of the on-track pilot implementations to inform the current WB drive to include beneficiary feedback for all Bank projects for which there is an identifiable beneficiary. This main report and three annexes provide a detailed examination combined with tools for the future implementation of digital engagement mechanisms. The main report introduces the review and sets out findings, conclusions, lessons learned, and recommendations. A comprehensive elaboration of the findings is set out in annex 1. A detailed explanation of the evaluation method is set out in annex 2. Drawing from the lessons from the on-track experience, annex 3 provides a toolkit for introducing and implementing digital engagement mechanisms in WB-funded projects. The review is organized by four themes: quality and relevance of design, contribution to development results, process efficiency, and replicability. This report ascribes significant difficulties against each of these themes.