Search

Displaying 1 - 9 of 9

Lesson
The DMF indicators and results chain, to effectively serve as a monitoring and evaluation tool, need to reflect the changes in TA scope and focus during implementation. Output performance indicators and targets were changed to align with the government’s requests for support to emerging priorities. The outcome statement and targets should also have been updated to reflect the changed focus of the TA which has evolved and become broader.

Project Number: 52006-001
Project Name: Capacity Building for Country Programming and Portfolio Management
Report Date:
Lesson
The design and monitoring framework (DMF) and monitoring and reporting mechanism need to be carefully developed at the planning stage. The outcome statement of the TA was not appropriate as it is too narrow and should be more focused on the TA benefits to Maldives. Outcome targets were too ambitious since there were several contributing factors outside the scope of the TA that affected their achievements. With a small country portfolio, unexpected delays in one or two projects will make the target unachievable. Having an outcome indicator at the broader level could help avoid that.

Project Number: 52006-001
Project Name: Capacity Building for Country Programming and Portfolio Management
Report Date:
Lesson
While customized, survey-based performance targets can be useful, they should not account for the bulk of the targets such that the overall outcome of the program depends simply on one’s ability to replicate the survey. In this case, 4 of 6 outcome targets were generated by custom surveys which, for reasons unknown, could not be replicated. Also, proxy data could not be located for three of the targets. Thus, the program’s effectiveness, despite evidence to the contrary, was compromised simply by a lack of data and an inability to confirm progress.

Project Number: 49117-002, 49117-003, 49117-004
Project Name: Facilitating Youth School-to-Work Transition Program (Subprograms 1, 2, and 3)
Report Date:
Lesson
More formal and comprehensive systems, supported by the TA, are needed to track and validate compliance with gender-based performance targets. The first two subprograms were classified effective gender mainstreaming, and subprogram 3 was classified gender equity as a theme. Explicit targets were set to prioritize women in multiple areas, including entry into labor activation programs and training, and covering both job seekers and government staff. Yet, tracking was less than robust and required significant follow-up to evaluate program performance.

Project Number: 49117-002, 49117-003, 49117-004
Project Name: Facilitating Youth School-to-Work Transition Program (Subprograms 1, 2, and 3)
Report Date:
Lesson
When designing results frameworks, the use of policy actions as results indicators should be minimized. If the indicator measures the reform success by the completion of the policy actions, it provides little information on the success of that policy action and undermines the relevance of the policy action for no result is achieved other than itself.

Project Number: 53248-001
Project Name: Second Public Efficiency and Financial Markets Program
Report Date:
Lesson
Understanding the Private Sector Small Medium Enterprises (PSME) context is essential both at the design stage and during implementation. A detailed assessment of SME policy and institutional, political, and social context is required, with ADB engagement as part of a coordinated program of support by development partners for SME reform. As achieved under the PSME2, it is important that the supported policy actions focus on a limited number of sequenced, high-impact reforms that lead to development outcomes that are clearly defined and reflected in the DMF.

Project Number: 44057-012, 44057-013
Project Name: Second Private Sector and Small and Medium-Sized Enterprises Development Program (Subprograms 1 and 2)
Report Date:
Lesson
The lack of available data across government departments can be challenging especially during times of crisis. The government encountered difficulties in collecting sex-disaggregated data in some instances; making it difficult to understand how women and girls were affected by the COVID-19 pandemic. Disaggregation by employment and disability status was challenging as well. The sex-segregated data on testing capacity and incentive for health workers included in the completion report were proxies based on total beneficiaries and the male and female ratio among the healthcare work force.

Project Number: 54177-001
Project Name: COVID-19 Active Response and Expenditure Support Program
Report Date:
Lesson
Indicators and targets relying on surveys that may not be available at the time of measurement could benefit from the identification of alternative measures during program design. One of the outcome Indicators in the CARES design and monitoring framework is measured by the WHO only every 5 years and information about its most recent assessment is due for release in mid to late 2022; after the end of the CARES program. Uncertainties and disruptions created by emergencies need to be considered when designing Indicators to ensure that targets are achievable and realistic.

Project Number: 54177-001
Project Name: COVID-19 Active Response and Expenditure Support Program
Report Date:
Lesson
In small island developing countries with limited policy reform capacity, ADB should avoid targeting multiple reform areas in one policy-based grant, particularly during a crisis.

Project Number: 52030-001
Project Name: Strengthening Macroeconomic Resilience Program
Report Date: