Search

Displaying 1 - 15 of 53

Lesson
A more nuanced iteration of the project design and monitoring framework (DMF) i.e., accurately differentiating outcome and output indicators, would be beneficial to facilitate better project results assessments. As observed by this validation, impact, outcome, and output statements in the DMF were vague and similar, and did not provide sufficient guidance to focus performance targets that would have provided better evidence for achieving the goals of the impact, outcome, and output statements.

Project Number: 45507-003
Project Name: Yunnan Chuxiong Urban Environment Improvement Project
Report Date:
Lesson
The practice at appraisal is to provide baseline information and the design and monitoring (DMF) outcome and output targets based on project inputs. In the case of this project, the DMF targets need to be project related. It used a target for the impact indicator that linked project output to the development of other projects. While it is possible to reasonably forecast results, the external capacity development may impact the outcomes.

Project Number: 47101-002
Project Name: Assam Power Sector Investment Program (Tranche 1)
Report Date:
Lesson
A design and monitoring framework could become more useful and informative for assessment if it could include quantifiable indicators for capacity building when the requirement is identified during program appraisal.

Project Number: 37192-023, 37192-033, 37192-043, 37192-044
Project Name: Power Transmission Enhancement Investment Program (Tranche 4 and Multitranche Financing Facility)
Report Date:
Lesson
The outcome performance indicator of a loan project that is deliberately designed to establish a reasonable cause-effect relationship between outputs and outcome can ensure a logical appropriateness and continuum of the design and monitoring framework results chain.

Project Number: 46417-001
Project Name: Jaipur Metro Rail Line 1-Phase B Project
Report Date:
Lesson
When designing results frameworks, the use of policy actions as results indicators should be minimized. If the indicator measures the reform success by the completion of the policy actions, it provides little information on the success of that policy action and undermines the relevance of the policy action for no result is achieved other than itself.

Project Number: 53248-001
Project Name: Second Public Efficiency and Financial Markets Program
Report Date:
Lesson
Insufficient up-to-date macroeconomic data on government websites, which could hinder timely and effective planning especially during crisis periods, needs to be rectified. The State Statistical Committee (SSC) has numerous macroeconomic indicators on its website. However, in most cases, very recent data are missing. International organizations such as ADB, the IMF and the World Bank release forecasts of macroeconomic indicators for upcoming years, and SSC should consider following the same approach.

Project Number: 55073-001
Project Name: COVID-19 Active Response and Expenditure Support Program
Report Date:
Lesson
Accessibility of healthcare data in Azerbaijan needs to be improved. Reports from the Ministry of Health Care are not publicly available on its website. In addition, the State Agency for Mandatory Health Insurance considers healthcare information to be highly sensitive. Accordingly, this information is not contained on its website. Information related to daily coronavirus infections and vaccinations was released publicly. It would be useful for the agency to disseminate gender, age, and region-disaggregated information to the public.

Project Number: 55073-001
Project Name: COVID-19 Active Response and Expenditure Support Program
Report Date:
Lesson
Understanding the Private Sector Small Medium Enterprises (PSME) context is essential both at the design stage and during implementation. A detailed assessment of SME policy and institutional, political, and social context is required, with ADB engagement as part of a coordinated program of support by development partners for SME reform. As achieved under the PSME2, it is important that the supported policy actions focus on a limited number of sequenced, high-impact reforms that lead to development outcomes that are clearly defined and reflected in the DMF.

Project Number: 44057-012, 44057-013
Project Name: Second Private Sector and Small and Medium-Sized Enterprises Development Program (Subprograms 1 and 2)
Report Date:
Lesson
Ensuring the direct link between supported activities, outputs, and outcome, and relevance of their indicators is critical. For example, this program failed to achieve or achieved only in part some outcome indicators even though all planned outputs were delivered.

Project Number: 46537-002
Project Name: Strengthening Education System Sector Development Program
Report Date:
Lesson
Without a comprehensive and robust design and monitoring framework (DMF) and without undertaking the necessary updates, the level of project achievements against targets cannot be ascertained. In this project, the scale and character of planned physical works in one scheme were substantially altered during implementation, but the impact of this change on project effectiveness cannot be properly captured by the indicators in the DMF. Similarly, without conducting baseline and impact assessments, the economic viability of project investments cannot be reliably established.

Project Number: 40190-013
Project Name: Greater Mekong Subregion Flood and Drought Risk Management and Mitigation Project 
Report Date:
Lesson
A simple and focused design strengthens the likelihood for project success. This project's design was simple and focused (with two well-differentiated outputs linked to a clear outcome), and with all dimensions of irrigation efficiency as determinants of agriculture productivity included in the scope of activities.

Project Number: 44328-013
Project Name: Uplands Irrigation and Water Resources Management Sector Project
Report Date:
Lesson
Setting output indicators in the design and monitoring framework (DMF) that are the same or identical to policy actions confuses inputs with intended changes generated by policy actions. IED notes that this has been a standard practice for policy-based loans (PBLs) approved under previous ADB guidelines for preparing DMFs. However, going forward, specifying indicators that clearly measure the intended changes of policy actions would facilitate a better assessment of results.

Project Number: 45253-002
Project Name: Third Capital Market Development Program
Report Date:
Lesson
Indicators and targets relying on surveys that may not be available at the time of measurement could benefit from the identification of alternative measures during program design. One of the outcome Indicators in the CARES design and monitoring framework is measured by the WHO only every 5 years and information about its most recent assessment is due for release in mid to late 2022; after the end of the CARES program. Uncertainties and disruptions created by emergencies need to be considered when designing Indicators to ensure that targets are achievable and realistic.

Project Number: 54177-001
Project Name: COVID-19 Active Response and Expenditure Support Program
Report Date:
Lesson
Projections about the impact of road projects should be realistic and adequately consider the accessibility of the roads to be built to communities. The impact statement in the design and monitoring framework about increased access to markets, jobs, and social services in the 4 project provinces should have been restricted to the 10 districts along the project roads, as the project roads could not generate impacts in farther areas. Performance Indicators and targets should also consider data availability and baselines that proved to be limited in at least one of the project provinces.

Project Number: 43309-013
Project Name: Provincial Roads Improvement Project
Report Date:
Lesson
Projections about the impact of road projects should be realistic and adequately consider the accessibility of the roads to be built to communities. The impact statement in the design and monitoring framework about increased access to markets, jobs, and social services in the 4 project provinces should have been restricted to the 10 districts along the project roads, as the project roads could not generate impacts in farther areas. Performance Indicators and targets should also consider data availability and baselines that proved to be limited in at least one of the project provinces.

Project Number: 43309-013
Project Name: Provincial Roads Improvement Project
Report Date: