Search

Displaying 1 - 15 of 27

Lesson
While customized, survey-based performance targets can be useful, they should not account for the bulk of the targets such that the overall outcome of the program depends simply on one’s ability to replicate the survey. In this case, 4 of 6 outcome targets were generated by custom surveys which, for reasons unknown, could not be replicated. Also, proxy data could not be located for three of the targets. Thus, the program’s effectiveness, despite evidence to the contrary, was compromised simply by a lack of data and an inability to confirm progress.

Project Number: 49117-002, 49117-003, 49117-004
Project Name: Facilitating Youth School-to-Work Transition Program (Subprograms 1, 2, and 3)
Report Date:
Lesson
More formal and comprehensive systems, supported by the TA, are needed to track and validate compliance with gender-based performance targets. The first two subprograms were classified effective gender mainstreaming, and subprogram 3 was classified gender equity as a theme. Explicit targets were set to prioritize women in multiple areas, including entry into labor activation programs and training, and covering both job seekers and government staff. Yet, tracking was less than robust and required significant follow-up to evaluate program performance.

Project Number: 49117-002, 49117-003, 49117-004
Project Name: Facilitating Youth School-to-Work Transition Program (Subprograms 1, 2, and 3)
Report Date:
Lesson
It is important to include in the design and monitoring framework (DMF) the extent to which capacity-building activities improve trainees' perception of their capacity to perform project-related tasks to gauge the effectiveness of such activities. Most project activities were capacity building. However, DMF targets measuring capacity-building activities were limited to the number of trainees reached which was purely informational for project accountability.

Project Number: 43007-023
Project Name: Higher Education Reform Project
Report Date:
Lesson
Changes in scope could cause a lack of alignment between outcomes and outputs in the project’s results chain. The outcome target indicator for the increased number of disadvantaged students enrolled in HEIs was not linked to the output activity and indicator that the project design intended. By associating an outcome target with a potential output activity that can contribute to its achievement, project implementation activities would be purposeful.

Project Number: 43007-023
Project Name: Higher Education Reform Project
Report Date:
Lesson
Inadequate risk assessments can prevent projects from achieving results. The design and monitoring framework was designed with more assumptions made than risks identified. Overall project implementation was impacted by changes in government, although higher education institutions (HEIs) remained a priority for the government. Identification of risks related to unforeseen changes in government would have informed ADB and the project implementation unit of factors that could prevent the achievement of project results.

Project Number: 43007-023
Project Name: Higher Education Reform Project
Report Date:
Lesson
Budget allocations and actual expenditures to continually achieve project objectives are an indication of its sustainability. As there was a general lack of a strong legal framework or related reform to support the sustainability of the project, ADB should have used information on budget allocations and actual expenditure for the higher education sector after project implementation to more substantially confirm the sustainability of the project’s results.

Project Number: 43007-023
Project Name: Higher Education Reform Project
Report Date:
Lesson
Most of the results were output based. There was limited evidence on the impact that the program was expected to have on reducing skill gaps in the labor market. A closer focus on the employability of students (through tracer studies) would help demonstrate program effectiveness.

Project Number: 48101-003
Project Name: Guizhou Vocational Education Development Program
Report Date:
Lesson
Inadequate data collection can obstruct the documentation of project impact. The project implementation unit focused exclusively on disbursements to the detriment of other metrics in the design and monitoring framework. Government ministries do not collect data regarding TVET graduates, such as whether they are employed, in what capacity they are employed (i.e., whether they are employed in their field of study or not), and how much is their income. Information on historic and forecast budgets for TVET were not provided, nor were data on tuition collected from fee-paying students.

Project Number: 46535-001
Project Name: Strengthening Technical and Vocational Education and Training
Report Date:
Lesson
Lack of capacity in governmen to continue reforms without external support puts the sustainability of reform projects' outputs at risk. Reforming the sector requires strong ownership and commitment in terms of providing sufficient financing and policy changes to support the reform. Some project outputs—including the textbook rental scheme and textbook provision, online training modules and attestation for teachers, curricula review system, and financing of innovative schools' additional functions—are incomplete as the government still has not implemented them countrywide.

Project Number: 46537-002
Project Name: Strengthening Education System Sector Development Program
Report Date:
Lesson
The main driver of the project was improving the quality of USE to enhance productivity and employability in Viet Nam’s growing economy. However, the revision of curriculum and instructional material preparation was not within the sphere of the project. Instead, the project assumed that curriculum revision and new instructional material will be introduced within the project time frame, but outside the project scope. ADB should have properly identified such a project risk and adequately reflected it in project risk

Project Number: 42275-013
Project Name: Second Upper Secondary Education
Development Project
Report Date:
Lesson
The DMF missed some essential data that were important in measuring project effectiveness. As this was a follow-up project, both executing agency and ADB should have had up-to-date data and information. To avoid such issues, ADB needs to make a rigorous assessment of the institutional arrangements, and database benchmarks in the case of long-term commitments and preparation of additional follow-on projects.

Project Number: 42275-013
Project Name: Second Upper Secondary Education
Development Project
Report Date:
Lesson
Two of the outcome performance indicators could not be measured directly using available data. This not only affects assessment of final outcome achievements but can also affect implementation. If indicators cannot be tracked accurately, project managers cannot receive regular implementation progress data indicating whether the project is on track or requires modification—or whether the targets themselves need to be revised. Flawed performance indicators need to be addressed as early as possible during implementation.

Project Number: 40368-022
Project Name: Secondary
Education Sector Development Program
Report Date:
Lesson
Using performance targets that are specific, measurable, and with generally available indicators and backed by adequate baseline data is key to the reliable assessment of project results.

Project Number: 42275-013
Project Name: Second Upper Secondary Education Development Project
Report Date:
Lesson
It is important to have a clear results chain logic when designing the DMF to extract valuable lessons from the project.

Project Number: 42080-013
Project Name: Strengthening Water Management and Irrigation Systems Rehabilitation Project
Report Date:
Lesson
Possible control groups need to be identified to measure benefits attributable to the project.

Project Number: 42080-013
Project Name: Strengthening Water Management and Irrigation Systems Rehabilitation Project
Report Date: