Consultant (Final External Evaluator)

TERMS OF REFERENCE

FINAL EXTERNAL EVALUATION OF THE PROJECT
“Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders”

Commissioned by: Monitoring, Evaluation, Accountability, and Learning (MEAL) Unit, IOM Türkiye

Managed by: MEAL Unit and Project Implementation Team

The International Organization for Migration (IOM), the United Nations (UN) Migration Agency, was established in 1951 and is the leading intergovernmental organization in the field of migration, working closely with governmental, intergovernmental, and non-governmental partners. With 175 member states, a further eight states holding observer status and offices in 172 countries, IOM is dedicated to promoting humane and orderly migration for the benefit of all.

The IOM established its operations in Türkiye in 1991. IOM’s partnership with the Government of Türkiye (GoT) was formalized in November 2004, when Türkiye became an IOM Member State. IOM Türkiye works closely with the government of the Republic of Türkiye, regional authorities, the UN, donors, and civil society organizations to address migration challenges by implementing programmes through three pillars: Resilience, Mobility, and Governance. Across the country, IOM Türkiye provides a comprehensive response to the humanitarian needs of migrants, internally displaced persons, returnees, and host communities through direct humanitarian assistance, recreational activities, and various other efforts. Alongside IOM’s role in addressing the needs of migrants during crises, the mission works in close collaboration with the Government of Türkiye to address the longer-term impact of migration, including migrant assistance programmes, labour integration and migration management, immigration and border management, and research and data collection on migrant movement.

The project “Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders”, funded by the Ministry of Foreign Affairs of the Kingdom of Denmark and implemented by IOM Türkiye in cooperation with the Ministry of Interior, Presidency of Migration Management Directorate General of Border Management is supporting Türkiye’s efforts in the implementation of an integrated border management (IBM) strategy and approach aiming to prevent irregular border crossings and other cross-border crimes at eastern and southern borders. The main beneficiary of the project is the Directorate General of Border Management (DGBM) - Presidency of Migration Management. DGBM is tasked to ensure national border management coordination at Turkish borders by establishing and enhancing coordination between relevant public institutions operating at border crossing points (BCP-hereinafter), as well as strengthening cooperation among national and international institutions involved in border management. Additionally, DGBM is responsible for collecting, analysing, and evaluating data related to border management.

The overall objective of the project is to support Türkiye’s efforts in strengthening its integrated border management (IBM) approach and preventing irregular border crossings and other cross-border crimes at eastern and southern borders. The expected outcome is the enhancement of the institutional capacity of the Directorate General of Border Management (DGBM) and related border management agencies to support the IBM response in the eastern and southern border provinces. The expected results are as follows:

Result 1: Border Management Agencies increase their surveillance and screening capacity through procurement of equipment

Result 2: Border Management Staff strengthen their knowledge and skills on migration and border management

Result 3 : Border Management Agencies in Türkiye increase their inter-agency and international coordination and cooperation on migration and border management

The initial project implementation period was from 01 January 2022 to 31 December 2023. The project received one no-cost extension (from 31 December 2023 to 31 August 2024) and, one cost extension (from 31 August 2024 to 31 August 2025). The evaluation will cover the entire implementation period of the project, from 01 January 2022 to 31 August 2025.

2. Evaluation Purpose and Objective

The final evaluation aims to comprehensively assess the Ministry of Foreign Affairs of the Kingdom of Denmark-funded project “Increasing Border Management Capacities at Türkiye’s Eastern and Southern Borders.” The objective is to assess achieved outcomes and to identify strengths and weaknesses within the project design, management, and implementation. This evaluation will assess the project’s success in achieving its intended results and examines the impact and sustainability of its activities. This evaluation will utilize the OECD-DAC evaluation criteria -relevance, coherence, efficiency, effectiveness, impact, and sustainability. The evaluation will inform strategic decision-making and future programming by identifying lessons learned, promoting good practices, and assessing stakeholder satisfaction with project activities and results.

3. Evaluation Scope

The final evaluation aims to comprehensively assess the project’s performance during the period of January 31, 2022 to August 31, 2025. The geographic scope of the evaluation will align with the project’s implementation areas, primarily focusing on the stakeholders based at the headquarters of the beneficiary institutions. The evaluation will adopt a participatory approach, actively engaging relevant stakeholders, including IOM Türkiye staff, the Ministry of Interior (MoI), the Directorate General of Border Management (DGBM) under the Presidency of Migration Management (PMM), and other agencies involved in border management in Türkiye.

Furthermore, the evaluation will also provide actionable recommendations, highlight good practices and lessons learned, and contribute valuable insights for future or similar programmes. An important aspect of the evaluation is the analysis of cross-cutting themes, particularly the integration of gender considerations and a human rights-based approach within project activities and implementation.

4. Evaluation Criteria

The evaluation will assess the criteria of relevance, effectiveness, efficiency, and sustainability of the project and, to the extent possible, will address the likely impact. It will also examine the project's complementarity and coordination with other relevant interventions under the criterion of coherence. The OECD-DAC definitions will guide the evaluation.

• Relevance : The extent to which the intervention's objectives and design respond to the needs, policies and priorities of beneficiaries at the global, national and institutional levels, and continue to do so as circumstances evolve.

• Coherence: The extent to which the intervention is compatible with other interventions within the same country, sector, or institution.

• Effectiveness: The extent to which the intervention has achieved, or is expected to achieve, its stated objectives and results, including any differential results across groups.

• Efficiency: The extent to which the intervention delivers, or is likely to deliver, results in a cost-effective and timely manner.

• Impact : The extent to which the intervention has produced or is expected to produce significant positive or negative, intended or unintended, higher-level effects.

• Sustainability: The extent to which the benefits of the intervention continue or are likely to continue.

5. Evaluation Questions

In the inception phase, the evaluator will further develop and refine the evaluation questions to ensure detailed and specific information is gathered for each criterion. The evaluation matrix will be reviewed collaboratively with IOM.

The following key questions will guide the evaluation process:

6. Evaluation Methodology

The evaluation will employ a comprehensive mixed-methods approach, utilizing both qualitative and quantitative methods to collect and analyse data from various sources. This rigorous approach will generate robust and reliable evidence for assessing the project's results, including outputs, outcomes, and objectives. The data will be cross-validated and triangulated using multiple methods to enhance accuracy. Evaluation findings and data will be disaggregated by gender, age, geographic location, and type of activity to ensure inclusive and meaningful analysis.

Data sources will include desk reviews, surveys, and interviews with beneficiaries, as well as key stakeholders such as the Ministry of Interior, Directorate General of Border Management (DGBM) under the Presidency of Migration Management (PMM), etc.

The evaluation will use a mixed-methods approach, combining both quantitative and qualitative data through the following methods:

• Desk review: A systematic and detailed examination of key documents, including the project proposal, results matrix, work plans, donor/progress reports, monitoring reports, data, and budgetary documents.
• Key informant interviews and focus group discussions: Primary data will be gathered through interviews and focus group discussions with staff from IOM. The interaction will be based on semi-structured questions to gather their perspectives and deeper insight into the project.
• Surveys and in-depth semi-structured interviews: Structured surveys and semi-structured interviews will target stakeholders who participated in project activities.

The evaluator will develop tools for review and approval by IOM Türkiye before data collection. The evaluation will incorporate gender and rights-based approaches throughout data collection and analysis.

Also, the evaluator will propose a purposive or stratified sampling strategy, ensuring adequate representation across stakeholder groups and geographic locations. The sample should account for diversity in role, gender, and institutional affiliation

7. Ethics, Norms, and Standards for Evaluation

IOM abides by the Norms and Standards of the UN Evaluation Group (UNEG) and expects all evaluation stakeholders to be familiar with the UNEG Ethical Conduct Guidelines and the UNEG Codes of Conduct . This evaluation will follow IOM's Evaluation Policy , M&E Guidelines , and Guidance on Quality Management of IOM Evaluations , including the quality checking tool for inception and final reports. The evaluation must also adhere to the Data Protection Principles laid out in the IOM Data Protection Manual .

8. Evaluation Deliverables

The external evaluator is expected to deliver the following:

• Inception report

The evaluator will prepare an inception report [1] outlining their approach to the evaluation. It should include the evaluation matrix, draft data collection tools, a clear articulation of their understanding of the ToR, the methodology, and any proposed methodological adjustments, and a detailed provisional work plan. The report should be submitted to IOM Turkiye after the document review phase for feedback and discussion, prior to the interview phase.

• Presentation of the initial findings

Following the interview phase, the evaluator should prepare a presentation of the preliminary evaluation findings, tentative conclusions, and recommendations. This will be used to debrief the IOM team and address any misinterpretations or gaps.

• A draft evaluation report

Based on the debrief and initial feedback, the evaluator should prepare a draft evaluation report incorporating lessons learned and recommendations. They will consolidate all comments received, including those from IOM, and revise the report accordingly.

• Final evaluation report

Once finalized, the evaluator will submit a final evaluation report using the IOM-provided template. The report should include an executive summary, a list of acronyms, an introduction, an evaluation context and purpose, an evaluation framework and methodology, findings, conclusions, recommendations, good practices, and lessons learned. Annexes should include the TOR, inception report, list of documents reviewed, persons interviewed or consulted, and data collection instruments.

The evaluator will submit the final evaluation report in accordance with IOM standards. All deliverables must be in English and meet professional language standards. Reports should meet the standards in the UNEG Quality Checklist for Evaluation Reports and the IOM Quality Control Tool for evaluation reports. The IOM House Style Manual and the IOM Publication Layout Manual should also be applied

• Evaluation brief (two-page summary according to the IOM template) and infographics

The evaluator will prepare a concise two-page evaluation brief [2] in English, summarising key findings, lessons learnt, and recommendations. IOM will provide a template, which may be adapted but should not exceed two pages. Page one should include identification of audience; project information (project title, countries covered, project type and code, project duration, project period, donor(s), and budget); evaluation background (purpose, team, timeframe, type of evaluation, and methodology); and a brief description of the project. Page two should summarise the most important evaluation results: key findings and/or conclusions, best practices and lessons learned (optional), and key recommendations. The evaluator will also prepare infographics summarizing key findings, good practices, lessons learned, conclusions, and recommendations. The purpose of these infographics is to enhance accessibility of results for diverse audiences and support effective dissemination.

• Management response matrix (IOM will provide the template)

After IOM Turkiye approves the evaluation report and brief, the evaluator should draft a Management Response Matrix [3] using the IOM template, listing recommendations and indicative timelines for implementation. The IOM team will finalize the matrix in coordination with project stakeholders.

• The final presentation of the evaluation report (online briefing with a PowerPoint for IOM staff, the donor, and key stakeholders to be identified and agreed upon)

The evaluator will deliver a presentation of the final findings and recommendations to stakeholders, including IOM staff, national partners, and donors. A draft should be shared with the IOM project and MEAL teams in advance, and feedback should be reflected in the final version.

IOM Türkiye will not cover any cost related to interpretation during data collection; all related expenses should be included in the evaluator’s proposed budget.

Upon final approval of the deliverables, the IOM Türkiye MEAL team will ensure that final evaluation findings are accessible to stakeholders, including sharing it with the Regional M&E team to facilitate its posting in IOM's global Evaluation Repository.

9. Specifications of Roles

The roles of the IOM project team, evaluator, and stakeholders are identified below:

The Evaluator:

• Conduct the evaluation in accordance with the Terms of Reference (ToR).
• Implement data collection, analysis, and reporting activities for the final evaluation.
• Conduct bilateral meetings with IOM to discuss progress, challenges, and emerging issues.
• Provide regular progress updates to the IOM team.
Prepare and deliver the inception report, draft and final evaluation reports, a two-page evaluation brief, the visual presentation of the evaluation findings and recommendations, and a draft management response matrix.

The MEAL Unit of IOM:

• Initiate a kick-off meeting with the evaluator and establish a work plan.
• Provide the evaluator with background information and relevant monitoring documents,
• Review the deliverables submitted by the evaluator.
• Coordinate the review of the evaluation deliverables with relevant individuals, IOM staff, and key stakeholders.
• Ensure that factual corrections are incorporated and reflected in the final report.
Facilitate the finalization of the management response matrix.

The Project Team of IOM:

• Provide the evaluator with general information, project documents, donor reports, and budget information relevant to the project.
• Review the deliverables submitted by the evaluator.
• Assist in scheduling in-person and virtual meetings with key stakeholders.
• Support logistical and travel arrangements as needed.
Coordinate with relevant stakeholders, including government counterparts, throughout the evaluation process.

10. Schedule

The evaluation will require 44 working days for the evaluator, including preparation, data collection, analysis, and reporting. Including IOM’s internal review, the total duration will be 55 days. The assignment is expected to begin in October 2025, with the final report and presentation delivered by November 2025. The specific dates will be finalised in the discussion with the selected evaluator.

The final evaluation of the project is divided into three phases:

The Inception Report, including the Evaluation Matrix, must be submitted within two weeks of the start of the assignment. It should demonstrate the evaluator's understanding of the assignment, methodology, and approach, along with a detailed work plan aligned with the evaluation outputs. The Inception Phase will be coordinated closely with IOM’s IBG Unit and MEAL Unit to obtain all the necessary documentation and stakeholder contact details, enabling timely scheduling of meetings and interviews.

The key tasks of the Desk Review phase are:

• The evaluator and IOM team will have a virtual briefing during the first week of the evaluation process's start. Relevant IOM colleagues and government focal points will also hold a kick-off meeting to decide on the precise table of contents of the inception report and discuss evaluation questions, information needs, additional fieldwork, and methodology.
• During the first week, the evaluator will review all available information and identify any additional sources of information.
• The evaluator will draft an inception report presenting the intervention logic, revised methodology, the work plan, and an evaluation matrix, along with the proposed field tools and draft interview schedule.
• Following feedback from IOM, the evaluator will review and finalise the Inception Report, including the evaluation questions, methodology, tools, and work plan.
• IOM will arrange meetings to ensure a common understanding of the evaluation process, provide necessary information to the evaluator for logistical arrangements, and provide input to the inception report. If needed, IOM will arrange a meeting with the evaluator and other stakeholders to finalize the methodology and work plan and validate the Inception Report.

The primary goal of this phase is to conduct stakeholder consultations and collect data through interviews and surveys.

The Field Phase should start upon the evaluation manager's approval of the Inception report. The main tasks of the field phase are:

• The evaluator will submit a detailed data collection plan, including an indicative list of interviewees, surveys plans, dates of visit, itinerary, and names of team members in charge. This plan should remain flexible to accommodate any field-level changes. If any significant deviation from the agreed work plan is perceived as creating a risk for the quality or timeline of the evaluation, these should be immediately discussed with the IOM.
The evaluator will ensure close consultation with IOM and stakeholders; use the most reliable data sources, and harmonize inputs from various sources to allow reliable interpretation. At the end of the field phase, the evaluator will summarize the fieldwork, discuss the reliability and coverage of data collection, and present the preliminary findings in a meeting with IOM.

Based on IOM’s comments from Phase 2, the evaluator must revise the draft report accordingly. Comments requesting methodological quality improvements should be incorporated unless unfeasible, in which case justification must be provided. Comments on the report's content can be accepted or rejected, with a focus on making factual corrections only. If rejected, the evaluator must provide a justification and explanation for the decision.

Upon finalizing the evaluation report, a half-day event will be organized in Ankara, with the participation of the Steering Committee members and other key stakeholders to discuss findings and follow-up actions. Based on the presentation, project stakeholders will discuss actions to be taken to address findings and enhance the capacities of all parties involved.

The following table gives an overview of the estimated timeline and distribution of responsibilities for a total of 44 working days for the evaluator:

The evaluator's fee will be all-inclusive, covering all costs related to flights, hotel accommodation, field trips to relevant implementation sites, translation, and any other costs required to complete the evaluation. Payment of consultancy fees will be made IOM’s approval of the following deliverables:

Payment Schedule:

Duration of the Contract

The overall evaluation process, including IOM’s internal review, will span 55 days, with 44 working days allocated to the evaluator. This period covers all evaluation tasks, including preparation, data collection, analysis, and reporting. The evaluator is expected to manage and complete these tasks efficiently within the agreed timeframe, ensuring high quality of deliverables. The assignment is scheduled between October and November 2025. The specific dates will be identified in consultation with the selected evaluator.

IOM Türkiye is seeking an independent, multidisciplinary external evaluator. The evaluator may be based in any country but must be willing to travel to Türkiye to conduct the evaluation. The candidate should demonstrate prior experience in conducting similar types of evaluations.

Education and Experience

• The evaluator should have at least ten years of experience in conducting project evaluations.
• Proven experience in using both quantitative and qualitative research methods and analytical tools.
• The candidate should have a master's degree or equivalent in evaluation, law, social sciences, public policy, development studies, or related fields.
• Demonstrated sound understanding of key migration themes, including migration governance, border management, labour migration, trafficking in persons, and crisis management.
Experience in working with IOM and evaluating IOM Immigration and Border Governance (IBG) projects is an advantage.

Competencies

• Excellent analytical, oral, and written communication skills in English.
• Experience collecting qualitative and quantitative data under challenging circumstances and using inclusive and participatory approaches.
• Ability to develop visual representations of key findings.
• Experience in technical and analytical report writing.
• Experience navigating complex institutional or multi-stakeholder environments.
• Displays cultural, gender, religious, racial, national, and age sensitivity and adaptability.
Ability to work with minimal supervision and to meet deadlines.

Languages: An excellent command of English is required. The evaluator needs to consider that the data will be collected in Turkish. Working knowledge of Turkish is an advantage.

Interested consultants should submit a technical proposal (not exceeding 15 pages) detailing their evaluation methodology, provisional work plan, and overall approach. An all-inclusive itemized budget must also be submitted. Proposals are due by [specify the date based on the date the application is sent out].

The submission should include the following:

• Technical proposal – a description of the approach and proposed evaluation methodology, including data collection plans and analysis techniques, ethical considerations, quality control measures, work plan, and timelines.
• Detailed budget – all-inclusive budget covering fees and all other anticipated expenses, with a cost breakdown.
• Cover letter – highlighting recent experience with similar assignments.
• A detailed CV including three references.
• Sample report – one recent evaluation report authored by the consultant.

Proposals and related inquiries should be sent via email to: XX

Responsibilities: The Evaluator:

Conduct the evaluation in accordance with the Terms of Reference (ToR).
Implement data collection, analysis, and reporting activities for the final evaluation.
Conduct bilateral meetings with IOM to discuss progress, challenges, and emerging issues.
Provide regular progress updates to the IOM team.

Prepare and deliver the inception report, draft and final evaluation reports, a two-page evaluation brief, the visual presentation of the evaluation findings and recommendations, and a draft management response matrix.

Qualifications: Education and Experience

The evaluator should have at least ten years of experience in conducting project evaluations.
Proven experience in using both quantitative and qualitative research methods and analytical tools.
The candidate should have a master's degree or equivalent in evaluation, law, social sciences, public policy, development studies, or related fields.
Demonstrated sound understanding of key migration themes, including migration governance, border management, labour migration, trafficking in persons, and crisis management.
Experience in working with IOM and evaluating IOM Immigration and Border Governance (IBG) projects is an advantage.

Competencies

Excellent analytical, oral, and written communication skills in English.
Experience collecting qualitative and quantitative data under challenging circumstances and using inclusive and participatory approaches.
Ability to develop visual representations of key findings.
Experience in technical and analytical report writing.
Experience navigating complex institutional or multi-stakeholder environments.
Displays cultural, gender, religious, racial, national, and age sensitivity and adaptability.
Ability to work with minimal supervision and to meet deadlines.

Languages: An excellent command of English is required. The evaluator needs to consider that the data will be collected in Turkish. Working knowledge of Turkish is an advantage.