Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027 (2-day Course), Praag

Praag, Tsjechië
© Anton Bussemaker
datum 16 oktober 2019 - 18 oktober 2019
plaats Praag
organisatie European Institute of Public Administration (EIPA) i

The first part of this 3-day course deals with monitoring tasks, indicators and the Performance Framework. The second part examines how to conduct “evaluations during the programming period”. Senior evaluation consultant-economists with vast programme experience will focus on the two recommended evaluation methods.

Your browser must support JavaScript in order to make a booking.

Persons:

Date: Choose...

Month / Day / Year

Check Availability

SKU: 1930206 Categories: EU Policies: Rules and Practice, EU Structural Funds Tags: EU Structural and Cohesion Fund, EU Structural and Cohesion Funds

About this seminar

Seminar Stage 1: Monitoring, indicators and the Performance Framework

Seminar Stage 2: Evaluations during the programming period

Member States are now conducting evaluations of their EU Structural and Cohesion Funds programmes. Are the programmes and Funds delivering Value for Money? What is monitoring data telling us and can we expect programmes to achieve their many objectives? How do we measure and understand the impacts? Which evaluation method should be used - theory-based or counter-factual?

This 2-stage seminar examines these questions and others relating to the evaluation and monitoring of the Structural and Cohesion Funds in 2014-2020 and looks forward to changes for 2021-2027:

  • Stage 1 (Day 1) deals with monitoring tasks, indicators and the Performance Framework. We will look at whether milestones were reached by the end of 2018? The Czech Ministry of Regional Development will provide insight into progress in their programmes. We will review other monitoring requirements and see how these are to change in 2021-2027.
  • Stage 2 (Days 2 & 3) examines how to conduct “evaluations during the programming period”. Senior evaluation consultant-economists with vast programme experience will focus on the two recommended evaluation methods - theory-based and counterfactual evaluations - and the challenges for programme evaluations on the ground. We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other large projects.
  • You will also learn how to manage evaluation studies, including aspects of fieldwork, and be aware of the typical live issues for your current / planned evaluations

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes in 2014-2020
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.

What you will learn in this course

At the end of the seminar, participants should have a clear understanding of all the urgent evaluation and monitoring requirements associated with current programmes. Participants should also have a quick general tool kit for undertaking impact evaluations for projects and programmes. Mini-workshops and exercises are used both to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

Participants are invited to send us their problems, issues and questions before the seminar, if they wish. We will do our best to address the problems / answer the questions during the seminar!

Marco Lopriore (IT)

EU Funds

Robin Smail

EU Structural Funds - External Expert

Iain Jenkins

Management: appraisal, monitoring and evaluation - External Expert

Vladimir Kvača

Policy design and evaluation - External Expert

Practical information

Course venue

Hotel Majestic Plaza ****

Štěpánská 33

CZ - 110 00 Prague 1

Tel.nr +420 221 486 100

www.hotel-majestic.cz / www.le-hotels.cz

Programme Organiser

Ms Nancy Vermeulen

Tel: +31 43 32 96 212

n.vermeulen@eipa.eu

Fee

The fee includes documentation and refreshments. Lunches, a reception or dinner are included if mentioned in the programme. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts

EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?

Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Meals

Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.

Confirmation

Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment

Prior payment is a condition for participation.

Cancellation policy

For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.).

The programme

Seminar Stage 1: Monitoring, indicators and the Performance Framework

 

08.45

Registration of participants

09.00

Opening of the seminar and meeting the participants:introduction to the objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.30

Monitoring projects and programmes in 2014-2020 and 2021-2027

  • Key monitoring tasks, relations with projects
  • Data requirements, MIS, AIR
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework
  • The draft regulations 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.45

Coffee break

11.15

Workshop and discussion: indicators by sector

  • What lessons can we learn?
  • Are we using these indicators?

Robin Smail

12.15

Is ESF achieving results?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

13.00

Lunch break

14.30

Case study with Performance Framework

  • should we use unit-cost benchmarks?
  • Are the indicators adequate?

Robin Smail

15.15

Coffee break

15.45

Management Challenges for Member States in collecting and managing data

  • lessons learned from the first years of implementation
  • data collection, MIS, interpreting data for the AIR
  • problems for the PF, measuring progress
  • programme amendments

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme - Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

17.00

Exercises on Unit cost benchmarks

  • setting targets, calculating budgets
  • appropriate benchmarks

Robin Smail

17.45

End of first day

Seminar Stage 2: Evaluations during the programming period

 

09.00

Opening of stage 2 seminar:introduction, objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.10

Evaluation and measuring impact, 2014-2020 and 2021-2027

  • the purpose of evaluation - criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation questions
  • evaluation methods, techniques
  • evaluation and monitoring requirements, the Performance Framework
  • new evaluation requirements for 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.20

Exercise: evaluation questions - by sector

Robin Smail

11.00

Coffee break

11.30

Evaluation methods, issues and technical concepts

  • Evaluation objectives, scope of evaluations
  • Testing the intervention rationale and logic
  • Assessing quantitative performance: theory-based evaluations, counter-factual evaluations
  • Counter-factual evaluations: randomised control trials, difference in difference, propensity score matching
  • Assessing processes, transferring ownership
  • Theory-based evaluation: logic models, theory of change, causality

Dr Iain Jenkins, Director, EKOS Consultants, Glasgow, United Kingdom

13.00

Lunch break

14.30

Workshop: Theory-based evaluation case study

  • Logic models and theory of change
  • Determining the nature and scope of an evaluation
  • Designing evaluation questionnaires

Dr. Iain Jenkins

16.00

Coffee break

16.30

Czech programme evaluation challenges

  • State of play: Czech programmes evaluation
  • Coordination of evaluation at Partnership agreement, programme and project level
  • Evaluation Plans for Czech programmes
  • Major challenges (procurement of evaluation, data issues)
  • Case-study from European Social Fund Social Innovation priority axis

Dr. Vladimir Kváča, former president of the Czech Evaluation Society, Prague

18.00

End of second day

18.30

Reception

 

09.15

Some hints for the choice of methods and techniques

  • Choosing methods and techniques
  • Theory-based evaluations: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case-studies

Dr. Vladimir Kváča

   

10.00

Workshop: Counterfactual Evaluation

  • Understanding bias
  • Sampling
  • Hidden assumptions

Dr. Vladimir Kváča

10.45

Coffee break

11.15

Quick inventory of the Counterfactual methods

  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Dr. Vladimir Kváča

11.45

Conducting thematic evaluations in 2014-2020 and beyond: evaluation plans, preparing for studies, managing studies, using the results

  • Project evaluation plans, preparing for studies
  • The Call for Proposal
  • Managing evaluations, stages of evaluations
  • Issues for evaluations, using the results

Dr. Iain Jenkins

13.15

Lunch break

14.15

Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis

Robin Smail

15.15

Coffee break

15.35

Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

16.25

Seminar conclusions, evaluation feedback

16.30

Close of seminar

 

DAY 1

 

Seminar Stage 1: Monitoring, indicators and the Performance Framework

 

WEDNESDAY 16 OCTOBER 2019

 

08.45

Registration of participants

   

09.00

Opening of the seminar and meeting the participants:introduction to the objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

   

09.30

Monitoring projects and programmes in 2014-2020 and 2021-2027

  • Key monitoring tasks, relations with projects
  • Data requirements, MIS, AIR
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework
  • The draft regulations 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

   

10.45

Coffee break

   

11.15

Workshop and discussion: indicators by sector

  • What lessons can we learn?
  • Are we using these indicators?

Robin Smail

   

12.15

Is ESF achieving results?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

   

13.00

Lunch break

   

14.30

Case study with Performance Framework

  • should we use unit-cost benchmarks?
  • Are the indicators adequate?

Robin Smail

   

15.15

Coffee break

   

15.45

Management Challenges for Member States in collecting and managing data

  • lessons learned from the first years of implementation
  • data collection, MIS, interpreting data for the AIR
  • problems for the PF, measuring progress
  • programme amendments

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme - Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

   

17.00

Exercises on Unit cost benchmarks

  • setting targets, calculating budgets
  • appropriate benchmarks

Robin Smail

   

17.45

End of first day

 
 

DAYS 2 & 3

 

Seminar Stage 2: Evaluations during the programming period

 

THURSDAY 17 OCTOBER 2019

   
   

09.00

Opening of stage 2 seminar:introduction, objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

   

09.10

Evaluation and measuring impact, 2014-2020 and 2021-2027

  • the purpose of evaluation - criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation questions
  • evaluation methods, techniques
  • evaluation and monitoring requirements, the Performance Framework
  • new evaluation requirements for 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

   

10.20

Exercise: evaluation questions - by sector

Robin Smail

   

11.00

Coffee break

   

11.30

Evaluation methods, issues and technical concepts

  • Evaluation objectives, scope of evaluations
  • Testing the intervention rationale and logic
  • Assessing quantitative performance: theory-based evaluations, counter-factual evaluations
  • Counter-factual evaluations: randomised control trials, difference in difference, propensity score matching
  • Assessing processes, transferring ownership
  • Theory-based evaluation: logic models, theory of change, causality

Dr Iain Jenkins, Director, EKOS Consultants, Glasgow, United Kingdom

   

13.00

Lunch break

   

14.30

Workshop: Theory-based evaluation case study

  • Logic models and theory of change
  • Determining the nature and scope of an evaluation
  • Designing evaluation questionnaires

Dr. Iain Jenkins

   

16.00

Coffee break

   

16.30

Czech programme evaluation challenges

  • State of play: Czech programmes evaluation
  • Coordination of evaluation at Partnership agreement, programme and project level
  • Evaluation Plans for Czech programmes
  • Major challenges (procurement of evaluation, data issues)
  • Case-study from European Social Fund Social Innovation priority axis

Dr. Vladimir Kváča, former president of the Czech Evaluation Society, Prague

   

18.00

End of second day

   

18.30

Reception

 
 

FRIDAY 18 OCTOBER 2019

 

09.15

Some hints for the choice of methods and techniques

  • Choosing methods and techniques
  • Theory-based evaluations: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case-studies

Dr. Vladimir Kváča

   

10.00

Workshop: Counterfactual Evaluation

  • Understanding bias
  • Sampling
  • Hidden assumptions

Dr. Vladimir Kváča

   

10.45

Coffee break

   

11.15

Quick inventory of the Counterfactual methods

  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Dr. Vladimir Kváča

   

11.45

Conducting thematic evaluations in 2014-2020 and beyond: evaluation plans, preparing for studies, managing studies, using the results

  • Project evaluation plans, preparing for studies
  • The Call for Proposal
  • Managing evaluations, stages of evaluations
  • Issues for evaluations, using the results

Dr. Iain Jenkins

   

13.15

Lunch break

   

14.15

Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis

Robin Smail

   

15.15

Coffee break

   

15.35

Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

   

16.25

Seminar conclusions, evaluation feedback

   

16.30

Close of seminar

-

Marco Lopriore (IT)

-

Robin Smail (External Expert)

-

Iain Jenkins (External Expert)

-

Vladimir Kvača (External Expert)

Provisional course venue

Rezidence Dlouhá 17

Dlouhá 17

110 00 Praha 1

Programme Organiser

Ms Nancy Vermeulen

Tel: +31 43 32 96 212

n.vermeulen@eipa.eu

Fee

The fee includes documentation and refreshments. Lunches, a reception or dinner are included if mentioned in the programme. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts

EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?

Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Meals

Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.

Confirmation

Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment

Prior payment is a condition for participation.

Cancellation policy

For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.).


1.

European Institute of Public Administration (EIPA)

Het Europees instituut voor bestuurskunde (beter bekend als The European Institute of Public Administration - ofwel EIPA) streeft ernaar om de kennis van ambtenaren die zich met de EU bezighouden te vergroten door het ontwikkelen en organiseren van trainingen. Het instituut wil wetenschappelijke kennis en praktische 'know–how' met elkaar verbinden. EIPA bestaat al meer dan 35 jaar.

Het hoofdkantoor van EIPA is gevestigd in Maastricht en heeft dependances in Luxemburg en Barcelona. Gemiddeld nemen 14.000 nationale en Europese ambtenaren per jaar deel aan de trainingen. Daarnaast biedt EIPA ook consultancy, onderzoek en op maat gemaakte programma’s/trainingen aan. Bij EIPA werken circa 120 hoogopgeleide medewerkers.

2.

Meer over...