1 / 16

Assessing the Programme performance: What worked, what can be improved?

‘ANALYSIS, EVALUATION AND DEVELOPMENT OF THE MED PROGRAMME’ Campobasso, June 13th 2011. Assessing the Programme performance: What worked, what can be improved?. Tarja Richard MED JTS Coordinator (interim). CONTENT. Traditional Calls: Challenges;

rcrouse
Download Presentation

Assessing the Programme performance: What worked, what can be improved?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ‘ANALYSIS, EVALUATION AND DEVELOPMENT OF THE MED PROGRAMME’ Campobasso, June 13th 2011 Assessing the Programme performance: What worked, what can be improved? Tarja Richard MED JTS Coordinator (interim)

  2. CONTENT • Traditional Calls: • Challenges; • Assessment: methods, tools, selection procedure, evaluation, adjustments; • Strengths and weaknesses of projects; • Strategic call: • Challenges; • Assessment: selection procedure, expectations; • Results; • Future perspectives?

  3. TRADITIONAL CALLSCHALLENGES Ensure project quality:  Offer possibility to improve applications with potential: • 2-step selection procedure; • Conditions / Recommendations. Ensure fair assessment; • Grid of criteria.

  4. TRADITIONAL CALLSASSESSMENT: METHOD AND TOOLS General evaluation/Individual evaluation; Discussion/ double evaluation; Based on grid of criteria + internal scale of values: • Eligibility and Quality check  PRESAGE system; • Coherence Axis – Political Frameworks; • Coherence MED Objectives; • Geographical balance – Transnationality; • Quality of Project / Implementation; • Partnership; • Budget.

  5. TRADITIONALCALLSASSESSMENT: SELECTION PROCEDURE 1st call for projects– 2 phases – 11 months (273 eligible projects / 531) by 4 project Officers Launch PA(1 month) Sub.PA (273/531) (4 months) Pre-S (109) (1 month) Launch A (1 month) Sub.A (4 months) Selection(50/108) 2nd call for projects– 2 phases – 11 months (330 eligible projects / 447) By 4 project Officers Launch PA(1 month) Sub.PA (330/447) (4 months) Pre-S (90) (1 month) Launch A (1 month) Sub.A (4 months)Selection(52/76)

  6. TRADITIONAL CALLS ASSESSMENT: WHAT HAD TO BE IMPROVED? 2 step-application selection procedure: • No real improvement of the whole application between phases  CONDITIONS set by the Selection Committee; • The draft application and the final one were too similar: the 1st phase was too heavy; • Long process and low programming rate (from 978 pre-proposals to 102 programmed projects).

  7. TRADITIONALCALLSASSESSMENT: ADJUSTMENTS IN TOOLS AND METHODS FOR THE 2ND CALL Taking better advantage of the 2-step selection procedure: • Recommendations drafted at pre-selection stage. Improve coherence of evaluations: - between evaluations; - between evaluators;  common understanding of criteria;  common scale of values;  harmonized comments; • Internal grid (scale of values); • Double evaluation / discussion.

  8. TRADITIONAL CALLS STRENGTHS AND WEAKNESSES OF ‘TRADITIONAL’ PROJECTS Open calls for all Priority Axis: high number of applications – ‘mass treatment’. No possibility to exchange between programme bodies (JTS and NCP’s) and applicants in the application phase. Projects having a weak correspondance with programme objectives. Partnership often not sufficiently managed by the LP and not strong since the beginning numerous partner changes in projects.

  9. TRADITIONAL CALLS STRENGTHS AND WEAKNESSES OF ‘TRADITIONAL’ PROJECTS Capitalisation approach not foreseen by projects since their beginning, but a need to capitalise and to share experience is clear in many projects. Spontaneous clusterisation is happening with part of the projects. Many project results are lost after the end of activities: programme needs to create an ‘electronic library’ to improve the use of deliverables and results. Projects are of different content quality, the key problem is that the operational programme has not been precise and concentrated enough to call for targeted activities.

  10. STRATEGIC CALLCHALLENGES Ensure project quality:  Offer possibility to improve applications with potential; • 2-step selection procedure; • Conditions / Recommendations. Ensure fair assessment: • Grid of criteria.

  11. STRATEGIC CALLASSESSMENT: SELECTION PROCEDURE for the 1st call 1 phase including a draft proposal – 11 months. Launch (1 month) Submission of Drafts (4 months) Applications (5 months) Selection. 35 Draft proposals for the two objectives (Renewable energies and maritime safety). 12 final applications submitted – 3 projects programmed in 2011. Evaluation with 4 Project Officers: • Evaluation grid adapted to Strategic Projects; • Seminar with Lead Partners in draft proposal phase; • Complementary opinions from external expert. Two meetings of Selection Committee.

  12. STRATEGIC CALLASSESSMENT: CONTENT EXPECTATIONS TO STRATEGIC PROJECTS • Coherence with MED Programme and Terms of reference; • Need-based approach; • Realism / feasibility of objectives; • Connection with existing public policies; • Innovative approach / added value; • Coherence of the partnership to reach the objectives of the project; • Impact of the project / long term perspectives; • (Perspective North / South).

  13. STRATEGIC CALLRESULTS: EVALUATION OF THE 1ST CALL FOR STRATEGIC PROJECTS The methodology ,with built-in exchange with the applicants and a Terms of Reference, was succesful in: - reducing the amount of proposals; - focusing better the contents. The call for Maritime Safety projects was not fruitful, none of the 5 eligible proposals was selected: the call was relaunched. The choice of the priority/objectives of the 1st call: topics that did not receive enough proposals or they were of insufficient quality. The question on the relevance of programme priorities to key stakeholders must be raised if the call for Strategic project does not bring quality proposals.

  14. Limited range of priorities.Even more focused Terms of Reference: limits of the ‘top down’ approach?Quality follow up: beyond administrative management.Exchanges between the programme (JTS and MC) and projects in the application phase: - conditioned by the amount of proposals received;- conflict of interest if evaluators participate in project development?More added value to the money spent.Complementarity of transnational projects with cross-border and regional programming?How to attract new structures with no experience on ETC projects, but a content potential? STRATEGIC CALLRESULTS:HOW CAN WE IMPROVE?

  15. Programming: Preparing the OP with a strategic approach on the cooperation space; Few priorities but with an integrated approach; Pilot projects shared with regional programmes; Capitalisation and clusterisation in-built in projects since the beginning.Management and implementation: External expertise in evaluating project proposals; Different roles to new and to more experimented partners in a project; JTS composed of management and content units. FUTURE PERSPECTIVES?

  16. THANK YOU FOR YOUR ATTENTION! Joint Technical Secretariat MED PROGRAMME stc-med@regionpaca.fr www.programmemed.eu

More Related