Methodological Recommendations for Federal and Regional Program Development in Russia

1. Evaluation in methodological recommendations for the development of federal and regional programs and putting them into practice Aleksander Borovykh StrategyDirector Charitable Fund «DownsideUp»

2. Methodologicalguidance on development and implementation of thegovernmentprograms in theRussianFederationDecree № 582 oftheMinistryofEconomic Development asof September, 16 2016:“On approval of guidelines for the development and implementation of government programs of the Russian Federation” Government programs development is implemented based on the following principles: «setting up measurable implementation objectives for the government programs (final outcomes, i.e. status of the socio-economic development (status change), characterized by quantitative and/or qualitative indicators…, which reflects the benefits from the government program (subprograms) implementation and immediate results, i.e. indicators of volume and quality of the event focused on final result of the government program implementation (subprogram)…»

3. definition of theexpectedoutcomes of thegovernemntprogram Expectedoutcomes of the government program implementation are indicated as qualitative and quantitative characteristics of the basic expected (planned) final outcomes (changes reflecting the effect caused by the government program implementation) including description of specific completed events (facts, phenomena), allowing unambiguously assess the results of the government program implementation, as well as the values of indicators for the last year of the program implementation and their dynamics.

4. indicators of thegovernmentprograms The amount of theindicatorsissetupbased on theprinciples of necessity and sufficiencyto achieve the goals and objectives of the government program. At thelevel of thegovernmentprogram, theindicatorsfocused on achievingonlythe final outcomes of itsimplementationshouldbereflected. Establishedindicators of thegovernmentprogram's subprogram maycharacterizeboth immediate and final outcomes of itsimplementation, at the same time, theiramountcannotexceedmorethantwicetheamount of themainactivitiesimplementedwithinthe subprogram framework.

5. indicators of thegovernmentprograms The indicator system of the government program (subprogram) should allow to clearly assess the progress in achieving all the goals and objectives of the government program (subprogram).

6. indicators should meet the following requirements: • Adequacy • Accuracy • Objectiveness • Comparability • Unambiguity • Cost effectiveness • Credibility • Timelinessandcoherence

7. governmentprogram (subprograms) indicatorshavetoinclude: • indicators, characterizing quantitatively the process of the program implementation, achievement of its main objectives and goals; • indicators, which reflect the quality of the most mass and socially significant public services provided by the federal executive bodies, as well as the main indicators of the state task in terms of quality and volume of the services provided.

8. Conceptofearlyinterventiondevelopment in theRussianFederationfortheperiodtill 2020 DecreeoftheGovernmentoftheRussianFederationasof August, 31 2016, No 1839-p

9. CONCEPT OF EARLY INTERVENTION DEVELOPMENT Priorityareasofactivity on addressingtheindicatedobjectivesare: • ensuring continuous professional development of specialists providing early intervention services; • ensuringearlyinterventionservicequalitymanagementandcreationofperformanceevaluationcriteriaoftheservicesprovided; • organizationofmonitoringoftheprovisionoftheearlyassistancetochildrenofthetargetgroupandtheirfamilies.

10. CONCEPT OF EARLY INTERVENTION DEVELOPMENT Creationofthe legislative basisforearlyinterventionpresupposes: • Development of official statistical reporting indicators characterizing the level of development of early intervention in the Russian Federation. Creation of conditions for the timely commencement of early intervention includes: • development of key indicators for the quality of early intervention and statistical indicators of its efficiency

11. CONCEPT OF EARLY INTERVENTION DEVELOPMENT Enabling environment for quality management of early intervention services and determining the criteria for performance evaluation of these services includes: • management of the program of early intervention ensuring its sustainability, development, high quality, methodological and organizational integrity;

12. CONCEPT OF EARLY INTERVENTION DEVELOPMENT Developing early intervention in the regions, taking into account this Concept, provides for: • introductionofthemonitoringandperformanceevaluationsystems, allowingto manage thequalityofearlyinterventionservices; • development of the criteria for the effectiveness of early intervention services and criteria for the completion of an individual program of early intervention, exit from the program of early intervention.

13. “Guidelines for creation of programs and a plan for the development of early intervention in the constituent entity of the Russian Federation” (approved by the Ministry of Labor of Russia, April 2018). http://legalacts.ru/doc/metodicheskie-rekomendatsii-po-sozdaniiu-programm-i-plana-razvitija-rannei/#100102

14. 1.3. Principles of creation of the system of early intervention in the region (constituent entity) of the Russian Federation: 1.3.6. Existence of a quality management system for the provision of early intervention services, including presence of clients’ feedback mechanisms and independent quality assessment of the early intervention services. 1.11. Monitoring and evaluation of the effectiveness of the implementation of the Early Intervention Program in the region of the Russian Federation. 1.11.1 Mechanisms and instruments of the monitoring and evaluation of the implementation efficiency of the Early Intervention Program in the region of the Russian Federation. 1.11.2 Implementation effectiveness indicators of the Early Intervention Program in the region of the Russian Federation (Annex 1).

15. creation of programs and development plans for early intervention in the region of Russian Federation 1.11.3. Annual implementation report on the realization of the Early Intervention Program in the region (constituent entity) of the Russian Federation, presented at the session of the Coordination body of the supreme executive authority of the region of the Russian Federation. 2. Implementation plan of the Early Intervention Program development in the region of the RF. 2.2. Early Intervention Program development activities. 2.2.6. Design and introduction of the independent quality evaluation mechanisms of the early intervention services and beneficiary’s feedback.

16. Annex1 RECOMMENDED SOURCES OF INFORMATION FOR DETERMINING INDICATORS OF THE EARLY INTERVENTION PROGRAM PEFORMANCE IN THE CONSTITUENT ENTITY OF THE RUSSIAN FEDERATION

17. DEFINING INDICATORS FOR ASSESSING EFFECTIVENESS OF THE EARLY INTERVENTION PROGRAM 1. Data on theexistenceofthechildrenearlydetectionsystemanditsdescription. 2. Results of monitoring the need for early intervention services.3. Percentage of children for whom an individual program of early intervention is designed, receiving early help in natural situations by their parents.

18. DEFINING INDICATORS FOR ASSESSING EFFECTIVENESS OF THE EARLY INTERVENTION PROGRAM 4. Percentageofchildrenobtainingservices in theframeworkofthe individual programofearlyintervention, bywhomthedecreaseofthedegreeofdisability was registered duringthecurrentyear. 5. Outcomes oftheearlyinterventionservicesassessmentreceivedbytheadults, raising a child (biologicalorfosterparents, caregivers, other relatives). 6. Challengesofthe Early Intervention Programfunctioning in theregionoftheRussianFederation.

19. Examples of thegoals, objectives and indicatorsfrompractice of thegovernmentprograms

20. Conceptgoaloftheearly Intervention The purpose of this Concept is to develop the basic principles and guidelines for creating conditions for the early intervention services provision on an interdepartmental basis, ensuring early detection of health issues and disabilities, optimal development and adaptation of children, integration of a family and a child into society, prevention or reduction of severity of disability, strengthening physical and mental health,

21. ObjectivesoftheearlyinterventionConcept (examples) • development of the legal and methodological framework guidelines and regulations for early intervention, taking into account best domestic and foreign practices; • transition from private models of early intervention organizing in certain regions to creating a unified system of early intervention, taking into account regional aspects; • Creation of theenvironment for earlyinterventionprograms in theregions of theRussianFederation.

22. priority areas of activity to address these objectives are (examples): • creation of the legal framework for early intervention services; • methodological support for the creation and operation of early intervention programs; • improvement of mechanisms for the timely detection of the children in need of early intervention, and the definition of the criteria for their inclusion in the program of early intervention; • ensuring the territorial and financial accessibility of early intervention services for children of the target group and their families; • ensuring that children in the target group and their families have access to the full range of early intervention services required;

23. model methodology for assessing the quality and effectiveness of early intervention services for children and their families • Indicator 1 – availability of a coordination system for development of early intervention in the region (constituent entity) of the Russian Federation. • Indicator values ​​and evaluation criteria: availability of downloadable current open documents (posted on the official web-resources of the executive authorities of the constituent entity of the Russian Federation, a specialized Internet resource to support the development of early assistance to children and their families in the Russian Federation)on creation, composition and operations of the interdepartmental Coordinating Body for the development of the Early Intervention Program in theregion (constituententity) oftheRussianFederation, …….

24. assessment of effectiveness of early intervention services includes using the following indicators: • Indicator 12. Percentage of children who demonstrate a decrease in the severity of activity limitations by target categories in accordance with the “International Classification of Functioning, Disability and Health” and (or) an increase in involvement in natural life situations in the process of implementing the IEIP (Individual Early Intervention Program) in the total number of children receiving early intervention services under the IEIP.

25. assessment of effectiveness of early intervention services includes the use of the following indicators: • Indicator 13. Percentage of families that noted the positive impact of the IEIP on any aspect of family functioning (e.g., the understanding of the child's characteristics by family members, their ability to contribute to a child's development, the quality of their relationships and interactions with the child and in the family as a whole, the adaptation of the family, the expansion of positive social interaction between the family and society) in the total number of families involved in the implementation of the IEIP. • Indicator 14. Proportion of children enrolled in educational institutions upon completion of the IEIP in the total number of children who completed the early intervention program in the current year.

26. examples of indicators for monitoring the effectiveness of activities carried out in the framework of the decade of childhood • Improvementofthe well-beingoffamilieswithchildren Share oflowincomehouseholdswithchildrenundertheageof 16 (18) in the total numberofthelowincomehouseholds • Modern childhood infrastructure Percentage of children aged 3-6 years who are placed on the waiting list for a place in a preschool educational organization (as a percentage of the total number of children of the corresponding age who do not attend preschool educational organization)

27. examples of indicators for monitoring effectiveness of activities carried out in the framework of the decade of childhood • Ensuring children's safety Number of children subjected to violence (abuse) in organizations for orphans and children deprived of parental care during the year. • Comprehensive education for children Number of competitions and other intellectual and (or) creative competitions, events aimed at the development of intellectual and creative abilities, abilities to engage in physical education and sports, interest in scientific (research) activities, etc.

28. examples of indicators for monitoring effectiveness of activities carried out in the framework of the decade of childhood • Safe informationspaceforchildren Number of convictions for distribution of extremist materials online. • Child andhisrighttofamily Proportion of orphans and children without parental care in foster care in the total number of orphans and children without parental care.

29. Vision oftheDownsideUp Impact on theimprovementofthelifequalityofpeoplewith DS Examplefrompracticeof «DownsideUp» CF Staff, foundersofDownsideUp, families, peoplewith DS, professionals, donors Findingsandrecommendationsregardingefficiencyandsocialimpactoftheprogrammes Monitoring & evaluation People with DS andtheirfamiliessupportprogramandspecialprojects Programmes andprojectsofthefund Families, peoplewith DS, professionals Findings on theneedsofthefamilies, expertsandpeoplewith DS Surveys oftheparticularneedsofthebeneficiaries StrategyoftheCharitable Fund «DownsideUp» Mission andstrategicgoals Experts, officials, NGOs, schools, etc. Rawandsecondarydata Case studyandexternaldataanalysis

30. Examplefrompracticeof «DownsideUp» CF

31. Examplefrompracticeof «DownsideUp» CF

32. Thankyou! Charitable Fund «DownsideUp» +7 (499) 367-10-00 www.downsideup.org