The impact of classroom evaluation practices on students. Impact evaluation figures among a broad range of complementary methods that support evidencebased policy. How to evaluate the programme world health organization. The current document represents the first step in this endeavor. The impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. Needs assessment process evaluation impact evaluation to address the low literacy levels, the government will deliver free text books to schools to improve passing rates and increase employment prospects of school leavers. Materials also include powerpoint presentations related to the chapters, an online. The approach to impact evaluation in this book is largely intuitive, and we. Impact investment portfolios are generating a growing set of impact data and investors are increasingly looking to move from basic impact reporting frameworks to impact assessment that creates value for management. Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate.
Patchin curtis mark carey c o m m i t t e e o f s p o n s o r i n g o r g a n i z a t i o n s o f t h e t r e a d w a y c o m m i s s i o n. He conducts analytical and operational work on social protection and safety nets. How social work practitioners evaluate their practice. Quantitative methods and practices makes a valu able contribution in this area by providing, for policy and research audiences, a com. References centers for disease control and prevention. An impact evaluation assesses the extent to which a program has caused desired. Core elements of a welldesigned impact evaluation 320. The information you collect allows you to better communicate your programs impact to others, which is critical for public relations, staff morale, and attracting and retaining support from current and potential funders. The electronic version allows communities of practice and colleagues working in sectors and regions, as well as students and teachers, to share notes and related materials for an enhanced, multimedia learning and knowledgeexchange experience. New techniques and technology resultsbased agenda including mdgs impact evaluation at the world bank as with all evaluation, much work takes place outside of oed for impact there is a new initiative dime promoting greater use of impact evaluation.
The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. Stake holders who use monitoring and evaluation can be found both within governments and outside. It also provides a number of tools and approaches for conducting impact evaluations. Quantitative and qualitative methods in impact evaluation. Finding adequate sources of data 291 kinds of data that are needed 291 using existing quantitative data 294 collecting new survey data 299 chapter 17. Types of evaluation centers for disease control and. Asian development bank impact evaluation of development. Evaluations can be internal, conducted by project staff, or contracted out to external organizations.
Impact evaluation can attract some of the worlds leading economic talent to engage with specific development projects. Impact evaluation using quasiexperimental design impact evaluation workshop rome june 16, 2011 mead over, senior fellow center for global developmen washington, dc. Impact evaluations should be focused around answering a small number of highlevel key evaluation questions keqs that will be answered through a combination of evidence. Planning an outcomeimpact evaluation new partners initiative technical assistance nupita project june 2011. The power of an effective teacher and why we should assess it. This goes beyond looking only at goals and objectives to also examine unintended impacts. The proper analysis of impact requires a counterfactual of what those outcomes would have been in the. Keeping checks and balances in place allows one to be accountable to the people served and to themselves as a professional. These questions should be clearly linked to the evaluative criteria. Explains that the differenceindifferences dd method compares the changes in outcomes over time between a population enrolled in a program the treatment group and a population not enrolled the comparison group. The impact of the full range of development interventions can be assessed projects, programmes, sector wide support and donor country strategies and macro economic growth and programme aid support using qualitative or quantitative approaches or a mix. Using an experimental or quasiexperimental design to demonstrate a change or not is the most powerful programme evaluation for detecting changes in outcome. The book incorporates realworld examples to present practical guidelines for designing and implementing evaluations.
Impact evaluation impact is sometimes used synonymous to outcome impact is perhaps better. Definition evaluation is a process of making judgements to be used as a basis for planning. Although the focus here is on impact evaluation, assessment of the programs impacts should be accompanied by the collection of. Impact evaluation is an assessment of how the intervention being evaluated affects outcomes. Curriculum evaluation is a method for determining the worth and effectiveness of any newly implemented curriculum.
An impact evaluation approach which unpacks an initiatives theory of change, provides a framework to collect data on immediate, basic changes that lead to longer, more transformative change, and allows for the plausible assessment of the initiatives contribution to results via boundary partners. There are several types of evaluations that can be conducted. Matching against different key evaluation questions. Performance audit the actual practice of pa include. Clinical evaluation tools the michigan center for nursing. The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and. The new partners initiative technical assistance nupita project is funded by the united states agency for international development usaid and implemented by john snow, inc. In the example of the microfinance project, an outcome might be the wages paid to employees of the enterprise, so enterprise workers are the unit of analysis. In other words, an impact evaluation measures not only whether there was an effect on beneficiaries, but whether or not that impact can be attributed to the program. The conclusions derived from the individual fields are then merged to produce an integrated summary with clear implications for effective educational practice. Although this book focuses on quantitative impact evaluation methods, it begins by placing them in the broader results context, which also includes. Powerpoint presentation at the annual meeting of the american evaluation association, honolulu, hi. Clarifying the terminology 7 4 utilising quantitative and qualitative approaches in impact evaluation 11.
Impact and outcome evaluations may be carried out using a variety of quantitative methods. Could lead to policy decisions to eliminate the program, which would be detrimental to beneficiaries and society an impact evaluation. Gertler pj, martinez s, premand p, rawlings lb, vermeersch cmj. Impact evaluation provides information about the impacts produced by an intervention. Has had different meanings sector or countrywide evaluation longrun effects establishing the counterfactual focus on final welfare outcomes oed adopt a combination of the last two. Introduction to program evaluation for public health programs. Impact evaluation in practice second edition world bank group. Impact evaluation in practice english the world bank.
Defining the key evaluation questions keqs the impact evaluation should address. This allows for correction for any differences between the treatment and comparison groups that remain constant over time. Different impact evaluation methodologies differ in how they construct the counterfactual counterfactual. The national science foundation, european commission which administers horizon 2020, the uk governments funding bodies like epsrc, esrc etc. An impact evaluation relies on rigorous methods to determine the changes in outcomes which can be attributed to a specific intervention based on causeandeffect analysis.
Many approaches for assessing practice exist, but as. It can be undertaken of a programme or a policy, or upstream work such as capacity building, policy advocacy and support for an enabling environment. A research based model for designing and evaluating the impact of youth development programs. This is the second edition of the impact evaluation in practice handbook. Patrick premand is a senior economist in the social protection and labor global practice at the world bank. The new pep training package impact evaluation using stata presents a series of examples illustrating the. A group of individuals not participating in the program or receiving the intervention necessary to determine if the program, rather than some. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. This particular document aims to serve as a complement to an interactive textbook, entitled impact evaluation in practice, published by the world bank in 2011 to provide an accessible introduction to the topic of impact evaluation and its practice in development. The risk of failing to conclude that your program has an impact even when it does. The primary conclusion is that classroom evaluation has powerful direct and indirect impacts, which may be positive or negative, and thus deserves very thoughtful planning and.
Templates, examples, bibliography program development. In fact, most authors identify the fundamental purposes of teacher evaluation as improving performance and documenting accountability. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented. Clinical evaluation tools opening ppt 61 introduce yourself, your role, and share some background information on your expertise with clinical evaluation. May include a comparison group impact evaluation what is a comparison or control group. Impact evaluation is an assessment of how the intervention being evaluated affects outcomes, whether these effects are intended or unintended. Impact evaluations need to account for the counterfactual what would have occurred without the intervention through the use of an experimental or quasiexperimental design using. An impact evaluation can be undertaken to improve or reorient an intervention i. She serves on the policy subcommittee of the icn advanced practice nursing network. First published in 2011, it has been used widely across the. Evaluation of practice is important because it is a way one can increase the effectiveness of their work. Impact to what extent is it likely that the desired practice change will lead to improvement in the state eg less poverty.
1195 1063 814 1313 341 817 1553 718 1333 54 970 768 385 418 736 188 1341 1519 516 303 474 11 106 1266 403 17 967 270 401 291 492 563 851 1060 1188 519