This focus on outcomes is a welcome addition to the program evaluation textbook market, because. Outcome based evaluation brianna hoffman, project coordinator small libraries create smart spaces based on materials from imls, plas project outcome, and the research institute for public libraries ripl outcome based evaluation. Competency outcomebased needs analysis strategic the outcome based approach is strategically oriented in two ways. Evaluation is an important part of managing a successful program. Stakeholdersincluding program directors, community members, and funderswant to know if a particular program is working as expected and making a difference for its intended participants. Outcome based evaluation explained outcome based evaluation is as much about planning programs as it is evaluating them. Comparing process and outcome evaluations national council. Evaluation constitutes part of an ongoing cycle of. Outcome based evaluation asks the question how did my library program or service change the skills. Two common ways to assess a program are process evaluation and outcome evaluation. You can document individual change, often small and. March 2010 this information will be made available in alternative format upon request. Paying attention to these questions will help you shape your evaluation into a. Outcomebased evaluation new york state library nysed.
Guidelines for outcome evaluators 5 introduction this publication, guidelines for evaluators, is the first in the companion series to the handbook on monitoring and evaluating for results. Basic guide to outcomesbased evaluation for nonprofit. Evaluation results can be used to maintain or improve program quality and to ensure that future planning can be more evidence based. Outcomesbased assessment an introduction and guide. Program planning, implementation, and evaluation are all part s of the whole that is driven by an i n s t i t u t i o n s purpose and vision. By keeping these two in close association, training programs can be better targeted at improving competency levels and performance. Outcome based program development workshop manual i. Developing an outcomebased evaluation data collection tool. While the focus is on tesol contexts, the testing theories and methods are applicable across various. Outcome based education or outcomes based education obe is an educational theory that bases each part of an educational system around goals outcomes. Pdf an outcomebased evaluation of functional family.
Evaluation constitutes part of an ongoing cycle of program planning. It is recommended that individual service buyers shall tailoradd on specifications according to their needs and requirements. Five steps of outcomebased planning and evaluation for public libraries. The organized process of developing an outcomebased program and a logic model an evaluation plan helps institutions articulate and establish clear program benefits outcomes, identify ways to measure those. Objective based impact evaluation effectiveness is based on the extent to which objectives have been met objectives based impact evaluation involves judging the worth of a program on the basis of the extent to which its stated objectives have been achieved. Todays activity improved my medical knowledge from to 2.
Outcomebased evaluation is a tool that librarians can use. Use of outcome statements in local curriculum documents is therefore not a radical move. The successproducing hub, obebuilt classroom has a clear set of learning outcomes. Basic guide to program evaluation free, complete, online training programs that include this topic. Journal of adult education volume 40, number 2, 2011 a program evaluation model. Mar 29, 2007 outcome based evaluation is a way to measure organizational effectiveness that has special value for faith based service organizations. In fact, some people actually call it outcome based planning and evaluation. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it. Outcomebased evaluation brianna hoffman, project coordinator small libraries create smart spaces based on materials from imls, plas project outcome, and the research institute for public libraries ripl outcomebased evaluation.
The goal of this training is to build the capacity of substance abuse program staff and administrators to develop and utilize logic models for program planning and evaluation. Outcomes based evaluations using the logic model march 2002 page 2 introduction goal. It does not occur within a vacuum, but is part of the core p r ocess of project deve l o p m e n t. Curriculum practical application the workshop curriculum has been created specifically for grassroots faith based and community organizations that are providing services with limited resources such as fulltime staff, technology, and funding.
Based on the information collected, it is then necessary to define the aims of an evaluation, and to consider the different types of evaluation methods that. Mcneil abstract outcomesbased program evaluation is a systematic approach to identifying outcome indicators and measuring results against those indicators. Taken together, you and your research team should know why the evaluation is being. Because process evaluation allows a nonprofit to look at how it develops itself, its structures, its supporting programs like communications and marketing, and even fund development to get to the. While it might, implicitly or explicitly, reflect the influence of obe, it also. An evaluation is a purposeful, systematic, and careful collection and analysis of information used for the purpose of documenting the effectiveness and impact of programs, establishing. Pdf moving towards outcome based budgeting an integrated. Outcome based evaluation is as much about planning programs as it is evaluating them. Evaluation of outcome, page 1 evaluation of outcomebased learning in an undergraduate english language program wang lixun the hong kong institute of education abstract since 2008, outcomebased learning obl, a studentcentred strategy aiming to enhance the quality of teaching and learning, has been launched as a major initiative among. Outcome based evaluation basics institute of museum and.
Objectivebased impact evaluation effectiveness is based on the extent to which objectives have been met objectivesbased impact evaluation involves judging the worth of a program on the basis of the extent to which its stated objectives have been achieved. Guidelines for impact or outcome evaluation for projects funded by the unifem trust fund to eliminate violence against women produced for the gender and development group prem world bank by linde rachel april 2006 i. Paying attention to these questions will help you shape your evaluation into a more useful tool. Specific goals of a program are identified and the degree. In fact, some people actually call it outcome based planning and. There is no single specified style of teaching or assessment in obe. The agency specifies that the enduser or library patron is the intended beneficiary of programs and services. Planning an outcomeimpact evaluation new partners initiative technical assistance nupita project june 2011. Outcome evaluations measure how clients and their circumstances change, and whether the treatment experience has been a factor in causing this change. Objectivebased impact evaluation impact evaluation. In other words, outcome evaluations aim to assess treatment effectiveness. Improvements in my practice that i intend to make based on information learned during todays activity.
Comparing process and outcome evaluations national. Outcomebased evaluation, sometimes called outcomes measurement, is a systemic way to determine if a program has achieved its goals. An outcome evaluation 1450 energy park drive, suite 200 st. Explain the role of program evaluation and the facts that support it. Kellogg foundation is wellknown for the development and use of outcome based program and policy evaluation. Schalocks outcomebased evaluation continues this shift by providing a primer on out come evaluation, intended for both consumers and producers of program evaluations. An outcomebased evaluation of the university of michigan. Decision maker buyin at the start and continued involvement during the process is vital to the success of the procurement activity. This online basic guide about outcomes based evaluation was designed.
The reader would gain deeper understanding about outcomes based evaluation by reading about the broader topic of evaluation. The handbook provides an overall context for results based monitoring and evaluation and. Outcomebased evaluation is a way to measure organizational effectiveness that has special value for faithbased service organizations. It is important to be very clear about what you are evaluating, why you are evaluating, and for whom you are evaluating. Outcomebased evaluation is also a highly useful management tool. As our grantee or constituent, you connect to your audiences where learning happens. I have worked with many libraries across new york state in successfully implementing obe to plan and evaluate library programs and services. Using blooms taxonomy to identify outcome indicators in outcomesbased program evaluations rita c.
This online basic guide about outcomesbased evaluation was designed. I am an independent consultant and certified outcomebased evaluation or obe trainer. Guidelines for impact or outcome evaluation for projects funded by the unifem trust fund to eliminate violence against women produced for the gender and development group prem. I am an independent consultant and certified outcome. Assessment seeks to improve the quality of performance regardless of its current level, whereas evaluation measures. Guide on specifications for outcomebasedperformance based. It doesnt matter how much you try if you dont actually achieve the desired outcome. By the end of the educational experience, each student should have achieved the goal. Evaluation of outcome, page 1 evaluation of outcome based learning in an undergraduate english language program wang lixun the hong kong institute of education abstract since 2008, outcome based learning obl, a studentcentred strategy aiming to enhance the quality of teaching and learning, has been launched as a major initiative among. Define and give examples of formative and summative evaluation.
Glossary of key terms in evaluation and results based. Imls awards support key activities of libraries, museums, and related organizations and encourage leadership, innovation, and partnership. Evaluation results can be used to maintain or improve program quality and to ensure that future planning can be more evidencebased. This topic is also included in the free nonprofit microemba learning module, designing your program evaluation plans including outcomes based evaluations. This type of evaluation represents the foundation of evaluative practice itself.
Evaluation is a systematic process to understand what a program does and how well the program does it. March 2010 this information will be made available in. The reader would gain deeper understanding about outcomesbased evaluation by reading about the broader topic of evaluation. The handbook provides an overall context for resultsbased monitoring and evaluation and. True false outcomebased evaluation focuses on the ultimate goal of a program or treatment, generally measured in the health field by morbidity or mortality statistics in a population, vital measures.
Outcomes based evaluation is but one type of evaluation there are many types of evaluations. How to evaluate the programme world health organization. As outcomebased procurement is not a conventional off the shelf solution. Outcomebased program development workshop manual i. Provides an excellent discussion of different types of evaluation and a detailed explanation of outcome evaluation. But it is important to note that different organisations may use different definitions, and there may be little consistency between these different.
A guide for outofschool time practitioners part 4 in a series on practical evaluation methods tiffany allen, m. The new partners initiative technical assistance nupita project is funded by the united states agency for international development usaid and implemented by john snow, inc. Its not all about assigning a textbook, homework, quizzes, and an assortment of. Imls has responded to your need to know what difference our services make by developing a model of outcomesbased planning and evaluation as one foundation of our grant making. Do all of our 10th grade students create a skillsbased resume. Outcomesbased evaluation is but one type of evaluation there are many types of evaluations. English 504 development and evaluation of language tests introduces students to the fundamental principles and best practice of language testing. Outcome based goals vs process based goals goals for babits. Should goals be based around outcomes, or based around processes. The dac working party on aid evaluation wpev has developed this glossary of key terms in evaluation and resultsbased management because of the need to clarify concepts and to reduce the terminological confusion frequently encountered in these a reas. There are several types of evaluations that can be conducted. Understanding three primary components of this type of evaluation helps determineba programs effectiveness, and.
Outcome based evaluation basics the institute of museum and library services imls is dedicated to strengthening museum and library service throughout the nation. Curriculum practical application the workshop curriculum has been created specifically for grassroots faithbased and community organizations that are providing services with limited resources such as fulltime staff, technology, and funding. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented. Outcome based evaluation asks the question how did my. Imls is gradually strengthening information about outcome based evaluation in guidelines for its discretionary grant programs and its program for state library agencies, and is considering the benefit of making outcome based evaluation for funded programs a requirement at some future time. The table below shows the results chain using a set of definitions originally developed by oecd dac in 2002 oecd, 2010. Outcomebased evaluation brianna hoffman, project coordinator small libraries create smart spaces based on materials from imls, plas project outcome, and the research institute for public libraries ripl. Evaluation of outcomebased learning in an undergraduate. Faith based social service organizationsand stewardship. Competency outcome based needs analysis strategic the outcome based approach is strategically oriented in two ways. Program evaluation is essential to a wellperforming program and has often been misunder. Outcomebased education or outcomesbased education obe is an educational theory that bases each part of an educational system around goals outcomes. Right from recruitment through course evaluation, outcome based education to faculty management system, everything is done without flaw how is learning outcomes set in obe.
1388 115 1482 1093 560 653 869 63 380 1281 746 1536 684 332 513 216 1225 449 300 1408 1104 1090 1387 748 125 747 78 799 1152 325 146 261 978 1516 871 1603 1040 1082 914 1414 114 517 908 799 1392 916