At cdc, program evaluation supports our agency priorities. An introduction to practice welcome to the companion site. Program evaluation and performance measurement at the epa. Program evaluation is an essential organizational practice in public health. Hawthorn discuss topics in a detailed fashion, making it a useful guide for practitioners who are constructing and implementing performance measurement. The stakes are high, so performance measures should be meaningful and help tell the story of how well an effort e. Key evaluation questions to be answered, potential available data sources, and feasibility of collecting available data required performance measures how evaluation and performance measurement will track subpopulations how evaluation findings and performance measures. Typically, performance measurement data are collected with some frequency and immediacy. What are performance measurement and program evaluation. Evaluation tells the program s effect on the people, families, or communities it is serving, that is, whether a program is producing results or having an impact box 2. Program evaluation and performance measurement offers a conceptual and practical introduction to program evaluation and performance measurement for public and nonprofit organizations. Performance measurement and evaluation definitions and relationships may 2011 gao gao11646sp both the executive branch and congressional committees need evaluative information to help them make decisions about the programs they overseeinformation that tells them whether, and why, a program is working well or not. Performance measurement provides the data you will use to measure your program s results.
Integrating program evaluation and performance measurement evaluation as a field has been transformed in the past 20 years by the broadbased movement in public and nonprofit organizations to construct and implement systems that measure program and organizational performance. Using indicators for program planning and evaluation cdcpdf. Performance measures that focus on outputs measure the products and services provided as a direct result of program activities like the number of technical assistance requests respondedto or the number of technical assistance guides developed. Program evaluation and performance monitoring family health. Performance measurement is an ongoing process that monitors and reports on a programs progress and accomplishments by using preselected performance measures. Identify components of your program to include in performance measurement identify indicators and the measures of progress performance that align with program components. Prc program indicators cdcpdf collects quantitative data that can be summarized across prcs and over time, provides information on the program s depth and scope. Chapter 2 describes some of the unique attributes of public health that influence the design and implementation of a performance measurement process in this field of work. Evaluating program performance is a key part of the federal governments strategy to manage for results. The evaluation process described below is designed to give you good information on your program and what it is doing for students, clients, the community and society. The program cycle design, implementation and evaluation fits into the broader cycle of the governments expenditure management system. Understand what a performance measurement system can and cannot dodiscover patterns, make.
Plans set out objectives and criteria for success, while performance reports assess what has been. Performance measurement has evolved from purely financial performance measures such as profit, cash flow or the return on capital employed roce. Performance measurement purposes 317 metaphors that support and sustain performance measurement 318 organizations as machines 319 government as a business 319 organizations as open systems 320 a note on complexity 321 comparing program evaluation and performance measurement 322 summary 331 discussion questions 332 references 333 9. Values repeated measurement of outcomes at appropriate intervals.
As ora intends to update this list periodically, we welcome suggestions of other resourcese. Performance measurement systems can be thought of as both evaluation tools and management systems that are designed to provide useful feedback on performance in order to strengthen decision making and improve program and organizational performance. Program evaluation and improvement occupational safety. Evaluations of rba have found it easy to understand and follow, highly motivating, and very effective in a. Program evaluation and performance measurement 3rd ed. Second edition program evaluation and performance measurement. Using examples, it covers topics in a detailed fashion. Develop logic models for the program for which performance measures are needed. Toward these ends, opre is happy to present an updated edition of.
Program evaluation and performance measurement does not assume a thorough understanding of research methods and design, instead guides the reader through a systematic introduction to these topics. What is evaluation one main goal of program evaluation is. Definitions for performance measurement vary, but practitioners are converging on a common understanding. Performance measurement to evaluation urban institute. Performance evaluation is a handson text for practitioners, researchers, educators, and students in how to use scientificallybased evaluations that are both rigorous and flexible. It takes students clearly and methodically through the steps needed to set up performance measurement systems, and to conduct evaluations.
The following list, while not exhaustive, offers information and practices supporting program evaluation and performance measurement in the arts. The authors cover the performance management cycle in organizations, which includes. Hawthorn john wanna the australian national university and. Measuring and tracking provide the data for analyses necessary for management to make informed decisions for the current fiscal year as well as future plans and budgets. Reporting is the documentation and sharing of performance.
From its inception, the miechv program has adopted a learning agenda approach that focuses research and evaluation efforts on improving program effectiveness and building the knowledge base. Selecting key performance measures to be reported to external customers, stakeholders, and policy makers. Eda performance measurement and program evaluation u. Measuring performance is often accompanied by requirements to publicly report performance results for programs.
An introduction to practice is a very useful handbook for students of social welfare, who are most likely to take up work in public and nonprofit agencies. Performance measurement is the process of collecting, analyzing, and reporting information regarding the performance of an individual, group, organization, system, or component. Author ingrid guerralopez, an internationallyknown evaluation expert, introduces the foundations of evaluation and presents the most applicable models for the performance improvement field. This site is intended to enhance your use of program evaluation and performance management, 3 rd edition, by james c. Design and implementation of performance measurement systems 337 introduction 339 key steps in designing and implementing a performance measurement system 341 identify the organizational champions of this change 342. Effective program evaluation is a carefully planned and systematic approach to documenting the nature and results of program implementation. Using the assessments in this guide, districts can incorporate performance measurement and monitoring for business processes that support academic achievement. Pdf program evaluation and performance measurement. Performance measurement to evaluation sponsored by the world bank group community outreach program.
Comparing program evaluation and performance measurement 322 summary 331 discussion questions 332 references 333 9. Program evaluation and performance measurement does not assume a thorough understanding of research methods. That is, performance measurement data, to best improve program performance, are collected and assessed while participants are being served, rather than only after a program cycle. Programs need to show effectiveness to justify funding. Participatory approaches, in particular, can help to build capacity. Helping to understand the relationship between activities and results. Guidebook for performance measurement public health. Accordingly, performance management helps to set agreedupon performance goals, allocates and prioritizes resources, confirms or changes current policy or program direction to meet established goals, and.
Virtually all industry segments were represented, including employers, health plans, program providers, academic research centers, and certification agencies. Hawthorn discuss topics in a detailed fashion, making it a useful guide for practitioners who are constructing and. Performance measurement and program evaluation share similarities but serve different purposes. Today there is greater emphasis on nonfinancial and multidimensional performance measures to understand and manage the performance of the organisation to achieve its goals. Is the measure compatible with other performance measures. Started in the 1950s, this approach gained popularity with the outcomes by objectives and performance management movements. Guide to performance measurement and program evaluation prepare goals and objectives, identify performance measures and program outcomes, identify evaluation questions, create a program planning or logic model, select evaluation design, decide on data collection methods, analyze and present data, use evaluation data. The program management process is the overall, generic process that helps to. Feature evaluation performance measurement steps in building capacity to conduct performance measurement and evaluation develop. Performance measurement provides the data you will use to measure your programs results. Performance measurement is generally defined as regular measurement of outcomes and results, which generates reliable data on the effectiveness and efficiency of programs. A focus on qualitative and quantitative program evaluations and needs assessments, as well as constructing and implementing performance measurement systems, offers a balanced perspective.
Outcome means a change, or lack of change, in the health of a defined population that is related to a public health intervention such as the tests, investigations, or educational services you offered as part of your process, above. Implementation monitoring and reporting of program accomplishments and progress indepth research activity that assesses whether the program works as expected time focus ongoing conducted periodically or on an adhoc basis cause and effect demonstrates if a change occurred, but not why. An introduction to practice, second edition offers an accessible, practical introduction to program evaluation and performance measurement for public and nonprofit organizations, and has been extensively updated since the first edition. Resources human resources, employee time, funding used to conduct activities and provide services. As employed and understood in edas performance measurement and program evaluation methods economic development. Chapters 1, 2 logic modelling, 3 research designs, 4 measurement, and 5 qualitative methods serve as foundations for both program evaluation and performance measurement. Introduction to performance measurement ohio school districts regularly measure academic performance and track other educationoriented indicators or performance measures. Performance measurement and program evaluation different focus performance measurement focuses on whether a program has achieved its objectives, expressed as measurable performance standards.
This document describes and explains the relationships among common types of systematic program assessments. Using examples, it covers topics in a detailed fashion, making it a useful guide for students as. Handbook of practi cal program evaluation handbook of. Generating data on program results not regularly collected or available through other means.
An introduction to practice, second edition offers an accessible, practical introduction to program evaluation and performance measurement for public and nonprofit organizations, and. Both program evaluation and performance measurement are increasingly seen as ways of contributing information that informs performance management decisions. Theory of change, logic model, and performance measurement. Performance measurement and management program guide.
Performance measurement tells what a program did and how well it did it. Essentially, performance measurement analyzes the success of a work group, program, or organizations efforts by comparing data on what actually happened to what was planned or intended 1. Program evaluation and performance measurement integrates performance measurement into evaluation practice and shows how the skills that are essential for building program evaluation expertise are also important foundations for performance measurement. Program evaluation and performance measurement sage. In february 2011, the council released a standard set of ten performance measures for counties and ten performance measures for cities that will aid residents, taxpayers, and state and local elected officials in determining the efficacy of counties and cities in providing services and measure residents. Performance evaluation can be classified into performance modeling and performance measurement, as illustrated in table 1. Aug 10, 2015 performance measurement systems can be thought of as both evaluation tools and management systems that are designed to provide useful feedback on performance in order to strengthen decision making and improve program and organizational performance. Best practices in performance measurement in government part 1. Program evaluation is a process of collecting information that will help identify how.
Later, performance measurement is done after the product is available in order to understand the performance of the actual system to various real world workloads and to identify modifications to incorporate in future designs. Effective program evaluation is a systematic way to improve and account for public health actions by involving procedures that are useful, feasible, ethical, and accurate. Program evaluations typically examine a broader range of information on program performance and its context than is feasible to monitor on an ongoing basis. Identify the organizational champions of change sustained leadership. As teachers become more familiar with datadriven instruction, they are making decisions about what and how they teach based on the information gathered from their students. What are the benefits performance measurement and evaluation are powerful tools to improve management and decision making at all levels. Chapter 3 offers seven good reasons for conducting performance measurement, no matter what field youre. Relationship between performance measurement and program evaluation different use process or implementation evaluation. Nor does the book assume a knowledge of statistics, although there are some sections that do outline the role that statistics play in evaluations. Key concepts and issues in program evaluation and performance measurement introduction a typical program evaluation. Program evaluation and performance measurement complement each other in. An outcome is not what the program actually produced itself the output, but the consequences of those products, services, or assistance.
It is a practical, nonprescriptive tool, designed to. The program assessment rating tool part was developed to assess and improve program performance so that the federal government can achieve better results. An early leader was william edwards deming, who developed an. During the process of gathering information, the words measurement, assessment and evaluation are often used interchangeably. Performance measurement is necessary, but not sufficient, for evaluation. Performance measurement is an ongoing process that monitors and reports on a program s progress and accomplishments by using preselected performance measures. Eda collects and reports on performance measures in compliance with government performance and results act of 1993 that, as amended by the gpra modernization act of 2010, establishes requirements for all agencies to collect, analyze and report on their performance edas performance goals and specific performance metrics are tied to the u. A program evaluations typically more indepth examination of program performance and context allows for an overall assessment of whether the program works and identification of adjustments that may improve its results. Resources on program evaluation and performance measurement nea. After that, employers should periodically, and at least annually, step back and assess what is working and what is not, and whether the program is on track to achieve its goals. Program evaluation, however, uses measurement and analysis to answer specific questions about how well a program is achieving its outcomes and why. Evaluation tells the programs effect on the people, families, or communities it is serving, that is, whether a program is producing results or having an impact box 2. Performance management, which is sometimes called resultsbased management, has emerged as an organizational management approach that is part of a broad movement of new public. Planning the evaluation determining the evaluation questions.
Program evaluation 101 american evaluation association. The framework for evaluation in public health 1 guides public health professionals in their use of program evaluation. In addition to the program monitoring and improvement efforts related to performance measurement and cqi, miechv promotes rigorous evaluation at the. Dual coverage demonstrates how program evaluation and performance measurement are complementary ways of supporting evidencebased management and decision making. Create a flyer for program evaluation and performance.
We introduce the performance management cycle and show how program evaluation and performance measurement fit resultsbased management systems. In 2010, the legislature created the council on local results and innovation. Our expertise in performance measurement also allows us to respond to the growing demand for the evaluation of performancebased incentive systems related to the delivery of public. Program evaluation, performance measurement, and data collection. Refers to the use of performance measurement information to effect positive change in organizational culture, systems, and processes. Key steps 12 steps for designing and implementing a performance measurement system 1. Developing performance measures developing performance measures 1104 page 4 g. A partnership with a qualified individual or organization to assist in evaluating program forms, instruments, or procedures for collecting. Developing or improving measures of program performance. In the previous chapter we described how to develop outcome and process objectives, performance measures, an action plan and a timeline, and how to.
When programs conduct strong, practical evaluations on a routine basis, the findings are better positioned to inform their management and improve program effectiveness. Program evaluation includes performance measurement and tracking, analysis, and reporting of what is delivered. Program evaluation, performance measurement, and data. Program evaluation and improvement once a safety and health program is established, it should be evaluated initially to verify that it is being implemented as intended. Are used for continuous program quality improvement. Performance measurement handbook of practical program.