Analysis of Handbook of Practical Program Evaluation by Wholey, Hatry and Newcomer - Assignment Example

THE INTERNET & PUBLIC ADMINISTRATION Summery In these articles, the Joseph Wholey, Harry Hatry and Kathryn Newcomer have explored how educators, consultants, analysts and managers in public and private institutions can evaluate and assess program results and also recognize ways of improving the program performances. The articles offer a complete source in evaluation, which covers both performance monitoring and program evaluations. They also cover methods of evaluation that will be constructive in all private and governmental organizations. 2. Why did the authors conduct evaluation? Evaluation was conducted to help in planning evaluations that are used in improving the programs that have to be evaluated. Evaluation assessment is also essential in evaluating program designs, exploring the reality of programs, and in ensuring that programs meet the objectives and goals, there is a clear definition of priority information, the clients and evaluators concur with the intended utilization of evaluation info. Evaluation is also essential in determining the problems that occur in evaluability assessment (Joseph, Harry and Kathryn, 2007). Evaluation can be used in the life cycle of a program by assessing the feasibility and the need for the program, designing and planning for the program, implementing the program and improving the program. 3. The goals of the desired outcomes Evaluation is meant to measure performances of the programs, the ways that performance monitoring may support evaluation of a program and management of performance. Performance of a program is vital because it can help the evaluators identify the efficiency of the program; if the program is efficient it means the performance is commendable, but if the program is not efficient in its performance then it means the performance is not commendable. Another goal is determination of the program impact and provides a logic modeling. Logic modeling helps in communicating effectively with program stakeholders to create helpful program logic models and avoiding pitfalls in modeling. Evaluability assessment is used in improving of programs that are under evaluation. 4. Theory that connects the program to the goals The use of the theory of logic models (program theory), which has features such as resources, activities, outputs, customers and outcomes (Joseph, Harry and Kathryn, 2007). The resources include the financial and human resources that support the program such as partnerships. The information regarding the needs of the customer is a vital resource in the program. Activities in the logic model are the steps that are necessary in achieving the goal. The outputs are the services, goods or products that are offered to the program’s customers. The customers are a feature that has been dealt with, as well. The outcomes are the benefits or changes that result from outputs and activities. The main contextual issues that are external to the program may influence the success both negatively or positively. The program managers have an increasing interest in a constant improvement and quality management. Many managers do not know that collection and analysis of data and selecting what to measure is vital in improvement. Whereas tools such as system analysis, risk analysis and flowcharts are used in describing and planning programs, the logic models are more inclusive in addressing the rising needs of the outcomes. 5. Plausible explanations that were ruled out Before the program theory got popular, there existed evaluation models that portrayed programs in the same way. The stake theory represented a model that called for outcomes and transaction of a program. The model was used in clarificative evaluation when designing a program. Another theory was the Funnell’s logic model, which helped the managers in dealing with delivery of program questions by asking that risk would be defined by at different steps such that programs are responsive of factors outside and within the program’s control. Parson’s logic model was also ruled out. This model indicated systemic and system change and was considered as one of the logic models with modification. 6. How the program theory guided the authors in conducting evaluation The program theory is created in 5 stages, which include collection of pertinent information, description of the problem that will be solved by the program, definition of the elements of the model, drawing the program theory and verification of the model. In the first stage, which is collection of pertinent info, the model of building logic requires teamwork. When the evaluation function is external, the evaluator carries out the process of model creation. When the program manager works alone, there is a higher risk that others may not signify the essential parts. If the program is poorly defined or complex, it is recommended that a small group should conduct the initial analysis. The second stage involves a clear definition of the existing problem. The next stage is drawing of a logic model, which captures the logical linkages and flows that exist in the performance. The logical model is used in organizing the information, which enables the audience to evaluate and understand the program. 7. How the authors proposed to evaluate the program in terms of goals The final product is seen as a network that displays the interrelations between the main components of the expected performances of the program. The external issues that influence the program’s success may be put in the model. The external issues, which influence the program’s success, may also be included in the model. These are useful for people who are unfamiliar with the program and also for the staff and evaluators who use the model. It is advisable to begin with simple diagram forms to more complex ones. While the process of the logic model discloses, the workgroup that produces the model must evaluate it. The verification process must appoint suitable stakeholders in the process of review. The work group uses the diagram of logic model. At this point, the workgroup may address the critical info regarding performance, measurement plans and evaluation. 8. The principle research methods that the authors used Evaluability assessment, which is a form of market research that reviews the demand of info that may come from a number of evaluations and it helps in matching evaluation supply. While most of the steps in evaluability assessment are present in a number of evaluation design attempts, it is quite rare for the evaluators to conduct all the steps. While planning the evaluations, the evaluators start by recognizing the goals of the program, data sources and indicators of performances(Bickman, 2007).  Evaluability assessment may be considered as a form of market research that reviews the demand for info that may come from various evaluations. 9. The authors’ conclusions Program managers in public and private sectors are being asked to evaluate and describe their programs in better ways. People also want the managers to address a rational argument for why and how the program handles a particular customer’s requirements and how evaluation and measurement will improve the effectiveness of the program. Often managers lack logical and clear reliable methods that help them with the task. However, the evaluators do and they can get the tool to the managers to assist them in meeting new challenges (Rogers, 2000). The logic model illustrates the logical connections among customers, outputs, activities and program resources. When the model of expected outcome has been designed, areas of evaluation and critical monitoring can be recognized. Since the program stakeholders are responsible for developing the measurement plan and the logic model, the stories that they tell ought to be a vision of success. 10. Any unintended consequences There were no incidences of any unintended consequences that arose 11. Did the program achieve its goal? The program did achieve its goal as a whole because all the five steps of logic program were followed to the latter. The design of the program was constructed logically, which was complete, and it also captured what the stakeholders considered as accurate idea of the program. 12. The uses of the evaluation results The evaluation results are used to contrast and compare assumptions and expectations of those who have the most significant influence in the program. It is also used to compare the expectations with the program outcomes that are likely to take place. It is also used to determine if the performance of a program is likely to be obtained at a particular cost. 13. The recommendations made by the authors In evaluation planning, the evaluators have the key role of gathering data on expectations of reality operations of a program. Evaluability assessment assists program managers and evaluators in understanding the people who have the highest influence in the program. 14. Program theory applies to the article The program theory applies to the article because all of the authors seem to support the theory more than the other theories. References Joseph S. Wholey, Harry p. Hatry, and Kathryn E. Newcomer, Jossey-Bass (2007). Handbook of Practical Program Evaluation 2nd edition, New York: an Imprint of John Wiley & Sons, Inc. Bickman, L. (2007). Using program theory in evaluation. San Francisco: Jossey-Bass. Rogers, P. J. (2000). Program theory in evaluation: Challenges and opportunities. San Francisco, Calif: Jossey-Bass. Read More