In the modern days, accountability in the government and nongovernmental human service organizations has become a critical issue. In this respect, performance measurement has emerged as an important tool for ensuring performance accountability (Rossi, Freeman, & Lipsey, 2004). There are various ways of measuring performance accountability (Martin & Kettner, 2010). In this paper, the author will discuss the concept of outcome measures in relation to a given situation. The scenario in question is, “it is possible to think of an on-line class as a social program with student learning as the outcome of interest.” The focus of the paper will be on the aspect of public evaluation while considering what was involved while evaluating the impact on the class.
What are some possible outcome measures that you could use to investigate the impact of the class?
As noted earlier, there are various outcome measures that can be used in the investigation of an impact. This includes the numeric counts, standardized measures, level of functioning scales, and client satisfaction, among others (Martin & Kettner, 2010). Therefore, these are some of the outcome measures that can be used in investigating the impact of a class. It should be noted that any measured value is comprised of two aspects. These are the true value and a certain amount of measurement error. The amount of measurement error has a direct impact on the true value. In this case, the value is regarded as more accurate when the measurement error is limited. There are two forms of measurement errors, including systematic and random errors. These two measurement errors have an impact on the validity and reliability of the measurement being taken (Chapter 6, n.d).
How would you assess the reliability of these measures?
Reliability of the outcome measure should be guaranteed to enhance the evaluation process. In assessing the reliability of the measurement outcomes, it is necessary to ensure that the outcome measure can produce similar results provided that no real change has happened (Chapter 6, n.d).
How would you assess the validity of these measures?
On the other hand, the validity of the measures is also critical. In assessing the validity of the outcome measures, it is essential to ensure that the measures are able to capture the phenomenon in a comprehensive manner. Both reliability and validity are crucial aspects of an outcome measure (Chapter 6, n.d).
Assuming that you could use the best possible design of those that are feasible, assess the generalizability and reproducibility of the results?
In the evaluation of the measurement outcome with respect to the on-line social class, it can be noted that the reproduction and generalization of the results of this study are possible. This is because the Internet has permeated all aspects of society, and many people are fast adopting the new opportunities that come with the Internet. The results from the outcome measure are critical, given that the best design is being adopted hence enhancing the reliability and validity of the result (Rossi, Freeman, & Lipsey, 2004).
What are the two most important characteristics of a good outcome measure?
The two most notable characteristics of a satisfactory outcome measure are validity and reliability. Validity can be described as the ability of an outcome measure to capture what it is intended for without failure. On the other hand, reliability can be described as the ability of an outcome measure to lead to similar results every time it is used, provided that no change happens to the phenomenon being measured. These two aspects form the core of the outcome measure (Martin & Kettner, 2010; Chapter 6, nod).
What are the three contributing factors to the gross outcomes of a program?
The three contributing factors to the gross outcomes of a program include “expertise, time and resources” (Rossi, Freeman, & Lipsey, 2004, p 59). These aspects affect the impact assessment procedure. In this respect, they are critical in the program operation.
References
Chapter 6: Measuring outcomes. (n.d). Web.
Martin, L. L. & Kettner, P. M. (2010). Measuring the performance of human service programs. Los Angeles: Sage.
Rossi, P. H., Freeman, H. E. & Lipsey, M. W. (2004). Evaluation: A systematic approach. Thousand Oaks [u.a.: Sage.