StudentShare
Contact Us
Sign In / Sign Up for FREE
Search
Go to advanced search...
Free

Evaluation approaches - Research Paper Example

Cite this document
Summary
The researcher of this paper revealed that the diversity in evaluation approaches provides researchers a comprehensive array of evaluation frameworks that would best suit the requirements and objectives of their respective research initiatives…
Download full paper File format: .doc, available for editing
GRAB THE BEST PAPER91.8% of users find it useful
Evaluation approaches
Read Text Preview

Extract of sample "Evaluation approaches"

?EVALUATION APPROACHES This is a review of the extant literature on three different types of evaluation in research: the archival evaluation, multi-method or systemic evaluation and comparative-descriptive evaluation. These approaches were examined through three different studies with different research subjects. The review revealed that the diversity in evaluation approaches provides researchers a comprehensive array of evaluation frameworks that would best suit the requirements and objectives of their respective research initiatives. Evaluation techniques are crucial in any form of research regardless of whether it is a qualitative or quantitative research or a combination of both. This is because evaluation or measurement determines the interpretation of data gathered and, hence, impacts the findings and conclusions of a particular study. There is an ongoing debate as to which technique of evaluation or measurement can best interpret probability. According to Hand (1996), this debate is stimulated and aggravated by controversy over the legitimacy of applying different classes of statistical methods to data that emerge as a consequence of different kinds of measurement activity. (p. 446) The body of literature supports this theme, from theories to actual research examples. The following studies undertaken to investigate three separate issues with different evaluation and measurement techniques highlight the differences by which the studies went through with their investigations. Archival Evaluation With an aim of investigating the validation approaches in Information Systems research, Boudreau, Gefen and Straub (2001) used an evaluation technique anchored on a comprehensive review and analysis of literature on the subject, specifically comparing two time periods. The researchers refer to it simply as a literature review except that such review was undertaken in a highly systematic manner. Clearly, the study is qualitative in character and it aims to describe the validation trends from 1997 to 1999. The employment of the review of literature as a foundation for inferences and conclusions is valid since qualitative research aims to find depth when quantitative studies seek breadth. Ambert et al. (1995) for instance, explained that because of this focus, evaluation could draw from a smaller group of research subjects or respondents instead of a large representative sample of the population. (p. 880) Bourdeau et al. selected five journals to represent the periods by which the study sought to compare. Out of these journals, the author evaluated a total of 193 articles selected based on specific criteria or attributes. (p. 6) There were at least eleven such attributes (i.e. research type, content and construct validity, research method, etc.) and that they were, in turn, evaluated according to a validation test statistic – a second independent coder. (p. 6) The resulting data allowed for the identification of relationships and the evaluation of the efficacy of validation approaches based on previous documents so that the research objectives are finally met. It was found, for instance, that instruments are more frequently validated today than they were 11 years ago. (p. 7) Multi-method Evaluation Boyd et al. (2007), investigated community health services with emphasis on the need for stakeholder participation and dialogue. For this purpose, they designed a multi-method approach in order to cover the numerous stakeholders involved in community health services: health practitioners, community leaders, marginalized people, etc. Three evaluation frameworks are designed for goals, the stakeholders and the organization. The researchers employed the so-called critical systems thinking (CST) principle in this strategy, which is typified by three fundamental characteristics, namely: Critical awareness for the examination of assumptions in addition to the conditions that led to their emergence; Improvement both on temporary and local levels done in an adequately informed manner; and, Methodological pluralism pertains to the use of several or a combination of methods, using the strengths of each to compensate for the weaknesses of the others. (p. 1306) The multi-method approach also called as systemic approach has been justified by the sheer number and diversity of the sampling population. Each has differing stakes on the issue of community health and their contribution to the data could only be appropriately evaluated by different frameworks. The researchers highlighted the fact that the evaluation strategy is also flexible and responsive, drawing upon aspects of the three evaluation approaches. These supposedly enable the researchers to comprehensively cover their sampling population and, hence, interpret data authoritatively because the approach has the ability to address complexities in addition to the ability to approach organizations effectively either from an objectivist or subjectivist point of view. Comparative Evaluation Comparative evaluation is not unlike a descriptive approach to evaluation by which concepts or samples are defined and explained so that their strengths and weaknesses are identified. This is the approach used by Duffield who evaluated the various sampling methods that can be applied to passive Internet measurement research. His objective was to determine the best technique to comprehensively cover the complexities of the Internet as a large distribution system and the network infrastructure in general. Within this framework, numerous concepts were introduced such as traffic measurement, network management, in addition to the various sampling methods that were evaluated. The proprietary historical review was used but the subject is recent, hence, the extant body of research is limited. But the main issues evaluated where the types of passive sampling methods, which include: polling management information base; packet monitoring; and, flow monitoring. (p. 477) Each of these passive sampling methods were explained, then compared. The subjects allowed for a purely descriptive evaluation approach because they are technical in nature. Checking from a manual or testing it from a machine can easily verify a point or an inference. Here, the evaluation is not about the measurement of probabilities because the process can yield accurate and quantified results. As the reviewed literature highlighted, evaluation is crucial in the outcome of an academic research. The appropriate evaluation techniques determine the validity of the research findings and conclusions. Another important variable that was revealed, however, is that the diversity in evaluation methods do not necessarily mean that research designers could not agree with about what should be the right framework, which underpins the drive for standardized evaluation models. Studies have different goals and different methodologies, with different sampling profile and populations. The large number of techniques can be interpreted as comprehensive and vibrant research frameworks, some of which are integrated into multi-approach evaluation model in order to address complex research objectives. References Ambert, A., Adler, P., Adler, P. and Detzner, D. (1995). "Understanding and Evaluating Qualitative Research." Journal of Marriage and Family, vol. 57, no. 4, pp. 879-893. Boyd, A., Geerling, T., Kagan, C. Midgley, G., Murray, P., and Walsh, M.P. (2007). "Systemic Evaluation: A Participative, Multi-Method Approach." The Journal of Operational Research, vol. 58, no. 10, pp. 1306-1320. Boudreau, M., Gefen, D. and Straub, D. (2001). "Validation in Information Systems Research: A State-of-the-Art Assessment." MIS Quarterly, vol. 25, no. 1. pp. 1-16. Duffield, N. (2004). "Sampling for Passive Internet Measurement: A Review." Statistical Science, vol. 19, no. 3, pp. 472-498. Hand, D.J. (1996). "Statistics and the Theory of Measurement." Journal of the Royal Statistical Society, vol. 159, no. 3, pp. 445-492. Read More
Tags
Cite this document
  • APA
  • MLA
  • CHICAGO
(“Evaluation approaches Research Paper Example | Topics and Well Written Essays - 1000 words”, n.d.)
Retrieved from https://studentshare.org/business/1395114-literature-review
(Evaluation Approaches Research Paper Example | Topics and Well Written Essays - 1000 Words)
https://studentshare.org/business/1395114-literature-review.
“Evaluation Approaches Research Paper Example | Topics and Well Written Essays - 1000 Words”, n.d. https://studentshare.org/business/1395114-literature-review.
  • Cited: 0 times

CHECK THESE SAMPLES OF Evaluation approaches

Nursing Certification and Learning Theory

Practice test and verbal communication Evaluation approaches will be used to evaluate the capability of learners presenting various concepts that were covered during the training as well as their capacity to apply the knowledge gained to the practical field.... The writer emphasizes the importance of effective teaching strategy and quality evaluation technique in professional development.... hellip; The supervision committee drive that nurses working in different sectors attain PCCN certification forms the basis for needs evaluation....
3 Pages (750 words) Article

Leadership Skills and Acquisition of Feedback

Through critical Evaluation approaches, there is evidence that different employees are capable of deciphering knowledgeable feedback from the management in accordance with levels of intelligence, experience, and other demographic variables.... At the problem identification stage, the management outlines the various stages of failure for the personnel while undertaking their daily course of tasks, and emphasized on the model approaches that shall embrace the delivery of positive feedback prior to execution tasks....
4 Pages (1000 words) Research Paper

Summative and Formative Program Evaluation

Title: Psychology Summative and Formative Program evaluation Name: Tutor: Institution: Date: November 25th 2013 Introduction evaluation refers to the process of determining the real values of a process or program, to find out whether it's working or not.... TYPES OF evaluation Formative evaluation This is a technique which is commonly used to judge the worth of a program basing its judgments on the program activities in progress....
4 Pages (1000 words) Essay

Critical Thinking Questions

These Evaluation approaches are quite critical in certain programs.... Program evaluation: Alternative approaches and practical guidelines.... here are several categories of evaluation studies that can be employed in a program.... These six categories of evaluation studies include objectives-oriented, management-oriented, consumer-oriented, expertise-oriented, adversary-oriented and naturalistic and participant-oriented evaluations (Fitzpatrick, Sanders, & Worthen, 2004)....
2 Pages (500 words) Essay

Course: Instructional Design and Development. Assignment#10 (Last)

There are also disparities in approaches, as summarized in the table below:Formative Evaluation ApproachesSummative Evaluation ApproachesSmith and Ragan's (2004) four stage process: “design reviews, expert reviews, learner validation, and ongoing evaluation” ( (Brown & Green, 2005, p.... 173)Aside from differences in approaches, there are also evident disparities in designing and conducting these two methods of evaluation where the formative evaluation method starts with focusing on ID projects (Brown & Green, 2005, p....
1 Pages (250 words) Essay

Practicum Project Methodology and Evaluation

Evaluation Plan In evaluating my practicum project, both formative and summative Evaluation approaches will be utilized.... Secondly, this project is geared towards helping the learner acquire the ability to identify and analyze leadership approaches used in managing multidisciplinary groups.... For the third objective, I will take in consideration the identified best practices such as open communication used to facilitate nursing operations as well as leadership approaches identified through observation and adopt them in my nursing practice during this practicum project....
2 Pages (500 words) Term Paper

Evaluation Models in Organizations

This paper critically assesses the different Evaluation approaches of training by comparing and contrasting each one of them.... However, it is recommended for organizations to adopt a hybrid-type, incorporating system-based approaches.... hellip; The implication of using system-based approaches is that the person evaluating examines and measures definite practices and outcomes; and interviews the trainees.... It will provide an insight on which models or approaches seem similar or compatible....
6 Pages (1500 words) Report

Risk and Safety Engineering

This assignment "Risk and Safety Engineering" sheds some light on a safety management system that has safety risk management as one of its functions.... One of the key components that make up safety risk management is the identification of risks.... hellip; I also recognize the fact that a steering system is a complex system that has comprises the interaction of the human-centered systems and the technical parts....
8 Pages (2000 words) Assignment
sponsored ads
We use cookies to create the best experience for you. Keep on browsing if you are OK with that, or find out how to manage cookies.
Contact Us