Return to search form  

Session Title: Conducting Multi-method Evaluations
Multipaper Session 672 to be held in D'Alesandro Room on Friday, November 9, 4:30 PM to 6:00 PM
Sponsored by the Quantitative Methods: Theory and Design TIG
Chair(s):
Linda Morell,  University of California, Berkeley,  lindamorell@earthlink.net
The Health Disease Process: Social Representations of Rural Workers Through Q Methodology
Presenter(s):
Virginia Gravina,  Universidad de la Republica Uruguay,  virginia@fagro.edu.uy
Pedro de Hegedüs,  Universidad de la Republica Uruguay,  phegedus@adinet.com.uy
Carolina Tonini,  Universidad Federal de Santa Maria,  carolinatonini@yahoo.com.br
Abstract: This study was conducted to identify the social representations of rural workers in relation to the way they perceive the health and disease process. To fulfill this objective Q methodology was used. This methodology combines in a unique way qualitative techniques to generate information and quantitative techniques to analyze the information (factor analysis). As a result of the work three factors emerged that were labeled in this way: i) health and integral prevention, ii) health system, and iii) health-work relation. The conclusions of the research are: i) the different context situations of the people can affect their health or disease conditions, ii) the scientific knowledge is used when people need advice from professionals, and iii) the indigenous knowledge is a valuable first kind of advisement to people in relation to good health practices.
Relationships Matter: Using Social Network Analysis to Evaluate Social Capital in the Kenyan Dairy Sector
Presenter(s):
Karabi Acharya,  Academy for Educational Development,  kacharya@aed.org
Charles Wambugu,  World Agroforestry Centre,  c.wambugu@cgiar.org
Esther Karanja,  World Agroforestry Centre,  e.karanja@cgiaf.org
Hellen Arimi,  World Agroforestry Centre,  harimi@cgiag.org
Bette Booth,  Academy for Educational Development,  bbooth@aed.org
Shera Bender,  Independent Consultant,  smbender_2000@yahoo.com
Abstract: This paper presents the results of an evaluation of a project that worked to build social capital among organizations working in the Kenyan dairy sector using the SCALE™ approach. SCALE™ is a systems-wide social change framework, participatory management process, and set of tools that interweaves governance, economic, environmental and social interests in a way that manages and conserves resources while also creating new economic opportunities. The evaluation design pioneered the use of systems theory and social network analysis for program evaluation with data collected at two points in time. The evaluation emphasized the importance of understanding where organizations sit within the whole system, what role they play, and how they are connected to other organizations, using standard social network indicators of cohesion, centrality, density and others. This paper will discuss the range of collaborative actions resulting from strengthening of the network of organizations working with small-scale dairy farmers in Kenya.
Validity Evidence Presented Through a Mixed Model Conceptual Framework
Presenter(s):
Linda Morell,  University of California, Berkeley,  lindamorell@earthlink.net
Abstract: This paper provides an example of how a mixed model conceptual framework can be used in assessment and how the framework illuminates the complementary nature of a validity investigation. Researchers in the areas of psychology and education have been exploring and trying to understand the intersections among aspects of validity, educational measurement, and cognitive theory. This study used a national validity project to investigate how can respondents contribute to the validation process in ways other than providing traditional “subject” information. A mixed model conceptual framework guided this study. Validity evidence was collected through a variety of methods including, traditional paper and pencil tests, surveys, think-alouds, and exit interviews of fifth and sixth grade students, as well as interviews with teachers and science experts.
Data Preparation, Analysis, and Reporting System Evaluation For a School System
Presenter(s):
David MacQuarrie,  Western Michigan University,  dmacquarrie@sbcglobal.net
Abstract: Data has become much more important in making quality educational decisions within the last decade. In order to make sound decisions from quantitative data the data must be collected, cleaned, analyzed, and reported in a manner that the reader's and decision maker's are clearly guided in the interpretation. An evaluation of a secondary level school's quantitative data system included the use of a qualitative focus group process made up of internal experts. First, two protocols were produced from best practices and processes of quantitative research and evaluation. Second, three qualitative instruments were created and aligned with the two protocols to enable the capturing of data. Third, the experts were lead through a process that compared the current data system to the two protocols in a backwards analytical process. The evaluation was summarized based on the protocol sections and also included recommendations for improvements in regards to equipment, software, and processes.
Search Form