| Session Title: Assessing the Quality of Research Instruments Using Cognitive Lab Methodology: A Practical Discussion and Lessons Learned |
| Demonstration Session 538 to be held in SEGUIN B on Friday, Nov 12, 9:15 AM to 10:45 AM |
| Sponsored by the Qualitative Methods TIG |
| Presenter(s): |
| Joanna Gilmore, University of South Carolina, jagilmor@mailbox.sc.edu |
| Heather Bennett, University of South Carolina, bennethl@mailbox.sc.edu |
| Karen Price, University of South Carolina, pricekj@mailbox.sc.edu |
| Abstract: When considering “evaluation quality” it is important to critically analyze the appropriateness of research instruments used to garner data on a particular subject. One method employed by researchers from the University of South Carolina to review instruments is the cognitive lab methodology. Cognitive labs involve asking individuals to report their decision-making processes and analyzing the resulting verbal data to garner information about the cognitive processes that an individual uses to complete a task (Van Someren, Barnard, & Sandberg, 1994). This demonstration will describe the purpose of the cognitive labs, how cognitive labs were employed in two projects, and the methods by which data were collected and analyzed. The presenters will also share lessons learned in conducting cognitive labs. Additionally, participants will be provided with an opportunity to observe a “mock” cognitive lab and will be invited to pose questions and comments throughout the presentation. |