| Session Title: The Corruption of Public Evaluation: And What Should We Do About It, Collectively or Individually? |
| Think Tank Session 447 to be held in Liberty Ballroom Section A on Thursday, November 8, 5:15 PM to 6:00 PM |
| Sponsored by the AEA Conference Committee |
| Discussant(s): |
| Michael Scriven, Western Michigan University, scriven@aol.com |
| Ernie House, University of Colorado, ernie.house@colorado.edu |
| Abstract: The AEA collectively is working to uprade the quality and image of evaluation, eg via standards, guidelines, and checklists. At the same time, cashing in to some extent on the image we are improving, various public and commercial interests are undermining the credibility of evaluation by corrupting good procedures (the FDA example, discussed last year by Ernie House), or failing to bolster weak procedures (Consumers Union scandalous misreporting on child's seats), or appealing to bogus evaluation organizations (Consumers Digest) or using misleading evaluation labels (Microsoft's bogus use of 'beta-testing' or World Bank's claim of 'external' evaluation), the Dept of Justice (claiming incompetence in firing US attorneys) or Education (RCT imperialism). There are many examples, some of which we will discuss in more detail. Should AEA be doing more to counteract this degradation of our profession, eg by publicizing minimum standards, as AMA does with medical matters? Does ABA have a better model? After short introductions by the two speakers, we will go to floor discussion and consider recommendations. |