|
Session Title: CC3: Lessons Learned From the Evaluation of Three Comprehensive Centers
|
|
Panel Session 693 to be held in Mineral Hall Section A on Friday, Nov 7, 4:30 PM to 6:00 PM
|
|
Sponsored by the Evaluation Use TIG
and the Pre-K - 12 Educational Evaluation TIG
|
| Chair(s): |
| Kim Cowley,
Edvantia Inc,
kim.cowley@edvantia.org
|
| Discussant(s):
|
| Caitlin Howley,
Edvantia Inc,
caitlin.howley@edvantia.org
|
| Abstract:
Three teams of evaluators from Edvantia, a West Virginia-based research and development organization, serve as the evaluation subcontractors for three regional comprehensive centers (CCs): (1) the Appalachia Regional Comprehensive Center (ARCC), (2) the Florida and the Islands Regional Comprehensive Center (FLICC), and (3) the Mid-Atlantic Regional Comprehensive Center (MACC). ARCC, FLICC, and MACC are three of 16 federally-mandated regional centers funded by the U.S. Department of Education to provide technical assistance services to state education agencies. Presenters will first position the three CC evaluations on a proposed continuum of involvement and proximity. Individual panelists will then discuss the unique evaluation practices developed by the evaluation teams to ensure effective evaluation use; the successful strategies the teams employed to communicate with program staff from each of the CCs, given their geographical/physical locations; the coordinated strategies utilized to communicate with evaluation teams across the three CCs; and cross-organizational lessons learned.
|
|
Evaluation of the Appalachia Regional Comprehensive Center
|
| Kimberly Good,
Edvantia Inc,
kimberly.good@edvantia.org
|
| Laura Plybon,
Edvantia Inc,
laura.plybon@edvantia.org
|
| Karen Bradley,
Edvantia Inc,
karen.bradley@edvantia.org
|
| Kim Cowley,
Edvantia Inc,
kim.cowley@edvantia.org
|
| Nicole Finch,
Edvantia Inc,
nicole.finch@edvantia.org
|
| Kathy McKean,
M&M Evaluations,
kmckean1@suddenlink.net
|
|
The Appalachia Regional Comprehensive Center (ARCC) at Edvantia, based in Charleston, WV, serves state education agencies (SEAs) in Kentucky, North Carolina, Tennessee, Virginia, and West Virginia. Edvantia evaluators conduct ARCC's internal evaluation; M&M Evaluations, located in Oklahoma, serve as the external evaluators. ARCC's evaluators are situated geographically near its state liaisons, who serve as the direct contacts for SEAs; this, coupled with the distinct evaluation responsibilities between internal and external evaluators, positions the ARCC evaluators at a far right position on the continuum of involvement and proximity. The relationship between internal and external evaluation is a traditional approach. ARCC evaluators will discuss the forging of relationships with state liaisons in evaluation implementation. Additionally, evaluators will discuss how internal evaluations of ARCC services are conducted and will present evaluation strengths and limitations. Panelists will also discuss the role of the external evaluators and how they support and improve the internal evaluation.
|
|
|
Evaluation of the Mid-Atlantic Comprehensive Center
|
| Nate Hixson,
Edvantia Inc,
nate.hixson@edvantia.org
|
| Karen Bradley,
Edvantia Inc,
karen.bradley@edvantia.org
|
| Kim Cowley,
Edvantia Inc,
kim.cowley@edvantia.org
|
|
Based in Arlington, VA, the Mid-Atlantic Comprehensive Center (MACC) at the George Washington University Center for Equity and Excellence in Education (GWU-CEEE) serves state education agencies in Delaware, District of Columbia, Maryland, New Jersey, and Pennsylvania. An evaluation coordinator from MACC leads the evaluation team, while remaining evaluators are housed at Edvantia, a subcontractor based in Charleston, WV. By maintaining clear distinctions in their respective roles/assignments, Edvantia evaluators provide both internal and external evaluation services to MACC. This distinctive relationship positions MACC evaluators in the center of the continuum of involvement and proximity described in the overall panel abstract, and gives the evaluators a unique perspective, one that affects evaluation practices. Edvantia's MACC evaluators will discuss the layering of evaluation services (national, external, and internal); how different evaluation roles affect interactions with MACC staff and other Edvantia evaluators assigned to different comprehensive center evaluations; and cross-organizational lessons learned.
| |
|
Evaluation of the Florida and the Islands Comprehensive Center
|
| Juan D'Brot,
Edvantia Inc,
juan.d'brot@edvantia.org
|
| Nate Hixson,
Edvantia Inc,
nate.hixson@edvantia.org
|
| Caitlin Howley,
Edvantia Inc,
caitlin.howley@edvantia.org
|
|
Located in Tampa, FL, the Florida and the Islands Comprehensive Center (FLICC) provides technical assistance to state education agencies (SEAs) in the state of Florida and the territories of Puerto Rico and the U.S. Virgin Islands. Edvantia is a research and evaluation firm based in Charleston, WV, that serves as the internal evaluation unit for the FLICC. Due to the geographic distance between the two organizations, interactions between FLICC and Edvantia are primarily electronically mediated, placing FLICC evaluators at the left-most position on the continuum of involvement and physicality. This position presents unique challenges and obstacles to the FLICC evaluation team. FLICC evaluators will focus their panel presentation on the emergence of unique practices developed to ensure effective and equitable evaluation of the comprehensive center. Panelists will also discuss the organizational lessons learned and processes utilized to cultivate and maintain productive relationships with geographically distant comprehensive center staff.
| |