Through the No Child Left Behind (NCLB) legislation school and district practitioners are being asked to become more involved in the evaluation of the effectiveness of their schools' efforts and progress. Many practitioners are short on time,funding, and evaluation experience. However, educators can maximize their learning from this work by building their evaluation around clearly articulated evaluation questions.
The critical guidance for evaluation work, just as in school-based action research, is the identification, use, and reflection on essential questions. These questions drive the learning, and evaluation is about learning:
As practitioners, engage in evaluation work, whether involved in a formal evaluation (perhaps supporting the work of outside evaluators) or undertaking an informal examination of a school initiative, they need to consider the following aspects of evaluation questions.
Identify the overarching questions that you want to answer and why. First of all, what do you and the people in your school want to learn from this evaluation work? If you are working with grant funds, what do the funders want to learn? For example, if your school district had received a grant to engage faculty, students, and community members to use a variety of technologies to enhance science and mathematics learning through a community-based environmental study, what would you want to learn from your evaluation efforts? Some of your evaluation questions might be:
Identifying and prioritizing these questions is the first step toward meaningful evaluation and essential learning for your school.
Matching Methods to Questions
It is essential to remember that the identification of evaluation questions dictates the choice of evaluation methods. Practitioners need to ensure that the data-gathering methods used will result in answers to the identified questions.
Using methods such as questionnaires, interviews, and focus groups makes perfect sense when you wish to determine changes in attitudes (e.g., attitudes toward technology use). However, classroom observations become the essential method (with interviews or questionnaires providing additional information) to gain useful data about the sue of technologies or the engagement of students in mathematics and science inquiry.
Although teacher interviews may give some insights into student learning and changes in student achievement of technology standards, an analysis of student products will more directly answer such an evaluation question. If the development of certain mathematics learning has been targeted within this project, an appropriate method may be the tracking of changes over time in teacher-designed assessments or selected sections of standardized tests.
It is essential to choose methods for your evaluation that will yield appropriate data for answering your top-priority questions.
Reflections on Evaluation Questions
Finally, it is critical, when the data are in and analyzed, to return to the evaluation questions and the results in order to determine the implications for your future work. For instance, perhaps you found that although the quality and reach of the technology-related professional development was excellent, too much time elapsed between that learning and the actual use of the technology environmental study, so time and energy had to be wasted on additional training. Or perhaps your classroom observations indicated that although use of graphic calculators was to be an essential component of the environmental project, the use was negligible. What if after three years of similar project work, the targeted areas for improvement in mathematics achievement showed no improvement? These findings would certainly lead you to strategic changes in your work.
—by Ann Abeille,
|For more information, contact|