Resources

Theological school deans are not just theological leaders for their institution, they must be EDUCATIONAL leaders. That is, they must implement sound educational practices related to curriculum, instruction, supervision, assessment, and administration. There is a variety of ways to assess the effectiveness of the curriculum, and there are several levels of assessment (program-level, course-level, student testing, student projects, etc.). While faculty members can focus on course-level and individual student learning assessment, academic deans need to focus on program-level assessment in order to evaluate the effectiveness of the school's curricular course of study. Here are ten basic curriculum assessment tools every academic dean needs, nine are covered in previous posts:  Outcomes alignment worksheet Syllabus assessment worksheet Curriculum maps Program-level rubrics Alumni survey Grade Distribution report Program retention and completion rate worksheets Entering student profile Graduating class profile Student course evaluations In this final entry of the series we review: 10. Student course evaluations that are worth the trouble Student course evaluations, a form of indirect assessment, can be a meaningful component of a school's formative assessment of its curriculum. Unfortunately, most course evaluation tools do not provide sufficiently meaningful data to be helpful. One evidence may be how difficult it is for most schools to collect meaningful data from the evaluations. Another is how students tend to see them as a chore, resulting in cursory responses and a low rate of return. Further, in most cases, the data collected rarely is analyzed at depth or used to prompt pedagogical actions for improvement in teaching and learning. Two approaches can help make course evaluations worth the trouble for students and for deans. First, a better-designed course evaluation tool, and second, a procedure that helps ensure a higher response rate. 1. A well-designed student course evaluation tool An effective student course evaluation tool will provide data and feedback that is meaningful. That is, the information from student feedback should address issues of pedagogy that are relevant, measurable, and actionable. For example, the mythical Central Generic Theological Seminary gathers the following clusters of information on its student course evaluations: (1) Student profile information (2) Feedback on program-level goals (3) Feedback on instruction and pedagogy (4) Feedback on instructor effectiveness (5) Feedback on the relevance of the course to the practice of ministry (6) Feedback on program and learning integration. In order to make these clusters meaningful, the instrument focuses on instructional effectiveness and curricular program goals, not on what students "like" or "enjoyed." Additionally, the clusters of items are co-factored to yield meaningful interpretation. See the attached "Anatomy of a Student Course Evaluation Tool" which shows how the instrument is structured by clusters and for co-factor analysis.  Download Anatomy of student evaluation Once the student evaluations are collected (CGTS uses its learning management system (LMS) for its course evaluations) the dean prepares an aggregate report for the Faculty. The aggregate report includes a comparison of selected items over the course of several semesters. The comparison focuses on areas targeted for improvement based on the student evaluations. Here are some examples: In Example 1 the dean compares student responses to degree program goal 1.A across two semesters. Additionally, the report compares two related items by gender.  In Example 2 the dean highlights three instructional items related to coursework (knowledge, principles, skills) and compares the responses over three semesters. This report item shows improvement in the most recent semester indicating that the interventions faculty members applied in their courses to address these issues are having a positive effect.  In Example 3 the dean compares a cluster of items related to instruction over three semesters. This feedback becomes important for the Faculty of CGTS in helping it realize the need to be more overt in applying pedagogical strategies that help students be more aware of the course learning objectives and to create learning experiences that yield a higher response from students about achieving the course outcomes. As a result of this feedback, the dean led the Faculty in applying teaching and learning practices to increase the effectiveness of these items.  You can download a copy of the student course assessment questionnaire here  2. A rigorous procedure for assessment The second strategy employed by CGTS is the implementation of policies and procedures that help ensure a high rate of return on student course evaluations. The school's policy makes completion of the student course evaluation part of the course completion requirements. Students who do not complete the course evaluation do not receive a grade for the course. Additionally, the school has put in place the procedures to help ensure this indirect assessment data set is part of the formative assessment plan. A Student Course Evaluation Sample Here is a sample of student course evaluation questions with questions that cover the various clusters for co-factor analysis.  Download Student Course Evaluation sample

Tat-siong Benny Liew Class of 1956 Professor in New Testament Studies College of the Holy Cross At the Annual Meeting of the Society of Biblical Literature last year, the Student Advisory Board organized an interesting session titled, “What I’m Telling My Students.” I find this a wonderful question for every

Joshua Canzona Georgetown University In his “Homage to Joe Sacco,” Edward Said celebrates the author of Palestine and gives us one of the best love letters to comics ever written. He shares his first comic book experience, “Everything about the enticing book of colored pictures, but specially its untidy, sprawling.

Martin Nguyen Associate Professor, Faculty Chair for Diversity Fairfield University In a time when it is of paramount importance to assert and witness that black lives matter, how do we go about preparing our Islam courses that all too often afford little to no time at all for the societal.

Caleb Elfenbein Assistant Professor Grinnell College Don’t we all have moments when we want to, or perhaps feel like we should, set aside a class session plan in lieu of discussing a pressing event or development? Despite the vast array of subjects that we teach within the broader field of..

Tat-siong Benny Liew Class of 1956 Professor in New Testament Studies College of the Holy Cross It is that time of the year. After weeks and months of class sessions and office hours, the spring semester is now over. There is, of course, something left for us teachers to do

Youshaa Patel Assistant Professor of Religious Studies Lafayette College These days, Islam is no stranger to controversy. Although we may deplore the mainstream media’s deliberate sensationalization of Muslim conflicts, as professors we can also exploit conflict in the classroom to help our students achieve their learning objectives. Many of my.

Cláudio Carvalhaes Associate Professor McCormick Theological Seminary At the heart of education, the most important “instrument” of our lives, the house we inhabit, is the very core of our selves: our bodies. Fully! It is in and through our bodies that we learn and are able to unlearn. The immense.

Eren Tasar Assistant Professor University of North Carolina at Chapel Hill I remember how dumbfounded I was the first time a student told me he had grown up believing Catholics were not Christian. He had never, moreover, heard of the Orthodox Church, the only form of Christianity recognized by most

Cláudio Carvalhaes Associate Professor McCormick Theological Seminary All of the schools under the Association of Theological Schools are required to have a very clear and strong sense of educational effectiveness. One of the ways to gauge such effectiveness is by evaluating to what extent a course meets its stated ‘learning