Resources

In remote teaching we all wrestle with how to effectively translate our typical assessments of student learning, and possibly, how to create new assessments.  This requires (re)determining what we most want our students to achieve and thinking creatively about how they can best demonstrate their learning in an online environment.  While there are tips to discourage cheating online, many instructors are concerned about academic integrity in online high-stakes, closed-book exams. Because students are more likely to learn from (and less likely to cheat on) assessments that provide authentic experiences or reflection on learning, it is valuable to think broadly about how best to assess our students learning in creative ways online. The principles of inclusivity and sustainability can guide our development of online assessments from the beginning to the end of the course. Sustainable assessments are those that help students develop skills necessary to direct and monitor their future learning.  Shifting students’ expectations from all feedback originating from the instructor to using self and peer assessment will help them reflect on their learning processes, and identify gaps in their skills and understanding. Making this shift will allow students to begin to assess and monitor their own learning, making it sustainable a skill that students can use after leaving your course. Inclusive assessments are those designed to measure students equitably, and in ways that are sensitive to cultural, economic and social differences. Transparency and clear communication regarding expectations for successful completion of work is key so that students understand its purpose, the necessary tasks to successfully complete the work, and upon what specific criteria they will be evaluated. This approach levels the playing field for diverse students while facilitating learning for all students. To apply these principles in your online course: Begin by seeking input from your students At the beginning of a course, surveys can be used to discover students’ incoming knowledge and skills as well as something about them as a person.  Rather than focusing on knowledge ‘deficits’ that the curriculum must fill, this kind of preassessment will allow you to discover students’ interests, lived experiences and motivations.  Equitable assessments should be accessible and responsive to students whose abilities, access to computational tools and reliable high-speed internet, access to quiet work spaces, and extent of flexibility in setting their study schedules may vary. Therefore, it will be important for you to know about your students for your course planning. Ask students to share what they are most excited about in the class, unique skills they are proud of, past educational experiences, and their own perceptions of their current knowledge and skills.  Use students’ input to help them build connections between the course content and their interests. To help them take ownership in creating spaces that welcome all members of the class, invite students to contribute to ground rules for class interactions. Where possible, provide opportunities for students to make choices about an assessment topic or format that leverages their skills and interests to help them feel more empowered and engaged in the course.  Use frequent low-stakes assessment to guide students’ learning throughout the course As your course progresses, assessments are a learning tool that can develop the students’ sense of belonging in the course community, as well as a shared responsibility for and awareness of their learning. There are many ways to accomplish this. Here are a few: Include a variety of low-stakes activities and assignments early and frequently such as short quizzes, reflective writing prompts, group projects, and synchronous or asynchronous discussions. This allows students to calibrate your expectations, get feedback they can incorporate, and understand their individual progress. Use online discussions to build opportunities for interaction that develop students’ sense of belonging, and motivate them to learn from each other in their responses and question of each other.  In both asynchronous discussions and synchronous sessions, guide opportunities for effective peer feedback by modeling it yourself, highlighting examples of productive exchanges, prompting them to ask each other guiding questions and asking them to use rubrics / clear criteria to guide and assess their responses. Before students hand in work, ask them to self-evaluate according to the grading criteria and to identify areas where they would most benefit from your feedback. Culminate the course with authentic applications of course knowledge and skills with integrative assessments Students can demonstrate their achievement of the course goals by applying disciplinary tools to real-world situations, analyzing authentic data or exploring solutions to so called “wicked problems.”  These are problems that have changing parameters, are resistant to solutions, involve incomplete data, or are difficult to recognize (Hanstedt 2018).   Creative projects with formative feedback will support students in developing the sustainable assessment skills necessary for lifelong learning. Consider To synthesize key ideas or reflect on what they’ve taken away, have students write research reports or papers. These can provide opportunities to practice disciplinary language and styles of communication.   To creatively demonstrate learning, have students create artifacts such as maps, figures, photo essays, journals, videos, blogs, podcasts, or portfolios. Structure checkpoints and opportunities for formative feedback to support students in successfully completing these projects.  To learn to self-assess the quality of their work, have students use use rubrics, peer-feedback, and/or compare it to exemplary examples.  Whatever forms of assessment you choose, clear communication is critical to their success.  Consider starting each unit with a brief overview of how all the course components fit together and alerting them to upcoming deadlines.  Make sure to inform students how each assessment will be useful for their learning, make expectations as transparent as possible, and be clear about where students can find answers to questions as they arise.  Learn More The Art & Science of Successful Online Discussions (Faculty Focus) Five Discussion Ground Rules for the Online Classroom (Colorado State University Online Blog) Professors Share Ideas for Building Online Community (Inside Higher Ed) Alternative to Exams for Remote Teaching (Teaching@Tufts) Creating Epic Finales or Limping Across the Finish Line (Teaching@Tufts) Curricula for Wicked Problems (Wicked Problems Project) Transparency in Learning and Teaching (TILT Higher Ed) Inclusive Assessment: Equal or Equitable? (Teaching@Tufts) Selected References Dewsbury, Bryan, and Cynthia J. Brame. “Inclusive Teaching.” CBE—Life Sciences Education 18, no. 2 (April 26, 2019): fe2. https://doi.org/10.1187/cbe.19-01-0021. Gikandi, J. W., D. Morrow, and N. E. Davis. “Online Formative Assessment in Higher Education: A Review of the Literature.” Computers & Education 57, no. 4 (December 1, 2011): 2333–51. https://doi.org/10.1016/j.compedu.2011.06.004. Hanstedt, P. (2018). Creating wicked students: Designing courses for a complex world. Stylus Publishing, LLC.   Kelly, D., J. S. Baxter, and A. Anderson. “Engaging First-Year Students through Online Collaborative Assessments.” Journal of Computer Assisted Learning 26, no. 6 (2010): 535–48. https://doi.org/10.1111/j.1365-2729.2010.00361.x.

What simple gestures and accommodations at the end of a semester can lighten the load without compromising teaching and learning? Educators expect waning energy as a semester and academic year conclude. Students are overwhelmed trying to finish overdue assignments, final projects, and exams. Faculty are at the breaking point with grading, administrative tasks, and work/life balance. While student energy for learning flags, most faculty tap into their very last teaching reserves to end courses in the best possible spirit. This normal rhythm of attenuating energy is intensifying in the Covid-19 crisis. End of year celebrations like graduation are not there to provide momentum, needed affirmation, and closure. Educators have become a last line of continuity and support for increasingly vulnerable students. We are teachers turned life-coach, counselor, parent, and pastor. All the while, grief and loss are mounting on every side. Here are four simple ways to lighten the teaching and learning load to finish well: Take a hard look at any remaining assignments left in the semester. Chances are, only one or two assignments are crucial assessment indicators for final grades. In one of my courses, it is a final exam. In another, it is an accumulative writing project. Other smaller-scale learning assignments that support student engagement and course tracking won’t impact an overall course grade to any significant degree. In the last few weeks of teaching, be transparent about which few assignments are crucial to finishing well in order to lighten the teaching and learning load. In one course, I’ve made other assignments optional or extra credit. In another, I’ve made select assignments pass/fail. Options and clarity help students make informed decisions about where they should focus their waning energy, and faculty can save significant time doing less low priority grading. Diversify ways an assignment can be submitted. In one of my courses, students are required to write a formal film review. I’ve offered them the alternative of submitting a slide presentation with audio narration. Or they can choose a creative project connecting a film’s themes to the challenges of Covid-19. Different choices allow students to meet assignment objectives with less fatigue and anxiety or less intensive editing help from remote support services. Including opportunities to connect with Covid-19 fosters learning engagement and helpful conversations in their life circles. Students reveal surprisingly diverse and creative communication skills when modes of presentation are flexible. And diverse submissions make the drudgery of grading … almost … fun. Allow students to partner with peers on assignments. In one of my courses, students were writing individual reviews on one of three books to complete the semester. Fifteen papers to write, fifteen papers to read and grade. I adjusted the assignment and asked students reading the same book to submit one review written collaboratively. They divided tasks and wrote with improved shared insight while bolstering their peer-to-peer relationships weakened by less classroom interaction. Overall, shared grades were higher, everyone benefited, and I graded 3 book reviews instead of 15. Most important: reassure, reassure, reassure. Students need a strong ongoing word of encouragement to finish well. Let them know expectations and goals are shifting and simplifying in response to Covid-19. I remind students at every possible moment that their singular task is to stay engaged in course learning to the degree they are able and maintain good communication about their circumstances and needs. In return, it is my responsibility to make sure they have every possible opportunity to finish their courses well. Reassurance means hosting conversations on Zoom or other discussion platforms about specific challenges or griefs impacting students’ lives. Reassurance means reminding them that, even in very uncertain times, they have value and gifts and a future. Reassurance means sharing our passion for our area of study and its resourcefulness during a pandemic. Reassure, reassure, reassure. It is less time intensive than grading, and it will help students reach the finish line with wellbeing in mind. Teaching and learning are life-giving and can be a lifeline. Though our energy is low, and our grief is high, we can do some simple things to ease the load and finish well. 

Without fail, every recent conversation that even remotely touches upon assessment leads to an increasingly intricate and technical discussion about how to prevent the cheating, presumed to be rampant, now that we’re all online. Should we use Lockdown Browser? Should we enable webcams? But what about smart phones? What proctoring services are available? Will time limits help? How many questions should we have in our question bank? What’s a good proportion of questions in the bank to questions drawn for the exam? Should we shuffle questions? Should we show only one question at a time? Should we allow students to see their incorrect answers right away? The questions concerning cheating proliferate—with each solution presenting further considerations and, often, new challenges. These conversations can’t help but remind me of one of the many theories for the pandemic “panic buying” of toilet paper: psychologists claimed that such hoarding was an attempt to retain or regain a sense of control over an uncontrollable situation, in which feelings of fear, disorientation, and overwhelm (in addition to actual physical danger) abound. We can’t control Covid-19 (yet), but we may be able to control how many toilet paper rolls we have stashed away in our homes. Perhaps teaching online feels similar to instructors: something that was thrust upon us, something most of us didn't want to do, something that most of us probably aren’t doing very well (either by default or by design). Trying to tamp down on cheating may be the academy’s version of toilet paper hoarding. When I’m part of these conversations, I keep James M. Lang’s Cheating Lessons in mind. (If you don’t have time for the whole book now, he wrote a series in The Chronicle of Higher Education that offers many of the same insights in shorter form.) Here are a few important considerations about cheating: • So far, we don’t have evidence that students are cheating now more than ever—though our worries about cheating have obviously increased. Even typical indicators of cheating, for instance, fast time on a test or an unusually high score, may be attributable to other factors. One colleague told me that some of her students were studying more at home, without all the distractions, and were more relaxed about taking tests—which led to better performance. • Most students in any given class won’t cheat (even if most people admit to having cheated at least once over the course of their lives; I know I have); this seems to be an especially important time to be viewing our students charitably, with positive regard, and avoiding a “deficit” lens. • Why do people cheat? Well, among other reasons, we know that certain conditions in a learning environment can incentivize cheating; one example is a single, high-stakes assessment for which students have been given little to no practice or preparation (e.g., one exam worth 50% of their course grade). To the extent that we can give students multiple opportunities to demonstrate knowledge or mastery of a skill, to the extent that we can offer them practice and timely feedback, and to the extent that we can help reduce their anxiety at this anxiety-inducing time, we will go a long way in creating conditions where they will not make the choice to cheat. • What is cheating anyway? We can’t assume students will know in the context of our specific class; even within the same field, the same department, these definitions and expectations may vary (just as there is no consistency across what we mean by different assignment types). Some students, like the first-generation population, are severely disadvantaged by this kind of “hidden curriculum.” The less that’s tacit, the more that’s explicit (or “transparent”)—on cheating and otherwise—the better for all students (but especially for underserved populations). • But okay, let’s assume, for a moment, that students know it’s cheating to look up answers online or in their books, and they do it anyway. One colleague of mine said, “Who cares? The point is I want them to learn. Maybe looking up the answers will help them learn.” What is our end goal here? How can we leverage or even embrace (perhaps newly) open testing situations? • Or, rather than focusing on the cheating that we defeatedly accept will occur—and trying to prevent the inevitable with complicated surveillance and other apparatuses—perhaps we might sidestep the issue entirely by designing our assessments to be as “cheat-proof” as possible. Questions of foundational knowledge are easy to look up; “higher-order” questions—application, analysis, evaluation, or creation—are not. (“Which of the following is the best definition of karma”? is easy to find in the textbook I use. “What would a Marxist interpretation of this [current news headline about religion]?” isn’t.) For those teaching large classes, those with heavy teaching loads, those without TAs, those stretched to capacity already, etc., these questions needn’t be asked only in short-answer or essay form, which can take way longer to grade. Multiple-choice questions can work here too, even if we don’t usually think of them as such. (A caveat: some folks find these kinds of multiple-choice questions harder to create.) I’m not convinced that we have to accept cheating as inevitable, even now. We, as instructors, have some control(!) over the learning environments, the testing conditions, and the assessments themselves. Let’s continue to use the influence we do have to encourage authentic, deep, transformative learning—not short-cuts or hacks.

One of the major advantages of the online learning environment is the capacity to help students develop critical thinking in more effective and efficient ways than the classroom environment allows. Emphasizing student engagement through online discussion forums is a powerful way to cultivate critical thinking. By having students engage more intentionally with texts and media, and respond to well-crafted prompts and questions, instructors can immediately assess the level of a student's understanding and concepts acquisition. Reading student responses to well-crafted prompts and questions is akin to a form of mind reading. The instructor gains immediate feedback on what the student thinks, how a student is thinking, the level of understanding achieved, and can identify misunderstandings. Assessing online student responses allows the teacher to provide correctives, follow up with clarifying questions, challenge fuzzy thinking, and push for specificity. In this way the teacher can cultivate critical thinking and assess evidence about how well students achieve it throughout the course. Critical thinking is one of the universally desired goals in teaching. The current ATS M.Div. program goals includes “. . . development of capacities—intellectual and affective . . . ” as one of its ministerial formation outcomes (Degree Program Standards A.3.1.3.). The online discussion experience is one of the most useful methods for developing and assessing critical thinking. What is Critical Thinking? Critical thinking is a particular cognitive activity evidenced by specific components. Attached is a handout, "Assessing and Cultivating Critical Thinking Online" with nine of those components. Other components of critical thinking not included are credibility, sufficiency, reliability, and practicality. You can use the handout to assess student responses for critical thinking. Sharing the chart with your students, or, converting it into an assessment rubric for online academic discussion can help your students cultivate critical thinking and help you assess how well they achieve it.

One of the most unfortunate practices in instruction is a teacher trying to get “right answers” from students. This is not to say that getting your students to get it right is a bad thing–in fact, it’s very desirable. Usually what happens, however, is that the teacher is engaged in teaching a concept and then pauses to “test” to see if students are getting it. The teacher asks a question intended to solicit a right answer, then is satisfied when one or two students answer correctly. The trap is that in the mind of the teacher a right answer indicates that learning has taken place and the student understands the concept. The truth is that a “right answer” may merely indicate that the learner has learned to mimic the teacher’s explanation—or maybe the learner made a lucky guess! When I was in grade school, I was chosen to be the spokesperson for an exhibit at the annual science fair. My job was to stand in front of a large container of water upon which were two small model boats. One model was intact and floated on the surface, but the other model had a hole in it. When I placed the second model boat on the surface of the water it would soon take on water and sink. I remember that my job was to explain to people why a boat with a hole in its hull sinks. I was chosen for the job because apparently I gave the "right" explanation well. But I have to confess that I was well aware that I didn’t really understand what it was that I was explaining! Even as I was giving the explanation to enraptured groups of students and teachers, I was keenly aware that I didn’t comprehend what I was talking about. I’d learned to mimic my science teacher’s explanation, but I didn’t understand it. Even when a learner gives a right answer, the skilled teacher will use the opportunity to follow up on how the learner arrived at the correct answer. Effective teachers assess understanding of the concepts being learned, not just test for “right answers.” In other words, effective teachers do not just focus on what a student says in an answer, but also assesses how a student arrived at the answer. One way to help learners acquire deeper understanding is to be more intentional in your response to student answers. When responding to a learner’s correct answer, don’t just say, “Right!” or “That’s correct!” Respond in a way that will both enforce the correct answer and help teach the group about why an answer is correct and how to arrive at the right answer. Teacher responses that include information about why the learner’s answer is correct, such as rephrasing the response to emphasize factors that make the answer correct, or the steps or methods used to get the correct answer, are helpful to other learners who are in the process of learning the reasoning behind why something is so, or who are trying to figure out the steps for arriving at an accurate answer to the question being posed. You can help students move beyond mimicking a right answer and toward comprehension by: - Amplifying the student’s response - Restating, modifying, or rephrasing the learner’s response and redirect for further discussion - Asking the student to explain how he or she arrived at the answer - Asking the student to provide an example or a corollary - Probing for further discussion. By the way, can you explain why a boat sinks?

The power of affirmation lies in the acknowledgement of a job well done.  When colleagues applaud our success, we feel more a part of the enterprise, more connected, and more accepted. Being affirmed is being seen, noticed, made visible in erasing workplaces where so much of our work feels like it goes unnoticed or simply taken for granted. Feelings of isolation and separation are lightened with applause. Recently, I facilitated a workshop on teamwork and collaboration for a group of women who work as administrative assistants for a large corporation. For the most part, they feel unappreciated and under-valued. I led them in an activity which was intended to spark appreciation amongst them. I divided them into pairs and instructed each pair to interview the other. The interviewee was to share two of her recent successes at work. Then the roles were switched. When it came time to report back, each pair member was told to tell the entire group one of the interviewee’s successes for which the entire group would then applaud wildly. I gave the instructions and asked if there were any questions. One woman commented that if we applaud too loudly security might come. I told her we would risk it. The group quickly divided into pairs and began the conversations. After a bit, I reconvened the group and asked the first pair to report. I reminded the group to get ready to applaud for each person. The first woman told of her partner’s success. I began applauding and the group members joined in. With each success story, I extended the applause and added a cheer and called out the woman’s name. The group followed suit. Smiles appeared on each face, and the woman being applauded sat up a little straighter in her chair and smiled--a little bit. By the time we finished, the energy in the room was vibrant. It was an affirmation fest! At the end of the last session, as our benediction, we repeated the exercise. Rather than being interviewed, each woman told of an accomplishment she had in the last week or so. Without prompting, the women applauded wildly for each other. Security did not come. I encouraged the women to find ways to routinely inquire about each other’s professional successes as well as personal accomplishments. I ended the session, gathered my belongings, and opened the door to leave. A senior executive was standing in the hallway. He looked surprised when the door opened. He commented, without smiling or making eye contact, in a chastising tone, “You all are very raucous.” I said, “We most certainty are,” as I walked past him without stopping. The postal service was still the preferred mode of communication for important documents when I was working on my dissertation. I had sent my advisor a draft of two chapters. When the mail was delivered to our home, there was a thick, thick envelope. I looked at the address label. The huge envelope was for me, from my advisor. My heart sank. I was mortified. Why was the package sooo thick? I assumed that she did not like my work and had included the paperwork needed for me to withdraw from the program. I assumed she hated my work and wrote, in many pages, to inform me of my inadequacy. My fears paralyzed me. I left the package unopened for a day–too afraid to open it. Finally–after having driven my family crazy with my whining and self-criticism–I opened the package. Much to my surprise, relief, and delight, my advisor had so thoroughly read my work that her comments, affirmations, and edits were two pages for every one page I had written. My advisor had done the closest read I had ever received on my work. Her extensive comments were on the ways I could continue to strengthen already sound chapters. Her affirmation reduced me to tears. What she thought of my work meant the world to me. Hearing that my work was good and could be made better was a life-changing experience. Knowing that she poured over my work, considered my assertions, and resonated with my argument, made me take my own thoughts more seriously. It made me want to write better, deeper, more clearly. She had sent me a package of affirmation. When I was in elementary school, on report card day, my brother and I received $1 for every A, 50 cents for every B, nothing for a C, and we owed our parents for anything lower than a C. My parents were not paying us for the grades we made. They were affirming us, in a very tangible and pleasant way, for our hard work. They were teaching us that our good grades needed to be celebrated. They wanted us to know that our good grades were noticed and that our good grades were a point of pride. After we were paid by my father, my brother would ask to go to the store so he could spend his bounty. I, more frugal, put mine in the log cabin bank on my dresser. I was planning on buying a blue Ford Mustang on my 16th birthday. Our faculty has a ritual which has been quite meaningful for me when it was been my turn, and for which I love to participate for others. At faculty meetings, when someone is tenured and promoted, we read aloud excerpts of the letter sent to the Trustee Board. The excerpts extol the value of the work by the celebrated colleague. The excerpts make reference to their successes and accomplishments, and proclaim the good efforts of the colleague. Once the words are spoken, the colleague receives thunderous applause and the entire faculty lifts champagne glasses and toasts the colleague for a job well done. It is an elegant gesture. It is a moment when the collected body affirms the individual for the contribution made for the flourishing of the whole. It is a lovely moment. Performance, per se, is not the world I know. Beyond third grade, I have never taken a bow with other cast members of a play; I have never bowed after performing with a band or choir. What I have experienced is, after giving a scholarly paper at a guild meeting, noticing the decibels of applause after my paper. In those moments, I am appreciative of the applause. If/when the applause seems to linger, even a bit, I am especially pleased that the audience signals their affirmation of my work. It is a small thing, but it sustains me, lifts me; there is no applause after writing a book. A challenge of teaching adult students is that they want to be affirmed for what they already know. When the desire for affirmation is at the expense of openness to learning, this is not applause worthy. Refusing to learn, yet still wanting applause, can be disconcerting to the hopeful teacher. I recently survived end-of-the-semester student presentations. For the students who engaged the assignment, worked at exploring new materials, and created a meaningful and feasible project, I gave strong and clear affirmation. For at least three students I clapped loudly, uproariously, gladly. For the students who presented half-baked projects which lacked thoughtfulness and made me, at times, question my vocational choices, I did not give negative words of criticism. I instead sat in silence, withholding the anticipated affirmation. Students seemed confused when their paltry presentations did not garner the expected affirmation. I am disappointed when they choose to opt-out of working hard in a course they have enrolled in under their own volition. I am amazed when they are confused about not getting affirmation for poor work.  Here’s the thing about applause. It is a gracious and generous gesture which is needed by us all. It is not to be squandered or provided disingenuously. It is not to be demanded for lazy efforts. The sound of applause and the feeling it conjures is that for which so many of us yearn. This yearning is not selfish or grandiose. It is a heartfelt desire to do work that counts, to do work that is meaningful and held in high regard by our peers and elders. The applause of a single human being is of great consequence.

“I feel like I’m constantly grading now.”  My colleague’s comment was offered as a lament over so much more assessment now that our school had transitioned to an online curriculum. That online courses required more grading was a surprise, and a mystery, to me at first too. Why should the delivery format make such a difference to how a course gets graded? There is an answer to that question, and the nature of learning provides the answer. Online learning is learning mediated by distance and time. It doesn’t have the same social component, or the immediacy of interaction, that learning in class does. Going to class—and therefore, presumably, learning—constitutes the primary blocks of a residential student’s day, but learning done by students in an online school is often piled onto or squeezed into a daily schedule that is not otherwise centered around education. Online learning, therefore, occurs in isolation from many of the reinforcements to comprehension, inquiry, and creativity provided by face-to-face environments, e.g., shared space, informal conversation, direct and immediate access to professors, and even simple sensory aids like handouts, refreshments, show-and-tell objects, and rituals used to begin and end class. These sorts of things all contribute, in face-to-face education, to creating a learning environment that marks the moment of learning: “Now, here, learning is happening,” they convey.   In other words, they help sustain student engagement. Online instructors must find other ways to achieve what going to class achieves for residential students. We have to design our online courses in ways that grab our students’ attention and keep them motivated as they progress. We learn to employ strategies that encourage students to logon frequently, help them feel present within the online space and online community, provide them with frequent opportunities to verify their understanding of course content, to ask questions, to participate in discussion, to receive feedback, and to see their progress.  Frequent, small assessments constitute one of these strategies. They play a role in a larger ecology of learning that has many points and modes of engagement. Certainly, instructors can overload a course with too many little tasks and activities, but, generally speaking, lessons that are chunked into multiple small assignments keep students more engaged than do lessons consisting simply of reading and discussion—leading up to a big test or paper at the end of the course. In addition, when those smaller chunks are graded, students must complete them in order to succeed in the course. Grading creates a point of connection between student and professor, especially if it includes feedback and not just a number. As they accumulate, grades can provide students with a visual picture of their progress. This is the reason why online education can involve so much grading. It’s about engagement. It isn’t necessarily about the need to measure or evaluate every single thing an online student does. One does not even have to award numbers or letter grades each time.  (Continually having to decide where student work falls on a grading scale is what tires instructors like my colleague.) The larger point is that student engagement and motivation are keys to successful learning in general, no matter the delivery method. And this is what teaching online, with its seemingly endless assessment, has taught me about learning. There are many studies proving the connection between engagement and learning. Since I cannot do justice to them here, I will close by reflecting on my own experiences as a learner. Like many future academics, motivating myself to learn was never particularly hard and I got to study things that naturally aroused my curiosity. I did not need bells and whistles to make me interested. But there are always exceptions. When learning is obligatory or seems irrelevant, it’s been the graded assignments that have spurred me on. Several years ago, I had to take a course in driver safety to be allowed to shepherd students on field trips. The course didn’t involve any actual driving but, rather, watching videos and taking a test. I was largely bored and disengaged until it was time to be tested. Then my competitive nature kicked in. When I passed with a nearly perfect grade but did not receive 100%, I wanted to take the course over again!  To this day, I still remember the driving rule that I got wrong on that test.

Persons new to the office of the Dean may soon discover the need to acquire a new set of skills to effectively carry out the job. Those skills range from supervision, pastoral care (yes, more than you imagined!), educational administrative planning, curriculum design and planning, political acumen, budgeting and financial management, and assessment. Of these, none seems to puzzle novice deans more than educational assessment. While it can seem daunting, as I sometimes tell deans asking for help in this practice, "It's not rocket science, but it helps if you know what you're doing." There are six types of assessment practices, which, used together, will provide the dean a multifaceted and holistic view of student learning outcomes. These will provide deans, and Faculty, the data needed to evaluate the effectiveness of the curricula and to make wise and appropriate adjustments. Good data, rigorously derived, make for better decision-making than hunches, good-sounding ideas, predilections, or fads. As well, these assessments will provide the information needed to demonstrate rigorous academic practices to accrediting bodies. The Six Types of Assessments DIAGNOSTIC Diagnostic assessment measures a student's, or a class of students', strengths, weaknesses, knowledge, and skills prior to an instructional set (a course), or prior to starting a program of study. Examples of diagnostic assessments used in theological schools include the TOEFL language proficiency exam given to international applicants, and the GRE. Some schools may administer writing assessments to evaluate the need for remedial work in preparation for academic writing in a degree program. Some DMin programs use the MAT as part of their admissions requirements. Some schools administered the MMPI personality inventory as part of their application process (which, upon taking, the seminary intake counselor suggested I should not go into ministry; advice I ignored and went on to have a successful ministry career. So there.). FORMATIVE Formative assessment practices give evidence of a student's performance during instruction, during a learning experience, or in the midst of a course of study. Formative assessments are applied regularly at intervals throughout the instruction process. An example is a multi-faceted "mid-course" assessment with a faculty adviser to review academic performance and progress through a degree program course of study. This can include a student's self-assessment about their progress in formation goals. For students, formative assessments is an opportunity to receive feedback on academic performance and other goals. SUMMATIVE Summative evaluations measure a student's achievement at the conclusion of an instructional set or course of study. The most obvious course level summative assessment are final exams and the final grade a student receives in a course. At the program level, summative assessments can include a grade distribution analysis, program retention and completion rates, graduating class profiles, and, a grade point analysis of graduating students (highest, lowest, median, average). NORM-REFERENCED This assessment practice compares a student's performance against a national or other "norm" group. Some denominations require candidacy and ordination exams that demonstrate competencies in areas such as biblical exegesis, theology, polity, and worship and sacraments. These denominations can provide comparative data to show your students' placement in norm-referenced evaluations and exams. Due to the loose and broad interpretation of accreditation standards, the wide variety of theological school cultures and contexts, and the range and amorphous nature of what constitutes effective ministry practice or pastoral competencies, norm-referenced assessments are a challenge in theological schools. CRITERION-REFERENCED This assessment practice measures a student's performance against a published goal, specific objectives, or standards. In theological schools the most common criteria are interpretations of accreditation standards in program goals and the derivative student learning outcomes embedded in courses and program components. The application of well-designed assessment rubrics aid in the assessment of criterion-referenced evaluations. BENCHMARK Benchmark evaluations are similar to some of the above. These practices are used to evaluate student performance at periodic intervals, or at the end of a grading period. They can be used to predict student performance on end-of-course summative tests, or, end-of-program competencies evaluations. Benchmark evaluations can also be used to predict student performance post-graduation. The use of alumni surveys evaluated with alignment with degree program goals can help in benchmark assessment. Again, the range ministry contexts in which alumni serve, and the amorphous nature of what constitutes ministry competencies, provide a challenge for theological schools to establish benchmarks. The increasing attention to competency-based programs will likely require schools to identify "benchmarks" as indicators of levels of competencies. How many of these six assessments do you apply in your evaluation practices in your school? Which might you need to implement to provide a richer and more balanced assessment profile for your school? How, for whom, and where will you publish the results of your assessments? For information? For accountability? For reporting?

There are at least two uses of the phrase “good enough.” One meaning commonly found in public discourse denotes minimal, less than best effort. The other meaning, a more technical one from psychology, requires a focused discipline of self-awareness that guards against unhealthy perfectionism (“I can and I will be perfect”) or academic narcissism (“I can and I will know it all”).  I often hear the more negative meaning in theological education: “I don’t want my students to be good enough,” a colleague said to me after reading my recent blog,[1] “I want them to be better than good enough.” After seeing the course learning goal to “define and give examples of good enough pastoral care,” a student remembered a motivational saying from their childhood that ran “good enough is the enemy of excellence.” These are important concerns if good enough means minimal, irresponsible engagement.  However, taken as a discipline of ongoing rigorous self-awareness, good enough teaching and learning is an important part of pedagogical excellence. I believe teaching and learning must be good enough, in this sense, to support thriving.[2]  Good enough teaching and learning involves identifying and responding to the predictable misconnections in our craft so that thriving is an available possibility for all teachers and learners.  A Mishap in Connecting the Dots I recently made a teaching mistake involving extreme connect-the-dots.  While I was familiar with the burgeoning market of adult mindfulness coloring books, a colleague introduced me to “extreme connect-the-dots” at a theory-heavy small academic meeting. The meeting involved wonderful academic papers and a lot of sitting and listening, and the exercise provided a strategy for mindful focusing. I was surprised that connecting the tiny numbered dots from one-to-seven-hundred-and-something to make my own dot-to-dot “Mona Lisa” did help me focus. Later, I decided to try this in my classroom in a week-long intensive course that met from 8:30 am-5:00 pm for five days straight. I am always up for new strategies for focus and energy in such a setting! In addition to trustworthy strategies like varying course activities and scheduling mid-week field work, I purchased an extreme connect-the-dot book called something like “florals and other calming themes.” I tried out a few and then distributed some pages I had not yet completed myself. This turned out to be a mistake.  During the mid-morning break the first day, a student came up and said that I might want to take a look at how she had connected the dots. To my surprise, once the dots were connected, one “floral and other calming theme” image depicted a human being in troubling cultural stereotype.  Embarrassed, I ended that connect-the-dot opportunity and replaced it with coloring sheets.  After processing the mishap with my student, I decided not to use class time to address the event since other students had not worked on the images. In hindsight, not disclosing what had happened to other students was likely a missed teaching and learning moment that could have benefitted the class. While not perfect, the class went well, overall. An Overall, Good Enough Class Overcoming the felt need for pedagogical perfection is a constant struggle. I am increasingly wary of the word “perfect” in my home or classroom.  When my son was in preschool, one day he said, “my day was good, overall.” Struck by his use of the word “overall,” I asked what he meant.  He said that anyone can make three mess ups and have an overall good day.  He proceeded to tell me about his mess ups that day—not listening, not paying attention to his body in space, hurting someone’s feelings. He explained that tomorrow you can do better if you work on these mess ups today.  As a pastoral theologian invested in good enough teaching and learning, I find the idea of an overall good enough day to be a helpful assessment tool. I hope to train and learn with budding theologians whose excellence includes (1) being aware that they will inevitably make mistakes and (2) practicing the courage needed to address and learn from mess ups in order to (3) be ever mindful of confessing and minimizing harm in the world. A good enough learning environment is not perfect, but rather thoughtful and open to continued learning. One way to connect the dots before class, metaphorically, is to think about the students and teachers who do not have the luxury of making mistakes, not even one minor mess up in a day not to mention three.  Absurd Expectations Academic pressures around perfectionism often have complex aspects.  Immigration, poverty, identity politics, the school to prison pipeline, and uneven preparation for graduate education from preschool to PhD contribute additional stress for some students who have to fight for a place at a table that likely was designed without “them” in mind. These same systemic pressures force some students and teachers to have to be perfect in unhealthy ways – no learning curve, no grace in student evaluations, no wiggle room for mistakes. If only we could connect the dots ahead of time, theological educators could better support colleagues and students who live and learn with such heightened anxiety.  “Would you rather imagine me be in prison or in school,” asked a DACA recipient who was talking with my class about the fragility of his citizenship status that pressures him to excel in all areas as a student. With a high school GPA above 4.0, multiple leadership experiences in school and extracurricular activities, and a model resume already at a young age, he recognizes the absurd expectations placed on him to be able to have a chance at keeping his family together. “Imagine,” writes bell hooks, “what it is like to be taught by a teacher who does not believe you are fully human [and therefore] really believes [you] are incapable of learning.”[3] It’s not hard for my DACA recipient friend and teacher to imagine. With my citizenship and other privileges, I commit to stretch my imagination to connect the dots so that no one is dehumanized in my classes, so that everyone has a chance to be good enough, to have overall good days, to thrive in their dreams. And yet the learning around that must be on-going rather than a static perfection. Dreaming of an Open Invitation to Good Enough Learning Days I’ve been imagining what it would look like to treat my syllabus, booklists, classroom space arrangements, and use of time, assignments, and discussions as working together to open a pathway for belonging when absurd expectations exclude some students from thriving. What does it feel like when everything is instead working well in a learning environment?  For me, on the best good enough learning days (1) I feel prepared enough, (2) students arrive prepared and energetic enough, (3) there is enough of a sense that the subject at hand matters deeply, (4) multiple voices and perspectives are voiced and heard, (5) students and I hear new connections and disconnections verbalized in the learning encounter, (6) unanticipated new insights and questions deepen conversation, (7) we are all still thinking about the class beyond the constraints of our time together in a classroom or online, and (8) something from the class may spill over into coffee conversations, office hours, semester assignments, even program assessment. On your best good enough learning days, what would you add? Indeed, such a day would really be a good enough learning day!  I conclude these reflections with some open questions for theological educators teaching religion in a politically challenging time. Are really good days available to all of the students in my class or the colleagues in my school? How about in your context? On each account, what are the avenues of participation for students and faculty? What are the roadblocks? What collaborations, accountabilities, self-reflection habits, and continuing education will help me connect as many dots as possible in advance of the class? How will I identify and respond to predictable misconnections in real time? How can theological educators work strategically in our own classrooms and across institutions to support dreamers’ thriving? [1] This blog follows from a previous blog entitled “The Privilege of Good Enough? Challenges of Radical Hospitality in Theological Education,” published November 9, 2017, at https://www.wabashcenter.wabash.edu/2017/11/privilege-good-enough-challenges-radical-hospitality-theological-education/ [2] I have in mind supporting the thriving dreams of all who embark in teaching and learning in hopes of honing critical tools and collaborative practices to address a suffering world yearning for new ideas and strategies of transformation.  I also have in mind Dreamers as the group of students who seek support for more humane immigration reform. I dedicate this blog to the tenacity of the Dreamers who teach me to work for systems that allow good enough teaching and learning to be available to all. For further information in this historical moment, download a toolkit to support Dreamers here: http://www.scholarshipsaz.org/students/educators/. [3] bell hooks, Teaching critical thinking. New York, NY: Routledge, 2010, p. 2.

Theological school deans are not just theological leaders for their institution, they must be EDUCATIONAL leaders. That is, they must implement sound educational practices related to curriculum, instruction, supervision, assessment, and administration. There is a variety of ways to assess...