Skip to main content
Home » Resources » Resource

Resources

The Wiley Handbook of Cognition and Assessment: Frameworks, Methodologies, and Applications

This is a book for assessment professionals; it is the rare teacher in higher education who would be able or willing to get this deep into the weeds of higher education assessment design and deployment. Many of the fifty-two authors contributing to this volume are affiliated with the Educational Testing Service and most seem to be practitioners of assessment for corporations or academic institutions. As the foreword clearly states, the authors are a mix of psychometricians and cognitive psychologists “bringing measurement science into real-world practice” (xx). The book is geared to a multidisciplinary audience, including “educational measurement researchers,” “assessment development practitioners,” and graduate students interested in the measurement of cognition. It is not suitable for classroom teachers interested in exploring course or program assessment. The greatest value of this volume for the average faculty member at any type of institution will be to provide a lens through which to view the many requests from higher administration to comply with particular types of assessment practices. The first part of the book, which comprises ten chapters, covers frameworks for assessment, and several of the earlier articles in this section are general enough to provide useful insight into assessment protocols. Most of the other two sections, focusing on Methodologies (six chapters) and Applications (seven chapters), are so detailed and technical as to be inaccessible to non-professionals in the field of assessment. A few articles stand apart from this: “Assessing and Supporting Hard-to-Measure Constructs in Video Games” by Valerie Shute and Lubin Wang, and “Conversation-Based Assessment” by G. Tanner Jackson and Diego Zapata-Rivera – both provide interesting alternative visions for approaching assessment and offer promising departures from the typical standardized written assessment. This volume is full of cutting-edge research on cognition and assessment couched in language inaccessible to those outside the field. The brief “Final Words” section contains a plea that classroom faculty should note: “in order for the work in this Handbook to have the best chance of finding its way into practice, we need to be ambassadors of this research while understanding that it will require time, patience, and functional prototypes to persuade clients and users to believe the scientific and social evidence” (586). This is not the entry-level volume that will allow faculty to help as ambassadors of this sort. This anthology will be of interest primarily to those whose professional focus for research or practice is cognition and assessment in education.

Innovative Practices for Higher Education Assessment and Measurement

Editors Cano and Ion offer a group of international voices in their contribution to the Advances in Higher Education and Professional Development Book Series (series editor, Jared Keengwe), with this volume focusing on innovative practices in assessment. The book’s organization structure involves general contents followed by a detailed table of contents with full abstracts for each chapter, then a thorough summary of each of the twenty authors’ works in the preface before turning to relevant chapters. Such a format facilitates pinpointing the reader’s interest in particular methodologies for assessment, measurement, and data-gathering. The volume itself is divided into three main sections: (I) Theoretical Approaches on Students’ Assessment, (II) Research-Based Evidences on Assessment, and (III) Innovative Practices in Students’ Assessment. The editors claim that the purpose of their book is to attend to an international level of assessment innovation with a triple perspective (theoretical, practical, and research-based), that integrates theory and practice to enrich the field of assessment (xvii). Authors have created scenario-specific assessment innovations and practices in each of their chapters so readers have a variety of choices from which to draw ideas. Section I focuses on engaging students in self-, peer-, and professor-based assessment loops. Self-regulated learning that is based on assessment, both in face-to-face and online environments, is addressed in the chapters one through three, and six. Competency-based assessment, where student competencies are measured against standards of performance, is illustrated in chapter four. “Brain-Based Learning” discusses the neuroscience of feedback and application to contexts in chapter five. “Comparative Judgement” is introduced in chapter seven as an alternative assessment domain to counter standardized tasks and test scoring. Section II moves to research about assessment versus testing cultures, beginning in chapter eight with meaning-oriented learning rather than recall and recognition learning. Research in this chapter shows that students will make the effort to succeed when asked to do more complex thinking than is required for standardized testing. Feeding back and feeding forward are discussed as case studies and analyses in chapters nine and ten. Self-direction and student participation are also analyzed in case studies in chapters eleven and twelve, followed by online assessment projects conducted in Portugal and Spain in the remaining two chapters of this section. Section III names innovative practices in student assessment. The remaining chapters in the book (fifteen through twenty) attend to pedagogical approaches to incorporate assessment into the learning endeavor. The chapters include case studies and strategies. Practical applications including project-based learning and formative assessment are outlined by each set of authors. The book is a reference resource, best used by browsing topics and making choices about which innovative approaches to assessment best fit one’s own context. There is some overlap in authors’ experiences, reinforcing the validity of the international research and pedagogical approaches. This resource, filled with illustrations, should be available in libraries for institutions of higher education that are working on self-study and self-assessment. There is much here to aid teachers in honing their attention to assessment excellence as part of the pedagogical task.

Learning, Teaching and Assessment in Higher Education: Global Perspectives

This global study of teaching, learning, and assessment goes beyond the typical single country context to extend to good pedagogical practice on six continents.The argument of each chapter is supported by examples of good practice accounts from around the world, a collection that forms a refreshing change from a generic case study model. Although the examples lean most heavily toward English-speaking institutions and classrooms, there is significant attention paid to various elements of pedagogy from many cultural perspectives. The author takes great care throughout the book to consider all elements of the changing higher education landscape, including the changing student body, changes in technology, and changes in expectations about the goals of higher education and graduate employability. The twelve chapters of this book take a comprehensive view of diversity in higher education teaching, learning, and assessment. The book opens with a consideration of cultural mores and assumptions that directly affect interactions in higher education. Brown looks both to the past and the future in subsequent chapters, noting pedagogical traditions and innovations in the context of today’s higher education landscape. She argues that we must adjust to a technology-rich world that necessitates more focus on “learning how and learning why than on learning what” (21). Her view of technology in the balance as both a distraction and a valuable addition to certain aspects of both teaching and learning is refreshing, as so many books either glorify or decry technology in classrooms and society. This ability to see things in the balance is one of the greatest strengths of this book: rather than arguing for a “best” way to teaching or learning or assessment, this book offers multiple possibilities from multiple contexts and thus leaves much to the reader to judge based on his or her context and constraints. Brown identifies a few global trends. The most widespread seems to be a move from transmissive to transformative education. She notes that there is a “movement from perceiving the university teacher as an all-knowing, unchallengeable authority figure” (27) and parallel a movement by institutions and disciplines toward encouraging learning outside of the lecture hall. Another trend is teaching toward the multiple literacies expected of a twenty-first century graduate, looking well beyond academic literacy to digital, assessment, and interpersonal literacies (88). Finally, Brown notes that all education needs to think of itself as taking place in a global environment. This book is itself a fine way to encourage broader thinking about pedagogical contexts in higher education: our students are shortchanged when we privilege our own pedagogical traditions and ignore the broader, global context of higher education. The strengths of this book are many. For instance, the author provides substantive and exhaustive bulleted lists in each chapter, a diverse set of highlighted good practice accounts, and a full chapter devoted to higher education teacher development. The book is easy to navigate, written in clear prose, and at once expansive but grounded in particulars. I would recommend this book highly to teachers and administrators in higher education across the disciplines.

Ten curriculum assessment tools every dean needs. Part 2: Syllabus Assessment Rubric Checklist

Theological school deans are not just theological leaders for their institution, they must be EDUCATIONAL leaders. That is, they must implement sound educational practices related to curriculum, instruction, supervision, assessment, and administration. There is a variety of ways to assess...

Ten curriculum assessment tools every dean needs. Part 1: Outcomes Alignment Worksheet

Theological school deans are not just theological leaders for their institution, they must be EDUCATIONAL leaders. That is, they must implement sound educational practices related to curriculum, instruction, supervision, assessment, and administration. There is a variety of ways to assess...

Eight Big Ideas on Assessment

Theological schools and seminaries have been relative latecomers to rigorous practices of educational assessment. There are varied and plausible reasons for that which "make sense." However, in the current age of higher accountability to accrediting agencies, stakeholders, and educational consumers,...

Specifications Grading: Restoring Rigor, Motivating Students, and Saving Faculty Time

Concerns about mastery of learning outcomes or competencies, grade inflation, student motivation, and faculty time compel reflection on how we assess students in higher education. In Specifications Grading, Nilson critiques the traditional, point-based grading system and argues that students should be assessed on whether they have mastered course learning outcomes. She proposes specifications (specs) grading as a positive alternative to the current grading system. Nilson makes the case for specs grading in ten chapters. Chapter 1 examines critiques of the traditional grading system and offers fifteen criteria for judging a grading system. Chapter 2 briefly introduces learning outcomes and course design. In chapter 3, Nilson shows that grades should correspond to whether a student has mastered learning outcomes. Nilson ties grades to specific learning outcomes: a student can earn higher grades for demonstrating the amount of their learning, mastering more learning outcomes, or both (25). In chapter 4, Nilson argues that assessments should be graded pass/fail because this raises the expectation for a passing grade to the B-level. This also potentially reduces faculty time spent grading as it eliminates the need to justify partial credit. In chapter 5, Nilson outlines some aspects of specs grading: a single level rubric, faculty clarity on assignments and assessment, student choice, and opportunities to resubmit work. Chapter 6 describes how to convert specs grading to final course grades by either employing a point system for assessment or requiring students to complete certain assessments (bundles or modules) to achieve a particular course grade. Chapter 7 offers examples of courses that employ specs grading in diverse disciplines. After addressing theories of motivation, chapter 8 demonstrates how specs grading can motivate students to master learning through student choice. Chapter 9 explains how to design a specs grading course and introduce students to this grading system. Chapter 10 evaluates specifications grading according to the fifteen criteria set out in chapter 1. Among its strengths, Specifications Grading offers experiential evidence from faculty as well as examples of specs grading from diverse disciplines. These examples encourage faculty to creatively re-envision their courses. Moreover, Nilson challenges faculty to draw on adult learning theories and motivational theory to promote mastery of course outcomes and encourage students to achieve their potential. Nonetheless, Nilson recognizes faculty’s hesitation in committing to a new grading system. As a result, Nilson describes (pure) specs grading courses as well as blended courses: courses that employ a mixture of point-based assessment and specs grading. These options enable faculty to slowly adjust to the new grading system or to attend to departmental or institutional grading expectations. Nilson argues provocatively for the ways specifications grading motivates students and raises the standard of student work. To do this, faculty must know their expectations for student work and be clear in the directions for assignments. Moreover, faculty must expect students to fulfill those expectations – to take responsibility for their own grades and master course outcomes.

Using Technology to Gather, Store and Report Evidence of Learning

In this short synopsis, Using Technology to Gather, Store, and Report Evidence of Learning from NIACE’s Digital Learning Guides series, Terry Loane presents an overview of the current prevailing technological methods for collecting and reporting evidence of learning. Largely, the guide is sufficient and serves as a solid reference for non-technical educators; it demonstrates the best methods for individual circumstances by providing ten vignettes of real-life situations. Loane’s opening theme of “a revolution whose time has come” (4) flows fluidly through the seven chapters, comparing and contrasting old ways with the new. Loane explains both the need and value of utilizing common elements of modern technology like mobile devices, online tools, and e-portfolios, in order to efficiently and effectively collect and present the fruit of one’s learning. He notes that the days of simply having to state that a qualification was met are gone; now the learner can present learned skills using easy and effective methods like mp3 recordings, YouTube videos, and blogging (55). The majority of the book covers the various forms of evidence gathering, technological means for data collection, and options for long-term cataloguing and presentation of one’s learning. The methods covered do offer a satisfactory representation of current options; however, as Loane notes, “the world has indeed moved on in just five years” (23). With rapid technological shifts, we must be open to adjusting our methods. Even since this book was published in early 2014, technology has moved more toward video, the one method Loane warns readers includes a range of issues involving lighting, intrusiveness, file sizes, and non-standardized codecs (28-29). As these obstacles are fast being worked out, and becoming more standardized, this guide may have a short shelf life and be in need of a second edition in the near future. What I found most intriguing was Loane’s futuristic idea – and possible current direction in the use of technology in preserving evidence of learning – of developing an “Online Record of Learning, Experience, and Achievement” (5) that will “rehumanize learning” by showing that learning is more than marks on paper (56, 57). The development of an online clearinghouse of sorts for learners and assessors to store and share evidence of learning is one that could greatly benefit the educational community as a whole. Loane rightly demonstrates that even technology that learners and assessors use everyday (like smart phones and tablets) has all the tools necessary to easily present learning and to create such a system, offering the ability to take certifications and evidence of learning along as one moves from institution to institution and job to job. I recommend this guide as a suitable reference tool for the non-technical educator, learner, or assessor seeking to move from old paper-and-pen methods to contemporary digital options. As Loane demonstrates, the benefits of embracing technology in learning far outweigh the hindrance of changing former traditional methods.

Assessing and Improving Your Teaching: Strategies and Rubrics for Faculty Growth and Student Learning

Assessing and Improving Your Teaching by Phyllis Blumberg describes a comprehensive plan for teacher development and offers creative strategies for teachers at all stages of their professional career. Blumberg identifies many ways by which faculty can gain insights and improve the quality of their teaching to foster better student learning. This book is an excellent resource for both beginning instructors and more experienced ones especially in terms of recommended methods and tools for assessing faculty growth and learning outcomes. The book goes beyond well-documented analysis of individual strategies and contributes to the relatively few studies that integrate strategies from a hierarchical approach to improve teaching. For Blumberg, “a hierarchical approach” is one “that places the locus of control with the instructor who wants to improve, rather than with others who need to judge teaching performance,” and “provides a robust teaching enhancement process” (4). The first part of the book describes Blumberg’s hierarchical approach by initially establishing criteria that define teaching standards. Borrowing a commonly used, learning-centered approach to teaching, Blumberg focuses primarily on what the instructor does to promote student learning and discusses misconceptions about teaching. She then recommends alternative ideas and essential aspects of teaching for “deep and intentional learning.” The second and third parts of the book build on each other by describing a constructive self-assessment model which uses self-assessment rubrics for purposes of improving and assessing teacher effectiveness. Blumberg believes that teaching is composed of many different skills that can be learned. However, she encourages “systematic growth” which results from periodic, critical reflection on one’s teaching along with on-going critical review and the incorporation and documentation of both. In addition to discussing ways to improve teaching, Blumberg proposes three types of principles for assessing teaching, namely: (1) the context for assessment or what to assess; (2) the assessment methods or how to assess; and (3) the results of this assessment process. She notes that many professors who serve on promotion and tenure committees regularly comment on how little is actually analyzed or documented about the teaching process or teacher effectiveness. Using multiple sources of data about teaching effectiveness, Blumberg shows there is a need throughout the academy to supplement student course evaluation data with other appropriate procedures and tools” (116). Opposed to the older instructor-centered models in which assessment focuses on teaching performance or lecturing skills, she emphasizes other roles and skills such as course alignment, organization of educational experiences, and reflection on instruction. The tools for self-reflection and analysis include rating scales and descriptive rubrics; Blumberg also describes five cases from very different contexts of teaching and faculty members with different levels of experience.  This book is a valuable contribution to literature on the evaluation of teaching in higher education because it contains both assessment forms that others can use to assess teachers as well as tools that instructors can use for self-reflection and analysis.

Starting a new degree program is the last thing a dean should do

When a school discovers a declining trend in enrollment it's time to huddle for some frantic strategic planning. If anxiety about the enrollment numbers is high enough some will want to talk about how the times they are a changin'...