Course evaluations, Spring 2017 edition

I just took a first look at my course evaluations for Spring 2017, and once again they show a striking pattern that has dogged me for several years. I often teach back-to-back sections of the same course, at 8:00 AM and 10:00 AM. It’s the same homework, same assignments, same in-class activities—but the course evaluations from the 8:00 AM class consistently come in lower than the 10:00 AM class. Our evaluations use a numerical system, a 1–5 Likert-type scale, and then means get reported back to us. What I’ll show you below is the difference between the 10:00 AM mean and the 8:00 AM mean.

Item Diff.
The course is well-organized. .40
The course textbook and other reading assignments are appropriate in content. .70
The course tests and other evaluations are appropriate in content and difficulty. .34
The course assignments are reasonable and appropriate in content and difficulty. .27
The course is demanding in comparison to other courses. .33
The course has increased my knowledge or understanding of the subject. .71
The course is excellent. .53
The overall class experience has enhanced my ability to think clearly, logically, independently, and critically. .58
The overall class experience has contributed to the development of my sense of personal values and moral integrity. .58
The professor shows interest and enthusiasm for teaching the course. .16
The professor is available outside of class for consultation if needed. .06
The professor is prepared for class and makes good use of class time. .44
The professor presents course material in a clear and engaging manner. .71
The professor is an excellent teacher. .53

Although I’ve seen this pattern for several years now, I still find it striking, and the magnitude of difference on some of these items—remember, it’s a scale of 1 to 5—continue to perplex me. I don’t think I’m that different at 8:00 AM compared to 10:00 AM. It’s particularly striking that the item about the textbooks and readings shows one of the highest differences, although these are identical for both sections and unaffected by my classroom demeanor/deportment and therefore independent of practice, adrenaline, mood, or any other such factors that might fluctuate over the hours I’m in class. Might there be a kind of halo effect here because of students’ general displeasure with having any 8:00 AM classes at all?

Practice what you preach, online educational video edition

I’ve just been watching a twenty-minute online educational video about making online educational videos. By the halfway mark, the gentleman lecturing into the camera has told viewers that online educational videos should include a lot of images and should be five or ten minutes long, maybe fifteen at the absolute most. In case you missed it the first time, this advice came from a talking head lecturing into the camera in a twenty-minute online video.

TALMID 2017

If you teach Biblical Hebrew in a seminary, university, or college, you might consider attending TALMID 2017, a workshop in communicative pedagogy for Biblical Hebrew. I would love to participate, but cannot for reasons of both cost and scheduling; however, I have previously attended two similar workshops, one by the CoHeLeT Project (with some of the same leadership team as TALMID) and one by the Biblical Language Center. Adopting communicative teaching/second language acquisition techniques has transformed my experience of teaching Biblical Hebrew, and all for the better (though not without growing pains). At any rate, I recommend the experience!

Character-izing gamification

For the convenience of anyone who wishes to follow along with my November 20, 2016 Society of Biblical Literature presentation entitled “Character-izing Gameful Learning: Using Student-Guided Narratives to Motivate, Engage, and Inform Learners,” here is the slideshow, presented as a PDF with one slide per page. The program book abstract reads as follows, though it’s no longer 100% accurate to the presentation:

Religion 101: Old Testament in Context is the first of three religion courses required of Pepperdine University undergraduates. For some time now, my students have encountered foundational course material (basic facts and orientation to key questions) in the form of 21 substantive homework assignments delivered within Pepperdine’s course management system. These lessons resemble a textbook in informal prose; students interact with the lessons by reading materials directly in the LMS, by following hyperlinks to other online readings and videos (mostly from Bible Odyssey, Oxford Biblical Studies Online, and educational YouTube channels), and completing reading quizzes in the LMS. Beginning in Fall 2010, I began to inject elements of gameful learning and teaching by introducing the “Worlds of Biblecraft” metaphor, switching to accrual grading, and introducing content-themed terminology to describe course activities (“learning tribes” instead of “small groups,” for example). Since then, “gamification of education” has gained steam worldwide. However, the blossoming literature on gamification can be hard to review, interpret, and apply. As Karl Kapp (2012) notes, “There are literally thousands of books, articles, and newspaper reports on the effectiveness of games and gamification. Some of the reporting is based on theoretical underpinnings, some of it is based on opinion, and some of it is based on wishful thinking.” In the Spring and Summer terms of 2016, I sought to contribute to the empirical research on the effects of gameful learning in biblical studies. Supported by a grant from Pepperdine University’s Technology and Learning department, I reframed one-third of the homework assignments as narrative “choose your own adventure” experiences using the fictional characters of Deanna Jones and Larry Croft as guides to help students explore the biblical stories of the creation of humanity, the exodus, the Israelite “judges,” the Assyrian domination of Israel and Judah, the rebuilding of Jerusalem after the edict of Cyrus, and the trials of Job. Core elements of the previous versions of the assignments—biblical readings, secondary readings and videos, and quizzes—remained fundamentally the same as in the discursive version. Learning gains were measures by comparing aggregate quiz and test scores in the control (pre-revision) and experimental (post-revision) groups. Additionally, student attitudes toward the two different types of assignments were measured self-report instruments.

Just a game?

jag-rbgFor the convenience of anyone who wishes to follow along with my November 19, 2016 Society of Biblical Literature presentation entitled “Just a Game? Exegesis, Theology, and Ethics in Five Recent Bible-Themed Board Games,” here is the slideshow, presented as a PDF with one slide per page. The program book abstract reads as follows, though it’s no longer 100% accurate to the presentation:

In both the introduction and the conclusion to their groundbreaking study Toying with God: The World of Religious Games and Dolls (Baylor University Press, 2010), Nikki Bado-Fralick and Rebecca Sachs Norris noted that “[m]ost religious board games are simply religious versions of familiar games like Monopoly or Risk, with churches and missions replacing railroads and hotels” (177–178; cf. 2). In the years since then, several new Bible-themed board games have appeared, including Genesis (Gigantoskop, 2010), Kingdom of Solomon (Minion Games, 2012), Kings of Israel (Funhill Games, 2014), and Commissioned (Chara Games, 2015). Each of these games seeks to provide a kind of religious edutainment in which players experience biblical narratives and themes by way of engaging game mechanics. In general, these games exhibit better game design and production values than previous attempts. Moreover, despite clear family resemblances to existing secular games, they depart from the trend noted by Bado-Fralick and Norris of reskinning prior exemplars. Like their forebears, however, these games are “expressions of religiosity growing out of contemporary modes of communication and exchange,” each with “layers of culture, relationship, and identity embedded in [it]” (Bado-Fralick and Norris, 175)—not to mention layers of exegesis, theology, and ethics. This presentation peels back some of those layers with respect to Genesis, Kingdom of Solomon, Kings of Israel, and Commissioned, and the presenter’s own work co-developing a fifth such game, Crossroads (Trivium Studios, 2016). Coherence and/or incoherence between the games’ implicit theologies and those held by the presumptively evangelical Christian audience, supportive and/or subversive approaches to the biblical source material, and representations of divinity, ethnicity, and gender in each game will receive special attention.