Issues

Introduction to Issue Twenty-One: Open Educational Resources

As we design our courses, we are participating in a larger project to design the future of higher education, and as we develop our skills in teaching, we must also develop our engagement with the larger questions of what our students will need to thrive in a world that is currently presenting so many challenges to their livelihood, health, and happiness.
—Robin DeRosa, A Foreword to Toward a Critical Instructional Design

As instructors in different contexts—an English program in a public two-year college, a language and linguistics department in a small liberal arts college, and digital scholarship services in a library at a major research university—we the co-editors of this special issue on Open Educational Resources (OER) have seen the attitudes toward and practices of OER shift over the last several years. Embraced by college and university administrators and funded by national and state initiatives as a means to lower barriers of entry for low-income college students, OER have also become a cornerstone of open pedagogy methods that work to make connections between the classroom, the university, and the world beyond the academy. Since the emergence of COVID-19, OER creation has expanded rapidly to accommodate the demands of remote and hybrid teaching and the ethical concerns of teaching in an increasingly inequitable world. The emphasis on equity and access has resulted in an increased quantity of OER material and platforms created and circulated online. The OER work that produced this glut of materials received a range of levels of institutional and financial support, ranging from dedicated individual scholars’ unpaid labor to corporations that produce and sell access to resources and platforms. At the same time, remote and hybrid teaching has also prompted for many instructors a series of questions about established pedagogical approaches. Some traditional teaching and learning practices developed in in-person learning environments have buckled upon adaptation to this new environment. Beyond that, online and hybrid teaching practices have impacted the way we teach in person now that we are returning to campuses. In this special issue, we explore questions and concerns that OER inspire about teaching practices, pedagogy, course planning, labor, and assessment.

While economic concerns are often the impetus for institutions and scholars to consider using or investing in OER, these free-to-use resources open the door for open education practices (OEP) as well. Unlike traditional proprietary textbooks and materials, OER can facilitate Open Pedagogy by promoting learner-driven approaches, fostering the development of digital literacies, and prioritizing accessibility, transparency, and collaboration. Open Pedagogy, stemming from Paolo Friere’s Pedagogy of the Oppressed, also restructures the traditional classroom because it abandons the paradigm of the static banking system of education and envisions the process instead as a dialogue, a conversation among students and educators working collaboratively as knowledge producers. At the same time, the alignment between OER and OEP that “focus on collaboration, connection, diversity, democracy, and critical assessments of educational tools and structures” is not cost-free; it consumes a great deal of time and labor, often unpaid, by many of the people involved.

Committing to the creation, adoption, and implementation of OER presents challenges, as it limits curricula to free or openly licensed materials and requires labor that may not be compensated or count towards tenure and promotion. Using OER in a curriculum demands labor intensive development and requires ongoing maintenance to update software, links, and interfaces on top of keeping content current. This work by instructors tends not to be recognized and/or remunerated by institutions. There have been several attempts to establish some guidelines for the assessment of digital projects, yet these efforts are not widely and formally accepted in most colleges and universities. And while funded initiatives for faculty and staff to familiarize themselves with and develop OER are increasing, these are not yet sufficient to support and sustain these types of projects and initiatives.

As the authors of this issue express in many ways, if our pedagogical approaches are not neutral, then neither are our teaching materials. For this special issue on OER, we are excited to share articles that explore the increased emphasis on and institutional demand for free teaching materials, tools, and platforms in the context of the COVID-19 pandemic and beyond. As college instruction went online in the early days of the pandemic, many professors started using OERs for the first time, often only learning their politics and practicalities on the fly. The authors collected here investigate multiple OER practices, teaching and learning frameworks, and resources that they have built into meaningful and inclusive future pedagogies, but also share critiques of OER design, distribution, and institutional management approaches.The articles in this issue explore the challenges of and inspirations for not just creating OER, but also of selecting, implementing, and administering already existing OER, from the perspective of educators, students, online education developers, librarians, instructional technologists, and administrators.

We aim to highlight disciplinary as well as institutional diversity: we showcase teaching in languages, literature, classics, psychology, math, and astronomy in small regional community colleges through large public universities. Unsurprising given the collaborative nature of so much OER work, six of the ten pieces are the product of co-authorship. The authors include educators from diverse positions in the division of academic labor, including OER faculty and librarians and global non-profits (like the Institute for the Study of Knowledge Management). The articles expand on the complexities of different stages of OER development: from assessing existing OER, to adoption for specific courses, to faculty and student perceptions of OER used in the classroom. Our authors provide critical context and challenge us all to participate in the broader shift to Open Educational Resources with attention and intention.

The first half of this issue examines classroom experiences. Philosophical perspectives on classroom needs often drive the instructors to adopt OER, but so do the practicalities of particular assignments. These articles move from planning class sessions, to broader syllabus concerns, to tools adoption, and finally to student evaluations of teachers who assign OER. Beginning with Emily Scida’s “How the Pandemic Transformed Us: The Process and Practices of a Diversity, Equity, Inclusion, and Accessibility-Focused OER Project for Teaching and Learning Spanish” we jump into the application of transformative learning theory in a Spanish language-learning sequence. Scida details the steps from the first stage of engagement in an OER project at the University of Virginia through the lenses of transformative learning theory. Scida’s intervention centers on addressing diversity, equity, inclusion, and accessibility (DEIA) in multiple levels of Spanish courses, highlighting the meaningful impact on faculty, the program, and the institution.

With careful attention to the goal of equity espoused by many who choose OER, Taylor Clement’s “Building a Community of Voices in Professional Writing” looks at what it takes to address intersectional audiences in an upper-level online professional writing class at University of Louisiana at Lafayette. The article provides “an example of how educators can employ Open Educational Resources (OER) to foster diversity, equity, and inclusion in professional writing courses.” As she argues, “Instructors should carefully consider the voices that open access resources amplify.”

Danica Savonick’s “Teaching DH on a Shoestring: Minimalist Digital Humanities Pedagogy” describes course design through assignments to show “how free, low-cost, and open-source tools can be used to help students increase their digital literacy, including their awareness of the ways technologies reproduce and challenge conditions of inequality.” Its focus on equitable education and readily available tools parallels both the goals and philosophy underpinning much of the movement behind OER.

Randi Shedlosky-Shoemaker’s “Don’t Judge a Book—But What about the Professor Who Assigned the Book?” study builds on existing research to determine if OER yields more positive student evaluations. They attempted to determine “whether participants saw the professor as caring, supportive of students, enthusiastic about teaching, and committed to student learning” based on their choice to use OER.

As these articles show, attention to student diversity and financial barriers to access can motivate the choice of OER, but there are many other crucial reasons the movement is gaining momentum. Digital texts can be quickly distributed, can accommodate a diverse student body, and they also enable new pathways to old knowledge. Not all OER are centered on lowering cost for students; in some cases the ability to access texts online enables new connections that reimagine, for instance, ancient language learning. Farnoosh Shamsian and Gregory Crane, in “Open Resources for Data-Driven Learning of Ancient Greek in Persian,” explore the use of localizable grammar explanations and cross-lingual annotations on ancient Greek open resources to develop teaching and learning resources for Persian speakers often excluded by the predominance of the presumption of familiarity with English in ancient-language learning materials.

The following three articles are case studies of building or using OER in different disciplines and institutions. They look at the benefits of crafting renewable assignments, and explore in detail the additional burden that offering OER places on faculty, and the layered difficulties confronting instructors using OER to serve missions of equity and inclusion. In the first in this series, Judy Orton Grissett and Feng-Ru Sheu’s “Creating Active and Meaningful Learning through a Renewable Assignment: A Case Study in a Human Growth Development Psychology Course” outlines a model for using OER to facilitate the extension of assignments’ relevance to students beyond the single semester in which they are due, contributing to learning for other students and for the general community.

Ian McDermott, Joshua Tan, Emma Handte, Alioune Khoule, Marta Kowalczyk and Rena Grossman follow with “Implementing OER at LaGuardia Community College: Three Case Studies,” outlining their diverse experiences putting OER into practice in the STEM fields of math, astronomy, and chemistry in their public community college in New York City with the assistance of a state-level grant. Their detailed case studies come with helpful advice regarding taking the opportunity the shift to OER to not only think about eliminating costs, but to build serious consideration of accessibility and universal design into the born-digital resources provided.

While higher education institutions may encourage OER creation, adoption or adaptation, Jennifer Epley Sanders, Daniel Bartholomay, Amanda Marquez, and Anthony Zoccolillo’s “An Interdisciplinary Case Study of Cost Concerns and Practicalities for Open Educational Resources at a Hispanic-Serving Institution in Texas” illustrates the significant labor burdens for faculty undertaking such projects. Teaching with OER, though likely beneficial for students, and potentially supportive of diversity, equity, and inclusion initiatives, often results in unrewarded and uncompensated labor for faculty at traditionally underfunded institutions, especially when maintenance and assessment are not counted toward tenure and promotion.

The last two articles round out the Issue beautifully by addressing OER at an organizational leve—how do these projects play out beyond the solo classroom, how do they get remixed, who chooses to adopt OER, and what keeps faculty invested? We see careful consideration of the distinct categories of users and their different expectations of OER searches in Michelle Brennan, Selena Burns, Cynthia Jimes, Jeff Hecker, Anastasia Karaglani, and Amee Evans Godwin’s “Five Faculty and Library Curation Personas to Aid OER Discovery Solutions.” The authors’ study sought to understand, through the use of User Experience (UX) research, the potential obstacles to OER adoption at the search phase by creating “user personas” of different kinds of instructors and librarians, noting their needs and potential pain points in their projects, allowing for better OER discovery solutions.

We conclude our issue with “Worth the Time: Exploring the Faculty Experience of OER Initiatives” by Stacy Katz and Shawna Brandle, who investigate faculty perceptions of adopting OER through an institution-level initiative. They found that across the City University of New York system and across different faculty levels (associate and full), instructors primarily chose to shift to OER because it benefited the students to have no-cost course readings. Their qualitative study addresses faculty motivations and the conditions of adoption, offering clear areas such initiatives could take in order to facilitate greater uptake among faculty.

We, the editors, would like to thank the JITP Editorial Collective and our incredible Managing Editor, Patrick DeDauw, for their monumental effort in migrating to Manifold, led by the inimitable Kelly Hammond and phenomenal committees headed by Brandon Walsh and Anne Donlon, as well as all who undertook interim workflows for the production of this themed issue. We also extend thanks to Matt Gold and Luke Waltzer, JITP alumni and CUNY GCDI and TLC superstars for their help and support in this transition.

We are proud to publish this special issue on CUNY’s Manifold instance. JITP grew in part out of the CUNY Graduate Center’s commitment to community platforms of exchange and has happily lived for its first twenty issues on the CUNY Academic Commons, a WordPress-based blogging and networking site developed to foster scholarly exchange across and between CUNY campuses. JITP has always been enriched by its relationship to the community-building work central to wonderful projects like the Commons and Manifold, both of which represent CUNY’s commitment to developing homegrown open infrastructure. As we look forward, we are grateful for all the Commons team has done for us, and are excited to shift our production process to Manifold, an open-source digital publishing platform developed by the CUNY Graduate Center in partnership with The University of Minnesota Press and the development firm Cast Iron Coding. Manifold represents a new approach to academic publishing generally, and to OER publishing specifically, allowing readers to collect, share, and collaboratively annotate articles. All issues of JITP going forward will be published directly on CUNY’s Manifold instance, and our entire archive will soon be available on CUNY’s Manifold instance. Using these features to connect JITP readers to authors and other readers directly in our openly published text supports our OER mission and the spirit motivating this special issue. To this end, we hope you’ll consider creating a reading account to publicly annotate and share, and learn more about reading on Manifold and creating Reading Groups. We hope you will join us!

About the Editors

Inés Vañó García is an Assistant Professor of Spanish at Saint Anselm College. She graduated in Hispanic Linguistics from the Graduate Center, CUNY where she also completed the Interactive Technology and Pedagogy Certificate, and was recognized by the Graduate Center Award for Excellence in Teaching (2020). Her research focuses on the political history of the teaching of Spanish in the United States. Her dissertation, “Discursos institucionales y manuales de texto de la American Association of Teachers of Spanish (1912–1944): un estudio de la historia política de la enseñanza del español en Estados Unidos,” draws from the history of the American Association of Teachers of Spanish, along with key linguistic instruments created by its members, and examines its role in the creation and shaping of a new academic field. She has served on the Editorial Collective of The Journal of Interactive Technology and Pedagogy since 2018.

Jojo Karlin is the Digital Scholarship Specialist at New York University Libraries. Previously the Manifold fellow focused on developing the project for Open Educational Resources, she received her PhD in English from the Graduate Center, CUNY, and won the 2021 Dissertation Showcase prize for her illustrated dissertation, “Yours Sincerely, Virginia Woolf: Virginia Woolf’s Poetics of Letter Writing.” She has served on the Editorial Collective of The Journal of Interactive Technology and Pedagogy since 2016 and co-edited Issue 14 with Danica Savonick and Stephen Klein. At NYU Libraries, Jojo works on open scholarship and digital humanities, and she has been developing her research practice of visual notetaking and conference illustration.

Krystyna Michael is an Assistant Professor at Hostos Community College, City University of New York. Her current book project, The Urban Domestic: Homosocial Domesticity in the Literature and Culture of 19th- and 20th-Century New York City, explores the relationship between transformations in urban planning and domestic ideology through American literature of the city. She has published articles and reviews in The Edith Wharton Review, The Journal of American Studies, and Postmedieval and is a member of the Editorial Collective of The Journal of Interactive Technology and Pedagogy. She works on the development teams of the grant-funded CUNY-based OER platforms, Manifold and the CUNY Academic Commons, and her courses center around American literature and writing, the digital humanities, and architecture and city space.

Creating Active and Meaningful Learning through a Renewable Assignment: A Case Study in a Human Growth Development Psychology Course

Abstract

Data show that homework accounts for about 20 percent of academic tasks (Cooper 2001), and in most cases, these assignments are limited to the semester in which they are completed. Further, students sometimes feel unmotivated to do their best on homework assignments because of the perceived lack of connection to a greater context. Without the connection to a larger purpose and the possibility of carryover into future semesters, students often dispose of completed homework at the end of semester. In this article, we outline an instructional approach using open educational resources that allows students to contribute their effort to something larger than homework assignments while practicing retrieval and repetition of course material. Specifically, through a renewable exam-review assignment based on an open textbook, forty-one students in a developmental psychology course wrote a set of multiple-choice questions and provided feedback to peers’ questions, as well as a description of student feedback about the assignment compared to a paper assignment, and the instructor’s views of the renewable assignment. We share lessons learned, including changes to pedagogy and assignment design using OER we undertook to keep the students at the center of assignment creation, design, and implementation.

Keywords: open educational resources (OER); multiple-choice questions; open pedagogy; renewable assignments.

Introduction

Assignments, such as projects, papers, and presentations, are often designed to allow students to review and apply material they have learned in a course to better understand the content covered in the assignment (Cooper 2001). Oftentimes, however, the assignment is limited to the length and scope of the course, meaning the work students do on them does not carry over into future terms or directly benefit others. These types of assignments are called disposable assignments because students and instructors dispose of them at the end of the assignment or course (Wiley 2013).

Inspired by Wiley (2013), we—one professor of Human Growth Development (Grissett) and one instructional designer (Sheu)—teamed up to design, create, and implement a renewable assignment using open educational resources, allowing students to share their work for the benefit of others (Wiley 2013). Renewable assignments are inspired by open pedagogy, which are teaching practices using open educational resources that allow students to become a direct part of the teaching practice, including creating material (e.g., exam questions) for classroom use (Wiley, 2013). In the present paper, we examine one type of renewable assignment, a multiple-choice question creation and review (QCR) assignment, where students create and review peers’ exam questions for an open textbook, and explore how students responded to this type of assignment. The research questions for this study are: 1) What are the students’ experiences with completing the QCR assignment? Are they generally positive or negative?; and 2) What is the instructor’s view about the QCR assignment? The findings in this research report are presented as formative feedback from the students’ and instructor’s perspectives and we reflect on how they will inform our future instruction.

Literature Review

Student engagement is key to any deep learning, and without feeling a sense of connection to an assignment, students may focus narrowly on the grade and limit themselves to shallow learning (Barkley and Major 2020). This results in potentially wasted time and effort on behalf of the student as, though they may meet the assignment requirements, they dispose of their work altogether at the end of the semester. Further, students can feel this kind of work is disconnected from themselves and from contexts outside of the classroom setting, which may lead many to feel unmotivated to do their best on the assignment and only do well enough to earn the grade they desire (Paudel 2012). This lack of connection to self and a larger goal can also lead students to feel distressed (Cooper 1994), as their time, effort, and energy have limited use (Seraphin et al. 2018).

While these disposable assignments have their merit—they allow students to explore concepts, flesh out ideas, and hone essential skills including oral and written communication, working in a team, and critical thinking—they at times fall short in allowing students to develop a deeper sense of purpose in their work by allowing them to contribute their time and effort to a larger goal (Wiley 2013).

An alternative type of assignment, known as renewable assignments (Wiley and Hilton 2018), allows students to work with others toward a common purpose. Renewable assignments allow students’ work to be used by other students, faculty, professionals, and the community beyond the classroom (Delgado et al. 2022). Some examples of renewable assignments include the creation of ancillary materials for an open textbook (such as slide decks, study guides, lecture notes, and quiz question banks), undertaking wiki projects, and contributing content to open textbooks for others to use.

The products generated through renewable assignments can have inherent value for the discipline and global community, and studies show that students and instructors alike see their particular benefits (Maimoona and Dabbagh 2019). Seraphin and colleagues (2018, 84) proclaim that renewable or “non-disposable assignments” yield an increase in “student excitement, engagement, productivity, and achievement.” There is also evidence that renewable assignments are connected to higher student performance (Wiley et al. 2017).

Wiley and Hilton (2018) describe a spectrum of non-disposable assignments, with disposable assignments simply being submitted to the instructor and renewable assignments allowing the student(s) to openly license and share their work globally with others. In between these two types of assignments are what Wiley and Hilton call “authentic assignments” because the artifact “extends beyond the students’ own learning, such as the creation of content tutorials for future classes” (Katz and Van Allen 2020). The project described in this paper is more in line with an “authentic assignment,” though we use the term “renewable assignment” to remain consistent with the original project’s description and to highlight its key renewable characteristics (DOER Fellows Renewable Assignments 2017).

In the present paper, we describe one type of renewable assignment—a multiple-choice question creation and review (QCR) assignment—that we implemented in an introductory-level psychology course. Our project was like one conducted by Jhangiani (2017), where students in a psychology course created multiple-choice questions to contribute to a test bank; however, with our own QCR assignment, students were also required to review and give feedback on their peers’ questions using an online rubric provided by the instructor.

Course Overview

The QCR assignment was implemented in a lower-level, general education developmental psychology course taught by one of the authors (Grissett) in spring of 2019 at a four-year regional state university in the southeastern United States. The class met in person two times a week in the morning for an hour and fifteen minutes each meeting. Throughout the course, the instructor used a combination of teaching techniques, including lectures (which were guided by slide presentations), assigned readings, and class-based activities, such as in-class short-writing assignments (e.g., reflections) and class-based discussions. The instructor used the open textbook Lifespan Development: A Psychological Perspective (2nd Ed.) by Lally and Valentine-French (2017).

Course Assignments

All students first completed a traditional paper assignment based on the reading. For the next assignment, students completed the question-creation and review (QCR) assignment. After students completed both a reflection paper assignment and a QCR assignment, they were then given a choice between the two for the next three assignments. Students completed brief surveys at three points in the semester to reflect and give feedback on their experiences with the QCR assignment and paper assignment.

Question creation and review assignment

For the QCR assignment, students created a set of three multiple-choice questions about material in the textbook and reviewed questions created by their peers in the course using a rubric. For the question-generation portion of the assignment, students received a brief in-class training from the instructor about how to create effective multiple-choice questions (instructions were drawn from Jhangiani’s guide for creating multiple-choice questions). Students were then assigned a portion of the textbook for which to create the multiple-choice questions. Students created and submitted their questions through a dropbox in the course learning management system. Then, students provided feedback on a randomly assigned peer’s set of questions. Using an online rubric, students reviewed the questions and rated them on a scale of 1–5 based on relevance to the material, level of difficulty, clarity, appropriateness of question choices, and whether the question should be used on an upcoming exam. Students were asked to provide comments about the questions, including areas of improvement.

Technology

As described earlier, the QCR assignment involved multiple steps: for the first part, students created questions based on given readings and submitted their questions by entering them into an online form. On the second part of the assignment, students reviewed questions created by a randomly assigned peer, based on an online rubric.

In previous semesters, we used Word documents and email to complete the QCR assignment; however, we wanted to enhance the student learning experiences and make the multiple-step assignment a more streamlined process, so we utilized various computer applications or platforms, including Google Forms, Qualtrics (an online platform to create dynamic online forms or surveys), and GeorgiaVIEW (learning management system used by public institutions of higher education in Georgia). We used these tools in an effort to improve students’ participation rates by making the process more streamlined (i.e., using online forms for submission and review processes versus Word documents submitted to a Dropbox),to reduce the overall time and effort for students in organizing and submitting their work, to allow students to complete their work on any electronic device, to randomly assign questions to students for peer review, and to help the instructor save paper and time grading assignments. Having the assignment online also allowed the survey to be more easily used in other courses and to allow us to share it more easily with other instructors.

Study

Participants

Forty-one students from several majors were enrolled in the course. Because the course is part of the psychology major curriculum, many students were psychology majors. Specific student demographic data (e.g., race and gender) were not collected.

Results

All students were required to complete the paper assignment for Assignment 1. For Assignment 2, all students were required to complete the question-creation and review (QCR) assignment. For Assignments 3–5, students had a choice between the paper assignment and the QCR assignment. The number of students who completed each type of assignment is provided in Table 1. Grades were not included in this analysis because there were not enough students who completed the paper versions of Assignments 3–5 to draw a comparison: one particular student completed the paper assignment for every assignment for which the option was available, and only one or two other students did likewise for each of Assignments 3–5.

Paper Assignment QCR Assignment
n (out of 41) n (out of 41)
Homework 3 3 35
Homework 4 2 35
Homework 5 2 33
Table 1. Number of students who completed paper and QCR assignments. Note that numbers do not always add up to 41 because some students completed neither assignment.

Most students (up to 93%) selected the QCR when given the choice. When asked why they selected the QCR assignment, students overwhelmingly provided positive feedback, such as “Doing the questions and feedback helps imprint the information into my brain and helps remember information easier,” (Student 14) and, “I chose this assignment because I have trouble getting engaged in the textbook. This assignment encouraged and allowed me to interact with the text more” (Student 31). Another commented, “It allowed me to be a little more creative and was definitive. It also forced me to read the book, something I should do but don’t” (Student 19). Some students provided a more neutral evaluation of the assignment, whereas few articulated a negative perspective (e.g., “Didn’t enjoy the assignments, format was complicated, felt unnecessary” [Student 24]).

Instructor’s Perspective on the QCR Assignment

As an instructor, I (Grissett) felt my students enjoyed the QCR assignment and were more likely to read the textbook to review the terms than when they write paper assignments. Though papers certainly have their merit, the process of students going to the chapter and creating questions from the material allowed students to engage with it in a new way. As one student noted, “They were fun and a good way to study” (Student 1). Another noted that they were “very interesting, [it was the] first time I ever did something like that” (Student 26). Overall, I think that the assignment helped students engage with and subsequently learn the material, specifically because it forced students to visit the text to create the questions—something that students may not do otherwise.

This is not to say that the assignment was not without its challenges or drawbacks. Students at first appeared to rush through it; however, when I provided them with feedback about their questions and peer comments, I noticed that students’ work on the next assignment was of higher quality, and specifically more questions appeared to be at a higher level of Bloom’s taxonomy of learning complexity (e.g., requiring student application of concepts instead of simple recall). For the negative student comment above regarding the “complicated” format, it is unclear what the student is referring to, though it is possible they are talking about the multiple steps required to complete the assignment.

Impact of Technology

The use of technology has had an impact on students’ experiences. In a previous semester, there were multiple steps making up each task in this two-phase assignment, that is creating questions and reviewing others’ work. We received feedback from students in previous semesters about inconveniences about the procedures (e.g., completing reviews on a Word document using the bubble feature and sending the documents back and forth). This semester, we did not receive any complaints regarding assignment procedures or logistics of completing the assignment. We also had fewer students asking questions or having problems completing the assignment.

Using technology also helped save the instructor time in collecting and comparing students’ work. Although it might take a little time to create the forms and online rubric, they can be re-used for future teaching. The data collected by Qualtrics and Google Forms can also provide material and means for quick analysis, allowing the instructor to get a quick glance on how students are doing.

Discussion

The purpose of this paper was to provide formative reflection on a question-creation and review (QCR) assignment that keeps the students at the center of assignment creation, design, and implementation. As an instructor and instructional designer, we chose the QCR assignment to increase student engagement, to help encourage students to look at the material under a fresh light, and to provide an opportunity to do something “new” that they had likely not done before. We emphasized in both the written and oral delivery of the assignment’s instructions that the questions would be used to create an exam test bank and that some questions would be used on the upcoming exam. Students understood that their work would not end with the grade but instead would impact the exams for current and future students. Further, it would force students to engage directly with the material on the upcoming exam, building an exam review strategy into course assignments, as well.

We also wanted to challenge students, so that they could not rely on the same skills traditionally used on more typical assignments (e.g., papers). Though not all renewable assignments are the same, as they draw on different skill types and levels of engagement for each assignment (e.g., wiki projects, textbook writing), the purpose is still the same: motivating students to engage with the course material more deeply by creating something for use beyond the class. We wanted to aim for the level of challenge that yields the best learning results, so that students work hard but not so hard that they feel overwhelmed by the task.

The QCR assignment was feasible for students and therefore may have decreased unnecessary stress of learning. An indicator that students felt confident was that the vast majority (93%) completed the QCR assignment. Students also expressed that the process of creating the exam questions was “fun” and “less stressful” than other assignments. Although we did not measure the student’s emotion or stress level directly, based on the instructor’s observations and feedback from students, students were pleased with the QCR assignment, and the process appeared to invoke less stress than other approaches. This is important because students learn and retrieve information better when they have a moderate amount of stress, rather than too much or too little (Yerkes and Dodson 1908).

Future Directions

We plan to use this assignment in the future, but with some changes. First, we would ask students to create more than three questions. Between five to seven questions would be more effective and would be a more equivalent time demand to a paper assignment. Second, we would have students create a multiple-choice question in class, exchange it with a peer for feedback, and incorporate that feedback into their question before completing the homework assignment. That way, students could get responses from both the instructor and a peer before jumping into the homework assignment itself, allowing them to apply lessons learned from a first attempt. Finally, we would ask students at the start of the assignment to create questions that were higher on Bloom’s taxonomy, such as applied questions, so that students could draw higher-order connections to the material.

Conclusion

Renewable assignments are a form of active learning that engage students to learn in meaningful ways and allow them to understand and connect with the purpose of an assignment. In the case of creating questions for an exam bank, we designed it in a way that is not only renewable and sustainable but also helpful in learning the material through active retrieval practice and establishing multiple points of exposure to the content. The goal is for students to enjoy the learning experience and feel that their work is contributing to something larger, rather than just work toward the grade. These goals directly align to those of open pedagogy—to put students at the center of the learning process, to engage them with experiential learning (“learning by doing”), and to make contributions to a larger community (e.g., other students and educators). These are educational goals that should be integrated into all course-based learning but, in the context of open pedagogy, are really made possible because of open educational resources. In conclusion, OER serve as the lynchpin in open pedagogy and for providing engaged, student-centered, service-based learning, and they should lie at the core of providing renewable, impactful assignments to all students in the college classroom.

Bibliography

Al Abri, Maimoona and Nada Dabbagh. 2019. “Testing the Intervention of OER Renewable Assignments in a College Course.” Open Praxis 11, no. 2: 195–209. http://doi.org/10.5944/openpraxis.11.2.916

Barkley, Elizabeth and Claire Major. 2020. Student Engagement Techniques: A Handbook for College Faculty. Second edition. San Francisco: Jossey-Bass.

Bloom, Benjamin Samuel. 1956. Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co., Inc.

Cooper, Harris. 1994. “Homework Research and Policy: A Review of the Literature.” Research/Practice 2, no. 2: 1–10.

Cooper, Harris. 2001. “Homework for All—in Moderation.” Educational Leadership 58, no. 7: 34–38.

Delgado, Francisco, Aoise Stratford, Akiyoshi Suzuki, Melissa Ryan, Allison Cummings, James Skidmore, and Kerry Kautzman. 2022. Beyond the Traditional Essay: Increasing Student Agency in a Diverse Classroom with Nondisposable assignments. Wilmington, DE: Vernon Press.

Jhangiani, Rajiv. 2017. “Why Have Students Answer Questions When They Can Write Them?” That Psych Prof. Blog post. https://thatpsychprof.com/why-have-students-answer-questions-when-they-can-write-them/.

Katz, Stacy and Jennifer Van Allen. “Evolving into the Open: A Framework for the Collaborative Design of Renewable Assignments.” In Open Pedagogy Approaches: Faculty, Library, and Student Collaborations, edited by Alexis Clifton and Kimberly Davies Hoffman. SUNY Geneseo. Geneseo, NY: Milne Publishing.

Lally, Martha and Suzanne Valentine-French. 2017. Lifespan Development: A Psychological Perspective. Second edition. College of Lake County, Illinois.

open/ed. 2017. “DOER Fellows Renewable Assignments.” Open Education Group. https://openedgroup.org/doer-fellows-renewable-assignments

Paudel, Jagadish. 2012. “Dealing with Homework in English Language Teaching: A Case of Dadeldhura District.” Journal of NELTA 17, nos. 1–2: 50–60.

Rimm-Kaufman, Sara and Lia Sandilos. 2015. Improving Students’ Relationships with Teachers. American Psychological Association. https://www.apa.org/education-career/k12/relationships.

Seraphin, Sally, J. Alex Grizzell, Anastasia Kerr-German, Marjorie Perkins, Patrick Grzanka and Erin Hardin. 2019. “A Conceptual Framework for Non-Disposable Assignments: Inspiring Implementation, Innovation, and Research.” Psychology Learning & Teaching 18, no. 1: 84–97. https://doi.org/10.1177/1475725718811711.

Wiley, David. 2013. “What is Open Pedagogy?” Improving Learning. Blog, October 21. Accessed April 02, 2022. https://opencontent.org/blog/archives/2975.

Wiley, David and John Levi Hilton, III. 2018. “Defining OER-Enabled Pedagogy.” The International Review of Research in Open and Distributed Learning 19, no. 4: 133–47. https://doi.org/10.19173/irrodl.v19i4.3601.

Wiley, David, Ashley Webb, Sarah Weston, and DeLaina Tonks. 2017. “A Preliminary Exploration of the Relationships Between Student-Created OER, Sustainability, and Students’ Success.” International Review of Research in Open and Distributed Learning 18, no. 4.

Yerkes, Robert and John Dodson. 1908. “The Relation of Strength of Stimulus to Rapidity of Habit-Formation. Journal of Comparative Neurology and Psychology 18, no. 5: 459–82.

About the Authors

Judy Orton Grissett is an Associate Professor of Psychology and the Director of Experiential Learning at Georgia Southwestern State University. She received her Masters and PhD in Educational Psychology from Georgia State University. Her research focuses primarily on pedagogical practices, including those surrounding open pedagogy, as well as high-impact practices in and out of the classroom. Dr. Orton Grissett has taught courses in developmental psychology, cultural psychology, research methods, and health psychology. She has won several teaching awards, including the university’s Professor of the Year award in 2016 and the Faculty Excellence and Commitment to Teaching award in 2019.

Dr. Feng-Ru Sheu is an Associate Professor and Instructional Design Librarian at the University Libraries in Kent State University (KSU). She received her PhD in Instructional System Technology, a Specialist degree in Information Science, and a Masters in Library Science from Indiana University. Her primary research interests include the application of learning theories, instructional approaches , and innovative technology in online, in-person, and blended learning environments. She also advocates for open education through her research on the effectiveness of open pedagogy and the impact of Open Educational Resources (OER), which can be used freely and make higher education more accessible and affordable.

An Interdisciplinary Case Study of Cost Concerns and Practicalities for Open Educational Resources at a Hispanic-Serving Institution in Texas

Abstract

Although existing research shows that Open Educational Resources (OER) have numerous educational and financial benefits for university students, there can be cost concerns and practicalities for faculty that affect their day-to-day workloads and career trajectories. The time, labor, and resource burdens that shift to faculty whenever they use, create, and assess OER can have negative professional and personal consequences and even restrict their abilities to accomplish goals related to diversity, equity, and inclusion (DEI). This paper provides an interdisciplinary case study of cost concerns and practicalities from the position of faculty members at a Hispanic-Serving Institution (HSI) in Texas to highlight the ways in which OER might be considered “no-cost” to students but can come at a significant cost to the faculty adopters themselves.

Keywords: open educational resources (OER); cost concerns; Hispanic-Serving Institutions.

Introduction

According to the United Nations Educational, Scientific, and Cultural Organization (UNESCO), “Open Educational Resources (OER) are learning, teaching and research materials in any format and medium that reside in the public domain or are under copyright that have been released under an open license, that permit no-cost access, re-use, re-purpose, adaptation and redistribution by others” (UNESCO 2019). Besides using UNESCO’s definition or similar ones from other sources, advocates of OER as tools for learning, teaching, and research at universities also often characterize OER as “free” in their proposals, policies, and practices. “Free” is not absolute, however, because there are certain cost concerns and practicalities that can limit the type, scope, and scale of OER use, creation, and assessment. Addressing the assumptions and realities about what exactly is “free,” for whom, and under what conditions can clarify the opportunities and risks of OER for different stakeholders and systems for the purposes of improved decision-making, implementation, and evaluation. Addressing the costs of OER also has implications for “open pedagogy,” sometimes referred to as open educational practices (OEP). One feature of OEP is the use of OER to engage with students not just as consumers of information, but also as creators of it. Students can essentially be a part of the process of creating information such that the resources have a greater impact on the community at large (University of Texas-Arlington 2022).

While “free” has multiple meanings and connotations for OER and may necessitate becoming comfortable with the ambiguity that sometimes exists in applying the term (McGowan 2020), of particular interest to the authors of this paper is the cost element. Specifically, what are the professional and personal costs of OER for faculty? As such, this paper understands and frames “free” as “no-cost” in a financial sense (e.g., McGowan 2020; Disu et al. 2022; Henderson and Ostashewski 2018; Jhangiani et al. 2016; Belikov and Bodily 2016) and provides an interdisciplinary case study of cost concerns and practicalities from the position of faculty members at a Hispanic-Serving Institution (HSI) in Texas to highlight the ways in which OER might be considered “no-cost” to students but can come at a significant cost to the faculty adopters themselves.

One of the main financial benefits of OER is not charging students and instructors for the use of openly licensed materials; but what about other potential and actual costs incurred? Cost savings in one process or outcome such as student budgets does not guarantee cost savings in other domains like instructors’ time, labor, and resources for OER endeavors, which can in turn have negative professional and personal consequences for those instructors. In this way, the decision to use, create, and assess OER can be analyzed through the lens of cost shifting. This paper aims to extend the dialogue on what can happen when the burden of cost is removed from students and shifted to faculty who are uncompensated or not incentivized for this effort (Disu et al. 2022), thereby adding to the emerging literature about the lived professional and personal experiences of university faculty who utilize OER (Martin and Kimmons 2020).

Understanding and accommodating for the nuances and limits of “no-cost” in the context of OER is necessary if education stakeholders, especially those situated at Minority Serving Institutions (MSIs), are truly invested in diversity, equity, and inclusion (DEI) and social justice as a set of values and praxis. On the one hand, OER can be no-cost for select user groups and can have the advantages of facilitating open pedagogy or OEP, learner-driven approaches, accessibility, digital literacies, collaboration, etc., which all align with DEI agendas and plans. On the other hand, there can be significant burdens for the individuals who are using, generating, and assessing OER. Two major considerations for education stakeholders and OER adopters are (a) a lack of infrastructure and resources to offset or minimize cost concerns and practicalities related to time and labor for faculty along with (b) missing or insufficient compensation and incentives for faculty. Without careful attention to these considerations, the general framing of OER as an instrument for DEI and redistributive justice is incomplete or incorrect because faculty are being excluded from the equation and negatively impacted. For OER truly to be a public good and for the public good, universities must focus, balance, and support the needs of both students and faculty.

In this interdisciplinary case study, the authors take a multipronged approach in sharing their experiences at an HSI in Texas as well as existing research literature from a range of disciplines to illuminate the professional and personal costs of OER for faculty. Each section describes a set of benefits and challenges for OER at the individual-, unit-, and/or institution-level. Each section also analyzes the ways in which “no-cost” is not totally without cost since OER are directly and indirectly affected by cost concerns and practicalities related to one’s status, positionality, and resources as a faculty member.

Case Study Context

For institutional context, “MSIs” are universities and colleges in the United States (US) that enroll a significant percentage of self-identified minority students from historically underrepresented and marginalized racial and ethnic groups such as American Indian, Alaskan Native, Asian, Pacific Islander, Black (not of Hispanic origin), Hispanic, and two or more of these groups. When determining eligibility for MSI status and access to federal funding and resources, the US government usually classifies MSIs as two-year or four-year, public or private, not-for-profit postsecondary institutions whose minority student enrollment percentages of total enrollment are “significant” or that serve certain populations of minority students under various programs created by Congress.[1] Texas A&M University-Corpus Christi (TAMUCC) is one such MSI with the additional federal designation of “Hispanic-Serving Institution” (“HSI”), which indicates an enrollment of undergraduate full-time equivalent students that is at least 25 percent Hispanic students.

Since 2018, the Carnegie Classification for TAMUCC is “R2,” meaning a doctoral university with “high research activity” (Indiana University Center for Postsecondary Research 2021). Not all colleges within the university are technically “R2,” however, since most programs and departments do not confer master’s degrees or doctoral degrees and instead largely focus on undergraduate students. One of the emergent expectations and pressures related to R2 status is that select faculty groups need to pivot from prioritizing teaching to finding ways to simultaneously prioritize teaching and research or prioritize research above teaching. This expectation and pressure can significantly alter and increase workloads, especially for faculty with existing teaching commitments in first-year programs, core curriculum courses, and/or large lecture courses (i.e., 175 or more students) alongside intensive service obligations, which are customary at TAMUCC.

According to the TAMUCC Data Center (2022), 10,762 students were enrolled at the university during Fall 2021, of which 60 percent (6,438 students) were from underrepresented minority groups. For further context, nearly 50 percent of TAMUCC students self-identified as Hispanic, and almost 50 percent identified as first-generation college students. Furthermore, the five-year trend at TAMUCC shows a steady decrease in the percentage of first-generation students, while the percentage of students from underrepresented minority groups has increased from 58 to 59.8 percent (Texas A&M University-Corpus Christi 2022). The percentage of Hispanic students has remained unchanged in the last three years. The authors were unable to obtain transfer student data, but the Carnegie data set indicates a high transfer-in rate for TAMUCC (Indiana University Center for Postsecondary Research 2021). The authors also did not have institutional data about students’ socioeconomic backgrounds, but their own observations suggest high percentages of students who work part-time or full-time while carrying full course loads. A subgroup of those working students has substantial caregiving responsibilities as well. It is common to see student cohorts carrying heavy professional and personal workloads themselves (with or without adequate resources and preparation), which means TAMUCC faculty often spend a lot of time planning, adapting, and implementing their teaching pedagogies and assessments in ways that best meet the needs and interests of their students. This is additional work for the faculty members in addition to their pre-existing teaching, research, and service workload.

In terms of retention, the TAMUCC Data Center (2022) statistics show the overall one-year retention rate of first-time, full-time students entering TAMUCC in Fall 2020 to be 67.2 percent, which represented nearly a 2 percent decrease from 2019. Underrepresented minority students overall (66.3%), and Hispanic students specifically (66.7%), were retained at slightly lower levels than white students (67.9%). First-generation students (65.2%) were retained at moderately lower rates than non-first-generation students (68.6%). Looking at the 2019 beginning cohort as reported in Summer 2021 to compare TAMUCC with other universities nationally, the overall retention rate at four-year public institutions was 76.3 percent with the retention rate of Hispanic students at 73.2 percent (National Student Clearinghouse 2021, 6), while for TAMUCC, the overall retention rate for that 2019 cohort was 69.1 percent with the retention rate for Hispanic students at 68.3 percent (Texas A&M University-Corpus Christi 2022). With an emphasis in the university’s mission, vision, and strategic plan on “student success” and “closing achievement gaps,” faculty pay close attention to retention rates and actively engage in activities to improve those rates for their courses, programs, and departments, which creates yet another added set of labor expectations and efforts.

One of the ongoing challenges for retention and DEI efforts at MSIs like TAMUCC is textbook costs. Existing research reveals that textbook costs have risen more than 1,000% since the 1970s (Popkin 2015), so not surprisingly, one of the most documented benefits of using OER is cost savings for students (Henderson and Ostashewski 2018; Jhangiani et al. 2016; Belikov and Bodily 2016). Furthermore, prior research describes how the increased burden of textbook costs is a real barrier to education. Students have reported that rising textbook costs have resulted in them not purchasing required course materials, enrolling in fewer courses, receiving worse grades, and even dropping, failing, or withdrawing from courses (Florida Virtual Campus 2019, 4).

While rising textbook costs can hurt students from a wide variety of backgrounds, certain student groups such as racial and ethnic minorities, low-income students, and first-generation students are disproportionately affected (Jenkins et al. 2020, 4). These student groups are less likely to have the textbook on the first day of class (which is strongly linked to performance); they are more likely to drop or avoid taking classes because of cost (in turn delaying graduation); and they are more likely to fail classes due to the inability to pay for textbooks (Florida Virtual Campus 2019, 4; Jenkins et al. 2020, 5). One alarming comparison is first-generation students are twice as likely and Latinx students are three times more likely to fail a class because of textbook costs compared to white students (Jenkins et al. 2020, 5–6).

Because MSIs are concerned about enrollment, retention, and graduation rates in the context of DEI and education economics (e.g., budgets and “the bottom line” for all involved), MSI stakeholders are increasingly searching for interventions and solutions for their student populations who are disproportionately impacted by high textbook costs. Contemporary research on OER’s academic impact delivers inspiring possibilities and pathways. For example, transitioning courses to OER has been associated with higher grades and lower drop, fail, and withdrawal rates, and these associations are most pronounced among Pell-eligible students (Colvard, Watson, and Park 2018, 267–269). Since the COVID-19 pandemic also likely exacerbated the educational disparities caused by textbook costs, there are OER advocates who endorse OER not only as an emergency stopgap, but as a long-term solution to promote equity and inclusive access to educational resources (Bartholomay 2022, 66; Van Allen and Katz 2020, 210; Green and Vézina 2020).

Given that OER help students financially and results in comparable or even improved academic outcomes (Fischer et al. 2015, 168; Jhangiani et al. 2016, 23), there appears to be little to lose and much to gain by endorsing widespread adoption of OER. While these considerations are important to this case study’s authors and their colleagues at other MSIs, the time, labor, and resource burdens associated with using, creating, and assessing OER can have negative career consequences that can potentially outweigh or undo the positive impacts that OER have for students. Moreover, without tangible and substantial institutional support to offset or minimize the costs of OER coupled with a lack of compensation and incentives for faculty, their abilities to actualize DEI visions, goals, programs, and projects are restricted.

For context, all four authors are faculty members at TAMUCC who deeply value DEI and have first-hand experience engaging in labor-intensive efforts in the initial decision-making processes and subsequent implementation stages for using, creating, and assessing OER. The authors hold varied institutional statuses as tenured, tenure-track, and non-tenure track faculty with corresponding teaching, research, and service loads. Their collaborative work on this paper emerged from a shared vision of the power of open pedagogy; regular conversations about the direct and indirect benefits of OER for student learning and outcomes; common experiences at professional development workshops and communities of practice; consultations with one another about “best practices” to incorporate into their respective pedagogies; mutual understanding regarding political and economic constraints related to their positionalities in different settings; and empathy for the challenges and consequences that arise from using, creating, and assessing OER. Over time, the authors decided to formally describe and analyze the costs incurred by faculty in the vetting and use of OER to validate their experiences and those of faculty at other MSIs or HSIs, have a “product” for the purposes of annual reviews and promotions, and increase information sharing and awareness within or between OER communities at TAMUCC and elsewhere.

Cost Concerns and Practicalities for Using OER

To better support TAMUCC’s diverse student body and their financial needs, social science faculty are increasingly exploring the use and adaptation of OER in their courses. Daniel Bartholomay and Jennifer Epley Sanders know firsthand the benefits and challenges of using and adapting OER in their undergraduate core curriculum and upper-level courses. Bartholomay was hired as a tenure-track assistant professor of sociology in Fall 2019 and typically teaches three face-to-face, hybrid, and/or online courses a semester with class sizes ranging from 15 to 200. Since starting at TAMUCC, he has not required students to purchase a textbook. Bartholomay has used and supplemented pre-existing OER as well as assembled his own collection of freely available materials through various online outlets and library resources. Epley Sanders was hired as a tenure-track assistant professor of political science in Fall 2010, was promoted to associate professor in Fall 2016, and became a full professor in Fall 2022. She, too, typically teaches three face-to-face, hybrid, and/or online courses a semester with class sizes ranging from 35 to 250. Like Bartholomay, Epley Sanders has used and supplemented pre-existing OER.

Although OER can be “no-cost” and academically advantageous to students, Bartholomay and Epley Sanders have found that the use and adaptation of OER comes at a cost to them in terms of time, labor, and resources. For example, faculty who choose to use OER may need additional training on pedagogical strategies and technology (Jhangiani et al. 2016, 19; Lantrip and Ray 2021, 897). They may also need specialized training about the distinct types of copyrights and licensing restrictions that determine how OER can be used and edited. Many OER require attribution, some can be modified and adapted, and others can be used commercially. Understanding the nuances of OER licensing typically requires instruction from librarians or other experts in open education. The responsibility of seeking out these trainings and informational resources is often placed upon individual faculty members since institutional support for OER is not a universal practice (Belikov and Bodily 2016, 243). Bartholomay first started using OER while teaching as a graduate student, so he initially had minimal access to OER professional development opportunities. He took it upon himself to research OER and learn strategies from reputable sources, such as the Open Education Network. In Spring 2020, after his first year as an assistant professor at TAMUCC, Bartholomay was identified as an OER advocate and was asked to co-chair the university’s Affordable Learning Tools committee. He continues to co-chair the committee, which involves facilitating monthly meetings, monitoring university textbook policies, maintaining communication with faculty senate and student government regarding textbook pricing, and spreading awareness and education on OER to both faculty and students through various formats.

Even when there are opportunities to get formal training about common strategies, technology, and copyrights or licensing, the process can be time-consuming while lacking corresponding compensation. For instance, Epley Sanders participated in a Communities of Practice in OER Course Unit Redesign during Spring 2019 which involved multiple meetings, workshops, and dedicated time for curating and using OER. The university paid her a $250 stipend at the end of that semester and did not give her additional funds when she later piloted OER during several consecutive semesters. When Epley Sanders co-facilitated a community of practice during Spring 2020 and Spring 2021, the facilitator stipend was $500 each time. Her professional development activities and university service related to OER were on top of the already substantial teaching, research, and service loads that are common at HSIs and schools aspiring to, or that have recently obtained, R2 status like TAMUCC.

Besides the unpaid or underpaid labor involved with OER training, preparation, and implementation, there is an extra related cost and “risk” consideration for faculty because many institutions do not incentivize OER efforts and lack clarity on how such work contributes formal credit for promotion and tenure (Delimont et al. 2016, 10). Current guidelines and policies for annual reviews, merit, and promotion and tenure (P&T) at TAMUCC do not delineate types of OER nor how they should “count” in one’s portfolio even though OER faculty adopters address content delivery, responsiveness to students’ needs, and advancement of the university community in distinct ways. P&T guidelines differ in their criteria both across institutions and within an institution at the college, department, and program levels. Elder et al. (2021) believe OER can fit into all three of the areas that faculty are typically assessed (i.e., teaching, research, and service). Something like the OER Contributions Matrix[2] (Coolidge, McKinney, and Shenoy 2022) might be useful to help incentivize the use of OER and OEP by indicating ways in which the adoption, modification, and creation of materials could fit within a university’s P&T requirements. When Bartholomay and Epley Sanders completed their annual reviews and promotion portfolios, they did not have a reference point like the OER Contributions Matrix nor did they have a standardized, formal, or technical way to report in a physical binder, Faculty Activity Report system, or online portfolio system like Interfolio partial or complete information about the quality and quantity of their OER work in any given class, semester, or as part of a comprehensive teaching pedagogy or DEI framework. It is as if that work did not take place at all. In this way, OER labor can be very costly for faculty members’ professional and financial trajectories.

Despite limited or non-existent OER-related incentives for annual reviews or promotion and tenure, faculty may still decide to proceed with OER to leverage a particular type of academic freedom. Within the realm of Creative Commons[3] licensing, faculty are afforded the autonomy to revise and remix OER to fit their educational needs (Van Allen and Katz 2020, 209). The flexibility and innovative possibilities that accompany adapting OER are often identified as driving factors that motivate faculty to adopt OER (Belikov and Bodily 2016, 242; McGreal 2019, 142; Ren 2019, 3489). This adaptability may be advantageous for faculty at MSIs as it allows them to incorporate timely and culturally relevant content into their courses.

Bartholomay and Epley Sanders appreciate the academic freedom that OER can provide. They are intentional about including OER that matter to their students in order to facilitate learning comprehension, retention, and community, even more so when focused on DEI as a set of values and praxis. However, this pedagogical approach has transactional costs related to their time and labor as faculty members. An example of such costs is having to consistently review and update OER, which can have a cumulative negative effect on faculty. Since many OER are produced independently by individuals who donate their time and talents, updated versions are not guaranteed. Therefore, faculty may be able to use OER for a brief period before the content and references become dated or no longer germane. Because several OER that Bartholomay and Epley Sanders use are now “old” in the social sciences, they will need to revise them directly or curate new collections in the coming years. In those instances, the burden to adapt or create resources falls solely on the instructors. To illustrate this concern and practicality, one open textbook Bartholomay uses has not been updated since 2012. Lacking current examples and scholarly innovations from the past decade, Bartholomay spends much time searching for and creating supplemental instructional materials for his students.

Besides curating or revising existing OER collections for relevant content, Epley Sanders must also carefully consider when and how to make technical updates in her courses because data and multimedia on websites from government institutions (e.g., the White House, the US House of Representatives, and the US Senate), non-profit organizations, mass media, and educational channels (e.g., Khan Academy and YouTube) are frequently changed, moved, or deleted. More websites are creating paywalls, too, that require paid subscriptions or expensive upfront one-time fees by instructors, students, or institutions. The best available resources are then no longer completely open or free. Without institutionalized mechanisms in place to compensate, incentivize, and recognize faculty for their efforts, using and adapting appropriate material that students may use freely becomes extra unpaid and unrewarded labor semester after semester.

The costs imposed upon faculty who use OER are also situated within a broader system of inequality. Faculty at community colleges (Doan 2017, 665) and MSIs (Seaman and Seaman 2021, 38) are more likely to use OER than faculty at other institutions. While an extensive study capturing the demographics of faculty who use OER has yet to be published, research in related areas—such as the finding that women faculty and faculty of color complete disproportionate amounts of underrecognized service work (El-Alyayli, Hansen-Brown, and Ceynar 2018; Joseph and Hirschfield 2011; O’Meara et al. 2019)—would support the hypothesis that faculty who belong to marginalized groups are most likely to use OER. Without institutionalized efforts to compensate, incentivize, and recognize OER work, using OER can worsen pre-existing gender, racial, and other inequalities in academia, as has been the experience of Bartholomay and Epley Sanders.

Cost Concerns and Practicalities for Creating OER

Amanda Marquez began working at TAMUCC in 2011. She presently is a Professional Assistant Professor and the First-Year Seminar Coordinator in the First-Year Learning Communities Program (FYLCP), which is a program designed to support first-year students as they make the transition to university. Established in 1994, the nationally recognized program enrolls all incoming first-year students in learning communities during their first year of college. The FYLCP has previously implemented OER into its First-Year Seminar courses, but Marquez’s journey into OER and OEP emerged from her role as a part-time lecturer for the Humanities Department.

Because of Marquez’s expertise on Mexican American history, she was invited to speak and participate in a Wikipedia Edit-A-Thon during Hispanic Heritage Month in Fall 2018. After that invitation, Marquez began collaborating with Wiki Education[4] and the Wikipedia Education Program[5] to investigate ways to embed a Wikipedia component into her Mexican American Women’s History course. Wiki Education’s commitment to “Equity, Quality, and Reach” (Wiki Education 2022a) aligned with Marquez’s belief that OER created by faculty and students can help close critical gaps in educational experiences.

With a colleague in the Department of Psychology and Sociology, Marquez held a working group in which both instructors agreed to embed a Wikipedia component into their respective undergraduate upper-level courses. Marquez’s goal was to create a project-based assignment that would challenge students to combine “traditional” research methods and “new” technology to enhance their information and digital information literacy skills. However, the decision to use Wikipedia as a teaching tool in an upper-division US History course was not without controversy. Using Wikipedia can be problematic because of perceptions that Wikipedia is not part of the “legitimate” academic canon, so encouraging her colleagues and students to adopt an unfamiliar perspective was initially challenging for Marquez and risky, professionally and personally. As more faculty are increasingly utilizing Wikipedia in their classes, stereotypes of the site are slowly shifting, however. Wikipedia is now being seen less as an untrustworthy site and more as a valuable centralized data repository that simultaneously can function as an effective teaching tool.

Marquez persisted and embedded Wikipedia into her history course as a 15-week, high-stakes longitudinal project. Her “Wikipedia Scholars Project”[6] was not simply treated as an afterthought or superficial supplement to the course. With the support from Wiki Education program managers, students completed mandatory training modules and participated in regular debriefing sessions. Students received support to help them identify gaps in editorship and limited representation in content areas related to Mexican American history, especially Mexican American women’s contributions. Students could either edit an existing page or create a new one. Wikipedia instructional sessions included supplemental materials curated by Marquez, and she integrated those sessions into her traditional lecture classes. Class activities centered on resources from the Wiki Education platform to support student research and writing. Editing standards, guided peer reviews, and content development sessions were also incorporated into the weekly course schedule. A publication showcase of the students’ work on the last day of classes was open to the public and made for a meaningful community experience, too. The shared experience of having their contributions “go live” on Wikipedia led many students to deeply consider the kind of impact their academic work could have beyond the classroom setting. In conjunction with this awareness, students gained applied public service experience as content creators and editors, which are models of OEP and DEI in practice.

In terms of academic benefits, a Wiki Education survey (Wiki Education 2022b) reports high rates of faculty satisfaction with its programs. For example, 97 percent of instructors surveyed agreed that a Wikipedia assignment improved their students’ digital and media literacy skills. Ninety-six percent of instructors agreed that a Wikipedia assignment helped their students develop a sense of digital citizenship. Additionally, 93 percent of instructors agreed that a Wikipedia assignment improved their students’ research skills. Seventy-seven percent of instructors also agreed that a Wikipedia assignment helped their students to become more socially and culturally aware. These survey results match common student learning objectives and outcomes that emphasize the importance of digital literacy and citizenship for twenty-first-century learners. TAMUCC is currently in the process of a Quality Enhancement Plan for digital information literacy, so individual faculty and specific programs increasingly are exploring and implementing innovative teaching practices and assessments such as those centered around Wikipedia.

As a result of Marquez’s participation in the Spring 2021 Wikipedia Education Student program, her course (25 students) was part of a cohort of 344 courses (6,091 student editors). The entire cohort contributed 4.31M words to Wikipedia. The students in Marquez’s course added 12.1K words to Wikipedia, edited seventeen articles, created two new entries, and added 105 references. The impacted article pages received about 78.7K page views in a one-month period. While these metrics are impressive for student and community outcomes, Marquez could have benefited from direct institutional support each step of the way and formal incentives upon project completion.

While a faculty member’s disciplinary expertise can help with the evaluation of students’ contributions to Wikipedia on the backend, vetting and implementing the Wiki Education instructional training resources for students prior to and during a course carries a significant labor cost. Marquez faced similar infrastructure, resource, and incentive challenges for using, adapting, and creating OER as her social science colleagues Bartholomay and Epley Sanders. The aforementioned survey results do not mention faculty feedback about the significant investment of time and effort in planning the sequence of Wikipedia training or navigating and using the course dashboard tools. While each participating faculty member is assigned one program manager to serve as technical support and troubleshooting liaison, faculty must be open to and prepared for the steep learning curve, continuous use of the site’s editing tools, and ongoing enforcement of Wikipedia’s editing guidelines with Wiki personnel and students.

Marquez’s Wikipedia Scholars Project highlights some of the benefits and challenges in the creation of OER but also has implications for open pedagogy and DEI more broadly. Derosa and Jhangiani (2017) note that open pedagogy “as a praxis, is a place where theories about learning, teaching, technology, and social justice enter into a conversation with each other and inform the development of educational practices and structures.” Hegarty (2015) identifies arc-of-life learning, which is “a seamless process that occurs throughout life when participants engage in open and collaborative networks, communities, and openly shared repositories of information in a structured way to create their own culture of learning,” as the foundation for open pedagogy. OER can serve as a complementary tool for open pedagogy and DEI.

For Marquez, open pedagogy and DEI in practice at TAMUCC necessitates a heightened focus on “community” and the shared collective use of resources and knowledge for the purposes of empowerment and social justice. She borrows and builds upon the open pedagogy model of teaching and learning by Hegarty (2015) with a specific emphasis on the attribute of “Connected Community.”[7] Marquez understands the latter to involve acknowledging and supporting the student as a whole person and respecting the knowledge and experiences that they bring to the classroom. Acknowledgment and support must extend to the communities and networks of which the students are members, too. The benefits of employing an open pedagogy alongside using or creating OER in ways that emphasize “connected community” include enhanced collaborations, cross-cultural communications, and cross-cultural understanding. There is an important additional advantage of helping to close the equity gap in education for students and communities that have been excluded because of institutional, structural, and systemic barriers. Marquez’s students were able to leverage their distinct sets of knowledge, experiences, and skills in a “connected community” to add crucial content to Wikipedia and increase its reliability, validity, and public reach while getting real-time support for their professional development and passions at the same time. The process and space for creating OER and “connected community” should not disproportionately burden faculty and take advantage of uncompensated or unrewarded labor, however, because the very orientation of a social justice agenda is to be inclusive and fair. In short, meaningful and substantive DEI requires a focus on students and faculty including more evenly distributed costs and benefits.

Cost Concerns and Practicalities for Assessing OER

Anthony Zoccolillo started working at TAMUCC in Fall 2013 and is now an Associate Professional Professor in the Department of Psychology and Sociology. Despite teaching since 1996 and being formally involved in assessment for almost as long, Zoccolillo’s OER journey is more recent. In 2021, the Department of Psychology and Sociology completed a redesign of their General Psychology course to use OER. The department is in the process of completing their first year of the project. According to the department’s budget estimates, students will save $100,000 in just one year based on the cost of the previously required textbook. Although there was buy-in for redesigning the course because of huge financial savings from which students would benefit, the department soon realized that adopting OER involves multiple considerations and integrated planning for overall curriculum development and assessment which would come at a cost. The latter is what Zoccolillo will focus on in the psychology program in the coming years.
When academics think of assessment in higher education, they often think about student-level outcomes based on metrics that serve institutional goals of continuous improvement. For example, the current assessment of the General Psychology course at TAMUCC involves a rotation of achievement-based skills including critical thinking, written communication, multicultural competence, and empirical and quantitative reasoning. These are assessed using modified versions of the AAC&U Value Rubrics (Association of American Colleges and Universities 2009). While these types of assessment are important for all stakeholders in a higher education setting, it is also important to realize that assessment can serve other purposes.

Assessment can and should be a means of accurately pinpointing areas to increase equity by helping to identify and remove barriers that impact outcomes for students from marginalized groups (Singer-Freeman and Robinson 2020, 8). There are perceptions that using OER, open pedagogy, and OEP increase inclusivity, but how can we be sure that the practices are serving their intended purpose? Like many higher education institutions in the US, Zoccolillo has observed that assessment methods at all levels at TAMUCC do not usually factor in DEI. The biggest challenge Zoccolillo and others involved with assessment face is how to incorporate equity-minded assessment effectively and efficiently into standardized assessment methods. In a recent survey, more than half of all respondents indicated that increasing equity was in their top three challenges with assessment, with a full 21% indicating it was their single biggest challenge (Singer-Freeman and Robinson 2020, 7). Even though there is attention to the social mission of making education available to all, there is little clarity regarding the actual processes of OER and OEP within institutions or any clarity on whether this emphasis indeed serves the needs of disadvantaged learners (Lee 2020, 192–193).

When we view OER and OEP from a DEI standpoint for students and faculty, time cost can mean more than selecting, assembling, and editing content. OER also require a commitment to assessment practices that support using OER in an inclusive way. Data suggests that while traditional assessment of classroom assignments, formal essays, and exams can perpetuate equity gaps (Singer, Hobbs, and Robinson 2019, 15), the more formative types of assessment that are better suited to mitigate these gaps (e.g., frequent low-stakes quizzing/assignments, minute papers, and student response systems) carry with them additional costs. This type of assessment requires extra time, knowledge, and resources both in the creation and maintenance of such assessments, as well as the additional time grading and providing substantive and useful feedback.

Much of the existing research focuses directly on the time commitment to conduct assessment (e.g., Andrade et al. 2011, 160; Belikov and Bodily 2016, 241; Hassall and Lewis 2017, 78). However, a closer look at the research uncovers other barriers that translate into additional time and effort on the part of faculty, including a need for training (Murphy 2013, 214); lack of support, tools, and resources (Andrade et al. 2011, 160; Hassal and Lewis 2017, 79); and a lack of human resources necessary to complete a costly course redevelopment (Murphy 2013, 212). TAMUCC’s redesign of General Psychology was not without these costs. Zoccolillo underwent training as part of an OER Community of Practice to learn the basics of adopting and adapting OER as well as to fulfill training requirements imposed by the grant the department received for the redesign. Evaluating multiple OER textbooks for content and support was time consuming. Given the department’s comprehensive use of the materials released by the traditional textbook publisher with the standard curriculum design, course redevelopment with the chosen OER included adapting all in-class and assessment materials, as well as creating new materials. All of these tasks were done in addition to a full teaching and service load with one other General Psychology faculty member who contributed when they could. The development and deployment of proper assessment methods are being done in addition to the summative assessment that will continue to take place and without the support of additional administrative, research, or teaching assistants, time releases, or financial compensation to offset the real-time burden of faculty members’ investments.

When we consider the cost and inclusion aspects of OER and OEP, we can see the ways in which the affordability of higher education is a social justice issue, and the skyrocketing cost of textbooks is a major part of the escalating expenses. Current methods of assessment lose sight of the social justice component, however. Zoccolillo and his colleagues have not yet been able to solve this assessment matter in General Psychology at TAMUCC. While the redesign project is in its second full year, their sights must soon shift from the adoption and adaptation phase to an assessment phase with an eye toward efficacy, DEI, and sustainability.

Addressing DEI and social justice agendas during assessment phases can be hampered if there are no formal incentives or funding for faculty. Zoccolillo’s department did have grant support of $5,000 to complete the course redesign, but the grant funding only covered implementation and basic assessment. The grant funds were also given after all of the work was completed. The grant did not include funding for ongoing updates or long-term meaningful assessment. The department will have to figure out a way to assess the effectiveness of the redesign based on both traditional (i.e., outcome-based) and non-traditional (i.e., equity-based) approaches without compensating or incentivizing the faculty’s time and effort. It will be labor-intensive because effective and reliable assessment starts at the individual classroom level with a sustainable plan that improves course quality, retention, and grades and then flows up to a program level where the positives of the course redesigns will have to be weighed against the costs. Although OER resources are increasingly available at TAMUCC, those resources are scattered throughout different departments. Starting in 2022, the institution is attempting to centralize OER efforts but is overlooking assessment-related processes, structures, and incentives. It remains to be seen if or when assessment will be comprehensively integrated into the university’s OER strategic plans.

If we view OER and OEP as primarily for the benefit and empowerment of otherwise non-privileged learners (Lambert 2018, 239), then these goals should be reflected in our assessment plans and practices as well. This will require that higher education institutions shift from merely implementing OER either without assessment or with poor assessment practices, to adopting a properly integrated OER-OEP-DEI-Assessment system. Institutional goals should be aligned with transparent equity values and purposeful attempts to minimize the equity gaps that exist (McNair, Bensimon, and Malcom-Piqueux 2020, 17), and assessment is one way to know if institutions have done so, how well, and for whom.

Recommendations and Conclusion

This interdisciplinary case study illustrates how OER adoption and creation can benefit students at an HSI by saving them money and providing them with the skills necessary to become curators and producers of openly accessible knowledge. The time, labor, and resource costs involved for faculty are problematic, however. For long-term viability, sustainability, and DEI goals, institutions will need to provide OER stakeholders with sufficient and ongoing infrastructure, resources, and incentives to use, create, and assess OER in individual courses, within programs and departments, and across universities. Tangible examples include course releases, one-time startup funding, periodic maintenance funding, evaluation funding, revising promotion and tenure guidelines and policies, professional awards, professional recognition, development and training workshops, networking events, advising and mentoring opportunities, structured peer reviews, positive publicity, communities of practice, and technology tools such as software or hardware as needed. These kinds of examples could also help offset or minimize costs to those OER implementers who are tasked with changing the climate and culture of OER on their respective campuses.

TAMUCC is in the preliminary stages of exploring and implementing some of these recommendations, which influences the authors’ viewpoints in this case study. For institutions that have not yet started to build their OER infrastructure, the authors suggest factoring in these building blocks early in a scaffolded strategic plan to avoid the pitfalls of uncompensated and unrewarded labor. Where possible, planning for assessment should be incorporated from the beginning as well. To think about assessment after the fact perpetuates the myth that assessment is only about evaluating outcomes and ignores the fact that assessment should support the learning process.

Additionally, funding agencies should more heavily consider the value of OER as tools of DEI and redistributive justice for underrepresented and marginalized students and prioritize grants for faculty using, adapting, creating, and assessing OER at MSIs. Given that the COVID-19 pandemic likely exacerbated educational achievement gaps for underserved students, incentivizing the use of OER at institutions that disproportionately serve those communities needs to become a prioritized DEI initiative in higher education.

One last consideration is acknowledging the various roles that local, state, and national governments play in the context of shaping or limiting institutional initiatives for OER, open pedagogy, and OEP. If political actors and entities do not support OER and OEP as tools for DEI and redistributive justice, for instance, then public higher education institutions will face even more challenges than they already do in formally supporting their programs, faculty, and students. Future case studies could examine the similarities and differences for OER-related processes and outcomes at MSIs within and between states. Such data could better inform strategic planning, decision-making, and evaluations so that institutions may improve their OER statistics, but more importantly, align and fulfill their promises of DEI for all stakeholders.

Notes

[1] See for example: US Department of Education, US Department of Education – Office of Postsecondary Education, and US Department of the Interior – Office of Civil Rights.
[2] The matrix and downloadable files are available online.
[3] Background information, resources, and training opportunities offered by Creative Commons are available on their website.
[4] Wiki Education became a spin-off of the Wikimedia Foundation, the nonprofit organization that runs Wikipedia, in 2013.
[5] The Wikipedia Education Program supports a variety of projects for diverse communities.
[6] The Wikipedia project page for History 4390: Mexican American Women’s History includes a course summary, timeline, and training module descriptions.
[7] Hegarty (2015) lists eight overlapping attributes of an open pedagogy model of teaching and learning: Participatory Technologies, People, Openness, Trust, Innovation and Creativity, Sharing Ideas and Resources, Connected Community, Learner-Generated, Reflective Practice, and Peer Review. A full description of each attribute is available in the author’s original article.

References

Association of American Colleges and Universities. 2009. Valid Assessment of Learning in Undergraduate Education (VALUE). Accessed May 13, 2022. https://www.aacu.org/initiatives/value.

Andrade, António, Ulf-Daniel Ehlers, Abel Caine, Roberto Carneiro, Grainne Conole, Anna-Kaarina Kairamo, Tapio Koskinen, et al. 2011. “Beyond OER–Shifting Focus to Open Educational Practices: OPAL Report 2011.” Accessed May 12, 2022. https://duepublico2.uni-due.de/servlets/MCRFileNodeServlet/duepublico_derivate_00025907/OPALReport2011_Beyond_OER.pdf.

Bartholomay, Daniel J. 2022. “A Time to Adapt, Not ‘Return to Normal’: Lessons in Compassion and Accessibility from Teaching During COVID-19.” Teaching Sociology 50, no. 1 (January): 62–72.

Belikov, Olga Maria, and Robert Bodily. 2016. “Incentives and Barriers to OER Adoption: A Qualitative Analysis of Faculty Perceptions.” Open Praxis 8, no. 3 (July-September): 235–246. http://doi.org/10.5944/openpraxis.8.3.308.

Coolidge, Amanda, Andrew McKinney, and Deepak Shenoy. 2022. “The OER Contributions Matrix.” Accessed October 3, 2022. https://www.doers3.org/tenure-and-promotion.html.

Colvard, Nicholas B., C. Edward Watson, and Hyojin Park. 2018. “The Impact of Open Educational Resources on Various Student Success Metrics.” International Journal of Teaching and Learning in Higher Education 30, no. 2 (July): 262–276.

Delimont, Nicole, Elizabeth C. Turtle, Andrew Bennett, Koushik Adhikari, and Brian L. Lindshield. 2016. “University Students and Faculty Have Positive Perceptions of Open/Alternative Resources and their Utilization in a Textbook Replacement Initiative.” Research in Learning Technology 24 (June): 29920. https://doi.org/10.3402/rlt.v24.29920.

Derosa, Robin, and Rajiv Jhangiani. 2017. “Open Pedagogy.” in A Guide to Making Open Textbooks with Students, edited by Elizabeth Mays, Zoe Wake Hyde, and Apurva Ashok, 7-20. https://press.rebus.community/makingopentextbookswithstudents/chapter/open-pedagogy/.

Disu, Sami, Joanna Dressel, Jamila Hammami, Marianne Madoré, and Conor Tomás Reed. 2022. “The Amount of Labor We Do for Free” and Other Contradictions.” Accessed October 3, 2022. https://academicworks.cuny.edu/gc_pubs/708/.

Doan, Tomalee. 2017. “Why Not OER?” Portal: Libraries and the Academy 17, no. 4 (October): 665–669. Project MUSE.

Green, Cable, and Brigitte Vezina. 2020. “Education in Times of Crisis and Beyond: Maximizing Copyright Flexibilities.” Creative Commons 31. Last modified March 31, 2020. https://creativecommons.org/2020/03/31/education-in-times-of-crisis-and-beyond-maximizing-copyright-flexibilities/.

Elder, Abbey, Anne Marie Gruber, Mahrya Burnett, and Teri Koch, 2021. “Open Education in Promotion, Tenure, & Faculty Development.” Accessed October 3, 2022. https://oept.pubpub.org/pub/1xl1zqxs.

El-Alayli, Amani, Ashley A. Hansen-Brown, and Michelle Ceynar. 2018. “Dancing Backwards in High Heels: Female Professors Experience More Work Demands and Special Favor Requests, Particularly from Academically Entitled Students.” Sex Roles 79, no. 3 (January): 136–150. https://doi.org/10.1007/s11199-017-0872-6.

Fischer, Lane, John Hilton, T. Jared Robinson, and David A. Wiley. 2015. “A Multi-Institutional Study of the Impact of Open Textbook Adoption on the Learning Outcomes of Post-Secondary Students.” Journal of Computing in Higher Education 27, no. 3 (September): 159–172. https://doi.org/10.1007/s12528-015-9101-x.

Florida Virtual Campus. 2019. “2018 Student Textbook and Course Materials Survey.” Last modified March 8, 2019. https://dlss.flvc.org/documents/210036/1314923/2018+Student+Textbook+and+Course+Materials+Survey+Report+–+FINAL+VERSION+–+20190308.pdf/07478d85-89c2-3742-209a-9cc5df8cd7ea.

Hassall, Christopher, and David I. Lewis. 2017. “Institutional and Technological Barriers to the Use of Open Educational Resources (OERs) in Physiology and Medical Education.” Advances in Physiology Education 41, no. 1 (January): 77–81. https://doi.org/10.1152/advan.00171.2016.

Hegarty, Bronwyn. 2015. “Attributes of Open Pedagogy: A Model for Using Open Educational Resources.” Educational Technology 55, no. 4 (July–August): 3–13. https://www.jstor.org/stable/44430383.

Henderson, Serena, and Nathaniel Ostashewski. 2018. “Barriers, Incentives, and Benefits of the Open Educational Resources (OER) Movement: An Exploration into Instructor Perspectives.” First Monday 23, no. 12 (December). http://dx.doi.org/10.5210/fm.v23i12.9172.

Indiana University Center for Postsecondary Research (2021). Carnegie Classifications 2021 public data file. Accessed October 3, 2022. http://carnegieclassifications.acenet.edu/downloads/CCIHE2021-PublicDataFile.xlsx.

Jenkins, J. Jacob, Luis A. Sánchez, Megan AK Schraedley, Jaime Hannans, Nitzan Navick, and Jade Young. 2020. “Textbook Broke: Textbook Affordability as a Social Justice Issue.” Journal of Interactive Media in Education 1, no. 3 (May): 1–13: https://doi.org/10.5334/jime.549.

Jhangiani, Rajiv S., Rebecca Pitt, Christina Hendricks, Jessie Key, and Clint Lalonde. 2016. “Exploring Faculty Use of Open Educational Resources at British Columbia Post-Secondary Institutions.” BCcampus Research Report. Last modified January 18, 2016. https://eduq.info/xmlui/bitstream/handle/11515/35344/exploring-faculty-use-of-oer-british-columbia-post-secondary-institutions-bccampus-2016.pdf?sequence=2.

Joseph, Tiffany D., and Laura E. Hirshfield. 2011. “‘Why Don’t You Get Somebody New to Do It?’ Race and Cultural Taxation in the Academy.” Ethnic and Racial Studies 34, no. 1 (August): 121–141. https://doi.org/10.1080/01419870.2010.496489.

Lambert, Sarah R. 2018. “Changing our (Dis)course: A Distinctive Social Justice Aligned Definition of Open Education.” Journal of Learning for Development 5, no. 3 (November): 225–244. ERIC.

Lantrip, Jennifer, and Jacquelyn Ray. 2021. “Faculty Perceptions and Usage of OER at Oregon Community Colleges.” Community College Journal of Research and Practice 45, no. 12 (December): 896–910. https://doi.org/10.1080/10668926.2020.1838967.

Lee, Kyungmee. 2020. “Who Opens Online Distance Education, to Whom, and for What?” Distance Education 41, no. 2 (May): 186–200. https://doi.org/10.1080/01587919.2020.1757404.

Martin, Troy, and Royce Kimmons. 2020. “Faculty Members Lived Experiences with Choosing Open Educational Resources.” Open Praxis 12, no. 1 (January–March): pp. 131–144. http://doi.org/10.5944/openpraxis.12.1.987.

McGreal, Rory. 2019. “A Survey of OER Implementations in 13 Higher Education Institutions.” The International Review of Research in Open and Distributed Learning 20, no. 5 (December): 141–145. https://doi.org/10.19173/irrodl.v20i5.4577.

McGowan, Veronica. 2020. “Institution Initiatives and Support Related to Faculty Development of Open Educational Resources and Alternative Textbooks.” Open Learning: The Journal of Open, Distance, and E-Learning 35, no. 1 (January): 24–45.

McNair, Tia Brown, Estela Mara Bensimon, and Lindsey E. Malcom-Piqueux. 2020. From Equity Talk to Equity Walk: Expanding Practitioner Knowledge for Racial Justice in Higher Education. Hoboken, NJ: Jossey-Bass. https://onlinelibrary.wiley.com/book/10.1002/9781119428725.

Murphy, Angela. 2013. “Open Educational Practices in Higher Education: Institutional Adoption and Challenges.” Distance Education 34, no. 2 (September): 201–217. https://doi.org/10.1080/01587919.2013.793641.

National Student Clearinghouse. 2021. “Persistence and Retention: 2019 Beginning Cohort. Snapshot Report, Summer 2021.” Accessed May 11, 2022. https://nscresearchcenter.org/wp-content/uploads/PersistenceRetention2021.pdf.

O’Meara, KerryAnn, Courtney Jo Lennartz, Alexandra Kuvaeva, Audrey Jaeger, and Joya Misra. 2019. “Department Conditions and Practices Associated with Faculty Workload Satisfaction and Perceptions of Equity.” The Journal of Higher Education 90, no. 5 (April): 744–772. https://doi.org/10.1080/00221546.2019.1584025.

Popkin, Ben. 2015. “College Textbook Prices Have Risen 1,041 Percent Since 1977.” Last modified August 6, 2015. https://www.nbcnews.com/feature/freshman-year/college-textbook-prices-have-risen-812-percent-1978-n399926.

Ren, Xinyue. 2019. “The Undefined Figure: Instructional Designers in the Open Educational Resource (OER) Movement in Higher Education.” Education and Information Technologies 24, no. 6 (June): 3,483–3,500. https://doi.org/10.1007/s10639-019-09940-0.

Seaman, Julia E., and Jeff Seaman. 2021. “Digital Texts in the Time of COVID: Educational Resources in US Higher Education, 2021.” Bay View Analytics: 1–56. https://www.bayviewanalytics.com/reports/digitaltextsinthetimeofcovid.pdf.

Singer-Freeman, Karen, Harriet Hobbs, and Christine Robinson. 2019. “Theoretical Matrix of Culturally Relevant Assessment.” Assessment Update 31, no. 4 (July-August): 1–16. https://www.researchgate.net/profile/Karen-Singer-Freeman/publication/335010340_Theoretical_Matrix_of_Culturally_Relevant_Assessment/links/5d4d70114585153e5948e446/Theoretical-Matrix-of-Culturally-Relevant-Assessment.pdf.

Singer-Freeman, Karen E., and Christine Robinson. 2020. “Grand Challenges for Assessment in Higher Education.” Research & Practice in Assessment 15, no. 2 (Winter): 59–78. ERIC.

Texas A&M University-Corpus Christi. 2022. “Data Center.” Accessed May 5, 2022. https://www.tamucc.edu/president/pir/datacenter.php.

UNESCO. 2019. “Open Educational Resources.” Accessed May 5, 2022. https://www.unesco.org/en/communication-information/open-solutions/open-educational-resources.

University of Texas-Arlington. 2022. “Introduction to Open Pedagogy.” Last modified, August 31, 2022. https://libguides.uta.edu/openped.

Van Allen, Jennifer, and Stacy Katz. 2020. “Teaching with OER During Pandemics and Beyond.” Journal for Multicultural Education 14, no. 3 and 4 (June): 209–218. https://doi.org/10.1108/JME-04-2020-0027.

Wiki Education. 2022a. “Teach with Wikipedia.” Accessed May 13, 2022. https://wikiedu.org/teach-with-wikipedia/.

Wiki Education. 2022b. “Increasing the Diversity of Tech on Wikipedia.” Accessed October 4, 2022. https://wikiedu.org/diversity-of-tech/.

Wikibooks. 2016. “Open Education Practices: A User Guide for Organisations/Resources and Practices.” Last modified September 9, 2016. https://en.wikibooks.org/wiki/Open_Education_Practices:_A_User_Guide_for_Organisations/Resources_and_Practices#Open_Courseware_and_Open_Educational_Resources.

About the Authors

Jennifer Epley Sanders is a Professor of Political Science in the Department of Social Sciences at Texas A&M University-Corpus Christi. She received her Ph.D. and M.A. in Political Science from the University of Michigan and a B.A. in Political Science from Vassar College. Epley Sanders uses qualitative and quantitative methods to study the meaning and significance of “identity” in politics to facilitate critical thinking, cross-cultural understanding, and productive learning experiences in different domestic, international, and educational contexts.

Anthony Zoccolillo is an Associate Professional Professor of Psychology in the Department of Psychology and Sociology at Texas A&M University-Corpus Christi. He received his Ph.D. in Educational Psychology from Capella University, his M.A. in Educational Psychology from New Jersey City University, and a B.A. in Psychology from Seton Hall University. Zoccolillo assists with the coordination of the General Psychology course (including all assessment) and the online Psychology program and teaches courses in Cross Cultural Psychology, Research Methods, Writing and Critical Thinking, and Psychology and Film.

Daniel Bartholomay is an Assistant Professor of Sociology and Co-Coordinator of Women’s, Gender, and Sexuality Studies at Texas A&M University-Corpus Christi. He received his Ph.D. in Sociology from the University of Wisconsin-Milwaukee, his M.S. in Sociology from North Dakota State University, and his B.S. in Mass Communications from Minnesota State University Moorhead. In addition to researching social inequalities at the intersections of sexuality, gender, race, and health, Bartholomay is also an American Sociological Association award-winning scholar of teaching and learning and an advocate for educational practices that promote equitable learning opportunities for underrepresented students.

Amanda Marquez is an Assistant Professional Professor and University Seminar Coordinator in the First-Year Learning Communities Program at Texas A&M University-Corpus Christi (TAMUCC). Marquez earned her M.A. and B.A. in History at TAMUCC. A social historian by training, her areas of specialization include Mexican American History, Women’s History, and the History of Gender and Sexuality. Marquez has received several teaching awards as an individual and as part of a team such as the Teaching Excellence Award for the Department of Undergraduate Studies, the university’s Teaching Innovation Award, and the College of Liberal Arts Teaching Excellence Award.

Stylized letters reminiscent of Greek spell DIDAKTA on a dark background.
0

Open Resources for Corpus-Based Learning of Ancient Greek in Persian

Abstract

This paper illustrates a new approach to learning historical languages through digital annotations in low-resource languages, focusing, in this case, on learning Ancient Greek in Persian. We have concentrated on how to use localizable grammar explanations and cross-lingual annotations, such as dependency trees, to develop resources in Persian for learning Ancient Greek. Instead of manual translations of sources available in other languages such as English, we have used treebanks data and localized grammatical explanations as an alternative approach to traditional textbooks, and utilized machine translation to make commentaries and lexicons accessible in Persian. The goal is to enable learners to focus on the precise vocabulary, morphology, and syntax that are prominent in the materials that they wish to understand. We report on how, after thirty hours of instruction, Persian speakers were able to critique existing Persian translations of the Iliad and create more accurate representations of the Greek original. The same learners were, at this point, able to begin producing the first direct translations of Plato’s Crito into Persian. As a result, we have three finalized translations of Crito under development that each represent a different interpretation or approach to the text. All of the resources used in the courses, including treebanks, translations, textbooks, and grammars, are openly licensed or in the public domain. Our Crito translation will also be released under a Creative Commons License.

Keywords: Ancient Greek; parallel corpora; translation alignment; dependency trees; historical languages.

Introduction

In recent years, there has been an increasing awareness of the use of technology as a pedagogical tool that can be used to accelerate the development of educational resources in different languages, particularly low-resource ones. In this paper, we have focused on using cross-lingual digital annotation to develop pedagogical resources in Persian for learning Ancient Greek.

Although Greek language and culture have a well-established influence in the Persian-speaking world through centuries of cultural exchange, the Ancient Greek language has not been studied extensively, if at all, in Persian-speaking academic institutions—there are, for example, no regular courses on Ancient Greek in any Iranian universities. Classes occasionally take place, but on an ad hoc and normally informal basis. Insofar as translations of Ancient Greek sources exist in Persian, the vast majority have not been translated from Greek to Persian directly, but indirectly through English, French, or German. Many texts have not only one, but multiple indirect translations. Such indirect translations lead to inaccuracies and misinterpretations that have, in turn, had a fundamental effect on how Ancient Greek texts have been received by Persian speakers (Palladino, Shamsian, and Yousef 2022).

Considering the historical and intellectual significance of Ancient Greek sources in Persian-speaking countries, having access to the original Greek texts instead of depending on indirect translation is crucial. In the case of this paper, we have focused on resources for the Homeric epics. However, the methods could be expanded to other Greek texts or even other languages.

Methods

Digital tools and annotations have the potential to facilitate the development of resources for low-resource languages to a great extent (Crane 2019). Hundreds of books and papers have been written about the Homeric epics in English; however, it would be extremely challenging to access most of them in another language. Even if they were in the public domain or openly licensed, manual translation of this much text into another language is time consuming and costly. However, some of these sources could become much more accessible in other languages through machine translation, given that machine translation was available for the target language. We have used machine translation to make lexicons, commentaries, and grammars more accessible. Nonetheless, this is only applicable to texts that are already machine readable and available under an open license.

Given the challenges of translating traditional sources about Greek into a language such as Persian, we decided to concentrate on materials that may be localized rather easily and are largely independent of learners’ first language (L1).

More than one million words of Ancient Greek are available in treebanks—textual databases in which annotations identify the part of speech, standardized dictionary form, and syntactic role of each word in a sentence (de Marneffe et al. 2021). A corpus of a million words is larger than the assigned reading list for any PhD program in Ancient Greek with which we are familiar—it provides far more reading materials than anyone but the most ambitious of learners could cover without years of work.

Treebanks have shown to be an effective pedagogical tool in the classroom for teaching Ancient Greek in English, encouraging learners to engage more closely with the original text (Gorman 2020; Mambrini 2016). These treebanks use consistent tags for describing Ancient Greek and by learning how to understand and use dependency trees, learners, regardless of their first language(s), can interact with the text more actively. Most beginner textbooks of Ancient Greek use simplified, easier to explain versions of more complex authentic texts. However, using annotations empowers learners to read authentic Greek text from the very beginning.

Although having cross-lingual annotations gives us numerous opportunities, we still need grammar manuals and textbooks, and the problem of localizability applies to these as well. The examples, explanations, and even exercises in such books are often written for English speakers. For instance, authors of a textbook about Ancient Greek in English may not consider it necessary to include proper explanations of definite articles because the concept is already familiar to an English speaker. Considering that Persian does not have definite articles, Persian speakers may require more explanation of what a definite article is and how it is used. To address this issue, the first author of this article created an open-source, localizable reference for learning Greek based on Smyth’s Greek Grammar, designed to include explanations for each concept, regardless of how familiar or unfamiliar the subject is for speakers of a different language. Explanations that could not be translated well into Persian were edited, and the text was simplified to get better results from machine translation. This localizable reference, called the Didakta Grammar for Annotation, provides explanations of syntactic complexities that are not represented in treebanks. Treebanks can tell learners that a word is in the dative case and modifies a verb, but additional grammatical explanations can tell learners that the dative describes an instrument (e.g., “the hero was struck with a spear”) vs. a location (e.g., “the hero was struck on the shoulder”).

In addition to treebanks and the Didakta Grammar for Annotation, we adopted a technique of annotating and aligning translations with the original Ancient Greek at word level as a pedagogical tool. We integrated Ugarit, an open-access digital alignment tool, for learning and assessment. Ugarit is a text alignment tool that allows you to manually annotate parallel text and generate word-level translation alignment in a variety of languages (Yousef et al. 2022). As a vocabulary learning tool, translation alignment provides context for each word and increases the chance of incidental learning (Foradi 2020). Conventionally, students of Ancient Greek are asked to translate a Greek text into their first language or compose a text in Greek to assess their knowledge of the language. The assessment of their translations is, among other issues, a time-consuming task for teachers and cannot easily be automated. Meanwhile, translation alignment along with multiple-choice questions can be used to assess a learner’s understanding of an Ancient Greek text. The knowledge of more advanced learners could also be assessed by their ability to create treebanks for complex sentences; however, we found this to be too complex for beginners.

An Introductory Course in Homeric Greek

Here, we report on the content and results of an introductory online course on Homeric Greek for Persian speakers taught by Farnoosh Shamsian, running from July to December 2021. The course included thirty sessions, each ninety minutes, and was taught in Persian to twenty-four initial participants with no prior knowledge of Ancient Greek. The goal of this course was to prepare learners for reading Homeric poems in Ancient Greek with the help of lexicons and grammar books. Students in this course, unlike most Greek courses, were never assigned to compose in Greek and instead, we focused solely on reading authentic texts. There is no textbook for Homeric Greek available in Persian and this course was based completely on open digital resources, including the Perseus Treebank (Crane et al. 2018), public domain sources such as Pharr’s Homeric Greek (1920), and a born-digital Persian translation of book one of the Iliad aligned with the original Greek.

The advantages of using corpora in language learning are well-established (Vyatkina and Boulton 2017); however, it is still not widely applied to learning historical languages. The syllabus for this course was based on frequency data derived from the annotated corpus of the Iliad, giving priority to the most frequent inflections and syntactic structures. Considering that many textbooks of Ancient Greek are not arranged based on the frequency of morphological and syntactic structures, the sequence of subjects in the Homeric Greek course was not very conventional. For instance, textbooks often introduce the present tense prior to the imperfect or the aorist tense; however, frequency data clearly shows that the present tense is not the most frequent tense in the Iliad. According to treebanks data, aorist indicative active tense was used 3948 times in the whole Iliad, while there were only 1469 instances of present indicative active tense. Therefore, aorist indicative active verbs were discussed in the seventh session of the Homeric Greek course and present indicative active verbs in the fifteenth session. The imperfect indicative active tense, with 2669 instances in the whole Iliad, was discussed in the ninth session.

Given that both Persian translations of the Iliad are derived from mediating French translations, it is not surprising that neither of them aligns well with the original Greek text. Therefore, book one of the Iliad was translated to Persian and aligned at word level. This aligned direct translation was used to help learners gain a better understanding of its syntax and navigate through the corpus more efficiently. The goal was to use parallel corpora instead of or in addition to traditional reference tools such as dictionaries, an approach that has already been shown to improve the translation quality for modern languages (Liu 2020).

To complement treebanks data, a grammar textbook is also crucial for providing adequate information on morphology and syntax. Recent approaches to a digital Greek grammar references give more freedom to the reader than conventional print books do. For instance, Overview of Greek Syntax by Rydberg-Cox, openly accessible in Perseus Digital Library, arranges the content of Smyth’s (1916) reference grammar in an innovative way (Rydberg-Cox 2000). More recently, the Pedalion modular syntax project developed at KU Leuven enables the reader to access information flexibly compared to more traditional printed grammar books that often have a fixed structure (Van Hal and Keersmakers 2021). With such a flexible approach to grammar referencing, we can take advantage of the benefits of digital media more effectively.

The main difficulty with using English-language Greek grammar books and textbooks with Persian speakers is that some of the explanations and examples are written exclusively for English speakers and thus cannot be translated; some textbooks even assume prior knowledge of Latin. To provide a localizable reference book, a modular grammar based on Smyth’s A Greek Grammar for Colleges and inspired by the work of Rydberg-Cox and Pedalion was developed by the instructor. In this modular grammar, Didakta Grammar for Annotation, the goal was to keep the explanation as localizable as possible while avoiding complex language that would cause inaccuracies in machine translation. The same approach was taken for developing a textbook based on Pharr’s Homeric Greek (1920). Both the grammar reference and the textbook have already been translated into Persian and are openly accessible.

Additionally, Ugarit was used in this course, both as an assessment tool by the instructor and as a vocabulary learning tool by learners, with which they could review each word in its context. Moreover, the process of aligning a translation in itself helps learners to develop a better understanding of the text semantically through systematic comparison (Palladino 2020).

Word-level alignment of the Iliad 1.43–54. The Greek text is on the left side and the Persian translation is on the right side of the image.
Figure 1. Word-level alignment of the Iliad 1.43–54 done by a learner in the Homeric Greek course.

Translating Homeric Greek to Persian

Since both available translations of the Iliad in Persian are indirect, they often do not match up well with the original Greek text in a word-level alignment, leaving multiple tokens unaligned either in the original text or in the translation itself. The learners in the Homeric Greek course, however, were able to provide more accurate translations by using digital annotation. For instance, after less than twenty hours of instruction, learners were asked to revise the indirect Persian translations of the following lines:

[4.3] τοὶ δὲ χρυσέοις δεπάεσσι [4.4] δειδέχατ᾽ ἀλλήλους, Τρώων πόλιν εἰσορόωντες: [4.5] αὐτίκ᾽ ἐπειρᾶτο Κρονίδης ἐρεθιζέμεν Ἥρην [4.6] κερτομίοις ἐπέεσσι παραβλήδην ἀγορεύων: (Hom. Il. 4. 3–6)

A.T. Murray’s translation (rev. Crane):

and they with golden goblets toasted one the other as they looked upon the city of the Trojans. And right away the son of Cronos began trying to provoke Hera with mocking words, saying with malice:

A bar chart showing the translation pair ratios across different translations. The number of unaligned pairs is 18 in Kazzazi’s, 6 in Nafisi’s, and 6 in Learner C’s translation. Other translations have fewer than three unaligned words. 1-1 pairs do not show any significant difference between direct and indirect translations, and 1-N pairs have a higher ratio in direct translation.
Figure 2. Translation pair ratios across different translations of Hom. Il. 4. 3–6.

Students’ translations were compared to those of other translators using translation alignment. As we see in the graph, the indirect translations leave a higher number of unaligned words in comparison to the students’ translations. Kazzazi’s translation includes extra synonyms and explanations that do not exist in the original Greek and are left unaligned. However, this graph only shows the unaligned tokens in the Persian translation and does not illustrate the unaligned words in the Greek text, where we see that Nafisi’s translation leaves six words unaligned, while some other translations have only one or two unaligned tokens in Greek, and two of them (learners B and E) leave no Greek word unaligned. All alignments were done by one annotator following the same guidelines. More details can be seen in the following word-by-word glosses. For styling reasons, Persian texts have been replaced by transliterations.

Nafisi’s translation (1958, 143)

(View the alignment on Ugarit.)

Transliteration and word-by-word glosses for Nafisi’s translation:

va [and] ānhā [they] sāqarhāye[goblets] zarrin [golden] be [to] dast [hand ] čašmān [eyes] rā [0][1] bar [on] divārhāye [walls] tro(v)ā [troy] duxte budand [gazed (literally, sewed)]. xodāye [god of] xodāyān [gods] ke [that] mixāst [wanted] herā [Hera] rā [0][1] be xašm āvarad [provoke] čonin [such] goft [said]

Revised machine translation results:

And they were staring at the walls of Troy with golden goblets in their hands. The god of the gods, who wanted to anger Hera, said:

Kazzazi’s translation (1998, 93)

(View the alignment on Ugarit.)

Transliteration and word-by-word glosses for Kazzazi’s translation:

ānān [they] jāmhāye [goblets] zarrin [golden] rā [0][1] be [to] ham [each other] midādand [gave] va [and] dar [in] hamān [same] hengām [moment] bar [on] šahre [city of] tro(v)āieān [trojans] minegaristand [were looking]. pas [then] kronosi [of Kronos] xāst [wanted] ke [that] bekušad [try] tā [to] bā [with] soxanāni [words] sard [cold] va [and] delāzar [upsetting] herā [Hera] rā [0][1] barāšubad [irritate] va [and] be xašm āvarad [provoke]; az in ruy [therefore], faribkārāne [deceitfully], vey [her] rā [0][1] goft [said]:

Revised machine translation results:

They gave each other the golden goblets and at the same time were looking at the city of Trojans. So [son] of Kronos wanted to try to irritate and provoke Hera with cold and upsetting words; Hence, he deceitfully said to her:

Student A’s translation

(View the alignment on Ugarit.)

va [and] jāmhāye [goblets] zarrin [golden] bargerefte [taking up] bar [on] farāze [over] šahre [city of] tro(v)a [Troy] čašm [eye] dāštand [have]. pure [son of] kronos [Kronos] ke [that] dar [in] talāš [effort] barāye [for] xašmgin [angery] sāxtane [to make] herā [Hera] bud[was], biderang [immediately] bā [with] soxanāni [words] gazande [harsh] faryād barāvard [shouted]

Revised machine translation results:

And they sat their eyes on the city of Troy, taking up their golden goblets. Son of Kronos that was trying to anger Hera, immediately shouted with harsh words

Student B’s translation

(View the alignment on Ugarit.)

Transliteration and word-by-word glosses:

va [and] ānān [they] hengāmi ke [when] šahre [city of] tro(v)ā [Troy] ra [0][1] minegaristand [were watching] moteqābelan [together] jāmhāye [goblets] zarrin [golden] boland kardand [lifted up]. pesare [son of] kronos [Kronos] biderang [immediately] qasde [attempt] āzordane [to annoy] herā [Hera] kard [did] va[and] be amd [deliberately] bā [with] kalamāti [words] gazande [stinging] soxan rānd [made a speech]

Revised machine translation results:

And they lifted up their golden goblets together as they were watching the city of Troy. Son of Kronos immediately attempted to annoy Hera and deliberately made a speech with harsh words

We have restricted our transliterations in this paper to the first two examples, however, the remaining alignment data is available on Ugarit:

The frequent use of participles and infinitives in ancient Greek is one of many ways in which it differs significantly from Persian. Furthermore, there are no definite articles, optative mood, middle voice, grammatical cases, or gender in Persian. Many learners often find such linguistic differences difficult to understand and render in a translation. For instance, participles and infinitives are commonly translated to finite verbs in Persian; however, we can see that many learners were successful in translating participles and infinitives. The majority of them (students A, B, C, and F) translated ἐρεθιζέμεν, which is an infinitive in Greek, to an infinitive in Persian. Another case in point is εἰσορόωντες, a Greek participle that students A and D were able to translate as a participle in Persian. Nonetheless, in many cases, we don’t see such flexibility of direct options in the target language. In the same sentence, the Greek participle ἀγορεύων could not be translated into a participle in any of the translations due to the linguistic limitations of the target language.

We see innovative attempts by learners to translate certain complexities of the Greek language to Persian more accurately. For instance, παραβλήδην, an adverb coming from the verb παραβάλλω, is accordingly translated to an adverb from a verbal root by Student F (“ta’ne zanān,” from the verb “ta’ne zadan”).

Having access to the original text allowed the learners to read various lexicon entries for specific words that had complex meanings and even look through commentaries to deepen their understanding of those words. For instance, in session eighteen of the Homeric course, the learners were asked to translate the following sentence:

ὣς τὸν μὲν λίπε θυμός, ἐπ᾽ αὐτῷ δ᾽ ἔργον ἐτύχθη ἀργαλέον Τρώων καὶ Ἀχαιῶν: οἳ δὲ λύκοι ὣς ἀλλήλοις ἐπόρουσαν, ἀνὴρ δ᾽ ἄνδρ᾽ ἐδνοπάλιζεν. (Hom. Il. 4.470–472)

A.T. Murray’s translation (rev. Crane):

So his spirit left him, and over his body was wrought grievous toil of Trojans and Achaeans. Even as wolves they leapt upon each other, and man made man to reel.

In this sentence, ἐδνοπάλιζεν is an obscure word that only occurs once in the whole Iliad; therefore, understanding it without the help of commentaries would be difficult. Being able to openly access commentaries as machine-readable text in these situations was especially helpful because even Persian-speaking learners who did not know English well could use machine translation to better understand the Greek text and provide a more accurate translation. In the translation of ἀνὴρ δ᾽ ἄνδρ᾽ ἐδνοπάλιζεν, the learners had access to two commentaries on the Perseus Digital Library, one of which also points out that “ἀνὴρ ἄνδρα” [man(sbj) man(obj)] is a poetic rendering of “ἀλλήλους” [each other]. Some examples from the translation of the phrase are given below:

  • Student A: “and each warrior pounded an opponent to the ground”
  • Student B: “and (they) jostled each other”
  • Student C: “and each agitated the other”
  • Student D: “a man struck a man to the ground”

Nevertheless, depending on how complicated the text or annotations are, it might occasionally be difficult to find the correct information. Novice learners might need practice to learn to navigate through long and complicated lexicon entries. If machine translation is used, there is also a chance of getting inaccurate results that would mislead learners. One case in point is the translation of δειδέχατ᾽ ἀλλήλους in the aforementioned exercise from session twelve by Student C as “they made a pact with one another.” This is an illustration of a situation where a learner may not have fully understood the commentaries as a result of inaccurate machine translation, though these occurrences have been rare. Bearing the benefits of having access to such a vast range of information in mind, we consider such errors to be rather negligible.

The alignments for the translations of Hom. Il. 4.470–472 are available on Ugarit:

Translation of Crito

In the spring of 2022, seven participants of the Homeric Greek course formed a translation group to produce the first direct translation of Plato’s Crito under the supervision of Farnoosh Shamsian. While Crito has four Persian translations, none of them are derived directly from the original Greek. Working with treebanks, commentaries, lexicon entries, and indirect Persian translations, each participant either refined an indirect Persian translation of Crito or translated it once again into Persian. All Persian translations were aligned to the Greek text by the translators themselves. The group met on a weekly basis to read and compare the translations. The initial goal of the group was to provide one finalized translation of Crito to Persian, but considering the high quality of the translations and the complexity of the text, it was decided to provide three finalized translations instead of one.

During the weekly meetings, the participants were able to not only critique existing Persian translations, but to actively engage with the original Greek text and form their own interpretations. The final three translations show noticeable improvement and precision compared to the indirect translations. Following discussions, each of the three finalized translations represents a different interpretation or approach to the text. For instance, while one of the translations is rather literal and focuses on representing the syntactic structure of the original Greek, another emphasizes lucidity and fluency. In the case of complexities that have sparked debate among translators or commentators, each Persian translation presents a unique interpretation (Shamsian and Crane 2022). The final goal is to openly publish all three translations simultaneously aligned with the original Greek to properly illustrate their variety of perspectives and approaches.

Conclusion

Based on the results of the Homeric Greek course, we conclude that cross-lingual annotations along with localized grammatical explanations provide us with an efficient and effective way of teaching Ancient Greek to Persian speakers. Through mastering how to use different annotations and tools used in the Homeric course, learners were able to provide accurate translations of a Homeric Greek text, and, later on, use the same methods and techniques to understand and translate Plato’s Crito.

Additionally, focusing on the localization of cross-lingual open resources allows us to efficiently upscale our method. We can make thousands of words of heavily annotated text available in another language simply by localizing the basic resources required for using treebanks. The grammar reference, Didakta Grammar for Annotation, has already proved to be easily localizable in Persian, and with minor revisions, it could be translated and localized in other languages as well.

Notes

[1] Postposition, commonly used as the marker of the object.

References

Crane, Gregory, Alison Babeu, Lisa Cerrato, Bridget Almas, Marie-Claire Beaulieu, and Anna Krohn. 2018. Perseus Digital Library. http://www.perseus.tufts.edu/hopper/.

Crane, Gregory. 2019. “Beyond Translation: Language Hacking and Philology.” Harvard Data Science Review 1, no. 2 (November 30). https://doi.org/10.1162/99608f92.282ad764.

Shamsian, Farnoosh, and Gregory Crane. 2022. “Corpus-Based Translation Training: Enhancing Translations from a Historical Language.” Translation in Transition 6. Prague, Czech Republic.

Foradi, Maryam. 2020. “Engagement with Classical Literature in the Framework of a Citizen Science Project Using Translation Alignment: Date Accuracy and Pedagogical Effectiveness.” PhD. diss., Universität Leipzig.

Gorman, Vanessa B. 2020. “Dependency Treebanks of Ancient Greek Prose.” Journal of Open Humanities Data 6 (March 26): 1–3. https://doi.org/10.5334/johd.13.

Kazzazi, Mir jalaleddin, trans. Iliad. By Homer. Tehran: Markaz, 1998.

Liu, Kanglong. 2020. Corpus-Assisted Translation Teaching: Issues and Challenges. Vol. 7. Corpora and Intercultural Studies. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-8995-9.

Mambrini, Francesco. 2016. “The Ancient Greek Dependency Treebank: Linguistic Annotation in a Teaching Environment.” In Digital Classics Outside the Echo-Chamber: Teaching, Knowledge Exchange & Public Engagement, edited by Gabriel Bodard and Matteo Romanello, 83–100. Ubiquity Press, 2016. https://doi.org/10.5334/bat.f.

Marneffe, Marie-Catherine de, Christopher D. Manning, Joakim Nivre, and Daniel Zeman. 2021 “Universal Dependencies.” Computational Linguistics 47, no. 2 (July 13): 255–308. https://doi.org/10.1162/coli_a_00402.

Nafisi, Saeed, trans. Iliad. By Homer. Tehran: Elmi Farhangi, 1958.

Palladino, Chiara, Farnoosh Shamsian, and Tariq Yousef. 2022. “Using Parallel Corpora to Evaluate Translations of Ancient Greek Literary Texts.” 1st Annual Conference of Computational Literary Studies. TU Darmstadt. Darmstadt, Germany.

Palladino, Chiara. “Reading Texts in Digital Environments: Applications of Translation Alignment for Classical Language Learning.” 2020. Journal of Interactive Technology and Pedagogy 18 (December 10). https://jitp.commons.gc.cuny.edu/reading-texts-in-digital-environments-applications-of-translation-alignment-for-classical-language-learning/.

Pharr, Clyde. 1920. Homeric Greek: A Book for Beginners. Boston: D. C. Heath & Co. https://github.com/gregorycrane/Homerica/blob/master/pharr-ocr.txt.

Rydberg-Cox, Jeffery. 2000. “Overview of Greek Syntax.” Perseus Digital Library.

Smyth, Herbert Weir. 2016. A Greek Grammar for Colleges. Woodstock, GA: American Book Company. http://www.perseus.tufts.edu/hopper/text?doc=Perseus:text:1999.04.0007.

Yousef, Tariq, Chiara Palladino, Farnoosh Shamsian, and Maryam Foradi. 2022. “Translation Alignment with Ugarit.” Information 13, no. 2 (January 27): 65. https://doi.org/10.3390/info13020065.

Van Hal, Toon, and Alek Keersmakers. 2021. “Seeing the Light through the Trees: How Treebanks Can Advance the Education of Classical Languages.” Les Études Classiques 89, no. 1–4. https://lesetudesclassiques.be/index.php/lec/article/view/759.

Vyatkina, Nina, and Alex Boulton. 2017. “Corpora in Language Teaching and Learning.” Language Learning and Technology 21, no. 3: 66–89. https://hal.archives-ouvertes.fr/hal-01237582.

About the Authors

Farnoosh Shamsian earned a BA in philosophy and an MA in Ancient Iranian Languages from the University of Tehran. She is currently a doctoral candidate at Leipzig University, focusing on teaching Ancient Greek to Persian speakers using digital tools and methods of annotation. Her main research interest is the application of digital annotation such as treebanks and translation alignments in localizing pedagogical resources in low-resource languages.

Gregory Crane is a professor in the Classical Studies Department at Tufts University, an adjunct professor in the Department of Computer Science, and Editor-in-Chief of the Perseus Project. As an Alexander von Humboldt Professor, he initiated the Open Greek and Latin Project (OGLP), which aims to represent every source text produced in Classical Greek or Latin from antiquity through the present. He has long been fascinated by the interplay between rapidly advancing digital technology and the humanities.

Books lined up on a shelf.
0

Don’t Judge a Book—But What about the Professor Who Assigned the Book?

Abstract

With the cost of higher education becoming increasingly scrutinized, and specifically, attention being paid to non-tuition costs like textbooks, digital open-educational resources (OER) offer a potential pathway to no- and low-cost course materials. While professors might encounter several concerns related to adopting any OER in their class, less is known about how students perceive the professor’s decision to opt for OER. Limited existing research suggests that assigning open-source textbooks should afford professors positive evaluations from students. The current study aims to replicate and extend upon previous experimental research comparing students’ perceptions of professors based on their textbook choices—specifically, whether they use a low-cost OER or a high-cost traditional textbook, and whether they choose to modify that book or use it as is. Drawing on responses from 153 participants recruited from an undergraduate introductory psychology course and representing a range of majors, findings from the current study provide partial support for previous research, suggesting that professors who use OER might be seen as committed to accessibility. Adding to the existing body of research, the current study finds that modifying the textbook perhaps affords even more positive evaluations from students, including whether participants saw the professor as caring, supportive of students, enthusiastic about teaching, and committed to student learning.

Keywords: open educational resources (OER); perceptions of professors; textbooks; textbook customization.

Introduction

Advances in digital technology have created a pathway for reducing textbook costs by offering e-books, which are generally cheaper than traditional textbooks (Hanson 2022). Digital technology has also offered a means for widely distributing open-educational resources (OER), which can then be accessed by students online, often at no cost to them—presuming they have internet access. Digital OER can help students access course material—both from a reading and financial standpoint (e.g., Bliss et al. 2013; Delimont et al. 2016; Grissett and Huffman 2019; Hilton 2016; Watson et al. 2017). Research has also generally found that OER achieves comparable learning outcomes for students (e.g., Grimaldi et al 2019). Despite many benefits, admittedly, there are still barriers to faculty adopting OER, including concerns about the perceived workload needed to investigate and potentially modify available OER options (McGreal 2019). Considering the workload OER often requires begs the question of what could incentivize adopting OER. One such potential incentive might be the impact on students’ perception of their professors when they opt for lower-cost OER. The current study aims to replicate and extend previous work exploring this question.

Background

Student perceptions of instructors who use OER

Existing literature suggests that students’ appreciation for improved accessibility of digital OER may spill over into students’ perceptions of the faculty who use such materials. For example, students reported a higher satisfaction rating of their professor when the course used free- or reduced-cost materials; although those professors were not necessarily seen as more effective teachers (Fine and Read 2020, 167–68). Similarly, Nusbaum and Cuttler (2020) found that professors randomly assigned to use an OER textbook for their introductory psychology course, as compared to a traditional textbook, were rated more favorably by their students in an end-of-the-semester survey. Because such studies used ratings of real professors, it afforded their results higher external validity. That also means that the ratings of the professors could be due to several factors beyond their professor’s use of OER.

As an alternative approach, Vojtech and Grissett (2017) presented participants with descriptions of professors that manipulated whether the professor allegedly used a more expensive traditional textbook or lower-cost OER. Their preliminary evidence suggested that students might perceive a professor more positively—kinder, more encouraging of students, and more knowledgeable—when the described professor assigned the lower-cost open-source option. Further, by reducing potential confounding variables that occur within a more field-based study, their study more clearly pointed to the use of OER being the cause of the positivity participants felt about the professor. That is not to say that their results were without limitations.

Limitations of past work

As Vojtech and Grissett (2017) noted themselves, there were limitations with their early evidence, including its basis on a small sample of 23 participants enrolled in an upper-level psychology course (166–67). The small sample meant that while Vojtech and Grissett varied factors like the professor’s gender, length of teaching experience, and whether the professor opted to use the textbook “as-is” or to customize it for their class, it would be difficult to consider whether these variables interacted with the professor’s choice to use OER in shaping participants’ perceptions. Considering the sample consisted of students in an upper-level psychology course—who would predominantly represent psychology majors, or potentially other social/behavioral science students—and asked about a psychology professor, it was also unclear whether these results would generalize when students were looking at a professor in other fields of study. Finally, as Vojtech and Grissett noted, their design set up participants to make a direct comparison between the two professors, and the wording “only $30” for the OER professor may have portrayed that target more positively (167).

Addressing limitations: overview of the current study

To address some of these limitations, the current study made a few alterations. First, a larger sample was drawn from an introductory psychology course; this sample recruitment pool aligned with Nusbaum and Cuttler’s (2020) approach for Study 1. The advantage of recruiting from an introductory psychology course was two-fold: 1) the majority of these students were first-year students who would have had limited previous experience with open-source textbooks and purchasing textbooks for college-level classes; and 2) the students in the course tend to represent a wide range of majors beyond psychology, and in fact, beyond social and behavioral sciences (Altman et al., 2021). Given participants were completing the study through their introductory psychology course, and all sections of that course used the OpenStax Psychology textbook, the current study shifted the hypothetical professor to other fields; modeling Nusbaum and Cuttler’s second study, the professor’s field of study was either biology or history.

To avoid some of the issues with students comparing two professors who vary only in terms of their textbook cost, the current study employed a between-subjects design: all participants read about and rated a single professor, with reduced language bias in that single description. The current study also was able to consider some variables that might interact with the professor’s choice to use OER or a traditional textbook. Specifically, retaining the manipulation of Vojtech and Grissett (2017), the current study explored whether altering the textbook, leading to a more customized portrayal of the content for students, or using the book “as is” influenced students’ views of the professor, whether they opted to use OER or a traditional textbook. Because OER is often touted for its potential to be readily adapted by instructors, this manipulation seemed particularly valuable in understanding students’ perceptions of professors based on textbook choices. Of course, traditional publishers will also sometimes offer this flexibility, and in fact, assist in modifying such materials, reducing the level of effort an instructor needs to invest to adapt course materials.

Whether adapting OER or traditional materials, one argued value is that customizing the textbook can produce a more relevant textbook that students can better connect with. That potential outcome might be in part supported by previous studies that find students feel customized content was more relevant to their class (e.g., Bliss et al. 2013). It seems reasonable that if students find such materials relevant, they might be appreciative of professors who put in that effort, feeling that those professors care about their students. Another proposed benefit of customizing course materials is equity, in that professors can create materials that meet their diverse classroom of students where they are (e.g., de los Arcos et al. 2016; Van Allen and Katz 2020). However, research seems limited to support these ideas, including whether students perceive modified textbooks in this way.

Hypotheses

Given previous findings suggest that using OER might be associated with more positive evaluations of professors (e.g., Fine and Read 2020; Nusbaum and Cuttler 2020; Vojtech and Grissett 2017), the current study hypothesized that 1) participants would have more positive views of the professor who used a no-cost/low-cost open-source textbook, as compared to a high-cost textbook obtained from a traditional publisher. Additionally, as some research suggested, students might appreciate customized textbooks (e.g., Bliss et al. 2013), it was hypothesized that 2) participants would have more positive views of the professor who modified the textbook, as compared to using the textbook “as is.” If these two variables interacted, it seemed reasonable that they might have additive effects such that 3) participants would rate the professor who used a modified low-cost textbook as most positive, and the professor who used a high-cost “as-is” textbook as least positive. No specific predictions were made about the impact of the field of study; ideally, the field would have no impact, suggesting that any effects of using OER would generalize to different fields of study.

Methods

Design

The study used a 2 (textbook cost: high-cost/publisher’s textbook vs. low-cost/open-source textbook) x 2 (textbook adaptation: as is vs. modified) x 2 (subject area: biology vs. history) experimental between-subjects design. The choice to vary the field of study was driven by several factors. Participants were completing the study through their introductory psychology course, which uses an open-source textbook that is available to students digitally for free; thus, it seemed best to avoid using psychology as a field of study. Biology and history were selected for two reasons: 1) Nusbaum and Cuttler (2020) used biology and history in their second study, and thus there was methodological precedence for using these fields, and 2) both fields represented common courses taken by students for their general education curriculum at the current institution.

Procedures

To safeguard participants, the study was reviewed and approved through the IRB. Introductory psychology students were invited to participate in the study to earn partial credit toward their experiential learning grade. Students had several options besides the current study to earn credit toward this grade. To be eligible, participants had to be 18 years of age or older. When students signed up for the study, they were directed to the online survey which they could complete based on their availability.

Manipulations of independent variables

After completing the informed consent, participants read a brief description of a professor. These descriptions largely replicated those used by Vojtech and Grissett (2017), with a few alterations:

  • The professor was not designated by name. Gender-based pronouns were changed to “they.” Participants were informed this was to protect the identity of the professor in the description. The alteration aimed to reduce the potential effect of the professor’s gender on participants’ perceptions, as well as interaction effects between the professor’s gender relative to the participant’s gender.
  • Teaching experience was held constant at 10 years, rather than varying it between 5 and 25 years, as teaching experience was not a variable of interest in the current study.
  • The description varied whether the professor taught in the field of biology or history, to demonstrate the generalizability of any findings across different areas of study.

Participants were informed that identifying information, including gender-based pronouns, had been removed. Beyond the independent variables, all descriptions were highly similar:

Professor A is a [biology/history] professor. They have been teaching in this field for 10 years and really enjoy their job. In class, they often use a mixture of lecturing, videos, and activities to help students learn. Professor A expects that students come to class prepared, having studied the required readings for the day ahead of time. The textbook they use is [a popular publisher’s textbook; students can get a digital copy for $175 or a printed copy for $250/an open-source book; students can get a digital copy for free ($0) or a printed copy for $40]. Professor A uses [the textbook “as-is” directly from the publisher, with no alterations to the book’s content. Although that means the content sometimes feels a little less personally relevant for the students in Professor A’s class, it does make it easier for students to sell their textbooks at the end of the term/modifies the textbook from the publisher and customizes the book’s content for their students. While this customization makes the course content more personally relevant for students in Professor A’s class, it does make it harder for students to sell their textbooks at the end of the term.] Overall, the textbook has received good student reviews and appears to help students better understand the material.

Participants saw a reminder that they would be quizzed on the description, to encourage them to thoroughly read the description before moving on. Three of the four quiz questions served as manipulation checks, to confirm that participants paid attention to the professor’s subject and textbook choices; a fourth question asked about how long the professor had been teaching, which was consistent across all descriptions. Participants who failed to answer all four questions of the quiz correctly were excluded from the data analysis.

Measurement of dependent variables

To measure participants’ perceptions of the professor, various close-ended statements were derived from the work of Vojtech and Grissett (2017) and Nusbaum and Cuttler (2020): “The professor…

  • …cares about students.”
  • …lacks knowledge of their field.”
  • …is very enthusiastic about teaching in their field.”
  • …is supportive of students.”
  • …lacks creativity in their approach to teaching.”
  • …is committed to student learning.”
  • …is committed to creating an equitable learning environment.”
  • …cares about making course materials accessible to students.”
  • …works to represent diverse voices in the class.”
  • …wants their students to relate to the course material.”

The display of the statements was randomized. For each item, participants indicated to what degree they felt the statement was true, ranging from 1, being not at all true, to 4, being entirely true. Considering that positive impressions may drive decision-making when it came to enrollment, participants were also asked to rate how likely they would be to take a course with this particular professor if they had to take a class in the professor’s field and if they did not have to take a class in the professor’s field; for both of these items, participants responded on a scale with 1, being extremely unlikely, to 5, being extremely likely.

Before completing the study, participants reported on demographics, including their number of earned credits to represent class standing, their field of study, and whether they were the first in their family to attend or earn a college degree. Participants described their gender identity and race/ethnicity using open-ended responses to allow participants to use language that was suitable to them. Finally, participants confirmed whether they wished for their data to be included in the analysis; this technique was employed to reduce any pressure on participants. Any participants who opted to exclude their data from analyses still earned credit toward their experiential learning component of the course.

Analysis of data

Before conducting any analysis, responses were removed for any participants who indicated they did not wish their data to be included in analyses. Additionally, responses from participants who failed to answer the four manipulation check questions correctly were removed; based upon their performance in these manipulation check items, it was unclear if they had thoughtfully processed the manipulation and thus would be unlikely to have been affected by the manipulation. Due to the multifactorial design and the multiple dependent variables, multiple analysis of variance (MANOVA) was used to avoid problems with repeated testing.

Results

Excluded data

Of the 190 participants who completed the study, 5 (3%) reported that they wished their data to be excluded from data analysis. Another 32 (17%) participants were excluded based on their failure to answer the manipulation checks correctly. This left 153 total participants included in further data analysis.

Demographics

Most of the participants were in their first year of college: 44% had earned 0 college credits and 30% had earned less than 29 credits before the current term. The remaining participants were in their second (11%), third (9%), or fourth year (3%). The sample represented various fields of study, with the largest portion of participants representing the health professions (33%) and/or social and behavioral sciences (20%). There were at least some students in all other areas: arts (7%), business (12%), education (13%), humanities (6%), life/natural sciences (4%), and physical sciences (12%). A small portion of participants (26%) reported that they were the first person in their immediate family to attend college, and another 6% reported that they would be the first in their immediate family to earn a college degree. Approximately 74% of the sample identified as White/Non-Hispanic, including those who identified themselves as European American or “Caucasian.” The majority of participants (67%) identified as a woman or female, while 29% identified as a man or male, and 2% identified as non-binary or genderfluid; the remaining participants (2%) did not provide anything in terms of gender identity.

Overall perceptions of the hypothetical professor

In an exploratory analysis, ratings of the hypothetical professor appeared to be correlated (see Table 1). Of the evaluative statements that seemingly stood by themselves was the degree to which the professor seemed to lack knowledge in their field. Despite the relationships between ratings, no efforts were made to create a singular measure by combining ratings, to better examine any nuances in terms of perceptions. All reported means represent the mean for that individual rating across all participants within the identified conditions.

Judgment: The professor… M (SD) 2 3 4 5 6 7 8 9 10 11
1. cares about their students. 3.27 (0.75) -0.15 0.45c 0.64c -0.23b 0.47c 0.41c 0.41c 0.29c 0.38c 0.27b
2. lacks knowledge in their field. 1.12 (0.49) -0.06 -0.05 0.18a -0.18a -0.04 -0.10 -0.07 -0.10 -0.11
3. is very enthusiastic about teaching in their field. 3.28 (0.76) 0.39c -0.31c 0.44c 0.24b 0.36c 0.03 0.28b 0.43c
4. supportive of students. 3.20 (0.69) -0.17a 0.48c 0.47c 0.41c 0.35c 0.32c 0.25b
5. lacks creativity in their approach to teaching. 1.67 (0.92 -0.21c -0.12 -0.26b -0.12 -0.44c -0.49c
6. committed to student learning. 3.44 (0.63) 0.37c 0.30c 0.22b 0.33c 0.43c
7. committed to creating an equitable learning environment. 3.10 (0.86) 0.52c 0.41c 0.31c 0.19a
8.tries to create an inclusive learning environment. 2.99 (0.80) 0.37c 0.50c 0.34c
9.cares about making course materials accessible to students. 3.16 (0.98) 0.14 0.07
10.works to represent diverse voices in the class. 2.25 (0.88) 0.42c
11.wants their students to relate to the course material. 2.77 (1.10)

a: p < .05, b:, p < .01, c: p < .001

Table 1. Means and correlations for perceptions of the professor.

Hypothesis testing

Hypothesis 1 predicted that participants would view the professor who used a no-cost/low-cost open-source textbook more positively than the professor who used a high-cost traditional textbook. Overall, the results provided limited support for Hypothesis 1. Participants appeared to feel that the hypothetical professor cared more about making course materials accessible (M = 3.71, SD = 0.56), relative to the professor who opted for the high-cost textbook (M = 2.63, SD = 1.02), F (1, 145) = 68.66, p < .001, ηp2 = .32. No other statistically significant differences emerged that would suggest opting for a low-cost textbook created more favorable perceptions of the professor (ps >.06). As another means to examine positivity towards the professor, participants’ reported likelihood of taking a course with the hypothetical professor was examined; although textbook cost did not impact this measure for courses that participants would have to take, F (1, 145) = 1.97, p = .16, ηp2 = .01, it did have a statistically significant impact when students did not have to take a course in the professor’s field, F (1, 145) = 5.10, p = .03, ηp2 = .03. Participants reported being more willing to take a course with the professor who opted for the low-cost textbook (M = 2.97, SD = 1.16) as compared to a professor who opted for the high-cost textbook (M = 2.53, SD = 1.30); of note, neither of these means exceeded the mid-point of the scale. Factoring in the field of study did not alter these findings (interactions: ps > .06).

Hypothesis 2 predicted that participants would view the professor who modified the textbook more positively than the professor who retained the book “as is.” This prediction was supported across several ratings (see Table 2 for statistically significant results). Unlike what was noted with cost, modifying the textbook did impact participants’ reported likelihood of taking a course with the hypothetical professor if they had to take the course, F (1, 145) = 4.99, p = .03, ηp2 = .03, but not if they did not have to take a course in the professor’s field, F (1, 145) = 2.62, p = .11, ηp2 = .02. For the former main effect, participants reported being more willing to take a course with the professor who opted to modify the textbook (M = 4.01, SD = 1.00) relative to the professor who kept the textbook “as is” (M = 3.63, SD = 1.10), providing some additional support for Hypothesis 2. Factoring in the field of study did not alter any of these findings (interactions: ps > .35).

Judgment: The professor… MANOVA Results “As Is” Condition
(n = 75)
M (SD)
Modified Condition
(n = 78)M (SD)
…cares about their students. F (1, 145) = 11.29, p < .01, ηp2 = .07 3.08 (0.78) 3.46 (0.66)
…is very enthusiastic about teaching in their field. F (1, 145) = 34.96, p < .001, ηp2 = .19 2.95 (0.80) 3.60 (0.54)
…is supportive of students. F (1, 145) = 6.72, p = .01, ηp2 = .04 3.05 (0.72) 3.33 (0.64)
…lacks creativity in their approach to teaching. F (1, 145) = 34.17, p < .001, ηp2 = .19 2.07 (0.96) 1.28 (0.68)
…is committed to student learning. F (1, 145) = 28.13, p < .001, ηp2 = .16 3.20 (0.68) 3.68 (0.47)
…tried to create an inclusive learning environment. F (1, 145) = 12.80, p < .001, ηp2 = .08 2.77 (0.78) 3.21 (0.76)
…works to represent diverse voices in the class. F (1, 145) = 25.24, p < .001, ηp2 = .15 1.92 (0.80) 2.58 (0.83)
…wants their students to relate to the course material. F (1, 145) = 104.28, p < .001, ηp2 = .42 2.05 (1.00) 3.46 (0.66)
Table 2. Main effects on judgments: using textbook “as is” vs. modifying textbook.

 

Hypothesis 3 addressed the potential interaction between the cost of the textbook and whether or not it was modified. Specifically, it predicted that participants would rate the professor who used a modified low-cost textbook as most positive, and the professor who used a high-cost “as-is” textbook as least positive. This hypothesis was partially supported on a single rating, F (1, 145) = 4.66, p = .03, ηp2 = .03 (see Figure 1). For a low-cost textbook, participants rated the professor as more caring when using a modified textbook, instead of using the book “as is,” t (70) = -4.04, p < .001. For the high-cost textbook, however, there was no statistically significant difference based on modification, t (79) = -0.86, p = .39. Cost seemed to have a statistically significant effect when the book was modified, t (76) = -2.06, p = .04, but not if the book was kept “as is”, t (73) = 1.17, p = .25.

Participants who read about the professor who used the low-cost textbook rated the professor as more caring when that professor modified the book as compared to keeping it as is. When the professor used a high-cost textbook, whether they modified it or not did not affect participants' ratings of how caring the professor seemed.
Figure 1. Professor seems to care about their students.

When factoring in the subject area, a three-way interaction emerged, affecting whether participants saw the professor as committed to creating an equitable learning environment, F (1, 145) = 4.87, p = .03, ηp2 = .03 (see Figure 2). This interaction seemed largely driven by perceptions of the history professor: no statistically significant differences emerged related to perceptions of the biology professor (ps > .12), but a two-way interaction emerged for the history professor, F (1, 74) = 5.04, p = .03, ηp2 = .06. In breaking down this interaction, modifying the low-cost textbook was seen more favorably than keeping it “as is,” t (36) = -2.71, p = .01, while there was no statistically significant difference between modified and “as is” for the high-cost textbook, t (38) = 0.54, p = .30. Likewise, cost only had a statistically significant effect when the textbook was modified, t (39) = -1.95, p =.03, but not when the textbook was adopted “as is,” t (35) = 1.27, p = .11.

When reading about a biology professor, participants were equally likely to see the professor as equitable no matter what textbook they used. However, for the hypothetical history professor, participants rated the professor as more committed to creating an equitable learning environment when they modified the low-cost textbook.
Figure 2. Professor creates an equitable learning environment.

Finally, when examining participants’ reported likelihood of taking a course with the hypothetical professor, there was no interaction between cost and modification for either a required or elective course (ps > .45). Factoring in the field of study did not alter any of these findings (interactions: ps > .20).

Discussion

Although the current study did not fully replicate the results of Vojtech and Grissett (2017), it did offer some limited confirmation of those previous findings. Specifically, participants saw the professor who used low-cost OER as more concerned about making course materials accessible to students. They were also more willing to take an elective course with this professor, as compared to the professor who used a high-cost traditional textbook. The discrepancy between the findings of Vojtech and Grissett (2017) and the current findings may speak more to methodology differences. First, the current study had a larger sample size drawing from students beyond the psychology major. Additionally, the current study did not create a forced comparison between the professor who opted for OER and the professor who opted for the traditional textbook; any positivity felt towards professors who opt for OER might be more relative in nature, in comparison to their colleagues who opt for higher cost traditional textbooks. Third, the current study permitted for comparison between another decision about textbooks: whether the professor modified the textbook or used it as is.

It was indeed that choice—whether the professor opted to modify the book or use it as is—that seemed to garner more positive evaluations from students. Specifically, modifying the textbook appeared to signal to students that the professor was enthusiastic about teaching, cared about their students, and was committed to student learning. This decision also seemed to suggest to students that the professor cared about creating an inclusive environment where diverse voices were represented. Within the description of the professor who opted to modify the textbook, it was noted that customizing the textbook can make the content feel more personally relevant to students—making the main effect of modifications on their judgment of whether “the professor wants their students to relate to the course material” less interesting. None of the other judgments were referenced in the description.

Finally, the current study considered that any positivity felt towards the professor based upon their textbook decision might be more complex than the main effects would reveal. For example, the professor who adopted the low-cost OER was seen as caring for their students, as long as they modified the textbook. It was not merely that students appreciated the professor’s extra effort to customize the book, given customizing a high-cost book was not seen as any more caring than leaving that expensive book as is. The field of study further complicated any effect of opting for OER, at least regarding whether participants felt the professor was committed to creating an equitable learning environment. For the history professor, opting for low-cost OER seemed to incur a less favorable rating if the professor kept the materials as is, with no modifications. On the other hand, for biology, no statistically significant effects were observed based on the choice to use low- or high-cost textbooks or to modify the book or not. This distinction between the two fields might be in part explained by the fact that students who take biology courses are used to spending more on textbooks, while those who take history classes have grown to expect the course materials in these classes to be more low-cost, at least relative to science courses.

Limitations and directions for future research

The current study relied on brief descriptions of hypothetical professors. As Nusbaum and Cuttler (2020) found, while students rated their real professors more positively when said professor used open-source resources, their findings did not generalize to a hypothetical professor/course. While the current study affords an element of control by creating an artificial description, it does create a disconnect between judgments of a hypothetical scenario and reality. Some participants even admitted that it was hard to make assumptions about a professor based only on a brief description. That said, students regularly make decisions about professors based upon reading a few brief evaluations on sites like ratemyprofessor.com.

Additionally, biology and history generally differ in terms of textbook costs, with the former being a costlier field of study. This confound could explain the observed three-way interaction in terms of whether the professor was seen as committed to creating an equitable classroom. Although the goal had been to provide a similar replication by using similar price points to Vojtech and Grissett (2017), these price points seemed higher than most textbooks that students would purchase in their first year at the present institution, especially if they were taking more humanities courses, such as history; the lower cost OER might not necessarily have been as attractive as the higher cost traditional textbook was unattractive.

Implications

In making choices about textbooks, faculty might be prone to focus on the content of the book as the primary criterion to be evaluated. Certainly having valid and credible content in a textbook is important. Beyond that decision, though, students seemingly make assumptions about their professor based on whether that textbook is affordable and whether the professor modifies the textbook. Although these assumptions likely will be only a small factor in terms of whether students take a professor’s class or not, they reasonably could affect the end-of-term evaluation surveys students complete, and when those evaluations are factored into decisions about maintaining and promoting faculty, they perhaps are not a matter to be entirely ignored.

Conclusions

With ongoing changes to digital technology, OER may become a choice more professors are considering. Students may seemingly give some credit to those professors, in that they perceive those professors as willing to make material accessible to students. However, that positivity may not be generalized to other evaluations, and in fact, modifying a textbook seems to bring broader positivity in terms of evaluations from students. For professors looking to impress their students, open-source resources tend to offer avenues for modifications to allow professors to tailor course resources to their course and their students.

References

Altman, William S., Melissa J. Beers, Elizabeth Yost Hammer, Erin E. Hardin, and Jordan D. Trosi. 2021. “Reimagining How We Teach Introductory Psychology: Support for Instructors Adopting the Recommendations of the PAA Introductory Psychology Initiative.” Scholarship of Teaching and Learning in Psychology 7, no. 3 (September): 181–191. https://doi.org/10.1037/stl0000289.

Bliss, T. J., T. Jared Robinson, John Hilton, and David A. Wiley. 2013. “An OER Coup: College Teacher and Student Perceptions of Open Educational Resources.” Journal of Interactive Media in Education 4, no. 1 (February): 1–25. http://doi.org/10.5334/2013-04.

de los Arcos, Beatriz, Robert Farrow, Rebecca Pitt, Martin Weller, and Patrick McAndrew. 2016. “Adapting the Curriculum: How K–12 Teachers Perceive the Role of Open Educational Resources.” Journal of Online Learning Research 2, no. 1 (March): 23-40. https://www.learntechlib.org/primary/p/151664/.

Delimont, Nicole, Elizabeth C. Turtle, Andrew Bennett, Koushik Adhikari, and Brian L. Lindshield. 2016. “University students and faculty have positive perceptions of open/alternative resources and their utilization in a textbook replacement initiative.”  Research in Learning Technology 24 (June). https://doi.org/10.3402/rlt.v24.29920.

Fine, Monica B., and Heather Read. 2020. “Factors Impacting Student Perception of Open Educational Resources.” e-Journal of Business Education & Scholarship of Teaching 14 no. 1 (June): 151–173. https://files.eric.ed.gov/fulltext/EJ1276430.pdf.

Grimaldi, Phillip J., Debshila Basu Mallick, Andrew E. Waters, and Richard G. Baraniuk. 2019. “Do open educational resources improve student learning? Implications of the access hypothesis.” PLoS ONE 14, no. 3 (March). https://doi.org/10.1371/journal.pone.0212508.

Grissett, Judy O., and Charles Huffman. 2019. “An Open versus Traditional Psychology Textbook: Student Performance, Perceptions, and Use.” Psychology Learning and Teaching 18, no. 1 (November): 21–35. https://doi.org/10.1177/1475725718810181.

Hanson, Melanie. “Average Cost of College Textbooks” EducationData.org. Last modified July 15, 2022. https://educationdata.org/average-cost-of-college-textbooks.

Hilton, John, III. 2016. “Open Educational Resources and College Textbook Choices: A Review of Research on Efficacy and Perceptions.” Educational Technology Research and Development 64 (February): 573–590. https://doi.org/10.1007/s11423-016-9434-9 .

McGreal, Rory. 2019. “A Survey of OER Implementations in 13 Higher Education Institutions.” International Review of Research in Open and Distributed Learning 20, no. 5 (December). https://doi.org/10.19173/irrodl.v20i5.4577.

Nusbaum, Amy, T., and Carrie Cuttler. 2020. “Hidden Impacts of OER: Effects of OER on Instructor Ratings and Course Selection.” Frontiers in Education 5, no. 72 (June): 1–7. https://doi.org/10.3389/feduc.2020.00072.

Van Allen, Jennifer, and Stacy Katz. 2020. “Teaching with OER During Pandemics and Beyond.” Journal for Multicultural Education 14, no. 3/4 (December): 209–218. https://doi.org/10.1108/JME-04-2020-0027.

Vojtech, Gabrielle, and Judy Grissett. 2017. “Student Perceptions of College Faculty Who Use OER.” International Review of Research in Open and Distributed Learning 18, no. 4 (June): 155–171. https://doi.org/10.19173/irrodl.v18i4.3032.

Watson, C. Edward, Denise P. Domizi, and Sherry A. Clouser. 2017. “Student and Faculty Perceptions of OpenStax in High Enrollment Courses.” International Review of Research in Open and Distributed Learning 18, no. 5: 287–304. https://doi.org/10.19173/irrodl.v18i5.2462.

About the Author

Randi Shedlosky-Shoemaker is an associate professor in the Department of Psychology at York College of Pennsylvania. They completed their graduate studies within the field of social psychology at the Ohio State University, with a focus on narrative psychology. Their current research focus covers issues related to social identity, inclusivity, equity in higher education, and teaching about social justice. They teach courses on general psychology, critical thinking and writing in the psychology field, multicultural awareness, intimate relationships, and group dynamics, as well as serving as an academic advisor to psychology majors. Beyond working with students, they often contribute to faculty development at their institution.

Images are for demo purposes only and are properties of their respective owners. ROMA by ThunderThemes.net

Skip to toolbar