Tutor vs. Automatic Focused Feedback and Grading of Student ESP Compositions in an Online Learning Environment

Document Type : Research Article

Authors

Foreign Philologies and their Linguistics, Philology, Universidad Nacional de Educación a Distancia (UNED), Madrid, Spain

Abstract

This article discusses the affordances and limitations of an automatic text evaluator in the context of the online teaching/learning of composition writing skills within a specialised linguistic domain, namely, English for Tourism. The system, named G-Rubric, was designed and built by an interdisciplinary team of linguists, psychologists, educationalists, and computer engineers to explore the applicability of data-driven language learning in education, for which it subsequently obtained several awards and distinctions. This article describes the adaptation process of G-Rubric to English for Tourism, contextualized in a distance learning university degree, and analyses its potential to substitute or complement frontline tutors in the task of revising and assessing student compositions. Two types of textual evaluation are provided by G-Rubric: numerical grading and focused feedback on form (writing) and function (content). Content evaluation is based on pattern-matching and machine reasoning against a specialised corpus and associated knowledge previously inserted in the tool as appropriate. The article compares the performance of both tutors and system and proposes specific lines of research to gain insights into their optimal integration.

Keywords