Student use of automated essay evaluation technology during revision

Abstract

The purpose of this study was to examine how six middle-school students used Automated Essay Evaluation (AEE) technology to revise their writing. Students in a combined 7th and 8th grade Literacy class at one school participated in two in-depth think alouds and semi-structured interviews as they used AEE technology to revise their writing on two separate writing tasks. Constant-comparative analysis of data, including think alouds, semi-structured interviews, and student writing along with a separate quantitative analysis of student revisions revealed themes in three areas: (a) student use of AEE feedback to make revisions; (b) student motivation to revise their writing when using AEE technology; (c) and student understanding and application of AEE feedback during revision. Findings indicated that students who received low scores used AEE feedback to prompt non-surface revisions whereas students with high scores did not. Further, students who used AEE feedback to prompt non-surface revisions made more overall non-surface revisions, revised for different reasons, made more t-unit level revisions, and had more revisions rated as major successes than students who did not use the feedback. Students who used the AEE feedback, MY Editor, were often confused by the grammar and punctuation feedback and had a low success rate using it. However, students were more successful with the spell checker only feedback. In addition, findings show that students were motivated to revise because of the numerical scores the technology assigned their writing. Moreover, knowledge that they would receive a score prompted students to do extensive revising prior to submitting their writing for scoring. Finally, student understanding of the AEE feedback was varied. Implications for classroom use of AEE technology and directions for future research are discussed.