A Comprehensive Review of Automated Essay Scoring (AES) Research and Development

Chun Then, Lim and Chih How, Bong and Wee Sian, Wong and Nung Kion, Lee (2021) A Comprehensive Review of Automated Essay Scoring (AES) Research and Development. Pertanika Journal of Science & Technology, 29 (3). pp. 1875-1899. ISSN 0128-7680

[img] PDF

Download (214kB)
Official URL: http://www.pertanika.upm.edu.my/pjst/browse/regula...


Automated Essay Scoring (AES) is a service or software that can predictively grade essay based on a pre-trained computational model. It has gained a lot of research interest in educational institutions as it expedites the process and reduces the effort of human raters in grading the essays as close to humans’ decisions. Despite the strong appeal, its implementation varies widely according to researchers’ preferences. This critical review examines various AES development milestones specifically on different methodologies and attributes used in deriving essay scores. To generalize existing AES systems according to their constructs, we attempted to fit all of them into three frameworks which are content similarity, machine learning and hybrid. In addition, we presented and compared various common evaluation metrics in measuring the efficiency of AES and proposed Quadratic Weighted Kappa (QWK) as standard evaluation metric since it corrects the agreement purely by chance when estimate the degree of agreement between two raters. In conclusion, the paper proposes hybrid framework standard as the potential upcoming AES framework as it capable to aggregate both style and content to predict essay grades Thus, the main objective of this study is to discuss various critical issues pertaining to the current development of AES which yielded our recommendations on the future AES development.

Item Type: Article
Additional Information: Information, Communication and Creative Technology
Uncontrolled Keywords: Attributes, automatic essay scoring, evaluation metrics, framework, human raters, recommendation, UNIMAS, University, Borneo, Malaysia, Sarawak, Kuching, Samarahan, IPTA, education, Universiti Malaysia Sarawak
Subjects: Q Science > QA Mathematics > QA76 Computer software
Divisions: Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology
Depositing User: How
Date Deposited: 06 Aug 2021 05:52
Last Modified: 12 Sep 2022 02:48
URI: http://ir.unimas.my/id/eprint/35758

Actions (For repository members only: login required)

View Item View Item