Chun Then, Lim and Chih How, Bong and Wee Sian, Wong and Nung Kion, Lee (2021) A Comprehensive Review of Automated Essay Scoring (AES) Research and Development. Pertanika Journal of Science & Technology, 29 (3). pp. 1875-1899. ISSN 0128-7680
![[img]](http://ir.unimas.my/style/images/fileicons/text.png) |
PDF
aes1.pdf Download (214kB) |
Abstract
Automated Essay Scoring (AES) is a service or software that can predictively grade essay based on a pre-trained computational model. It has gained a lot of research interest in educational institutions as it expedites the process and reduces the effort of human raters in grading the essays as close to humans’ decisions. Despite the strong appeal, its implementation varies widely according to researchers’ preferences. This critical review examines various AES development milestones specifically on different methodologies and attributes used in deriving essay scores. To generalize existing AES systems according to their constructs, we attempted to fit all of them into three frameworks which are content similarity, machine learning and hybrid. In addition, we presented and compared various common evaluation metrics in measuring the efficiency of AES and proposed Quadratic Weighted Kappa (QWK) as standard evaluation metric since it corrects the agreement purely by chance when estimate the degree of agreement between two raters. In conclusion, the paper proposes hybrid framework standard as the potential upcoming AES framework as it capable to aggregate both style and content to predict essay grades Thus, the main objective of this study is to discuss various critical issues pertaining to the current development of AES which yielded our recommendations on the future AES development.
| Item Type: | Article |
|---|---|
| Additional Information: | Information, Communication and Creative Technology |
| Uncontrolled Keywords: | Attributes, automatic essay scoring, evaluation metrics, framework, human raters, recommendation, UNIMAS, University, Borneo, Malaysia, Sarawak, Kuching, Samarahan, IPTA, education, Universiti Malaysia Sarawak |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software |
| Divisions: | Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology Faculties, Institutes, Centres > Faculty of Computer Science and Information Technology Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology |
| Depositing User: | How |
| Date Deposited: | 06 Aug 2021 05:52 |
| Last Modified: | 12 Sep 2022 02:48 |
| URI: | http://ir.unimas.my/id/eprint/35758 |
Actions (For repository members only: login required)
 |
View Item |
