Transformer 언어 모델을 활용한 초중등 학습자 작문 연령 예측 모델 구현
Implementation of Age Prediction Model for Elementary and Secondary Learners' Writings Using Transformer Language Model

초록

This study implemented a prediction model that can predict the age group of elementary and secondary learners’ writings using the Transformer language model, especially KoBERT, KcBERT, and KoBART. By conducting fine-tuning for the "National Language Institute's non-published corpus (version 1.1)" among the "everyone corpus" based on the KoBERT, KcBERT, and KoBART which are pre-trained for large-scale corpus, an age prediction model was embodied. As a result, the prediction model was found to have an accuracy of about 61.1% to 68.1%, and among them, the prediction model based on KoBART showed the best performance. In particular, when fine-tuning was conducted in consideration of the genre of writings, the accuracy was up to 70% or more, confirming the possibility of elaborating the age prediction model for elementary and secondary learners’ writings. In addition, this paper extracted learners’ writings that are judged to be typical for each age group by using the age prediction model. Through this, it is possible to analyze the development aspect of learners’ writings, and furthermore, it is expected to lay the foundation for searching for clues to evaluations for learners’ writings or teaching & learning content of writing based on typical and representative learners’ writings.

키워드

Deep-learningTransformer Language ModelBERTBARTLearners’ WritingsWriting Development딥러닝Transformer 언어 모델BERTBART학습자 작문작문 발달
제목
Transformer 언어 모델을 활용한 초중등 학습자 작문 연령 예측 모델 구현
제목 (타언어)
Implementation of Age Prediction Model for Elementary and Secondary Learners' Writings Using Transformer Language Model
저자
나상수강지영이상재오지은
DOI
10.26589/jockle..90.202211.51
발행일
2022-11
저널명
청람어문교육
90
페이지
51 ~ 96