ANALYSIS OF NEEDS FOR A DIGITAL AUTOMATED SHORT ESSAY SCORING (ASES) BASED ASSESSMENT MODEL IN ENGLISH LEARNING IN VOCATIONAL SECONDARY SCHOOLS

Evi Susilawati, Imamul Khaira, Isnaini Halimah Rambe, Metrilitna Br Sembiring, Wildawani Siregar, Dhia Octariani

Abstract


The aim of this research is to look at the needs analysis of the digital-based assessment model Automated Short Essay Scoring (ASES) in English language learning in Vocational High Schools. This research is a research and development (R&D) research carried out in the Computer Network Technology Department at SMK Negeri 1 Percut Sei Tuan. This research is included in mixed methods research with the assessment development model used, namely the Borg and Gall model which consists of ten stages,: needs analysis, development plan, initial product development, initial test or one-on-one test, initial product revision, field test, product revision, field implementation test (operational test), revising the final product, and implementation in the field. This research focuses on the first step of all the steps in developing the Borg and Gall model above, namely needs analysis activities. The results of this research show that the implementation of digital assessment models needs to be carried out in English language learning. The use of ASES digital-based assessment media is an urgent need for assessment to be implemented to take into account the knowledge, skills, dispositions and attitudes needed to equip students to keep up with the increasingly changing digital world. Furthermore, identification of the development of the ASES digital-based assessment model in English language learning at Vocational High Schools was carried out by conducting FGDs with teachers and students of SMK Negeri 1 Percut Sei Tuan resulting in an agreement that in learning English students need to be equipped with digital skills.


Keywords


ASES; assessment model; English language learning

Full Text:

PDF

References


Bulut, O., Cutumisu, M., Aquilina, A. M., & Singh, D. (2019) Effects of digital score reporting and feedback on students' learning in higher education. Frontiers in Education, 4, 1-16. Doi:10.3389/feduc.2019.00065.

Canggung D. H., Niman, E. M., Fatwamati, F., & Nendi, F. (2022). Implementasi penilaian otentik oleh guru bahasa inggris di flores. Jurnal Pendidikan Dan Kebudayaan, 7(1), 65 - 77. Doi: https://doi.org/10.24832/jpnk.v7i1.2639

Dikli. S. (2006). Automated essay scoring. Turkey Online J. Distance Educ.7(1), 49–62. Cited from https://dergipark.org.tr/en/pub/tojde/issue/16923/176620

Gall. M. D., Gall. J. P., & Borg. W. R. (2003). Educational Research: An Introduction (7th ed. ). Boston: Pearson Education, Inc.

Gilakjani, A. P., Sabouri, N. B., & Zabihniaemran, A. (2015). What are the barriers in the use of computer technology in efl instruction?. Review of European Studies, 7(11), 213–221. https://doi.org/10.5539/res.v7n11p213

Hizer, S. E., Schultz, P. W., & Bray, R. (2017). Supplemental instruction online: as effective as the traditional face-to-face model?. Journal of Science Education and Technology,26(1), 100-115. Doi: https://doi.org/10.1007/s10956-016-9655-z

Indriani, R. & Wirza, Y. (2020). Praktik guru dalam pemanfaatan teknologi di kelas bahasa inggris. Jurnal Penelitian Pendidikan, 20(1), 98-110. Doi: DOI: https://doi.org/10.17509/jpp.v20i1.24560

Ke, Z. dan Ng, V. (2019) Automated essay scoring: A survey of the state of the art. IJCAI International Joint Conference on Artificial Intellegence, 2019, 6300–6308. Doi: 10.24963/ijcai.2019/879.

Lim, C. T., Bong, C. H., Wong, W. S., & Lee, N. K. (2021). A comprehensive review of automated essay scoring (aes) research and development. Pertanika Journal of Science & Technology, 29(3), 1875-1899. Doi: https://doi.org/10.47836/pjst.29.3.27.

Machicao, J. C. (2019). Higher Education Challenge Characterization To Implement Automated Essay Scoring Model For Universities With A Current Traditional Learning Evaluation System. Information Technology And Systems: Proceedings Of ICITS 2019, 835-844. Cited from https://link.springer.com/chapter/10.1007/978-3-030-11890-7_78.

Nasution, A., Siddik, M., & Manurung, N. (2021). Efektivitas mobile learning dalam pembelajaran bahasa inggris pada sekolah menengah kejuruan. Journal of Science and Social Research, 4(1), 1-5. doi: https://doi.org/10.54314/jssr.v4i1.470

Player-Koro, C. (2012). Factors influencing teachers’ use of ict in education. Education Inquiry, 3(1), 93–108. Doi: https://doi.org/10.3402/edui.v3i1.22015

Pribadi, F. S., Utomo, A. B., & Mulwinda, A. (2018). Automated Short Essay Scoring System Using Normalized Simpson Methods. AIP Conference Proceeding, 1941, 1-5. Doi: 10.1063/1.5028081.

Ramesh, D., & Sanampudi, S. K. (2022). An Automated essay scoring systems: a systematic literature review. Artificial Intelligence Review, 55(3), 2495-2527. Doi: https://doi.org/10.1007/S10462-021-10068-2

Susilawati, E., (2022). Inovasi Automated Short Essay Scoring Sebagai Model Penilaian Digital Di Era Metaverse. Digitalisasi Era Metatverse. Tulungagung: Akademia Pustaka.

Susilawati, E., Lubis, H., Kesuma, S., Pratama, K., & Khaira, I. (2022). Exploring automated short essay scoring (ases) technology based assessment model: the role of operational management strategies to improve quality at universities. Operational Research In Engineering Sciences: Theory And Applications, 5(3), 244–261. Retrieved from https://oresta.org/menu-script/index.php/oresta/article/view/534

Susilawati. E., & Khaira, I., (2023). Implementasi model penilaian berbasis digital automated short essay scoring (ases) untuk meningkatkan hasil belajar mahasiswa. Journal of Edcuation Technology and Civil Literacy, 3(2), 43-48. Doi: https://doi.org/10.30743/jetcivil.v3i2.6975

Tshibalo, A. E. (2007). The potential impact of computer-aided assessment technology in higher education. South African Journal of Higher Education, 21(6), 686-695. Doi: 10.4314/sajhe.v21i6.25738

Wijayanti, R.W., Riyanto, Y., & Subroto, W.T. (2023). Pengembangan instrumen penilaian digital untuk mengukur hasil belajar ips kelas iv sekolah dasar. edukasia: Jurnal Pendidikan dan Pembelajaran, 4(1), 127-136. Retrieved from https://www.jurnaledukasia.org/index.php/edukasia/article/view/230




DOI: https://doi.org/10.30743/ll.v7i2.8248

Refbacks

  • There are currently no refbacks.


Fakultas Sastra 
Universitas Islam Sumatera Utara (UISU), Medan
Jl. Sisingamangaraja Teladan Medan 20217
Telp. (061) 7869911, e-mail: language_literacy@sastra.uisu.ac.id