The Chatbot Effect in Supporting Blended Learning on Students' Academic Achievement
DOI:
https://doi.org/10.30762/sittah.v6i2.6804Keywords:
Blended Learning, Chatbot Application, Learning OutcomesAbstract
This study is motivated by the use of technology in education that is increasingly developing, and with chatbot applications, is one of the technologies that can be utilized to improve classroom learning quality. The research method used is quantitative. The type of research is quasi-experimental with a pretest-posttest control group design. The total population and sample consist of 63 students divided into two classes, 5A and 5B. Data collection techniques using test and non-test. The data collection instruments are question sheets, observation sheets, and documentation guidelines. The analysis technique used is descriptive analysis and hypothesis testing. Based on the data analysis obtained, 1) The Control class pretest learning outcomes are 47.74. while the posttest is 71.61. 2) The experimental class pretest learning outcomes are 53.44, and the posttest is 86.88. 3) The blended learning method assisted by the NAFA chatbot application has a significant effect. 4) The blended learning method assisted by the NAFA chatbot application has an effect size test of 4.2335. So, it can be concluded that the blended learning method assisted by the NAFA chatbot application greatly influences learning outcomes. These findings imply that chatbot-assisted blended learning holds strong potential for fostering interactive and student-centered classrooms in elementary education. Future studies are recommended to expand the scope across subjects, student populations, and school settings, and to explore their long-term impact on learners’ motivation, engagement, and critical thinking.
Downloads
References
Afriani, F., Suyato, S., Devi, I., Syafitri, A., Harahap, N. I. Y., & Simbolon, A. M. Y. (2024). Case study: Impact analysis of educational Chatbot use in supporting students in the online learning process. Jurnal Inovasi Teknologi Pendidikan, 11(4), 439–453. https://doi.org/10.21831/jitp.v11i4.69941
Akbar, R. & Mukminan. (2019). Biology E-Magazine Development in Human Respiratory System Topic for Grade VIII of Junior High School. Journal of Physics: Conference Series, 1233(1), 012010. https://doi.org/10.1088/1742-6596/1233/1/012010
Andrade, C. (2021). The Limitations of Quasi-Experimental Studies, and Methods for Data Analysis When a Quasi-Experimental Research Design Is Unavoidable. Indian Journal of Psychological Medicine, 43(5), 451–452. https://doi.org/10.1177/02537176211034707
Baskara, F. R. (2023). Chatbots and Flipped Learning: Enhancing Student Engagement and Learning Outcomes through Personalised Support and Collaboration. IJORER: International Journal of Recent Educational Research, 4(2), 223–238. https://doi.org/10.46245/ijorer.v4i2.331
Bulus, M. (2021). Sample Size Determination and Optimal Design of Randomized/Non-equivalent Pretest-posttest Control-group Designs. Adıyaman University Journal of Educational Sciences, 11(1), 48–69. https://doi.org/10.17984/adyuebd.941434
Cahyani, W. E. P., Sb, N. S., & Purwati, P. D. (2024). Telegram Chatbot-Based Interactive Media in Fourth Grade Elementary School Indonesian Language Subjects. Journal of Education Research and Evaluation, 8(2), 350–361. https://doi.org/10.23887/jere.v8i2.77063
Chen, Y., Jensen, S., Albert, L. J., Gupta, S., & Lee, T. (2023). Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success. Information Systems Frontiers, 25(1), 161–182. https://doi.org/10.1007/s10796-022-10291-4
Deveci Topal, A., Dilek Eren, C., & Kolburan Geçer, A. (2021). Chatbot application in a 5th grade science course. Education and Information Technologies, 26(5), 6241–6265. https://doi.org/10.1007/s10639-021-10627-8
Du, J., & Daniel, B. K. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers and Education: Artificial Intelligence, 6, 100230. https://doi.org/10.1016/j.caeai.2024.100230
Em, S. (2024). Exploring Experimental Research: Methodologies, Designs, and Applications Across Disciplines (SSRN Scholarly Paper No. 4801767). Social Science Research Network. https://doi.org/10.2139/ssrn.4801767
Fitri, H., Hermansyah, & Setyaningrum, V. (2025). The Effect of Blended Learning Method Assisted by Chatbot DARA Application on Fifth Grade Students’ Learning Outcomes. Ibriez Jurnal Kependidikan Dasar Islam Berbasis Sains, 10(1), 45–54. https://doi.org/10.21154/rgyz2n80
Grab, M. Ö. (2025). Integrated AI chatbot practice: A pathway to improved ESL speaking skills. Social Sciences & Humanities Open, 12, 101933. https://doi.org/10.1016/j.ssaho.2025.101933
Hasnunidah, N., Rosidin, U., & Kadaritna, N. (2024). Improving Students’ Understanding of Science Concepts: Is there a Relationship Between Learning Models and Academic Ability? Jurnal Pendidikan MIPA, 25(3), 1224–1243.
Huang, W., Jiang, J., King, R. B., & Fryer, L. K. (2025). Chatbots and student motivation: A scoping review. International Journal of Educational Technology in Higher Education, 22(1), 26. https://doi.org/10.1186/s41239-025-00524-2
Indriani, C., Hidayat, S., & Astriani, M. (2025). Improving learning outcomes through discovery learning on the human respiratory system material. Journal of Education and Learning (EduLearn), 19(3), 1307–1316. https://doi.org/10.11591/edulearn.v19i3.20987
Jeon, J. (2024). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 37(1–2), 1–26. https://doi.org/10.1080/09588221.2021.2021241
Kang, K.-A., Kim, S.-J., Oh, B., & Kim, Y.-H. (2024). Development of a chatbot for school violence prevention among elementary school students in South Korea: A methodological study. Child Health Nursing Research, 30(1), 45–53. https://doi.org/10.4094/chnr.2023.054
Kassa, M. M., Azene, M. K., Mengstie, S. M., & Ferede, M. W. (2024). Effect of using multimedia and dynamic classroom integrated instruction on grade 11 students’ biology academic achievement. Heliyon, 10(18). https://doi.org/10.1016/j.heliyon.2024.e37315
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018. https://doi.org/10.1007/s10639-022-11177-3
Kurni, M., Mohammed, M. S., & Srinivasa, K. G. (2023). Chatbots for Education. In M. Kurni, M. S. Mohammed, & S. K G (Eds.), A Beginner’s Guide to Introduce Artificial Intelligence in Teaching and Learning (pp. 173–198). Springer International Publishing. https://doi.org/10.1007/978-3-031-32653-0_10
Kusnadi, K., Lazuardi, Z., & Surakusumah, W. (2019). The Conceptual change of human respiratory system through POE-Based Learning. Journal of Physics: Conference Series, 1280(3), 032009. https://doi.org/10.1088/1742-6596/1280/3/032009
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: Systematic literature review. International Journal of Educational Technology in Higher Education, 20(1), 56. https://doi.org/10.1186/s41239-023-00426-1
Lee, J. E., & Maeng, U. (2023). Perceptions of High School Students on AI Chatbots Use in English Learning: Benefits, Concerns, and Ethical Consideration. Journal of Pan-Pacific Association of Applied Linguistics, 27(2), 53–72. https://doi.org/10.25256/PAAL.27.2.4
Mehri, A., Sadipour, E., & Dortaj, F. (2025). The impact of AI Chatbot-based blended learning on self-directed learning, academic engagement, and critical thinking disposition. Technology of Education Journal (TEJ). https://doi.org/10.22061/tej.2025.11481.3152
Merelo, J. J., Castillo, P. A., Mora, A. M., Barranco, F., Abbas, N., Guillén, A., & Tsivitanidou, O. (2024). Chatbots and messaging platforms in the classroom: An analysis from the teacher’s perspective. Education and Information Technologies, 29(2), 1903–1938. https://doi.org/10.1007/s10639-023-11703-x
Miller, C. J., Smith, S. N., & Pugatch, M. (2020). Experimental and quasi-experimental designs in implementation research. Psychiatry Research, 283, 112452. https://doi.org/10.1016/j.psychres.2019.06.027
Ningsih, L. R., Rusdi, R., & Miarsyah, M. (2019). Exploring respiratory system to improve biological learning motivation: Resysmart media application. Biosfer: Jurnal Pendidikan Biologi, 12(2), 211–222. https://doi.org/10.21009/biosferjpb.v12n2.211-222
Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033. https://doi.org/10.1016/j.caeai.2021.100033
Polakova, P., & Klimova, B. (2024). Implementation of AI-driven technology into education – a pilot study on the use of chatbots in foreign language learning. Cogent Education, 11(1), 2355385. https://doi.org/10.1080/2331186X.2024.2355385
Purnamasari, A. I., Prahani, B. K., & Suryanti. (2025). Analyzing the Critical Thinking Skills of 5th Grade Students on the Respiratory System Material Using a Qualitative Descriptive Method. Jurnal Komunikasi Pendidikan, 9(1), 1–12. https://doi.org/10.32585/jurnalkomdik.v9i1.6004
Rahayu, H. P., & Wulandari, D. (2024). Development of Augmented Reality Learning Media on IPAS Subject Matter of the Respiratory System. Jurnal Penelitian Pendidikan IPA, 10(10), 7562–7571. https://doi.org/10.29303/jppipa.v10i10.7740
Rini, D. S., Azrai, E. P., & Inayah, S. S. (2024). The effect of using ar sinaps learning supplements on high school students’ concept understanding of respiratory system topics. Biosfer: Jurnal Pendidikan Biologi, 17(2), 361–370. https://doi.org/10.21009/biosferjpb.37579
Rusmansyah, R., Leny, L., & Sofia, H. N. (2023). Improving Students’ Scientific Literacy and Cognitive Learning Outcomes through Ethnoscience-Based PjBL Model. Journal of Innovation in Educational and Cultural Research, 4(1), 1–9. https://doi.org/10.46843/jiecr.v4i1.382
Sáiz-Manzanares, M. C., Marticorena-Sánchez, R., Martín-Antón, L. J., Díez, I. G., & Almeida, L. (2023). Perceived satisfaction of university students with the use of chatbots as a tool for self-regulated learning. Heliyon, 9(1). https://doi.org/10.1016/j.heliyon.2023.e12843
Sekarani, F., & Abdullah, K. (2025). Effect of Assemblr Edu on fifth graders’ learning outcomes in the respiratory system. Inovasi Kurikulum, 22(3), 1635–1646. https://doi.org/10.64014/jik.v22i3.91
Silva, M., & Almeida, A. (2017). Primary School Pupils’ Misconceptions of the Human Respiratory System in Primary School Students: From Identification to Deconstruction. ICERI2017 Proceedings, 1205–1210. 10th annual International Conference of Education, Research and Innovation. https://doi.org/10.21125/iceri.2017.0399
Simatupang, E. C., Silitonga, M., & Rajagukguk, S. H. (2023). Students’ critical thinking skills on human respiratory system material in flipped classroom. JPBI (Jurnal Pendidikan Biologi Indonesia), 9(3), 387–393. https://doi.org/10.22219/jpbi.v9i3.26841
Singh, J., Evans, E., Reed, A., Karch, L., Qualey, K., Singh, L., & Wiersma, H. (2022). Online, Hybrid, and Face-to-Face Learning Through the Eyes of Faculty, Students, Administrators, and Instructional Designers: Lessons Learned and Directions for the Post-Vaccine and Post-Pandemic/COVID-19 World. Journal of Educational Technology Systems, 50(3), 301–326. https://doi.org/10.1177/00472395211063754
Singh, J., Steele, K., & Singh, L. (2021). Combining the Best of Online and Face-to-Face Learning: Hybrid and Blended Learning Approach for COVID-19, Post Vaccine, & Post-Pandemic World. Journal of Educational Technology Systems, 50(2), 140–171. https://doi.org/10.1177/00472395211047865
Straková, N., & Válek, J. (2024). Chatbots as a Learning Tool: Artificial intelligence in education. R&E-SOURCE, 245–265. https://doi.org/10.53349/resource.2024.is1.a1259
Su, F., & Zou, D. (2022). Technology-enhanced collaborative language learning: Theoretical foundations, technologies, and implications. Computer Assisted Language Learning, 35(8), 1754–1788. https://doi.org/10.1080/09588221.2020.1831545
Utamy, V. G., & Rosdiana, L. (2023). Analysis of Students’ Misconception Profil on Human Respiratory System Material Using Four-Tier Diagnostic Test. INSECTA: Integrative Science Education and Teaching Activity Journal, 4(2), 124–137. https://doi.org/10.21154/insecta.v4i2.6929
Wang, Y. (2025). A Study on the Efficacy of ChatGPT-4 in Enhancing Students’ English Communication Skills. Sage Open, 15(1), 21582440241310644. https://doi.org/10.1177/21582440241310644
Wei, W., Zhao, A., & Ma, H. (2025). Understanding How AI Chatbots Influence EFL Learners’ Oral English Learning Motivation and Outcomes: Evidence From Chinese Learners. IEEE Access, 13, 56699–56716. https://doi.org/10.1109/ACCESS.2025.3554545
Wiboolyasarin, W., Wiboolyasarin, K., Tiranant, P., Jinowat, N., & Boonyakitanont, P. (2025). AI-driven chatbots in second language education: A systematic review of their efficacy and pedagogical implications. Ampersand, 14, 100224. https://doi.org/10.1016/j.amper.2025.100224
Xia, Q., Li, W., Yang, Y., Weng, X., & Chiu, T. K. F. (2025). A systematic review and meta-analysis of the effectiveness of Generative Artificial Intelligence (GenAI) on students’ motivation and engagement. Computers and Education: Artificial Intelligence, 9, 100455. https://doi.org/10.1016/j.caeai.2025.100455
Zagouras, C., Egarchou, D., Skiniotis, P., & Fountana, M. (2022). Face to face or blended learning? A case study: Teacher training in the pedagogical use of ICT. Education and Information Technologies, 27(9), 12939–12967. https://doi.org/10.1007/s10639-022-11144-y
Zulia, R., & Alimah, S. (2023). The replica of human respiration system to improve student’s interpretation skill. Biosfer: Jurnal Pendidikan Biologi, 16(2), 232–243. https://doi.org/10.21009/biosferjpb.26742
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Pika Yulianti, Hermansyah Hermansyah, Vidya Setyaningrum
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
