Development of a digital numeracy assessment instrument based on Articulate Storyline for pre-service elementary teachers
DOI:
https://doi.org/10.30762/f_m.v9i1.8206Keywords:
Assessment Instrument, Authentic Assessment, Articulate Storyline, Digital Numeracy Literacy, Teacher EducationAbstract
Digital numeracy literacy is an essential competence for prospective elementary school teachers because it supports contextual problem-solving, data interpretation, and mathematical reasoning in 21st-century learning. However, contextual and technology-based assessment instruments capable of authentically measuring these competencies remain limited in teacher education. This study aimed to develop an interactive digital numeracy assessment instrument using Articulate Storyline, which supports multimedia-based and contextual assessment activities for prospective teachers in Madrasah Ibtidaiyah Teacher Education (PGMI) and Primary School Teacher Education (PGSD) programs. This research adopted a 4D Research and Development framework that included the stages of defining, designing, developing, and disseminating the instrument. The instrument was developed through needs analysis, expert validation, pilot, and field testing involving prospective teachers from three universities. The instrument contained contextual numeracy tasks of varying difficulty, covering geometry, measurement, equations, functions, ratios, and data representation. It was based on three digital numeracy indicators: mathematical symbol use, information analysis, and interpretation for decision-making. Validity was assessed through expert judgment, practicality through lecturer and student questionnaires, and effectiveness through variations in competencies across indicators and institutions. The findings indicated that the developed instrument achieved high validity and practicality and effectively identified variations in digital numeracy competencies across educational contexts. These findings indicate that the instrument can function as both an evaluation and diagnostic tool to support contextual and technology-based numeracy learning in teacher education.
Downloads
References
Adriyani, Z., Faqih, M. I., Kharirroh, & Malik, M. S. (2023). Development of literacy and numeracy-based assessment instruments for Madrasah Ibtidaiyah teacher education students. Didaktika Tauhidi: Jurnal Pendidikan Guru Sekolah Dasar, 10(2), 213–222. https://doi.org/10.30997/dt.v10i2.7625
Aldon, G., & Panero, M. (2020). Can digital technology change the way mathematics skills are assessed? ZDM, 52(7), 1333–1348. https://doi.org/10.1007/s11858-020-01172-8
Bennett, R. E. (2015). The changing nature of educational assessment. Review of Research in Education, 39(1), 370–407. https://doi.org/10.3102/0091732X14554179
Butler, D., Giblin, F., & Kingston, M. (2022). Numeracy and digital learning: Use of digital technologies as tools for numeracy development: A review of the literature—Department of Education (Ireland).
Cahyani, L. N., Shodiq, L. J., & Agustin, D. R. (2022). Kemampuan literasi matematika siswa dalam memecahkan soal TIMSS konten aljabar ditinjau dari pengetahuan metakognitif. Journal Focus Action of Research Mathematic (Factor M), 5(1), 31–51. https://doi.org/10.30762/f_m.v5i1.646
Dalim, S. F., Aris, S. R. S., Hoon, T. S., Nadzri, F. A., Deni, S. M., Yahya, N., & Ellianawati. (2023). Framework for numeracy and digital skills attributes in higher education. Research in Social Sciences and Technology, 8(3), 16–35. https://doi.org/10.46303/ressat.2023.18
De León, L., Corbeil, R., & Corbeil, M. E. (2023). The development and validation of a teacher education digital literacy and digital pedagogy evaluation. Journal of Research on Technology in Education, 55(3), 477–489. https://doi.org/10.1080/15391523.2021.1974988
Faishol, A., Waris, & Adhim, F. (2025). Developing assessment instrument of literacy and numeracy in elementary school. Jurnal Penelitian Pendidikan IPA, 11(9), 431–439. https://doi.org/10.29303/jppipa.v11i9.11772
Gal, I. (2024). Adult education in mathematics and numeracy: A scoping review of recent research. ZDM - Mathematics Education, 56(2), 293–305. https://doi.org/10.1007/s11858-024-01549-z
Greef, M. D., Segers, M., Nijhuis, J., Lam, J. F., Groenestijn, M. V., Hoek, F. V., Deursen, A. J. A. M. V., Bohnenn, E., & Tubbing, M. (2015). The development and validation of testing materials for literacy, numeracy and digital skills in a Dutch context. International Review of Education, 61(5), 655–671. https://doi.org/10.1007/s11159-015-9519-4
Grosseck, G., Sava, S., Ion, G., & Malita, L. (Eds.). (2024). Digital assessment in higher education. Springer Nature Singapore. https://doi.org/10.1007/978-981-97-6136-4
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–86. https://doi.org/10.1007/BF02504676
Heil, J., & Ifenthaler, D. (2023). Online assessment in higher education: A systematic review. Online Learning, 27(1), 187–218. https://doi.org/10.24059/olj.v27i1.3398
Hoogland, K. (2023). The changing nature of basic skills in numeracy. Frontiers in Education, 8, Article 1293754. https://doi.org/10.3389/feduc.2023.1293754
Ifenthaler, D., & Yau, J. Y.-K. (2020). Utilising learning analytics to support study success in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1961–1990. https://doi.org/10.1007/s11423-020-09788-z
Kaya Capocci, S., O'Leary, M., & Costello, E. (2022). Towards a framework to support the implementation of digital formative assessment in higher education. Education Sciences, 12(11), Article 823. https://doi.org/10.3390/educsci12110823
Kim, J., Glassman, E. L., Monroy-Hernández, A., & Morris, M. R. (2015). RIMES. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 1535–1544. https://doi.org/10.1145/2702123.2702186
Maghfiroh, R., Lestari, A. S. B., & Nurmalitasari, D. (2025). Numeracy literacy abilities of students with introverted personality types. Journal Focus Action of Research Mathematic (Factor M), 8(1), 129–146. https://doi.org/10.30762/f_m.v8i1.3706
Melissa, M. M., Laila, E. N., Ningrum, M. P., & Kusuma, O. R. (2024). Problem-based learning (PBL) model to improve numeracy skills and self-confidence of middle school students. Journal Focus Action of Research Mathematic (Factor M), 7(2), 190–205. https://doi.org/10.30762/f_m.v7i2.2622
Ndibalema, P. (2021). Online assessment in the era of digital natives in higher education institutions. International Journal of Technology in Education, 4(3), 443–463. https://doi.org/10.46328/ijte.89
Nguyen, L. A. T., & Habók, A. (2024). Tools for assessing teacher digital literacy: A review. Journal of Computers in Education, 11(1), 305–346. https://doi.org/10.1007/s40692-022-00257-5
Ngware, M. W., Hungi, N., & Mutisya, M. (2019). Assessing learning: How can classroom-based teachers assess students' competencies in numeracy? Assessment in Education: Principles, Policy & Practice, 26(2), 222–244. https://doi.org/10.1080/0969594X.2018.1503156
OECD. (2023). PISA 2022 results: Volume I and II – Indonesia country note. https://www.oecd.org/en/publications/pisa-2022-results-volume-i-and-ii-country-notes_ed6fbcc5-en/indonesia_c2e1ae0e-en.html
Putriani, D., Putra, R. D. A., Anjani, K., & Sari, Y. M. (2025). Cognitive assessment development: Item analysis with classical and modern theories. Journal Focus Action of Research Mathematic (Factor M), 8(1), 1–16. https://doi.org/10.30762/f_m.v8i1.2668
Qamariah, N., Hidayati, K., Retnawati, H., Tuanaya, R., Rifqiyah, F., & Begimbetova, G. (2025). Bridging the gap across global research on numeracy assessment in the digital era: Toward the development of diagnostic assessment. EPJ Web of Conferences, 344, Article 01005. https://doi.org/10.1051/epjconf/202534401005
Redecker, C., & Johannessen, Ø. (2013). Changing assessment towards a new assessment paradigm using ICT. European Journal of Education, 48(1), 79–96. https://doi.org/10.1111/ejed.12018
Sakurai, J., & Goos, M. (2023). Revisiting tools in numeracy learning: The role of authentic digital tools. Frontiers in Education, 8, Article 1291407. https://doi.org/10.3389/feduc.2023.1291407
Seifert, H., & Lindmeier, A. (2024). Developing a performance-based assessment to measure pre-service secondary teachers' digital competence to use digital mathematics tools. Journal für Mathematik-Didaktik, 45(2). https://doi.org/10.1007/s13138-024-00251-7
Sillat, L. H., Tammets, K., & Laanpere, M. (2021). Digital competence assessment methods in higher education: A systematic literature review. Education Sciences, 11(8), Article 402. https://doi.org/10.3390/educsci11080402
Sopandi, H., Supratman, & Dewi, S. V. (2024). The concept structure of student in mathematical literacy. Journal Focus Action of Research Mathematic (Factor M), 7(2), 291–303. https://doi.org/10.30762/f_m.v7i2.3757
Sugiyono. (2012). Metode penelitian pendidikan. Alfabeta.
Sugiyono. (2021). Metode penelitian pendidikan (kuantitatif, kualitatif, kombinasi, R&D, dan penelitian pendidikan) (Alfabeta, Ed.). Alfabeta.
Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children. Indiana University.
Westwood, P. S. (2021). Teaching for numeracy across the age range: An introduction. Springer.
Xiao, F., Barnard-Brak, L., Lan, W., & Burley, H. (2019). Examining problem-solving skills in technology-rich environments as related to numeracy and literacy. International Journal of Lifelong Education, 38(3), 327–338. https://doi.org/10.1080/02601370.2019.1598507
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Febry Rizki Susanti Kalaka, Dewi Darmiyani Napu, Indra A Otuhu
This work is licensed under a Creative Commons Attribution 4.0 International License.
