Assessing The Feasibility of a Web-Based Interactive Writing Assessment (WISSE): An Evaluation of Media and Linguistic Aspects

Authors

  • Hamamah Department of Language and Literature, Universitas Brawijaya, Indonesia
  • Rafidah Sahar Kuliyyah of Language Management, International Islamic University Malaysia, Malaysia
  • Ive Emaliana Department of Language Education, Universitas Brawijaya, Indonesia
  • Yulia Hapsari Department of English Language Education, Universitas Brawijaya, Indonesia
  • Putu Dian Danayanti Degeng Department of Language Education, Universitas Brawijaya, Indonesia

DOI:

https://doi.org/10.30762/jeels.v10i1.1093

Keywords:

academic writing, feasibility test, interactive learning, web-based media, online writing assessment

Abstract

This study aims to conduct a feasibility test on a Web-Based Interactive Writing Assessment (WISSE) that has been designed to assist students and teachers of Academic Writing classes by facilitating feedback provision online. WISSE was created to align with the requirements of the OBE curriculum. During this study, feedback about WISSE was gathered to enhance its feasibility and readiness. Trials focused on evaluating media aspects (usability, functionality, visual communication) and linguistic aspects (technical language, grammar, word choice). Quantitative and qualitative data were employed. The quantitative data were obtained through a material validation questionnaire and media validation using a rating scale on the quality of the media obtained from the objective assessment of media experts and linguists. The qualitative data were obtained from the feedback of media experts and linguists on the quality of the media provided in the comment column on the questionnaire. This data serves as a consideration in revising the product for the website’s view and feasibility. the results of the expert test indicate that the web-based interactive learning assessment product, WISSE, is feasible for use, although revisions based on feedback from media and language experts are necessary before piloting it to a wider audience.

References

Adir, G., Adir, V., & Pascu, N. E. (2012). Logo design and the corporate identity. Procedia - Social and Behavioral Sciences, 51, 650–654. https://doi.org/10.1016/j.sbspro.2012.08.218

Arikunto, S. (2002). Metodologi penelitian suatu pendekatan proposal. Rineka Cipta.

Arikunto, S., & Jabar, C. S. A. (2009). Evaluasi program pendidikan. Bumi Aksara.

Ariyanti, A., & Fitriana, R. (2017). EFL students’ difficulties and needs in essay writing. Proceedings of the International Conference on Teacher Training and Education 2017 (ICTTE 2017). https://doi.org/10.2991/ictte-17.2017.4

Prior, M. T. (2019). Elephants in the room: An" affective turn," or just feeling our way?. The Modern Language Journal, 103 (2), 516-527. https://doi.org/10.1111/modl.12569

Bridgeman, B., Trapani, C., & Attali, Y. (2012). Comparison of human and machine scoring of essays: Differences by gender, ethnicity, and country. Applied Measurement in Education, 25 (1), 27–40. https://doi.org/10.1080/08957347.2012.635502

Brumberger, E. (2003). The rhetoric of typography: The persona of typeface and text. Technical Communication (Washington), 50 (2), 206–223.

Cavalcanti, A.P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y., Gasevic, D., Mello, R.F. (2021). Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence 2. https://doi.org/10.1016/j.caeai.2021.100027

Dyson, M. C., & Beier, S. (2016). Investigating typographic differentiation: Italics are more subtle than bold for emphasis. Information Design Journal, 22 (1), 3–18. https://doi.org/10.1075/idj.22.1.02dys

Ellis, R. (2009). Corrective feedback and teacher development. L2 Journal, 1 (1). doi:10.5070/l2.v1i1.905410.5070/L2.V1I1.9054 downloaded on 2020-02-21

Elviana, R., Inderawati, R., & Mirizon, S. (2020). Developing interactive multimedia for teaching descriptive texts-based on Palembang local culture. Indonesian EFL Journal, 6 (1), 19-26. doi: 10.25134/ieflj.v6i1.2634.

Fleiss, J. (1981). Statistical methods for rates and proportions (1st ed.). John WIley & Sons.

Gagne,R.M., Wager, W.W., Golas, K., Keller, J.M. (2005) Principles of instructional design (5th ed.), Thomson: Wadsworth.

Gillis, R. (2017). “Watch your language!”: Word choice in library website usability. Partnership: The Canadian Journal of Library and Information Practice and Research, 12(1). https://doi.org/10.21083/partnership.v12i1.3918

Graham, S. (2019). Changing how writing is taught. Review of Research in Education 43 (1): 277-303.

Griffiths, C.M., Murdock-Perriera, L., Eberhardt, J.L. (2023). “Can you tell me more about this?”: Agentic written feedback, teacher expectations, and student learning. Contemporary Educational Psychology 73. https://doi.org/10.1016/j.cedpsych.2022.102145

Grobelny, J., & Michalski, R. (2015). The role of background color, interletter spacing, and font size on preferences in the digital presentation of a product. Computers in Human Behavior, 43, 85–100. https://doi.org/10.1016/j.chb.2014.10.036

Hamamah, H., Hapsari, Y., Emaliana, I., & Degeng, P. D. D. (2020). Integrated academic writing assessment model to support the implementation of OBE curriculum. Jurnal Pendidikan: Teori, Penelitian, Dan Pengembangan, 5(7), 1040. https://doi.org/10.17977/jptpp.v5i7.13827

Hidayati, K. H. (2018). Teaching writing to EFL learners: an investigation of challenges confronted by Indonesian teachers. Langkawi: Journal of The Association for Arabic and English, 4(1), 21. https://doi.org/10.31332/lkw.v4i1.772

Huang, Y. & Wilson, J. (2021). Using automated feedback to develop writing proficiency. Computers and Composition 62. https://doi.org/10.1016/j.compcom.2021.102675

Juwariyah, S. (2015). Penilaian dalam pembelajaran menulis bahasa Indonesia. Magistra, 93, 73–84.

Katsanos, C., Tselios, N., & Avouris, N. (2010). A survey of tools supporting design and evaluation of websites based on models of human information interaction. International Journal on Artificial Intelligence Tools, 19(06), 755–781. https://doi.org/10.1142/S0218213010000418

Koppi, A. J., Lublin, J. R., & Chaloupka, M. J. (1997). Effective teaching and learning in a high‐tech environment. Innovations in Education & Training International, 34(4), 245–251. https://doi.org/10.1080/1355800970340402

Kuklick, L., Greiff, S., & Lindner, M. A. (2023). Computer-based performance feedback: Effects of error message complexity on cognitive, metacognitive, and motivational outcomes. Computers & Education, 200, 104785.

Kurnia, A. (2022). Efl Students’ Problems In Dealing With Teacher Written Feedback. Jurnal Pendidikan Indonesia, 3(05), 485–492. https://doi.org/10.59141/japendi.v3i05.1143

Liˇcen, S.; Cassar, M.; Filomeno, L.; Yeratziotis, A.; Prosen, M. (2023) Development and Validation of an Evaluation Toolkit to Appraise eLearning Courses in Higher Education: A Pilot Study. Sustainability 15, 6361. https:// doi.org/10.3390/su15086361.

Machado, J. C., de Carvalho, L. V., Torres, A., & Costa, P. (2015). Brand logo design: Examining consumer response to naturalness. Journal of Product & Brand Management, 24(1), 78–87. https://doi.org/10.1108/JPBM-05-2014-0609

Monaghan, W., & Bridgeman, B. (2005). E-rater as a quality control on human scores. R&D Connections, 2nd.

Mueller, M. L., Dunlosky, J., Tauber, S. K., & Rhodes, M. G. (2014). The font-size effect on judgments of learning: Does it exemplify fluency effects or reflect people’s beliefs about memory? Journal of Memory and Language, 70, 1–12. https://doi.org/10.1016/j.jml.2013.09.007

Ni’am, S., Wibawa, H.A., & Endah, S. N. (2014). Pengembangan aplikasi Learning Management System (LMS) pada Sekolah Menengah Pertama Islam Terpadu (SMP IT) Harapan Bunda Semarang, Journal of Informatics and Technology, vol. 2, no. 1, pp. 11-32, Sep. 2014. [Online]. Retrieved from: https://ejournal3.undip.ac.id/index.php/joint/article/view/6266/0

Ramineni, C., Trapani, C.S., Williamson, D.M. (2015). Evaluation of e-rater for the Praxis I Writing Test. doi:10.1002/ets2.12047

Sia, D. & Cheung, Y.L. (2017). Written corrective feedback in writing instruction: A qualitative synthesis of recent research. Issues in Language Studies 6(1): 61-80.

Sugiyono. (2008). Metode penelitian kuantitatif kualitatif dan R&D. Alfabeta.

Tahira, M., & Haider, G. (2019). The role of critical thinking in academic writing: An investigation of efl students’ perceptions and writing experiences. International Online Journal of Primary Education, 8(1), 1–30.

van Grinsven, B., & Das, E. (2016). Logo design in marketing communications: Brand logo complexity moderates exposure effects on brand recognition and brand attitude. Journal of Marketing Communications, 22(3), 256–270. https://doi.org/10.1080/13527266.2013.866593

Viera, Anthony,J., and Joanne M. Garrett. (2005). Understanding interobserver agreement of the kappa statistic. Fam Med 37.p: 360-363.

Wallace, T., Stariba, W. E., & Walberg, H. J. (2004). Teaching speaking, listening and writing. International Academy of Education, May, 13.

Wisniewski, B., Zierer, K., Hattie, J. (2020). The power of feedback revisited: a meta-analysis of educational feedback research. Frontiers in Psychology 10. https://doi.org/10.3389/fpsyg.2019.03087

Wulandari, Y. (2022). Effective feedback to improve students’ writing skills. English Education, Linguistics, and Literature Journal 1(1): 10-17

Yesilada, Y., Jay, C., Stevens, R., & Harper, S. (2008). Validating the use and role of visual elements of web pages in navigation with an eye-tracking study. Proceedings of the 17th International Conference on World Wide Web - WWW ’08, 11. https://doi.org/10.1145/1367497.1367500

Yulando, S., Sutopo, S., & Franklin Chi, T. (2019). Electronic module design and development: an interactive learning. American Journal of Educational Research, 7(10), 694–698. https://doi.org/10.12691/education-7-10-4

Yustiana, D. (2015). Penilaian otomatis terhadap jawaban esai pada soal berbahasa Indonesia menggunakan latent semantic analysis. Seminar Nasional “Inovasi Dalam Desain Dan Teknologi” - IDeaTech 2015, 123–130.

Zhang, S. (2021). Review of automated writing evaluation systems. Journal of China Computer-Assisted Language Learning, 1(1), 170-176. https://doi.org/10.1515/jccall-2021-2007

Downloads

Published

2023-05-29

How to Cite

Hamamah, Sahar, R., Emaliana, I., Hapsari, Y. ., & Degeng, P. D. D. . (2023). Assessing The Feasibility of a Web-Based Interactive Writing Assessment (WISSE): An Evaluation of Media and Linguistic Aspects. JEELS (Journal of English Education and Linguistics Studies), 10(1), 177–197. https://doi.org/10.30762/jeels.v10i1.1093

Issue

Vol. 10 No. 1 (2023): JEELS May 2023

Section

Articles

License

Copyright (c) 2023 JEELS (Journal of English Education and Linguistics Studies)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.