Assessing The Feasibility of a Web-Based Interactive Writing Assessment (WISSE): An Evaluation of Media and Linguistic Aspects
DOI:
https://doi.org/10.30762/jeels.v10i1.1093Keywords:
academic writing, feasibility test, interactive learning, web-based media, online writing assessmentAbstract
This study aims to conduct a feasibility test on a Web-Based Interactive Writing Assessment (WISSE) that has been designed to assist students and teachers of Academic Writing classes by facilitating feedback provision online. WISSE was created to align with the requirements of the OBE curriculum. During this study, feedback about WISSE was gathered to enhance its feasibility and readiness. Trials focused on evaluating media aspects (usability, functionality, visual communication) and linguistic aspects (technical language, grammar, word choice). Quantitative and qualitative data were employed. The quantitative data were obtained through a material validation questionnaire and media validation using a rating scale on the quality of the media obtained from the objective assessment of media experts and linguists. The qualitative data were obtained from the feedback of media experts and linguists on the quality of the media provided in the comment column on the questionnaire. This data serves as a consideration in revising the product for the website’s view and feasibility. the results of the expert test indicate that the web-based interactive learning assessment product, WISSE, is feasible for use, although revisions based on feedback from media and language experts are necessary before piloting it to a wider audience.
Downloads
References
Adir, G., Adir, V., & Pascu, N. E. (2012). Logo design and the corporate identity. Procedia - Social and Behavioral Sciences, 51, 650–654. https://doi.org/10.1016/j.sbspro.2012.08.218
Arikunto, S. (2002). Metodologi penelitian suatu pendekatan proposal. Rineka Cipta.
Arikunto, S., & Jabar, C. S. A. (2009). Evaluasi program pendidikan. Bumi Aksara.
Ariyanti, A., & Fitriana, R. (2017). EFL students’ difficulties and needs in essay writing. Proceedings of the International Conference on Teacher Training and Education 2017 (ICTTE 2017). https://doi.org/10.2991/ictte-17.2017.4
Prior, M. T. (2019). Elephants in the room: An" affective turn," or just feeling our way?. The Modern Language Journal, 103 (2), 516-527. https://doi.org/10.1111/modl.12569
Bridgeman, B., Trapani, C., & Attali, Y. (2012). Comparison of human and machine scoring of essays: Differences by gender, ethnicity, and country. Applied Measurement in Education, 25 (1), 27–40. https://doi.org/10.1080/08957347.2012.635502
Brumberger, E. (2003). The rhetoric of typography: The persona of typeface and text. Technical Communication (Washington), 50 (2), 206–223.
Cavalcanti, A.P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y., Gasevic, D., Mello, R.F. (2021). Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence 2. https://doi.org/10.1016/j.caeai.2021.100027
Dyson, M. C., & Beier, S. (2016). Investigating typographic differentiation: Italics are more subtle than bold for emphasis. Information Design Journal, 22 (1), 3–18. https://doi.org/10.1075/idj.22.1.02dys
Ellis, R. (2009). Corrective feedback and teacher development. L2 Journal, 1 (1). doi:10.5070/l2.v1i1.905410.5070/L2.V1I1.9054 downloaded on 2020-02-21
Elviana, R., Inderawati, R., & Mirizon, S. (2020). Developing interactive multimedia for teaching descriptive texts-based on Palembang local culture. Indonesian EFL Journal, 6 (1), 19-26. doi: 10.25134/ieflj.v6i1.2634.
Fleiss, J. (1981). Statistical methods for rates and proportions (1st ed.). John WIley & Sons.
Gagne,R.M., Wager, W.W., Golas, K., Keller, J.M. (2005) Principles of instructional design (5th ed.), Thomson: Wadsworth.
Gillis, R. (2017). “Watch your language!”: Word choice in library website usability. Partnership: The Canadian Journal of Library and Information Practice and Research, 12(1). https://doi.org/10.21083/partnership.v12i1.3918
Graham, S. (2019). Changing how writing is taught. Review of Research in Education 43 (1): 277-303.
Griffiths, C.M., Murdock-Perriera, L., Eberhardt, J.L. (2023). “Can you tell me more about this?”: Agentic written feedback, teacher expectations, and student learning. Contemporary Educational Psychology 73. https://doi.org/10.1016/j.cedpsych.2022.102145
Grobelny, J., & Michalski, R. (2015). The role of background color, interletter spacing, and font size on preferences in the digital presentation of a product. Computers in Human Behavior, 43, 85–100. https://doi.org/10.1016/j.chb.2014.10.036
Hamamah, H., Hapsari, Y., Emaliana, I., & Degeng, P. D. D. (2020). Integrated academic writing assessment model to support the implementation of OBE curriculum. Jurnal Pendidikan: Teori, Penelitian, Dan Pengembangan, 5(7), 1040. https://doi.org/10.17977/jptpp.v5i7.13827
Hidayati, K. H. (2018). Teaching writing to EFL learners: an investigation of challenges confronted by Indonesian teachers. Langkawi: Journal of The Association for Arabic and English, 4(1), 21. https://doi.org/10.31332/lkw.v4i1.772
Huang, Y. & Wilson, J. (2021). Using automated feedback to develop writing proficiency. Computers and Composition 62. https://doi.org/10.1016/j.compcom.2021.102675
Juwariyah, S. (2015). Penilaian dalam pembelajaran menulis bahasa Indonesia. Magistra, 93, 73–84.
Katsanos, C., Tselios, N., & Avouris, N. (2010). A survey of tools supporting design and evaluation of websites based on models of human information interaction. International Journal on Artificial Intelligence Tools, 19(06), 755–781. https://doi.org/10.1142/S0218213010000418
Koppi, A. J., Lublin, J. R., & Chaloupka, M. J. (1997). Effective teaching and learning in a high‐tech environment. Innovations in Education & Training International, 34(4), 245–251. https://doi.org/10.1080/1355800970340402
Kuklick, L., Greiff, S., & Lindner, M. A. (2023). Computer-based performance feedback: Effects of error message complexity on cognitive, metacognitive, and motivational outcomes. Computers & Education, 200, 104785.
Kurnia, A. (2022). Efl Students’ Problems In Dealing With Teacher Written Feedback. Jurnal Pendidikan Indonesia, 3(05), 485–492. https://doi.org/10.59141/japendi.v3i05.1143
Liˇcen, S.; Cassar, M.; Filomeno, L.; Yeratziotis, A.; Prosen, M. (2023) Development and Validation of an Evaluation Toolkit to Appraise eLearning Courses in Higher Education: A Pilot Study. Sustainability 15, 6361. https:// doi.org/10.3390/su15086361.
Machado, J. C., de Carvalho, L. V., Torres, A., & Costa, P. (2015). Brand logo design: Examining consumer response to naturalness. Journal of Product & Brand Management, 24(1), 78–87. https://doi.org/10.1108/JPBM-05-2014-0609
Monaghan, W., & Bridgeman, B. (2005). E-rater as a quality control on human scores. R&D Connections, 2nd.
Mueller, M. L., Dunlosky, J., Tauber, S. K., & Rhodes, M. G. (2014). The font-size effect on judgments of learning: Does it exemplify fluency effects or reflect people’s beliefs about memory? Journal of Memory and Language, 70, 1–12. https://doi.org/10.1016/j.jml.2013.09.007
Ni’am, S., Wibawa, H.A., & Endah, S. N. (2014). Pengembangan aplikasi Learning Management System (LMS) pada Sekolah Menengah Pertama Islam Terpadu (SMP IT) Harapan Bunda Semarang, Journal of Informatics and Technology, vol. 2, no. 1, pp. 11-32, Sep. 2014. [Online]. Retrieved from: https://ejournal3.undip.ac.id/index.php/joint/article/view/6266/0
Ramineni, C., Trapani, C.S., Williamson, D.M. (2015). Evaluation of e-rater for the Praxis I Writing Test. doi:10.1002/ets2.12047
Sia, D. & Cheung, Y.L. (2017). Written corrective feedback in writing instruction: A qualitative synthesis of recent research. Issues in Language Studies 6(1): 61-80.
Sugiyono. (2008). Metode penelitian kuantitatif kualitatif dan R&D. Alfabeta.
Tahira, M., & Haider, G. (2019). The role of critical thinking in academic writing: An investigation of efl students’ perceptions and writing experiences. International Online Journal of Primary Education, 8(1), 1–30.
van Grinsven, B., & Das, E. (2016). Logo design in marketing communications: Brand logo complexity moderates exposure effects on brand recognition and brand attitude. Journal of Marketing Communications, 22(3), 256–270. https://doi.org/10.1080/13527266.2013.866593
Viera, Anthony,J., and Joanne M. Garrett. (2005). Understanding interobserver agreement of the kappa statistic. Fam Med 37.p: 360-363.
Wallace, T., Stariba, W. E., & Walberg, H. J. (2004). Teaching speaking, listening and writing. International Academy of Education, May, 13.
Wisniewski, B., Zierer, K., Hattie, J. (2020). The power of feedback revisited: a meta-analysis of educational feedback research. Frontiers in Psychology 10. https://doi.org/10.3389/fpsyg.2019.03087
Wulandari, Y. (2022). Effective feedback to improve students’ writing skills. English Education, Linguistics, and Literature Journal 1(1): 10-17
Yesilada, Y., Jay, C., Stevens, R., & Harper, S. (2008). Validating the use and role of visual elements of web pages in navigation with an eye-tracking study. Proceedings of the 17th International Conference on World Wide Web - WWW ’08, 11. https://doi.org/10.1145/1367497.1367500
Yulando, S., Sutopo, S., & Franklin Chi, T. (2019). Electronic module design and development: an interactive learning. American Journal of Educational Research, 7(10), 694–698. https://doi.org/10.12691/education-7-10-4
Yustiana, D. (2015). Penilaian otomatis terhadap jawaban esai pada soal berbahasa Indonesia menggunakan latent semantic analysis. Seminar Nasional “Inovasi Dalam Desain Dan Teknologi” - IDeaTech 2015, 123–130.
Zhang, S. (2021). Review of automated writing evaluation systems. Journal of China Computer-Assisted Language Learning, 1(1), 170-176. https://doi.org/10.1515/jccall-2021-2007
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 JEELS (Journal of English Education and Linguistics Studies)
This work is licensed under a Creative Commons Attribution 4.0 International License.
