Overcoming Challenges of Peer Assessment Implementation in Online Collaborative Learning in Higher Institutions of Learning

Job Kalema; Jane  Katusiime; Simon  Kawuma; Deborah  Natumanya

doi:10.47540/ijias.v5i2.1792

Authors

Job Kalema Department of Computer Science, Mbarara University of Science and Technology, Uganda
Jane Katusiime Department of Computer Science, Mbarara University of Science and Technology, Uganda
Simon Kawuma Department of Computer Science, Mbarara University of Science and Technology, Uganda
Deborah Natumanya Department of Computer Science, Mbarara University of Science and Technology, Uganda

DOI:

https://doi.org/10.47540/ijias.v5i2.1792

Keywords:

Group Dynamics, Implementation Challenges, Online Collaborative Learning, Peer Assessment, Student Engagement

Abstract

Online collaborative learning has become an essential component of higher education, offering students opportunities to engage in peer-based learning activities. Peer assessment, as a tool for enhancing collaborative learning, has demonstrated significant potential but also presents several implementation challenges. The primary objectives of this paper are to identify and analyze the key challenges encountered in the implementation of peer assessment within online collaborative learning environments. This study employed a mixed-methods approach, combining qualitative and quantitative research methods to explore the challenges faced in implementing peer assessment in online collaborative learning environments. Approximately 35% of students in our study reported difficulties related to the peer assessment platforms, including usability issues and limited integration with other learning management systems.35% of students in our study found the assessment rubrics unclear or insufficiently detailed. The challenges identified in this study, particularly those concerning technological limitations, lack of training, and issues with fairness and trust, have significant implications for the implementation of peer assessment in online collaborative learning. Based on the results and expert review, it is clear that overcoming these challenges requires a multifaceted approach. Technological, pedagogical, and social challenges all play a role in hindering the effectiveness of peer assessment, but these challenges can be addressed through targeted strategies.

References

Adesina, O. O., Adesina, O. A., Adelopo, I., & Afrifa, G. A. (2022). Managing group work: the impact of peer assessment on student engagement. Accounting Education, 32(1), 90–113.

Ahmed, M. R., & Sidiq, M. A. (2023). Evaluating Online Assessment Strategies: A Systematic Review of Reliability and Validity in E-Learning Environments. North American Academic Research, 6(12), 1–18.

Al Harrasi, K. T. S. (2024). Enhancing learner self-monitoring in self-assessment through the use of pedagogical resources. Cogent Social Sciences, 10(1).

Andrade HL. (2019). A Critical Review of Research on Student Self-Assessment. Front. Educ. 4:87.

Babik, D., Gehringer, E., Kidd, J. et al. A systematic review of educational online peer-review and assessment systems: charting the landscape. Education Tech Research Dev (2024).

Cabero-Almenara, J., Romero-Tena, R. and Palacios-Rodríguez, A. (2020). Evaluation of teacher digital competence frameworks through expert judgement: The use of the expert competence coefficient, Journal of New Approaches in Educational Research, 9(2).

Celeste, R. J., & Osias, N. (2024). Challenges and implementation of technology integration: Basis for enhanced instructional program. American Journal of Arts and Human Science, 3(2), 106-130.

Chai, K.C., Tay, K.M. and Lim, C.P. (2015). A new fuzzy peer assessment methodology for cooperative learning of students, Applied Soft Computing Journal, 32.

Chaiklin, H. (1991). Case Study Research: Design and Methods’, The Journal of Nervous and Mental Disease, 179(2).

Chen, T.L. (2020). Learning programming language in higher education for sustainable development: Point-earning bidding method, Sustainability (Switzerland), 12(11).

Chourishi, D. (2011). Effective E-Learning through Moodle, International Journal of Advance Technology & Engineering Research, 1(1).

Creswell, J.W. (2003a). Creswell, J.W. (2003). Chapter One, “A Framework for Design.”’, Research design Qualitative quantitative and mixed methods approaches [Preprint].

Creswell, J.W. (2003b). Research design Qualitative quantitative and mixed methods approaches’, Research design Qualitative quantitative and mixed methods approaches [Preprint].

Demir, M. (2018). Using online peer assessment in an Instructional Technology and Material Design course through social media, Higher Education, 75(3).

Demosthenous, G., Panaoura, A. and Eteokleous, N. (2020). The Use of Collaborative Assignment in Online Learning Environments: The Case of Higher Education, International Journal of Technology in Education and Science, 4(2).

Donia, M. B. L. (2021). Student satisfaction with use of an online peer feedback system. Assessment & Evaluation in Higher Education, 47(4), 1-15.

Double, K.S., McGrane, J.A. & Hopfenbeck, T.N. The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies. Educ Psychol Rev. 32, 481–509 (2020).

Dudovskiy, J. (2021). Positivism Research Philosophy, Research Methodology [Preprint].

Elsdaig, M. and Nassar, D.A. (2019). Evaluation of healthcare information system using delone and mclean quality model, case study ksa, International Journal of Advanced Trends in Computer Science and Engineering, 8(1.4S1).

Erbilgin, E., Robinson, J., Jarrah, A. M., Johnson, J. D., & Gningue, S. (2023). Exploring the type and quality of peer feedback in a graduate-level blended course. Education Sciences, 13(6).

Gamage, S.H.P.W., Ayres, J.R. and Behrend, M.B. (2022). A systematic review on trends in using Moodle for teaching and learning, International Journal of STEM Education.

Gielen, S., Peeters, E., Dochy, F., Onghena, P., & Struyven, K. (2010). Improving the effectiveness of peer feedback for learning. Learning and Instruction, 20(4), 304-315.

Gweon, G. (2011). A Framework for Assessment of Student Project Groups On-Line and Off-Line, in Analyzing Interactions in CSCL.

Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275–285.

Hermansyah, H., Nurhairunnisah, N. and Dwi Lestari, I. (2022). Analysis of Prospective Teacher’s Learning Independence Based on Gender Through the Utilization of Moodle-Based E-Learning, Jurnal Pendidikan Fisika dan Teknologi, 8(1).

Higgins, R. (2017). The Conscientious Consumer: Reconsidering the role of assessment feedback in student learning The Conscientious Consumer: reconsidering the role of assessment feedback in student learning, Studies in Higher Education, 27(1).

Hyttinen, K. (2017). Human-centered design model in the development of online learning tools for international security training CASE IECEU New Media based Learning Application (NMLA), in IC3K 2017 - Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management.

Ijeoma B. Anumaka. (2013). Institutional Effectiveness: Best Practices and Assessment Strategies in Uganda Universities’, BEST: International Journal of Management, Information Technology and Engineering (BEST: IJMITE), 1(2).

Jaime, A. (2016). Spiral and Project-Based Learning with Peer Assessment in a Computer Science Project Management Course, Journal of Science Education and Technology, 25(3).

Jakoet-Salie, A., & Ramalobe, K. (2023). The digitalization of learning and teaching practices in higher education institutions during the COVID-19 pandemic. Teaching Public Administration, 41(1), 59-71.

Jones, A. (2000). Collaborative Learning: Cognitive and Computational Approaches, Computers & Education, 35(1).

Karami, A., & Rezaei, A. (2015). An overview of peer-assessment: The benefits and importance. Journal for the Study of English Linguistics, 3(1), 93.

Kearney, S. (2013). Improving engagement: The use of “Authentic self-and peer-assessment for learning” to enhance the student learning experience, Assessment and Evaluation in Higher Education, 38(7).

Kerman, N.T., Banihashem, S.K., Karami, M. et al. Online peer feedback in higher education: A synthesis of the literature. Educ Inf Technol. 29, 763–813 (2024).

Konings, K. D., van Zundert, M., & van Merrienboer, J. J. G. (2019). Scaffolding peer-assessment skills: Risk of interference with learning domain-specific skills? Learning and Instruction, 60, 85-94.

Kritikos, V.S. (2011). Intergroup Peer Assessment in Problem-Based Learning Tutorials for Undergraduate Pharmacy Students, American Journal of Pharmaceutical Education, 75(4).

Lagan, S. (2020). Actionable health app evaluation: translating expert frameworks into objective metrics, npj Digital Medicine, 3(1).

Li, H. (2020). Does peer assessment promote student learning? A meta-analysis, Assessment and Evaluation in Higher Education, 45(2).

Limpanuparb, T. (2021). ACAD-Feedback: Online Framework for Assignment, Collection, Analysis, and Distribution of Self, Peer, Instructor, and Group Feedback, Journal of Chemical Education, 98(9).

Marjo van Zundert, M., Sluijsmans, D., & van Merriënboer, J. (2009). Effective peer assessment processes: Research findings and future directions. Learning and Instruction, 19(4), 289–305.

Matovu, M. and Zubairi, A.M. (2015). Assessment Practices in the Developing World: Predictors of Assessment Practices in Ugandan Institutions of Higher Learning, IIUM Journal of Educational Studies, 3(2).

Mayende, G. (2015). Peer assessment based assignment to enhance interactions in online learning groups, in Proceedings of 2015 International Conference on Interactive Collaborative Learning, ICL 2015.

Mohamed Hashim, M., Tlemsani, I. & Matthews, R. Higher education strategy in digital transformation. Educ Inf Technol. 27, 3171–3195 (2022).

McKenzie, J., Pelliccione, L. and Parker, N. (2008). Developing peer review of teaching in blended learning environments: Frameworks and challenges, in ASCILITE 2008 - The Australasian Society for Computers in Learning in Tertiary Education.

Moccozet, L. and Tardy, C. (2015). An assessment for learning framework with peer assessment of group works, in 2015 International Conference on Information Technology Based Higher Education and Training, ITHET 2015.

Mota, A.R. (2019). Peer and Self-assessment: A Mathematical Model to Improve Students’ Accountability in Laboratory Stations Model, International Journal of Physics and Chemistry Education, 11.

Nguyen Ngoc, H., Lasa, G. and Iriarte, I. (2022). Human-centred design in industry 4.0: case study review and opportunities for future research, Journal of Intelligent Manufacturing.

Nguyen, V.A. (2017). A peer assessment approach to project based blended learning course in a Vietnamese higher education’, Education and Information Technologies, 22(5).

Papinczak, T., Young, L., & Groves, M. (2007). Peer assessment in problem-based learning: A qualitative study. Advances in Health Sciences Education, 12(2), 169-186.

Peimani, N. and Kamalipour, H. (2021). Online education in the post covid-19 era: Students’ perception and learning experience, Education Sciences, 11(10).

Pereira, D., Flores, M.A. and Niklasson, L. (2016). Assessment revisited: a review of research in Assessment and Evaluation in Higher Education’, Assessment and Evaluation in Higher Education, 41(7).

Phelan, S. (2011). Case study research: design and methods, Evaluation & Research in Education, 24(3).

Putu Ramayasa, I. (2015). Evaluation model of success and acceptance of e-learning, Journal of Theoretical and Applied Information Technology, 82(3).

Ramayasa, I.P. (2015). Evaluation Model of Success and Acceptance of E-Learning, Journal of Theoretical and Applied Information Technology, 3182(3).

Rawlusyk, P.E. (2018). Assessment in Higher Education and Student Learning, Journal of Instructional Pedagogies, 21.

Rezaei, E., Beheshti Shirazi, S.S. The impact of thinking-aloud peer assessment (TAPA) on the development of high order thinking skills (HOTS) in math e-learning. Educ Inf Technol. (2024).

Roberts, T. S. (2006). Self, Peer and Group Assessment in E-Learning. Idea Group Inc.

Rosa, S.S., Coutinho, C.P. and Flores, M.A. (2016). Online Peer Assessment: Method and Digital Technologies, Procedia - Social and Behavioral Sciences, 228.

Rust, C. (2002). The Impact of Assessment on Student Learning, Active Learning in Higher Education, 3(2).

Saputra, K.O., Mertasana, P.A. and Rahardjo, P. (2020). Model of Group Peer Assessment on E-Learning, International Journal of Engineering and Emerging Technology, 4(2).

Saraç, S. and Karakelle, S. (2012). On-line and off-line assessment of metacognition, International Electronic Journal of Elementary Education, 4(2).

Shermin, A., De Silva, B., & Wesumperuma, A. (2019, December). Groupwork Assessment Development (GAD): A framework for developing an effective group work assessment. In Australasian Conference on Information Systems. Fremantle, Western Australia.

Scott, G.W. (2017). Active engagement with assessment and feedback can improve Group-Work outcomes and boost student confidence, Higher Education Pedagogies, 2(1).

Sridharan, B. and Boud, D. (2019). The effects of peer judgements on teamwork and self-assessment ability in collaborative group work, Assessment and Evaluation in Higher Education, 44(6).

Štilic, A. (2023). An Expert-Opinion-Based Evaluation Framework for Sustainable Technology-Enhanced Learning Using Z-Numbers and Fuzzy Logarithm Methodology of Additive Weights, Sustainability (Switzerland), 15(16).

Surahman, E. (2019). Design of Peer Collaborative Authentic Assessment Model Based on Group Project Based Learning to Train Higher Order Thinking Skills of Students, in. doi:10.2991/icet-18.2018.6.

Tait-McCutcheon, S. and Knewstubb, B. (2018). Evaluating the alignment of self, peer and lecture assessment in an Aotearoa New Zealand pre-service teacher education course, Assessment and Evaluation in Higher Education, 43(5).

Tumpa, R. J., Skaik, S., Chaudhry, G., & Ham, M. (2021). Group-based Assessments and Project Management Education: Towards a Dynamic Framework with Best Practices. International Journal of Innovation and Business Strategy, 5(4), 275–285.

Wanner, T. and Palmer, E. (2018). Formative self-and peer assessment for improved student learning: the crucial factors of design, teacher participation and feedback. Assessment and Evaluation in Higher Education, 43(7).

Wei, Z. (2023). Navigating Digital Learning Landscapes: Unveiling the Interplay Between Learning Behaviors, Digital Literacy, and Educational Outcomes. J Knowl Econ (2023).

Yin S, Chen F and Chang H (2022) Assessment as Learning: How Does Peer Assessment Function in Students' Learning? Front. Psychol. (13), 912568.

Yundayani, A., Alghadari, F., & Odewumi, M. O. (2019). Technology-mediated peer assessment in a course: A snapshot through the students’ lens.

Zheng, L., Zhang, X., & Cui, P. (2019). The role of technology-facilitated peer assessment and supporting strategies: A meta-analysis. Assessment & Evaluation in Higher Education, 45(1), 1-15.