Evaluating the Effectiveness of Online Peer Assessment Frameworks for Group-Based Assessment in Higher Institutions of Learning

Job Kalema; Jane  Katusiime; Simon  Kawuma; Deborah  Natumanya

doi:10.47540/ijias.v5i1.1768

Authors

Job Kalema Department of Computer Science, Mbarara University of Science and Technology, Uganda
Jane Katusiime Department of Computer Science, Mbarara University of Science and Technology, Uganda
Simon Kawuma Department of Computer Science, Mbarara University of Science and Technology, Uganda
Deborah Natumanya Department of Computer Science, Mbarara University of Science and Technology, Uganda

DOI:

https://doi.org/10.47540/ijias.v5i1.1768

Keywords:

Collaborative Learning, Higher Institutions of Learning, Online Learning, Peer Assessment

Abstract

This study assesses the effectiveness of online peer assessment frameworks in higher institutions of learning through a quantitative analysis. The research explores the relationships between several dimensions of online peer assessment, comprising participant engagement, perceived challenges, and the effectiveness of online collaborative tools. Employing a sample of 154 participants, data were collected via surveys, and statistical methods, including factor analysis, t-tests, and regression analysis, were applied to examine the results. The findings indicate a generally positive perception of online peer assessment, with significant correlations between technical support and user satisfaction. The effects of these results highlight the need for higher institutions of learning to address technical challenges and improve support mechanisms to improve the effectiveness of online peer assessment frameworks.

References

Alcarria, R., Bordel, B., de Andrés, D. M., & Robles, T. (2018). Enhanced peer assessment in MOOC evaluation through assignment and review analysis. International Journal of Emerging Technologies in Learning, 13(1).

Alowayr, A. (2022). Determinants of mobile learning adoption: extending the unified theory of acceptance and use of technology (UTAUT). International Journal of Information and Learning Technology, 39(1).

Alyoussef, I. Y. (2023). Acceptance of e-learning in higher education: The role of task-technology fit with the information systems success model. Heliyon, 9(3).

Cabero-Almenara, J., Romero-Tena, R., & Palacios-Rodríguez, A. (2020). Evaluation of teacher digital competence frameworks through expert judgement: The use of the expert competence coefficient. Journal of New Approaches in Educational Research, 9(2).

Chai, K. C., Tay, K. M., & Lim, C. P. (2015). A new fuzzy peer assessment methodology for cooperative learning of students. Applied Soft Computing Journal, 32.

Chen, T. L., Hsiao, T. C., Kang, T. C., Wu, T. Y., & Chen, C. C. (2020). Learning programming language in higher education for sustainable development: Point-earning bidding method. Sustainability (Switzerland), 12(11).

Chourishi, D., Buttan, C. K., Chaurasia, A., & Soni, A. (2011). Effective E-Learning through Moodle. International Journal of Advance Technology & Engineering Research, 1(1).

Creswell, J. W. (2003a). Creswell, J.W. (2003). Chapter One, “A Framework for Design.” Research Design Qualitative Quantitative and Mixed Methods Approaches.

Creswell, J. W. (2003b). Research design Qualitative quantitative and mixed methods approaches. Research Design Qualitative Quantitative and Mixed Methods Approaches.

Demir, M. (2018). Using online peer assessment in an Instructional Technology and Material Design course through social media. Higher Education, 75(3).

Demosthenous, G., Panaoura, A., & Eteokleous, N. (2020). The Use of Collaborative Assignment in Online Learning Environments: The Case of Higher Education. International Journal of Technology in Education and Science, 4(2).

Gamage, S. H. P. W., Ayres, J. R., & Behrend, M. B. (2022). A systematic review on trends in using Moodle for teaching and learning. In International Journal of STEM Education, 9(1).

Gweon, G., Jun, S., Lee, J., Finger, S., & Rosé, C. P. (2011). A Framework for Assessment of Student Project Groups On-Line and Off-Line. In Analyzing Interactions in CSCL.

Hermansyah, H., Nurhairunnisah, N., & Dwi Lestari, I. (2022). Analysis of Prospective Teacher’s Learning Independence Based on Gender Through the Utilization of Moodle-Based E-Learning. Jurnal Pendidikan Fisika Dan Teknologi, 8(1).

Higgins, R., Hartley, P., Skelton, A., Higgins, R., Hartley, P., & Skelton, A. (2017). The Conscientious Consumer: Reconsidering the role of assessment feedback in student learning The Conscientious Consumer: reconsidering the role of assessment feedback in student learning. Studies in Higher Education, 27(1).

Jaime, A., Blanco, J. M., Domínguez, C., Sánchez, A., Heras, J., & Usandizaga, I. (2016). Spiral and Project-Based Learning with Peer Assessment in a Computer Science Project Management Course. Journal of Science Education and Technology, 25(3).

Jones, A. (2000). Collaborative Learning: Cognitive and Computational Approaches. Computers & Education, 35(1).

Kearney, S. (2013). Improving engagement: The use of “Authentic self-and peer-assessment for learning” to enhance the student learning experience. Assessment and Evaluation in Higher Education, 38(7).

Kritikos, V. S., Woulfe, J., Sukkar, M. B., & Saini, B. (2011). Intergroup peer assessment in problem-based learning tutorials for undergraduate Pharmacy students. American Journal of Pharmaceutical Education, 75(4).

Lagan, S., Aquino, P., Emerson, M. R., Fortuna, K., Walker, R., & Torous, J. (2020). Actionable health app evaluation: translating expert frameworks into objective metrics. Npj Digital Medicine, 3(1).

Li, H., Xiong, Y., Hunter, C. V., Guo, X., & Tywoniw, R. (2020). Does peer assessment promote student learning? A meta-analysis. Assessment and Evaluation in Higher Education, 45(2).

Collection, Analysis, and Distribution of Self, Peer, Instructor, and Group Feedback. Journal of Chemical Education, 98(9).

Matovu, M., & Zubairi, A. M. (2015). Assessment Practices in the Developing World: Predictors of Assessment Practices in Ugandan Institutions of Higher Learning. IIUM Journal of Educational Studies, 3(2).

Mayende, G., Isabwe, G. M. N., Muyinda, P. B., & Prinz, A. (2015). Peer assessment based assignment to enhance interactions in online learning groups. Proceedings of 2015 International Conference on Interactive Collaborative Learning, ICL 2015.

McKenzie, J., Pelliccione, L., & Parker, N. (2008). Developing peer review of teaching in blended learning environments: Frameworks and challenges. ASCILITE 2008 - The Australasian Society for Computers in Learning in Tertiary Education.

Michael Edoru, J., & Sanni Adebayo, T. (2019). Information and Communication Technology in Ugandan Higher Education: A Case of Makerere University Communication. Rwanda Journal of Social & Applied Sciences (RJSAS), 5.

Moccozet, L., & Tardy, C. (2015). An assessment for learning framework with peer assessment of group works. 2015 International Conference on Information Technology Based Higher Education and Training, ITHET 2015.

Mota, A. R., Santos, J., Esperto, P., & Coutinho, I. (2019). Peer and Self-assessment: A Mathematical Model to Improve Students’ Accountability in Laboratory Stations Model. International Journal of Physics and Chemistry Education, 11.

Mudzana, T., & Maharaj, M. (2015). Measuring the success of business-intelligence systems in South Africa: An empirical investigation applying the DeLone and McLean Model. SA Journal of Information Management, 17(1).

Nguyen Ngoc, H., Lasa, G., & Iriarte, I. (2022). Human-centred design in industry 4.0: case study review and opportunities for future research. In Journal of Intelligent Manufacturing (Vol. 33, Issue 1).

Nguyen, V. A. (2017). A peer assessment approach to project based blended learning course in a Vietnamese higher education. Education and Information Technologies, 22(5).

Ojo, A. I. (2017). Validation of the delone and mclean information systems success model. Healthcare Informatics Research, 23(1).

Peimani, N., & Kamalipour, H. (2021). Online education in the post covid-19 era: Students’ perception and learning experience. Education Sciences, 11(10).

Pereira, D., Flores, M. A., & Niklasson, L. (2016). Assessment revisited: a review of research in Assessment and Evaluation in Higher Education. Assessment and Evaluation in Higher Education, 41(7).

Rawlusyk, P. E. (2018). Assessment in Higher Education and Student Learning. Journal of Instructional Pedagogies, 21.

Rosa, S. S., Coutinho, C. P., & Flores, M. A. (2016). Online Peer Assessment: Method and Digital Technologies. Procedia - Social and Behavioral Sciences, 228.

Rust, C. (2002). The Impact of Assessment on Student Learning. Active Learning in Higher Education, 3(2).

Saputra, K. O., Mertasana, P. A., & Rahardjo, P. (2020). Model of Group Peer Assessment on E-Learning. International Journal of Engineering and Emerging Technology, 4(2).

Saraç, S., & Karakelle, S. (2012). On-line and off-line assessment of metacognition. International Electronic Journal of Elementary Education, 4(2).

Scott, G. W. (2017). Active engagement with assessment and feedback can improve Group-Work outcomes and boost student confidence. Higher Education Pedagogies, 2(1).

Sridharan, B., & Boud, D. (2019). The effects of peer judgements on teamwork and self-assessment ability in collaborative group work. Assessment and Evaluation in Higher Education, 44(6).

Štilic, A., Puška, E., Puška, A., & Božanic, D. (2023). An Expert-Opinion-Based Evaluation Framework for Sustainable Technology-Enhanced Learning Using Z-Numbers and Fuzzy Logarithm Methodology of Additive Weights. Sustainability (Switzerland), 15(16).

Surahman, E., Wedi, A., Sulthoni, Soepriyanto, Y., & Setyosari, P. (2019). Design of Peer Collaborative Authentic Assessment Model Based on Group Project Based Learning to Train Higher Order Thinking Skills of Students. Proceedings of the International Conference on Education and Technology (ICET 2018), Atlantis Press.

Tait-McCutcheon, S., & Knewstubb, B. (2018). Evaluating the alignment of self, peer and lecture assessment in an Aotearoa New Zealand pre-service teacher education course. Assessment and Evaluation in Higher Education, 43(5).

Wanner, T., & Palmer, E. (2018). Formative self-and peer assessment for improved student learning: the crucial factors of design, teacher participation and feedback. Assessment and Evaluation in Higher Education, 43(7).

Williamson, S., & Paulsen - Becejac, L. (2018). The Impact of Peer Learning within a Group of International Post-graduate Students – A Pilot Study. Athens Journal of Education, 5(1).