A literature review of online exams in HE in Physics and Maths

Authors

DOI:

https://doi.org/10.29311/ndtns.v0i19.4424

Keywords:

Open book exam, closed book exam, physics, maths, exam preparation

Abstract

During the COVID pandemic, universities around the globe had to move not only their content delivery online, but also their assessments. Due to COVID causing significant upheaval in Higher Education (HE), this enforced experiment also afforded an opportunity to reflect on traditional, invigilated, closed book exams (ICBE) resulting in research and advice in this area. A systematic review of this academic and grey literature was performed concentrating on maths heavy physics examinations to investigate what guidance is given to examination writers, educators who prepare students for exams and HE examinees themselves. The literature review results were divided into: Advice for examiners who need to provide an uinvigilated open book exam (UOBE), discussions on cheating, advice for students and case studies. It was found that ICBEs were good at examining lower order cognitive skills, e.g. recall and understanding, but higher order skills, such as analysing and synthesising, are better examined with access to a larger range of resources. Guidance on making academic misconduct more difficult also suggested using higher order thinking skills in exam questions as responses to these type of tasks are more individual and getting outside help may be more difficult in a time constrained UOBE. Furthermore, literature encouraged reflection on the motivation for cheating and suggested that overly demanding assessment may encourage students to seek inappropriate help. The advice for students highlighted the need to prepare as thoroughly for a UOBE as they would for a traditional exam. Probably the thrust should change from pure memorization to students preparing their notes so that they can efficiently access their material to locate relevant parts for synthesis during a UOBE. Some of the case studies used statistical methods to investigate comparability of grades between UOBEs and ICBEs and some of the studies found them comparable, so a large shift of results may be due to other factors rather than the exam type. Other studies describe their approach and include stakeholder reflections.

 

The main recommendation to exclude lower cognitive skills can pose a problem for maths heavy exams as they mainly assess how well an examinee has mastered these skills before building on them. However, it seems advisable to climb higher up Bloom’s taxonomy if possible. Also, it may be conceivable to break up exams into shorter sections that require individual uploading before access to the next part is granted to reduce the possibility of outside help. Furthermore, individualised maths type problems could be achievable by using different data sets for a question. Student advice should highlight the differences between UOBEs and ICBEs so that they can prepare appropriately.

References

Abdelrahim, Y. (2021). How COVID-19 Quarantine Influenced Online Exam Cheating: A Case of Bangladesh University Students. Journal of Southwest Jiaotong University, 56.

https://doi.org/10.35741/issn.0258-2724.56.1.18

Akhabau, I. (2021). Why More University Students are Cheating Amid the COVID-19 Pandemic [Online]. Available from: https://metro.co.uk/2021/09/11/COVID-19-cheats-more-university-students-tempted-by-at-home-exams-15237372/ [Accessed 4 Aug 2 022 2022].

Alibak, M., Talebi, H. and Neshat-Doost, H.T. (2019). Development and Validation of a

Test Anxiety Inventory for Online Learning Students. Journal of Educators Online, 16, (2).

https://doi.org/10.9743/JEO.2019.16.2.2

Al-Shalout, M. I., Rasmi, M. and Hassan, M. A. (2021). Evaluation of E-exam during COVID-

Psychology and Education Journal, 58, 4604-4612.

https://doi.org/10.17762/PAE.V58I1.1576

Ashri, D. and Sahoo, B. P. (2021). Open Book Examination and HE During COVID-19: Case of

University of Delhi. Journal of Educational Technology Systems, 50, 73-86.

https://doi.org/10.1177/0047239521013783

Babbar, M. and Gupta, T. (2021). Response of Educational Institutions to COVID-19 Pandemic:

An Inter-Country Comparison. Policy Futures in Education, 20 (4).

https://doi.org/10.1177/14782103211021937

Ball, S., Bew, C., Bloxham, S., Brown, S., Kleiman, P., May, H., McDowell, L., Morris, E., Orr, S., Payne, E., Price, M., Rust, C., Smith, B. and Waterfield, J. (2012). A Marked Improvement, Transforming assessment in HE. York: The HE Academy.

Bengtsson, L. (2019). Take-Home Exams in HE: A Systematic Review. Education Sciences, 9, 267.

https://doi.10.3390/educsci9040267

Bhute, V. J., Campbell, J., Kogelbauer, A., Shah, U. V. and Brechtelsbauer, C. (2020). Moving to Timed Remote Assessments: The Impact of COVID-19 on Year-End Exams in Chemical Engineering at Imperial College London. Journal of Chemical Education, 97, 2760-2767.

https://doi:10.1021/acs.jchemed.0c00617

Bohmer, C., Feldmann, N. and Ibsen, M. (2018). E-exams in Engineering Education—Online Testing of Engineering Competencies: Experiences and Lessons Learned. IEEE Global Engineering

Education Conference (EDUCON), 571-5

https://doi:10.1109/EDUCON.2018.8363281

Booth, A., Sutton, A., Clowes, M. and Martyn-St James, M. (2016). Systematic Approaches to a Successful Literature Review, London: Sage.

Brown, S. and Sambell, K. (2020). Contingency-Planning: Exploring Rapid Alternatives to Face-to-Face Assessment. [Online]. Available from:

https://sally-brown.net/kay-sambell-and-sally-brown-COVID-19-assessmentcollection/ [Accessed 6 Oct 2022].

Brown, S. and Sambell, K. (2020). Fifty Tips For Replacements For Time-Constrained, Invigilated On Site Exams. [Online]. Available from:

https://sally-brown.net/kay-sambell-and-sally-brown-COVID-19-assessment-collection/ [Accessed 6 Oct 2022].

Brown, S. and Sambell, K. (2020). Writing Better Assignments in the Post-COVID19 Era: Approaches to Good Task Design. [Online], 2022. Available from:

https://sally-brown.net/kay-sambell-and-sally-brown-COVID-19-assessment-collection/ [Accessed 6 Oct 2022].

Burghart, A. (2022). Essay Mills are Now Illegal - Skills Minister Calls on Internet Service Platforms to Crack Down on Advertising. [Online]. Available from:

https://educationhub.blog.gov.uk/2022/04/28/essay-mills-are-now-illegal-skills-minister-calls-on-internet-service-providers-to-crack-down-on-advertising/ [Accessed 16 Dec 2022].

Chang, L. P. L., Cerimagic, S. and Conejos, S. (2021). Challenges of Running Online Exams and Preventing Academic Dishonesty During the COVID-19 pandemic. Journal of Learning Development in Higher Education.

https://doi:10.47408/jldhe.vi22.830

Chible, H. (2021). Proposed Method to be Adopted for Online Exam Without Proctored Environment During COVID 19, Int. J. Sci. Res. in Multidisciplinary Studies, 7, 4, 53-61.

During, S. J., Dong, T., Ratcliffe, T., Schuwirth, L., Artino, A. R., Boulet, J. R. and Eva, K. (2016). Comparing Open-Book and Closed-Book Examinations: A Systematic Review. Academic Medicine, 91, 583-599.

https://doi:10.1097/ACM.0000000000000977

El-Hashash, A. (2022). Adapting Examination and Student Evaluation at Biomedical Science Institute in the time of COVID-19. Open Journal of Educational Research, 138-146.

https://doi:10.31586/ojer.2022.272

Georgescu, M. R. and Berechet, L. D. (2021). Challenges in Higher Online Education: Discouraging Fraudulent Attempts On Online Exams. DIEM: Dubrovnik International Economic Meeting, 2022. Sveučilište u Dubrovniku, 10-21.

Gordon, D. (2020). Don’t Panic: The Hitch-hiker's Guide to Alternative Assessment.

Harmon, O. R. and Lambrinos, J. (2008). Are Online Exams an Invitation to Cheat? The Journal of Economic Education, 39, 116-125.

https://doi:10.3200/JECE.39.2.116-125

Hendry, G. (n. d.) Practical assessment strategies to prevent students from plagiarising. [Online].

Heriot Watt University. (2020) Take-home exams: The student perspective.

Heriot Watt University. (n. d.-a) Assessments. Creating a take-home exam.

Heriot Watt University. (n. d.-b) Assessments. Guide to exam alternatives.

Heriot Watt University. (n. d.-c) Assessments. Making your exam work as a take-home assessment.

Hobson, T. (2022). The Impact of COVID-19 on Mathematics Education [Online]. Available from: https://ima.org.uk/20392/the-impact-of-COVID-19-on-mathematics-education/

[Accessed 12 Oct 2022].

Howcroft, J. and Mercer, K. (2022). What if my Wi-Fi crashes during an exam? First-year

engineering student perceptions of online learning during the COVID-19 pandemic, European Journal of Engineering Education, 1-15.

https://doi.org/10.1080/03043797.2022.2031115

Institute of Physics. (2022) Degree Accreditation Framework.

Jilkara, R. and Waters, D. P. (2020). Determination of the helpfulness of physics exam study methods. arXiv preprint arXiv:2012.10693.

https://doi.10.1080/0047231x.2023.12315865

Johanns, B., Dinkens, A. and Moore, J. (2017). A systematic review comparing open-book and closed-book examinations: Evaluating effects on development of critical thinking skills, Nurse Education in Practice, 27, 89-94.

https://doi.org/10.1016/j.nepr.2017.08.018

Jungic, V. (2021). Making calculus relevant: final exam in the time of COVID-19. International Journal of Mathematical Education in Science and Technology, 52, 609-621.

https://doi.org/10.1080/0020739X.2020.1775903

Khalaf, K., El-Kishawi, M., Moufti, M. A. and Al Kawas, S. (2020). Introducing a comprehensive high-stake online exam to final-year dental students during the COVID-19 pandemic and evaluation of its effectiveness, Medical Education Online, 25, 1826861.

https://doi.org.10.1080/10872981.2020.1826861

Kitsantas, A. (2002). Test Preparation and Performance: A Self-Regulatory Analysis, The Journal of Experimental Education, 70, 101-113.

https://doi.org/10.1080/00220970209599501

Kustijono, R. and Budiningarti, H. (2020). The Use of quizStar Application for Online Examination in Basic Physics Course, Journal of Physics: Conference Series, IOP Publishing, 012033.

Lawrence, J. (2020). Designing out Plagiarism for Online Assessment.

Available from:

https://thesedablog.wordpress.com/2020/04/02/online-assessment/

Manteufel, R., Karimi, A. and Bhounsule, P. (2020). Use of Phones and Online Tutors to Cheat on

Engineering Exams. 2020 Gulf Southwest Section Conference. Online.

https://doi.10.18260/1-2-370.620-36006

Mehrabian, A., Ali, T. and Rahrooh, A. (2008). Crafting Online Exams In Engineering And Technology: Latest Challenges, Methodologies, And Trends. Annual Conference & Exposition, 13.338. 1-13.338. 7.

https://doi.10.18260/1-2--5779

Morales-Martinez, G. E., Lopez-Ramirez, E. O., Mezquita-Hoyos, Y. N., Lopez-Perez, R. and Resendiz, A. Y. L. (2019). Cognitive Mechanisms Underlying the Engineering Students' Desire to Cheat during Online and Onsite Statistics Exams, European Journal of Educational Research, 8, 1145-1158.

https://doi:10.12973/eu-jer.8.4.1145

Prakasha, G., Hemalathaa, K., Tamizh, P., Bhavna, B. and Kenneth, A. (2021). Online Test Anxiety And Exam Performance Of International Baccalaureate Diploma Programme Students Under E-Proctored Exams Amid COVID-19, Problems of Education in the 21st Century, 79, 942.

https://doi:10.33225/pec/21.79.942

QAA. (2020). COVID-19: Initial Guidance for HE Providers on Standards and Quality.

QAA. (2022). Contracting to Cheat in Higher Education. 3rd ed.

Redrup, R. (2020. COVID-19: Preparing for Take Home Exams?

Available from:

https://blogs.reading.ac.uk/librarynews/2020/04/COVID-19-preparing-for-take-home-exams/ 2022]

Renfrew, K. (2020a). Top Tips for Taking Open Book Exams 1 - Preparation.

Available from:

https://blogs.bath.ac.uk/academic-and-employability-skills/2020/12/02/top-tips-for-taking-open-book-exams-1-preparation/.

Renfrew, K. (2020b). Top Tips for Taking Open Book Exams 2 - On the Day.

Available from:

https://blogs.bath.ac.uk/academic-and-employability-skills/2020/12/02/top-tips-for-taking-open-book-exams-1-preparation/

Sambell, K. and Brown, S. (2020). The Changing Landscape of Assessment: Some Possible Replacements for Unseen Time-Constrained Face-to-Face Invigilated Exams.

[Online], 2022. Available from:

https://sally-brown.net/kay-sambell-and-sally-brown-COVID-9-assessment-collection/

[Accessed 6 Oct 2022].

Sambell, K., Brown, S. and Race, P. (n. d.) Alternatives to Traditional Exams.

Sambell, K., Brown, S. and Race, P. (n. d.) Combatting Contract Cheating.

Smith, C. A. (2021). Development and Integration of Freely Available Technology into Online STEM Courses to Create a Proctored Environment During Exams, Journal of Higher Education Theory and Practice, 21, 126-130.

https://doi:10.33423/jhetp.v21i5.4274

Uniwise. (2020). Preventing Academic Misconduct in Digital Exams Using Third-Party

Programs. Available from:

https://www.uniwise.co.uk/blog/preventing-academic-misconduct-in-digital-exams-using-third-party-programs

Ural, M. N. and Takaoğlu, Z. B. (2023). Comparison of Online and Face-to-Face Exams Conducted in Physics I Course in Higher Education, Turkish Journal of Engineering, 7, 9-16.

https://doi:10.31127/tuje.1004417

Van Etten, S., Freebern, G. and Pressley, M. (1997). College Students’ Beliefs About Exam Preparation, Contemporary Educational Psychology, 22, 192-212.

https://doi.org/10.1006/ceps.1997.0933

Wood, G. C. (2020a). Preparing for Take-Home and Open Book Exams: A Student Guide. Available from: https://

www.garycwood.uk/2020/05/preparingffor-take-home-and-open-book exams.html

Wood, G. C. (2020b). Sitting Your Take-Home and Open Book Exams: A Student Guide, Available from:

https://www.garycwood.uk/2020/05/sitting-your-take-home-and-open-book-exams.html

Downloads

Published

12-02-2024

How to Cite

Braun, M. (2024). A literature review of online exams in HE in Physics and Maths. New Directions in the Teaching of Natural Sciences, (19). https://doi.org/10.29311/ndtns.v0i19.4424