ContactISSN:3023-6673
Author Sign-inReviewer Sign-inRegister
EnglishTürkçe
HomeAim and ScopeSpecial IssueSend ArticleLatest IssueArchiveContact Us

CAN CHATGPT PHYSIOTHERAPY FIELD ALSO PASS THE PROFESSIONAL PRACTICE EXAM?

Fatma Erdeo

  •  Year : 2024
  •  Vol : 2
  •  Issue : 2
  •  Page : 129-134
In the modern era, artificial intelligence (AI) continues to sweep the world. In various fields, tasks and jobs that were previously done only by humans are being performed quickly and easily by AI-powered software and robots. ChatGPT is a freely available conversational AI tool designed on the concept of reinforcement learning from human feedback. ChatGPT has wide applications. One of its popular uses includes academic assessment and assistance among medical students. Many say that ChatGPT1’s capabilities are impressive, with the model being able to pass even university exams, especially when it comes to ChatGPT’s ability to pass Multiple Choice Question (MCQ)-based exams for higher education.This study planned to examine the current research evidence on ChatGPT's performance on MCQ-based exams and its success on professional practice exams in physiotherapy education. ChatGPT3 free version 1.2023.256 and ChatGPT4 paid version were used. The final exam questions of the fall 2022 semester were used as the basis. ChatGPT3 passed with 61.01, while ChatGPT4 failed with 52.45. 58 out of 98 students scored 60 or above in this exam. 40 people scored below 60. MCQ-based assessments for professional qualifications should be conducted under secure conditions with limited access to similar tools like ChatCPT. The study highlights the need for robust online exam security measures, such as improved proctoring systems and more complex multi-modal exam questions, to reduce potential academic misconduct caused by AI technologies. This does not mean that AI tools like ChatGPT should not be used in education. On the contrary, AIs, which are easily available to everyone in education in parallel with the developing technology, can be used to improve the quality of education.
Cite this Article As : Erdeo, F. (2024). Can ChatGPT physiotherapy field pass the professional practice exam? Sustainable Welfare, 2(2), 129-134.

Conflict of interest : The authors declare that they have no conflict of interest.

This article is published under the CC BY-NC 4.0 license.
Sustainable Welfare
2024, Vol2, Issue2
ISSN: 3023-6673
Received : , Accepted : , Published Online :

References

  1. Farazouli, A., Cerratto-Pargman, T., Bolander-Laksov, K., & McGrath, C. (2024). Hello GPT! Goodbye home examination? An exploratory study of AI chatbots impact on university teachers’ assessment practices. Assessment & Evaluation in Higher Education, 49(3), 363-375.
  2. Edwards, A. A., Steacy, L. M., Siegelman, N., Rigobon, V. M., Kearns, D. M., Rueckl, J. G., & Compton, D. L. (2022). Unpacking the unique relationship between set for variability and word reading development: Examining word- and child-level predictors of performance. Journal of Educational Psychology, 114(6), 1242–1256. https://doi.org/10.1037/edu0000696
  3. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment. JMIR medical education, 9(1), e45312.
  4. Hammer, A. (2023). The rise of the machines? ChatGPT CAN pass US Medical Licensing Exam and the Bar, experts warn-after the AI chatbot received B grade on Wharton MBA paper. Daily Mail.
  5. Huh, S. (2023). Issues in the 3rd year of the COVID-19 pandemic, including computer-based testing, study design, ChatGPT, journal metrics, and appreciation to reviewers. Journal of educational evaluation for health professions, 20.
  6. Newton, P. M. (2024). Guidelines for creating online MCQ-based exams to evaluate higher order learning and reduce academic misconduct. In Second Handbook of Academic Integrity (pp. 269-285). Cham: Springer Nature Switzerland.
  7. Newton, P. M., & Xiromeriti, M. (2023). ChatGPT performance on MCQ exams in higher education. A pragmatic scoping review. EdArXiv. February, 21.
  8. OpenAI. 2023a. ‘New GPT-3 Capabilities: Edit & Insert’. 2023. https://openai.com/blog/gpt-3-edit
  9. Dibble, M. (2023). Schools ban ChatGPT amid fears of artificial intelligence-assisted cheating. VOA News.
  10. Qureshi, B. (2023). Exploring the use of chatgpt as a tool for learning and assessment in undergraduate computer science curriculum: Opportunities and challenges. arXiv preprint arXiv:2304.11214.
  11. TALAN, T., & KALINKARA, Y. (2023). The role of artificial intelligence in higher education: ChatGPT assessment for anatomy course. Uluslararası Yönetim Bilişim Sistemleri ve Bilgisayar Bilimleri Dergisi, 7(1), 33-40.