UPM Institutional Repository

A bibliometric exposition and review on leveraging LLMs for programming education


Citation

Amos, Joanah Pwanedo and Amodu, Oluwatosin Ahmed and Raja Mahmood, Raja Azlina and Abdulqudus, Akanbi Bolakale and Zakaria, Anies Faziehan and Iyanda, Abimbola Rhoda and Ali Bukar, Umar and Mohd Hanapi, Zurina (2025) A bibliometric exposition and review on leveraging LLMs for programming education. IEEE Access, 13. pp. 58364-58393. ISSN 2169-3536

Abstract

The world is experiencing an AI revolution, with large language models (LLMs) transforming various industries, including education. Academics are striving to harness the potential of LLMs while also contending with their risks. This paper presents the first bibliometric analysis focused on LLM research in programming education, identifying leading countries, authors, and institutions while analyzing key terms and popular keywords in this field. Additionally, it highlights influential studies on topics such as introductory programming, computer science, computing, programming education, and prompt engineering, discussing key insights from these works. Findings indicate that LLMs could play a significant role in programming education and may be integrated into computer science curricula. However, careful consideration is needed to ensure their benefits outweigh their risks across various use cases. This study specifically examines ChatGPT as a representative LLM, exploring its benefits and limitations as both a learning aid for students and a support tool for professionals. It also evaluates the quality of ChatGPT-generated code and its effectiveness in simplifying programming concepts for beginners. Furthermore, the ethical implications of increasing reliance on LLMs for programming tasks, including concerns about dependency, plagiarism, and potential effects on critical thinking, are addressed. By contributing to the ongoing discourse on integrating AI tools like ChatGPT in programming education, this research emphasizes the importance of responsible and ethical usage to maximize benefits for students, educators, and the broader educational community.


Download File

[img] Text
121571.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (2MB)
Official URL or Download Paper: https://ieeexplore.ieee.org/document/10938596/

Additional Metadata

Item Type: Article
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.1109/ACCESS.2025.3554627
Publisher: Institute of Electrical and Electronics Engineers
Keywords: ChatGPT; Code generation; Ethical concerns; Introductory programming; Large language models (LLMs); Programming education; Prompt engineering
Depositing User: MS. HADIZAH NORDIN
Date Deposited: 06 Nov 2025 03:52
Last Modified: 06 Nov 2025 03:52
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1109/ACCESS.2025.3554627
URI: http://psasir.upm.edu.my/id/eprint/121571
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item