Human-AI Collaboration in Scientific Writing Training: A Quantitative Evaluation of Learning Effectiveness and Academic Integrity
Article Sidebar
AI Writing,
Human-AI Collaboration,
Scientific Writing,
Training Evaluation
Main Article Content
Eko Risdianto
Nanik Setyowati
Mohammad Qaiz Rezvani
M. Abdul Jamal
Mageswaran Sanmugam
M. Esad Kuloğlu
Abstract
Background: The rapid advancement of Artificial Intelligence (AI) has significantly transformed academic writing practices, offering both opportunities and ethical challenges, particularly related to plagiarism and over-reliance on automated tools.
Objectives: This study aims to evaluate the effectiveness of AI-assisted scientific writing training in enhancing participants’ writing skills, academic integrity awareness, and writing efficiency through a Human-AI Collaboration approach.
Methods: A quantitative descriptive method was employed using a structured questionnaire consisting of 20 Likert-scale items administered to 85 participants. The instrument measured five dimensions: relevance and conceptual understanding, instructional quality, writing skill improvement, academic integrity awareness, and perceived impact. Data were analyzed using descriptive statistics, including mean scores and percentage distributions.
Results: The findings reveal that the training achieved a very high level of effectiveness, with an overall mean score of 3.59. All variables were categorized as very high, with academic integrity awareness obtaining the highest mean score (3.70), indicating strong improvement in ethical understanding. Writing skill improvement showed relatively lower scores, suggesting the need for continuous practice.
Conclusion: AI-assisted scientific writing training based on the Human-AI Collaboration framework is highly effective in improving scientific writing competence and promoting ethical awareness. This approach provides a balanced model integrating technical skills and academic integrity in AI-supported writing practices.
Downloads
Article Details
Copyright (c) 2026 Eko Risdianto, Nanik Setyowati, Mohammad Qaiz Rezvani, M. Abdul Jamal, Mageswaran Sanmugam, M. Esad Kuloğlu
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Arianda, Y. D., Madani, F., Badrujaman, A., & Priyanto, S. (2025). Evaluation of Scientific Article Writing Training Program Using CIPP Model: Case Study in Directorate of Research and Community Service. Journal of Education Research and Evaluation, 9(3), 530–538. https://doi.org/10.23887/jere.v9i3.100612
Baldrich, K., García, C. P., & Santamarina-Sancho, M. (2025). Artificial intelligence in Academic Literacy: Empirical Evidence on Reading and Writing Practices in Higher Education. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1701238
Barella, Y., Fergina, A., Mustami, M. K., Rahman, U., & Alajaili, H. M. A. (2024). Quantitative Methods in Scientific Research. Jurnal Pendidikan Sosiologi Dan Humaniora, 15(1), 281. https://doi.org/10.26418/j-psh.v15i1.71528
Chan, C. K. Y., & Hu, W. (2023). Students’ Voices on Generative AI: Perceptions, Benefits, and Challenges in Higher Education. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00411-8
Cotton, D., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148
Dakakni, D., & Safa, N. (2023). Artificial Intelligence in the L2 Classroom: Implications and Challenges on Ethics and Equity in Higher Education: A 21st Century Pandora’s Box. Computers and Education: Artificial Intelligence. https://doi.org/10.1016/J.CAEAI.2023.100179
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J. S., Eirug, A., Galanos, V., Ilavarasan, P. V., Janssen, M., Jones, P., Kar, A. K., Kizgin, H., Kronemann, B., Lal, B., Lucini, B., … Williams, M. D. (2019). Artificial Intelligence (AI): Multidisciplinary Perspectives on Emerging Challenges, Opportunities, and Agenda for Research, Practice and Policy. International Journal of Information Management, 57, 101994. https://doi.org/10.1016/j.ijinfomgt.2019.08.002
Escalante, J., Pack, A., & Barrett, A. (2023). AI-Generated Feedback on Writing: Insights Into Efficacy and ENL Student Preference. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00425-2
Gaber, S. A., & Ali, S. I. (2022). Effectiveness of a Training Program in Improving Scientific Writing Skills Based on APA 7 Style among Postgraduate Students. International Journal of Learning Teaching and Educational Research, 21(11), 282–299. https://doi.org/10.26803/ijlter.21.11.16
Giray, L., Silos, P. Y. De, Adornado, A., Buelo, R. J. V., Galas, E. M., Reyes-Chua, E., Santiago, C. S., & Ulanday, M. L. (2024). Use and Impact of Artificial Intelligence in Philippine Higher Education: Reflections from Instructors and Administrators. Internet Reference Services Quarterly, 28(3), 315–338. https://doi.org/10.1080/10875301.2024.2352746
Hadaitana, D., & Iqbal, M. A. (2023). The Effect Of Training and Development on Employee Performance With Mediation of Employee Satisfaction. International Journal of Advanced Multidisciplinary, 1(4), 436–447. https://doi.org/10.38035/ijam.v1i4.161
Hegazy, hmed Z., Gaber, S. A., Alkhateeb, I. A., Alqatam, M. A., Almughyirah, S. M., Mahgoub, Y. M., & Ali, H. (2024). Saudi Postgraduate Students` Ethical Commitment Between Awareness and Application of Artificial Intelligence in Scientific Writing. International Journal of Learning Teaching and Educational Research, 23(10), 583–598. https://doi.org/10.26803/ijlter.23.10.28
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial Intelligence In Education: Promises and Implications for Teaching and Learning. In Open Research Online (The Open University). The Open University.
Hwang, A. H., Liao, Q. V., Blodgett, S. L., Olteanu, A., & Trischler, A. (2024). “It was 80% me, 20% AI”: Seeking Authenticity in Co-Writing with Large Language Models. ArXiv (Cornell University). https://doi.org/10.48550/arxiv.2411.13032
Kamoun, F., Ayeb, W. El, Jabri, I., Sifi, S., & Iqbal, F. (2024). Exploring Students’ and Faculty’s Knowledge, Attitudes, and Perceptions Towards ChatGPT: A Cross-Sectional Empirical Study. Journal of Information Technology Education Research, 23, 4. https://doi.org/10.28945/5239
Kim, J., Yu, S., Detrick, R., & Li, N. (2024). Exploring students’ perspectives on Generative AI-assisted Academic Writing. Education and Information Technologies, 30(1), 1265–1300. https://doi.org/10.1007/s10639-024-12878-7
Klímová, B., Pikhart, M., & Kacetl, J. (2023). Ethical Issues of the Use of AI-Driven Mobile Apps for Education. Frontiers in Public Health, 10. https://doi.org/10.3389/fpubh.2022.1118116
Limongi, R. (2024). The Use of Artificial Intelligence in Scientific Research with Integrity and Ethics. Future Studies Research Journal Trends and Strategies, 16(1). https://doi.org/10.24023/futurejournal/2175-5825/2024.v16i1.845
Luttges, B. L., Rogers, T., Goldstein, D. G., Ungar, L., & Duckworth, A. (2025). Learning from Examples: AI Assistance Can Enhance Rather Than Hinder Skill Development. ArXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.02880
Marzuki, M., Widiati, U., Rusdin, D., Darwin, D., & Indrawati, I. (2023). The impact of AI writing Tools on the Content and Organization of Students’ Writing: EFL Teachers’ Perspective. Cogent Education, 10(2). https://doi.org/10.1080/2331186x.2023.2236469
Matta, D. (Daoud). (2026). The AI Skill Development Framework: from Cognitive Offloading to Skill Retention Through External Verification. Zenodo (CERN European Organization for Nuclear Research). https://doi.org/10.5281/zenodo.18470063
Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024). Human-AI Collaboration Patterns in AI-Assisted Academic Writing. Studies in Higher Education, 49(5), 847–864. https://doi.org/10.1080/03075079.2024.2323593
Park, J. (2025). A Systematic Literature Review of Generative Artificial Intelligence (GenAI) Literacy in Schools. Computers and Education Artificial Intelligence, 9, 100487. https://doi.org/10.1016/j.caeai.2025.100487
Perrotta, C., Downey, V., Elabbasy, D., Ingram, C., Lo, C. P., Naseer, A., Thorson, A., & Brizuela, V. (2023). Remote Training for Strengthening Capacity in Sexual and Reproductive Health and Rights Research: A Systematic Review. BMC Public Health, 23(1). https://doi.org/10.1186/s12889-023-16851-w
Phukan, A. (2025). Human–AI Collaborative Writing Systems: A Technical Architecture for Controlled Co-Creation. International Journal of Research and Scientific Innovation, 12(13), 125–129. https://doi.org/10.51244/ijrsi.2025.1213cs0010
Pradilia, A. D., & Gani, I. P. (2025). Penguatan Keterampilan Menulis Karya Ilmiah Bagi Mahasiswa Jurusan Pendidikan Ekonomi Universitas Negeri Gorontalo. Jambura Arena Pengabdian., 3(1), 1–8. https://doi.org/10.37905/jardian.v3i1.31888
Satyawati, S. T., & Waruwu, M. (2024). Evaluation of the Effectiveness of E-Training in Preparing Scientific Work Using the Kirkpatrick Model. JPI (Jurnal Pendidikan Indonesia), 13(3), 571–583. https://doi.org/10.23887/jpiundiksha.v13i3.75203
Seßler, K., Fürstenberg, M., Bühler, B., & Kasneci, E. (2025). Can AI grade your essays? A comparative analysis of large language models and teacher ratings in multidimensional essay scoring. 462–472. https://doi.org/10.1145/3706468.3706527
Shen, J. H., & Tamkin, A. (2026). How AI Impacts Skill Formation. ArXiv (Cornell University). https://doi.org/10.48550/arxiv.2601.20245
Song, C., & Song, Y. (2023). Enhancing Academic Writing Skills and Motivation: Assessing the Efficacy of ChatGpt in AI-Assisted Language Learning For EFL Students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843
Suriyati, S., Jamaluddin, J., Nur, M. J., & Zulfikar, Z. (2024). Pelatihan Penulisan Karya Tulis Ilmiah dalam Meningkatkan Kemampuan Menulis Pimpinan dan Kader PK IMM FTIK UIAD SINJAI. Jurnal Pengabdian Pendidikan Masyarakat (JPPM), 5(2), 202–208. https://doi.org/10.52060/jppm.v5i2.1830
Tejeda, A. S., Oller, J. C. D., Baldaquí-Escandell, J. M., Gómez-Díaz, R., & García-Rodríguez, A. (2026). The Impact of Generative AI on Academic Reading and Writing: A Synthesis of Recent Evidence (2023–2025). Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1711718
Tobías, R. G., Lozano, J. M., Torres, M. B. A., Álvarez, J., Baldini, G. M., & Okoye, K. (2025). AI and VR Integration for Enhancing Ethical Decision-Making Skills and Competency of Learners in Higher Education. International Journal of STEM Education, 12(1). https://doi.org/10.1186/s40594-025-00575-x
Usher, M., & Barak, M. (2024). Unpacking the Role of AI Ethics Online Education for Science and Engineering Students. International Journal of STEM Education, 11(1). https://doi.org/10.1186/s40594-024-00493-4
Zhao, W., Liu, Z., Wang, T., Yin, X., Sun, Y., Zhang, X., & Yang, H. (2023). Assessment of A Training Project of English As A Aedia of Instruction(EMI) Using Kirkpatrick Model. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04204-5
Zhu, A. S., Zhu, J. H., Chen, Y., & Li, P. P. (2026). Developing a Delphi-Consensus Evaluation Framework for Clinical Research Training: A Chinese Model with Global Implications. Journal of Medical Education and Curricular Development, 13. https://doi.org/10.1177/23821205261428939
Костікова, І., Holubnycha, L., Besarab, T., Moshynska, O., Moroz, T., & Shamaieva, I. (2024). Chat GPT for Professional English Course Development. International Journal of Interactive Mobile Technologies (IJIM), 18(2), 68–81. https://doi.org/10.3991/ijim.v18i02.46623