Skip to the main content

Original scientific paper

https://doi.org/10.2478/exell-2023-0008

Clause complexing in research-article abstracts: Comparing human- and AI-generated text

Alvin Ping Leong ; Nanyang Technological University, Singapore


Full text: english pdf 538 Kb

page 99-132

downloads: 54

cite


Abstract

The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended.

Keywords

abstracts; clause complexing; generative AI; Bard; ChatGPT; Poe Assistant

Hrčak ID:

311162

URI

https://hrcak.srce.hr/311162

Publication date:

12.12.2023.

Visits: 120 *