Summary:
This study looked at whether using artificial intelligence (AI) writing tools such as large language models (LLMs) during essay writing affects how much people think, remember, and engage with their work. In this paper, LLM is a type of AI used to generate text, for example tools like ChatGPT. The researchers compared three groups: one used AI text generation, one used a search engine, and one wrote without any outside tools. Fifty-four people completed the first three writing sessions, and 18 later took part in a follow-up session where some switched groups. The researchers measured brain activity with an EEG (a diagnostic test that measures activity in the brain), analysed the essays with computer tools, and scored the writing using both human markers and AI. The study found that people who wrote without any tools showed the highest level of brain activity and mental engagement. People using search engines showed a medium level of engagement, while people using AI text generation showed the lowest. The AI group also felt less ownership over their essays and found it harder to remember or quote what they had written. Overall, the findings suggest that while AI tools may make writing easier, relying on them too much may reduce mental effort, weaken memory, and make people feel less connected to their own work.
Read the Complete Article >
Abstract:
This study explores the neural and behavioral consequences of LLM-assisted essay writing. Participants were divided into three groups: LLM, Search Engine, and Brain-only (no tools). Each completed three sessions under the same condition. In a fourth session, LLM users were reassigned to Brain-only group (LLM-to-Brain), and Brain-only users were reassigned to LLM condition (Brain-to-LLM). A total of 54 participants took part in Sessions 1-3, with 18 completing session 4. We used electroencephalography (EEG) to assess cognitive load during essay writing, and analyzed essays using NLP, as well as scoring essays with the help from human teachers and an AI judge. Across groups, NERs, n-gram patterns, and topic ontology showed within-group homogeneity. EEG revealed significant differences in brain connectivity: Brain-only participants exhibited the strongest, most distributed networks; Search Engine users showed moderate engagement; and LLM users displayed the weakest connectivity. Cognitive activity scaled down in relation to external tool use. In session 4, LLM-to-Brain participants showed reduced alpha and beta connectivity, indicating under-engagement. Brain-to-LLM users exhibited higher memory recall and activation of occipito-parietal and prefrontal areas, similar to Search Engine users. Self-reported ownership of essays was the lowest in the LLM group and the highest in the Brain-only group. LLM users also struggled to accurately quote their own work. While LLMs offer immediate convenience, our findings highlight potential cognitive costs. Over four months, LLM users consistently underperformed at neural, linguistic, and behavioral levels. These results raise concerns about the long-term educational implications of LLM reliance and underscore the need for deeper inquiry into AI’s role in learning.
Article Publication Date: 10/06/2025
DOI: 10.48550/arXiv.2506.08872
