Document Type
Article
Publication Date
2025
Abstract
Generative large-language models (LLMs) such as ChatGPT and Claude have sparked debate throughout higher education about their potential and threats to the current pedagogical models for research. This paper scans the literature on the benefits and drawbacks of using LLMs in teaching and research, and compares and contrasts two literature reviews on the subject, one written by a human author and one produced by Claude. The comparison explores areas where the generative AI excels, such as quickly summarizing points of agreement across sources, as well as its limitations, like struggling with synthesis, providing incomplete citations, and hallucinating false information. While Claude was able to identify key themes and sources, the areas where it struggles show that without human intervention (providing context and analysis), the tool cannot produce a literature review that would stand on its own. However, the experiment demonstrates potential for these models to augment and accelerate research workflows when leveraged responsibly alongside human scholars.
Recommended Citation
Sparkman, Max and Witt, Alan, "Claude AI and Literature Reviews: An Experiment in Utility and Ethical Use" (2025). Milne Library. 22.
https://knightscholar.geneseo.edu/library-research/22