gpt3-69-of-178-incorrect-dois-cureus-2023

IN premise — summaries/2026/08/24/wiki-Hallucination_artificial_intelligence-chunk-2.md

Created 2026-08-24T17:11:12+00:00

In a 2023 Cureus study, GPT-3 produced 69 out of 178 (approximately 39%) incorrect or nonexistent DOIs.

Summary

In a 2023 Cureus study, GPT-3 got the DOI wrong or made one up entirely about 39% of the time (69 out of 178). That means any workflow relying on a language model to generate or verify citation identifiers should assume nearly 4 in 10 will be bad and needs an independent lookup step before anything downstream can trust the output.