That AI tool I tried hallucinated an entire source

Was testing a new chatbot for work last week. Asked it to summarize a study from 2022. Gave me a real-sounding author name and journal. Looked it up. Never existed. The whole citation was made up. How are people trusting these things for anything important? Has anyone else had a tool just invent references out of thin air?

2 comments

2 Comments

evannelson21d ago

Nah, that's super common with these language models. They're basically designed to sound confident even when they're completely wrong, so you gotta double check everything.

oscar_hunt6121d ago

I mean, @evannelson, I kind of see it the other way since they're just tools that need fact-checking.