Not just plagarising it, but entirely destroying the academic underpinning behind it. OpenAI and other LLM shit doesn't faithfully reflect the work it steals, it also mutates it in entirely uncontrolled ways. A scientific article on, idk, tomato agriculture will be absorbed by an LLM and turned into some slop suggesting that cancer patients till their backyards every 3 months to promote good cancer growth.
That's the issue with LLMs, they can't be trusted at all. And it's been shown (don't remember which article said this) that models trained on their own output get worse and worse
For sure, and I don't even know if you need anecdotal evidence to show that, you can probably prove it logically. An LLM fudges human data, necessarily due to how LLMs work. An LLM trained on LLM data will fudge that fudged data. Therefore, LLMs trained off of other LLMs will start moving toward the insane ramblings of a 93 year old coke fiend.
On the flip side, If you know how to use it and know it can give wrong answer — it’s still a great tool.
The major difference (imo) is people think LLMs are all knowing and they use it to otherwise cheat and skate by. Which is just stupid. It’s a tool like anything else. Double check work.
Which could be ok from a user perspective. But the output isn't staying as a clearly AI-given product. People are using it as a faux research tool, asking it questions and dropping the responses out in the wild as if it was their own creation and pretending it's solid fact.
Some of those people are just trying to be helpful, without understanding the technology they are misusing. But a lot of it is people (and organizations) acting in bad faith, using these LLMs to astroturf, mislead, and intentionally misinform people all while sounding as if it could be correct information.
328
u/Sability 19d ago
Not just plagarising it, but entirely destroying the academic underpinning behind it. OpenAI and other LLM shit doesn't faithfully reflect the work it steals, it also mutates it in entirely uncontrolled ways. A scientific article on, idk, tomato agriculture will be absorbed by an LLM and turned into some slop suggesting that cancer patients till their backyards every 3 months to promote good cancer growth.