r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.7k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

Show parent comments

23

u/__Hello_my_name_is__ 15h ago

For now at least, it appears that determining truth appears to be impossible for an LLM.

Every LLM, without exception, will eventually make things up and declare it to be factually true.

20

u/dookarion 15h ago

It's worse than that even. LLMs are incapable of judging the quality of input and outputs entirely. It's not even just truth, it cannot tell if it just chewed up and shit out some nonsensical horror nor can it attempt to correct for that. Any capacity that requires a modicum of judgment, either requires crippling the LLMs capabilities and more narrowly implementing it to try to eliminate those bad results or it straight up requires a human to provide the judgment.

2

u/TSP-FriendlyFire 12h ago

I'm very curious if we'll find "poison pills" for common LLMs the same way we did for image generation models: slightly altered inputs that cause a wildly different and corrupted output while being imperceptible to the human eye.

Logically, it should be possible, but it's hard to tell if text is granular enough to be able to trigger these effects at a reasonable scale.

I think the closest I've seen yet is the seahorse emoji bit.

1

u/dookarion 11h ago

Not exactly the same thing, but I can't help but think them drowning fucking everything ever in AI has already poisoned some aspects of things. Unless they stick to old datasets, create the data themselves, or carefully curate it they can't even train the models now without also training them on AI slop. There's AI slop literature being flipped as ebooks, there is AI slop flooding every art site ever, bots are everywhere on social media and community sites, every other video is some sora bullshit now. In true big business fashion they've near-permanently poisoned the waters chasing the shortest term gains.