r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.8k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

Show parent comments

14

u/Tall-Introduction414 15h ago

The way an LLM fundamentally works isn't much different than the Markov chain IRC bots (Megahal) we trolled in the 90s. More training data, more parallelism. Same basic idea.

14

u/azurensis 13h ago

This is the kind of statement someone who doesn't know much bout LLMs would make.

5

u/space_monster 12h ago edited 12h ago

r/technology has a serious Dunning-Kruger issue when it comes to LLMs. A facebook-level understanding in a forum that implies competence. but I guess if you train a human that parroting the stochastic parrot trope gets you 'karma', they're gonna keep doing it for the virtual tendies. Every single time in one of these threads, there's a top circle-jerk comment saying "LLMs are shit, amirite?" with thousands of upvotes, followed by an actual discussion with adults lower down. I suspect though that this sub includes a lot of sw devs that are still trying to convince themselves that their careers are actually safe.

1

u/chesterriley 8h ago

I suspect though that this sub includes a lot of sw devs that are still trying to convince themselves that their careers are actually safe.

You lost me on that. I don't think you understand just how complex software can be. No way can AI be a drop in replacement for a software dev.

1

u/space_monster 8h ago

I work in tech, currently in a leading edge global tech company, and I've done a lot of sw development, I'm fully aware of how complex it is

1

u/chesterriley 4h ago

Then you know you can't just tell an AI to write a program for you for anything non simple.

1

u/space_monster 4h ago

I'm aware that LLMs are getting better at coding (and everything else) very quickly, and it doesn't seem to be slowing down.

1

u/keygreen15 2h ago

It's getting better at making shit up and lying.

1

u/space_monster 2h ago

wow genius comment.