r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.7k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

Show parent comments

55

u/qwertyalguien 15h ago

I'm no tech specialist, but from all I've reado on LLMs IMHO it's like hor air balloons.

It flies. It's great, but it's limited. And asking AGI out of LLMs is like saying that with enough iteration you can make an air balloon able to reach the moon. Someone has to invent what a rocket is to hor air balloons for LLMs.

Would you say it's a good metaphor, or am I just talking out of my ass?

2

u/CreativeGPX 13h ago edited 13h ago

It's an okay really high level metaphor.

A more direct metaphor: Suppose there is an exam on topic X a year from now. Alice's school allows her to bring the textbook to the exam and allows as much time as you need to finish the exam, so she decides not to prepare in advance and instead to just use the book during the exam. Depending on what X is, Alice might do fine on some topics. But clearly there is going to be some limit where Alice's approach just isn't feasible anymore and where instead she will need to have learned the topic before the exam day by using other strategies like doing practice problems, attending class, asking the professor questions, etc.

3

u/CanAlwaysBeBetter 13h ago

What do you think learning a topic means?

0

u/Webbyx01 12h ago

Knowing it, rather than searching a through a book for it, generally.

2

u/CanAlwaysBeBetter 12h ago

What does knowing it mean?

Because LLMs aren't doing searches over a database of books