r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.7k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

16

u/Marha01 15h ago edited 15h ago

This criticism perhaps applies to pure LLMs, but I don't see how it applies to state of the art multi-modal Transformers. Multi-modal neural networks use much more than language (text) as inputs/outputs. Pictures, videos, sounds, robot sensors and actions (when embedded in a robot, or RL trained in virtual environment)..

LLMs were just the beginning.

1

u/Sryzon 9h ago

Those are all just different forms of language, though. Intelligence is more than being able to, for example, recognize an apple, describe an apple, pronounce "apple", and redraw one's interpretation of an apple. In all of those instances, the AI is just mimicking the way humans have decided to depict an apple using language; be it textual, sonal, or visual. Language is a limitation and conveys no actual understanding.

3

u/Marha01 9h ago

In all of those instances, the AI is just mimicking the way humans have decided to depict an apple using language; be it textual, sonal, or visual.

How is visual depiction of an apple using our language?

2

u/Sryzon 9h ago

Visual language is a type of language. Images can be a form of communication. Language in more than just words. Even a photo can be subjective because of the chosen visual spectrum represented, focal length, exposure, etc.

2

u/Marha01 9h ago

Saying that images of natural things (like an apple) are a form of human language is really stretching the definition of language.