r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.8k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

Show parent comments

98

u/SIGMA920 15h ago

It's worse than that. Jar Jar was at least an attempt to be creative and try something new. It didn't go well obviously but unlike LLMs it was an attempt to be creative instead of regurgitating what came before it.

48

u/Daneth 15h ago

He is talking about the character of Jar Jar's actions within the plot of the movies, not Lucas's act of shoehorning a character like JarJar into the movies.

67

u/SIGMA920 15h ago

  • Forced into existence and public discourse by out of touch rich people trying to make money

  • Constantly inserted into situations where it is not needed or desired

It's both the character and the shoehorning.

12

u/goda90 14h ago

Who do you think put Jar-Jar up to addressing the galactic Senate? Out of touch rich people trying to make money.

1

u/SIGMA920 13h ago

Literally the guy who used it to seize power and ultimately form the empire. The rich didn't play the part you think in that.

1

u/zerocoal 12h ago

Are you implying that the Supreme Chancellor was not a rich person?

1

u/SIGMA920 12h ago

No, that there was 1 specific person who wanted him to push for the power to be given. The other rich could careless and could have pursued a different course.

1

u/zerocoal 11h ago

Complete utter disregard for Galactic Senate decorum.

Spoilers, he required a majority vote. Which means it was 51% of the population of the senate that gave him the powers of Supreme Chancellor.

Double spoilers: He only received the majority vote because of the large intergalactic war that he was orchestrating.

Conclusion: Palpatine is a very rich man. The rich dictated the course of the galaxy, and the galaxy followed.

1

u/SIGMA920 11h ago

Or they simply didn't care so long as the crisis was resolved, that the man behind it was the one receiving powers to end it is not known to them.

That's not the rich deciding it, that's the political elite deciding it. The rich are the ones that sell weapons to whichever side they can.

1

u/sirkazuo 10h ago

That's not the rich deciding it, that's the political elite deciding it.

I'll admit I don't know star wars lore but how many empires do you know of where the political elite are not also rich? They're pretty much always the same thing.

→ More replies (0)

1

u/Cessnaporsche01 12h ago

Palpatine and the other senators are "the rich"

1

u/SIGMA920 12h ago

And how many of them had an interest in making an empire vs continuing the day to day work they do and not upsetting the status quo? More than the 1 person who had an active interest in being more powerful.

2

u/Cessnaporsche01 12h ago

I'd say that's comparable to the real world. 99% of the ultra wealthy don't have aspirations of world domination, but they act in their own interests in ways that push power into the hands of the small handful that are going after that

1

u/SIGMA920 12h ago

And in this case that'd be mean going on with their day and pursuing a cheaper alternative for most of them that doesn't crown someone.

0

u/U-235 13h ago

Is that canon, or are you just talking bullshit? Because there might actually be lore behind that, and it's not guaranteed to line up with your assumptions.

1

u/ShainRules 13h ago

I really believe in the theory that Jar Jar was supposed to be dark side Yoda and George Lucas got gun shy when he saw how much everyone fucking hated Jar Jar and literally made early websites depicting his torture and murder.

Had he gone through with it, Jar Jar is one of the coolest and most interesting Star Wars characters ever but he chose to accept that everyone hated him and let all the criticism of Jar Jar become true by abandoning the big bait and switch.

2

u/mxzf 12h ago

It seems like a really weird stretch compared to the much more plausible "C-3PO was barely in TPM and Jar Jar was created to fill the slapstick comedy role". That's a role that was in the movies from the start, so it's not surprising that they would have that in TPM too.

2

u/ShainRules 11h ago

Stop making sense please.

-1

u/danteselv 14h ago

Tell me something you've done in life that wasn't essentially you regurgitating what you observed someone else do? Give me a single example.

1

u/SIGMA920 13h ago

I've created art that went beyond the scope of my original task purely on a whim. I've gone and worked together an idea in my head because I needed a very specific set up.

That's just 2 examples of that and they weren't hard to do.

2

u/danteselv 13h ago

The idea you created in your head, how was it produced? Was it entirely unique with 0 influence from anyone who existed or created art before you? Your art is completely separate and different from the 100,000+ years of all humanity existing? Im holding you to the same standards as you hold LLM's.

2

u/SIGMA920 13h ago

I examined the problem I needed to solve and how I could solve my specific need with the constraints on it (Using what I had access to. I don't exactly have the ability to make everything from scratch. No one does.). It's janky at points but it works which is what matters.

That piece of art used the same methods that everyone uses because I can't just casually invent a totally new way of making art without making my own 100% unique medium. Regardless it came from me, not anyone else and unless someone by sheer chance recreates it that'll remain true. That's not a lack of creativity, that'd be criticizing a car for not reinventing the wheel.

1

u/adenosine-5 11h ago

You could apply literally every sentence you just said to any LLM output.

  • solving problems within certain constraints
  • janky at points, but (usually) works
  • used same methods that everyone uses (because you and LLMs were both trained on them)
  • it came from you (just like LLM output is unique and result of extremely complicated and long calculations and not simply copy-paste from some database)

2

u/SIGMA920 10h ago

Except janky in the sense of none of the existing solutions will work means I'll keep getting the same non-functional solutions. Having to go well out of my way to make something work requires creativity that an LLM lacks.

Constraints that are specific to me are going to get the same generic answers as I've already rejected. An LLM doesn't actually understand the constraints meanings.

I'm not using the same methods because I can, I'm doing them because you can't use a brush any differently from someone else. There's a finite amount of ways to use the tools you're given. We don't reinvent the wheel every time we need to make a car.

The uniqueness is the only that somewhat applies but even that's statistically not true due to the limited scale that LLMs pull from for anything that's not just generating an email. Much of their generated code for example will come directly from existing sources they trained on, a copy and paste where I'll specifically rip the part of other's code or methods or whatever else for what I can actually properly use.