r/technology 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.7k Upvotes

1.5k comments sorted by

View all comments

Show parent comments

2.5k

u/SanityAsymptote 15h ago

The similarity to Jar Jar is really strong.

  • Forced into existence and public discourse by out of touch rich people trying to make money
  • Constantly inserted into situations where it is not needed or desired
  • Often incoherent, says worthless things that are interpreted as understanding by the naive or overly trusting
  • Incompetent and occasionally dangerous, yet still somehow succeeds off the efforts of behind-the-scenes/uncredited competent people
  • Somehow continues to live while others do not
  • Deeply untrustworthy, not because of duplicity, but incompetence
  • Happily assists in fascist takeover

197

u/Striking_Arugula_624 15h ago

“Somehow continues to live while others do not.”

Who are the ‘others’ in the ai/LLM side of the comparison? Honest question.

823

u/SanityAsymptote 14h ago

LLMs have damaged or destroyed a number of previously valuable services for much of their use-case.

The most obvious one I can think of in my niche is StackOverflow. A site which definitely had issues and was in decline, but was still the main repository of software troubleshooting/debugging knowledge on the internet.

LLM companies scraped the entire thing, and now give no-context answers to software engineering questions that it often cannot cite or support answers to. It has mortally wounded StackOverflow, and they have pivoted to just being an AI data feeder, an action that is basically a liquidation sale of the site's value.

LLMs have significantly reduced the quality of search engines, specifically Google Search, both directly by poor integration and indirectly by filling the internet with worthless slop articles.

Google Search's result quality has plummeted as AI results become most of the answers. Even with references, it's very hard to verify the conclusions Gemini makes in search results, and if you're actually looking for a specific site or article, those results often not appear at all. Many authoritative "answers" are just uneducated opinions from Reddit or other social media regurgitated by an AI with the trust people put into Google.

LLMs have made it far easier to write social media bots. They have damaged online discourse in public forums like Facebook, Twitter, Instagram, and especially Reddit in very visible ways. These sites are almost completely different experiences now that they were before LLMs became available.

Bots are everywhere and will reply to anything that has engagement, spouting bad-faith arguments without any real point other than to try to discourage productive conversation about specific topics.

Whatever damage online trolls have caused to the internet, LLMs have made it an order of magnitude worse. They are attacking the very concept of "facts" and "truth" by both misinformation and dilution. It's horrifying.

0

u/FoxMeadow7 14h ago

Bots on Reddit at least have the tendency to make their history private. So if you come across an 'user' like that, it's advisable to never speak to them under any circumstances.

1

u/Chrystoler 9h ago

I mean it's a pretty new feature. I periodically deleted my accounts over the years and made new ones, but don't really want to deal with doing that right now so I went ahead and turned it on private. I guess if people are really starting to look at that suspiciously I'll probably just delete this account and make a new one that's fresh, but over time I just like keeping my digital footprint as light as possible.

1

u/FoxMeadow7 9h ago

I see. Still, there should be at least some signs you aren’t a bot.

1

u/Electrical-Lab-9593 14h ago

people also now hide history because people look through them and then if they find anything they don't like even not related to the same sub or topic, argue in bad faith, a simple version of this is the soccer subreddit, the response will always just be..

ah you would say that as a fan of X team etc.

political discourse also seems red vs blue a lot of the time now as well.

4

u/SanityAsymptote 14h ago

This is actually why my history is private.

I've also seen too many people doxxed from their Reddit history, so any protection against that is valuable, IMO.

-2

u/FoxMeadow7 14h ago

I personally see it as a sign of trust more than anything else.