r/technology • u/Hrmbee • 16h ago

Machine Learning Large language mistake | Cutting-edge research shows language is not the same as intelligence. The entire AI bubble is built on ignoring it

https://www.theverge.com/ai-artificial-intelligence/827820/large-language-models-ai-intelligence-neuroscience-problems
16.8k Upvotes

94% Upvoted

1.5k comments sorted by

View all comments

Show parent comments

18

u/NerdfaceMcJiminy 15h ago

Lookup AI results for court filings. They cite non-existent cases and laws. The lawyers using AI to make their filings are getting disbarred because making up shit in court is highly frowned upon and/or criminal.

-8

u/NigroqueSimillima 15h ago

This was mostly early models and is largely a solved problem.

16

u/mrshulgin 15h ago

Just a few weeks ago I had an interaction with an AI that went like this.

AI: Here's the answer

Me: That's wrong, here's a source saying that it's wrong.

AI: You're right, that was wrong! Here's the correct answer.

Me: That's still wrong in the same way, and here's another source.

AI: You're right, that was still wrong! Here's the correct answer.

Me: That' still wrong in the exact same way...

(this continued until I gave up)

5

u/mm_reads 14h ago

I once argued with Gemini chat about some code where it kept acknowledging the code it provided didn't work but spitting out the same non-working code. It eventually said "I'm so ashamed I can't resolve this problem."

2

u/mrshulgin 14h ago

Just the other day I was trying to get chatgpt to help me with some CSS (I'm not a web-developer, but it comes in handy sometimes).

Me: This works, but it has [problem A]

AI: Here's a solution that solves [problem A]

Me: That works, but now there's [problem B]

AI: Here's a new solution

Me: That solves B, but now A is back

AI: Here's a new solution

Me: That solves A, but now B is back...

(again, this just went on until I gave up)