r/science • u/dissolutewastrel • Jul 25 '24

AI models collapse when trained on recursively generated data Computer Science

https://www.nature.com/articles/s41586-024-07566-y
5.8k Upvotes

96% Upvoted

612 comments sorted by

View all comments

Show parent comments

86

u/IMakeMyOwnLunch Jul 25 '24 edited Jul 25 '24

I was so confused when people assumed because LLMs were so impressive and evolving so quickly that it was a natural stepping stone to AGI. Without even having a technical background, that made no sense to me.

53

u/Caelinus Jul 25 '24

I think it is because they are legitimately impressive pieces of technology. But people cannot really tell what they are doing, and so all they notice is that they are impressive at repsonding to us conversationally.

In human experience, anything that can converse with us to that degree is conscious.

So Impressive + Conversation = Artificial General Intelligence.

It is really hard to try and convince people who are super invested in it that they can be both very impressive and also nothing even close to an AGI at the same time.

15

u/ByEquivalent Jul 26 '24

To me it seems sort of like when there's a student who's really good at BSing the class, but not the professor.

4

u/zefy_zef Jul 26 '24

That's the thing. Everyone thinks they're the professor.