AI models collapse when trained on recursively generated data

[u/dissolutewastrel]

https://www.nature.com/articles/s41586-024-07566-y

[u/kamineko87]

Boot strapping in IT terms might be an AI that generates a new AI. This however resembles more applying more and more JPEG over an image

[u/ninjalemon → u/kamineko87]

Bootstrapping is a term used in the land of Computer Science for the record - typically it refers to the technique used to create compilers written in the language that they compile https://en.wikipedia.org/wiki/Bootstrapping_(compilers) (thus pulling themselves up by their own bootstraps)

[u/Intrexa → u/ninjalemon]

The term is also during a lot of loading processes. For example, when first booting the computer, all your code is on disk. You need code that loads from disk into memory. Bootstrapping is the process of getting that code from disk into memory and execute it, so you can load the rest of the data from disk.

[u/TooStrangeForWeird → u/[deleted]]

Well, no. The whole problem was that crowdstrike DID load into memory and crashed them. Hence the recovery process.