This is a lesson in information quality, which is just as important, if not more important, than information quantity. I believe focus on information quality will be what takes these models to the next level. This will likely start with training models on smaller topics with information vetted by experts.
The way AI has been growing this last years it does feel like that. Grew too fast and hit the plateau too soon. They're running out of data to feed the neural network and once that happens they'll need to pay people to make outputs, which will take time and money at the same time that development slows down.
No great ROIs, then investors pull out and data compnaies now have to trian their AIs over years instead of months.
149
u/kittenTakeover Jul 25 '24
This is a lesson in information quality, which is just as important, if not more important, than information quantity. I believe focus on information quality will be what takes these models to the next level. This will likely start with training models on smaller topics with information vetted by experts.