Ilya Sutskever's Bombshell at NeurIPS: Pre-training is Over, Data Squeezing is Finished

Ilya Sutskever’s shocking statement at NeurIPS 2024: the end of pre-training and data exhaustion. The AI industry must adapt to new models beyond large-scale pre-training.

"Reasoning is unpredictable, so we must start with incredible, unpredictable AI systems."

Ilya finally made his appearance, and he began with astonishing words.

This Friday, Ilya Sutskever, the former Chief Scientist of OpenAI, stated at the global AI summit, "The data we can obtain has reached its peak, and there will be no more."

Ilya Sutskever, co-founder and former Chief Scientist of OpenAI, left the company in May this year to start his own AI lab, Safe Superintelligence, making headlines.

Since leaving OpenAI, he has stayed out of the media, but this Friday, he made a rare public appearance at the NeurIPS 2024 conference in Vancouver.

"We are undoubtedly at the end of pre-training as we know it," Sutskever said on stage.