Ilya Sutskever – We're moving from the age of scaling to the age of research

<p>Ilya & I discuss SSI’s strategy, the problems with pre-training, how to improve the generalization of AI models, and how to ensure AGI goes well.</p><p>Watch on <a target="_blank" href="https://youtu.be/aR20FWCCjAs">YouTube</a>; read the <a target="_blank" href="https://www.dwarkesh.com/p/ilya-sutskever-2">transcript</a>.</p><p>Sponsors</p><p>* <a target="_blank" href="https://gemini.google">Gemini 3</a> is the first model I’ve used that can find connections I haven’t anticipated. I recently wrote a blog post on RL’s information efficiency, and Gemini 3 helped me think it all through. It also generated the relevant charts and ran toy ML experiments for me with zero bugs. Try Gemini 3 today at <a target="_blank" href="https://gemini.google">gemini.google</a></p><p>* <a target="_blank" href="https://labelbox.com/dwarkesh">Labelbox</a> helped me create a tool to transcribe our episodes! I’ve struggled with transcription in the past because I don’t just want verbatim transcripts, I want...