It is hard to remember that Ilya previously chatted with Dwarkesh the month before GPT-4's release. Many things have changed since then.
Most of the comments are subtle, but it's clear that Ilya is searching for breakthroughs in knowledge generalization and continual learning, and he expects this research to take 5–20 years.
As with all Ilya appearances, this one is too short and barely scratches the surface.