The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence

Recent research in artificial intelligence and machine learning has largely
emphasized general-purpose learning and ever-larger training sets and more and
more compute. In contrast, I propose a hybrid, knowledge-driven,
reasoning-based approach, centered … Read more


Open AI: Deep Double Descent

We show that the double descent phenomenon occurs in CNNs, ResNets, and transformers: performance first improves, then gets worse, and then improves again with increasing model size, data size, or training time. This effect is often avoided through carefu... (more…)

Read more »