AI Articles, Tutorials & News

AI

AI Alignment Newsletter

I edit and write content for the Alignment Newsletter, a weekly publication with recent content relevant to AI alignment with over 2000 subscribers. It turns out that people don’t notice thin…

Read more »
AI

Microsoft’s ZeRO-2 Speeds up AI Training 10x

Microsoft open-sourced Zero Redundancy Optimizer version 2 (ZeRO-2), a distributed deep-learning optimization algorithm that scales super-linearly with cluster size. Using ZeRO-2, Microsoft trained a 100-billion-parameter natural-language processing (NLP)…

Read more »