Tutorial: How to Code and Understand DeepMind’s Synthetic Gradients (in Python)

TLDR: In this blogpost, we’re going to prototype (from scratch) and learn the intuitions behind DeepMind’s recently proposed Decoupled Neural Interfaces Using Synthetic Gradients paper. Read more

Similar

Customizing class creation in Python

When one thinks of ways of customizing classes at creation time, people probably typically think of metaclasses and class decorators. Metaclasses are at typically viewed as the beginning of class creation while class decorators are at the end. But what yo... (more…)

Read more »