We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less co... (more…)

In a previous post, I described teaching a humanoid to walk by imitating a fellow humanoid. Here I give my humanoid the capability to learn on its own. The humanoid’s only resources are the Proximal Policy Optimization algorithm, two randomly initialized ... (more…)

Wherein I take you on a journey through the sordid details of academic hardships (but in a fun way). I actually am curious if this is a better approach to he... (more…)

This paper attempts a preliminary analysis of the global desirability of different forms of openness in AI development (including openness about source code, science, data, safety techniques, capabilities,... (more…)

While China's trove of data may give it an advantage now, it may not be much of a long-term foothold on the climb to AI dominance. (more…)