A team of scientists at LMU Munich have developed Pattern-Exploiting Training (PET), a deep-learning training technique for natural language processing (NLP) models. Using PET, the team trained a Transformer NLP model with 223M parameters that out-perform... (more…)

When tuned up, old algorithms can match the abilities of their successors... (more…)

Your weekly curation of 4 impactful future-oriented stories. (more…)

The eventual goal is to help illiterate people to program. (more…)

John Carmack has stepped down as CTO of Oculus to pursue the problem of artificial intelligence while working from home. (more…)