Facebook’s latest giant language AI hits computing wall at 500 Nvidia GPUs

Facebook AI research’s latest breakthrough in natural language understanding, called XLM-R, performs cross-language tasks with 100 different languages including Swahili and Urdu, but it’s also running up against the limits of existing computing power. Read more

Similar

“Software without AI will be unthinkable.”

A speech bubble emerges from Darth Vader’s helmet, announcing Klue’s three alliterative tenets: “Fast, Flowy, Friendly”. In the company’s brightly-lit Vancouver office, a cut out of the helmet - along with its surprisingly unmenacing utterance – is pinned... (more…)

Read more »