Facebook’s latest giant language AI hits computing wall at 500 Nvidia GPUs

Facebook AI research’s latest breakthrough in natural language understanding, called XLM-R, performs cross-language tasks with 100 different languages including Swahili and Urdu, but it’s also running up against the limits of existing computing power. Read more

Similar