People have been dreaming of robot butlers for decades, but one of the biggest barriers has been getting machines to understand our instructions. Google has started to close the gap by marrying the latest language AI with state-of-the-art robots.

Human language is often ambiguous. How we talk about things is highly context-dependent, and it typically requires an innate understanding of how the world works to decipher what we’re talking about. So while robots can be trained to carry out actions on our behalf, conveying our intentions to them can be tricky.

If they have any ability to understand language at all, robots are typically designed to respond to short, specific instructions. More opaque directions like “I need something to wash these chips down” are likely to go over their heads, as are complicated multi-step requests like “Can you put this apple back in the fridge and fetch the chocolate?”

In contrast, a new breed of massive language models inspired by Open AI’s groundbreaking GPT-3 are capable of some impressive linguistic feats. By training on enormous amounts of written material scraped from the web, these AI systems are able to generate high-quality prose, power convincing chatbots, and answer complicated questions about text.