I will discuss our approach to building a personal assistant in Minecraft, and the opportunities it presents for geometric deep learning.