BOLT - Broad Operational Language Translation

Using an Interactive Robotic System to Ground Language in the Real World

I work on a portion of the DARPA-funded BOLT project that focuses on learning language using sensory data obtained by a robotic system. Our system uses a robotic arm to interact with objects in its environment. The robot learns object properties by seeing, touching, and moving the object. Interaction with a human mentor helps the robot connect human language to the properties it has discovered.