Towards an architecture combining grounding and planning for human-robot interaction

Abstract

We consider here the problem of connecting natural language to the physical world for robotic object manipulation. This problem needs to be solved in robotic reasoning systems so that the robot can act in the real world. In this paper, we propose an architecture that combines grounding and planning to enable robots to solve such a problem. The grounding system of the architecture grounds the meaning of a natural language sentence in physical environment perceived by the robot’s sensors and generates a knowledge base of the physical environment. Then the planning system utilizes the knowledge base to infer a plan for object manipulation, which can be effectively generated by an Answer Set Programming (ASP) planner. We evaluate the overall architecture on several datasets and a task of RoboCup2014@home (http://www.robocup2014. org/). The results show that the new architecture outperformed some other systems, and yielded acceptable performance in a real-world scenario.