We present a methodology for enabling mobile service robots to follow natural language instructions for object pick-and-place tasks from nonexpert users, with and without user-specified constraints, and with a particular focus on spatial language understanding. Our approach is capable of addressing both the semantic and pragmatic properties of object movement-oriented natural language instructions, and in particular, proposes a novel computational field representation for the incorporation of spatial pragmatic constraints in mobile manipulation task planning. The design and implementation details of our methodology are also presented, including the grammar utilized and our procedure for pruning multiple candidate parses based on context. The paper concludes with an evaluation of our approach implemented on a simulated mobile robot operating in both 2D and 3D home environments. © Springer International Publishing 2013.
CITATION STYLE
Fasola, J., & Matarić, M. J. (2013). Using spatial semantic and pragmatic fields to interpret natural language pick-and-place instructions for a mobile service robot. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 8239 LNAI, pp. 501–510). https://doi.org/10.1007/978-3-319-02675-6_50
Mendeley helps you to discover research relevant for your work.