Innovative intelligent interaction systems of loader cranes and their human operators

Abstract

An overview of the research on the design of interaction systems between lifting devices and their human operators equipped with a speech interface in a natural language, is presented, covering also the integration with augmented reality and interactive manipulators with force feedback. An innovative processing scheme, using several functional modules employing developed hybrid methods, for the interaction has been presented. The proposed design is based on an experimental implementation of the interactive speech-based complex system for controlling loader cranes. It features intelligent methods for meaning analysis of spoken natural languages, analysis and evaluation of command effects, assessment of command safety, and supporting decision-making processes.