A simulation-based procedure for expert system evaluation

Abstract

It is well recognized that the evaluation of the knowledge-based system is very important and difficult in the development of expert systems in the domains such as aviation and navigation. To alleviate some of the difficulties, and to reduce the development cost, the authors proposed an evaluating procedure based on simulation. The proposed procedure was designed to validate the functionality and capability of an expert system that was developed to provide decision-making support in ship navigation. In this paper, the developed expert system for collision avoidance is first outlined, and the procedure to evaluate the developed expert system by using a simulationbased approach is presented in details. It is also concluded that the simulationbased procedure is feasible and effective for evaluating expert systems in a number of different domains.