The evaluation of business process predictive monitoring models usually focuses on accuracy of predictions. While accuracy aggregates performance across a set of process cases, in many practical scenarios decision makers are interested in the reliability of an individual prediction, that is, an indication of how likely is a given prediction to be eventually correct. This paper proposes a first definition of business process prediction reliability and shows, through the experimental evaluation, that metrics that include features defining the variability of a process case often give a better prediction reliability indication than metrics that include the probability estimation computed by the machine learning model used to make predictions alone.
CITATION STYLE
Comuzzi, M., Marquez-Chamorro, A. E., & Resinas, M. (2019). Does your accurate process predictive monitoring model give reliable predictions? In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 11434 LNCS, pp. 367–373). Springer Verlag. https://doi.org/10.1007/978-3-030-17642-6_30
Mendeley helps you to discover research relevant for your work.