Hidden Feedback Loops in Machine Learning Systems: A Simulation Model and Preliminary Results

Abstract

In this concept paper, we explore some of the aspects of quality of continuous learning artificial intelligence systems as they interact with and influence their environment. We study an important problem of implicit feedback loops that occurs in recommendation systems, web bulletins and price estimation systems. We demonstrate how feedback loops intervene with user behavior on an exemplary housing prices prediction system. Based on a preliminary model, we highlight sufficient existence conditions when such feedback loops arise and discuss possible solution approaches.