A Comprehensive Review and Benchmarking of Fairness-Aware Variants of Machine Learning Models

Abstract

Fairness is a fundamental virtue in machine learning systems, alongside with four other critical virtues: Accountability, Transparency, Ethics, and Performance (FATE + Performance). Ensuring fairness has been a central research focus, leading to the development of various mitigation strategies in the literature. These approaches can generally be categorized into three main techniques: pre-processing (modifying data before training), in-processing (incorporating fairness constraints during training), and post-processing (adjusting outputs after model training). Beyond these, an increasingly explored avenue is the direct modification of existing algorithms, aiming to embed fairness constraints into their design while preserving or even enhancing predictive performance. This paper presents a comprehensive survey of classical machine learning models that have been modified or enhanced to improve fairness concerning sensitive attributes (e.g., gender, race). We analyze these adaptations in terms of their methodological adjustments, impact on algorithmic bias and ability to maintain predictive performance comparable to the original models.