Retrospective evaluation of landslide susceptibility maps and review of validation practice

Abstract

Despite the widespread application of landslide susceptibility analyses, there is hardly any information about whether or not the occurrence of recent landslide events was correctly predicted by the relevant susceptibility maps. Hence, the objective of this study is to evaluate four landslide susceptibility maps retrospectively in a landslide-prone area of the Swabian Alb (Germany). The predictive performance of each susceptibility map is evaluated based on a landslide event triggered by heavy rainfalls in the year 2013. The retrospective evaluation revealed significant variations in the predictive accuracy of the analyzed studies. Both completely erroneous as well as very precise predictions were observed. These differences are less attributed to the applied statistical method and more to the quality and comprehensiveness of the used input data. Furthermore, a literature review of 50 peer-reviewed articles showed that most landslide susceptibility analyses achieve very high validation scores. 73% of the analyzed studies achieved an area under curve (AUC) value of at least 80%. These high validation scores, however, do not reflect the high uncertainty in statistical susceptibility analysis. Thus, the quality assessment of landslide susceptibility maps should not only comprise an index-based, quantitative validation, but also an additional qualitative plausibility check considering local geomorphological characteristics and local landslide mechanisms. Finally, the proposed retrospective evaluation approach cannot only help to assess the quality of susceptibility maps and demonstrate the reliability of such statistical methods, but also identify issues that will enable the susceptibility maps to be improved in the future.