GISB: A benchmark for geographic map information extraction

Abstract

The growing number of different models and approaches for Geographic Information Systems (GIS) brings high complexity when we want to develop new approaches and compare a new GIS algorithm. In order to test and compare different processing models and approaches, in a simple way, we identified the need of defining uniform testing methods, able to compare processing algorithms in terms of performance and accuracy regarding: large imaging processing, algorithms for GIS pattern-detection. Taking into account, for instance, images collected during a drone flight or a satellite, it is important to know the processing cost to extract data when applying different processing models and approaches, as well as their accuracy (compare execution time vs. extracted data quality). In this work we propose a GIS Benchmark (GISB), a benchmark that allows to evaluate different approaches to detect/extract selected features from a GIS data-set. Considering a given data-set (or two data-sets, from different years, of the same region) it provides linear methods to compare different performance parameters regarding GIS information, making possible to access the most relevant information in terms of features and processing efficiency.