Automated detecting, segmenting and measuring of grains in images of fluvial sediments: The potential for large and precise data from specialist deep learning models and transfer learning

Abstract

The size of sedimentary particles in rivers bears information on the sediment entrainment or deposition mechanisms and the hydraulic conditions controlling them. However, collecting such data from coarse-grained sediments is work intensive, both in the field and remotely. Therefore, attention has turned to machine learning models to improve the data acquisition. Despite their success, current methods need large quantities of data and yield results limited to a few percentile values of grain size datasets, often additionally affected by a systematic bias. In most cases, the root of these limitations is the challenge of accurately segmenting grains. Here, we present a new approach to improve the segmentation of individual grains based on the capacity of transfer learning in convolutional neural networks. Specifically, we re-train a state-of-the-art model for cell segmentation in biomedical images to find and segment coarse-grained particles in images of fluvial sediments. Our results show that the performance in the segmentation tasks can be directly transferred to images of fluvial sediments and that our re-trained models outperform existing methods. We document that our results are achievable with only 10%–20% of the data needed for training other deep learning models designed to measure the size of fluvial sediments. Moreover, we find that traits in our data control the segmentation performance. This enables data-driven approaches to create specialist segmentation models. Additionally, comparing our automatically obtained datasets with the results retrieved from image and field-based surveys confirms that improvements in segmentation are directly leading to more precise and more accurate grain size data even if data collection occurs in images taken at different conditions. Finally, we release a software package, the trained models and our data. The goal is to offer a tool to efficiently segment and measure grains in sediment images in an automated way, which can be adapted to different settings.