Fusing Convolutional Neural Network Features with Hand-Crafted Features for Objective Fabric Smoothness Appearance Assessment

Abstract

In the textile and apparel industry, it remains a challenging task to evaluate the fabric smoothness appearance objectively. In existing studies, with computer vision technology, researchers use the hand-crafted image features and deep convolutional neural network (CNN) based image features to describe the fabric smoothness appearance. This paper presents an image classification framework to evaluate the fabric smoothness appearance degree. The framework contains a feature fusion module to fuse the hand-crafted and CNN features to take both advantages of them. The framework uses the multi-scale spatial masking model and a pre-trained CNN to extract hand-crafted and CNN features of fabric images respectively. In addition, a mislabeled sample filtering module is set in the framework, which helps to avoid the negative impact of mislabeled samples in training. In the experiments, the proposed framework achieves 85.2%, 96.1%, and 100% average evaluation accuracies under errors of 0 degree, 0.5 degree, and 1 degree respectively. The experiments on the feature fusion and mislabeled sample filtering verified their effectiveness in improving the evaluation accuracies and the label noise robustness. The proposed method outperforms the state-of-the-art methods for fabric smoothness assessment. Promisingly, this paper can provide novel research ideas for image-based fabric smoothness assessment and other similar tasks.