Using a hybrid neural network model dcnn–lstm for image-based nitrogen nutrition diagnosis in muskmelon

Abstract

In precision agriculture, the nitrogen level is significantly important for establishing pheno-type, quality and yield of crops. It cannot be achieved in the future without appropriate nitrogen fertilizer application. Moreover, a convenient and real-time advance technology for nitrogen nutrition diagnosis of crops is a prerequisite for an efficient and reasonable nitrogen-fertilizer management system. With the development of research on plant phenotype and artificial intelligence technology in agriculture, deep learning has demonstrated a great potential in agriculture for recognizing nonde-structive nitrogen nutrition diagnosis in plants by automation and high throughput at a low cost. To build a nitrogen nutrient-diagnosis model, muskmelons were cultivated under different nitrogen levels in a greenhouse. The digital images of canopy leaves and the environmental factors (light and temperature) during the growth period of muskmelons were tracked and analyzed. The nitrogen concentrations of the plants were measured, we successfully constructed and trained machine-learning-and deep-learning models based on the traditional backpropagation neural network (BPNN), the emerging convolution neural network (CNN), the deep convolution neural network (DCNN) and the long short-term memory (LSTM) for the nitrogen nutrition diagnosis of muskmelon. The ad-justed determination coefficient (R2 ) and mean square error (MSE) between the predicted values and measured values of nitrogen concentration were adopted to evaluate the models’ accuracy. The values were R2 = 0.567 and MSE = 0.429 for BPNN model; R2 = 0.376 and MSE = 0.628 for CNN model; R2 = 0.686 and MSE = 0.355 for deep convolution neural network (DCNN) model; and R2 = 0.904 and MSE = 0.123 for the hybrid model DCNN–LSTM. Therefore, DCNN–LSTM shows the highest accuracy in predicting the nitrogen content of muskmelon. Our findings highlight a base for achieving a convenient, precise and intelligent diagnosis of nitrogen nutrition in muskmelon.