Neural Network Algorithm with Dropout Using Elite Selection

2Citations
Citations of this article
8Readers
Mendeley users who have this article in their library.

Abstract

A neural network algorithm is a meta-heuristic algorithm inspired by an artificial neural network, which has a strong global search ability and can be used to solve global optimization problems. However, a neural network algorithm sometimes shows the disadvantage of slow convergence speed when solving some complex problems. In order to improve the convergence speed, this paper proposes the neural network algorithm with dropout using elite selection. In the neural network algorithm with dropout using elite selection, the neural network algorithm is viewed from the perspective of an evolutionary algorithm. In the crossover phase, the dropout strategy in the neural network is introduced: a certain proportion of the individuals who do not perform well are dropped and they do not participate in the crossover process to ensure the outstanding performance of the population. Additionally, in the selection stage, a certain proportion of the individuals of the previous generation with the best performance are retained and directly enter the next generation. In order to verify the effectiveness of the improved strategy, the neural network algorithm with dropout using elite selection is used on 18 well-known benchmark functions. The experimental results show that the introduced dropout strategy improves the optimization performance of the neural network algorithm. Moreover, the neural network algorithm with dropout using elite selection is compared with other meta-heuristic algorithms to illustrate it is a powerful algorithm in solving optimization problems.

References Powered by Scopus

Optimization by simulated annealing

34732Citations
N/AReaders
Get full text

Differential Evolution - A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces

23963Citations
N/AReaders
Get full text

Ant system: Optimization by a colony of cooperating agents

10481Citations
N/AReaders
Get full text

Cited by Powered by Scopus

An Enhanced Neural Network Algorithm with Quasi-Oppositional-Based and Chaotic Sine-Cosine Learning Strategies

2Citations
N/AReaders
Get full text

Fractional Order PID Controller Based-Neural Network Algorithm for LFC in Multi-Area Power Systems

0Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Wang, Y., Wang, K., & Wang, G. (2022). Neural Network Algorithm with Dropout Using Elite Selection. Mathematics, 10(11). https://doi.org/10.3390/math10111827

Readers' Seniority

Tooltip

Lecturer / Post doc 3

100%

Readers' Discipline

Tooltip

Business, Management and Accounting 1

50%

Computer Science 1

50%

Save time finding and organizing research with Mendeley

Sign up for free