Deep learning is a state-of-the-art learning method that is used in fields such as visual object recognition and speech recognition. This learning uses a large number of layers and a huge number of units and connections, so overfitting occurs. Dropout learning is a kind of regularizer that neglects some inputs and hidden units in the learning process with a probability p; then, the neglected inputs and hidden units are combined with the learned network to express the final output. We compared dropout learning and ensemble learning from three viewpoints and found that dropout learning can be regarded as ensemble learning that divides the student network into two groups of hidden units. From this insight, we explored novel dropout learning that divides the student network into more than two groups of hidden units to enhance the benefit of ensemble learning.
CITATION STYLE
Hara, K., Saitoh, D., Kondou, T., Suzuki, S., & Shouno, H. (2016). Group dropout inspired by ensemble learning. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9948 LNCS, pp. 66–73). Springer Verlag. https://doi.org/10.1007/978-3-319-46672-9_8
Mendeley helps you to discover research relevant for your work.