New Research and Future Directions

Abstract

Many supervised tasks in natural language processing, speech recognition, and automatic video analysis may soon become trivial through large RNNs. In the near future, both supervised learning RNNs and reinforcement learning will be greatly scaled up. Current large ANNs have on the order of a billion connections; soon that will be a trillion, at the same price. By comparison, human brains have a trillions of—much slower—connections.