Interstellar: Using halide's scheduling language to analyze DNN accelerators

163Citations
Citations of this article
132Readers
Mendeley users who have this article in their library.
Get full text

Abstract

We show that DNN accelerator micro-architectures and their program mappings represent specific choices of loop order and hardware parallelism for computing the seven nested loops of DNNs, which enables us to create a formal taxonomy of all existing dense DNN accelerators. Surprisingly, the loop transformations needed to create these hardware variants can be precisely and concisely represented by Halide's scheduling language. By modifying the Halide compiler to generate hardware, we create a system that can fairly compare these prior accelerators. As long as proper loop blocking schemes are used, and the hardware can support mapping replicated loops, many different hardware dataflows yield similar energy efficiency with good performance. This is because the loop blocking can ensure that most data references stay on-chip with good locality and the processing units have high resource utilization. How resources are allocated, especially in the memory system, has a large impact on energy and performance. By optimizing hardware resource allocation while keeping throughput constant, we achieve up to 4.2× energy improvement for Convolutional Neural Networks (CNNs), 1.6× and 1.8× improvement for Long Short-Term Memories (LSTMs) and multi-layer perceptrons (MLPs), respectively.

Cite

CITATION STYLE

APA

Yang, X., Gao, M., Liu, Q., Setter, J., Pu, J., Nayak, A., … Horowitz, M. (2020). Interstellar: Using halide’s scheduling language to analyze DNN accelerators. In International Conference on Architectural Support for Programming Languages and Operating Systems - ASPLOS (pp. 369–383). Association for Computing Machinery. https://doi.org/10.1145/3373376.3378514

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free