An integer programming approach to optimal derivative accumulation

1Citations
Citations of this article
3Readers
Mendeley users who have this article in their library.
Get full text

Abstract

In automatic differentiation, vertex elimination is one of the many methods for Jacobian accumulation and in general it can be much more efficient than the forward mode or reverse mode (Forth et al. ACM Trans Math Softw 30(3):266-299, 2004; Griewank and Walther, Evaluating derivatives: principles and techniques of algorithmic differentiation, SIAM, Philadelphia, 2008). However, finding the optimal vertex elimination sequence of a computational graph is a hard combinatorial optimization problem. In this paper, we propose to tackle this problem with an integer programming (IP) technique, and we develop an IP formulation for it. This enables us to use a standard integer optimization solver to find an optimal vertex elimination strategy. In addition, we have developed several bound-tightening and symmetry-breaking constraints to strengthen the basic IP formulation. We demonstrate the effectiveness of these enhancements through computational experiments. © 2012 Springer-Verlag.

Cite

CITATION STYLE

APA

Chen, J., Hovland, P., Munson, T., & Utke, J. (2012). An integer programming approach to optimal derivative accumulation. In Lecture Notes in Computational Science and Engineering (Vol. 87 LNCSE, pp. 221–231). https://doi.org/10.1007/978-3-642-30023-3_20

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free