MURAL - Maynooth University Research Archive Library



    Algorithmic Differentiation through Convergent Loops


    Pearlmutter, Barak A. and Link, Hamilton E. (2002) Algorithmic Differentiation through Convergent Loops. Project Report. UNSPECIFIED.

    [img]
    Preview
    Download (77kB) | Preview


    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...



    Add this article to your Mendeley library


    Abstract

    We consider an explicit iterate-to-fixedpoint operator and derive associated rules for both forward and reverse mode algorithmic differentiation. Like other AD transformation rules, these are exact and efficient. In this case, they generate code which itself invokes the iterate-to-fixedpoint operator. Loops which iterate until a variable changes less than some tolerance should be regarded as approximate iterate-to-fixedpoint calculations. After a convergence analysis, we contend that it is best both pragmatically and theoretically to find the approximate fixedpoint of the adjoint system of the actual desired fixedpoint calculation, rather than find the adjoint of the approximate primal fixedpoint calculation. Our exposition unifies and formalizes a number of techniques already known to the AD community, introduces a convenient and powerful notation, and opens the door to fully automatic efficient AD of a broadened class of codes.

    Item Type: Monograph (Project Report)
    Keywords: algorithmic differentiation; convergent loop; approximate fixedpoint; approximate primal fixedpoint calculation; variable change; iterate-to-fixedpoint operator; adjoint system; powerful notation; fixedpoint calculation ad transformation rule; exposition unifies; ad community mode algorithmic differentiation; broadened class; explicit iterate-to-fixedpoint operator; convergence analysis; automatic efficient ad; approximate iterate-to-fixedpoint calculation;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 10237
    Depositing User: Barak Pearlmutter
    Date Deposited: 22 Nov 2018 14:44
    URI:
      Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

      Repository Staff Only(login required)

      View Item Item control page

      Downloads

      Downloads per month over past year

      Origin of downloads