MURAL - Maynooth University Research Archive Library



    Algorithmic Differentiation through Convergent Loops


    Pearlmutter, Barak A. and Link, Hamilton E. (2002) Algorithmic Differentiation through Convergent Loops. Project Report. UNSPECIFIED.

    [thumbnail of BP-Algorithmic-2002.pdf]
    Preview
    Text
    BP-Algorithmic-2002.pdf

    Download (77kB) | Preview

    Abstract

    We consider an explicit iterate-to-fixedpoint operator and derive associated rules for both forward and reverse mode algorithmic differentiation. Like other AD transformation rules, these are exact and efficient. In this case, they generate code which itself invokes the iterate-to-fixedpoint operator. Loops which iterate until a variable changes less than some tolerance should be regarded as approximate iterate-to-fixedpoint calculations. After a convergence analysis, we contend that it is best both pragmatically and theoretically to find the approximate fixedpoint of the adjoint system of the actual desired fixedpoint calculation, rather than find the adjoint of the approximate primal fixedpoint calculation. Our exposition unifies and formalizes a number of techniques already known to the AD community, introduces a convenient and powerful notation, and opens the door to fully automatic efficient AD of a broadened class of codes.
    Item Type: Monograph (Project Report)
    Keywords: algorithmic differentiation; convergent loop; approximate fixedpoint; approximate primal fixedpoint calculation; variable change; iterate-to-fixedpoint operator; adjoint system; powerful notation; fixedpoint calculation ad transformation rule; exposition unifies; ad community mode algorithmic differentiation; broadened class; explicit iterate-to-fixedpoint operator; convergence analysis; automatic efficient ad; approximate iterate-to-fixedpoint calculation;
    Academic Unit: Faculty of Science and Engineering > Computer Science
    Item ID: 10237
    Depositing User: Barak Pearlmutter
    Date Deposited: 22 Nov 2018 14:44
    URI: https://mural.maynoothuniversity.ie/id/eprint/10237
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads