MURAL - Maynooth University Research Archive Library

    The Principles of First Order Automatic Differentiation

    Hoffmann, Philipp (2014) The Principles of First Order Automatic Differentiation. Working Paper.

    Download (231kB) | Preview
    Official URL: arXiv:1411.0583 [math.NA]

    Share your research

    Twitter Facebook LinkedIn GooglePlus Email more...

    Add this article to your Mendeley library


    This article provides a short overview of the theory of First Order Automatic Differentiation (AD) for readers unfamiliar with this topic. In particular, we summarize different characterisations of Forward AD, like the vector-matrix based approach, the idea of lifting functions to the algebra of dual numbers, the method of Taylor series expansion on dual numbers and the application of the push-forward operator. We give short, but precise mathematical descriptions of these methods and show why they all reduce to the same actual chain of computations (and are, hence, equivalent). Finally, we give a short summary of Reverse AD and again point out the underlying computational steps.

    Item Type: Monograph (Working Paper)
    Additional Information: This work was supported by Science Foundation Ireland grant 09/IN.1/I2637.
    Keywords: Automatic Differentiation; Forward AD; Reverse AD; Dual Numbers;
    Academic Unit: Faculty of Science and Engineering > Mathematics and Statistics
    Item ID: 5857
    Depositing User: Philipp Hoffmann
    Date Deposited: 18 Feb 2015 15:34
    Refereed: No
    Funders: Science Foundation Ireland (SFI)
      Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

      Repository Staff Only(login required)

      View Item Item control page


      Downloads per month over past year

      Origin of downloads