1 / 28

Speeding up HMC with better integrators

Speeding up HMC with better integrators. A D Kennedy and M A Clark School of Physics & SUPA, The University of Edinburgh Boston University. Outline. Symmetric symplectic integrators in HMC Shadow Hamiltonians and Poisson brackets Tuning integrators using Poisson brackets

braima
Download Presentation

Speeding up HMC with better integrators

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Speeding up HMC with better integrators A D Kennedy and M A Clark School of Physics & SUPA, The University of Edinburgh Boston University

  2. Outline • Symmetric symplectic integrators in HMC • Shadow Hamiltonians and Poisson brackets • Tuning integrators using Poisson brackets • Hessian or Force-Gradient integrators • Symplectic integrators and Poisson brackets on Lie groups • Results for single-link updates A D Kennedy

  3. We are interested in finding the classical trajectory in phase space of a system described by the Hamiltonian The idea of a symplectic integrator is to write the time evolution operator (Lie derivative) as Symplectic Integrators A D Kennedy

  4. Define and so that Since the kinetic energy T is a function only of p and the potential energy S is a function only of q, it follows that the action of and may be evaluated trivially Symplectic Integrators A D Kennedy

  5. If A and B belong to any (non-commutative) algebra then , where  constructed from commutators of A and B (i.e., is in the Free Lie Algebra generated by A and B ) • More precisely, where and Symplectic Integrators Baker-Campbell-Hausdorff (BCH) formula A D Kennedy

  6. Explicitly, the first few terms are • The following identity follows directly from the BCH formula Symplectic Integrators • In order to construct reversible integrators we use symmetric symplectic integrators A D Kennedy

  7. Symplectic Integrators • From the BCH formula we find that the PQP symmetric symplectic integrator is given by • In addition to conserving energy to O (² ) such symmetric symplectic integrators are manifestly area preserving and reversible A D Kennedy

  8. This may be obtained by replacing the commutators in the BCH expansion of with the Poisson bracket Shadow Hamiltonians For each symplectic integrator there exists a Hamiltonian H’ which is exactly conserved A D Kennedy

  9. For the PQP integrator we have Conserved Hamiltonian A D Kennedy

  10. Tuning HMC • For any (symmetric) symplectic integrator the conserved Hamiltonian is constructed from the same Poisson brackets • A procedure for tuning such integrators is • Measure the Poisson brackets during an HMC run • Optimize the integrator (number of pseudofermions, step-sizes, order of integration scheme, etc.) offline using these measured values • This can be done because the acceptance rate (and instabilities) are completely determined by δH = H’ - H A D Kennedy

  11. Consider the PQPQP integrator The conserved Hamiltonian is thus Simple Example (Omelyan) Measure the “operators” and minimize the cost by adjusting the parameter α A D Kennedy

  12. An interesting observation is that the Poisson bracket depends only of q We may therefore evaluate the integrator explicitly Hessian Integrators The force for this integrator involves second derivatives of the action Using this type of step we can construct very efficient Force-Gradient integrators A D Kennedy

  13. Higher-Order Integrators • We can eliminate all the leading order Poisson brackets in the shadow Hamiltonian leaving errors of O (δτ2) • The coefficients of the higher-order Poisson brackets are much smaller than those from the Campostrini integrator A D Kennedy

  14. Beyond Scalar Field Theory We need to extend the formalism beyond a scalar field theory Fermions are easy How do we extend all this fancy differential geometry formalism to gauge fields? A D Kennedy

  15. Hamiltonian Mechanics Symplectic 2-form Hamiltonian vector field Equations of motion Poisson bracket Flat Manifold General Darboux theorem: All manifolds are locally flat A D Kennedy

  16. The left invariant forms dual to the generators of a Lie algebra satisfy the Maurer-Cartan equations Maurer-Cartan Equations A D Kennedy

  17. Fundamental 2-form We can invent any Classical Mechanics we want… So we may therefore define a closed symplectic 2-form which globally defines an invariant Poisson bracket by A D Kennedy

  18. Define a vector field such that Hamiltonian Vector Field We may now follow the usual procedure to find the equations of motion: Introduce a Hamiltonian function (0-form) Hon the cotangent bundle (phase space) over the group manifold A D Kennedy

  19. The classical trajectories are then the integral curves of h: Integral Curves A D Kennedy

  20. Poisson Brackets Recall our Hamiltonian vector field For H(q,p) = T(p) + S(q) we have vector fields A D Kennedy

  21. More Poisson Brackets We thus compute the lowest-order Poisson bracket and the Hamiltonian vector corresponding to it A D Kennedy

  22. Even More Poisson Brackets A D Kennedy

  23. Integrators A D Kennedy

  24. Campostrini Integrator A D Kennedy

  25. Hessian Integrators A D Kennedy

  26. One-Link Results A D Kennedy

  27. Scaling Behaviour A D Kennedy

  28. Conclusions • We hope that very significant performance improvements can be obtained using Force-Gradient integrators • For fermions one extra inversion of the Dirac operator is required • Pure gauge force terms and Poisson brackets get quite complicated to program • Real-life speed-up factors will be measured really soon… A D Kennedy

More Related