MCMC using $\textit{bouncy}$ Hamiltonian dynamics: A unifying framework for Hamiltonian Monte Carlo and piecewise deterministic Markov process samplers

AI-generated keywords: MCMC Bayesian computation PDMP samplers Hamiltonian Monte Carlo bouncy Hamiltonian dynamics

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Authors Andrew Chin and Akihiko Nishimura explore Bayesian computation through PDMP samplers
  • PDMP samplers are cutting-edge in MCMC methods
  • Connection between PDMPs and Hamiltonian Monte Carlo revealed
  • Use of time-reversible deterministic dynamics as Metropolis proposals
  • Exploitation of PDMPs' unique velocity changes for rejection-free mechanisms
  • Establishment of rejection-free Metropolis proposals based on bouncy Hamiltonian dynamics
  • Proposed dynamics exhibit strong convergence to PDMP equivalents with increased refreshment frequency
  • Development of a sampler based on bouncy Hamiltonian dynamics related to BPS
  • Competitive performance demonstrated on complex real-data posteriors with many parameters
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Andrew Chin, Akihiko Nishimura

Abstract: Piecewise-deterministic Markov process (PDMP) samplers constitute a state of the art Markov chain Monte Carlo (MCMC) paradigm in Bayesian computation, with examples including the zig-zag and bouncy particle sampler (BPS). Recent work on the zig-zag has indicated its connection to Hamiltonian Monte Carlo, a version of the Metropolis algorithm that exploits Hamiltonian dynamics. Here we establish that, in fact, the connection between the paradigms extends far beyond the specific instance. The key lies in (1) the fact that any time-reversible deterministic dynamics provides a valid Metropolis proposal and (2) how PDMPs' characteristic velocity changes constitute an alternative to the usual acceptance-rejection. We turn this observation into a rigorous framework for constructing rejection-free Metropolis proposals based on bouncy Hamiltonian dynamics which simultaneously possess Hamiltonian-like properties and generate discontinuous trajectories similar in appearance to PDMPs. When combined with periodic refreshment of the inertia, the dynamics converge strongly to PDMP equivalents in the limit of increasingly frequent refreshment. We demonstrate the practical implications of this new paradigm, with a sampler based on a bouncy Hamiltonian dynamics closely related to the BPS. The resulting sampler exhibits competitive performance on challenging real-data posteriors involving tens of thousands of parameters.

Submitted to arXiv on 14 May. 2024

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2405.08290v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In their paper titled "MCMC using $\textit{bouncy}$ Hamiltonian dynamics: A unifying framework for Hamiltonian Monte Carlo and piecewise deterministic Markov process samplers," authors Andrew Chin and Akihiko Nishimura delve into the cutting-edge field of Bayesian computation through the lens of piecewise-deterministic Markov process (PDMP) samplers. These samplers represent a state-of-the-art paradigm in Markov chain Monte Carlo (MCMC) methods. The authors highlight recent research that has uncovered a profound connection between PDMPs and Hamiltonian Monte Carlo. This revelation reveals fundamental similarities in the underlying dynamics of these seemingly disparate paradigms. By leveraging time-reversible deterministic dynamics as valid Metropolis proposals and exploiting PDMPs' unique velocity changes as an alternative to traditional acceptance-rejection mechanisms, the authors establish a rigorous framework for constructing rejection-free Metropolis proposals based on bouncy Hamiltonian dynamics. This innovative approach imbues the proposals with Hamiltonian-like properties and generates discontinuous trajectories reminiscent of PDMPs. Through periodic refreshment of inertia, the proposed dynamics exhibit strong convergence to PDMP equivalents as refreshment frequency increases. The practical implications of this novel paradigm are demonstrated through the development of a sampler based on bouncy Hamiltonian dynamics closely related to BPS. Remarkably, this sampler showcases competitive performance on complex real-data posteriors involving tens of thousands of parameters. In summary, Chin and Nishimura's work sheds light on a unifying framework that bridges the gap between Hamiltonian Monte Carlo and PDMP samplers, offering new insights into efficient Bayesian computation techniques with broad applicability in diverse fields.
Created on 26 Jul. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.