Listen "Differentiable Cosmological Simulation with Adjoint Method"
Episode Synopsis
Differentiable Cosmological Simulation with Adjoint Method by Yin Li et al. on Monday 21 November
Rapid advances in deep learning have brought not only myriad powerful neural
networks, but also breakthroughs that benefit established scientific research.
In particular, automatic differentiation (AD) tools and computational
accelerators like GPUs have facilitated forward modeling of the Universe with
differentiable simulations. Current differentiable cosmological simulations are
limited by memory, thus are subject to a trade-off between time and space/mass
resolution. They typically integrate for only tens of time steps, unlike the
standard non-differentiable simulations. We present a new approach free of such
constraints, using the adjoint method and reverse time integration. It enables
larger and more accurate forward modeling, and will improve gradient based
optimization and inference. We implement it in a particle-mesh (PM) $N$-body
library pmwd (particle-mesh with derivatives). Based on the powerful AD system
JAX, pmwd is fully differentiable, and is highly performant on GPUs.
arXiv: http://arxiv.org/abs/http://arxiv.org/abs/2211.09815v1
Rapid advances in deep learning have brought not only myriad powerful neural
networks, but also breakthroughs that benefit established scientific research.
In particular, automatic differentiation (AD) tools and computational
accelerators like GPUs have facilitated forward modeling of the Universe with
differentiable simulations. Current differentiable cosmological simulations are
limited by memory, thus are subject to a trade-off between time and space/mass
resolution. They typically integrate for only tens of time steps, unlike the
standard non-differentiable simulations. We present a new approach free of such
constraints, using the adjoint method and reverse time integration. It enables
larger and more accurate forward modeling, and will improve gradient based
optimization and inference. We implement it in a particle-mesh (PM) $N$-body
library pmwd (particle-mesh with derivatives). Based on the powerful AD system
JAX, pmwd is fully differentiable, and is highly performant on GPUs.
arXiv: http://arxiv.org/abs/http://arxiv.org/abs/2211.09815v1
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.