Towards on-sky adaptive optics control using reinforcement learning
Authors: J. Nousiainen, C. Rajani, M. Kasper, T. Helin, S. Y. Haffert, C. Vérinaud, J. R. Males, K. Van Gorkom, L. M. Close, J. D. Long, A. D. Hedglen, O. Guyon, L. Schatz, M. Kautz, J. Lumbres, A. Rodack, J. M. Knight, K. Miller
AI-generated Key Points
- Direct imaging of potentially habitable exoplanets is a crucial scientific objective for future high contrast imaging instruments on ground-based telescopes.
- eXtreme Adaptive Optics (XAO) systems with thousands of actuators are used to achieve this goal.
- Current XAO systems' control laws have limitations when imaging habitable exoplanets at small angular separations from their host stars.
- The study introduces a new method called PO4AO to improve adaptive optics correction.
- PO4AO learns a dynamics model and optimizes a control neural network known as a policy, building upon previous work in Reinforcement Learning for AO.
- The method is evaluated through numerical simulations and laboratory experiments using different telescope aperture cases.
- PO4AO significantly improves coronagraphic contrast in both simulations and experiments, achieving contrast improvements by factors of 3-5 within the control region of deformable mirrors (DM) and Pyramid wavefront sensors (WFS).
- PO4AO has fast training timescales of 5-10 seconds and low inference time (< ms), making it suitable for real-time control on large telescopes.
- The study presents an innovative approach to adaptive optics control using reinforcement learning techniques.
- By reducing residual flux in the coronagraphic point spread function, PO4AO holds promise for advancing direct imaging capabilities and understanding potentially habitable exoplanets.
Abstract: The direct imaging of potentially habitable Exoplanets is one prime science case for the next generation of high contrast imaging instruments on ground-based extremely large telescopes. To reach this demanding science goal, the instruments are equipped with eXtreme Adaptive Optics (XAO) systems which will control thousands of actuators at a framerate of kilohertz to several kilohertz. Most of the habitable exoplanets are located at small angular separations from their host stars, where the current XAO systems' control laws leave strong residuals.Current AO control strategies like static matrix-based wavefront reconstruction and integrator control suffer from temporal delay error and are sensitive to mis-registration, i.e., to dynamic variations of the control system geometry. We aim to produce control methods that cope with these limitations, provide a significantly improved AO correction and, therefore, reduce the residual flux in the coronagraphic point spread function. We extend previous work in Reinforcement Learning for AO. The improved method, called PO4AO, learns a dynamics model and optimizes a control neural network, called a policy. We introduce the method and study it through numerical simulations of XAO with Pyramid wavefront sensing for the 8-m and 40-m telescope aperture cases. We further implemented PO4AO and carried out experiments in a laboratory environment using MagAO-X at the Steward laboratory. PO4AO provides the desired performance by improving the coronagraphic contrast in numerical simulations by factors 3-5 within the control region of DM and Pyramid WFS, in simulation and in the laboratory. The presented method is also quick to train, i.e., on timescales of typically 5-10 seconds, and the inference time is sufficiently small (< ms) to be used in real-time control for XAO with currently available hardware even for extremely large telescopes.
Tools for this paper
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
We compare the title and abstract with papers indexed in our database. For arXiv papers, we search within the same category; for DOI and other sources, we search across sources and subjects. You can rerun the search as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.