Laboratory experiments of model-based reinforcement learning for adaptive optics control Article Swipe
Jalo Nousiainen
,
Byron Engler
,
M. Kasper
,
Chang Rajani
,
Tapio Helin
,
Cédric Taïssir Héritier
,
Sascha P. Quanz
,
Adrian M. Glauser
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1117/1.jatis.10.1.019001
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1117/1.jatis.10.1.019001
Direct imaging of Earth-like exoplanets is one of the most prominent scientific drivers of the next generation of ground-based telescopes. Typically, Earth-like exoplanets are located at small angular separations from their host stars, making their detection difficult. Consequently, the adaptive optics (AO) system's control algorithm must be carefully designed to distinguish the exoplanet from the residual light produced by the host star. A promising avenue of research to improve AO control builds on data-driven control methods, such as reinforcement learning (RL). RL is an active branch of the machine learning research field, where control of a system is learned through interaction with the environment. Thus, RL can be seen as an automated approach to AO control, where its usage is entirely a turnkey operation. In particular, model-based RL has been shown to cope with temporal and misregistration errors. Similarly, it has been demonstrated to adapt to nonlinear wavefront sensing while being efficient in training and execution. In this work, we implement and adapt an RL method called policy optimization for AO (PO4AO) to the GPU-based high-order adaptive optics testbench (GHOST) test bench at ESO headquarters, where we demonstrate a strong performance of the method in a laboratory environment. Our implementation allows the training to be performed parallel to inference, which is crucial for on-sky operation. In particular, we study the predictive and self-calibrating aspects of the method. The new implementation on GHOST running PyTorch introduces only around 700 μs of in addition to hardware, pipeline, and Python interface latency. We open-source well-documented code for the implementation and specify the requirements for the RTC pipeline. We also discuss the important hyperparameters of the method and how they affect the method. Further, the paper discusses the source of the latency and the possible paths for a lower latency implementation.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1117/1.jatis.10.1.019001
- https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdf
- OA Status
- hybrid
- Cited By
- 7
- References
- 61
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4392046750
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4392046750Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1117/1.jatis.10.1.019001Digital Object Identifier
- Title
-
Laboratory experiments of model-based reinforcement learning for adaptive optics controlWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-02-22Full publication date if available
- Authors
-
Jalo Nousiainen, Byron Engler, M. Kasper, Chang Rajani, Tapio Helin, Cédric Taïssir Héritier, Sascha P. Quanz, Adrian M. GlauserList of authors in order
- Landing page
-
https://doi.org/10.1117/1.jatis.10.1.019001Publisher landing page
- PDF URL
-
https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
hybridOpen access status per OpenAlex
- OA URL
-
https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdfDirect OA link when available
- Concepts
-
Reinforcement, Reinforcement learning, Computer science, Control (management), Adaptive control, Control engineering, Engineering, Artificial intelligence, Structural engineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
7Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 7Per-year citation counts (last 5 years)
- References (count)
-
61Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4392046750 |
|---|---|
| doi | https://doi.org/10.1117/1.jatis.10.1.019001 |
| ids.doi | https://doi.org/10.3929/ethz-b-000673957 |
| ids.openalex | https://openalex.org/W4392046750 |
| fwci | 4.47144984 |
| type | article |
| title | Laboratory experiments of model-based reinforcement learning for adaptive optics control |
| biblio.issue | 01 |
| biblio.volume | 10 |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12611 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.6805999875068665 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Neural Networks and Reservoir Computing |
| topics[1].id | https://openalex.org/T11749 |
| topics[1].field.id | https://openalex.org/fields/22 |
| topics[1].field.display_name | Engineering |
| topics[1].score | 0.6730999946594238 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2207 |
| topics[1].subfield.display_name | Control and Systems Engineering |
| topics[1].display_name | Iterative Learning Control Systems |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C67203356 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6355306506156921 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1321905 |
| concepts[0].display_name | Reinforcement |
| concepts[1].id | https://openalex.org/C97541855 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6304218769073486 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q830687 |
| concepts[1].display_name | Reinforcement learning |
| concepts[2].id | https://openalex.org/C41008148 |
| concepts[2].level | 0 |
| concepts[2].score | 0.4611551761627197 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[2].display_name | Computer science |
| concepts[3].id | https://openalex.org/C2775924081 |
| concepts[3].level | 2 |
| concepts[3].score | 0.4418291747570038 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q55608371 |
| concepts[3].display_name | Control (management) |
| concepts[4].id | https://openalex.org/C107464732 |
| concepts[4].level | 3 |
| concepts[4].score | 0.41066303849220276 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q235781 |
| concepts[4].display_name | Adaptive control |
| concepts[5].id | https://openalex.org/C133731056 |
| concepts[5].level | 1 |
| concepts[5].score | 0.32281967997550964 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q4917288 |
| concepts[5].display_name | Control engineering |
| concepts[6].id | https://openalex.org/C127413603 |
| concepts[6].level | 0 |
| concepts[6].score | 0.2436765432357788 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[6].display_name | Engineering |
| concepts[7].id | https://openalex.org/C154945302 |
| concepts[7].level | 1 |
| concepts[7].score | 0.22797232866287231 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[7].display_name | Artificial intelligence |
| concepts[8].id | https://openalex.org/C66938386 |
| concepts[8].level | 1 |
| concepts[8].score | 0.11553487181663513 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q633538 |
| concepts[8].display_name | Structural engineering |
| keywords[0].id | https://openalex.org/keywords/reinforcement |
| keywords[0].score | 0.6355306506156921 |
| keywords[0].display_name | Reinforcement |
| keywords[1].id | https://openalex.org/keywords/reinforcement-learning |
| keywords[1].score | 0.6304218769073486 |
| keywords[1].display_name | Reinforcement learning |
| keywords[2].id | https://openalex.org/keywords/computer-science |
| keywords[2].score | 0.4611551761627197 |
| keywords[2].display_name | Computer science |
| keywords[3].id | https://openalex.org/keywords/control |
| keywords[3].score | 0.4418291747570038 |
| keywords[3].display_name | Control (management) |
| keywords[4].id | https://openalex.org/keywords/adaptive-control |
| keywords[4].score | 0.41066303849220276 |
| keywords[4].display_name | Adaptive control |
| keywords[5].id | https://openalex.org/keywords/control-engineering |
| keywords[5].score | 0.32281967997550964 |
| keywords[5].display_name | Control engineering |
| keywords[6].id | https://openalex.org/keywords/engineering |
| keywords[6].score | 0.2436765432357788 |
| keywords[6].display_name | Engineering |
| keywords[7].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[7].score | 0.22797232866287231 |
| keywords[7].display_name | Artificial intelligence |
| keywords[8].id | https://openalex.org/keywords/structural-engineering |
| keywords[8].score | 0.11553487181663513 |
| keywords[8].display_name | Structural engineering |
| language | en |
| locations[0].id | doi:10.1117/1.jatis.10.1.019001 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S2765061990 |
| locations[0].source.issn | 2329-4124, 2329-4221 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | 2329-4124 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | Journal of Astronomical Telescopes Instruments and Systems |
| locations[0].source.host_organization | https://openalex.org/P4310315543 |
| locations[0].source.host_organization_name | SPIE |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310315543 |
| locations[0].source.host_organization_lineage_names | SPIE |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Journal of Astronomical Telescopes, Instruments, and Systems |
| locations[0].landing_page_url | https://doi.org/10.1117/1.jatis.10.1.019001 |
| locations[1].id | pmh:oai:www.research-collection.ethz.ch:20.500.11850/673957 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306402302 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Repository for Publications and Research Data (ETH Zurich) |
| locations[1].source.host_organization | https://openalex.org/I35440088 |
| locations[1].source.host_organization_name | ETH Zurich |
| locations[1].source.host_organization_lineage | https://openalex.org/I35440088 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | info:eu-repo/semantics/publishedVersion |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Journal of Astronomical Telescopes, Instruments, and Systems, 10 (1) |
| locations[1].landing_page_url | http://hdl.handle.net/20.500.11850/673957 |
| locations[2].id | pmh:oai:HAL:hal-04650504v1 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306402512 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | HAL (Le Centre pour la Communication Scientifique Directe) |
| locations[2].source.host_organization | https://openalex.org/I1294671590 |
| locations[2].source.host_organization_name | Centre National de la Recherche Scientifique |
| locations[2].source.host_organization_lineage | https://openalex.org/I1294671590 |
| locations[2].license | other-oa |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | Journal articles |
| locations[2].license_id | https://openalex.org/licenses/other-oa |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | Journal of Astronomical Telescopes Instruments and Systems, 2024, 10 (01), pp.019001. ⟨10.1117/1.JATIS.10.1.019001]⟩ |
| locations[2].landing_page_url | https://hal.science/hal-04650504 |
| locations[3].id | pmh:oai:HAL:insu-04726556v1 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S4306402512 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | HAL (Le Centre pour la Communication Scientifique Directe) |
| locations[3].source.host_organization | https://openalex.org/I1294671590 |
| locations[3].source.host_organization_name | Centre National de la Recherche Scientifique |
| locations[3].source.host_organization_lineage | https://openalex.org/I1294671590 |
| locations[3].license | other-oa |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | info:eu-repo/semantics/article |
| locations[3].license_id | https://openalex.org/licenses/other-oa |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | Journal of Astronomical Telescopes, Instruments, and Systems |
| locations[3].landing_page_url | https://insu.hal.science/insu-04726556 |
| locations[4].id | pmh:oai:aaltodoc.aalto.fi:123456789/130307 |
| locations[4].is_oa | True |
| locations[4].source.id | https://openalex.org/S4306401662 |
| locations[4].source.issn | |
| locations[4].source.type | repository |
| locations[4].source.is_oa | False |
| locations[4].source.issn_l | |
| locations[4].source.is_core | False |
| locations[4].source.is_in_doaj | False |
| locations[4].source.display_name | Aaltodoc (Aalto University) |
| locations[4].source.host_organization | https://openalex.org/I9927081 |
| locations[4].source.host_organization_name | Aalto University |
| locations[4].source.host_organization_lineage | https://openalex.org/I9927081 |
| locations[4].license | cc-by |
| locations[4].pdf_url | |
| locations[4].version | submittedVersion |
| locations[4].raw_type | publishedVersion |
| locations[4].license_id | https://openalex.org/licenses/cc-by |
| locations[4].is_accepted | False |
| locations[4].is_published | False |
| locations[4].raw_source_name | |
| locations[4].landing_page_url | https://aaltodoc.aalto.fi/handle/123456789/130307 |
| locations[5].id | pmh:oai:www.research-collection.ethz.ch:20.500.11850/655616 |
| locations[5].is_oa | True |
| locations[5].source.id | https://openalex.org/S4306402302 |
| locations[5].source.issn | |
| locations[5].source.type | repository |
| locations[5].source.is_oa | False |
| locations[5].source.issn_l | |
| locations[5].source.is_core | False |
| locations[5].source.is_in_doaj | False |
| locations[5].source.display_name | Repository for Publications and Research Data (ETH Zurich) |
| locations[5].source.host_organization | https://openalex.org/I35440088 |
| locations[5].source.host_organization_name | ETH Zurich |
| locations[5].source.host_organization_lineage | https://openalex.org/I35440088 |
| locations[5].license | cc-by |
| locations[5].pdf_url | |
| locations[5].version | submittedVersion |
| locations[5].raw_type | info:eu-repo/semantics/workingPaper |
| locations[5].license_id | https://openalex.org/licenses/cc-by |
| locations[5].is_accepted | False |
| locations[5].is_published | False |
| locations[5].raw_source_name | arXiv |
| locations[5].landing_page_url | http://hdl.handle.net/20.500.11850/655616 |
| locations[6].id | doi:10.3929/ethz-b-000655616 |
| locations[6].is_oa | True |
| locations[6].source.id | https://openalex.org/S7407051236 |
| locations[6].source.type | repository |
| locations[6].source.is_oa | False |
| locations[6].source.issn_l | |
| locations[6].source.is_core | False |
| locations[6].source.is_in_doaj | False |
| locations[6].source.display_name | ETH Zürich Research Collection |
| locations[6].source.host_organization | |
| locations[6].source.host_organization_name | |
| locations[6].license | |
| locations[6].pdf_url | |
| locations[6].version | |
| locations[6].raw_type | article-journal |
| locations[6].license_id | |
| locations[6].is_accepted | False |
| locations[6].is_published | |
| locations[6].raw_source_name | |
| locations[6].landing_page_url | https://doi.org/10.3929/ethz-b-000655616 |
| locations[7].id | doi:10.3929/ethz-b-000673957 |
| locations[7].is_oa | True |
| locations[7].source.id | https://openalex.org/S7407051236 |
| locations[7].source.type | repository |
| locations[7].source.is_oa | False |
| locations[7].source.issn_l | |
| locations[7].source.is_core | False |
| locations[7].source.is_in_doaj | False |
| locations[7].source.display_name | ETH Zürich Research Collection |
| locations[7].source.host_organization | |
| locations[7].source.host_organization_name | |
| locations[7].license | |
| locations[7].pdf_url | |
| locations[7].version | |
| locations[7].raw_type | article-journal |
| locations[7].license_id | |
| locations[7].is_accepted | False |
| locations[7].is_published | |
| locations[7].raw_source_name | |
| locations[7].landing_page_url | https://doi.org/10.3929/ethz-b-000673957 |
| indexed_in | crossref, datacite |
| authorships[0].author.id | https://openalex.org/A5020491745 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Jalo Nousiainen |
| authorships[0].countries | FI |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I9927081 |
| authorships[0].affiliations[0].raw_affiliation_string | Aalto University (Finland) |
| authorships[0].affiliations[1].institution_ids | https://openalex.org/I63548447 |
| authorships[0].affiliations[1].raw_affiliation_string | Lappeenranta-Lahti University of Technology (Finland) |
| authorships[0].institutions[0].id | https://openalex.org/I9927081 |
| authorships[0].institutions[0].ror | https://ror.org/020hwjq30 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I9927081 |
| authorships[0].institutions[0].country_code | FI |
| authorships[0].institutions[0].display_name | Aalto University |
| authorships[0].institutions[1].id | https://openalex.org/I63548447 |
| authorships[0].institutions[1].ror | https://ror.org/0208vgz68 |
| authorships[0].institutions[1].type | education |
| authorships[0].institutions[1].lineage | https://openalex.org/I63548447 |
| authorships[0].institutions[1].country_code | FI |
| authorships[0].institutions[1].display_name | Lappeenranta-Lahti University of Technology |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Jalo Nousiainen |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Aalto University (Finland), Lappeenranta-Lahti University of Technology (Finland) |
| authorships[1].author.id | https://openalex.org/A5104087156 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Byron Engler |
| authorships[1].countries | DE |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I1321434546 |
| authorships[1].affiliations[0].raw_affiliation_string | European Southern Observatory, Garching bei München, Germany |
| authorships[1].institutions[0].id | https://openalex.org/I1321434546 |
| authorships[1].institutions[0].ror | https://ror.org/01qtasp15 |
| authorships[1].institutions[0].type | facility |
| authorships[1].institutions[0].lineage | https://openalex.org/I1321434546 |
| authorships[1].institutions[0].country_code | DE |
| authorships[1].institutions[0].display_name | European Southern Observatory |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Byron Engler |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | European Southern Observatory, Garching bei München, Germany |
| authorships[2].author.id | https://openalex.org/A5027635524 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-8425-6606 |
| authorships[2].author.display_name | M. Kasper |
| authorships[2].countries | DE |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I1321434546 |
| authorships[2].affiliations[0].raw_affiliation_string | European Southern Observatory, Garching bei München, Germany |
| authorships[2].affiliations[1].raw_affiliation_string | of of |
| authorships[2].institutions[0].id | https://openalex.org/I1321434546 |
| authorships[2].institutions[0].ror | https://ror.org/01qtasp15 |
| authorships[2].institutions[0].type | facility |
| authorships[2].institutions[0].lineage | https://openalex.org/I1321434546 |
| authorships[2].institutions[0].country_code | DE |
| authorships[2].institutions[0].display_name | European Southern Observatory |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Markus Kasper |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | European Southern Observatory, Garching bei München, Germany, of of |
| authorships[3].author.id | https://openalex.org/A5060046167 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-1691-8206 |
| authorships[3].author.display_name | Chang Rajani |
| authorships[3].countries | FI |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I133731052 |
| authorships[3].affiliations[0].raw_affiliation_string | University of Helsinki, Helsinki, Finland |
| authorships[3].institutions[0].id | https://openalex.org/I133731052 |
| authorships[3].institutions[0].ror | https://ror.org/040af2s02 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I133731052 |
| authorships[3].institutions[0].country_code | FI |
| authorships[3].institutions[0].display_name | University of Helsinki |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Chang Rajani |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | University of Helsinki, Helsinki, Finland |
| authorships[4].author.id | https://openalex.org/A5087514308 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-5788-0008 |
| authorships[4].author.display_name | Tapio Helin |
| authorships[4].countries | FI |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I63548447 |
| authorships[4].affiliations[0].raw_affiliation_string | Lappeenranta-Lahti University of Technology (Finland) |
| authorships[4].institutions[0].id | https://openalex.org/I63548447 |
| authorships[4].institutions[0].ror | https://ror.org/0208vgz68 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I63548447 |
| authorships[4].institutions[0].country_code | FI |
| authorships[4].institutions[0].display_name | Lappeenranta-Lahti University of Technology |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Tapio Helin |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Lappeenranta-Lahti University of Technology (Finland) |
| authorships[5].author.id | https://openalex.org/A5040724898 |
| authorships[5].author.orcid | https://orcid.org/0009-0003-1557-1914 |
| authorships[5].author.display_name | Cédric Taïssir Héritier |
| authorships[5].countries | DE, FR |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I1321434546 |
| authorships[5].affiliations[0].raw_affiliation_string | European Southern Observatory, Garching bei München, Germany |
| authorships[5].affiliations[1].institution_ids | https://openalex.org/I2801658355 |
| authorships[5].affiliations[1].raw_affiliation_string | ONERA (France) |
| authorships[5].affiliations[2].institution_ids | https://openalex.org/I21491767 |
| authorships[5].affiliations[2].raw_affiliation_string | Aix Marseille University (France) |
| authorships[5].institutions[0].id | https://openalex.org/I1321434546 |
| authorships[5].institutions[0].ror | https://ror.org/01qtasp15 |
| authorships[5].institutions[0].type | facility |
| authorships[5].institutions[0].lineage | https://openalex.org/I1321434546 |
| authorships[5].institutions[0].country_code | DE |
| authorships[5].institutions[0].display_name | European Southern Observatory |
| authorships[5].institutions[1].id | https://openalex.org/I21491767 |
| authorships[5].institutions[1].ror | https://ror.org/035xkbk20 |
| authorships[5].institutions[1].type | education |
| authorships[5].institutions[1].lineage | https://openalex.org/I21491767 |
| authorships[5].institutions[1].country_code | FR |
| authorships[5].institutions[1].display_name | Aix-Marseille Université |
| authorships[5].institutions[2].id | https://openalex.org/I2801658355 |
| authorships[5].institutions[2].ror | https://ror.org/005y2ap84 |
| authorships[5].institutions[2].type | facility |
| authorships[5].institutions[2].lineage | https://openalex.org/I2801658355 |
| authorships[5].institutions[2].country_code | FR |
| authorships[5].institutions[2].display_name | Office National d'Études et de Recherches Aérospatiales |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Cédric T. Heritier |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | Aix Marseille University (France), European Southern Observatory, Garching bei München, Germany, ONERA (France) |
| authorships[6].author.id | https://openalex.org/A5068920295 |
| authorships[6].author.orcid | https://orcid.org/0000-0003-3829-7412 |
| authorships[6].author.display_name | Sascha P. Quanz |
| authorships[6].countries | CH |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I35440088 |
| authorships[6].affiliations[0].raw_affiliation_string | ETH Zurich, Institute for Particle Physics and Astrophysics, Zurich, Switzerland |
| authorships[6].institutions[0].id | https://openalex.org/I35440088 |
| authorships[6].institutions[0].ror | https://ror.org/05a28rw58 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I2799323385, https://openalex.org/I35440088 |
| authorships[6].institutions[0].country_code | CH |
| authorships[6].institutions[0].display_name | ETH Zurich |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Sascha P. Quanz |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | ETH Zurich, Institute for Particle Physics and Astrophysics, Zurich, Switzerland |
| authorships[7].author.id | https://openalex.org/A5018585394 |
| authorships[7].author.orcid | https://orcid.org/0000-0001-9250-1547 |
| authorships[7].author.display_name | Adrian M. Glauser |
| authorships[7].countries | CH |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I35440088 |
| authorships[7].affiliations[0].raw_affiliation_string | ETH Zurich, Institute for Particle Physics and Astrophysics, Zurich, Switzerland |
| authorships[7].institutions[0].id | https://openalex.org/I35440088 |
| authorships[7].institutions[0].ror | https://ror.org/05a28rw58 |
| authorships[7].institutions[0].type | education |
| authorships[7].institutions[0].lineage | https://openalex.org/I2799323385, https://openalex.org/I35440088 |
| authorships[7].institutions[0].country_code | CH |
| authorships[7].institutions[0].display_name | ETH Zurich |
| authorships[7].author_position | last |
| authorships[7].raw_author_name | Adrian M. Glauser |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | ETH Zurich, Institute for Particle Physics and Astrophysics, Zurich, Switzerland |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdf |
| open_access.oa_status | hybrid |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Laboratory experiments of model-based reinforcement learning for adaptive optics control |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T12611 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.6805999875068665 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Neural Networks and Reservoir Computing |
| related_works | https://openalex.org/W2920061524, https://openalex.org/W4310083477, https://openalex.org/W1977959518, https://openalex.org/W2038908348, https://openalex.org/W2107890255, https://openalex.org/W2969358681, https://openalex.org/W2107122120, https://openalex.org/W2112559358, https://openalex.org/W194970950, https://openalex.org/W2342009288 |
| cited_by_count | 7 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 7 |
| locations_count | 8 |
| best_oa_location.id | doi:10.1117/1.jatis.10.1.019001 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S2765061990 |
| best_oa_location.source.issn | 2329-4124, 2329-4221 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | 2329-4124 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | Journal of Astronomical Telescopes Instruments and Systems |
| best_oa_location.source.host_organization | https://openalex.org/P4310315543 |
| best_oa_location.source.host_organization_name | SPIE |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310315543 |
| best_oa_location.source.host_organization_lineage_names | SPIE |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Journal of Astronomical Telescopes, Instruments, and Systems |
| best_oa_location.landing_page_url | https://doi.org/10.1117/1.jatis.10.1.019001 |
| primary_location.id | doi:10.1117/1.jatis.10.1.019001 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S2765061990 |
| primary_location.source.issn | 2329-4124, 2329-4221 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | 2329-4124 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | Journal of Astronomical Telescopes Instruments and Systems |
| primary_location.source.host_organization | https://openalex.org/P4310315543 |
| primary_location.source.host_organization_name | SPIE |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310315543 |
| primary_location.source.host_organization_lineage_names | SPIE |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://www.spiedigitallibrary.org/journals/Journal-of-Astronomical-Telescopes-Instruments-and-Systems/volume-10/issue-1/019001/Laboratory-experiments-of-model-based-reinforcement-learning-for-adaptive-optics/10.1117/1.JATIS.10.1.019001.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Journal of Astronomical Telescopes, Instruments, and Systems |
| primary_location.landing_page_url | https://doi.org/10.1117/1.jatis.10.1.019001 |
| publication_date | 2024-02-22 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W6644691334, https://openalex.org/W3098029385, https://openalex.org/W6665225068, https://openalex.org/W4213298463, https://openalex.org/W3012269970, https://openalex.org/W1967940759, https://openalex.org/W2891835234, https://openalex.org/W2049372684, https://openalex.org/W2966920842, https://openalex.org/W3158115046, https://openalex.org/W2091859238, https://openalex.org/W2106658000, https://openalex.org/W1989358756, https://openalex.org/W3049657153, https://openalex.org/W1969260645, https://openalex.org/W1977963568, https://openalex.org/W2755193435, https://openalex.org/W3080227826, https://openalex.org/W2729910076, https://openalex.org/W2039993623, https://openalex.org/W2152879211, https://openalex.org/W2921225479, https://openalex.org/W2776309731, https://openalex.org/W4281715717, https://openalex.org/W2817594461, https://openalex.org/W2510261629, https://openalex.org/W2972791735, https://openalex.org/W3127137989, https://openalex.org/W3135227764, https://openalex.org/W3214735541, https://openalex.org/W3017328094, https://openalex.org/W4388220985, https://openalex.org/W4377089782, https://openalex.org/W3162544156, https://openalex.org/W4226078592, https://openalex.org/W3107565260, https://openalex.org/W3193724394, https://openalex.org/W4386495337, https://openalex.org/W3086875908, https://openalex.org/W6669402789, https://openalex.org/W1522301498, https://openalex.org/W6840157643, https://openalex.org/W3110899249, https://openalex.org/W2397214950, https://openalex.org/W4282008490, https://openalex.org/W2107712335, https://openalex.org/W2951832675, https://openalex.org/W3188977275, https://openalex.org/W4285586007, https://openalex.org/W3158994024, https://openalex.org/W2058238861, https://openalex.org/W4387362572, https://openalex.org/W2795942194, https://openalex.org/W3112242379, https://openalex.org/W1978106706, https://openalex.org/W3196534416, https://openalex.org/W3098204269, https://openalex.org/W2963173807, https://openalex.org/W2076337359, https://openalex.org/W4390344756, https://openalex.org/W4297965929 |
| referenced_works_count | 61 |
| abstract_inverted_index.A | 62 |
| abstract_inverted_index.a | 95, 121, 188, 195, 293 |
| abstract_inverted_index.AO | 69, 114, 170 |
| abstract_inverted_index.In | 124, 156, 215 |
| abstract_inverted_index.RL | 81, 105, 127, 164 |
| abstract_inverted_index.We | 249, 264 |
| abstract_inverted_index.an | 83, 110, 163 |
| abstract_inverted_index.as | 77, 109 |
| abstract_inverted_index.at | 25, 182 |
| abstract_inverted_index.be | 46, 107, 204 |
| abstract_inverted_index.by | 58 |
| abstract_inverted_index.in | 152, 194, 240 |
| abstract_inverted_index.is | 5, 82, 97, 119, 210 |
| abstract_inverted_index.it | 139 |
| abstract_inverted_index.of | 2, 7, 13, 17, 65, 86, 94, 191, 224, 239, 270, 285 |
| abstract_inverted_index.on | 72, 230 |
| abstract_inverted_index.to | 49, 67, 113, 131, 143, 145, 172, 203, 207, 242 |
| abstract_inverted_index.we | 159, 186, 217 |
| abstract_inverted_index.700 | 237 |
| abstract_inverted_index.ESO | 183 |
| abstract_inverted_index.Our | 198 |
| abstract_inverted_index.RTC | 262 |
| abstract_inverted_index.The | 227 |
| abstract_inverted_index.and | 135, 154, 161, 221, 245, 256, 273, 288 |
| abstract_inverted_index.are | 23 |
| abstract_inverted_index.can | 106 |
| abstract_inverted_index.for | 169, 212, 253, 260, 292 |
| abstract_inverted_index.has | 128, 140 |
| abstract_inverted_index.how | 274 |
| abstract_inverted_index.its | 117 |
| abstract_inverted_index.new | 228 |
| abstract_inverted_index.one | 6 |
| abstract_inverted_index.the | 8, 14, 38, 51, 54, 59, 87, 102, 173, 192, 201, 219, 225, 254, 258, 261, 267, 271, 277, 280, 283, 286, 289 |
| abstract_inverted_index.μs | 238 |
| abstract_inverted_index.(AO) | 41 |
| abstract_inverted_index.also | 265 |
| abstract_inverted_index.been | 129, 141 |
| abstract_inverted_index.code | 252 |
| abstract_inverted_index.cope | 132 |
| abstract_inverted_index.from | 29, 53 |
| abstract_inverted_index.host | 31, 60 |
| abstract_inverted_index.most | 9 |
| abstract_inverted_index.must | 45 |
| abstract_inverted_index.next | 15 |
| abstract_inverted_index.only | 235 |
| abstract_inverted_index.seen | 108 |
| abstract_inverted_index.such | 76 |
| abstract_inverted_index.test | 180 |
| abstract_inverted_index.they | 275 |
| abstract_inverted_index.this | 157 |
| abstract_inverted_index.with | 101, 133 |
| abstract_inverted_index.(RL). | 80 |
| abstract_inverted_index.GHOST | 231 |
| abstract_inverted_index.Thus, | 104 |
| abstract_inverted_index.adapt | 144, 162 |
| abstract_inverted_index.being | 150 |
| abstract_inverted_index.bench | 181 |
| abstract_inverted_index.light | 56 |
| abstract_inverted_index.lower | 294 |
| abstract_inverted_index.paper | 281 |
| abstract_inverted_index.paths | 291 |
| abstract_inverted_index.shown | 130 |
| abstract_inverted_index.small | 26 |
| abstract_inverted_index.star. | 61 |
| abstract_inverted_index.study | 218 |
| abstract_inverted_index.their | 30, 34 |
| abstract_inverted_index.usage | 118 |
| abstract_inverted_index.where | 92, 116, 185 |
| abstract_inverted_index.which | 209 |
| abstract_inverted_index.while | 149 |
| abstract_inverted_index.work, | 158 |
| abstract_inverted_index.Direct | 0 |
| abstract_inverted_index.Python | 246 |
| abstract_inverted_index.active | 84 |
| abstract_inverted_index.affect | 276 |
| abstract_inverted_index.allows | 200 |
| abstract_inverted_index.around | 236 |
| abstract_inverted_index.avenue | 64 |
| abstract_inverted_index.branch | 85 |
| abstract_inverted_index.builds | 71 |
| abstract_inverted_index.called | 166 |
| abstract_inverted_index.field, | 91 |
| abstract_inverted_index.making | 33 |
| abstract_inverted_index.method | 165, 193, 272 |
| abstract_inverted_index.on-sky | 213 |
| abstract_inverted_index.optics | 40, 177 |
| abstract_inverted_index.policy | 167 |
| abstract_inverted_index.source | 284 |
| abstract_inverted_index.stars, | 32 |
| abstract_inverted_index.strong | 189 |
| abstract_inverted_index.system | 96 |
| abstract_inverted_index.(GHOST) | 179 |
| abstract_inverted_index.(PO4AO) | 171 |
| abstract_inverted_index.PyTorch | 233 |
| abstract_inverted_index.angular | 27 |
| abstract_inverted_index.aspects | 223 |
| abstract_inverted_index.control | 43, 70, 74, 93 |
| abstract_inverted_index.crucial | 211 |
| abstract_inverted_index.discuss | 266 |
| abstract_inverted_index.drivers | 12 |
| abstract_inverted_index.errors. | 137 |
| abstract_inverted_index.imaging | 1 |
| abstract_inverted_index.improve | 68 |
| abstract_inverted_index.latency | 287, 295 |
| abstract_inverted_index.learned | 98 |
| abstract_inverted_index.located | 24 |
| abstract_inverted_index.machine | 88 |
| abstract_inverted_index.method. | 226, 278 |
| abstract_inverted_index.running | 232 |
| abstract_inverted_index.sensing | 148 |
| abstract_inverted_index.specify | 257 |
| abstract_inverted_index.through | 99 |
| abstract_inverted_index.turnkey | 122 |
| abstract_inverted_index.Further, | 279 |
| abstract_inverted_index.adaptive | 39, 176 |
| abstract_inverted_index.addition | 241 |
| abstract_inverted_index.approach | 112 |
| abstract_inverted_index.control, | 115 |
| abstract_inverted_index.designed | 48 |
| abstract_inverted_index.entirely | 120 |
| abstract_inverted_index.latency. | 248 |
| abstract_inverted_index.learning | 79, 89 |
| abstract_inverted_index.methods, | 75 |
| abstract_inverted_index.parallel | 206 |
| abstract_inverted_index.possible | 290 |
| abstract_inverted_index.produced | 57 |
| abstract_inverted_index.research | 66, 90 |
| abstract_inverted_index.residual | 55 |
| abstract_inverted_index.system's | 42 |
| abstract_inverted_index.temporal | 134 |
| abstract_inverted_index.training | 153, 202 |
| abstract_inverted_index.GPU-based | 174 |
| abstract_inverted_index.algorithm | 44 |
| abstract_inverted_index.automated | 111 |
| abstract_inverted_index.carefully | 47 |
| abstract_inverted_index.detection | 35 |
| abstract_inverted_index.discusses | 282 |
| abstract_inverted_index.efficient | 151 |
| abstract_inverted_index.exoplanet | 52 |
| abstract_inverted_index.hardware, | 243 |
| abstract_inverted_index.implement | 160 |
| abstract_inverted_index.important | 268 |
| abstract_inverted_index.interface | 247 |
| abstract_inverted_index.nonlinear | 146 |
| abstract_inverted_index.performed | 205 |
| abstract_inverted_index.pipeline, | 244 |
| abstract_inverted_index.pipeline. | 263 |
| abstract_inverted_index.prominent | 10 |
| abstract_inverted_index.promising | 63 |
| abstract_inverted_index.testbench | 178 |
| abstract_inverted_index.wavefront | 147 |
| abstract_inverted_index.Earth-like | 3, 21 |
| abstract_inverted_index.Similarly, | 138 |
| abstract_inverted_index.Typically, | 20 |
| abstract_inverted_index.difficult. | 36 |
| abstract_inverted_index.execution. | 155 |
| abstract_inverted_index.exoplanets | 4, 22 |
| abstract_inverted_index.generation | 16 |
| abstract_inverted_index.high-order | 175 |
| abstract_inverted_index.inference, | 208 |
| abstract_inverted_index.introduces | 234 |
| abstract_inverted_index.laboratory | 196 |
| abstract_inverted_index.operation. | 123, 214 |
| abstract_inverted_index.predictive | 220 |
| abstract_inverted_index.scientific | 11 |
| abstract_inverted_index.data-driven | 73 |
| abstract_inverted_index.demonstrate | 187 |
| abstract_inverted_index.distinguish | 50 |
| abstract_inverted_index.interaction | 100 |
| abstract_inverted_index.model-based | 126 |
| abstract_inverted_index.open-source | 250 |
| abstract_inverted_index.particular, | 125, 216 |
| abstract_inverted_index.performance | 190 |
| abstract_inverted_index.separations | 28 |
| abstract_inverted_index.telescopes. | 19 |
| abstract_inverted_index.demonstrated | 142 |
| abstract_inverted_index.environment. | 103, 197 |
| abstract_inverted_index.ground-based | 18 |
| abstract_inverted_index.optimization | 168 |
| abstract_inverted_index.requirements | 259 |
| abstract_inverted_index.Consequently, | 37 |
| abstract_inverted_index.headquarters, | 184 |
| abstract_inverted_index.reinforcement | 78 |
| abstract_inverted_index.implementation | 199, 229, 255 |
| abstract_inverted_index.hyperparameters | 269 |
| abstract_inverted_index.implementation. | 296 |
| abstract_inverted_index.misregistration | 136 |
| abstract_inverted_index.well-documented | 251 |
| abstract_inverted_index.self-calibrating | 222 |
| cited_by_percentile_year.max | 99 |
| cited_by_percentile_year.min | 98 |
| corresponding_author_ids | https://openalex.org/A5020491745 |
| countries_distinct_count | 4 |
| institutions_distinct_count | 8 |
| corresponding_institution_ids | https://openalex.org/I63548447, https://openalex.org/I9927081 |
| citation_normalized_percentile.value | 0.92472731 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |