Augmenting X-Ray Astronomical Representations with Scientific Knowledge Through Contrastive Learning
Abstract
Astronomers have produced large multimodal datasets that include images, spectra, and time series, and that encode physical information about the observed objects. In addition, a large amount of physics-specific knowledge about these objects has been accumulated in the astronomical literature. We introduce a physics-informed representation alignment framework that matches X-ray observations of astrophysical objects and text summaries describing the physical properties of those sources. We perform contrastive learning between data representations learned using a Poisson process autodecoder and text summary representations generated with a Large Language Model. We demonstrate the generalization capabilities of the system and evaluate the performance of the post-alignment shared representations for regression tasks. We also present a use case for the physical interpretation of newly observed astrophysical sources.
Cite
Text
Martínez-Galarza et al. "Augmenting X-Ray Astronomical Representations with Scientific Knowledge Through Contrastive Learning." ICLR 2025 Workshops: Re-Align, 2025.Markdown
[Martínez-Galarza et al. "Augmenting X-Ray Astronomical Representations with Scientific Knowledge Through Contrastive Learning." ICLR 2025 Workshops: Re-Align, 2025.](https://mlanthology.org/iclrw/2025/martinezgalarza2025iclrw-augmenting/)BibTeX
@inproceedings{martinezgalarza2025iclrw-augmenting,
title = {{Augmenting X-Ray Astronomical Representations with Scientific Knowledge Through Contrastive Learning}},
author = {Martínez-Galarza, Juan Rafael and Vago, Nicolò Oreste Pinciroli and Raval, Shivam and Cuesta-Lazaro, Carolina and Weber, Melanie and Alvarez-Melis, David and Accomazzi, Alberto and Garraffo, Cecilia and Knutson, Joshua and Thill, Ryan and Green, Christopher B. and Ahangama, Imantha},
booktitle = {ICLR 2025 Workshops: Re-Align},
year = {2025},
url = {https://mlanthology.org/iclrw/2025/martinezgalarza2025iclrw-augmenting/}
}