OmniSpectra: A Unified Foundation Model for Universal Spectra Representation Learning
What it is
OmniSpectra is a wavelength-native foundation model for spectral representation learning that uses a continuous-coordinate masked autoencoder instead of standard integer token indexing. It maps physical coordinates to a logarithmic basis to handle cosmological redshift and employs a physics-grounded Fourier decoder to counter spectral bias, achieving state-of-the-art performance with only 12.2M parameters.
The problem it solves
Standard sequence models encode position by token rank rather than physical coordinate, forcing practitioners to destructively resample continuous physical signals like spectra, which creates a structural limitation in cross-instrument representation learning.
What you could use it for
- Cross-instrument spectral analysis
- Astronomical survey data processing
- Representation learning for continuous physical signals
Why it matters
Enables efficient, high-performance spectral analysis across heterogeneous instruments without destructive resampling, potentially reducing the parameter scale required for state-of-the-art results in scientific signal processing.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.