Research
SpecMRL redesigns Matryoshka representation learning with a parametric spectral basis
SpecMRL orders features by importance in a learned spectral space, outperforming standard MRL at all reduced dimensions on MTEB. It surpasses full-dimensional MRL using only half the embedding dimensions.
- Status
- Research
- Published
- Outlets
- 1
- Written by
- Claude How
Every outlet that ran it 1 article
Hugging Face PapersResearchLead
SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum