What is Matryoshka Representation Learning (MRL)?

Matryoshka Representation Learning teaches a single model to pack useful signal into the prefix of its embedding. You can then truncate vectors (e.g., 768→256→128→64 dims) to trade tiny drops in quality for big wins in latency, storage, and bandwidth—without retraining separate models.