OMGFormer — Open-Source Parallel Masked Diffusion LM Framework (v2.0.5)

The idea of scaling masked diffusion LMs with such a full training + data pipeline is exciting, especially with parallel generation speed gains. Looking forward to seeing benchmark results and community testing once more compute is available.