ByteDance and Renmin University release iLLaDA, a diffusion-based language model competing with Qwen2.5

The fact

The model matches Qwen2.5's base performance but lags behind after fine-tuning.

Developed through a collaboration between Renmin University researchers and ByteDance, it explores an alternative to dominant autoregressive architectures.