Sinoué GAD

Papers

Luth [github] [HuggingFace] — Luth: Efficient French specialization for small language models. Achieved SOTA results on French benchmarks while retaining performance in other languages. Collaborated with LiquidAI to release Luth-LFM2, a series of SLMs fine-tuned for French.
Muon clip [github] — Implemented the Muon optimizer in PyTorch, incorporating the latest research improvements (QK-clipping from Kimi K2, improved Newton–Schulz orthogonalization with gradient matrix eigenvalue estimation). Supports distributed training with PyTorch and DeepSpeed, optimized for scalability.
VLM GRPO [github] — An implementation of GRPO for VLM training, compatible with Unsloth. Collaborated with the Unsloth team to integrate this implementation into their framework.
KADSI [github] — KADSI: Knowledge and AI for Dermatology and Skin Inclusion. Our solution for the 2025 edition of the D4GEN hackaton. Awarded 3rd place.