GitHub · LinkedIn · HuggingFace · Scholar
Download CV
Projects
- Luth
[github]
[HuggingFace]
— Luth: Efficient French specialization for small language models. Achieved SOTA results on French benchmarks while retaining performance in other languages. Collaborated with LiquidAI to release Luth-LFM2, a series of SLMs fine-tuned for French.
- Muon clip
[github]
— Implemented the Muon optimizer in PyTorch, incorporating the latest research improvements (QK-clipping from Kimi K2, improved Newton–Schulz orthogonalization with gradient matrix eigenvalue estimation). Supports distributed training with PyTorch and DeepSpeed, optimized for scalability.
- VLM GRPO
[github]
— An implementation of GRPO for VLM training, compatible with Unsloth. Collaborated with the Unsloth team to integrate this implementation into their framework.
- KADSI
[github]
— KADSI: Knowledge and AI for Dermatology and Skin Inclusion. Our solution for the 2025 edition of the D4GEN hackaton. Awarded 3rd place.