My latest projects
Luth: Efficient French specialization for small language models. Achieved SOTA results on French benchmarks while retaining performance in other languages. Collaborated with LiquidAI to release Luth-LFM2, a series of SLMs fine-tuned for French.
Implemented the Muon optimizer in PyTorch, incorporating the latest research improvements (QK-clipping from Kimi K2, improved Newton–Schulz orthogonalization with gradient matrix eigenvalue estimation). Supports distributed training with PyTorch and DeepSpeed, optimized for scalability.
An implementation of GRPO for VLM training, compatible with Unsloth. Collaborated with the Unsloth team to integrate this implementation into their framework.
KADSI: Knowledge and AI for Dermatology and Skin Inclusion. Our solution for the 2025 edition of the D4GEN hackaton. Awarded 3rd place.
A portfolio website made with Astro JS.
A flexible MLP implementation from scratch with numpy.