Product
LoRA Speedrun Public Leaderboard: Fine-tune Qwen2.5-1.5B to 61.1% Accuracy on GSM8K in 6 Minutes 5 Seconds
The LoRA Speedrun project has launched a public leaderboard, competing on the fine-tuning runtime of Qwen2.5-1.5B on fixed hardware (single L40S). The current record is held by @Saivineeth147 at 6 minutes 5 seconds, using sequence packing and completion-only loss masking, achieving approximately 2x speedup over the baseline of 11 minutes 57 seconds with higher accuracy (61.1%). The project provides a free Modal sandbox for verification, and any submission must be confirmed by three independent reproductions.
Read the original (opens in a new tab)
News stream data aggregated by AI HOT