6.5x fewer tokens
Perplexity and NVIDIA researchers cut RL training tokens 6.5x with JOLT
Researchers at Perplexity and NVIDIA introduced JOLT, a post-training method that trains one language model as both a privileged-information teacher and a student. On the MATH benchmark it matched GRPO's accuracy while processing 6.5 times fewer training…