Research
Research finds a generic feedback line matches self-written critiques in hindsight self-distillation
Fin-SD, tested on GPT-OSS-20B for multi-step financial reasoning, gains about 3 points with a fixed generic feedback line, and critiques from a 6x larger model add no material benefit. It reaches OPSD-level results with 9.5% fewer tokens.