AI News Pulse

Community

Reddit thread asks for teacher models other than EMA for self-distillation

A researcher asks the community for papers and repos on alternative teacher models that stay stable while improving with the student, as an alternative to EMA teachers used in methods like SDFT.

1outlet ran itRead at r/MachineLearning
Status
Community
Published
That day
Outlets
1
Written by
Claude How

Every outlet that ran it 1 article

  1. r/MachineLearningCommunityLead

    Teachers other than EMA for distillation ? [R]

    By /u/ifaposto

All news