AI News Pulse

Community

ApexW, a PyTorch optimizer with compact states and Triton kernels, posted for feedback

The developer reports a Triton plus compact-state path about 1.5x faster than PyTorch fused AdamW on a few large tensors, with optimizer-state memory roughly halved. Small-tensor workloads are much slower, at about 0.21x in one test, and results come from optimizer-only benchmarks.

1outlet ran itRead at r/MachineLearning
Status
Community
Published
That day
Outlets
1
Written by
Claude How

Every outlet that ran it 1 article

  1. r/MachineLearningCommunityLead

    I built a PyTorch optimizer for large GPU workloads — looking for feedback[P]

    By /u/Ready_Parking_5435

All news