Research
MemT-1.0 paper introduces memory foundation models with internalized memory
The paper presents MemT-1.0-Nano and MemT-1.0-Flash, trained on 34B tokens. At 128K tokens, Nano reports about 1.86x end-to-end inference speedup and a 66x reduction in persistent storage versus full context KV cache.
Every outlet that ran it 1 article
r/LocalLLaMACommunityLead