Tag: lm-head

moonshots

Regenerated LM Head

Moonshot hypothesis that most vocabulary rows in the output head should be regenerated from compact descriptors and shared factors rather than stored directly.