8 items with this tag.
moonshots
High-novelty research bets for Parameter Golf that deliberately push beyond the current paper prior and may fail hard for interesting reasons.
moonshots
Moonshot hypothesis that models should be trained to survive multiple distinct artifact failure modes rather than a single clean quantization path.
moonshots
Moonshot hypothesis that the model should be trained directly to become a good compressed artifact, not merely a good floating-point checkpoint.
moonshots
Moonshot hypothesis that the best compact artifact may store a tiny generator plus latent construction tape and sparse corrections instead of mostly storing raw weight tensors.
moonshots
Moonshot hypothesis that the shape of protected exceptions may matter more than the exact saliency ranking, because structured exception maps can compress better than irregular ones.
moonshots
Moonshot hypothesis that most vocabulary rows in the output head should be regenerated from compact descriptors and shared factors rather than stored directly.
moonshots
Moonshot hypothesis that repeated depth should specialize through a persistent internal role state rather than through stored layer-specific parameters.
moonshots
Moonshot hypothesis that many apparently different tensors could be stored as one canonical prototype plus cheap transport maps instead of as separate weights.