1 item with this tag.

  • papers

    QuaRot

    Paper note on using rotations to remove hidden-state outliers so that weights, activations, and KV cache can all be quantized more uniformly.