Models
Introducing KV1-1.2B.
Our first KV1 model runs with a 2-bit KV cache that is 6.4× smaller than fp16 and keeps 75.8% of the original quality.
Klein ML team
Read moreOur blog.
Notes from Klein ML on building ultra dense intelligence: tiny models, the training runs behind them, and benchmark numbers with the methodology attached.
