> ## Content Index
> Fetch the complete content index at: https://www.anup.io/llms.txt
> Use this file to discover other available public pages before exploring further.

# TIL: Quantisation
- URL: https://www.anup.io/til-quantisation/
- Published: 2026-03-28T09:45:57.000Z
- Updated: 2026-05-09T20:56:36.000Z
- Description: Quantisation is really a precision-allocation problem.
- Author: Anup Jadhav
- Tags: #til, Quantisation

Spent some time properly working through quantisation this week.

I liked this [piece](https://ngrok.com/blog/quantization?ref=anup.io) (from ngrok) because it does not stop at “make the model smaller”. It gets into the actual mechanics: lower-bit representations, scale factors, dequantisation, and the trade-off between compression and error.

I also implemented a small version of the workflow locally to make the ideas concrete for myself. The bit that stood out most was how different symmetric and asymmetric quantisation can be once you actually look at the error distribution, rather than just the file size.

My main takeaway is that quantisation is really a precision-allocation problem. The question is not just how much you can compress a model, but how much numerical fidelity you can give up before your task stops working.