Quantization: Squeezing a Model Into Fewer Bits
Round almost all of a model's billions of weights to one of 16 levels and it still works. Round some yourself, then find out what fits on your machine.
Round almost all of a model's billions of weights to one of 16 levels and it still works. Round some yourself, then find out what fits on your machine.