Title here
Summary here
BPW (bits per weight)
A measure of average quantization density. Q4_K_M ≈ 4 BPW, Q6_K ≈ 6 BPW, etc. Useful for comparing quantization schemes across different naming conventions.
Next
Context windowA measure of average quantization density. Q4_K_M ≈ 4 BPW, Q6_K ≈ 6 BPW, etc. Useful for comparing quantization schemes across different naming conventions.