8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

2026-11-01来源 dev.to OpenSourceEnglish

Try it

Live chat with Qwen3.8-27B and Qwen3.5-2B v2 in your browser: https://huggingface.co/spaces/harshit-genrius/pingala8-qwen35-live

Originally published at https://genrius-ai.github.io/pingala8-llm/2-bit-quantization-8-models-cost.html

This article was written with the help of AI; every number comes from our measured logs and the paper.

原文：https://www.a8q9.cn/en/article/8-open-models-77-85-smaller-what-2-bit-quantization-costs-and-what-it-keeps-4d5dc3.html

相关文章