Bonsai 2 27B: what 1.76 bits per weight buys you over a Q4 GGUF
How to run PrismML's 5.9 GB ternary Qwen3.8 27B locally, what it scores next to a 17.6 GB Q4 quant, and the fork, long-context and vision costs the headline hides.
Tagged
Tagged
How to run PrismML's 5.9 GB ternary Qwen3.8 27B locally, what it scores next to a 17.6 GB Q4 quant, and the fork, long-context and vision costs the headline hides.