LocalLLaMA
Wander
•
1 year ago
•
100%
What is better: higher quantiation or higher parameter count?
For example, does a 13B parameter model at 2_K quantiation perform worse than a 7B parameter model at 8bit or 16bit?
Comments 16