karamjotsingh
/

Qwen2.5-3B-Instruct

Model card Files Files and versions

No model card

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including karamjotsingh/Qwen2.5-3B-Instruct

GPTQ DeepCompressor

GPTQ models for nn.Linear 4bit weight & 16bit activation (symmetric) integer quantization • 7 items • Updated May 31