Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

268

Base only

Active filters: qat

nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2

Text Generation • 2B • Updated 18 days ago • 56k • 48

SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF

25B • Updated Jun 11 • 8.24k • 32

ji-farthing/gemma-4-qat-q4_0-MTP-assistants-ik-llama-GGUF

0.4B • Updated Jun 8 • 588 • 6

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated Jul 6 • 12k • 53

SC117/gemma-4-E4B-it-heretic-QAT-GGUF

7B • Updated Jun 8 • 3.16k • 22

sakamakismile/Huihui-gemma-4-26B-A4B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 16B • Updated Jun 12 • 1.38k • 5

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 15 days ago • 6.32k • 18

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 13 days ago • 1.8k • 8

FadedRedStar/gemma-4-E2B-it-qat-q4_0-heretic-GGUF

Image-Text-to-Text • 5B • Updated Jul 11 • 9.2k • 7

mlx-community/gemma-4-26B-A4B-it-qat-q4_0-mlx-aligned

Text Generation • 25B • Updated Jul 6 • 397 • 2

DarrenJiaImbue/gemma-4-E4B-it-qat-litertlm

Text Generation • Updated Jul 7 • 1

Wiself/Dark-Scarlett-v1.0-QAT-26B-A4B-Voice

Text Generation • Updated 18 days ago • 1.08k • 2

guga112/gemma-4-E4B-it-heretic-QAT-GGUF

7B • Updated 19 days ago • 816 • 1

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4-W4A4

Image-Text-to-Text • 30B • Updated 13 days ago • 148 • 3

Wiself/Odette-26B-A4B-QAT-Voice

Text Generation • Updated 16 days ago • 486 • 2

Ryannnnnnz/w2_4

4B • Updated 5 days ago • 100 • 1

motionsilse/Gemma-4-12B-QAT-Heretic-StyleTune-GGUF

Text Generation • 13B • Updated 25 days ago • 917 • 1

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 18

Thomaschtl/test3

Text Generation • 0.2B • Updated Jun 4, 2025 • 11

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated Dec 12, 2025 • 106 • 3

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 342

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 1.05k

thebajajra/RexReranker-0.6B-MXFP4

Text Ranking • 0.5B • Updated Jan 24 • 32 • 3

Adanmohh/apuri-v3-0.6b-sft-qat-gguf

0.6B • Updated Jan 14 • 37

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 6

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 15

Harahan/QVGen-Wan-1_3B-W4A4

Text-to-Video • 1B • Updated Feb 2 • 23 • 3

Harahan/QVGen-CogVideoX-2B-W4A4

Text-to-Video • 2B • Updated Feb 2 • 23 • 2