Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,781

Base only

Active filters: quantization

slevinw/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

Image-Text-to-Text • 28B • Updated 11 days ago • 631

vcruz305/Muse-Glimmer-30B-Hermes-Agentic-NVFP4

Image-Text-to-Text • 19B • Updated 11 days ago • 18

MESHIVEAI/Qwen-3.8-27B-Q4_K_M-Imatrix

Text Generation • 27B • Updated 7 days ago • 28

casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8

36B • Updated 7 days ago • 162

mesiu650/GR00T-N1.6-LIBERO-llm-w4a4-flatquant-tf32

Updated 11 days ago • 6

LayerNorm/Qwen3-ASR-0.6B-hf-hqq-int4

Automatic Speech Recognition • 0.5B • Updated 11 days ago • 15

Kindadodgy/qwen38-256k-on-16gb

Text Generation • 27B • Updated 10 days ago • 366 • 1

matbee/LFM2.5-350M-Instruct-ONNX-Vulkan

Text Generation • Updated 10 days ago

arashakb/FastWAM_UR3

Robotics • Updated 9 days ago

xedro98/quantization-as-a-transfer-constraint

Updated 10 days ago • 1

altaidevorg/turkish-bge-m3-model2vec-turboquant-4bit

Feature Extraction • Updated 10 days ago • 12

neopolita/Qwen3.8-84B-A53B-Niwaki-v2-experimental-mlx

Text Generation • 84B • Updated 8 days ago • 149

nightscape/Intern-S2-Mobius-4bit-mlx

Text Generation • 35B • Updated 10 days ago • 45

Vandita/QuantizedSarcBERT-static-v2

Text Classification • Updated 8 days ago • 31

vcruz305/granite-4.2-30b-GGUF

Text Generation • 29B • Updated 9 days ago • 392

darioooooo0o/granite-4.2-8b-G-Q5-GGUF

9B • Updated about 17 hours ago • 441 • 1

kaushik3009/industrial-vision-agent

Updated 9 days ago

hmarchant/speaker-id-joint-int8

Updated 9 days ago • 29

hmarchant/speaker-id-joint-mlx-int8

Updated 9 days ago • 27

hmarchant/speaker-id-joint-int4

Updated 9 days ago • 21

lackonendes/PAW-35B-A3B-GGUF

4B • Updated 9 days ago • 419

marwanelamami/nabra-82m-int4qat-onnx

Text-to-Speech • Updated 9 days ago

marwanelamami/nabra-82m-int8-onnx

Text-to-Speech • Updated 9 days ago

marwanelamami/nabra-82m-fp16-onnx

Text-to-Speech • Updated 9 days ago

Lucierr8732/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated 9 days ago • 13

marwanelamami/nabra-82m-sherpa-onnx

Text-to-Speech • Updated 4 days ago

0xKitkat/Qwen3.8-Flash-Next-GGUF

Image-Text-to-Text • Updated 9 days ago • 3

Ttimms/Ornith-1.5-35B-A3B-REAP-50-NVFP4A16

Text Generation • 19B • Updated about 24 hours ago • 904 • 1

Nichonauta/LFM2.5-230M-ToMoE-INT8

Text Generation • 0.2B • Updated 9 days ago • 50

Nichonauta/LFM2.5-230M-ToMoE-INT4

Text Generation • 0.1B • Updated 9 days ago • 143