Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,734

Base only

Active filters: quantization

ZTFlynn/LFM2-350M-Cascadia-ternary3

Text Generation • Updated about 2 hours ago

felixhrdyn/mobileclip2-s0-onnx

Feature Extraction • Updated 3 days ago

VikramPal/Muse-Glimmer-30B-hermes-funcall-DynQuant-4bit

Image-Text-to-Text • 4B • Updated about 8 hours ago • 44

VikramPal/Muse-Glimmer-30B-hermes-funcall-DynQuant-3bit

Image-Text-to-Text • 3B • Updated about 8 hours ago • 38

manalejandro/DeepSeek-R1-Distill-Qwen-1-5B-f16-iq3_xxs-GGUF

Text Generation • Updated 4 days ago • 50

ZTFlynn/LFM2.5-230M-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2-350M-Math-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2-350M-ENJP-MT-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2.5-350M-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2-700M-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2-1.2B-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2-1.2B-Extract-Cascadia-ternary3

Text Generation • Updated 1 day ago

engharat2/Qwen3.8-27B-QUASAR-NVFP4-NINFER

Text Generation • Updated 4 days ago • 526

ZTFlynn/LFM2.5-1.2B-Instruct-Cascadia-ternary3

Text Generation • Updated 1 day ago

ZTFlynn/LFM2.5-1.2B-Thinking-Cascadia-ternary3

Text Generation • Updated 1 day ago

J-Fraudster/Qwen3.5-2B-W4A16-AutoRound

Image-Text-to-Text • 1B • Updated 4 days ago • 24

J-Fraudster/Qwen3.5-2B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated 4 days ago • 25

J-Fraudster/Qwen3.5-0.8B-W4A16-AutoRound

Image-Text-to-Text • 0.5B • Updated 4 days ago • 22

J-Fraudster/Qwen3.5-2B-W4A16-AutoRound-LLM-Compressor

Image-Text-to-Text • 2B • Updated 4 days ago • 19

J-Fraudster/Qwen3.5-0.8B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 0.9B • Updated 4 days ago • 21

J-Fraudster/Qwen3.5-0.8B-W4A16-AutoRound-LLM-Compressor

Image-Text-to-Text • 0.9B • Updated 4 days ago • 21

marlalabsAI/Qwen3.8-27B-SX8

Text Generation • 27B • Updated 2 days ago • 357

ajh-code/Fish-Audio-S2-Pro-NVFP4-Balanced

Text-to-Speech • 4B • Updated 4 days ago • 35

arashakb/IMAGEWAM_UR3

Robotics • Updated 3 days ago

manalejandro/Qwen2.5-Coder-1-5B-Instruct-f16-q4_k_m

Text Generation • Updated 4 days ago • 36

jclyons52/Qwen3.8-27B-UD-Q3_K_XL-MLX-gptq-direct

Text Generation • Updated 3 days ago • 61

jclyons52/Qwen3.8-27B-UD-Q3_K_XL-MLX-imatrix-direct

Text Generation • Updated 3 days ago • 499

0xSero/GLM-5.3-Flash-EXL3

Updated 2 days ago

jclyons52/Qwen3.8-27B-UD-Q2_K_XL-MLX-imatrix-direct

Text Generation • Updated 3 days ago • 526

ZTFlynn/LFM2.5-8B-A1B-Cascadia-ternary3

Text Generation • Updated 1 day ago