Inference Providers
Active filters: fp_quant
ISTA-DASLab/Qwen3-8B-FPQuant-RTN-MXFP4
Text Generation
• 5B • Updated • 20
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-GPTQ-MXFP4
5B • Updated • 16
ISTA-DASLab/Qwen3-8B-FPQuant-RTNv2-MXFP4
5B • Updated • 14
ISTA-DASLab/Qwen3-8B-FPQuant-GPTQ-MXFP4
5B • Updated • 14
ISTA-DASLab/Qwen3-14B-FPQuant-GPTQ-MXFP4
9B • Updated • 16
ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4
18B • Updated • 12
ISTA-DASLab/Qwen3-4B-FPQuant-RTN-MXFP4
Text Generation
• 2B • Updated • 36
ISTA-DASLab/Qwen3-4B-FPQuant-RTN-NVFP4
Text Generation
• 2B • Updated • 28
ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-NVFP4
Text Generation
• 1B • Updated • 19
ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-MXFP4
Text Generation
• 1B • Updated • 32
ISTA-DASLab/Qwen3-8B-FPQuant-RTN-NVFP4
Text Generation
• 5B • Updated • 23
ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-200steps
Text Generation
• 1B • Updated • 19
ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-600steps
Text Generation
• 1B • Updated • 21
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-200steps
Text Generation
• 5B • Updated • 14
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-600steps
Text Generation
• 5B • Updated • 15
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1400steps
Text Generation
• 5B • Updated • 21
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1000steps
Text Generation
• 5B • Updated • 16
ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-nvfp
Image-Text-to-Text
• 5B • Updated • 21
ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-mxfp
Image-Text-to-Text
• 5B • Updated • 24
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4
5B • Updated • 16
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4
2B • Updated • 23
• 1
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4
2B • Updated • 9
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-MXFP4
5B • Updated • 17
ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4
Text Generation
• 1B • Updated • 22
ISTA-DASLab/Qwen3-4B-FPQuant-QAT-NVFP4
Text Generation
• 2B • Updated • 25
• 1
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4
5B • Updated • 43
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-MXFP4
5B • Updated • 42
ISTA-DASLab/Llama-3.2-1B-Instruct-W4A4-nvfp4-gptq-hadamard-transform-sft-fp_quant
Updated • 11
ISTA-DASLab/Llama-3.2-1B-Instruct-W4A4-nvfp4-gptq-identity-transform-sft-fp_quant
ISTA-DASLab/Llama-3.2-1B-Instruct-W4A4-mxfp4-rtn-identity-transform-sft-fp_quant