Qwen3.8-Flash-Next-oQ4e-fp16-mtp
This model was converted from Jundot/Qwen3.8-Flash-Next-oQ4e-mtp using this script. It was not requantized, just processed to convert all bf16 parts to fp16, for better performance on M1/M2 machines.
Quantization details
- Model type: qwen4_exp
- Bits: 4
- Group size: 64
- Format: MLX safetensors
- Downloads last month
- 315
Model size
180B params
Tensor type
U32
·
F16 ·
I64 ·
F32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for monroewilliams/Qwen3.8-Flash-Next-oQ4e-fp16-mtp
Base model
Jundot/Qwen3.8-Flash-Next-oQ4e-mtp