Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,266

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 1.25M • 1.28k

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 3 days ago • 27.2k • 215

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 6 days ago • 160k • 210

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 20 days ago • 6.03M • 417

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated 1 day ago • 39k • 71

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 4 days ago • 7.49k • 33

InternScience/Agents-A1-Q4_K_M-GGUF

35B • Updated about 20 hours ago • 25

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated May 31 • 6.42M • 296

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 7 days ago • 40.7k • 46

s-batman/Ornith-1.0-35B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated 4 days ago • 26.5k • 21

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 26 days ago • 356k • 84

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated May 27 • 793 • 37

empero-ai/Qwable-9B-Claude-Fable-5-GGUF

Image-Text-to-Text • 9B • Updated 14 days ago • 31.6k • 52

nvidia/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 84B • Updated 1 day ago • 80 • 16

canada-quant/GLM-5.2-W4A16-MTP

Text Generation • 116B • Updated about 6 hours ago • 138 • 14

Winnougan/Z-Image-Base-Turbo-INT8-Convrot

Text-to-Image • Updated about 20 hours ago • 12

Winnougan/Boogu-INT8

Text-to-Image • Updated 6 days ago • 11

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 2.21M • 107

LordNeel/Ornith-1.0-35B-GGUF-llamacpp-tp1

Text Generation • 35B • Updated 2 days ago • 13k • 9

mudler/Ornith-1.0-35B-APEX-GGUF

35B • Updated 2 days ago • 2.36k • 9

mudler/Agents-A1-APEX-GGUF

35B • Updated 2 days ago • 2.31k • 9

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 18 days ago • 342k • 54

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 35B • Updated about 6 hours ago • 4.88k • 8

InternScience/Agents-A1-FP8

Text Generation • 35B • Updated about 19 hours ago • 8

stepfun-ai/Step-3.7-Flash-GGUF

Image-Text-to-Text • 197B • Updated 30 days ago • 44.7k • 138

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 3.1k • 19

sahilchachra/unlimited-ocr-mxfp8-mlx

Image-Text-to-Text • 1B • Updated 10 days ago • 1.55k • 10

AtomicChat/ornith-9b-GGUF

Text Generation • 9B • Updated 7 days ago • 5.28k • 12

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 2 days ago • 2.39k • 7

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 225k • 524