Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

375,219

Base only

Active filters: text-generation-inference

meta-llama/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 25, 2024 • 5.93M • • 8.34k

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Jun 18, 2025 • 736k • • 5.31k

bytkim/Qwen3.8-27B-pi

Text Generation • 28B • Updated 11 days ago • 2.01k • 70

bytkim/Qwen3.8-27B-pi-GGUF

Text Generation • 27B • Updated 11 days ago • 21.7k • 47

Qwen/Qwen3-0.6B

Text Generation • 0.8B • Updated Jul 26, 2025 • 30.6M • • 1.77k

meta-llama/Llama-3.1-8B

Text Generation • 8B • Updated Oct 16, 2024 • 683k • • 2.63k

deepseek-ai/DeepSeek-R1

Text Generation • 684B • Updated Mar 27, 2025 • 1.12M • • 14.3k

google/medgemma-1.5-4b-it

Image-Text-to-Text • 4B • Updated Apr 13 • 164k • 996

meta-llama/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Oct 24, 2024 • 1.49M • • 2.77k

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 12 days ago • 1.29M • 1.74k

meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 312k • • 3.12k

ponpoke/flux2-klein-9b-uncensored-text-encoder

Text-to-Image • 8B • Updated May 2 • 29.4k • 725

google/gemma-3-4b-it

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 1.17M • • 1.57k

openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 15.6M • 4.22k

google/medgemma-4b-it

Image-Text-to-Text • 4B • Updated Oct 28, 2025 • 773k • 1.1k

meta-llama/Meta-Llama-3-8B

Text Generation • 8B • Updated Sep 27, 2024 • 191k • • 6.74k

meta-llama/Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Oct 24, 2024 • 6.88M • • 1.81k

google/medgemma-27b-it

Image-Text-to-Text • 29B • Updated Jul 10, 2025 • 48.4k • 462

Qwen/Qwen2.5-1.5B-Instruct

Text Generation • 2B • Updated Sep 25, 2024 • 6.31M • • 874

google/paligemma-3b-pt-224

Image-Text-to-Text • 3B • Updated Sep 21, 2024 • 238k • 633

incoai/Qwen3.8-27B-DFlash2

Text Generation • 2B • Updated 24 days ago • 278k • 270

mradermacher/Qwen3.5-9B-Kimi-k3-Distilled-GGUF

9B • Updated 4 days ago • 11.2k • 9

Qwen/Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Sep 25, 2024 • 6.96M • • 666

meta-llama/Llama-3.2-1B

Text Generation • 1B • Updated Oct 24, 2024 • 682k • • 2.68k

Qwen/Qwen3-4B

Text Generation • 4B • Updated Jul 26, 2025 • 12.2M • • 732

Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 9.65M • • 2.09k

meta-llama/Llama-2-7b-hf

Text Generation • 7B • Updated Apr 17, 2024 • 735k • 2.45k

google/gemma-2-2b-it

Text Generation • 3B • Updated Aug 27, 2024 • 462k • • 1.56k

meta-llama/Llama-3.2-3B

Text Generation • 3B • Updated Oct 24, 2024 • 281k • • 1.01k

Qwen/Qwen2.5-Coder-32B-Instruct

Text Generation • 33B • Updated Jan 12, 2025 • 800k • • 2.17k