Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2311.16502

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

500

Base only

Active filters: 2311.16502

google/gemma-3-1b-it

Text Generation • 1.0B • Updated Apr 4, 2025 • 4.28M • • 1.08k

google/gemma-3-4b-it

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 1.94M • • 1.44k

google/gemma-3-12b-it-qat-q4_0-gguf

Image-Text-to-Text • 12B • Updated Apr 11, 2025 • 1.56k • 291

google/gemma-3-270m

Text Generation • 0.3B • Updated Aug 14, 2025 • 2.15M • 1.06k

google/gemma-3-1b-it-qat-q4_0-gguf

Text Generation • 1.0B • Updated Apr 11, 2025 • 1.19k • 146

ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12, 2025 • 150k • 36

01-ai/Yi-6B-Chat

Text Generation • 6B • Updated Nov 11, 2024 • 23.7k • 72

google/gemma-3-27b-it

Image-Text-to-Text • 27B • Updated Mar 21, 2025 • 853k • • 2.01k

google/gemma-3-12b-it

Image-Text-to-Text • 12B • Updated Mar 21, 2025 • 1.28M • • 797

ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21, 2025 • 44.1k • 57

google/gemma-3-4b-it-qat-q4_0-gguf

Image-Text-to-Text • 4B • Updated Apr 11, 2025 • 2.47k • 274

unsloth/gemma-3-1b-it-unsloth-bnb-4bit

Text Generation • 1B • Updated May 12, 2025 • 14.1k • 12

mozilla-ai/gemma-3-4b-it-llamafile

Text Generation • Updated Mar 31, 2025 • 129 • 7

mozilla-ai/gemma-3-12b-it-llamafile

Text Generation • Updated Mar 31, 2025 • 28 • 3

google/gemma-3-12b-it-qat-q4_0-unquantized

Image-Text-to-Text • 12B • Updated Apr 15, 2025 • 96.6k • • 155

unsloth/gemma-3-1b-it-qat-unsloth-bnb-4bit

Image-Text-to-Text • 1B • Updated May 12, 2025 • 21 • 2

unsloth/gemma-3-1b-it-qat-bnb-4bit

Image-Text-to-Text • 1B • Updated May 12, 2025 • 40 • 2

litert-community/gemma-3-270m-it

Text Generation • Updated Apr 8 • 2k • 58

google/t5gemma-2-1b-1b

Image-Text-to-Text • 2B • Updated Dec 18, 2025 • 24.9k • 82

google/t5gemma-2-4b-4b

Image-Text-to-Text • 9B • Updated Dec 18, 2025 • 29.7k • 155

CCSSNE/llmfan46-Gemma-3-12B-IT-Ultra-Uncensored-Heretic-ComfyUI

Image-Text-to-Text • Updated Apr 21 • 1

01-ai/Yi-34B

Text Generation • 34B • Updated Nov 11, 2024 • 9.01k • 1.3k

01-ai/Yi-6B

Text Generation • 6B • Updated Nov 11, 2024 • 15.7k • 375

01-ai/Yi-34B-200K

Text Generation • 34B • Updated Nov 11, 2024 • 8.96k • 320

01-ai/Yi-6B-200K

Text Generation • 6B • Updated Nov 11, 2024 • 13.4k • 172

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 5

LoneStriker/Yi-6B-200K-4.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 7

LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 6

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 8 • 1

LoneStriker/Yi-6B-200K-8.0bpw-h8-exl2

Text Generation • Updated Mar 16, 2024 • 12 • 1