Second State

company

https://github.com/second-state/LlamaEdge

secondstateinc

second-state

Activity Feed Request to join this org

AI & ML interests

Run open source LLMs across CPU and GPU without changing the binary in Rust and Wasm locally!

second-state 's collections 18

SmolVLM2 GGUF Models

LlamaEdge compatible quants for SmolVLM2 models.

second-state/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 20, 2024 • 738 • 1
second-state/SmolVLM2-500M-Video-Instruct-GGUF

Image-Text-to-Text • 0.4B • Updated May 29, 2025 • 1.31k
second-state/SmolVLM2-256M-Video-Instruct-GGUF

Image-Text-to-Text • 0.2B • Updated May 29, 2025 • 688

Qwen3 GGUF Models

LlamaEdge compatible quants for Qwen3 models.

second-state/Qwen3-30B-A3B-GGUF

31B • Updated May 14, 2025 • 325 • 1
second-state/Qwen3-32B-GGUF

33B • Updated May 1, 2025 • 683 • 13
second-state/Qwen3-14B-GGUF

Text Generation • 15B • Updated May 1, 2025 • 582 • 1
second-state/Qwen3-8B-GGUF

8B • Updated May 1, 2025 • 1.23k • 8

EXAONE-3.5 GGUF Models

LlamaEdge compatible quants for EXAONE-3.5 models.

second-state/EXAONE-3.5-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 21, 2025 • 1.06k
second-state/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 432
second-state/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 529

Gemma-3-it GGUF Models

LlamaEdge compatible quants for Gemma-3-it models.

second-state/gemma-3-27b-it-GGUF

Image-Text-to-Text • 27B • Updated May 19, 2025 • 747
second-state/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 19, 2025 • 1.21k • 2
second-state/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 19, 2025 • 924
second-state/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Jun 11, 2025 • 1.18k

Stable Diffusion models

second-state/stable-diffusion-v1-5-GGUF

Text-to-Image • 1B • Updated Nov 22, 2024 • 43.3k • 39
second-state/stable-diffusion-v-1-4-GGUF

Text-to-Image • 1B • Updated Nov 22, 2024 • 350 • 3
second-state/stable-diffusion-3.5-medium-GGUF

Text-to-Image • 0.7B • Updated Nov 23, 2024 • 20.2k • 13
second-state/stable-diffusion-3.5-large-GGUF

Text-to-Image • 0.7B • Updated Nov 19, 2024 • 22.9k • 18

Qwen2-VL GGUF Models

LlamaEdge compatible quants for Qwen2-VL models.

second-state/Qwen2-VL-72B-Instruct-GGUF

Image-Text-to-Text • 73B • Updated Jan 11, 2025 • 567
second-state/Qwen2-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated Jan 11, 2025 • 1.26k • 4
second-state/Qwen2-VL-2B-Instruct-GGUF

Image-Text-to-Text • 2B • Updated Jan 11, 2025 • 2.14k • 2

Tool Use

LlamaEdge compatible quants for tool-use models.

second-state/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Aug 2, 2024 • 1.04k • 2
second-state/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 31, 2024 • 783 • 2
second-state/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 1.22k • 2
second-state/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Aug 29, 2025 • 878 • 1

Llama-3.2 1B & 3B GGUF Models

LlamaEdge compatible quants for Llama 3.2 3B and 1B Instruct models.

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Feb 8, 2025 • 1.32k • 4
second-state/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Feb 8, 2025 • 980

Yi-1.5 GGUF Models

LlamaEdge compatible quants for Yi-1.5 chat models.

second-state/Yi-1.5-9B-Chat-16K-GGUF

Text Generation • 9B • Updated Jul 2, 2024 • 594 • 5
second-state/Yi-1.5-34B-Chat-16K-GGUF

Text Generation • 34B • Updated Jun 13, 2024 • 644 • 3
second-state/Yi-1.5-9B-Chat-GGUF

Text Generation • 9B • Updated Jul 2, 2024 • 1.12k • 8
second-state/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Aug 28, 2024 • 497 • 3

Qwen2.5-VL GGUF Models

LlamaEdge compatible quants for Qwen2.5-VL models.

second-state/Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated May 17, 2025 • 1.64k
second-state/Qwen2.5-VL-32B-Instruct-GGUF

Image-Text-to-Text • 33B • Updated May 17, 2025 • 659

Tessa-T1 GGUF Models

LlamaEdge compatible quants for Tessa-T1 models.

second-state/Tessa-T1-32B-GGUF

33B • Updated Mar 25, 2025 • 218
second-state/Tessa-T1-3B-GGUF

3B • Updated Mar 25, 2025 • 475
second-state/Tessa-T1-7B-GGUF

8B • Updated Mar 26, 2025 • 542 • 1
second-state/Tessa-T1-14B-GGUF

15B • Updated Mar 26, 2025 • 225

EXAONE-Deep GGUF Models

LlamaEdge compatible quants for EXAONE-Deep models.

second-state/EXAONE-Deep-32B-GGUF

Text Generation • 32B • Updated Mar 21, 2025 • 518
second-state/EXAONE-Deep-7.8B-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 437 • 1
second-state/EXAONE-Deep-2.4B-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 600

DeepSeek-R1 Distilled GGUF Models

LlamaEdge compatible quants for DeepSeek-R1 distilled models.

second-state/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Feb 13, 2025 • 888
second-state/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Feb 13, 2025 • 680 • 1
second-state/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • 15B • Updated Jan 21, 2025 • 2.69k • 2
second-state/DeepSeek-R1-Distill-Qwen-32B-GGUF

Text Generation • 33B • Updated Jan 21, 2025 • 501

Falcon3-Instruct GGUF Models

LlamaEdge compatible quants for Falcon3-Instruct models.

second-state/Falcon3-10B-Instruct-GGUF

Text Generation • 10B • Updated Jan 11, 2025 • 368 • 1
second-state/Falcon3-7B-Instruct-GGUF

Text Generation • 7B • Updated Jan 11, 2025 • 398 • 2
second-state/Falcon3-3B-Instruct-GGUF

Text Generation • 3B • Updated Jan 11, 2025 • 380
second-state/Falcon3-1B-Instruct-GGUF

Text Generation • 2B • Updated Jan 11, 2025 • 683

Qwen2.5-Coder

LlamaEdge compatible quants for Qwen2.5-Coder models.

second-state/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Nov 11, 2024 • 723 • 1
second-state/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 634
second-state/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 11, 2024 • 496
second-state/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 11, 2024 • 684

InternLM-2.5 GGUF

LlamaEdge compatible quants for InternLM-2.5 models.

second-state/internlm2_5-7b-chat-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 1.01k • 1
second-state/internlm2_5-20b-chat-GGUF

Text Generation • 20B • Updated Aug 7, 2024 • 800
second-state/internlm2_5-1_8b-chat-GGUF

Text Generation • 2B • Updated Aug 7, 2024 • 519

Qwen-2.5 GGUF Models

LlamaEdge compatible quants for Qwen 2.5 instruct and coder models.

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • 73B • Updated Sep 20, 2024 • 611 • 1
second-state/Qwen2.5-32B-Instruct-GGUF

Text Generation • 33B • Updated Sep 19, 2024 • 829
second-state/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 678
second-state/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 871

FLUX.1 GGUF Models

LlamaEdge compatible quants for FLUX.1 models.

second-state/FLUX.1-schnell-GGUF

Text-to-Image • 83.8M • Updated Sep 25, 2024 • 5.49k • 17
second-state/FLUX.1-dev-GGUF

Text-to-Image • 0.1B • Updated Sep 28, 2024 • 2.05k • 14
second-state/FLUX.1-Redux-dev-GGUF

Text-to-Image • 64.5M • Updated Nov 26, 2024 • 315 • 15
second-state/FLUX.1-Canny-dev-GGUF

Text-to-Image • 12B • Updated Nov 25, 2024 • 268 • 13

SmolVLM2 GGUF Models

LlamaEdge compatible quants for SmolVLM2 models.

second-state/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Nov 20, 2024 • 738 • 1
second-state/SmolVLM2-500M-Video-Instruct-GGUF

Image-Text-to-Text • 0.4B • Updated May 29, 2025 • 1.31k
second-state/SmolVLM2-256M-Video-Instruct-GGUF

Image-Text-to-Text • 0.2B • Updated May 29, 2025 • 688

Qwen2.5-VL GGUF Models

LlamaEdge compatible quants for Qwen2.5-VL models.

second-state/Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated May 17, 2025 • 1.64k
second-state/Qwen2.5-VL-32B-Instruct-GGUF

Image-Text-to-Text • 33B • Updated May 17, 2025 • 659

Qwen3 GGUF Models

LlamaEdge compatible quants for Qwen3 models.

second-state/Qwen3-30B-A3B-GGUF

31B • Updated May 14, 2025 • 325 • 1
second-state/Qwen3-32B-GGUF

33B • Updated May 1, 2025 • 683 • 13
second-state/Qwen3-14B-GGUF

Text Generation • 15B • Updated May 1, 2025 • 582 • 1
second-state/Qwen3-8B-GGUF

8B • Updated May 1, 2025 • 1.23k • 8

Tessa-T1 GGUF Models

LlamaEdge compatible quants for Tessa-T1 models.

second-state/Tessa-T1-32B-GGUF

33B • Updated Mar 25, 2025 • 218
second-state/Tessa-T1-3B-GGUF

3B • Updated Mar 25, 2025 • 475
second-state/Tessa-T1-7B-GGUF

8B • Updated Mar 26, 2025 • 542 • 1
second-state/Tessa-T1-14B-GGUF

15B • Updated Mar 26, 2025 • 225

EXAONE-3.5 GGUF Models

LlamaEdge compatible quants for EXAONE-3.5 models.

second-state/EXAONE-3.5-32B-Instruct-GGUF

Text Generation • 32B • Updated Mar 21, 2025 • 1.06k
second-state/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 432
second-state/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 529

EXAONE-Deep GGUF Models

LlamaEdge compatible quants for EXAONE-Deep models.

second-state/EXAONE-Deep-32B-GGUF

Text Generation • 32B • Updated Mar 21, 2025 • 518
second-state/EXAONE-Deep-7.8B-GGUF

Text Generation • 8B • Updated Mar 21, 2025 • 437 • 1
second-state/EXAONE-Deep-2.4B-GGUF

Text Generation • 2B • Updated Mar 21, 2025 • 600

Gemma-3-it GGUF Models

LlamaEdge compatible quants for Gemma-3-it models.

second-state/gemma-3-27b-it-GGUF

Image-Text-to-Text • 27B • Updated May 19, 2025 • 747
second-state/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 19, 2025 • 1.21k • 2
second-state/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 19, 2025 • 924
second-state/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Jun 11, 2025 • 1.18k

DeepSeek-R1 Distilled GGUF Models

LlamaEdge compatible quants for DeepSeek-R1 distilled models.

second-state/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Feb 13, 2025 • 888
second-state/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Feb 13, 2025 • 680 • 1
second-state/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • 15B • Updated Jan 21, 2025 • 2.69k • 2
second-state/DeepSeek-R1-Distill-Qwen-32B-GGUF

Text Generation • 33B • Updated Jan 21, 2025 • 501

Stable Diffusion models

second-state/stable-diffusion-v1-5-GGUF

Text-to-Image • 1B • Updated Nov 22, 2024 • 43.3k • 39
second-state/stable-diffusion-v-1-4-GGUF

Text-to-Image • 1B • Updated Nov 22, 2024 • 350 • 3
second-state/stable-diffusion-3.5-medium-GGUF

Text-to-Image • 0.7B • Updated Nov 23, 2024 • 20.2k • 13
second-state/stable-diffusion-3.5-large-GGUF

Text-to-Image • 0.7B • Updated Nov 19, 2024 • 22.9k • 18

Falcon3-Instruct GGUF Models

LlamaEdge compatible quants for Falcon3-Instruct models.

second-state/Falcon3-10B-Instruct-GGUF

Text Generation • 10B • Updated Jan 11, 2025 • 368 • 1
second-state/Falcon3-7B-Instruct-GGUF

Text Generation • 7B • Updated Jan 11, 2025 • 398 • 2
second-state/Falcon3-3B-Instruct-GGUF

Text Generation • 3B • Updated Jan 11, 2025 • 380
second-state/Falcon3-1B-Instruct-GGUF

Text Generation • 2B • Updated Jan 11, 2025 • 683

Qwen2-VL GGUF Models

LlamaEdge compatible quants for Qwen2-VL models.

second-state/Qwen2-VL-72B-Instruct-GGUF

Image-Text-to-Text • 73B • Updated Jan 11, 2025 • 567
second-state/Qwen2-VL-7B-Instruct-GGUF

Image-Text-to-Text • 8B • Updated Jan 11, 2025 • 1.26k • 4
second-state/Qwen2-VL-2B-Instruct-GGUF

Image-Text-to-Text • 2B • Updated Jan 11, 2025 • 2.14k • 2

Qwen2.5-Coder

LlamaEdge compatible quants for Qwen2.5-Coder models.

second-state/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Nov 11, 2024 • 723 • 1
second-state/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 634
second-state/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 11, 2024 • 496
second-state/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 11, 2024 • 684

Tool Use

LlamaEdge compatible quants for tool-use models.

second-state/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Aug 2, 2024 • 1.04k • 2
second-state/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 31, 2024 • 783 • 2
second-state/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 1.22k • 2
second-state/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Aug 29, 2025 • 878 • 1

InternLM-2.5 GGUF

LlamaEdge compatible quants for InternLM-2.5 models.

second-state/internlm2_5-7b-chat-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 1.01k • 1
second-state/internlm2_5-20b-chat-GGUF

Text Generation • 20B • Updated Aug 7, 2024 • 800
second-state/internlm2_5-1_8b-chat-GGUF

Text Generation • 2B • Updated Aug 7, 2024 • 519

Llama-3.2 1B & 3B GGUF Models

LlamaEdge compatible quants for Llama 3.2 3B and 1B Instruct models.

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Feb 8, 2025 • 1.32k • 4
second-state/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Feb 8, 2025 • 980

Qwen-2.5 GGUF Models

LlamaEdge compatible quants for Qwen 2.5 instruct and coder models.

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • 73B • Updated Sep 20, 2024 • 611 • 1
second-state/Qwen2.5-32B-Instruct-GGUF

Text Generation • 33B • Updated Sep 19, 2024 • 829
second-state/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 678
second-state/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 871

Yi-1.5 GGUF Models

LlamaEdge compatible quants for Yi-1.5 chat models.

second-state/Yi-1.5-9B-Chat-16K-GGUF

Text Generation • 9B • Updated Jul 2, 2024 • 594 • 5
second-state/Yi-1.5-34B-Chat-16K-GGUF

Text Generation • 34B • Updated Jun 13, 2024 • 644 • 3
second-state/Yi-1.5-9B-Chat-GGUF

Text Generation • 9B • Updated Jul 2, 2024 • 1.12k • 8
second-state/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Aug 28, 2024 • 497 • 3

FLUX.1 GGUF Models

LlamaEdge compatible quants for FLUX.1 models.

second-state/FLUX.1-schnell-GGUF

Text-to-Image • 83.8M • Updated Sep 25, 2024 • 5.49k • 17
second-state/FLUX.1-dev-GGUF

Text-to-Image • 0.1B • Updated Sep 28, 2024 • 2.05k • 14
second-state/FLUX.1-Redux-dev-GGUF

Text-to-Image • 64.5M • Updated Nov 26, 2024 • 315 • 15
second-state/FLUX.1-Canny-dev-GGUF

Text-to-Image • 12B • Updated Nov 25, 2024 • 268 • 13

AI & ML interests

Team members 8

second-state 's collections 18