GGUF
community
AI & ML interests
Our goal is to simplify the process of searching for and exchanging quantized models in GGUF format, as well as to create a space for efficient exchange and access to the models you need
-
itlwas/granite-3b-code-base-2k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3b-code-base-128k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 13 -
itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 10 -
itlwas/granite-3.1-8b-base-Q4_K_M-GGUF
8B β’ Updated β’ 3
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 12 β’ 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 34 β’ 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation β’ 7B β’ Updated β’ 23 β’ 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 7 β’ 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 14 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 4 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation β’ 2B β’ Updated β’ 7 β’ 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation β’ 8B β’ Updated β’ 4 β’ 1
-
matrixportalx/gemma-2-2b-it-abliterated-Q8_0-GGUF
3B β’ Updated β’ 16 -
matrixportalx/gemma-2-9b-it-Q4_0-GGUF
Text Generation β’ 9B β’ Updated β’ 53 β’ 1 -
matrixportalx/gemma-2-9b-it-tr-Q4_0-GGUF
Text Generation β’ 9B β’ Updated β’ 24 -
matrixportalx/gemma-2-2b-it-Q2_K-GGUF
Text Generation β’ 3B β’ Updated β’ 6
-
itlwas/Llama-Guard-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 11 -
itlwas/Llama-Guard-3-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 12 -
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 12 -
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 11
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 19 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 11 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 16 β’ 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 30
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 73 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B β’ Updated β’ 8 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 0.5B β’ Updated β’ 79 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 64
-
itlwas/Llama-3.1-Tulu-3-8B-DPO-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5 -
itlwas/Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 17 -
itlwas/Llama-3.1-Tulu-3-8B-SFT-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 25 -
itlwas/llama-3.1-tulu-2-8b-Q4_K_M-GGUF
8B β’ Updated β’ 9
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B β’ Updated β’ 10 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 24 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 9
-
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 26 β’ 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B β’ Updated β’ 27 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B β’ Updated β’ 28 -
itlwas/FastLlama-3.2-1B-Instruct-Q4_K_M-GGUF
1B β’ Updated β’ 26
-
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B β’ Updated β’ 75 -
itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF
4B β’ Updated β’ 13 β’ 1 -
itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF
4B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.2-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 88
-
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation β’ 4B β’ Updated β’ 49 -
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 5 β’ 1 -
itlwas/phi-1-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 -
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation β’ 14B β’ Updated β’ 9
-
itlwas/granite-3b-code-base-2k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3b-code-base-128k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 13 -
itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 10 -
itlwas/granite-3.1-8b-base-Q4_K_M-GGUF
8B β’ Updated β’ 3
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 12 β’ 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 34 β’ 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation β’ 7B β’ Updated β’ 23 β’ 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 7 β’ 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 14 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 4 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation β’ 2B β’ Updated β’ 7 β’ 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation β’ 8B β’ Updated β’ 4 β’ 1
-
matrixportalx/gemma-2-2b-it-abliterated-Q8_0-GGUF
3B β’ Updated β’ 16 -
matrixportalx/gemma-2-9b-it-Q4_0-GGUF
Text Generation β’ 9B β’ Updated β’ 53 β’ 1 -
matrixportalx/gemma-2-9b-it-tr-Q4_0-GGUF
Text Generation β’ 9B β’ Updated β’ 24 -
matrixportalx/gemma-2-2b-it-Q2_K-GGUF
Text Generation β’ 3B β’ Updated β’ 6
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B β’ Updated β’ 10 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 24 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 9
-
itlwas/Llama-Guard-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 11 -
itlwas/Llama-Guard-3-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 12 -
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 12 -
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 11
-
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 26 β’ 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B β’ Updated β’ 27 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B β’ Updated β’ 28 -
itlwas/FastLlama-3.2-1B-Instruct-Q4_K_M-GGUF
1B β’ Updated β’ 26
-
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B β’ Updated β’ 75 -
itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF
4B β’ Updated β’ 13 β’ 1 -
itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF
4B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.2-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 88
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 19 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 11 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 16 β’ 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 30
-
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation β’ 4B β’ Updated β’ 49 -
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 5 β’ 1 -
itlwas/phi-1-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 -
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation β’ 14B β’ Updated β’ 9
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 73 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B β’ Updated β’ 8 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 0.5B β’ Updated β’ 79 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 64
-
itlwas/Llama-3.1-Tulu-3-8B-DPO-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5 -
itlwas/Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 17 -
itlwas/Llama-3.1-Tulu-3-8B-SFT-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 25 -
itlwas/llama-3.1-tulu-2-8b-Q4_K_M-GGUF
8B β’ Updated β’ 9