apoorvparmar007/gemma-2-2b-Q4_K_M-GGUF
Text Generation • 3B • Updated • 50
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
25,976
Active filters: llama-cpp
BafS/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 2.35k • 10
Stark2008/Llama-Phi-3_DoRA-Q8_0-GGUF
4B • Updated • 9
Alex01837178373/gemma-2-2b-it-abliterated-Q4_K_M-GGUF
3B • Updated • 342 • 1
Alex01837178373/gemma-2-2b-it-abliterated-Q5_K_M-GGUF
3B • Updated • 92
newsletter/gemma-2-2b-it-Q6_K-GGUF
Text Generation • 3B • Updated • 29
Stark2008/orca_mini_v7_7b-Q6_K-GGUF
8B • Updated • 11
KnutJaegersberg/gemma-2-2b-it-abliterated-Q8_0-GGUF
3B • Updated • 67 • 4
KnutJaegersberg/gemma-2-2b-it-abliterated-Q4_K_M-GGUF
3B • Updated • 170
martintomov/gemma-2-2b-Q5_K_M-GGUF
Text Generation • 3B • Updated • 33
roshanai/gemma-2-2b-it-Q6_K-GGUF
Text Generation • 3B • Updated • 73 • 2
NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF
Text Generation • 3B • Updated • 36 • 1
ac3xx/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 46
ac3xx/gemma-2-2b-it-Q6_K-GGUF
Text Generation • 3B • Updated • 32
waltervix/gemma-2b-it-Q2_K-GGUF
3B • Updated • 44
waltervix/gemma-2b-it-Q4_K_M-GGUF
3B • Updated • 27
qqqq-hf/Llama3.1-8B-Chinese-Chat-Q4_K_M-GGUF
Text Generation • 8B • Updated • 15
Kondara/gemma-2-9b-it-Q4_K_M-GGUF
Text Generation • 9B • Updated • 21
qqqq-hf/Llama3-8B-Chinese-Chat-Q4_K_M-GGUF
Text Generation • 8B • Updated • 14
Brian314/llama-3-Korean-Bllossom-8B-Q4_K_M-GGUF
8B • Updated • 6
Kondara/gemma-2-2b-it-Q8_0-GGUF
Text Generation • 3B • Updated • 34
Kondara/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation • 3B • Updated • 40
HideOnHouse/Phi-3-mini-4k-instruct-Q4_0-GGUF
Text Generation • 4B • Updated • 26
yabs/gemma-2-27b-Q4_K_M-GGUF
Text Generation • 27B • Updated • 38 • 1
hamminson/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF
Text Generation • 8B • Updated • 29
ironlanderl/gemma-2-2b-it-Q5_K_M-GGUF
Text Generation • 3B • Updated • 29
e-lumos/Llama-3-KoEn-8B-Instruct-preview-Q4_K_M-GGUF
Text Generation • 8B • Updated • 16
delijoe/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF
12B • Updated • 15
latentheat/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 35
delijoe/Mistral-Nemo-Instruct-2407-Q6_K-GGUF
12B • Updated • 15