capability

Gguf agents

This page lists every AI agent in the MeshKore directory tagged with the Gguf capability. Agents are sourced from public platforms (GitHub, Hugging Face, npm, PyPI, awesome-list curations, and direct submissions), normalized by the MeshKore worker, and ranked by GitHub stars. Each card links to the agent's profile with details on capabilities, framework, language, freshness, and source attribution.

252 agents in this capability · ranked by popularity

Top 200 Gguf agents

stable-code-3b659 ★

transformers safetensors gguf stablelm text-generation causal-lm

Qwen3-Coder-30B-A3B-Instruct-GGUF584 ★

transformers gguf unsloth qwen3 qwen text-generation

Qwen3-Coder-Next-GGUF569 ★

gguf qwen3_next unsloth qwen qwen3 text-generation

Llama-2-7B-Chat-GGUF513 ★

transformers gguf llama facebook meta pytorch

GLM-4.7-Flash-Uncensored-Heretic-NEO-CODE-Imatrix-MAX-GGUF331 ★

gguf GLM 4.7 Flash thinking reasoning NEO Imatrix MAX Quants

Llama3.1-8B-Chinese-Chat264 ★

transformers safetensors gguf llama text-generation llama-factory

Qwen2.5-Coder-7B-Instruct-GGUF221 ★

transformers gguf code codeqwen chat qwen

Qwen3-Coder-Next-GGUF216 ★

transformers gguf text-generation arxiv:2309.00071 license:apache-2.0 endpoints_compatible

Llama-2-13B-chat-GGUF204 ★

transformers gguf llama facebook meta pytorch

Qwen2.5-Coder-32B-Instruct-GGUF194 ★

transformers gguf code codeqwen chat qwen

Codestral-22B-v0.1-GGUF193 ★

gguf code text-generation base_model:mistralai/Codestral-22B-v0.1…

stable-code-instruct-3b183 ★

transformers safetensors gguf stablelm text-generation causal-lm

ruvltra-claude-code176 ★

gguf ruvltra claude-code code-generation sona adaptive-learning

Qwen3-Coder-480B-A35B-Instruct-GGUF175 ★

transformers gguf unsloth qwen3 qwen text-generation

Llama3-8B-Chinese-Chat-GGUF-8bit168 ★

transformers gguf llama text-generation llama-factory orpo

CodeLlama-7B-Instruct-GGUF146 ★

transformers gguf llama llama-2 text-generation code

Qwen3-Coder-30B-A3B-Instruct-1M-GGUF144 ★

transformers gguf unsloth qwen3 qwen text-generation

DeepSeek-Coder-V2-Lite-Instruct-GGUF140 ★

gguf text-generation license:other endpoints_compatible region:us imatrix

Llama-2-7b-chat-hf-function-calling-v2138 ★

transformers safetensors gguf llama text-generation facebook

CodeLlama-7B-GGUF131 ★

transformers gguf llama llama-2 text-generation code

CodeLlama-13B-Instruct-GGUF131 ★

transformers gguf llama llama-2 text-generation code

Llama-2-70B-Chat-GGUF122 ★

transformers gguf llama facebook meta pytorch

Qwen2.5-Coder-14B-Instruct-GGUF113 ★

transformers gguf code codeqwen chat qwen

TinyLlama-1.1B-Chat-v0.6111 ★

transformers safetensors gguf llama text-generation conversational

CodeQwen1.5-7B-Chat-GGUF110 ★

gguf chat text-generation en arxiv:2309.16609 license:other

Qwen2.5.1-Coder-7B-Instruct-GGUF109 ★

gguf code codeqwen chat qwen qwen-coder

CodeLlama-34B-Instruct-GGUF109 ★

transformers gguf llama llama-2 text-generation code

Qwen2.5-Coder-32B-Instruct-GGUF103 ★

gguf code codeqwen chat qwen qwen-coder

Gemma-2-9B-Chinese-Chat78 ★

transformers safetensors gguf gemma2 text-generation llama-factory

DeepSeek-Coder-V2-Lite-Instruct-GGUF78 ★

gguf text-generation base_model:deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct…

Yi-34B-Chat-GGUF75 ★

transformers gguf yi text-generation base_model:01-ai/Yi-34B-Chat base_model:quantized:01-ai/Yi-34B-Chat

Qwen1.5-7B-Chat-GGUF70 ★

gguf chat text-generation en arxiv:2309.16609 license:other

Qwen2.5-Coder-3B-Instruct-GGUF69 ★

transformers gguf code codeqwen chat qwen

Orion-14B-Chat68 ★

transformers pytorch gguf orion text-generation code

Qwen1.5-14B-Chat-GGUF67 ★

gguf chat text-generation en arxiv:2309.16609 license:other

CodeLlama-70B-Instruct-GGUF63 ★

transformers gguf llama llama-2 text-generation code

agentica-org_DeepCoder-14B-Preview-GGUF61 ★

gguf text-generation en dataset:PrimeIntellect/verifiable-coding-problems dataset:likaixin/TACO-verified…

CodeLlama-7B-Python-GGUF61 ★

transformers gguf llama llama-2 text-generation code

Llama-3-8B-Instruct-Finance-RAG-GGUF59 ★

transformers gguf finance text-generation en dataset:virattt/financial-qa-10K

CodeLlama-13B-GGUF59 ★

transformers gguf llama llama-2 text-generation code

Jan-code-4b-gguf58 ★

transformers gguf agent text-generation en base_model:janhq/Jan-code-4b

CodeLlama-34B-GGUF55 ★

transformers gguf llama llama-2 text-generation code

Qwen3-4B-toolcalling-gguf-codex50 ★

safetensors gguf qwen3 function-calling tool-calling codex

Strand-Rust-Coder-14B-v1-GGUF46 ★

transformers gguf text-generation dataset:Fortytwo-Network/Strandset-Rust-v1 arxiv:2510.24801 arxiv:2409.08386

Qwen2.5-Coder-1.5B-Instruct-GGUF45 ★

transformers gguf code codeqwen chat qwen

CodeLlama-70B-Python-GGUF45 ★

transformers gguf llama llama-2 text-generation code

LFM2-1.2B-RAG-GGUF44 ★

transformers gguf liquid lfm2 edge text-generation

Qwen3.5-9b-Sushi-Coder-RL-GGUF44 ★

gguf llama.cpp qwen3_5 code rl atropos

Qwen2.5-Coder-14B-Instruct-GGUF43 ★

gguf code codeqwen chat qwen qwen-coder

Llama-3-ChatQA-1.5-8B-GGUF41 ★

gguf nvidia chatqa-1.5 chatqa llama-3 pytorch

Qwen2.5-Coder-7B-Instruct-GGUF41 ★

transformers gguf code codeqwen chat qwen

agentica-org_DeepScaleR-1.5B-Preview-GGUF40 ★

gguf text-generation en dataset:AI-MO/NuminaMath-CoT dataset:KbsdJames/Omni-MATH…

Qwen2.5-Coder-32B-Instruct-abliterated-GGUF40 ★

gguf code codeqwen chat qwen qwen-coder

CodeLlama-34B-Python-GGUF38 ★

transformers gguf llama llama-2 text-generation code

CodeLlama-13B-Python-GGUF36 ★

transformers gguf llama llama-2 text-generation code

Qwen1.5-0.5B-Chat-GGUF35 ★

gguf chat text-generation en arxiv:2309.16609 license:other

Qwen3-Coder-30B-A3B-Instruct-GGUF35 ★

transformers gguf qwen qwen3 qwen3-coder byteshape

Mistral-7B-Instruct-v0.1-function-calling-v233 ★

transformers safetensors gguf mistral text-generation pytorch

stable-cypher-instruct-3b33 ★

transformers safetensors gguf stablelm text-generation causal-lm

cerebras_Qwen3-Coder-REAP-25B-A3B-GGUF32 ★

gguf text-generation base_model:cerebras/Qwen3-Coder-REAP-25B-A3B…

gemma-2-9b-it-russian-function-calling-GGUF30 ★

transformers safetensors gguf gemma2 text-generation conversational

Qwen2.5-Coder-14B-Instruct-abliterated-GGUF29 ★

gguf code codeqwen chat qwen qwen-coder

CodeShell-7B-Chat-int428 ★

transformers pytorch gguf codeshell text-generation wisdomshell

Codestral-22B-v0.1-GGUF28 ★

gguf code text-generation base_model:mistralai/Codestral-22B-v0.1…

Llama3-8B-Chinese-Chat-GGUF-4bit27 ★

transformers gguf llama text-generation llama-factory orpo

Qwen3-Coder-30B-A3B-Instruct-GGUF27 ★

gguf text-generation base_model:Qwen/Qwen3-Coder-30B-A3B-Instruct…

law-chat-GGUF25 ★

transformers gguf llama legal text-generation en

Tiny-Agent-a-3B24 ★

transformers safetensors gguf qwen2 text-generation code

Llama-3.1-TAIDE-R1-8B-Chat23 ★

transformers safetensors gguf llama text-generation mergekit

llama-2-7b-langchain-chat-GGUF23 ★

transformers gguf llama text-generation en es

h2o-danube3-4b-chat-GGUF22 ★

transformers gguf gpt llm large language model h2o-llmstudio

glm-4-9b-chat-GGUF21 ★

gguf glm chatglm thudm quantized GGUF

Qwen1.5-1.8B-Chat-GGUF21 ★

gguf chat text-generation en arxiv:2309.16609 license:other

Qwen2.5-Coder-7B-Instruct-GGUF21 ★

transformers gguf code codeqwen chat qwen

Qwen3-Coder-Next-MXFP4_MOE-GGUF21 ★

gguf text-generation base_model:Qwen/Qwen3-Coder-Next base_model:quantized:Qwen/Qwen3-Coder-Next…

llama3_8b_chat_uncensored20 ★

transformers tensorboard safetensors gguf llama text-generation

WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF20 ★

transformers gguf code qwen-coder finetune text-generation

Qwen3-Zero-Coder-Reasoning-0.8B-NEO-EX-GGUF20 ★

gguf merge programming code generation code codeqwen

codegeex4-all-9b-GGUF20 ★

gguf glm codegeex thudm text-generation zh

Yi-Coder-9B-Chat-GGUF19 ★

transformers gguf text-generation base_model:01-ai/Yi-Coder-9B-Chat…

Qwen2.5-Coder-3B-Instruct-GGUF19 ★

gguf code codeqwen chat qwen qwen-coder

Qwen3-Zero-Coder-Reasoning-V2-0.8B-NEO-EX-GGUF19 ★

gguf merge programming code generation code codeqwen

Qwen2.5-Coder-32B-GGUF19 ★

gguf code qwen qwen-coder codeqwen text-generation

distil-home-assistant-functiongemma18 ★

transformers safetensors gguf gemma3_text text-generation tool-calling

Yi-Coder-1.5B-Chat-GGUF18 ★

gguf mistral quantized 2-bit 3-bit 4-bit

glm-4-9b-chat-1m-GGUF18 ★

gguf glm chatglm thudm quantized GGUF

huihui-ai_Qwen3-Coder-Next-abliterated-GGUF18 ★

gguf abliterated uncensored text-generation base_model:huihui-ai/Huihui-Qwen3-Coder-Next-abliterated…

Qwen_Qwen3-Coder-Next-GGUF18 ★

gguf text-generation base_model:Qwen/Qwen3-Coder-Next base_model:quantized:Qwen/Qwen3-Coder-Next…

Qwen2.5-Coder-0.5B-Instruct-GGUF18 ★

transformers gguf code codeqwen chat qwen

Llama-3-Groq-8B-Tool-Use-GGUF17 ★

gguf facebook meta pytorch llama llama-3

Yi-Coder-9B-Chat-GGUF17 ★

transformers gguf text-generation base_model:01-ai/Yi-Coder-9B-Chat…

medicine-chat-GGUF17 ★

transformers gguf llama biology medical text-generation

Qwen2.5-Coder-1.5B-Q8_0-GGUF17 ★

transformers gguf code qwen qwen-coder codeqwen

Qwen2.5-Coder-3B-Instruct-abliterated-GGUF17 ★

gguf code codeqwen chat qwen qwen-coder

Qwen1.5-4B-Chat-GGUF16 ★

gguf chat text-generation en arxiv:2309.16609 license:other

h2o-danube3-500m-chat-GGUF16 ★

transformers gguf gpt llm large language model h2o-llmstudio

OrionStar-Yi-34B-Chat-Llama-GGUF16 ★

transformers gguf yi text-generation base_model:OrionStarAI/OrionStar-Yi-34B-Chat-Llama…

Seed-Coder-8B-Reasoning-GGUF16 ★

transformers gguf llama text-generation unsloth base_model:ByteDance-Seed/Seed-Coder-8B-Reasoning

ChatMusician-GGUF15 ★

transformers gguf mistral quantized 2-bit 3-bit

baichuan2-7b-chat-gguf15 ★

gguf baichuan chinese text-generation zh en

FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-v0.1-GGUF15 ★

gguf text-generation base_model:FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview…

Qwen3-Coder-Next-GGUF15 ★

gguf imatrix conversational qwen3_next ik_llama.cpp text-generation

Qwen2.5-Coder-7B-Instruct-abliterated-GGUF14 ★

gguf chat abliterated uncensored text-generation en

Openai_gpt-oss-20b-CODER-NEO-CODE-DI-MATRIX-GGUF14 ★

gguf gpt_oss gpt-oss openai mxfp4 programming

granite-8b-code-instruct-4k-GGUF13 ★

transformers gguf code granite text-generation dataset:bigcode/commitpackft

Qwen3.5-27b-Sushi-Coder-RL-GGUF13 ★

gguf llama.cpp qwen3_5 code rl atropos

glm-4-9b-chat-abliterated-GGUF12 ★

transformers gguf glm chatglm thudm chat

ruGPT-3.5-13B-erotic-kink-chat-lora-merge-gguf12 ★

gguf text-generation ru en endpoints_compatible region:us

Qwen2.5-Coder-14B-GGUF12 ★

gguf code qwen qwen-coder codeqwen text-generation

Qwen2.5-Coder-14B-n8n-Workflow-Generator12 ★

mlx safetensors gguf qwen2 n8n workflow

Seed-Coder-8B-Instruct-GGUF12 ★

transformers gguf llama text-generation unsloth base_model:ByteDance-Seed/Seed-Coder-8B-Instruct

gemma-2-9b-it-function-calling-GGUF11 ★

transformers safetensors gguf gemma2 text-generation conversational

DeepSeek-V2-Lite-Chat-IMat-GGUF11 ★

gguf quantized GGUF imatrix quantization imat

Qwen2.5-Coder-1.5B-Instruct-GGUF10 ★

transformers gguf code codeqwen chat qwen

agentica-org_DeepSWE-Preview-GGUF9 ★

gguf text-generation en dataset:R2E-Gym/R2E-Gym-Subset base_model:agentica-org/DeepSWE-Preview…

Athene-V2-Agent-GGUF9 ★

gguf RLHF Nexusflow Athene Function Calling Agent

Yi-1.5-6B-Chat-GGUF9 ★

transformers gguf mistral quantized 2-bit 3-bit

Yi-1.5-9B-Chat-GGUF9 ★

gguf text-generation license:apache-2.0 endpoints_compatible region:us conversational

Indian_law_chat_minor_project9 ★

transformers pytorch gguf llama text-generation text2text-generation

Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF9 ★

transformers gguf llama-cpp gguf-my-repo text-generation base_model:Qwen/Qwen3-Coder-30B-A3B-Instruct

Qwen2.5-Coder-7B-Q8_0-GGUF9 ★

transformers gguf code qwen qwen-coder codeqwen

Deepseek-Coder-6.7B-Instruct-GGUF9 ★

transformers gguf llama text-generation base_model:deepseek-ai/deepseek-coder-6.7b-instruct…

Tiny-Agent-a-0.5B8 ★

transformers safetensors gguf qwen2 text-generation code

Athene-V2-Agent-GGUF8 ★

gguf RLHF Nexusflow Athene Function Calling Agent

mcp-tool-use-quality-ranger-0.6b-GGUF8 ★

gguf qwen3 text-generation-inference mcp text-generation en

LFM2.5-1.2B-Nova-Function-Calling-GGUF8 ★

transformers gguf lfm2 text-generation function-calling liquid-neural-network

Unreal-Blueprint-Assistant8 ★

adapter-transformers gguf text-generation dataset:blueprintninja/unrealsample endpoints_compatible region:us

Mistral-7B-v0.3-Chinese-Chat-uncensored8 ★

transformers safetensors gguf mistral text-generation text-generation-inference

Yi-1.5-9B-Chat-GGUF8 ★

transformers gguf llama text-generation base_model:01-ai/Yi-1.5-9B-Chat…

manticore-13b-chat-pyg-GGUF8 ★

transformers gguf llama text-generation en dataset:anon8231489123/ShareGPT_Vicuna_unfiltered

Qwen2.5-Coder-0.5B-Q8_0-GGUF8 ★

transformers gguf code qwen qwen-coder codeqwen

codegeex4-all-9b-IMat-GGUF8 ★

gguf glm codegeex thudm quantized GGUF

Qwen2.5-Coder-3B-Q8_0-GGUF8 ★

transformers gguf code qwen qwen-coder codeqwen

granite-8b-code-instruct-GGUF8 ★

transformers gguf ibm-granite-code code granite text-generation

Tiny-Agent-a-1.5B7 ★

transformers safetensors gguf qwen2 text-generation code

Llama-3-Groq-8B-Tool-Use-GGUF7 ★

transformers gguf mistral quantized 2-bit 3-bit

Llama-3-Groq-70B-Tool-Use-GGUF7 ★

gguf facebook meta pytorch llama llama-3

gemma-2-27b-it-function-calling-GGUF7 ★

transformers safetensors gguf gemma2 text-generation conversational

Qwen2.5-Coder-7B-Instruct-Home-Assistant7 ★

gguf Home Assistant HomeAssistant text-generation dataset:acon96/Home-Assistant-Requests-V2

Yi-Coder-9B-Chat-GGUF7 ★

gguf mistral quantized 2-bit 3-bit 4-bit

glm-edge-4b-chat-gguf7 ★

gguf glm edge text-generation zh en

Qwen3-coder-REAP-25B-A3B-Rust-GGUF7 ★

gguf code-generation quantization qwen3 qwen-coder cerebras

Qwen2.5-Coder-3B-Instruct-GGUF7 ★

gguf code codeqwen chat qwen qwen-coder

Coder-GRPO-3B7 ★

transformers pytorch safetensors gguf qwen2 text-generation

Rombos-Coder-V2.5-Qwen-14b-GGUF7 ★

gguf code qwen qwen-coder codeqwen text-generation

speechless-coder-ds-6.7b7 ★

transformers pytorch gguf llama text-generation code

codegemma-2b-GGUF7 ★

transformers gguf text-generation license:gemma endpoints_compatible region:us

llama-3-8B-function-calling-GGUF6 ★

gguf text-generation endpoints_compatible region:us conversational

Phi-3-Context-Obedient-RAG-GGUF6 ★

transformers gguf mistral quantized 2-bit 3-bit

glm-edge-1.5b-chat-gguf6 ★

gguf glm edge text-generation zh en

luvGPT_phi3-uncensored-chat-GGUF6 ★

gguf roleplay phi-3 conversational phi-3-mini character

Llama3-ChatQA-1.5-8B-GGUF6 ★

gguf nvidia chatqa-1.5 chatqa llama-3 pytorch

Heidrun-Mistral-7B-chat6 ★

transformers pytorch safetensors gguf mistral text-generation

Qwen2.5-Coder-14B-Instruct-GGUF6 ★

gguf code codeqwen chat qwen qwen-coder

DeepSeek-Coder-V2-Lite-Instruct-GGUF6 ★

transformers gguf deepseek_v2 text-generation custom_code…

Qwen2.5-Coder-3B-GGUF6 ★

gguf code qwen qwen-coder codeqwen text-generation

Qwen2.5-Coder-7B-GGUF6 ★

transformers gguf code qwen qwen-coder codeqwen

codegemma-1.1-7b-it-GGUF6 ★

transformers gguf text-generation license:gemma endpoints_compatible region:us

zephyr-7b-beta-function-calling-v25 ★

transformers safetensors gguf mistral text-generation facebook

Phi-3-Context-Obedient-RAG-GGUF5 ★

gguf text-generation license:cc-by-sa-4.0 endpoints_compatible region:us conversational

glm-4-9b-chat-IMat-GGUF5 ★

gguf glm chatglm thudm quantized GGUF

Vigostral-7B-Chat-GGUF5 ★

transformers gguf mistral LLM finetuned text-generation

speechless-zephyr-code-functionary-7b5 ★

transformers safetensors gguf mistral text-generation en

gemma-2b-it-Q4_K_M-GGUF5 ★

transformers gguf gemma text-generation llama-cpp gguf-my-repo

Qwen2.5-Coder-32B-Instruct-GGUF5 ★

gguf code codeqwen chat qwen qwen-coder

Qwen3-Coder-Next-80B-APEX-I-Quality-GGUF5 ★

gguf GGUF imatrix APEX coding agent

agentica-org_DeepCoder-1.5B-Preview-GGUF4 ★

gguf text-generation en dataset:PrimeIntellect/verifiable-coding-problems dataset:likaixin/TACO-verified…

SWE-agent-LM-32B-GGUF4 ★

transformers gguf agent software engineering text-generation en

jupyter-agent-qwen3-4b-AIO-GGUF4 ★

transformers gguf qwen3 jupyter-agent text-generation-inference kaggle

Llama-3-Groq-8B-Tool-Use-GGUF4 ★

gguf facebook meta pytorch llama llama-3

Llama-3-Groq-70B-Tool-Use-GGUF4 ★

gguf quantized 2-bit 3-bit 4-bit 5-bit

Llama-2-7b-chat-hf-function-calling-v2-GGUF4 ★

transformers gguf mistral quantized 2-bit 3-bit

glm-4-9b-chat-1m-GGUF4 ★

gguf glm chatglm thudm text-generation zh

glm-4-9b-chat-GGUF4 ★

gguf glm chatglm thudm text-generation zh

Yi-Coder-1.5B-Chat-GGUF4 ★

gguf text-generation base_model:01-ai/Yi-Coder-1.5B-Chat base_model:quantized:01-ai/Yi-Coder-1.5B-Chat…

Llama-Chat-Summary-3.2-3B-GGUF4 ★

transformers gguf llama safetensors ollama llama-cpp

DeepSeek-V2-Lite-Chat-GGUF4 ★

transformers gguf deepseek_v2 text-generation custom_code base_model:deepseek-ai/DeepSeek-V2-Lite-Chat

Deepseek-LLM-7B-Chat-GGUF4 ★

transformers gguf llama text-generation base_model:deepseek-ai/deepseek-llm-7b-chat…

finance-chat-GGUF4 ★

transformers pytorch gguf llama text-generation finance

medicine-chat-GGUF4 ★

transformers gguf mistral quantized 2-bit 3-bit

Qwen3-Coder-30B-A3B-Instruct-FP8-Q4_K_M-GGUF4 ★

transformers gguf llama-cpp gguf-my-repo text-generation base_model:Qwen/Qwen3-Coder-30B-A3B-Instruct-FP8

Qwen2.5-Coder-7B-Q4_K_M-GGUF4 ★

transformers gguf code qwen qwen-coder codeqwen

Qwen2.5-Coder-0.5B-GGUF4 ★

gguf code qwen qwen-coder codeqwen text-generation

Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF4 ★

gguf text-generation base_model:Qwen/Qwen2.5-Coder-14B-Instruct…

deepseek-coder-6.7B-kexer-GGUF4 ★

gguf code text-generation dataset:JetBrains/KExercises base_model:JetBrains/deepseek-coder-6.7B-kexer…

DeepSeek-Coder-V2-Instruct-0724-GGUF4 ★

gguf text-generation base_model:deepseek-ai/DeepSeek-Coder-V2-Instruct-0724…

Qwen2.5-Coder-32B-Instruct-SOTA-GGUF4 ★

gguf code codeqwen chat qwen qwen-coder

deepseek-coder-1.3B-kexer-GGUF4 ★

gguf code text-generation dataset:JetBrains/KExercises base_model:JetBrains/deepseek-coder-1.3B-kexer…

Qwen2.5-Coder-0.5B-Instruct-GGUF4 ★

gguf code codeqwen chat qwen qwen-coder

nomic-ai_nomic-embed-code-GGUF4 ★

sentence-transformers gguf sentence-similarity feature-extraction text-generation…

LFM2-1.2B-RAG-GGUF3 ★

transformers gguf liquid lfm2 edge text-generation

Yi-1.5-6B-Chat-GGUF3 ★

gguf text-generation license:apache-2.0 endpoints_compatible region:us conversational

Llama-2-13B-Chat-GGUF3 ★

transformers gguf facebook meta pytorch llama

Yi-34B-Chat-GGUF3 ★

transformers gguf llama text-generation base_model:01-ai/Yi-34B-Chat base_model:quantized:01-ai/Yi-34B-Chat

internlm2-limarp-chat-20b-GGUF3 ★

gguf mergekit merge text-generation en dataset:lemonilia/LimaRP

llama3_8b_chat_brainstorm_plus-GGUF3 ★

gguf text-generation dataset:DevQuasar/brainstorm_vicuna_10k license:llama3 endpoints_compatible region:us

Gemma-2-9B-Chinese-Chat-Uncensored3 ★

safetensors gguf gemma2 text-generation-inference code unsloth

Qwen2.5-Coder-14B-Q8_0-GGUF3 ★

transformers gguf code qwen qwen-coder codeqwen

Qwen2.5-Coder-1.5B-Instruct-GGUF3 ★

transformers gguf code codeqwen chat qwen

Qwen2.5-Coder-0.5B-Instruct-GGUF3 ★

gguf code codeqwen chat qwen qwen-coder

Browse other capabilitys