capability

Quantized agents

This page lists every AI agent in the MeshKore directory tagged with the Quantized capability. Agents are sourced from public platforms (GitHub, Hugging Face, npm, PyPI, awesome-list curations, and direct submissions), normalized by the MeshKore worker, and ranked by GitHub stars. Each card links to the agent's profile with details on capabilities, framework, language, freshness, and source attribution.

22 agents in this capability · ranked by popularity

Top 22 Quantized agents

glm-4-9b-chat-GGUF21 ★

gguf glm chatglm thudm quantized GGUF

Yi-Coder-1.5B-Chat-GGUF18 ★

gguf mistral quantized 2-bit 3-bit 4-bit

glm-4-9b-chat-1m-GGUF18 ★

gguf glm chatglm thudm quantized GGUF

Qwen3-Coder-Next-NVFP418 ★

safetensors qwen3_next NVFP4 quantized llm-compressor compressed-tensors

ChatMusician-GGUF15 ★

transformers gguf mistral quantized 2-bit 3-bit

DeepSeek-V2-Lite-Chat-IMat-GGUF11 ★

gguf quantized GGUF imatrix quantization imat

gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-mlx-4bit10 ★

mlx gemma4 safetensors 4-bit quantized apple-silicon

Yi-1.5-6B-Chat-GGUF9 ★

transformers gguf mistral quantized 2-bit 3-bit

codegeex4-all-9b-IMat-GGUF8 ★

gguf glm codegeex thudm quantized GGUF

Qwen3-Coder-Next-MLX-9bit8 ★

mlx safetensors qwen3_next quantized text-generation conversational

Llama-3-Groq-8B-Tool-Use-GGUF7 ★

transformers gguf mistral quantized 2-bit 3-bit

Yi-Coder-9B-Chat-GGUF7 ★

gguf mistral quantized 2-bit 3-bit 4-bit

Phi-3-Context-Obedient-RAG-GGUF6 ★

transformers gguf mistral quantized 2-bit 3-bit

glm-4-9b-chat-IMat-GGUF5 ★

gguf glm chatglm thudm quantized GGUF

Llama-3-Groq-70B-Tool-Use-GGUF4 ★

gguf quantized 2-bit 3-bit 4-bit 5-bit

Llama-2-7b-chat-hf-function-calling-v2-GGUF4 ★

transformers gguf mistral quantized 2-bit 3-bit

medicine-chat-GGUF4 ★

transformers gguf mistral quantized 2-bit 3-bit

Llama-2-7b-chat-hf-function-calling-v3-GGUF2 ★

transformers gguf mistral quantized 2-bit 3-bit

vigostral-7b-chat-Mistral-7B-Instruct-v0.1-GGUF1 ★

transformers gguf mistral quantized 2-bit 3-bit

Qwen3-Coder-Next-GGUF1 ★

gguf mistral quantized 2-bit 3-bit 4-bit

Qwen3-Coder-Next-REAP-48B-A3B-oQ41 ★

mlx safetensors qwen3_next oq quantized text-generation

Qwen3-Coder-Next-REAP-48B-A3B-oQ3.51 ★

mlx safetensors qwen3_next oq quantized text-generation

Browse other capabilitys