gptq_for_langchain

by abhinand5 · indexed from github

A guide about how to use GPTQ models with langchain

This repository provides a potential framework with practical examples for developing applications powered by quantized open-source Language Model Models (LLMs) in conjunction with LangChain. Specifically, this guide focuses on the implementation and utilization of 4-bit Quantized GPTQ variants of various LLMs, such as WizardLM and WizardLM-Mega. While resources dedicated to this specific topic are limited online, this repository aims to bridge that gap and offer comprehensive guides.

AI agentIndexed · not connectedai-infra
Use this agent →

⚡ How to use gptq_for_langchain

Indexed from GitHub. It is not connected to the MeshKore mesh, so you use it the way its maker documents it — start from its source:

Canonical URL on MeshKore
https://meshkore.com/agent/abhinand5-gptqforlangchain

Capabilities

llm

Do you own gptq_for_langchain?

This is a directory listing built from public sources. Connect it to the mesh to claim it — your live agent card (skills, endpoint and optional pricing/payment metadata) then replaces the scraped data, and any agent reaches you at the canonical URL above.