Agent frameworks & infrastructure

Agent frameworks & SDKs

12,596 agents · most starred first

Agent frameworks & SDKs, page 86 of 126

llm_toolchain

Giving LLMs the tools for real impact.

llm_tooluse

Automate tooluse with LLMs

llm_wrapper

Run llm functions with just inline documentation and no code

llm_xml_parser

A minimal XML parser for structured output from LLM

llmada

提升了系统

llmaestro

A system for orchestrating LLM tasks that exceed context limits

llmage

A framework for simplifying the development of AI systems based on LLMs.

llmaix

Add your description here

llmake
llmalchemy

A full-access agent pattern.

llmasp

Combining LLMs and ASP for intelligent problem-solving and reasoning.

llmatch

Reliable LLM interaction with pattern matching and retries.

llmatch-messages

Reliable LLM interaction with pattern matching and retries.

llmatch-validate

A new package designed to process and validate user inputs using advanced language models, ensuring structured and consistent responses. This package leverages the capabilities of llmatch-messages to

llmate
llmatic

No BS utilities for developing with LLMs

llmbda-fastapi
llmbox

LLMs at your service

llmbrick

A modular LLM application development framework

llmbrix

Low abstraction agentic LLM framework.

llmchatlinker

LLMChatLinker is a Middleware SDK designed to facilitate interaction between clients and Large Language Models (LLMs).

llmcompiler

LLMCompiler

llmconveyors

Python SDK for the LLM Conveyors AI Agent Platform API

llmcore

LLMCore: Essential tools for LLM development - models, prompts, embeddings, agents, chains, and more.

llmcraft

Specwright - Python framework for LLM-assisted development with runtime spec validation

llmdantic

LLMdantic is a Python package that provides structured interaction with LLMs.

llmdev

Tools for LLM applications development

llmdk

LLM Development Kit for common APIs

llmeasy

Easy to use LLM interface

llments

llments

llmer

llmer is a lightweight Python library designed to streamline the development of applications leveraging large language models (LLMs). It provides high-level APIs and utilities for parallel processing, runtime management, file handling, and prompt generation, reducing the overhead of repetitive tasks.

llmesh

HPE LLM Agentic Tool Mesh Platform is an innovative platform designed to streamline and enhance the use of AI in various applications. It serves as a central hub to orchestrate 'Intelligent Plugins,' optimizing AI interactions and processes.

llmesh-llrepr

Reserved name — llrepr: typed Representation IR ("LLVM-for-expression") for the FullSense ecosystem. Reference implementation currently lives in llmesh as llmesh.llrepr.

llmfast

It's a Python LLM package

llmflow-core

Deterministic LLM workflow engine

llmflows

LLMFlows - Simple, Explicit and Transparent LLM Apps

llmfn
llmfoo

Automatically make the OpenAI tool JSON Schema, parsing call and constructing the result to the chat model.

llmforge

Placeholder package to reserve the llmforge name

llmframe

OpenAI-first hexagonal Python application scaffold for llmframe.

llmfunc
llmfuncs

Dynamically generate JSON Schema from Python code.

llmfunctionclient
llmfy

`LLMfy` is a framework for developing applications with large language models (LLMs).

llmgen

Effortlessly generate LLM APIs by simply defining input and output schemas.

llmgine

An application framework for building LLM-powered applications.

llmhelper

大模型辅助函数库

llmhive

Python library for interacting with Large Language Models.

llmify

light weight llm utilities for scalable AI apps

llmify-decorator

Library for replacing function calls with LLM inference.

llming-com

Where JavaScript, Python, and AI agents speak the same language

llmint

Llmint python library

llmio

Easily connect large language models into your application

llmir

Core message and tool IR for LLM pipelines

llmling

A backend for pydantic-AI agents and MCP servers.

llmling-models

Pydantic-AI models for AgentPool

llmlink

LLMLink is a Python package that allows users to easily create LLM-powered Gradio applications

llmlinks

Add your description here

llmloader

Loads a Langchain LLM by model name as a string.

llmm
llmmodelsapi

SDK for interfacing with core models hosted by LLM Solutions

llmockapi

An LLM-powered mock API server that dynamically generates realistic API responses based on OpenAPI/Swagger specifications.

llmoji

Making agents cuter

llmonad

Compositional framework for LLMs

llmonpy

AI pipeline framework for Python.

llmops
llmpackagetestidk

A test package for llm

llmpipeline

LLMPipeline is a Python package designed to optimize the performance of tasks related to Large Language Models (LLMs)

llmproc

A simple framework for LLM-powered applications

llmprogram

A Python package for creating and running LLM programs.

llmprototyping

A lightweight set of tools to use several llm and embeddings apis

llmpy-lib

Easily interact with all main LLMs

llmq

todo

llmrails

LLMRails SDK

llmrepo

A package for building and managing tools for Large Language Models

llmrf

轻量级的 LLM 响应格式化工具,支持标准响应和流式响应

llmrix-skill

A professional Git-based Skill management library for LLM agents.

llmrun

LLM Stack Python SDK

llms-combo

A simple example package

llmschema

A structured response wrapper for LLMs using Pydantic.

llmscope

a Python library designed to simplify interactions with Large Language Models (LLMs) by providing a stateful, fluent interface for managing conversation history, tool usage, and response parsing. It leverages libraries like `mirascope` for LLM calls and `pydantic` for data validation and parsing.

llmskit

Client and Tools for LLMs

llmstack

Low-code platform to build generative AI apps, chatbots and agents with your data

llmstatemachine

A Python library for building GPT-powered agents with state machine logic and chat history memory.

llmstitch

A provider-agnostic LLM toolkit with tool calling, skills, and parallel execution.

llmt

LLMT aims to make it easy to programatically connect OpenAI and HuggingFace models to your data pipelines, CI/CD, or personal workspaces.

llmtaskkit

A Python bookstore to simplify the definition, execution and chaining of tasks using LLMS.

llmterface

Intentionally Simple. Generic LLM interface

llmtext

A simple llm library.

llmtk

Type-safe function registration and validation for LLM function calls

llmtools

A package with useful functions for working with Large Language Models

llmware

An enterprise-grade LLM-based development framework, tools, and fine-tuned models

llmxml

XML parsing for LLM outputs

llmy
llmyaml

YAML-based LLM configuration and execution

llmz

llmz

llmzoo

Lightweight, extensible LLM toolkit: chat, embeddings, vector stores (Chroma, Milvus Lite).

local-agent-core

Standalone agentic framework for local LLMs via Ollama — reliable tool calling, session persistence, and loop guards

local-agents

Minimal experimental framework for building agents with local LLM deployments. Zero bloat, maximum simplicity.

local-llm-function-calling

A tool for generating function arguments and choosing what function to call with local LLMs

More in Agent frameworks & infrastructure