Category

Data, search & knowledge

11,544 agents

Every agent in Data, search & knowledge, page 7 of 116

Delphic★ 316

Starter App to Build Your Own App to Query Doc Collections with Large Language Models (LLMs) using LlamaIndex, Langchain, OpenAI and more (MIT Licensed)

Chatette★ 316

A powerful dataset generator for Rasa NLU, inspired by Chatito

agent-fetch★ 316

Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, multi-strategy article extraction, and web scraping.

dory★ 316

AI-native SQL client for humans and agents. Query, explore, visualize, and open agent database work as editable SQL workspaces.

blockify-agentic-data-optimization★ 316

Blockify: Agentic data optimization for enterprise RAG and agentic search. Blockify replaces naive chunking with deduplicated IdeaBlocks — ≈78X accuracy aggregate improvement, 2.29X vector search accuracy, 40X compression, 3.09X token efficiency. Integrates with LlamaIndex, LangChain, Obsidian, Milvus, Elastic, Supabase, Cloudflare.

llm-reader★ 315

Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

RAGLAB★ 314

[EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation

gfm-rag★ 314

[NeurIPS'25, ICLR'26] Graph Foundation Model for Retrieval Augmented Generation

rag-research-agent-template★ 313
bookwith★ 312

BookWith – A New Reading Experience with AI. A next-generation conversational reading platform that goes beyond traditional e-book readers

notion-chat-langchain★ 311

A notion chatbot for your knowledge base built with langchain, typescript/javascript and pinecone.

reader★ 311

📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/

Graph-CoT★ 311

Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (ACL 2024)

gamewiki★ 311

An intelligent Wiki overlay tool designed specifically for gamers, featuring GEMINI-powered RAG (Retrieval-Augmented Generation) capabilities for smart Q&A services.

jina-cli★ 311

A lightweight CLI tool wrapping Jina AI Reader API for AI Agents. Fetch and parse any URL into LLM-friendly formats (Markdown/Text/HTML). Perfect for reading X(Twitter), blogs, and news sites.

DataPup★ 310

A modern, AI-assisted, cross-platform database client - free

sqlkit★ 308

Agentic SQL database manager for 40+ databases — PostgreSQL, MySQL, SQL Server, SQLite, DuckDB, ClickHouse, Oracle and more. Lightweight, privacy-first, AI-powered, cross-platform. Built with Tauri (Rust).

releem-agent★ 308

Releem is a MySQL performance tuning tool with AI and controlled automation. Improve query performance and resource efficiency with workload-based recommendations.

KG-Pipeline★ 306

Converting Unstructured Data to a Knowledge Graph: An End-to-End Pipeline

knowledge-rag★ 306

Local RAG server for Claude Code, Cursor and other MCP clients: hybrid BM25 + vector search with cross-encoder reranking on by default, 13 MCP tools, 33 file types including code, re-indexing on file changes. One Python process with embedded ChromaDB and FastEmbed ONNX: no Docker, database server or API key; offline after the first model download.

llm-wiki-v2★ 306

Turn your documents into a Markdown wiki you can read, that answers with citations. Works with any LLM provider, Ollama included. CROW: 99.5% right note read vs 79%, 1.6× faster ingest, 63% fewer LLM tokens, no scaling limit.

semantic-cache★ 305

A fuzzy key value store based on semantic similarity rather lexical equality.

MinerU-HTML★ 302

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

digcrawl★ 302

Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI.

KnowledgeBase-RAG-LLM-System★ 301

轻量级本地知识库 RAG 问答系统 · Streamlit + LangChain + Chroma,支持知识库上传与检索增强问答

datasetGPT★ 300

A command-line interface to generate textual and conversational datasets with LLMs.

qKnow★ 300

qKnow is an open-source agent platform for enterprise knowledge intelligence and industry AI. It provides knowledge graphs, RAG, and bot building, encapsulating industry AI into standardized modules for rapid deployment. Supporting unified integration of documents and data, it helps enterprises quickly build knowledge hubs and AI solutions.

Argus★ 300

🌱 Argus 是一个基于 RAG 架构的开源知识库平台,后端采用 Java 21 + Spring Boot + MyBatis-Plus + PostgreSQL/pgvector,前端采用 Vue 3 + TypeScript + Element Plus,AI 层基于 Spring AI Alibaba(通义千问)+ ReactAgent 图引擎,以 MinIO + Elasticsearch 为存储与检索引擎。

laravel-ask-database★ 298

Query your database using natural language

py-idp★ 298

AI-enabled Intelligent Document Processing for Python: 12+ LLM backends, Pydantic schemas, self-hosted OCR (Nanonets-OCR2-3B), auto-schema discovery, HITL review, prod FastAPI server. AGPL-3.0 + commercial.

awesome-rag-production★ 297

A curated list of battle-tested tools, frameworks, and best practices for building scalable, production-grade Retrieval-Augmented Generation (RAG) systems.

moore-wechat-article-downloader★ 297

本地优先的微信内容情报库:同步公众号文章,保存精选评论和互动数据,供 Codex/Claude Code 做内容研究。

openDomain★ 297

Git-native, evidence-backed domain semantic layer for AI agents and human maintainers.

denser-retriever★ 295

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

ezdata★ 294

AI-native data platform: 60+ connectors, dlt-based ETL, DAG scheduling, per-source RAG knowledge bases, and sandboxed AI agents that query, chart, and analyze your data.

knowledge-gpt★ 293

Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.

Revornix★ 292

Revornix is an open-source, local-first AI information/markdown workspace. It helps you collect fragmented inputs, turn them into structured knowledge, generate reports with images and podcast audio, and deliver the output through automated notifications.

teracrawl★ 291

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

pagesift★ 291

Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.

DeepWideResearch★ 290

Agentic RAG for any scenario. Customize sources, depth, and width

local-LLM-with-RAG★ 290

Running local Language Language Models (LLM) to perform Retrieval-Augmented Generation (RAG)

llama-github★ 289

Llama-github is an open-source Python library that empowers LLM Chatbots, AI Agents, and Auto-dev Solutions to conduct Agentic RAG from actively selected GitHub public projects. It Augments through LLMs and Generates context for any coding question, in order to streamline the development of sophisti

OpenConstructionEstimate-DDC-CWICR★ 289

Open multilingual construction cost database for AI Agents - 55K+ work items, 27K+ resources, 30 regions. Semantic search via Qdrant vector DB

pdfdeal★ 288

A python wrapper for the Doc2X API and comes with native texts processing (to improve PDF recall in RAG). | Doc2X API的python封装,同时附带本地的文本处理(提升PDF在RAG中的召回率)。

MindGeniusAI★ 287

An AI agent that reads your PDFs and draws editable mind maps — visible tool-calling loop, built-in RAG, bring-your-own-key, multi-provider (OpenAI / Claude / DeepSeek / Kimi). Self-hostable.

DiscovAI-search★ 286

🔍 DiscovAI-Search: An AI-powered search engine for AI tools and custom data. Built with Next.js, OpenAI, Supabase, and more. Features vector-based search, Redis caching, and LLM-powered responses.

youtu-rag★ 284

Youtu-RAG: Next-Generation Agentic Intelligent Retrieval-Augmented Generation System

langchain-chat-with-documents★ 283

Chat with documents (pdf, docx, txt) using ChatGPT and Langchain

ask.py★ 283

A simple Python program to implement the search-extract-summarize flow.

searcharvester★ 283

Self-hosted search + markdown harvester for AI agents. SearXNG (100+ engines) + FastAPI + trafilatura. Tavily-compatible /search plus /extract with size presets and pagination. One-command Docker Compose.

code_qa★ 282

RAG on codebases using treesitter and LanceDB

chromadb-admin★ 282

Admin UI for Chroma embedding database built with Next.js

argo★ 282

Multi-engine search and deep research for AI agents across 300+ sources, 18 languages, and MCP / CLI.

ivory★ 282

Ivory is home for your database clusters — deploy, watch and fix them from one place, be it your browser, your phone or your AI agent. Open source, self-hosted, one Docker container and nothing to install on your hosts.

warc-gpt★ 281

WARC + AI - Experimental Retrieval Augmented Generation Pipeline for Web Archive Collections.

langchain-chatbot★ 278

Examples of chatbot implementations with Langchain and Streamlit

vidore-benchmark★ 278

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

docling-Studio★ 278

Chunkless RAG for AI agents, powered by Docling. Parse your PDFs, inspect every title, table and box on the page, then let any MCP client (Claude, Cursor…) read only the sections it needs under a token budget and cite exact, server-verified passages. No chunks, no embeddings, no vector store.

Adaptive-rag★ 277

按问题复杂度自动分流的电商客服 RAG:简单问题直接回答;复杂问题经过多跳检索并自我纠错;查单、退改通过工具调用完成,且高风险写操作必须先经人工确认。基于 FastAPI 和 LangGraph,混合检索并附带引用,内置离线评测与 Prometheus 指标。涵盖简历写法和项目面试拷打

langchain-GLM_Agent★ 276

本地知识库 + chatGLM6B + CustomAgent

BYO-LLM-WIKI★ 276

Build your own LLM-native WIKI (knowledge library). Search, extract, summarize, Q&A with contextual RAG, layered knowledge graph, and reinforced memory. Importantly use selected context to automatically generate skills, empowered by Claude subagents + CodeAct pipeline and gated by human review. **Try Live Demo**: https://byo-wiki-demo.vercel.app

vectordbz★ 275

A modern desktop application for exploring, managing, and analyzing vector databases

Multi-Agent-GPT★ 271

Multi-Agent-GPT: 一款基于RAG和agent构建的多模态专家助手GPT。它集成了文本、图像和音频等模态工具。支持本地部署和私有数据库建设。

ragflow-admin★ 271

基于ragflow二次开发的后台管理系统,可以独立运行,支持批量管理知识库、聊天、智能体、用户等,解决ragflow在后台管理上的痛点。

skills★ 271

Agent skills for Qdrant vector search: scaling, performance optimization, search quality, monitoring, deployment, model migration, version upgrades, and SDK usage across Python, TypeScript, Rust, Go, .NET, Java

aixplora★ 270

AIxplora is a open-source tool which let's you query all kind of files not limited to any length or format.

DeepEye★ 269

DeepEye: An Autonomous Data Agent System

llmdocparser★ 266

A package for parsing PDFs and analyzing their content using LLMs.

NanoSage★ 265

Local LLM Powered Recursive Search & Smart Knowledge Explorer

isolation-forest★ 265

A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

PyScrappy★ 265

Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.

claude-code-agentic-rag-series★ 264

Planning docs and PRDs for the Claude Code Agentic RAG Masterclass video series. Build a full-stack AI app with Python, React, and Supabase.

Diver★ 262

Complex Reasoning Rag System, Agentic Rag System

convoys★ 261

Implementation of statistical models to analyze time lagged conversions

data-enrichment★ 261

LangGraph Studio template for creating an agent that does web research to genearte or enrich structured data.

ontocast★ 261

Agentic Ontology Assisted Framework for Semantic Triple Extraction

docGPT-langchain★ 260

🔐Free GPT-3.5 chat with your docs (PDF, WORD, CSV, TXT)

ragpi★ 260

🤖 An open-source AI assistant answering questions using your docs

DeepSeek-R1-Chat-Assistant-Web-Search★ 260

streamlit region:us

dat★ 258

Asking yours data in a natural language way through pre-modeling (data models and semantic models).

akcio★ 257

Akcio is a demonstration project for Retrieval Augmented Generation (RAG). It leverages the power of LLM to generate responses and uses vector databases to fetch relevant documents to enhance the quality and relevance of the output.

SARA★ 257

Official Implementation for the ACL 2026 paper "SARA: Selective and Adaptive Retrieval-augmented Generation with Context Compression"

ah-douyin-clean-downloader★ 257

把抖音链接或口令直接交给 Codex,下载无平台角标原视频并按博主自动归档

rag-chat★ 256

Prototype SDK for RAG development.

OpenPlexity-Pages★ 256

SearchGPT / Perplexity Pages clone, but personalised for you.

sim-cli★ 254

Turn any CAE files into structured text an agent can use

LangChain-RAG-FastAPI-Service★ 250

基于LangChain与FastAPI的RAG项目,主分支为基于RAG的智能笔记助手,base-rag分支为开箱即用的基础RAG项目

RapidRAG★ 250

QA based on local knowledge and LLM.

rag-ecosystem★ 250

Understand and code every important component of RAG architecture

vector-storage★ 249

Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses OpenAI embeddings to convert documents into vectors and allows searching for similar documents based on cosine similarity.

LongRAG★ 248

Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".

Gossiping-Chinese-Corpus★ 248

PTT 八卦版問答中文語料

llm-movieagent★ 246

Semantic layer on top of a graph database to provide an LLM with a set of robust tools to interact with the database

identity-rag-customer-insights-chatbot★ 246

Connect to your customer data using any LLM and gain actionable insights. IdentityRAG creates a single comprehensive customer 360 view (golden record) by unifying, consolidating, disambiguating and deduplicating data across multiple sources through identity resolution.

lang2sql★ 245

A tutorial for setting an SQL code generator with the OpenAI API

satoriDB★ 245

High performance embedded vector database

qabot★ 244

CLI based natural language queries on local or remote data

ai-tutor-rag-system★ 244

This is a repository for the course "From Beginner to LLM Developer" by Towards AI.

k8ssandra-operator★ 244

The Kubernetes operator for K8ssandra

search-result-scraper-markdown★ 243

This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.

Other categories