Category

Data, search & knowledge

11,544 agents

Every agent in Data, search & knowledge, page 4 of 116

GraphRAG-SDK★ 1,036

Build fast and accurate GenAI apps with GraphRAG SDK at scale 🌟

canopy★ 1,030

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

ade-python★ 1,027

Python library for Agentic Document Extraction (ADE).

FlashRank★ 1,015

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

x-tweet-fetcher★ 1,012

Fetch X/Twitter tweets, replies, timelines, search, Lists and X Articles without login or API keys. Python CLI + library for AI agents: FxTwitter / Nitter / browser backends with auto fallback, unified JSON, optional SQLite archive. 免登录免 API 抓取推特推文。

fastembed-rs★ 1,007

Rust library for generating vector embeddings and reranking locally!

autollm★ 1,006

Ship RAG based LLM web apps in seconds.

autollm★ 1,001

Ship RAG based LLM web apps in seconds.

VisRAG★ 991

Parsing-free RAG supported by VLMs

vectordb-recipes★ 991

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

synaplan★ 989

Own the flow: one open-source AI platform for your knowledge, models and channels – web, WhatsApp, email, Outlook, Nextcloud & ownCloud. Local and cloud models side by side, with the cost on every answer.

RustXNG★ 975

Self-hosted metasearch and grounding engine for AI agents, based on SearXNG. Rust, JSON API, optional page text.

dataset-viewer★ 972

A sleek dataset viewer built entirely by AI Agent. Supports streaming large files from WebDAV, S3, SSH, Local or Hugging Face.

crw★ 968

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

Local_Pdf_Chat_RAG★ 964

Transparent Python RAG reference with FAISS + BM25 hybrid retrieval, reranking, Gradio UI, and FastAPI.

rag-fusion★ 960

RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.

KG_RAG★ 950

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

retentioneering-tools★ 948

Python toolkit, MCP server, and agent skills for reproducible, auditable clickstream and event log analytics. Helps AI agents, data scientists and analysts build, validate, and cross-check product analytics, quantitative UX, customer journeys, graph-based user flows, behavioral segmentation, A/B tests, process mining models, Markov chain simulation

chatgpt-pgvector★ 939

ChatGTP (gpt3.5-turbo) starter app

ChatIE★ 935

The online version is temporarily unavailable because we cannot afford the key. You can clone and run it locally. Note: we set defaul openai key. If keys exceed plan and are invalid, please tell us. The response speed depends on openai. ( sometimes, the official is too crowded and slow)

citra★ 935

Give your AI agent eyes for PDFs — structured text, tables, OCR, visual evidence, and page-level citations via MCP. Native Rust, local-first.

rag-api★ 927

ID-based RAG FastAPI: Integration with Langchain and PostgreSQL/pgvector

rag-time★ 918

RAG Time: A 5-week Learning Journey to Mastering RAG

chatWeb★ 916

ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content, then answer your questions based on the content, or summarize the key points.

pylate★ 914

Late Interaction Models Training & Retrieval

SuperMew★ 914

SuperMew — Agentic RAG with LangChain & LangGraph

spacy-layout★ 913

📚 Process PDFs, Word documents and more with spaCy

rag_api★ 904

ID-based RAG FastAPI: Integration with Langchain and PostgreSQL/pgvector

LaunchStack★ 898

AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. Includes predictive missing-document detection, role-based workflows, and page-level insight extraction.

layra★ 897

LAYRA—an enterprise-ready, out-of-the-box solution—unlocks next-generation intelligent systems powered by visual RAG and limitless visual multi-step agent workflow orchestration.

restheart★ 892

A backend for web, mobile, AI and IoT apps. Built on MongoDB

Chatito★ 890

🎯🗯 Dataset generation for AI chatbots, NLP tasks, named entity recognition or text classification models using a simple DSL!

html-to-markdown★ 889

Turn messy, real-world HTML into clean Markdown, from every major language.

multi-agent-postgres-data-analytics★ 885

The way we interact with our data is changing.

vectordb★ 874

A high performance Vector Database leveraging parallel graph computing

statespace★ 869

Search for the agentic web.

serverless-chat-langchainjs★ 869

Build your own serverless AI Chat with Retrieval-Augmented-Generation using LangChain.js, TypeScript and Azure

statespace-search★ 869

Search for the agentic web.

NeumAI★ 868

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

entaoai★ 867

Chat and Ask on your own data. Accelerator to quickly upload your own enterprise data and use OpenAI services to chat to that uploaded data and ask questions

ChatPDF★ 863

RAG for Local LLM, chat with PDF/doc/txt files, ChatPDF. 纯原生实现RAG功能,基于本地LLM、embedding模型、reranker模型实现,支持GraphRAG,无须安装任何第三方agent库。

IncarnaMind★ 860

The artifact layer for any agent: what your AI writes, checked against your files. A free, open-source desktop app for macOS, Windows and Linux. Connect Claude Code or another agent, or use your ChatGPT plan, your own key or a local model. Your files in one Library, sorted and searchable, with your meetings.

rag-in-action★ 859

End-to-end RAG system design, evaluation, and optimization. 极客时间RAG训练营,RAG 10大组件全面拆解,4个实操项目吃透 RAG 全流程。RAG的落地,往往是面向业务做RAG,而不是反过来面向RAG做业务。这就是为什么我们需要针对不同场景、不同问题做针对性的调整、优化和定制化。魔鬼全在细节中,我们深入进去探究。

rag-demystified★ 855

An LLM-powered advanced RAG pipeline built from scratch

doc-chatbot★ 855

Document chatbot — multiple files, topics, chat windows and chat history. Powered by GPT.

byaldi★ 852

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

s3★ 849

[EMNLP'25] s3 - ⚡ Efficient & Effective Search Agent Training via RL for RAG (RLVR for Search with Minimal Data)

AutoSchemaKG★ 849

This repository contains the implementation of AutoSchemaKG, a novel framework for automatic knowledge graph construction that combines schema generation via conceptualization.

Autogen_GraphRAG_Ollama★ 848

Microsoft's GraphRAG + AutoGen + Ollama + Chainlit = Fully Local & Free Multi-Agent RAG Superbot

BambooAI★ 848

AI-powered data analysis workbench built for transparency, reproducibility and user control. Inspect the code and evidence behind results, verify calculations through replay, and choose from a wide range of models, including local open-weight models.

firecrawl-app-examples★ 846

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

azure-search-openai-demo-csharp★ 845

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure Cognitive Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

agentic-data-scientist★ 845

An end-to-end Data Scientist

pg_vectorize★ 835

Full-text and semantic search on any Postgres

moss★ 828

The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.

rag★ 824

This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.

robot★ 820

知识图谱问答机器人,聊天机器人,基于知识图谱、语义理解等的对话机器人。

Robby-chatbot★ 812

AI chatbot 🤖 for chat with CSV, PDF, TXT files 📄 and YTB videos 🎥 | using Langchain🦜 | OpenAI | Streamlit ⚡

sift-kg★ 809

Turn any collection of documents into a knowledge graph. Extract entities and relationships via LLM, deduplicate with your approval. Map domains, find hidden connections, spot patterns across documents — knowledge that persists and compounds, for you and your AI agents. All from the CLI.

carrel★ 808

Ontology-Augmented Generation for AI agents.

instructor-js★ 805

structured extraction for llms

swiftide★ 805

Fast, streaming indexing, query, and agentic LLM applications in Rust

dac★ 805

DaC is a dashboard-as-code tool. Build interactive dashboards using YAML and JSX. Built-in semantic layer. Get your agents to build standardized, reviewable dashboards.

IncarnaMind★ 802

Connect and chat with your multiple documents (pdf and txt) through GPT 3.5, GPT-4 Turbo, Claude and Local Open-Source LLMs

vulcan-sql★ 792

Data API Framework for AI Agents and Data Apps

album-ai★ 792

AI-First Album: Chat with your gallery using plain language! LLM Vision + RAG + Album/Gallery.

PaperPilot★ 791

Your local AI copilot for documents

local-rag★ 766

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

mini-rag★ 763

An Educational Project (step by step) to teach how to build a production-ready app for RAG application.

Nucleoid★ 762

Logic Language for LLMs 🌱🐋🌍 Build Neuro-Symbolic AI for Learning and Reasoning

semantic-search-nextjs-pinecone-langchain-chatgpt★ 760

Embeds text files into vectors, stores them on Pinecone, and enables semantic search using GPT3 and Langchain in a Next.js UI

ketch★ 755

Fast, stateless CLI for web search and scrape. Built for AI agents.

claude-chat-exporter★ 753

One-click, privacy-first exporter for Claude.ai chats — clean Markdown with artifacts and attachments, ready for Obsidian and RAG.

dataagent★ 746

DataFoundry is an open-source AI workbench for data analysis, unifying data sources, knowledge, tools, and agent runtime into a governed workspace for interactive analytics.

datafoundry★ 740

DataFoundry is an open-source AI workbench for data analysis, unifying data sources, knowledge, tools, and agent runtime into a governed workspace for interactive analytics.

html-to-markdown★ 739

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the Kreuzberg team. Kreuzberg is a fast, polyglot document intelligence engine with a Rust core. It extracts structured data from 56+ document formats using streaming parsers and built-in OCR.

chatdocs★ 738

Chat with your documents offline using AI.

datafoundry★ 734

DataFoundry is an open-source AI workbench for data analysis, unifying data sources, knowledge, tools, and agent runtime into a governed workspace for interactive analytics.

DeepRetrieval★ 719

[COLM’25] DeepRetrieval — 🔥 Training Search Agent by RLVR with Retrieval Outcome

Auto-Analyst★ 710

Open-source AI-powered data science platform.

searchGPT★ 709

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

VLM2Vec★ 705

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

langchain-supabase-website-chatbot★ 702

Build a chatgpt chatbot for your website using LangChain, Supabase, Typescript, Openai, and Next.js.

xyne★ 697

AI-first Search & Answer Engine for work. Open-source alternative to Glean.

rag-chatbot★ 692

Chat with multiple PDFs locally

oc★ 691

Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.

knowledge-graph-from-GPT★ 688

Using GPT to organize and access information, and generate questions. Long term goal is to make an agent-like research assistant.

Rankify★ 683

🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.

fenic★ 681

Semantic DataFrames for humans and agents

Docufinder★ 678

Anything — 파일 이름이 아니라 본문으로 찾는 문서 검색기. HWP·PDF·Office 전문 검색을 오프라인으로. Windows·macOS | Offline content search across Korean documents (HWP, PDF, Office). Windows and macOS

Versatile-OCR-Program★ 677

Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams)

RAGLight★ 672

RAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vector stores, and now includes seamless MCP integration to connect external tools and data sources.

ViDoRAG★ 670

[EMNLP 2025] ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents

RankGPT★ 666

Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]

haiku.rag★ 664

Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server

llm-search★ 661

Querying local documents, powered by LLM

wren-engine★ 660

This repository has been merged into Canner/WrenAI under the core/ directory

insights-lm-public★ 660

Open-source, self-hosted alternative to NotebookLM. Chat with your documents, generate audio summaries, and ground AI in your own sources—built with Supabase and N8N on a React frontend.

sage-wiki★ 658

sage-wiki is a graph memory and knowledge base that AI agents and humans build and query together. Drop in documents; an LLM compiler turns them into an interlinked wiki with a knowledge graph. One Go binary scales it from a personal vault to a team hub to a company knowledge graph.

MinerU-Document-Explorer★ 653

Agent-native knowledge engine with MCP tools for document indexing, wiki organization, fast retrieval and deep reading across PDF/DOCX/PPTX/Markdown

Other categories