An intelligent automated exploratory data analysis tool powered by Large Language Models, providing in-depth insights and visualizations for your datasets

llm-batch-annotate

Batch-oriented LLM annotation workflows for tabular datasets with OpenAI Batch support.

llm-batch-processor

A package to process CSV text data in batches using OpenAI API

llm-behavior-eval

Evaluate large-language models for undesirable behaviors such as bias.

llm-benchmark-toolkit

Benchmark LLMs with 10 benchmarks & 132K+ questions. 8 providers: OpenAI, Anthropic, Groq, Together, Fireworks, DeepSeek, Ollama, HuggingFace. Unified CLI + Web dashboard.

llm-chunk-optimizer

Semantic-aware chunking with provenance tracking for production RAG and LLM data pipelines

llm-cost-guard

Real-time cost tracking, budget enforcement, and usage analytics for LLM applications

llm-data-converter

Best open-source document to markdown converter for LLM training data. Convert PDF, Word, PowerPoint, Excel, images, URLs to clean markdown, JSON, HTML locally. Alternative to Unstructured, Docling, Marker, MarkItDown, MinerU, PaddleOCR, Tesseract

llm-data-lens

A Python package for calculating key metrics to assess LLM performance in various tasks, including extracting structured dataa.

llm-data-processor

A processor for LLM tasks

llm-data-simulator

Generate synthetic evaluation datasets from your own documents.

llm-databricks

LLM access to Databricks model serving

llm-dataclass

A dataclass interface for llms

llm-datagen

极简高性能流式数据加工库

llm-dataset-converter

Python3 library for converting between various LLM dataset formats.

llm-dataset-converter-all

Meta-library that combines all llm-dataset-converter libraries.

llm-datasets

A collection of datasets for language model training including scripts for downloading, preprocesssing, and sampling.

llm-datatech

RAG llm datatech

llm-deep-research

LLM plugin of various deep research implementations

llm-dispatcher

Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics

llm-exo-graph

Advanced Knowledge Graph Engine with Document Processing, Semantic Search and Multi-LLM Integration

llm-explain

Tools that use LLM to explain datasets

llm-explorer

A Lakehouse LLM Explorer. Wrapper for spark, databricks and langchain processes

llm-extractinator

A framework that enables efficient extraction of structured data from unstructured text using large language models (LLMs).

llm-extractor

Extract structured, validated JSON from any LLM ÃƒÆ’Ã†â€™Ãƒâ€šÃ‚Â¢ÃƒÆ’Ã‚Â¢ÃƒÂ¢Ã¢â€šÂ¬Ã…Â¡Ãƒâ€šÃ‚Â¬ÃƒÆ’Ã‚Â¢ÃƒÂ¢Ã¢â‚¬Å¡Ã‚Â¬Ãƒâ€šÃ‚Â OpenAI, Anthropic, Gemini ÃƒÆ’Ã†â€™Ãƒâ€šÃ‚Â¢ÃƒÆ’Ã‚Â¢ÃƒÂ¢Ã¢â€šÂ¬Ã…Â¡Ãƒâ€šÃ‚Â¬ÃƒÆ’Ã‚Â¢ÃƒÂ¢Ã¢â‚¬Å¡Ã‚Â¬Ãƒâ€šÃ‚Â with batch extraction, caching, per-field confidence scoring, schema evolution, multi-schema extraction, output transforms, partial extraction, extraction diff, pipeline extraction, and smart auto-retry.

llm-feat

Automated feature engineering using Large Language Models (LLMs) for tabular data

llm-feature-gen

Generate interpretable feature schemas and tabular exports from text, images, tabular data, and video with LLMs

llm-file-format

Token-efficient data format converter for LLM contexts

llm-fragments-pypi

LLM fragments plugin for PyPI packages metadata

llm-function-tools

Minimal metadata and discovery helpers for typed Python tools used by llm_function runtimes.

llm-guard

LLM-Guard is a comprehensive tool designed to fortify the security of Large Language Models (LLMs). By offering sanitization, detection of harmful language, prevention of data leakage, and resistance against prompt injection attacks, LLM-Guard ensures that your interactions with LLMs remain safe and secure.

llm-html

LLM-optimized HTML cleaning: hydration extraction, token budgets, multiple output formats

llm-hygiene

a data preprocessing toolkit that makes it easy to create common LLM-related data structures; from training data to chain payloads!

Data agents — page 66 of 78

Browse other category pages