Data pipelines & ETL
1,206 agents · most starred first
Data pipelines & ETL, page 11 of 13
A TinyDB storage implementation that uses JSON and encryption.
Redis and S3 storages for TinyDB that refuse to overwrite each other.
Small aiohttp server application for TLE storage
A package for integrating LLMs like GPT-3.5 and GPT-4 into topic modelling
Official implementation of TopicGPT: A Prompt-based Topic Modeling Framework (NAACL'24)
TinyDB storage with orjson and msgpack
A unified async interface to upload and download blobs to/from Azure or AWS S3, switchable via env var.
Tree hash-storage files
Pytroll file utilities
A boilerplate utility package
Time-series skills, tool contracts, and sandboxes for agentic workflows.
SQLite schema, Python classes and data management tools for working with time series from engineering test beds
Minimalist time-series forecasting toolkit for coding agents
A package which handles the storage of TVB data
Python interface to the TVRage television information database.
The protocol implementation for the Magicicada filesync server (open source fork of the Ubuntu One filesync).
Health check execution SDK for 'Dragonfly, The Data Quality Monitoring Tool' from Upshot Ideas Technology Lab.
An util for python backend storage packaging.
A package for storing key-value data with backup history.
Create storage for tests
Unified Storage Interface for Python.
Storage Service
Sample storage add-on for VALER LIMS
Library for access to different managed storages
A framework for storing and managing component and application data for machine apps.
A wrapper around the vercel storage blob api
Verse Storage Components
Database storage for vexbot
Kafka-based ingest and decoding classes for VideoIngestFragments
Storage driver used throughout views 3.
Virtual Storage Manager
Storage collection, filesystem forked from django
A Python client for https://web3.storage
Use AWS S3 with private documents in Wagtail.
Waylay Storage
Waylay Storage Types
WCraaS Storage Service
Support for s3 storage backends in Django
Smooth data across multiple dimensions using weighted averages
A client for the Wellcome Storage Service
File format for 96-well plate layouts.
wix-protos-answers-streams-cdc-agent-cdc-agent
wix-protos-answers-streams-prod-agg-agent-agg-agent
wix-protos-answers-streams-prod-cdc-agent-cdc-agent
wix-protos-answers-streams-prod-dwh-agent-dwh-agent
wix-protos-answers-streams-prod-view-agent-view-agent
wix-protos-answers-streams-services-agent-aggregate-service
This is a package to generate topics for the text corpus.
pytohn object storage
xilong storage library
Universal data storage module for persisting development data
Forming fragments files through three files (barcodes.txt.gz, .mtx.gz and .peaks.txt)
zen storage library
Plottie review: compare features, pricing, use cases, access model, and alternatives for this Data Science agent in 2026. Generate professional scientific figures for manuscripts, grants, and presentations. The accurate, n
AI that builds, fixes, and manages your data pipelines automatically.
typing, schemas and services based in protocol buffers
API Builder ORM
to generate bare bones models for objection
API Builder ORM
Grapi Schema Generator For GraphQL Server
Minimal InfluxDB client library for Node.js
A simple forwarder that acts as an InfluxDB subscriber, forwarding each write to an AWS Firehose stream.
Adala lets AI agents learn to label and process data on their own.
Populate an in-warehouse agents.* schema from dbt manifests, OSI YAML, LookML, and markdown skills.
Storage extension for PySTAC
ETL-D SDK: The Agentic Data & Finance Middleware
Production-ready examples for @ruvector/agentic-synth - DSPy training, multi-model benchmarking, and advanced synthetic data generation patterns
Pure TypeScript agentic dataset builder for Pi, Codex, and Claude Code history
An AI-powered Python library for context-aware data cleaning using local LLMs
Query (and build) the AIND dynamic-foraging behavioral parquet database.
Extensible plugin-based client for unified wattnet time-series metric storage across multiple backends.
Allows to use server environment with fs storage attachment
Allows to use server environment with fs storage
Delegate storage file backend swap to queue jobs
Sync agent for managing eTiKeT synchronization from various data sources
Folder-based connector for eTiKeT sync agent
Native filesystem connector for eTiKeT sync agent
QCoDeS connector for eTiKeT sync agent
File converters for eTiKeT sync agent
LLM-assisted qualitative survey coding with auditable Excel workbooks
DataAgent - A powerful multi-modal Data Agent workflow template framework
A YAML-configured data fetching library for agentic applications.
An integration package connecting SibFly (measured ground motion per US address, from NASA InSAR) and LangChain
ПЕРЕХОДНИК на s-persistkit[object] (волна 4). Объектное хранилище (ObjectStorage protocol + MinIO adapter + image normalization for Skillery)
Autonomous Multi-Agent Business Intelligence and Data Engineering Platform
A Django storage field that works everywhere. One import. Any backend. Zero plumbing.
Local-first AI agent for reproducible biological data analysis