Data pipelines & ETL
1,206 agents · most starred first
Data pipelines & ETL, page 6 of 13
LLM-powered data operations engine for Excel/CSV files
Reusable storage access for DataRobot
LLM-based automated dataset standardization and evaluation framework
Generate textual and conversational datasets with LLMs.
Enrich data by prompting LLMs
Dict-like object that can be saved in hdf5 or numpy format
An agent that can be installed inside a firewall or VPN and used to push data to Datateer
Agentic core for DB crawling.
Agent for dbrhino
One-stop-shop for docs and test coverage of dbt projects
Django Project to handle Static and Upload Files on s3 the right way
Gaussian and Binomial distributions
A non-persistent in-memory data storage backend for Django.
A set of django media storage classes for different use cases such as private file storage on S3
Nice file storage support for Django
Configure Django storage from a URL
This application allows you easily save media and static files into webdav storage
Django package that provides Cloudinary storages for both media and static files as well as management commands for removing unnecessary files.
Django storage engine that connects to Akamai NetStorage.
A simple Django storage backend for aliyun oss2.
A simple Django storage backend for aliyun oss2.
Django storage for Aliyun OSS Storage
A simple Django app to use SwiftStack Storage
ATC Profile storage app
AWS S3 Bucket file storage system for Django applications
Django storage backends for Windows Azure blob storage.
Django storage backends for Windows Azure blob storage.
Django BackBlaze B2 Storage
A Dropbox Storage for your Django apps
dnastorage provides basic support for encoding and decoding files into and out of DNA with several convenient interfaces.
A package for handling various storage options.
Dolmen Zope3 Grok Storage Annotation
Data quality CLI demo with deterministic checks, anomaly detection, and replayable artifacts
Collection of Python scripts for post-processing Illumina DRAGEN results output files.
Utilities for Dragen
An Optimized, RML-engine-agnostic Interpreter for Functional Mappings. It planns the optimized execution of FnO functions integrated in RML mapping rules, interprets and transforms the rules into function-free ones efficiently. Since Dragoman is engine-agnostic it can be adopted by any RML-compliant Knowledge Graph creation framework.
Complete pipelines and helper tools for data science and machine learning projects.
Preprocessing scripts for the DRAGON benchmark
A library that facilitates transporting data around.
A common python library for DS.
Data service agent
Library for managing DSW S3 storage
Dynafed Storage Stats Module
Synthetic medical record generator with realistic schema variance across locales
........
ec-storage,it is used to replace the three copy storage strategy of HDFS, so as to save storage space
echoss AI Bigdata Solution - Object Storage like S3 handler
Binary storage for the Edeposit project.
RethinkDB storage plugin for ErrBot
Storage service for ERT
python-eve S3 MediaStorage extension
mostly it is a dependency
Enhance your data pipelines with the power of Large Language Models. EzLLM is a developer tool that opens the door to the LLM ecosystem. Automatic webscrapers, natural language data extraction, semantic search and as little as 3 lines of code
Easy storage handler
The FAIRagro advanced middleware API client
The FAIRagro advanced middleware shared components
Python library for generating synthetic data with LLMs
Django storage for fake.py
Pathy storage for fake.py
User-agent parsing library with Go backend
An intelligent agent for suggesting features for machine learning datasets
Automated Feature Engineering Toolkit Based on Large Language Models
Fenixflow storage package with Pydantic ORM, temporal data management, and state-based schema sync
Well Logs Tool for Oil & Gas
Universal tool for file storages
storage handler for multiple services
Save uploaded files in configurable stores
package for file storage
A lightweight library to generate dummy data for database using OpenAI
Fill your database with mocked instances.
一个支持阿里云OSS和MinIO的对象存储抽象包
FLARE storage adapter package
Multi-cloud storage manager with automatic fallback for Git LFS (Cloudinary + Google Drive)
Simple and easy file storages for Flask
AWS S3 object storage plugin for the floe data platform
MinIO object storage plugin for the floe data platform
A web-based data exploration system for rapid task definition.
Framework for modeling, orchestrating,and executing ETL pipelines in a controlled environment.
Package with fragua sets with reutilizable functions for ETL process.
Fstorage, Secure file storage, SYNC/ASYNC clients, easy to learn, fast to code.
Provides a layer for storing key / value paires.
realtime data sync agent for various data sources
Unified storage interface.
This is a (POC) simple json storage manager.
Azure Storage file store for Gallerist
Garage-61-Api is a simple Python wrapper around the Garage61 API.
desc
for managing data storage between local environments and Google Cloud Storage (GCS) bucketss.
Python Client for Google Cloud Storage
Python Client for Google Cloud Storage
A stub emulator for the Google Cloud Storage API
A package to manage Google Cloud Storage
gCloud - The Cloud made in Italy Python API
A lightweight parallel post process package for GCM output.
Package for accessing into Cloud Storage in Google Cloud Platform.