Data pipelines & ETL
1,206 agents · most starred first
Data pipelines & ETL, page 5 of 13
A package to use the BigQuery Storage Write API
LDAP Storage for Archetypes
A facade storage layer for Archetypes delegating to the Plone memberdata tool
Data storage library for asset model apps
A simple JSON-based key-value storage library
API for storing and retrieving Atom entries.
Client part of the plugin to load CSV and Parquet files from AWS S3 into Atoti tables
Client part of the plugin to load CSV and Parquet files from Azure Blob Storage into Atoti tables
Client part of the plugin to load CSV and parquet files from Google Cloud Storage into Atoti tables
Server part of the plugin to load CSV and Parquet files from AWS S3 into Atoti tables
Server part of the plugin to load CSV and Parquet files from Azure Blob Storage into Atoti tables
Server part of the plugin to load CSV and parquet files from Google Cloud Storage into Atoti tables
Defines a common API to handle file objects independently of storage - Blobfile plugin
Defines a common API to handle file objects independently of storage
A Python script for backing up and synchronizing data between SSD and HDD with CPU usage monitoring.
A package for automating ETL processes
A cloud-ready, ML-powered, rule-driven data quality agent.
Moving averaging schemes (exponentially weighted, polynomial-decay).
A library to calculate the average of marks
Calculates the average decision ordering metric
A sample Averaging project
A library to calculate the average of marks
To find avg
A simple Python library to calculate averages of values.
Pydantic v2 models for AWS kinesis_video_webrtc_storage, shipped as a PEP 420 namespace extension of aws-resource-validator.
Microsoft Azure Storage SDK for Python
Microsoft Azure Blob Storage Client Library for Python
Microsoft Azure Storage Blob ChangeFeed Client Library for Python
Microsoft Azure Storage Common Client Library for Python
Microsoft Azure Storage File Client Library for Python
Microsoft Azure File DataLake Storage Client Library for Python
Microsoft Corporation Azure Storage File Share Client Library for Python
Azure Storage Helper
Microsoft Azure Storage Namespace Package [Internal]
Microsoft Corporation Azure Storage Queue Client Library for Python
A utility for tracking volume in and out of azure storage containers
A Python Wrapper for modeling client side encrypted azure storage tables, queues and blobs
Backblaze b2
提供了基于 Node.js 开发的 RESTful 接口,可以方便地进行数据的增删改查(CRUD)操作以及高效的数据搜索
Async batch functionality for Azure Table Storage
Bayesian weighted averages for inconsistent data sets
Small extensions of the Bellman-Ford routines in NetworkX, primarily for convenience (https://networkx.github.io).
Custom implementation of seaborn Beeswarm class
Autonomous Data Factory Agents - Health Monitoring, Self-Healing, and Data Governance
Dataclass for boto3 bedrock_data_automation.
Dataclass for boto3 bedrock_data_automation_runtime.
Helper Library for various Dataset formats
A python module for the BunnyCDN Storage API
A Python client for BunnyCDN Storage API
Transformation of categorical data to numerical feature vectors with Large Language Models
Base CBI objects for storages (RethinkDB, Redix, Clickhouse, etc)
The code is a Python package for managing file storage on either AWS S3 or a local machine. It provides methods for listing, searching, and storing files. The package includes two classes, Aws and Local, which implement the same set of methods for accessing and manipulating files in S3 and a local directory.
IO Interface for Reading and Writing CCSDS Data in Python.
Local storage: CCStorage, and simple local file string read/write: CCIO
Concurrent CDS API downloader with TUI and script mode
A library for relational database access from the Chaos Platform
Import ChatGPT conversations into a SQLite database
ZODB storage wrapper for encryption of database records
Cloud storage for CKAN
Extension to manage CKAN resources in any S3-like object storage.
CKAN API Extension for OFS Storage
A Python package for performing classification on datasets.
A comprehensive collection of data science, analysis, and engineering skills and scripts.
Convert a Claude.ai export to SQLite
Intelligent data cleaning agent for automated data quality improvement
A package to visualize tokenization of text using HTML
cmis_storage is a storage engine for Django to integrate CMIS-compatible services, like Alfresco
Yet another Ceph Collectd Plugin in Python.
A AT field storage which stores values to a cassandra database
GSS saves the document types supported by the Google Docs service on the Google servers
Blob storage for PloneSoftwareCenter
External storage for PloneSoftwareCenter
This recipe aids the creation and management of multiple Zope 2 filestorages.
An util for python backend storage packaging.
Partner Client for CommonHealth Cloud Storage Service
TODO
Distributed storage for community archives using ipfs-cluster, Tailscale and Docker
Package for embedded storage systems
Use couchdb to store storage meta data
Command to Read a coverage file and put the data in a SQL database
Python package to handle data gathered from biologgers (GPS, TDR, AXY) attached to central-place foraging seabirds. The idea is to make movement ecology data a bit easier to process.
CRAMS API opensource crams storage package.
Libreria de creacion de tablas para un proyecto de migracion
A small package that is used by Compute Studio to read and write model results to google cloud storage.
A data local persistence ORM framework.
DaSSCo Storage API SDK
Data Agent is a python library for pipelining real-time and historical data to and from industrial historians and control systems
Aspen IP21 historian plugin for `data-agent` package
Osisoft PI historian plugin for `data-agent` package
ZIP files plugin for `data-agent` package
Data Designer plugin adding cache-enabled LLM text and structured column generators
Intelligent data enrichment agent for automated feature engineering
Enabling random access to large datasets on disk for PyTorch training and other use cases
A multi-agent data processing system built on AgentScope and Data-Juicer
Add apply_multi and other bugs fix
A package for performing Data Catalog operations on object storage solutions
Catalog-based data storage system with pluggable serializers
Haystack custom components for your favourite dataframe library.