Data, search & knowledge

Data pipelines & ETL

1,206 agents · most starred first

Data pipelines & ETL, page 10 of 13

snakemake-storage-plugin-sftp

A Snakemake storage plugin that handles files on an SFTP server.

snakemake-storage-plugin-sharepoint

Snakemake storage plugin for reading and writing files on Microsoft SharePoint.

snakemake-storage-plugin-webdav
snakemake-storage-plugin-xrootd

A Snakemake storage plugin for XRootD storage

snakemake-storage-plugin-zenodo

A Snakemake storage plugin for reading from and writing to zenodo.org

snappy-gpt

Another Wrapper for ESA Snap Graph Processing Tool

sneakydog_object_storage_service

Unified Object Storage Client SDK with multiple backend support

snowflake-data-exchange-agent

Data exchange agent for migrations and validation

softlayer-object-storage

SoftLayer Object Storage client bindings for Python.

solar-and-storage

Modelling for Solar and Storage

sonnet-storage

Virtual file storage backed by PostgreSQL for sonnet-server applications

sorting-by-average

Python library for sorting collections of integers, dictionaries, or tuples based on their average values.

sp-storage

Storage provider for sharepoint service

spark-advisor-storage-connector

Storage connector for reading Spark event logs from HDFS, S3, and GCS

springtownai-rag

A simple S3 file downloader

sqlite-bedrock-packs

Python package that loads data from Minecraft: Bedrock Edition packs into SQLite database

sqlite-cache-storage

SQLite cache storage for botasaurus.

starai-llmdatacleaner

use llm to clean data for start ai

steerage

Pluggable async storage backends for Python projects

stock-storage-frame

A configuration-driven stock data storage framework

storage

Libraries to interact with Enterprise Storage Arrays, FC Switches and Servers.

storage-actions

Unified object storage helpers for Alibaba OSS and S3-compatible backends

storage-bridge

A Python package for managing storage

storage-bucket

Easy to work with Google Cloud Platform Storage Bucket wrapper

storage-bucket-s2

High-performance encrypted file uploader for Storage Buckets

storage-cache

Storage Cache

storage-client

Python SDK for interacting with the Storage API

storage-device-managers

Helpful context managers for managing decryption and mounts of storage devices

storage-hub

soon

storage-interfaces

Abstract classes for representing storage-related objects

storage-local

PyPI Package for Circles Storage functions

storage-manager

Storage - a load-balanced storage manager

storage-observer

Project Description

storage-orm

Python for using in-memory storage with ORM

storage-remote-graphql
storage-script

Rasa Storage Script

storage-service

Storage Service is a Django + DRF package that help to work with model.

storage-tool

Package for manager files in differents storages

storage-tools

Make it easy to work with local or cloud storage as part of a data science workflow

storage-usage

Scan file-system storage, record results in a database, and serve a live web UI.

storage-utils

Blob storage utilities

storage1024

Premium High-performance object storage client library for Python.

storage3

Supabase Storage client for Python.

storageCat

A CLI tool for creating and submitting SciCat dataset entries

storage_stats

Calculates count and average file size of files recorded by file extension

storageanalyser

Storage Analyzer & Cleanup Recommender

storageapi

http://getstorage.net for Python

storagebox

A reusable, idempotent, and exactly once deduplication API

storagecli

CLI for Storage at app.merklebot.com

storagedef

Abstract storage interfaces

storagehandling

Library for storage handling

storagekit

object storage python sdk tools

storagelayer

Content-addressable storage for aleph and memorious

storagemodel

A simple Databricks package

storageobject

Ein thread-sicherer In-Memory Speicher, basierend auf Python-Dictionaries.

storager

a nice Variable-storager

storagerouter

Placeholder package to claim the storagerouter namespace.

storages

UNKNOWN

storagetest

Storage Test tools/scripts.

storagex

just storagex

storagy

A common API for many types of storage.

streamsx.objectstorage

Object Storage integration for IBM Streams

swaggerwithgroq

Generate realistic API data from Swagger json using Groq

swarm-to-sqlite

Create a SQLite database containing your checkin history from Foursquare Swarm

swarmauri_tool_folium

This repository includes an example of a First Class Swarmauri Example.

swarmbar

SwarmBar: Bar plots with individual points and significance markers.

swarmbee-bakery

CLI for the Swarm & Bee dataset bakery — order curated AI training corpora from the terminal.

swh.objstorage

Software Heritage object storage

swh.objstorage.replayer

Software Heritage content replayer

swh.storage

Software Heritage storage manager

swiftstorage

A simple way to interact with local and remote file systems. Easily extendable to support custom endpoints.

synapse-s3-storage-provider

A storage provider which can fetch and store media in Amazon S3.

synapse-s3-storage-provider-delete-local

A storage provider which can fetch and store media in Amazon S3 with local delete after upload

szn-sellma-data

Add your description here

szn-storageclient

Add your description here

tabsdata-agent

Tabsdata Agent service for AI-powered data processing.

tabullm

Seamless Feature Extraction and Interpretation of Text Columns in Tabular Data Using Large Language Models

tai-storage

Librería para gestión unificada de archivos en múltiples orígenes de almacenamiento

taichu-storage

storage sdks aggregation

tap-gemini

Singer.io tap for extracting data from Yahoo Gemini

target-azure-storage

`target-azure-storage` is a Singer target for Azure Storage, built with the Meltano SDK for Singer Targets.

target-azureblobstorage

Singer.io target for extracting data

target-magentobi

Singer.io target for the Magento Business Intelligence API

target-questions-generator-agent

AI-powered agent for converting technical ML requirements into user-friendly questions

target-synthesis-agent

AI-powered target variable creation and synthesis agent

tempstorage

A RAM-based storage for ZODB

terragon

a better pickle

terragon-downloader

Create EO Minicubes from Polygons and simplify EO Data downloading.

tgstorage-cluster

A lightweight, high-performance file storage API using Telegram as a backend.

thlink-backend-object-storage-lib

S3 Wrapper

thoth-storage

Storage and database adapters available in project Thoth

thoth-storages

Storage and database adapters available in project Thoth

thumbor-cloud-storage

Google Cloud Storage loader and result storage for Thumbor

tigrbl-identity-storage

Storage adapters and Tigrbl/SQLAlchemy tables for the Tigrbl identity package suite.

tilebox-storage

Storage client for Tilebox

time-weighted-average-for-water

A tool to calculate time weighted average for water level / flow.

tiny-object-storage

A lightweight S3-compatible object storage server for local development and learning.

tiny-storage

Tiny library for key-value single-file application data storage

tiny-storage-unstable

Tiny library for key-value single-file application data storage

tiny-storage-unstable-unstable

Tiny library for key-value single-file application data storage

More in Data, search & knowledge