Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Apache Doris is an easy-to-use, high performance and unified analytics database.

An orchestration platform for the development, production, and observation of data assets.

Fancy stream processing made operationally mundane

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

The open source high performance ELT framework powered by Apache Arrow

Flink CDC is a streaming data integration tool

Privacy and Security focused Segment-alternative, in Golang and React

Build data pipelines, the easy way 🛠️

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Open source data anonymization and synthetic data orchestration for developers. Create high fidelity synthetic data and sync it across your environments.

Quadratic | Spreadsheet with Python, SQL, and AI

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

A curated list with resources about node-based UIs

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage