Skip to content
项目分类

数据 · GitHub

比较数据库、数据分析、SQL 与数据工程项目。

实用 GitHub 项目

6,841 个项目

spirit

block

204星标

Online schema change and data operations for MySQL 8.0+

数据GoApache-2.0GitHub

bitcoin-etl

blockchain-etl

462星标

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

数据PythonMITGitHub

ethereum-etl

blockchain-etl

3,132星标

用于处理以太坊区块、交易、ERC20 / ERC721 代币、转账、收据、日志、合约和内部交易的 ETL(提取、转换和加载)作业的 Python 脚本。数据可在 Google BigQuery 中获取:https://goo.gl/oY5BCQ

数据PythonMITGitHub

ethereum-etl-airflow

blockchain-etl

443星标

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

数据PythonMITGitHub

polygon-etl

blockchain-etl

106星标
polygon-etl preview

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

数据PythonMITGitHub

scan

blockloop

614星标

Tiny lib to scan SQL rows directly to structs, slices, and primitive types

tsfresh

blue-yonder

9,495星标
tsfresh preview

从时间序列中自动提取相关特征:

  • Christ, M., Braun, N., Neuffer, J., and Kempa-Liehr A.W. (2018). Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh -- A Python package). Neurocomputing 307, p. 72-77, doi: 10.1016/j.neucom.2018.03.067.
  • Christ, M., Kempa-Liehr, A.W., and Feindt, M. (2017). Distributed and parallel time series feature extraction for industrial big data applications. ArXiv e-print 1610.07717, https://arxiv.org/abs/1610.07717.
数据Jupyter NotebookMITGitHub

turbodbc

blue-yonder

658星标

Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with the Python Database API Specification 2.0.

Tree

BlueM

237星标

PHP library for handling tree structures based on parent IDs, e.g. a self-joined database table

serverless

bluenimble

32星标
serverless preview

BlueNimble is a Hybrid Serverless Platform focusing on developer productivity and application portability. Create and run scalable APIs and applications without coding or by coding less. Focus on application business logic without any knowledge of the underlying microservices architecture.

数据HTMLApache-2.0GitHub

Meerschaum

bmeares

154星标
Meerschaum preview

Create and manage data pipes with Meerschaum.

  • ⚡️ Incremental by default — the sync engine fetches only new or changed rows and concurrently updates many streams at once. Duplicate rows are ignored; rows with existing keys are updated.
  • 📊 Built for data scientists and analysts — integrate with Pandas, Grafana, and friends; persist DataFrames and always get the latest data. Skip pandas overhead and read rows as plain dicts with Pipe.get_docs().
数据RustApache-2.0GitHub

boilstream

boilingdata

105星标

Rust based DuckDB Server with 1st class Postgres interface for BI Tools like Power BI and Tableau. Streaming interfaces like Web, Kafka, and FlightSQL/RPC.

  • Multi-tenant DuckDB — Full tenant isolation (secrets, attachments, DuckLakes, filesystem)
  • Streaming views — Continuous row-by-row SQL transforms on ingested data