Skip to content
プロジェクトカテゴリ

データ · GitHub

データベース、分析、SQL、データエンジニアリングのプロジェクトを比較できます。

便利なGitHubプロジェクト

6,841 プロジェクト

ethereum-etl-airflow

blockchain-etl

443スター

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

polygon-etl

blockchain-etl

106スター
polygon-etl preview

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

scan

blockloop

614スター

Tiny lib to scan SQL rows directly to structs, slices, and primitive types

tsfresh

blue-yonder

9,495スター
tsfresh preview

時系列から関連する特徴量を自動抽出:

  • Christ, M., Braun, N., Neuffer, J., and Kempa-Liehr A.W. (2018). Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh -- A Python package). Neurocomputing 307, p. 72-77, doi: 10.1016/j.neucom.2018.03.067.
  • Christ, M., Kempa-Liehr, A.W., and Feindt, M. (2017). Distributed and parallel time series feature extraction for industrial big data applications. ArXiv e-print 1610.07717, https://arxiv.org/abs/1610.07717.
データJupyter NotebookMITGitHub

turbodbc

blue-yonder

658スター

Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with the Python Database API Specification 2.0.

Tree

BlueM

237スター

PHP library for handling tree structures based on parent IDs, e.g. a self-joined database table

serverless

bluenimble

32スター
serverless preview

BlueNimble is a Hybrid Serverless Platform focusing on developer productivity and application portability. Create and run scalable APIs and applications without coding or by coding less. Focus on application business logic without any knowledge of the underlying microservices architecture.

データHTMLApache-2.0GitHub

Meerschaum

bmeares

154スター
Meerschaum preview

Create and manage data pipes with Meerschaum.

  • ⚡️ Incremental by default — the sync engine fetches only new or changed rows and concurrently updates many streams at once. Duplicate rows are ignored; rows with existing keys are updated.
  • 📊 Built for data scientists and analysts — integrate with Pandas, Grafana, and friends; persist DataFrames and always get the latest data. Skip pandas overhead and read rows as plain dicts with Pipe.get_docs().
データRustApache-2.0GitHub

boilstream

boilingdata

105スター

Rust based DuckDB Server with 1st class Postgres interface for BI Tools like Power BI and Tableau. Streaming interfaces like Web, Kafka, and FlightSQL/RPC.

  • Multi-tenant DuckDB — Full tenant isolation (secrets, attachments, DuckLakes, filesystem)
  • Streaming views — Continuous row-by-row SQL transforms on ingested data

bookshelf

bookshelf

6,344スター

Knex.jsを基盤に構築された、PostgreSQL、MySQL、SQLite3向けのシンプルなNode.js ORMです。

データJavaScriptMITGitHub

velox4j

boostscale

46スター

Community Java bindings for https://github.com/facebookincubator/velox

データJavaApache-2.0GitHub

dryrun

boringSQL

36スター

PostgreSQL schema intelligence MCP server with offline linting, migration safety, query validation for AI coding assistants.

データGoBSD-2-ClauseGitHub

bigbash

Borisvl

294スター

A converter that generates a bash one-liner from an SQL Select query (no DB necessary)

218スター

Web API Framework demonstrates scalable, multitenant, architecture and allows building its own solution in the minutes. Uses: Entity Framework, UnitOfWork, Repository patterns. Wrapped in Docker, Kubernetes

245スター

PostgreSQL extension for vscode providing explorer, highlighting, diagnostics, and intellisense

データTypeScriptMITGitHub