Skip to content
Projektkategorien

Daten · GitHub

Vergleiche Datenbanken, Analysen, SQL- und Data-Engineering-Projekte.

Nützliche GitHub-Projekte

4,889 Projekte
865Sterne

Rich Criteria API for JPA providers

  • Use CTEs and recursive CTEs
  • Use modification CTEs aka DML in CTEs
DatenJavaApache-2.0GitHub

blazingsql

BlazingDB

2,012Sterne
blazingsql preview

BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.

DatenC++Apache-2.0GitHub
35Sterne
rivianmate preview

Self-hosted data logger and dashboard for Rivian vehicles: drives, charging sessions, vehicle health, and more stored in your own database

DatenTypeScriptGPL-3.0GitHub

node-gtfs

BlinkTagInc

507Sterne
node-gtfs preview

Import, validate, query, and export GTFS Schedule and Realtime data with SQLite, PostgreSQL, and MySQL.

DatenTypeScriptMITGitHub

bitcoin-etl

blockchain-etl

463Sterne

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

DatenPythonMITGitHub

ethereum-etl

blockchain-etl

3,133Sterne

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

DatenPythonMITGitHub

ethereum-etl-airflow

blockchain-etl

444Sterne

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

DatenPythonMITGitHub

polygon-etl

blockchain-etl

106Sterne
polygon-etl preview

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

DatenPythonMITGitHub

scan

blockloop

615Sterne

Tiny lib to scan SQL rows directly to structs, slices, and primitive types

tsfresh

blue-yonder

9,490Sterne
tsfresh preview

Automatic extraction of relevant features from time series:

  • Christ, M., Braun, N., Neuffer, J., and Kempa-Liehr A.W. (2018). Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh -- A Python package). Neurocomputing 307, p. 72-77, doi: 10.1016/j.neucom.2018.03.067.
  • Christ, M., Kempa-Liehr, A.W., and Feindt, M. (2017). Distributed and parallel time series feature extraction for industrial big data applications. ArXiv e-print 1610.07717, https://arxiv.org/abs/1610.07717.
DatenJupyter NotebookMITGitHub

turbodbc

blue-yonder

660Sterne

Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with the Python Database API Specification 2.0.

serverless

bluenimble

32Sterne
serverless preview

BlueNimble is a Hybrid Serverless Platform focusing on developer productivity and application portability. Create and run scalable APIs and applications without coding or by coding less. Focus on application business logic without any knowledge of the underlying microservices architecture.

DatenHTMLApache-2.0GitHub

Meerschaum

bmeares

154Sterne
Meerschaum preview

Create and manage data pipes with Meerschaum.

  • ⚡️ Incremental by default — the sync engine fetches only new or changed rows and concurrently updates many streams at once. Duplicate rows are ignored; rows with existing keys are updated.
  • 📊 Built for data scientists and analysts — integrate with Pandas, Grafana, and friends; persist DataFrames and always get the latest data. Skip pandas overhead and read rows as plain dicts with Pipe.get_docs().
DatenRustApache-2.0GitHub
84Sterne
materialize-tutorials preview

Materialize is a streaming database for real-time analytics. This is a collection of Materialize demos and tutorials.

Bodo

bodo-ai

384Sterne
Bodo preview

High Performance Scalable Data Processing in Python and SQL

  • Drop-in Pandas replacement, (just change the import!) with a seamless fallback to vanilla Pandas to avoid breaking existing workloads.
  • Intuitive APIs for simplifying and scaling AI workloads.
DatenPythonApache-2.0GitHub