Skip to content
Catégories de projets

Données · GitHub

Comparez bases de données, analyses, SQL et projets d’ingénierie des données.

Projets GitHub utiles

3,298 projets

misata

rasinmuhammed

77étoiles
misata preview

Declarative synthetic data for Python. State the facts a dataset must hold (monthly revenue, channel shares, balanced ledgers, foreign keys, state machines) and get multi-table data that holds them exactly, with a DuckDB certificate anyone can rerun. From YAML, SQL DDL or a sentence. CLI and MCP server.

  • outcome_curves - a measure's total per period, to the cent - ✓
  • rate_curves - the share of rows flagged per period, to the nearest row - ✓

etlx

realdatadriven

57étoiles

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

dbt-Workbench

rezer-bleede

73étoiles
dbt-Workbench preview

Open-source, self-hosted dbt control plane for data lineage, orchestration, and catalog management. Built for local, on-prem, and air-gapped deployments.

DonnéesTypeScriptMITGitHub
149étoiles
OUI-Master-Database preview

MAC address manufacturer lookup database combining IEEE, Nmap, Wireshark and HDM Mac-Tracker, with downloadable formats and a browser lookup. https://ringmast4r.github.io/OUI-Master-Database/

DonnéesJavaScriptGitHub

uql

rogerpadilla

132étoiles
uql preview

JSON-native TypeScript ORM for Bun, Browsers, Edge, Node, Workers

DonnéesTypeScriptMITGitHub

Kafka-FDB-Streamline

Ronitsabhaya75

26étoiles

Streams changes from a FoundationDB directory to a Kafka topic using FDB's native CDC. See Proposal.md for scope and design.

DonnéesPythonApache-2.0GitHub

rosedb

rosedblabs

4,889étoiles
rosedb preview

Lightweight, fast and reliable key/value storage engine based on Bitcask.

DonnéesGoApache-2.0GitHub

stock-screener

RyanJHamby

73étoiles
stock-screener preview

Automated stock screener scanning 3,800+ stocks daily for confirmed Stage 2 uptrends passing 8 strict criteria. Features: smart caching (74% fewer API calls), market regime filtering, automated stop-loss calculation, and GitHub Actions automation. Follows Mark Minervini's Trend Template.

scriptella-etl

scriptella

131étoiles
scriptella-etl preview

Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java.

DonnéesJavaApache-2.0GitHub

Exploit-Index

SecureWithUmer

105étoiles
Exploit-Index preview

Exploit-Index : The Ultimate CVE Proof of Concept (PoC) & Exploit Database. A zero-API, high-performance aggregator for 0days, vulnerabilities, and Threat Intelligence. Replacing manual searches for elite SOC teams, DevSecOps, and Bug Bounty Hunters.

minarrow

SpaceCell

103étoiles

Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.

DonnéesRustApache-2.0GitHub

Wired

SpaceCell

44étoiles
Wired preview

Fast data transport : Apache Arrow, Protobuf and Message Pack data on the one stream. Measured faster than Arrow Flight on all open benchmarks. HTTP, TCP, QUIC, Websocket, Webtransport, Stdio, UDS, all interchangeable, with 64-byte SIMD compatibilty maintained over the network and to/from disk via custom Arrow Mmap and Parquet Readers and Writers

sqlbuild

sqlstack-io

49étoiles
sqlbuild preview

SQL transformation framework with custom compile-time checks, end-to-end testing and safe renames that keep your table history.

DonnéesRustApache-2.0GitHub
27étoiles

Easily connect to MySQL in Garry's Mod using Rust binary!

  • ✅ Dual Database Support - MySQL and SQLite
  • ⚡ Async & Sync - Both asynchronous and synchronous queries

litefs

superfly

4,915étoiles

FUSE-based file system for replicating SQLite databases across a cluster of machines

DonnéesGoApache-2.0GitHub

tabsdata

tabsdata

44étoiles
tabsdata preview

Agentic data engineering built on Pub/Sub for Tables. Discover, publish, transform and consume data as versioned tables with lineage, with an AI agent doing the assembly and the engineer approving.

tidx

tempoxyz

108étoiles
tidx preview

tidx indexes Tempo chain data into a hybrid PostgreSQL + ClickHouse architecture for fast point lookups (OLTP) and lightning-fast analytics (OLAP).

  • Tiered Storage: hot window in PostgreSQL (OLTP), full archive in ClickHouse (OLAP), queried as one
  • Event/Function Decoding: Query decoded events or function calldata by ABI signature (no pre-registration)

finmlkit

terbed

114étoiles
finmlkit preview

An open-source, lightweight, and blazing-fast financial machine learning library built with Numba. Process raw trades, generate advanced bars, features, and labels for quantitative research.

  • Dual-backend architecture (pandas for development/prototyping, Numba for production)
  • SISO, MISO, SIMO, MIMO transform patterns for flexible feature engineering
49étoiles
UserAgent-list preview

Automated User-Agent database for 100+ browsers on 100+ operating systems. Updated every 5 minutes via GitHub Actions. Weighted by real-world popularity, grouped by OS and browser, with a cumulative ALL/ folder of unique agents.

  • 100+ browsers: Chrome, Firefox, Safari, Edge, Opera, Brave, Vivaldi, Yandex, Tor, and others
  • 100+ operating systems: Windows, macOS, Linux, Android, iOS, Chrome OS, BSD, and others

buntdb

tidwall

4,871étoiles

BuntDB is an embeddable, in-memory key/value database for Go with custom indexing and geospatial support

  • In-memory database for fast reads and writes
  • Embeddable with a simple API

bigtesty

tosun-si

68étoiles
bigtesty preview

Integration tests for BigQuery SQL, on the real engine and ephemeral datasets: YAML, pytest and any language.

pytrilogy

trilogy-data

61étoiles
pytrilogy preview

Can we improve the best language for data analytics? Strongly typed, composable, cross-engine SQL. More declarative and expressive, safer, and simpler for humans and agents.

turingdb

turing-db

189étoiles
turingdb preview

TuringDB high performance in-memory column-oriented graph database engine