Skip to content
プロジェクトカテゴリ

データ · GitHub

データベース、分析、SQL、データエンジニアリングのプロジェクトを比較できます。

便利なGitHubプロジェクト

3,298 プロジェクト
149スター
OUI-Master-Database preview

MAC address manufacturer lookup database combining IEEE, Nmap, Wireshark and HDM Mac-Tracker, with downloadable formats and a browser lookup. https://ringmast4r.github.io/OUI-Master-Database/

uql

rogerpadilla

132スター
uql preview

JSON-native TypeScript ORM for Bun, Browsers, Edge, Node, Workers

データTypeScriptMITGitHub

Kafka-FDB-Streamline

Ronitsabhaya75

26スター

Streams changes from a FoundationDB directory to a Kafka topic using FDB's native CDC. See Proposal.md for scope and design.

データPythonApache-2.0GitHub

rosedb

rosedblabs

4,889スター
rosedb preview

Lightweight, fast and reliable key/value storage engine based on Bitcask.

データGoApache-2.0GitHub

stock-screener

RyanJHamby

73スター
stock-screener preview

Automated stock screener scanning 3,800+ stocks daily for confirmed Stage 2 uptrends passing 8 strict criteria. Features: smart caching (74% fewer API calls), market regime filtering, automated stop-loss calculation, and GitHub Actions automation. Follows Mark Minervini's Trend Template.

scriptella-etl

scriptella

131スター
scriptella-etl preview

Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java.

データJavaApache-2.0GitHub

Exploit-Index

SecureWithUmer

105スター
Exploit-Index preview

Exploit-Index : The Ultimate CVE Proof of Concept (PoC) & Exploit Database. A zero-API, high-performance aggregator for 0days, vulnerabilities, and Threat Intelligence. Replacing manual searches for elite SOC teams, DevSecOps, and Bug Bounty Hunters.

minarrow

SpaceCell

103スター

Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.

データRustApache-2.0GitHub

Wired

SpaceCell

44スター
Wired preview

Fast data transport : Apache Arrow, Protobuf and Message Pack data on the one stream. Measured faster than Arrow Flight on all open benchmarks. HTTP, TCP, QUIC, Websocket, Webtransport, Stdio, UDS, all interchangeable, with 64-byte SIMD compatibilty maintained over the network and to/from disk via custom Arrow Mmap and Parquet Readers and Writers

sqlbuild

sqlstack-io

49スター
sqlbuild preview

SQL transformation framework with custom compile-time checks, end-to-end testing and safe renames that keep your table history.

データRustApache-2.0GitHub
27スター

Easily connect to MySQL in Garry's Mod using Rust binary!

  • ✅ Dual Database Support - MySQL and SQLite
  • ⚡ Async & Sync - Both asynchronous and synchronous queries

Reports.JS

stimulsoft

54スター

Stimulsoft Reports.JS is a reporting tool for Node.js and JavaScript applications.

litefs

superfly

4,915スター

FUSE-based file system for replicating SQLite databases across a cluster of machines

データGoApache-2.0GitHub

surrealdb.py

surrealdb

271スター

SurrealDB SDK for Python

  • Automatic tracing: All database methods are instrumented automatically
  • Smart parameter logging: Sensitive data (tokens, passwords) are automatically scrubbed
データPythonApache-2.0GitHub

tabsdata

tabsdata

44スター
tabsdata preview

Agentic data engineering built on Pub/Sub for Tables. Discover, publish, transform and consume data as versioned tables with lineage, with an AI agent doing the assembly and the engineer approving.

tidx

tempoxyz

108スター
tidx preview

tidx indexes Tempo chain data into a hybrid PostgreSQL + ClickHouse architecture for fast point lookups (OLTP) and lightning-fast analytics (OLAP).

  • Tiered Storage: hot window in PostgreSQL (OLTP), full archive in ClickHouse (OLAP), queried as one
  • Event/Function Decoding: Query decoded events or function calldata by ABI signature (no pre-registration)

finmlkit

terbed

114スター
finmlkit preview

An open-source, lightweight, and blazing-fast financial machine learning library built with Numba. Process raw trades, generate advanced bars, features, and labels for quantitative research.

  • Dual-backend architecture (pandas for development/prototyping, Numba for production)
  • SISO, MISO, SIMO, MIMO transform patterns for flexible feature engineering
49スター
UserAgent-list preview

Automated User-Agent database for 100+ browsers on 100+ operating systems. Updated every 5 minutes via GitHub Actions. Weighted by real-world popularity, grouped by OS and browser, with a cumulative ALL/ folder of unique agents.

  • 100+ browsers: Chrome, Firefox, Safari, Edge, Opera, Brave, Vivaldi, Yandex, Tor, and others
  • 100+ operating systems: Windows, macOS, Linux, Android, iOS, Chrome OS, BSD, and others

buntdb

tidwall

4,871スター

BuntDB is an embeddable, in-memory key/value database for Go with custom indexing and geospatial support

  • In-memory database for fast reads and writes
  • Embeddable with a simple API

bigtesty

tosun-si

68スター
bigtesty preview

Integration tests for BigQuery SQL, on the real engine and ephemeral datasets: YAML, pytest and any language.

pytrilogy

trilogy-data

61スター
pytrilogy preview

Can we improve the best language for data analytics? Strongly typed, composable, cross-engine SQL. More declarative and expressive, safer, and simpler for humans and agents.

turingdb

turing-db

189スター
turingdb preview

TuringDB high performance in-memory column-oriented graph database engine

cloud-etl-pipeline

Victor-Kipruto-Rop

45スター

Built a scalable cloud ETL pipeline using Python, PostgreSQL, Pandas, and Docker to efficiently process, clean, and load over 1.6 million records with optimized batch processing, fault tolerance, and automated data validation.