Skip to content
프로젝트 카테고리

데이터 · GitHub

데이터베이스, 분석, SQL, 데이터 엔지니어링 프로젝트를 비교하세요.

유용한 GitHub 프로젝트

4,473 프로젝트
161스타
athenadriver preview

A fully-featured AWS Athena database driver (+ athenareader https://github.com/uber/athenadriver/tree/master/athenareader)

  • Support multiple AWS authorization methods :link:
  • Full support of Athena Basic Data Types

reddit-detective

umitkaanusta

225스타
reddit-detective preview

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

  • Convert any tabular Reddit data to Neo4j Graph with given instructions from the user
  • A relationship to link users with its only property being the amount of encounters

monorm

UniForgeStack

48스타

An async ORM for Python and TypeScript with one Rust core: one Prisma schema, typed models, migrations, PostgreSQL and SQLite.

  • Schema language, SQLite and PostgreSQL types, client defaults, code generation - schema.md
  • Python API: queries, pagination, subqueries, windows, CTEs, writes, transactions, locks, hooks - python-api.md
27스타
awesome-data-engineering-skills preview

36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.

64스타
data-engineering-agent-skills preview

Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.

  • Spec-first lifecycle with /spec, /plan, /build, /validate, /review, /backfill, and /ship
  • 73 workflow skills covering ingestion, transformation, orchestration, streaming, lakehouse, warehousing, governance, quality tooling, legacy modernization, release, incident recovery, and platform operating concerns, plus 1 compatibility alias entry skill

vastdb_sdk

vast-data

40스타
vastdb_sdk preview

Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.

  • The Basics - examples/quickstart.py - Connecting via environment variables, basic schemas/tables, simple inserts, and querying with predicates.
  • Direct S3 Ingest - examples/import_parquet.py - Creating tables directly from existing Parquet files on VAST without client-side copying.
데이터PythonApache-2.0GitHub
46스타

Exploring football and other sports through data. Includes analyses of match events, player performance, xG models, tactical visualizations, and predictive insights.

데이터Jupyter NotebookGitHub

streaming-pipeline

Victor-Kipruto-Rop

42스타

Real-time data streaming pipeline built with modern data engineering tools for scalable ingestion, processing, transformation, and analytics of continuous data streams.

sql-to-logsql

VictoriaMetrics

36스타
sql-to-logsql preview

Simple UI that provides SQL support for VictoriaLogs and VictoriaTraces

  • It supports integrations via JDBC driver.
  • Go app + library with zero dependencies
데이터GoApache-2.0GitHub

VictoriaTraces

VictoriaMetrics

521스타

Fast and easy to use database for traces, which can efficiently handle terabytes of trace spans.

데이터TypeScriptApache-2.0GitHub
584스타

This tool allows you to perform OSINT and reconnaissance on an organisation or an individual. It allows one to search 1.4 Billion clear text credentials which was dumped as part of BreachCompilation leak. This database makes finding passwords faster and easier than ever before.

데이터PythonGPL-3.0GitHub

visprex

visprex

527스타

Visualise your CSV files in seconds without sending your data anywhere

데이터TypeScriptMITGitHub