Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

4,888 projects

sql-kit

vapor

294stars
sql-kit preview

*️⃣ Build SQL queries in Swift. Extensible, protocol-based design that supports DQL, DML, and DDL.

DataSwiftMITGitHub
64stars
data-engineering-agent-skills preview

Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.

  • Spec-first lifecycle with /spec, /plan, /build, /validate, /review, /backfill, and /ship
  • 73 workflow skills covering ingestion, transformation, orchestration, streaming, lakehouse, warehousing, governance, quality tooling, legacy modernization, release, incident recovery, and platform operating concerns, plus 1 compatibility alias entry skill
DataPythonMITGitHub

nebula

varchar-io

156stars
nebula preview

A distributed block-based data storage and compute engine

DataC++Apache-2.0GitHub
1,267stars
fastapi-alembic-sqlmodel-async preview

This is a project template which uses FastAPI, Pydantic 2.0, Alembic and async SQLModel as ORM. It shows a complete async CRUD using authentication and role base access control.

  • FastAPI Integration: FastAPI is a modern and efficient web framework that allows you to quickly and easily create APIs. This template uses the latest features of FastAPI and offers type hints that are compatible with Python 3.10 and later versions.
  • Asynchronous Database Management: We use SQLModel, an asynchronous ORM library, to interact with the database efficiently and securely.
DataPythonMITGitHub

TraffiQ

Varn1t

39stars

AI-powered traffic intelligence platform for real-time vehicle analytics, congestion prediction, and smart urban mobility systems.

  • ⚙️ Interactive Control Panel - Collapsible sidebar for live web-based parameter configuration
  • 🎯 Multi-Object Tracking - ByteTrack algorithm with unique vehicle IDs

PHP-MySQL-Class

Vasiliy-Makogon

39stars

PHP class library for simple, convenient, fast and safe work with MySql database, using PHP mysqli extension and imitation of prepared queries.

vastdb_sdk

vast-data

40stars
vastdb_sdk preview

Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.

  • The Basics - examples/quickstart.py - Connecting via environment variables, basic schemas/tables, simple inserts, and querying with predicates.
  • Direct S3 Ingest - examples/import_parquet.py - Creating tables directly from existing Parquet files on VAST without client-side copying.
DataPythonApache-2.0GitHub

vemetric

vemetric

397stars
vemetric preview

Simple, yet powerful Web- & Product Analytics.

  • Real-time analytics
  • Behavior tracking via User Journeys
DataTypeScriptAGPL-3.0GitHub
114stars

A curated collection of Java full stack interview questions for professionals with 3 to10 years of experience. This repository covers essential topics like Java, Hibernate, Spring Boot, microservices, JavaScript, ReactJS, HTML, CSS, and JUnit, tailored to help you excel in your interviews with various companies.

sql-formatter

vertical-blank

272stars

SQL formatter written with only Java Standard Library, without dependencies.

915stars

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

DataDockerfileApache-2.0GitHub

mcp-local-wp

verygoodplugins

34stars

MCP server for WordPress database access via Local by Flywheel

DataTypeScriptGitHub

nebula

vesoft-inc

12,468stars
nebula preview

A distributed, fast open-source graph database featuring horizontal scalability and high availability

DataC++Apache-2.0GitHub
739stars

📊 An analytics server that doesn't undermine user's privacy

  • Fair - It's meant to provide lightweight and anonymous analytics about traffic and usage, not to track behaviors nor geographical locations of users
  • Distributed - Raw traffic data is written in an append-only, secure, and distributed log. It uses hypercore under the hood
DataJavaScriptMITGitHub

VexDB-Lite

VexDB-THU

2,319stars

A cross-platform vector database, which can be integrated into existing databases as a plugin.

pg_background

vibhorkum

262stars

Production-grade PostgreSQL extension to execute arbitrary SQL in background worker processes — with async execution, autonomous transactions, cookie-protected handles, cancellation, progress reporting, and observability.

  • Async SQL execution — offload queries to background workers running inside the server
  • Autonomous transactions — workers commit (or roll back) independently of the caller
46stars

Exploring football and other sports through data. Includes analyses of match events, player performance, xG models, tactical visualizations, and predictive insights.

DataJupyter NotebookGitHub

cloud-etl-pipeline

Victor-Kipruto-Rop

45stars

Built a scalable cloud ETL pipeline using Python, PostgreSQL, Pandas, and Docker to efficiently process, clean, and load over 1.6 million records with optimized batch processing, fault tolerance, and automated data validation.

DataPythonMITGitHub

SQL-for-Data

Victor-Kipruto-Rop

43stars

SQL practice repository covering data analysis, joins, aggregations, window functions, and real-world query solving for data engineering and analytics.