Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

6,820 projects

oneDAL

uxlfoundation

654stars
oneDAL preview

oneAPI Data Analytics Library (oneDAL)

DataC++Apache-2.0GitHub

V3n0M-Scanner

v3n0m-Scanner

1,592stars
V3n0M-Scanner preview

Popular Pentesting scanner in Python3.6 for SQLi/XSS/LFI/RFI and other Vulns

DataPythonGPL-3.0GitHub

pronto

vadimdemedes

689stars
pronto preview

⚡ The now.sh experience for databases

DataJavaScriptMITGitHub

selda

valderman

480stars

A type-safe, high-level SQL library for Haskell

  • Monadic interface.
  • Portable: backends for SQLite and PostgreSQL.
DataHaskellMITGitHub

sonic

valeriansaliou

21,389stars
sonic preview

🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.

  • Search terms are stored in collections, organized in buckets; you may use a single bucket, or a bucket per user on your platform if you need to search in separate indexes.
  • Search results return object identifiers, that can be resolved from an external database if you need to enrich the search results. This makes Sonic a simple word index, that points to identifier results. Sonic doesn't store any direct textual data in its index, but it still holds a word graph for auto-completion and typo corrections.
DataRustMPL-2.0GitHub
265stars

ANTLR-based PostgreSQL query parser for Go. Extracts tables, columns, joins, CTEs, parameters, DDL actions, and full column-usage metadata from SQL into a structured IR.

DataGoApache-2.0GitHub

valkey-search

valkey-io

148stars

valkey-search is a C++ module which extends valkey with vector search and secondary indexing capabilities. It enables users to index and query data stored in Valkey using complex queries with filters while maintaining high performance and scalability.

DataC++BSD-3-ClauseGitHub

fluent

vapor

1,421stars
fluent preview

Vapor ORM (queries, models, and relations) for NoSQL and SQL databases

DataSwiftMITGitHub
264stars

Swift ORM (queries, models, and relations) for NoSQL and SQL databases

DataSwiftMITGitHub

sql-kit

vapor

294stars
sql-kit preview

*️⃣ Build SQL queries in Swift. Extensible, protocol-based design that supports DQL, DML, and DDL.

DataSwiftMITGitHub
65stars
data-engineering-agent-skills preview

Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.

  • Spec-first lifecycle with /spec, /plan, /build, /validate, /review, /backfill, and /ship
  • 73 workflow skills covering ingestion, transformation, orchestration, streaming, lakehouse, warehousing, governance, quality tooling, legacy modernization, release, incident recovery, and platform operating concerns, plus 1 compatibility alias entry skill
DataPythonMITGitHub

nebula

varchar-io

156stars
nebula preview

A distributed block-based data storage and compute engine

DataC++Apache-2.0GitHub
1,266stars
fastapi-alembic-sqlmodel-async preview

This is a project template which uses FastAPI, Pydantic 2.0, Alembic and async SQLModel as ORM. It shows a complete async CRUD using authentication and role base access control.

  • FastAPI Integration: FastAPI is a modern and efficient web framework that allows you to quickly and easily create APIs. This template uses the latest features of FastAPI and offers type hints that are compatible with Python 3.10 and later versions.
  • Asynchronous Database Management: We use SQLModel, an asynchronous ORM library, to interact with the database efficiently and securely.
DataPythonMITGitHub

TraffiQ

Varn1t

38stars

AI-powered traffic intelligence platform for real-time vehicle analytics, congestion prediction, and smart urban mobility systems.

  • ⚙️ Interactive Control Panel - Collapsible sidebar for live web-based parameter configuration
  • 🎯 Multi-Object Tracking - ByteTrack algorithm with unique vehicle IDs
308stars

An Online System built for the Blood Donation Organisation to manage the Blood Bank System in which Blood Donors can willingly give their name and the Person in need of blood can find whether the Blood is available or not.

284stars

Semi-automatic admin site generator for any SQL database

DataCSSWTFPLGitHub

PHP-MySQL-Class

Vasiliy-Makogon

39stars

PHP class library for simple, convenient, fast and safe work with MySql database, using PHP mysqli extension and imitation of prepared queries.

vastdb_sdk

vast-data

40stars
vastdb_sdk preview

Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.

  • The Basics - examples/quickstart.py - Connecting via environment variables, basic schemas/tables, simple inserts, and querying with predicates.
  • Direct S3 Ingest - examples/import_parquet.py - Creating tables directly from existing Parquet files on VAST without client-side copying.
DataPythonApache-2.0GitHub