Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

4,218 projects
61stars
steampipe-mod-azure-compliance preview

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS, HIPAA HITRUST, NIST, and more across all of your Azure subscriptions using Powerpipe and Steampipe.

DataPuppetApache-2.0GitHub
28stars
steampipe-plugin-shodan preview

Use SQL to instantly query host, DNS and exploit information using Shodan. Open source CLI. No DB required.

DataGoApache-2.0GitHub
34stars
Superstore-Sales-Dashboard-with-Streamlit preview

Superstore Sales with Streamlit is a data visualization and analysis project that uses the Streamlit framework to create an interactive web application for exploring and analyzing sales data from a superstore. This project aims to provide an easy-to-use interface for users to gain insights into sales trends, Sales performance, product performance,

  • Interactive Data Visualization: Visualize sales data through dynamic charts and graphs.
  • Filter and Search: Easily filter data by date, product category, region, and more.

tuva-core

tuva-health

333stars

Main repo including core data model, data marts, data quality tests, and terminology sets.

DataPythonApache-2.0GitHub

typetta

twinlogix

115stars

Node.js ORM written in TypeScript for type lovers.

DataTypeScriptApache-2.0GitHub

uberjob

twosigma

33stars

uberjob is a Python package for building and running call graphs.

DataPythonApache-2.0GitHub

tyk-pump

TykTechnologies

134stars

Tyk Analytics Pump to move analytics data from Redis to any supported back end (multiple back ends can be written to at once).

161stars
athenadriver preview

A fully-featured AWS Athena database driver (+ athenareader https://github.com/uber/athenadriver/tree/master/athenareader)

  • Support multiple AWS authorization methods :link:
  • Full support of Athena Basic Data Types

reddit-detective

umitkaanusta

225stars
reddit-detective preview

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

  • Convert any tabular Reddit data to Neo4j Graph with given instructions from the user
  • A relationship to link users with its only property being the amount of encounters
DataPythonMITGitHub

monorm

UniForgeStack

48stars

An async ORM for Python and TypeScript with one Rust core: one Prisma schema, typed models, migrations, PostgreSQL and SQLite.

  • Schema language, SQLite and PostgreSQL types, client defaults, code generation - schema.md
  • Python API: queries, pagination, subqueries, windows, CTEs, writes, transactions, locks, hooks - python-api.md
27stars
awesome-data-engineering-skills preview

36 data-engineering skills for AI coding agents — dbt, Airflow, Dagster, Prefect, Spark, Snowflake, BigQuery, Databricks, Kafka, Iceberg. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with idempotency, backfill, and data-quality know-how. Runs in Claude Code, Cursor, Codex, Copilot, Gemini CLI and more.

64stars
data-engineering-agent-skills preview

Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.

  • Spec-first lifecycle with /spec, /plan, /build, /validate, /review, /backfill, and /ship
  • 73 workflow skills covering ingestion, transformation, orchestration, streaming, lakehouse, warehousing, governance, quality tooling, legacy modernization, release, incident recovery, and platform operating concerns, plus 1 compatibility alias entry skill
DataPythonMITGitHub

vastdb_sdk

vast-data

40stars
vastdb_sdk preview

Python-based SDK designed for interacting with VAST Database & VAST Catalog, enabling schema and table management, efficient ingest, query and modification of columnar data.

  • The Basics - examples/quickstart.py - Connecting via environment variables, basic schemas/tables, simple inserts, and querying with predicates.
  • Direct S3 Ingest - examples/import_parquet.py - Creating tables directly from existing Parquet files on VAST without client-side copying.
DataPythonApache-2.0GitHub

sql-formatter

vertical-blank

272stars

SQL formatter written with only Java Standard Library, without dependencies.

62stars

500+ Java interview questions and answers for Junior, Middle, and Senior developers. Covers Spring Boot, Hibernate, SQL, Kafka, Docker, Kubernetes, and more.

DataJavaScriptMITGitHub