Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

4,889 projects

setl

SETL-Framework

186stars
setl preview

A simple Spark-powered ETL framework that just works 🍺

DataScalaApache-2.0GitHub
33stars

PostGIS extension for ActiveRecord's PostgreSQL adapter. Adds spatial types and queries to Rails 8+ with zero configuration.

  • st_point, st_line_string, st_polygon
  • st_multi_point, st_multi_line_string, st_multi_polygon

kaunta

seuros

63stars

Privacy-focused web analytics. Single binary, self-hosted.

2,664stars
connector-x preview

Fastest library to load data from DB to DataFrames in Rust and Python

dataprep

sfu-db

2,272stars
dataprep preview

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

DataPythonMITGitHub

storage-box

shahradelahi

441stars

💾 A Memory-based key-value storage system for JavaScript.

  • Support for Node.js, Bun and the browser
  • Support for multiple storage types (Memory, File, Browser-storage, etc.)
DataTypeScriptMITGitHub

learn-data-munging

shauryashaurya

53stars
learn-data-munging preview

Notes on Data Engineering with Pandas, PySpark, Dask, Ray, Arrow DataFusion, Polars etc.

DataJupyter NotebookMITGitHub
1,342stars
Beyond-LeetCode-SQL preview

Analysis of SQL Leetcode and classic interview questions, common pitfalls, anti-patterns and handy tricks. Sample databases.

DataJupyter NotebookMITGitHub

pg-osc

shayonj

621stars
pg-osc preview

Easy CLI tool for making zero downtime schema changes and backfills in PostgreSQL

  • pg-osc supports when a column is being added, dropped or renamed with no data loss.
  • pg-osc acquires minimal locks throughout the process (read more below on the caveats).
1,040stars
pg_easy_replicate preview

Easily setup logical replication and switchover to new database with minimal downtime

memento

sheharyarn

797stars
memento preview

Simple + Powerful interface to the Mnesia Distributed Database 💾

DataElixirMITGitHub

jev4pg

Sheltercosmo

262stars
jev4pg preview

Established strong JEV based natural language to SQL performance and well-covered semantic operators for PostgreSQL with optimized cost and latency. Reusable evidence, with native execution, parallel plans and explainable embeddings in development preview.

  • Support and operations queues - Classify unresolved requests, join account data and share reviewed priority definitions with reporting.
  • Document intake - Extract typed fields with exact source passages, review the proposed records and approve an import. Guide.
DataPythonApache-2.0GitHub

easydb_app

shencangsheng

591stars
easydb_app preview

EasyDB is a lightweight desktop app built with Tauri + Rust, powered by Apache DataFusion. Query local CSV, TSV, Text, NdJson, Excel, Parquet files and MySQL databases directly with SQL — no external database required. Handles datasets from hundreds of MB to several GB with ease. 让所有数据说同一种“语言”

  • High Performance — Built on Rust and DataFusion, effortlessly handles large files
  • Low Memory Usage — Runs with minimal hardware resources
DataTypeScriptMITGitHub

mouji

sheshbabu

54stars
mouji preview

Minimal Web Analytics

  • Track pageviews
  • Multiple projects support
DataGoAGPL-3.0GitHub

shinzo

shinzo-labs

33stars
shinzo preview

Complete observability platform for AI agents and MCP servers. Improve your AI deployment outcomes, identify inference inefficiencies, and gain insights into real agent usage patterns.

DataTypeScriptGitHub

shinzo-ts

shinzo-labs

68stars

TypeScript SDK for MCP server observability, built on OpenTelemetry. Gain insight into agent usage patterns, contextualize tool calls, and analyze server performance across platforms. Integrate with any OpenTelemetry ingest service including the Shinzo platform.

DataTypeScriptMITGitHub

awesome-mysql

shlomi-noach

2,617stars

A curated list of awesome MySQL software, libraries, tools and resources