Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

3,298 projects

filesql

nao1215

385stars

loads CSV, TSV, LTSV, JSON, JSONL, Parquet, XLSX, ACH, and Fedwire files into SQLite; includes prep and frame for cleanup and in-memory transforms

  • Query file data with standard SQLite syntax, including joins, CTEs, and json_extract().
  • Optionally query with MySQL, PostgreSQL, or GoogleSQL syntax via WithDialect (translated to SQLite).

ZeBridge

ndrean

42stars

A bidirectional, local-first sync engine between Postgres and edge SQLite/PGLITE/Postgres/DuckDB clients over NATS

DataZigApache-2.0GitHub

sequelize

nestjs

266stars

Sequelize module for Nest framework (node.js) 🍈

DataTypeScriptMITGitHub

NeuraVision

NeuroVision-Studio

124stars

NeuraVision — AI content generation platform (PHP backend engine: auth, credits, generation, analytics)

soukai

NoelDeMartin

31stars

Javascript Active Record library

DataTypeScriptMITGitHub
26stars

Korpuslinguistik war noch nie so einfach...

  • Unterstützt über 100 unterschiedliche Datei-/Textformate für Im-/Export - inkl. vieler linguistischer XML-Formate.
  • Integrierter Webcrawler zum Sammeln eigener Webkorpora.
DataC#AGPL-3.0GitHub

open-prices

openfoodfacts

111stars

An open database of prices 🧾💸💰🏷️🤑🍽️

DataPythonAGPL-3.0GitHub

sql

opensearch-project

175stars

Query your data using familiar SQL or intuitive Piped Processing Language (PPL)

DataJavaApache-2.0GitHub

MongoKitten

orlandos-nl

756stars
MongoKitten preview

Native MongoDB driver for Swift, written in Swift

  • Change Streams: MongoDB 3.6+ (replica set or sharded cluster)
  • Transactions: MongoDB 4.0+ (replica set or sharded cluster)
DataSwiftMITGitHub

collector

pganalyze

408stars
collector preview

pganalyze statistics collector for gathering PostgreSQL metrics and log data

pivot

pivotlake

174stars
pivot preview

Pivot is a high-performance real time analytics database on open data formats.

  • Fast - Written in Rust and built on state-of-the-art columnar execution techniques, including morsel-driven parallelism, SIMD, NUMA-aware execution, and cache-conscious aggregation and joins, in addition to a few novel additions.
  • Scalable - With object storage as its backing store, Pivot can be scaled up, down, or to zero almost instantly.
DataRustApache-2.0GitHub
149stars
mindact-agent preview

MindAct: Community-Driven AI Agent for Claude, Obsidian, and RAG Knowledge Graphs

  • AI-powered knowledge graph – MindAct connects Claude, Obsidian, and retrieval-augmented generation so your notes stop being a pile of files and start behaving like a living, queryable graph. Ask questions in plain language and let the agent trace connections you didn't know were there.
  • Local-first by design – Your vault stays on your machine. The agent works against your own knowledge base, so your ideas, drafts, and research never need to leave your computer just to get organized.
DataTypeScriptMITGitHub
4,865stars

Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.

DataPythonMITGitHub

opengenie

raphaelmansuy

8stars
opengenie preview

Open-source Databricks App hosting a coding agent that sees your workspace — Unity Catalog, SQL warehouses, notebooks, jobs — on the model you choose. Genie Code's context, your choice of model and bill.

  • Unity Catalog - lists tables, reads columns, types and comments, searches table and column names - dbx_list_tables, dbx_describe_table, dbx_search_tables
  • SQL warehouses - runs the query, reads the result or the engine's error, corrects itself - dbx_run_sql
DataPythonApache-2.0GitHub

rapto

raptodb

40stars

For engineers seeking an in-memory key-value database, Rapto provides predictable performance, cache-aware design, and low memory usage through an event-driven runtime.

DataZigApache-2.0GitHub

misata

rasinmuhammed

77stars
misata preview

Declarative synthetic data for Python. State the facts a dataset must hold (monthly revenue, channel shares, balanced ledgers, foreign keys, state machines) and get multi-table data that holds them exactly, with a DuckDB certificate anyone can rerun. From YAML, SQL DDL or a sentence. CLI and MCP server.

  • outcome_curves - a measure's total per period, to the cent - ✓
  • rate_curves - the share of rows flagged per period, to the nearest row - ✓
DataPythonMITGitHub

etlx

realdatadriven

57stars

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

dbt-Workbench

rezer-bleede

73stars
dbt-Workbench preview

Open-source, self-hosted dbt control plane for data lineage, orchestration, and catalog management. Built for local, on-prem, and air-gapped deployments.

DataTypeScriptMITGitHub