Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

3,122 projects

blacklist

anudeepND

1,322stars+1in 24h
blacklist preview

Curated and well-maintained hostfile to block ads, tracking, cryptomining, and more! Updated regularly. ⚡🔒

  • Host file: Based on hosts file, all the bad domains are blocked with 0.0.0.0
  • Any device: Compatible with all devices, regardless of OS.
DataHosts FileMITGitHub

arrow

apache

17,279stars+1in 24h

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

DataC++Apache-2.0GitHub
1,270stars+1in 24h

Node.js Driver for Apache Cassandra

  • Simple, Prepared, and Batch statements
  • Asynchronous IO, parallel execution, request pipelining
DataJavaScriptApache-2.0GitHub

couchdb

apache

7,007stars+1in 24h

Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability

DataErlangApache-2.0GitHub

gluten

apache

1,619stars+1in 24h
gluten preview

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

DataScalaApache-2.0GitHub

linkis

apache

3,418stars+1in 24h
linkis preview

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

  • Support for diverse underlying computation storage engines : Spark, Hive, Python, Shell, Flink, JDBC, Pipeline, Sqoop, OpenLooKeng, Presto, ElasticSearch, Trino, SeaTunnel, etc.;
  • Support for diverse language : SparkSQL, HiveSQL, Python, Shell, Pyspark, Scala, JSON and Java;
DataJavaApache-2.0GitHub
20,822stars+1in 24h
shardingsphere preview

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

  • Database types completely decoupled, supporting rapid integration of new databases
  • Functional modules completely decoupled, supporting on-demand feature combination
DataJavaApache-2.0GitHub

kubeblocks

apecloud

3,166stars+1in 24h
kubeblocks preview

KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.

  • Supports various databases, including MySQL, PostgreSQL, Redis, MongoDB, Kafka, Clickhouse, ElasticSearch and more
  • Provides production-level performance, resilience, and observability
DataGoAGPL-3.0GitHub

arcadedb

ArcadeData

1,248stars+1in 24h
arcadedb preview

ArcadeDB Multi-Model Database, one DBMS that supports SQL, Cypher, Gremlin, HTTP/JSON, MongoDB and Redis. ArcadeDB is a conceptual fork of OrientDB, the first Multi-Model DBMS. ArcadeDB supports Vector Embeddings.

DataJavaApache-2.0GitHub

fit-dashboard

arpanghosh8453

241stars+1in 24h
fit-dashboard preview

Standalone offline local desktop application to process, store, and visualize Garmin FIT file data in a comprehensive dashboard.

  • FIT File Parsing: Native Rust parser using the fitparser crate. Supports all standard Garmin FIT activity files with automatic field extraction.
  • High-Performance Storage: DuckDB-powered analytical database with automatic downsampling for fast time-series queries. Handles hundreds of activities with millions of data points.
DataTypeScriptGitHub

garmin-grafana

arpanghosh8453

3,541stars+1in 24h
garmin-grafana preview

A Dockerized python Script to fetch Garmin health data and populate that in a InfluxDB Database, for visualization long term health trends with Grafana

  • Automatic data collection from Garmin
  • Heart Rate Data
DataPythonBSD-3-ClauseGitHub

arroyo

ArroyoSystems

5,078stars+1in 24h
arroyo preview

Distributed stream processing engine in Rust

DataRustApache-2.0GitHub

odmantic

art049

1,177stars+1in 24h

Sync and Async ODM (Object Document Mapper) for MongoDB based on python type hints

DataPythonISCGitHub
8,250stars+1in 24h

A vector search SQLite extension that runs anywhere!

DataCApache-2.0GitHub

schemagate

ashishsinha1602

135stars+1in 24h
schemagate preview

Text-to-SQL access control: schema selection that gives the LLM only the tables the caller is allowed to read. Row-level-security-aware table pruning for LangChain, MCP and any SQL agent. Postgres, Oracle, MySQL, SQL Server. 75% fewer prompt tokens.

DataPythonApache-2.0GitHub

authorizer

authorizerdev

2,120stars+1in 24h
authorizer preview

Your data, your control. Fully open source, authentication and authorization. No lock-ins. Deployment in Railway in 120 seconds || Spin a docker image as a micro-service in your infra. Built in login page and Admin panel out of the box.

DataGoApache-2.0GitHub

autobase

autobase-tech

4,435stars+1in 24h
autobase preview

Automated database platform for PostgreSQL® - Your own DBaaS.

DataJinjaMITGitHub

sdk

basedosdados

429stars+1in 24h
sdk preview

⚙️ Código de manutenção do datalake (metadados e pacotes de acesso) | 📖 Docs: https://basedosdados.org/docs/home

CSVLint

BdR76

251stars+1in 24h
CSVLint preview

CSV Lint plug-in for Notepad++ for syntax highlighting, csv validation, automatic column and datatype detecting, fixed width datasets, change datetime format, decimal separator, sort data, count unique values, convert to xml, json, sql etc. A plugin for data cleaning and working with messy data files.

DataC#GPL-3.0GitHub

bigchaindb

bigchaindb

4,031stars+1in 24h

Meet BigchainDB. The blockchain database.

DataPythonApache-2.0GitHub