Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

4,888 projects

beavers

tradewelltech

41stars
beavers preview

Python stream processing for analytics

  • Works in real time (eg: reading from Kafka) and replay mode (eg: reading from Parquet files).
  • Optimized for analytics, using micro-batches (instead of processing records one by one).
DataPythonApache-2.0GitHub

Strata

tradingtechnologies

1,000stars

Open source analytics and market risk library from OpenGamma

DataJavaApache-2.0GitHub

traildb

traildb

1,090stars
traildb preview

TrailDB is an efficient tool for storing and querying series of events

mquire

trailofbits

193stars

Zero-dependency Linux memory forensics, leveraging kernel-embedded BTF and kallsyms for type-aware memory analysis without external debug info.

DataRustApache-2.0GitHub
28stars

lakeFS airflow operator

  • Experimentation - try tools, upgrade versions and evaluate code changes in isolation.
  • Reproducibility - go back to any point of time to a consistent version of your data lake.
DataPythonApache-2.0GitHub

sqlstyle.guide

treffynnon

1,527stars

A consistent code style guide for SQL to ensure legible and maintainable projects

trefle-api

treflehq

589stars

🍀 Trefle is a botanical JSON REST API for plants species, allowing you to search and query over all the registered species, and build the next gardening apps and farming robots.

DataRubyAGPL-3.0GitHub

pytrilogy

trilogy-data

61stars
pytrilogy preview

Can we improve the best language for data analytics? Strongly typed, composable, cross-engine SQL. More declarative and expressive, safer, and simpler for humans and agents.

DataPythonMITGitHub

trilogy

trilogy-libraries

794stars

Trilogy is a client library for MySQL-compatible database servers, designed for performance, flexibility, and ease of embedding.

  • Password authentication
  • Query, ping, and quit commands

bqfetch

TristanBilot

27stars

A lightweight tool to fetch tables from BigQuery as pandas DataFrame very fast using BigQuery Storage API combined with multiprocessing

DataPythonMITGitHub

safeql

ts-safeql

1,574stars
safeql preview

Validate and auto-generate TypeScript types from raw SQL queries in PostgreSQL.

  • ⚡️ Automatic Type Inference & Validation: SafeQL automatically infers the type of the query result based on the query itself.
DataTypeScriptMITGitHub

DB-GPT

TsinghuaDatabaseGroup

713stars
DB-GPT preview

An LLM Based Diagnosis System (https://arxiv.org/pdf/2312.01454.pdf)

DataPythonApache-2.0GitHub
842stars

The code repository for projects and tutorials in R and Python that covers a variety of topics in data visualization, statistics sports analytics and general application of probability theory.

DataJupyter NotebookGitHub
157stars

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.

tugraph-db

TuGraph-family

1,768stars
tugraph-db preview

TuGraph: A High Performance Graph Database.

DataC++Apache-2.0GitHub

jetpants

tumblr

1,127stars

MySQL toolkit for managing billions of rows and hundreds of database machines

DataRubyApache-2.0GitHub

tuplex

tuplex

813stars

Tuplex is a parallel big data processing framework that runs data science pipelines written in Python at the speed of compiled code. Tuplex has similar Python APIs to Apache Spark or Dask, but rather than invoking the Python interpreter, Tuplex generates optimized LLVM bytecode for the given pipeline and input data set.

DataC++Apache-2.0GitHub
114stars
steampipe-mod-aws-perimeter preview

Is your AWS perimeter secure? Use Powerpipe and Steampipe to check your AWS accounts for public resources, resources shared with untrusted accounts, insecure network configurations and more.

DataPascalApache-2.0GitHub
61stars
steampipe-mod-azure-compliance preview

Run individual configuration, compliance and security controls or full compliance benchmarks for CIS, HIPAA HITRUST, NIST, and more across all of your Azure subscriptions using Powerpipe and Steampipe.

DataPuppetApache-2.0GitHub