Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

4,862 projects

dbt-ui

data-diving

129stars
dbt-ui preview

A modern web-based user interface for dbt-core projects

  • Project Browser: Browse your dbt project structure with an intuitive tree view. Each user works on their own branch in a separate git worktree on the server (hover the question mark next to the branch name to see its path); switching to another project asks for confirmation first
  • Code Editor: Edit SQL models, YML configurations, tests, and macros with Monaco Editor
DataTypeScriptMITGitHub

go-txdb

DATA-DOG

750stars

Immutable transaction isolated sql driver for golang

DataGoGitHub

elusion

DataBora

144stars
elusion preview

DataFrame / Data Engineering Library with familiar syntax like ones we love: PySpark and SQL, focused on user experience, spead and accuracy.

  • Fabric - Microsoft Fabric - OneLake connectivity - features = ["fabric"]
  • Azure - Azure BLOB storage connectivity - features = ["azure"]
DataRustApache-2.0GitHub

cubes

DataBrewery

1,475stars

[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis

DataPythonGitHub

lakeflow_framework

databricks-solutions

30stars

Metadata-driven framework for Databricks Spark Declarative Pipelines. Config-driven, pattern based approach to batch & streaming across the medallion architecture. Deploys via Declarative Automation Bundles. Built for simplicity, extensibility, and alignment with the Databricks product roadmap.

  • Configuration-driven pattern based pipeline delivery with reusable implementation patterns
  • Support for batch and streaming pipelines across Bronze/Silver/Gold, aligned to your chosen modelling pattern
DataPythonGitHub

koalas

databricks

3,371stars

Koalas: pandas API on Apache Spark

DataPythonApache-2.0GitHub

know-ais

datacerdas

29stars
know-ais preview

🥇🏆🏅 KnowAIS project won first place and Best Visualization in The UN Big Data Hackathon 2022 Big Data Expert Track.

DataJupyter NotebookGitHub

datacontract-cli

datacontract

1,110stars
datacontract-cli preview

Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). MIT.

DataJavaScriptMITGitHub

dbt-coves

datacoves

283stars
dbt-coves preview

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

DataPythonApache-2.0GitHub

Spark-StudyClub

DataEngineering-LATAM

40stars
Spark-StudyClub preview

Grupo de Estudios de Apache Spark organizado por la comunidad Data Engineering Latam

DataJupyter NotebookGitHub

csv-detective

datagouv

57stars

Inspection of tabular (csv, xls-like, parquet) files to guess the columns' content

  • types (float, int, dates, datetimes, JSON) and more specific (latitude, longitude, geoJSON...)
  • Communes, Départements, Régions, Pays
DataPythonMITGitHub