Skip to content
Project categories

Data · GitHub

Store, explore, and understand your data.

Useful GitHub projects

3,298 projects
3,211stars

💎多语言实现,高性能生成唯一数字ID。 💎优化的雪花算法(SnowFlake)——雪花漂移算法,在缩短ID长度的同时,具备极高瞬时并发处理能力(50W/0.1s)。 💎原生支持 C#/Java/Go/Rust/C/JavaScript/TypeScript/Python/Pascal 多语言,提供其它适用于其它语言的多线程安全调用动态库(FFI)。💎支持容器环境自动扩容(自动注册 WorkerId ),单机或分布式唯一IdGenerator。💎顶尖优化,超强效能。

Messenger

yoosuf

608stars
Messenger preview

Relational messaging database schema for one-to-one and group chat apps with attachments and MySQL Workbench model.

  • One-to-one conversation support.
  • Group chat support.
1,522stars
mybatis-plus-join preview

支持连表查询的mybatis-plus,mybatis-plus风格的连表操作提供left join、right join等操作

DataJavaApache-2.0GitHub
4,748stars
microservices-platform preview

基于SpringBoot2.x、SpringCloud和SpringCloudAlibaba并采用前后端分离的企业级微服务多租户系统架构。并引入组件化的思想实现高内聚低耦合,项目代码简洁注释丰富上手容易,适合学习和企业中使用。真正实现了基于RBAC、jwt和oauth2的无状态统一权限认证的解决方案,面向互联网设计同时适合B端和C端用户,支持CI/CD多环境部署,并提供应用管理方便第三方系统接入;同时还集合各种微服务治理功能和监控功能。模块包括:企业级的认证系统、开发平台、应用监控、慢sql监控、统一日志、单点登录、Redis分布式高速缓存、配置中心、分布式任务调度、接口文档、代码生成等等。

DataJavaApache-2.0GitHub

CoDiver

AhmadHassan-BTed

4,668stars

An advanced, unified platform for code quality, architectural metrics, and Agile analytics. Features Python AST parsing, Java static analysis (code smells), and interactive project health dashboards built with Streamlit.

  • Code Metrics - AST generation, Cyclomatic & Cognitive complexity mapping, Defect density prediction, COCOMO estimation. - ast, radon
  • Static Architecture - God Class detection, Feature Envy identification, naming conventions, Javadoc validation, raw LOC distributions. - javalang
DataPythonMITGitHub

lumen

s-theo

455stars

✨ 专为 VitePress 打造的主题美化与 Vue 扩展组件库

pandas

pandas-dev

50,493stars
pandas preview

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

  • Easy handling of missing data (represented as NaN, NA, or NaT) in floating point as well as non-floating point data
  • Size mutability: columns can be inserted and deleted from DataFrame and higher dimensional objects
DataPythonBSD-3-ClauseGitHub

prometheus

prometheus

67,575stars
prometheus preview

The Prometheus monitoring system and time series database.

DataGoApache-2.0GitHub
6,004stars
Synology_HDD_db preview

Add your HDD, SSD and NVMe drives to your Synology's compatible drive database and a lot more

DataShellMITGitHub

agami-core

AgamiAI

30stars

The trust layer between AI and your data. Turns your database schema - messy joins, undocumented tables, into a governed semantic model so AI answers with correct SQL and a receipt on every answer. Run it locally, or self-host a shared team server with Docker.

  • "Revenue" definition - Re-derived every query - Signed off by name + role, pinned
  • Join correctness - Guessed from schema hints - FK-derived or human-approved, pre-flighted

DBFlow

agrosner

4,842stars

A blazing fast, powerful, and very simple ORM android database library that writes database code for you.

DataKotlinMITGitHub

NumPyCNN

ahmedfgad

600stars
NumPyCNN preview

Building Convolutional Neural Networks From Scratch using NumPy

Validoopsie

akmalsoliev

91stars
Validoopsie preview

A simple and easy to use Data Validation library for Python.

DataPythonMITGitHub

fabric-pipeline-express-7

amineaiaitbou-eng

68stars
fabric-pipeline-express-7 preview

Event-driven OneLake pipeline desktop tool with auto-merge Upsert, Python reporting, and Teams alert

  • Event-driven trigger: A OneLake FileCreated event on the Files/inbox folder launches the pipeline automatically as soon as a .csv file lands, with a filter matching files whose subject ends in .csv. No schedule, no manual invocation.
  • Filename resolution from the event: A Set variable activity extracts the file name from the trigger event payload, falling back to a pipeline parameter when the run is started manually. The resolved value is reused by every downstream activity.
38stars

Collection of 350+ best practices for Java persistence performance in Spring Boot 4 / Hibernate 7 applications provided by Vlad Mihalcea and Anghel Leonard

355stars
skywalking-banyandb preview

An observability database aims to ingest, analyze and store Metrics, Tracing and Logging data.

DataGoApache-2.0GitHub
53stars

Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.

149stars
fabric-pipeline-express-7 preview

Event-driven OneLake pipeline with automated Upsert merge and Python reporting

  • Event-driven orchestration: A trigger bound to OneLake file-created events watches the designated inbox folder and launches the pipeline automatically the moment a matching file lands. No scheduler, no manual run, no polling loop; the arrival of data is itself the execution signal.
  • Parameterless-by-design entry point: The trigger event carries the file name through to the pipeline, where a variable resolution step coalesces the event payload with an optional manual parameter. The same pipeline supports both automatic and on-demand invocation without code changes or duplicated definitions.
DataTypeScriptMITGitHub
95stars
vscode-dataform-tools preview

Dataform Tools - VS Code extension to run and visualise Dataform data pipelines and much more

  • Compiled query and dry run - ✅ - ✅ - Beside the file on save, with the size and cost of a dry run and the schema of the result
  • Errors in the editor - ✅ - ✅ - Compile errors and BigQuery's dry-run errors, on the line you wrote
DataTypeScriptMITGitHub

backup

backup

4,859stars
backup preview

Easy full stack backup operations on UNIX-like systems.