Data · GitHub

ultra low latency graph based stream processing framework

• Fast: ~0.3 ns compiled / ~12 ns interpreted of engine overhead per node cycle, from a topologically sorted DAG execution engine that visits each node once per tick.
• Nitro — three execution tiers, one wiring: interpreted, compiled, or a compiled island — all derived from the same definition, so they cannot drift. Compiled runs 4.4×–37× faster.

The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.

geoBoundaries : A Political Administrative Boundaries Dataset (www.geoboundaries.org)

Octo.jl 🐙 is an SQL Query DSL in Julia

Functional relational programming for Clojure(Script).

• Fully featured in-memory database with indexed SQL style query.
• Integrated and embedded in clojure, use clojure functions in queries, build queries with clojure.

SawitDB: The First Agricultural-Based Database with Anti-Corruption Protocols. Built for Data Sovereignty to oppose expensive, unreliable state infrastructure.

• Hybrid Paged Architecture: Data is stored in 4096-byte binary pages, but hot data is cached as native Objects for zero-copy reads.
• Single File Storage: All data, schema, and indexes are stored in a single .sawit file.

TypeSQL - Generate Typescript API from raw SQL. Supports PostgresSQL, MySQL, Sqlite, LibSQL (Turso) and D1 (Cloudflare)

• Do not restrict the use of SQL You dont need to learn any new query language, you can use SQL with all its power and expressiveness.
• Infer parameters and columns types. SELECT DATEDIFF(:date1, :date2) as days_stayed will resolve the date1 and date2 parameters to the type Date and the function return type as number.

Wvlet: a flow-style query language that compiles to SQL for DuckDB, Trino, Snowflake, and Hive. Easy for humans and AI agents to read and edit.

• Flow-style syntax: Write queries in the natural order of data processing
• Multi-database support: Works with DuckDB, Trino, Hive, and more

ERD Online is an online collaborative data warehouse design software. It does not need to install applications locally and operate databases online. It is an excellent alternative to desktop data modeling tools.

📚深入浅出数据库存储：数据库理论、关系型数据库、文档型数据库、键值型数据库、New SQL、搜索引擎、数据仓库与 OLAP、大数据与数据中台

📚深入浅出 MySQL 实战

KCenter(KafkaCenter) is a unified platform for kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components(ksql/kafka connect).it's kafkacenter(kafka center).

• monitor producers and consumers with graphs and the ability to easily configure email alerts for thresholds
• let your users request topics and monitor them themselves in a simple web UI

PostgreSQL zero-downtime migrations made easy

• Zero-downtime migrations (no database locking, no breaking changes).
• Keep old and new schema versions working simultaneously.

GoAccess Docker Image for Nginx Proxy Manager and more...