Skip to content
Catégories de projets

Données · GitHub

Comparez bases de données, analyses, SQL et projets d’ingénierie des données.

Projets GitHub utiles

3,298 projets

snowplow

snowplow

7,050étoiles+1in 24h

Leader de l’infrastructure de données client

DonnéesScalaApache-2.0GitHub
30étoiles+1in 24h
real-time_crypto_data_pipeline_using_kafka preview

I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations

DonnéesPythonCC0-1.0GitHub

slothdb

SouravRoy-ETL

412étoiles+1in 24h
slothdb preview

An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.

  • SQL - 130+ features - JOINs, CTEs (recursive), window functions, QUALIFY, MERGE, subqueries, set operations
  • Live file views - CREATE LIVE VIEW caches the result and auto-refreshes on file change. Incremental CSV append path parses only new bytes on log-tail workloads

jackcess

spannm

28étoiles+1in 24h

A pure Java library for reading / writing Microsoft Access databases

  • Pure Java: 100% Java implementation. No native dependencies, no DLLs, no MS Access installation required.
  • Wide Version Support: Supports Access versions 2000, 2003, 2007, 2010, 2013, 2016, and 2019.
DonnéesJavaApache-2.0GitHub

lada-cache

spiritix

593étoiles+1in 24h
lada-cache preview

A Redis based, fully automated and scalable database cache layer for Laravel

  • 🚀 Fully automated query caching - no code changes required after setup
  • 🧩 Granular invalidation - automatically invalidates only affected rows or tables

sqlancer

sqlancer

1,774étoiles+1in 24h

Automated testing to find logic and performance bugs in database systems

pg_ivm

sraoss

1,511étoiles+1in 24h

IVM (Incremental View Maintenance) implementation as a PostgreSQL extension

jinjasql

sripathikrishnan

844étoiles+1in 24h

Template Language for SQL with Automatic Bind Parameter Extraction

omnisql-mcp

srthkdev

91étoiles+1in 24h
omnisql-mcp preview

omnisql-mcp

  • Reuse saved connections - Read database and SSH settings from DBeaver-compatible workspaces, including custom projects.
  • Query across engines - PostgreSQL, MySQL/MariaDB, SQLite, SQL Server, Oracle, DuckDB, and ClickHouse.
DonnéesTypeScriptMITGitHub

magic-api

ssssssss-team

1,919étoiles+1in 24h
magic-api preview

magic-api 是一个接口快速开发框架,通过Web页面编写脚本以及配置,自动映射为HTTP接口,无需定义Controller、Service、Dao、Mapper、XML、VO等Java对象

stackrender

stackrender

558étoiles+1in 24h
stackrender preview

StackRender is the next-gen database schema design and generation tool.

  • Interactive Diagram UI – Visually design and manage your database schemas with an intuitive drag-and-drop interface.
  • In-Depth Tables & Columns Control – Fully customize tables, columns, types, and constraints.
DonnéesTypeScriptAGPL-3.0GitHub

statsmodels

statsmodels

11,748étoiles+1in 24h

Statsmodels: statistical modeling and econometrics in Python

  • Ordinary least squares
  • Generalized least squares
DonnéesPythonBSD-3-ClauseGitHub

world_countries

stefangabos

1,594étoiles+1in 24h

Constantly updated lists of world countries and their associated alpha-2, alpha-3 and numeric country codes as defined by the ISO 3166 standard, available in CSV, JSON , PHP, SQL and XML formats, in multiple languages and with national flags included; also available are the ISO 3166-2 codes of provinces/ states associated with the countries

DonnéesPHPCC-BY-SA-4.0GitHub

bob

stephenafamo

1,803étoiles+1in 24h

SQL query builder and ORM/Factory generator for Go with support for PostgreSQL, MySQL and SQLite

SQLite.swift

stephencelis

10,188étoiles+1in 24h
SQLite.swift preview

A type-safe, Swift-language layer over SQLite3.

  • A pure-Swift interface
  • A type-safe, optional-aware SQL expression builder

mcp-server-db2i

Strom-Capital

29étoiles+1in 24h

Read-only MCP server that lets Claude, Cursor and other AI assistants query IBM Db2 for i (IBM i, AS/400). People sign in with their own IBM i user; library allowlist, column masking and audit log. Self-hosted, over ODBC, JDBC or Mapepire (SSH).

  • Read-only SQL queries - Execute SELECT statements safely with automatic result limiting, and a query timeout that cancels runaway statements on the IBM i
  • Schema inspection - List all schemas/libraries with optional filtering
DonnéesTypeScriptMITGitHub
1,045étoiles+1in 24h

Flutter integration for Supabase. These packages makes it simple for developers to build secure and scalable products.

corrosion

superfly

1,878étoiles+1in 24h

Gossip-based service discovery (and more) for large distributed systems.

  • A flexible API to read from and write to Corrosion's store using SQL statements
  • File-based schemas with on-the-fly updates
DonnéesRustApache-2.0GitHub

jsonbase

syamdanda

561étoiles+1in 24h

A database software completely built as JSON files in backend. A powerful, portable and simple database works on top of JSON files. It is like a database software, currently having basic CRUD operation features. You can use this as a backend for your ReST APIs as well. The software is completely free and opensource. We are coming up with new features and providing more updates. The another beautiful advantage with JSON-base is since it is a NPM module, this fits well in your nodeJs applications eco system. if you want to develop quick prototypes/poc or need of a database with minimal requirements then, JSONBASe is an must option that you can consider. However there is a limitation if you go beyond a million records per table.

DonnéesJavaScriptApache-2.0GitHub