Datos · GitHub

I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations

An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.

• SQL - 130+ features - JOINs, CTEs (recursive), window functions, QUALIFY, MERGE, subqueries, set operations
• Live file views - CREATE LIVE VIEW caches the result and auto-refreshes on file change. Incremental CSV append path parses only new bytes on log-tail workloads

DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.

📊 Adana - 1-click analytical dashboard for OSINT researchers

Space and Time | Proof of SQL

Fast data transport : Apache Arrow, Protobuf and Message Pack data on the one stream. Measured faster than Arrow Flight on all open benchmarks. HTTP, TCP, QUIC, Websocket, Webtransport, Stdio, UDS, all interchangeable, with 64-byte SIMD compatibilty maintained over the network and to/from disk via custom Arrow Mmap and Parquet Readers and Writers

Open source Firebase + Heroku to develop, scale and secure serverless apps on Kubernetes

• Powerful CRUD: Flexible queries, transactions, aggregations and cross-database joins
• Realtime: Make live queries to your database

El champán de las bases de datos integradas en fase beta

• API similar to a threadsafe BTreeMap<[u8], [u8]>
• serializable (ACID) transactions for atomically reading and writing to multiple keys in multiple keyspaces.

Interactive and Reactive Data Science using Scala and Spark.

Self-hosted multi-user Apache Spark notebooks — PySpark + Scala, per-user kernel pods, MinIO IAM storage, OAuth. One Helm install. Apache-2.0.

• Spark notebooks in the browser — PySpark, Scala (Almond), with Monaco editor, Markdown cells, kernel restart, and a Libraries dialog that wraps spark.jars.packages / import $ivy so users add Maven coordinates without editing code.
• Embedded Spark UI + DataFlint — open the kernel's Spark Web UI (DAGs, stages, SQL plans, metrics) in-app, no port-forward. DataFlint (a Spark performance plugin) is on by default for PySpark and Scala, adding a performance tab that flags slow stages, skew, and oversized scans.

A blazingly fast tool to analyze all the selected organizations in Google Summer of Code in the form of graphical analytics.

Dump the contents of a database

A Laravel package to retrieve pageviews and other data from Google Analytics

A package to backup your Laravel app

Quickly dump and load databases

Add comments to SQL queries made by Laravel

Add tags and taggable behaviour to your Laravel app