stolon
sorintlab
比较数据库、数据分析、SQL 与数据工程项目。
sorintlab
soth-ai
SourabhSinghRana

I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations
sous-chefs
Development repository for the mysql cookbook
sous-chefs
Development repository for the postgresql cookbook
Southeastofstar
C#: EPSON Robot Remote TCP/IP Control,Motion Control(GoogolTech/LeadShine),Advantech(PCI1752/PCI1754),Keyence Laser,RS232C,RS485,TCP/IP Server/Client(Sync/Async),OPC Client/Server,CAN, EtherCAT,XML,Excel,MYSQL/ACCESS Database,Common functions,Delay(time), etc.C#开发的工业自动化控制类,大部分已经写完且验证过: 一、EPSON Robot Remote TCP/IP Control: 用于对EPSON机械手进行远程以太网控制,建立以太网通讯后发送命令给爱普生机械手控制器,然后依照返回的命令处理相应结果; 二、Motion Control(GoogolTech/LeadShine):【二次封装】固高GTS系列运动控制卡运动卡控制类:初始化运动卡和更新IO,控制固高运动控制器轴运动;这是对固高和雷赛运动控制卡的DLL文件中的函数进行第二次封装,使在实际编程的时候更加方便、快捷; 三、Advantech: PCI1752:研华数据采集卡PCI1752更新输出及输出状态回读; PCI1754:研华数据采集卡PCI1754更新输入信号; 四、Keyence Laser:基恩士激光读取数据; 五、RS232C:RS232C串口通讯,包括界面类; 六、RS485:RS485串口通讯,还没有完成; 七、TCP/IP Server/Client(Sync/Async):以太网通讯客户端和服务器端,支持同步和异步通讯; 八、OPC Client/Server:还没有完成; 九、CAN, EtherCAT:还没有完成; 十、XML:XML文件操作,包括写和读取的相关实用函数; 十一、Excel:Excel文件的相关操作,包括快速写大量数据到EXCEL文件;其中处理条件格式的代码还在调试中; 十二、MYSQL/ACCESS Database:数据库操作; 十三、Common functions:操作系统和文件相关操作、获取TcpClient连接的本地/对方IP地址和端口、通用TCP/IP函数、跨线程安全的委托、进制转换、通用RS232C函数; 十四、Delay(time):延时计时器,等待指定时间,如果计算机不支持高性能计数器,则只支持整数秒的时间 十五、ListView:针对ListView控件的各项增加、删除、查找操作;
soyelherein
PySpark data-pipeline testing and CICD
sp8rks
MSE5540/6640 Materials Informatics course at the University of Utah. Learn how data science tools are revolutionizing materials science!
spaceandtimefdn
SpaceCell
Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.
SpaceCell

Fast data transport : Apache Arrow, Protobuf and Message Pack data on the one stream. Measured faster than Arrow Flight on all open benchmarks. HTTP, TCP, QUIC, Websocket, Webtransport, Stdio, UDS, all interchangeable, with 64-byte SIMD compatibilty maintained over the network and to/from disk via custom Arrow Mmap and Parquet Readers and Writers
spacecloud-io
spacejam
spaghettidba
spannm
A pure Java library for reading / writing Microsoft Access databases
spannm
Open-source pure Java JDBC driver for Microsoft Access databases (*.accdb, *.mdb). Enables client programs (e.g. OpenOffice, LibreOffice, Matlab, SQuirreL) to read and write Access databases.
Sparagas
Silent Hill Reverse Engineering File Formats
spark-notebook
sparkdq-community
A lightweight, declarative PySpark framework for data quality validation — check columns, rows, and entire datasets directly in your Spark pipelines
sparklabx

Self-hosted multi-user Apache Spark notebooks — PySpark + Scala, per-user kernel pods, MinIO IAM storage, OAuth. One Helm install. Apache-2.0.
Sparsh1212
spatie