nano-vllm
GeeeekExplorer
Nano vLLM
- 🚀 Fast offline inference - Comparable inference speeds to vLLM
- 📖 Readable codebase - Clean implementation in ~ 1,200 lines of Python code
发现模型训练、评估与推理框架,比较深度学习和机器学习项目的社区关注度。
GeeeekExplorer
Nano vLLM
isair

面向桌面的私密本地 AI 助手。支持语音和文字聊天、个人记忆、听写以及 MCP 工具。可通过 Ollama 或兼容 OpenAI 的服务器,在 macOS、Windows 和 Linux 上离线运行。
koharu-rs
LINJIANG12
四十五门真实网课的模块合辑全书 + 思维导图复习笔记 + 逐字稿,全部由 Video2Book 从课程音频重构:518 册教材、603 篇笔记、2,286 份逐字稿,从逐讲精读到考前速查,笔记支持 Markmap / XMind 脑图导入。
microsoft
nerfstudio-project
nmap
Nmap——网络映射器。官方 SVN 仓库的 GitHub 镜像。
NVIDIA

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Unstructured-IO
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
WeThinkIn
ARahim3
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
charliedream1
DataTalksClub
google-research
Google Research
hzwer
mcmonkeyprojects
nndl
NVlabs
OpenMOSS
owainlewis
ray-project
Ray 是一款 AI 计算引擎。Ray 由核心分布式运行时和一组用于加速机器学习工作负载的 AI 库组成。
remsky
Rikorose
snakers4

Silero VAD:预训练的企业级语音活动检测器