Skip to content
Catégories de projets

Outils de développement · GitHub

Améliorez votre environnement avec des éditeurs, terminaux et outils CLI ou Git.

Projets GitHub utiles

82,863 projets

aibrix

vllm-project

5,186étoiles
aibrix preview

Cost-efficient and pluggable Infrastructure components for GenAI inference

  • Gateway and routing - OpenAI-compatible API. Picks a pod from live engine state, including prefix-cache, load, and prefill/decode placement, with session affinity for agentic workloads.
  • Multi-engine - Serve vLLM, SGLang, and TensorRT-LLM behind one gateway.

taskq

vmihailenco

1,342étoiles
taskq preview

Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

  • Redis, SQS, IronMQ, and in-memory backends.
  • Automatically scaling number of goroutines used to fetch (fetcher) and process messages (worker).