kubernetes-sigs/kueue has 3,139 GitHub stars and 897 forks. GitHot measured +1 stars in 24 hours. Last checked 2026-11-08 17:44 UTC. Last push 2026-11-02.
:vertical_traffic_light: Kubernetes-native Job Queueing and Scheduling
What you can do
- Fair sharing — share quota fairly across teams, with borrowing through cohorts and optional preemption.
- Hierarchical quotas — organize quota in a tree of cohorts, such as departments and teams.
- Flavor fungibility — choose when to try another resource flavor, such as spot nodes, before borrowing or preempting.
- Elastic workloads — scale supported jobs up or down without suspending them, reserving quota for each scale-up.
Measured star growth
- in 24h
- +1
- in 7 days
- Update delayed
- in 15 days
- Update delayed
- in 1 month
- Update delayed
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
README.md
Original
Kueue
Get started · Docs · Community · Help Kueue grow
Kueue is a Kubernetes-native queueing and scheduling system that decides when, where and how your training, inference and batch workloads run.
It works alongside kube-scheduler, cluster-autoscaler and your job controllers instead of replacing them. Learn more in the overview.
Capabilities at a glance
- Fair sharing — share quota fairly across teams, with borrowing through cohorts and optional preemption.
- Hierarchical quotas — organize quota in a tree of cohorts, such as departments and teams.
- Flavor fungibility — choose when to try another resource flavor, such as spot nodes, before borrowing or preempting.
- Elastic workloads — scale supported jobs up or down without suspending them, reserving quota for each scale-up.
- Admission checks — hold workloads until external checks pass, such as node capacity from cluster-autoscaler.
- Device quotas (DRA) — admit workloads only when there is quota for the GPUs and other devices they request through DRA.
- All-or-nothing (gang) scheduling — by default, no Pods start until there is quota for all of them.
- Topology-Aware Scheduling (TAS) — place communicating Pods close together, such as on one rack.
- MultiKueue — dispatch workloads to other clusters with free capacity.
Integrations: Kubernetes Job, JobSet, KubeRay, LeaderWorkerSet and more
Built-in integrations, grouped by common use:
- Batch and training: Kubernetes Job (including CronJobs), JobSet, MPIJob, RayJob (KubeRay), TrainJob (Kubeflow Trainer v2) and SparkApplication (alpha).
- Inference and serving: LeaderWorkerSet, RayService, Deployment and StatefulSet.
- Other workloads: Pods and Pod groups, AppWrapper and RayCluster.
External and custom integrations: run external frameworks, such as Argo Workflows and Tekton, or write an integration for your own workload types.
Deprecated: Kubeflow Trainer v1 jobs (PyTorchJob, TFJob, JAXJob, PaddleJob, XGBoostJob); migrate to TrainJob or JobSet.
Roadmap: priorities and long-term goals
Priorities include integrating with Workload-Aware Scheduling (WAS) in kube-scheduler and continued improvements for training, inference and other workloads.
2026 priorities
- Integrate with Workload-Aware Scheduling (WAS) in kube-scheduler, including Topology-Aware Scheduling #8871
- MultiKueue improvements:
- Extend support for elastic Ray workloads, including autoscaling #13243 (replaces #8712)
- Add workload-level admission constraints and preference-aware dispatching (proposal #8729)
- Prevent starting preemptions in multiple worker clusters #8303
- Maintain service availability during cross-cluster moves (proposal #8526)
- Retrieve logs from worker clusters #3526
- Topology-Aware Scheduling improvements:
- Support resource transformations #8860
- Extend support for elastic workloads #8160
- Evict workloads from nodes that become tainted #8828
- Support concurrent workload admission #8691
- Support large, high-priority jobs ("hero workloads") #8826
- Consider preemption cost when finding preemption candidates #7990
- Extend the Dynamic Resource Allocation (DRA) integration #8243, #2941
Long-term goals
- Partial preemption of serving workloads #3762
- Deeper integration with workflow frameworks such as Argo Workflows and Tekton #74
- Budget support #28
- Flavor assignment strategies, e.g. minimizing cost vs minimizing borrowing #312
- Cooperative preemption for workloads that implement checkpointing #477
- Delayed preemption for two-stage admission #3758
- Graduate the API to v1 #3476
Get started
Kubernetes 1.35 or newer is recommended; older versions may work but aren't tested. Install the latest release, or see the other installation options, including Helm:
kubectl apply --server-side -f \
https://github.com/kubernetes-sigs/kueue/releases/download/v0.20.5/manifests.yaml
Then follow the quick start to set up resource flavors, queues and quota, and run your first job.
Configuration and operations guides
- Understand queueing: workloads, queueing and admission.
- Configure queues: administer cluster quotas, then set priorities and queueing strategies.
- Share quota: cohorts, borrowing, fair-sharing policies, preemption, flavor fungibility and dynamic reclaim.
- Size jobs: start a Job smaller with partial admission, or resize supported jobs with elastic workloads.
- Control admission: admission checks, autoscaling with ProvisioningRequest, all-or-nothing scheduling, Pod readiness and enforcing Kueue management.
- Place workloads: set up Topology-Aware Scheduling and MultiKueue.
- Manage device quotas: DRA concepts and DRA setup; consumable capacity is alpha.
- Run in production: production setup (cert-manager, network policies, Prometheus) and RBAC.
- Monitor Kueue: observability, metrics, pending workloads and the KueueViz dashboard.
Browse concepts, task guides, examples and DeepWiki.
Production readiness
- Used in production; see the public adopters.
- Minor releases about every two months; see the release process.
- Unit, integration and scalability tests, plus end-to-end tests on every Kubernetes version Kueue officially supports.
Testing and compatibility
API stability: core APIs use v1beta2 and follow the Kubernetes deprecation policy.
Testing: the dashboards below track the main branch, and end-to-end suites run on Kind clusters. For supported Kubernetes versions, see the installation prerequisites; for scalability, see the performance test setup.
| Kubernetes version | E2E dashboards |
|---|---|
| 1.35 | baseline · extended shard 0 · extended shard 1 · extended shard 2 |
| 1.36 | baseline · extended shard 0 · extended shard 1 · extended shard 2 |
| 1.37 | baseline · extended shard 0 · extended shard 1 · extended shard 2 |
| Test suite | Dashboards |
|---|---|
| Unit | dashboard |
| Integration | shard 0 · shard 1 · shard 2 · shard 3 · MultiKueue |
| TAS E2E | baseline · extended shard 0 · extended shard 1 |
| MultiKueue E2E | baseline · extended shard 0 · extended shard 1 · DRA |
| Sequential E2E, baseline | shard 0 · shard 1 |
| Sequential E2E, extended | shard 0 · shard 1 |
| Other E2E | cert-manager · DRA |
| Performance | baseline · TAS · large scale |
Community
Connect: WG Batch · Slack · mailing list · talks
Contribute: contributing guide · Kubernetes community · code of conduct
Help Kueue grow
Showing how people use and value Kueue helps keep the project well supported and growing:
- Star Kueue if you like the project.
- Add your organization if you run Kueue in production, by editing
site/data/adopters.yaml. - Share your experience on Medium with the
kueuetag.
Releases · Latest release · Artwork: Kueue, KueueViz
Explore related projects
codecrafters-io/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
561,274 starspublic-apis/public-apis
A collective list of free APIs
497,534 starsmorluto/rea
Reverse engineer anything with agents, from app behavior down to native binaries.
446,051 starsopenclaw/openclaw
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
394,234 stars