GPU node pools for AKS on Azure Local
GPU work in Kubernetes needs a node pool built for it. We prepare the hosts, create the GPU pool and make sure only the workloads that need a GPU land there.
Scope of the work
- Confirm the GPU model and virtual machine sizes supported for AKS on Azure Local
- Prepare the hosts and drivers
- Create GPU node pools and label and taint them
- Schedule workloads with requests, limits and priorities
- Monitor GPU use and plan capacity
- A GPU node pool ready for workloads
- Scheduling rules that keep GPUs for GPU work
- GPU utilization dashboards
Billed at $150.00 per hour. Ask Keith for an estimate.
What we check first.
Supported combinations
Only specific GPU models and virtual machine sizes are supported. We check before the purchase.
One GPU, one pod
Without sharing configured, a pod takes a whole GPU. We decide deliberately whether to share.
Draining GPU nodes
Updates of the underlying machine affect GPU nodes differently. The runbook covers it.
Four steps, written down.
A call with Keith
You describe the goal, the estate and the deadline. Keith turns it into a written scope with an hour estimate at the hourly rate.
A written design by Gus
Gus reviews the environment and gives you a written design with each decision and its reason.
Hands-on implementation
Gus implements in your tenant and your racks, remotely or on site, with every change logged as it is made.
Documents and a named contact
You receive the as-built record and the runbooks. Keith stays on as your account and project manager.
Asked before every engagement.
Can we use GPUs we already have?
If the model is on the supported list for AKS on Azure Local, yes. Otherwise it may still work for virtual machines but not for AKS node pools.
Do we need a separate cluster for GPU work?
No. A dedicated node pool in the same cluster is usually enough.
What does the consulting cost?
Consulting is billed at $150.00 per hour. Keith sends a written hour estimate after the scoping call, and work starts when you approve it.
Often scoped together.
One rate. Two people.
Consulting is billed at $150.00 per hour. Keith runs sales, project management and your account. Gus does the architecture, the design and the implementation.
per consulting hour, for every consulting service