Reference architecture: AKS platform with GPU inference
A Kubernetes platform laid out by purpose: separate node pools for gateway, data, database and GPU inference. This mirrors how we run our own production platform.
Design decisions
- Node pools separated by workload type, each with labels and taints
- GPU node pool reserved for model serving
- A replicated database on dedicated nodes with pooling
- Registry, build runners and deployment from source control on the cluster
- Metrics, logs and alerts for platform and workloads
- The architecture sized for your workloads
- Cluster and node pool definitions as code
- An upgrade and capacity plan
Billed at $150.00 per hour. Ask Keith for an estimate.
The layers, top to bottom.
What we check first.
Pools prevent noisy neighbors
Putting databases, gateways and GPU jobs on separate nodes keeps one from starving another.
Control plane availability
A production cluster uses a highly available control plane. We size it from the start.
Address space
Each pool, load balancer and upgrade needs addresses. The plan covers growth.
Four steps, written down.
A call with Keith
You describe the goal, the estate and the deadline. Keith turns it into a written scope with an hour estimate at the hourly rate.
A written design by Gus
Gus reviews the environment and gives you a written design with each decision and its reason.
Hands-on implementation
Gus implements in your tenant and your racks, remotely or on site, with every change logged as it is made.
Documents and a named contact
You receive the as-built record and the runbooks. Keith stays on as your account and project manager.
Asked before every engagement.
How many node pools are too many?
Each pool adds overhead. We create one where isolation or hardware differs, not for every team.
Can this start small?
Yes. The same layout works with one node per pool and grows by adding nodes.
What does the consulting cost?
Consulting is billed at $150.00 per hour. Keith sends a written hour estimate after the scoping call, and work starts when you approve it.
Often scoped together.
One rate. Two people.
Consulting is billed at $150.00 per hour. Keith runs sales, project management and your account. Gus does the architecture, the design and the implementation.
per consulting hour, for every consulting service