AI on Azure Local
Some data cannot leave the building. We design and build AI workloads on Azure Local so that models run next to your data, on GPUs you control.
Scope of the work
- Choose which workloads belong on premises and which belong in Azure
- Size GPUs, memory and storage for the models you plan to run
- Serve models on AKS with GPU node pools
- Build retrieval over your own documents
- Set access control, logging and usage limits
- A working model serving environment on your cluster
- A sizing and cost record
- An operating guide: updates, monitoring and access
Billed at $150.00 per hour. Ask Keith for an estimate.
What we check first.
Start from the use case
The model size follows the task. Many business tasks run well on models that fit one modest GPU.
GPU memory is the limit
A model must fit in GPU memory with room for the context. That number drives the hardware choice.
Preview features
Several Microsoft AI services for Azure Local are still in preview. We tell you which, and design so you are not stuck if they change.
Four steps, written down.
A call with Keith
You describe the goal, the estate and the deadline. Keith turns it into a written scope with an hour estimate at the hourly rate.
A written design by Gus
Gus reviews the environment and gives you a written design with each decision and its reason.
Hands-on implementation
Gus implements in your tenant and your racks, remotely or on site, with every change logged as it is made.
Documents and a named contact
You receive the as-built record and the runbooks. Keith stays on as your account and project manager.
Asked before every engagement.
Do we need Azure Local to run AI on premises?
No, but it gives you managed Kubernetes, GPU node pools and central management through Azure, which saves building those yourself.
Can on-premises models work with Azure AI services?
Yes. A common design keeps sensitive data and inference on site and uses Azure for workloads that are allowed to leave.
What does the consulting cost?
Consulting is billed at $150.00 per hour. Keith sends a written hour estimate after the scoping call, and work starts when you approve it.
Often scoped together.
One rate. Two people.
Consulting is billed at $150.00 per hour. Keith runs sales, project management and your account. Gus does the architecture, the design and the implementation.
per consulting hour, for every consulting service