Private language models on premises
A language model that runs entirely inside your network. It is designed so prompts and documents stay inside your network, and you decide who can use it and what is logged.
Scope of the work
- Select open models that fit your tasks and your GPUs
- Serve them behind an API compatible with common client libraries
- Add authentication, per-team limits and audit logging
- Connect internal applications and a chat interface
- Plan model updates and evaluation
- A private model endpoint inside your network
- Access control and usage logs
- An evaluation of the chosen models on your tasks
Billed at $150.00 per hour. Ask Keith for an estimate.
What we check first.
Licenses
Open models carry different licenses. We check that the one you choose allows your use.
Evaluate on your work
Public benchmarks say little about your documents. We test on samples you provide.
No silent egress
We verify that the serving stack makes no outbound calls.
Four steps, written down.
A call with Keith
You describe the goal, the estate and the deadline. Keith turns it into a written scope with an hour estimate at the hourly rate.
A written design by Gus
Gus reviews the environment and gives you a written design with each decision and its reason.
Hands-on implementation
Gus implements in your tenant and your racks, remotely or on site, with every change logged as it is made.
Documents and a named contact
You receive the as-built record and the runbooks. Keith stays on as your account and project manager.
Asked before every engagement.
Is a private model as good as a hosted one?
For many internal tasks, such as summarizing, drafting, classification and search over documents, a well-chosen open model is enough. For the hardest reasoning tasks, hosted frontier models are stronger.
How many GPUs do we need?
It depends on the model and the number of concurrent users. We size it after a short evaluation.
What does the consulting cost?
Consulting is billed at $150.00 per hour. Keith sends a written hour estimate after the scoping call, and work starts when you approve it.
Often scoped together.
One rate. Two people.
Consulting is billed at $150.00 per hour. Keith runs sales, project management and your account. Gus does the architecture, the design and the implementation.
per consulting hour, for every consulting service