Service 02
Private, self-hosted & air-gapped AI
Open-weight models running on infrastructure you control, up to and including a network with no egress at all, so prompts, documents and outputs stay inside your boundary and you can prove it to whoever asks.
The problem this solves
You have a use case where the value is obvious and the data is the reason it has not happened. Patient records, privileged material, unpublished financials, case files, citizen data: the kind of material that makes "we send it to an API" a sentence nobody wants to say in front of the information governance board.
The usual response is to wait, or to build something deliberately crippled on synthetic data that never goes live. The alternative is to move the model to the data instead of the data to the model.
What we deploy
Open-weight models, on your infrastructure
Current open-weight models, deployed to your own hardware or to dedicated capacity in a UK region on a contract you hold. Served through a proper inference stack: batching, quantisation where it does not cost you accuracy, and capacity sized against measured demand rather than optimism.
An interface you own
Applications talk to an internal interface, not directly to a model. That single decision is what keeps you able to change model, change tier, or run different backends for different data classifications later, without rewriting anything above it.
Evaluation before belief
We build a test set from your real material, with reviewed correct answers, and measure the deployment against it. You get a number, not an impression. That number is also what makes every subsequent change (new model, new configuration) a decision with evidence behind it.
The evidence pack
A written statement of where processing occurs, what is retained and for how long, who can access it, and what the failure and exit paths are. This is the artefact that unblocks procurement and assurance, and it is genuinely half the value of the engagement.
Air-gapped and on-premise accelerated compute
For defence and for segregated government networks the deployment tier is decided before anybody discusses models: there is no route to the internet, so there is no route to a cloud region either, and cloud residency stops being the relevant question. We have delivered air-gapped platforms on NVIDIA DGX B300 for a central government department and on NVIDIA HGX B300 for a defence organisation, both running NVIDIA AI Enterprise.
The engineering work in an air-gapped deployment is not the inference. It is removing every assumption of connectivity, and there are more of those than anyone expects:
- Container registry mirrored inside the boundary, images pinned by digest rather than tag
- Operating system and language package repositories mirrored and version-pinned
- GPU driver, CUDA and firmware bundles staged as versioned artefacts with a tested rollback
- Licensing served locally, so entitlement never needs a route out
- Model weights imported as hashed artefacts, in formats that do not execute code on load
- Vulnerability and CVE feeds imported on a defined cadence, like everything else
Every one of those becomes a standing sustainment obligation, so each gets a named owner and an update cadence before go-live rather than after. That is the part that decides whether the platform is still safe to run in year three, and it is the conversation we would rather have during procurement.
Hardened to a named baseline
Hosts, container runtime and orchestration are built from DISA STIG baselines reconciled against CIS Benchmarks Level 2, in code, and scanned before handover. The runtime and orchestration layer is the one most AI platform deployments skip, and a carefully hardened host running a permissive container runtime is not a hardened system.
Platforms are mapped onto the NCSC Cyber Assessment Framework and the NCSC Guidelines for Secure AI System Development, and traced to NIST SP 800-53 and the NIST AI Risk Management Framework where your supply chain expects that vocabulary. There is more detail, including what "aligned to" honestly does and does not mean, on the security standards page.
Choosing the tier honestly
We use three tiers with clients, and we will recommend the cheapest one your data classification permits:
- Air-gapped and self-hosted: your hardware, your network, and in the strictest case no egress path at all. Nothing crosses the perimeter. The strongest position and the highest operational burden.
- Private UK deployment: dedicated instances in a UK region on your contract. Where most regulated production workloads belong.
- Contracted hosted: a frontier model under enterprise terms with zero retention. Correct for low-classification work, and we will say so when it is.
A consultancy whose recommendation is always the most expensive tier is not advising you. Most engagements end up with a mix, routed by classification.
The operational question you should ask yourself first
Private deployment fails most often for a non-technical reason: nobody internally owns the infrastructure after handover. Before committing, be honest about whether you have, or will hire, someone who can own capacity, updates and incidents.
If the answer is no, say so early. There are good intermediate options, including managed private capacity, and choosing one deliberately is far better than discovering the gap six months after go-live.
Handover is the deliverable
Everything lands in your repository: infrastructure as code, deployment pipeline, evaluation harness, runbook, architecture decision records. We run handover sessions with your engineers and expect to be unnecessary afterwards.
If you want us on a retainer for escalation and periodic model review, that is available. It is not required for the thing to keep working, which is the distinction that matters.
Questions we get asked
Can you deliver this fully air-gapped?
Yes. We have delivered air-gapped platforms on NVIDIA DGX B300 for central government and NVIDIA HGX B300 for defence, both with NVIDIA AI Enterprise. Air-gapped work is a different engineering problem from private deployment: every dependency has to be mirrored inside the boundary, including container images, operating system and language packages, GPU drivers and firmware, licensing, model weights and vulnerability feeds. The first deployment is the easy half. Sustainment is the half that decides whether it is still safe to run in year three, so we design that first. See the case studies for how these are built.
What security standard do you build the hosts to?
DISA STIG baselines reconciled against CIS Benchmarks Level 2, expressed as code so the build is reproducible, applied to the operating system, the container runtime and the orchestration layer rather than the host alone. Scan output is part of handover. Some Level 2 controls genuinely conflict with GPU driver and scheduler operation, so there is always a short deviation list, and each entry carries the finding ID, the technical reason and the compensating control. Details are on the security standards page.
Do we need our own GPUs?
Not necessarily, and often not. Dedicated GPU capacity in a UK cloud region gives you residency and isolation without a hardware purchase, and suits most regulated workloads. Owned hardware makes sense when you need physical control, when volume is high and steady enough that the economics flip, or when your risk position genuinely does not tolerate a third-party operator. We model both against your projected volume before recommending either.
Are open-weight models good enough?
For the work most regulated organisations actually want (retrieval, extraction, classification, summarisation, drafting for human review) usually yes, and the gap is smaller than the discourse suggests. For the hardest reasoning tasks, frontier hosted models remain ahead. We settle this with an evaluation set built from your own data rather than from published benchmarks, because benchmark performance and performance on your documents are only loosely related.
What does this cost to run once it is live?
It depends on volume and model size, but the shape is predictable: mostly fixed cost, dominated by compute capacity, with marginal cost per request approaching negligible. That is the inverse of hosted pricing, and it is why the crossover favours private deployment as adoption grows. We produce a five-year cost model against your projected volume as part of the engagement.
What happens when a better model comes out?
You swap it. That is a large part of the point. We keep model access behind an internal interface you control, so replacing the model underneath does not mean rewriting the applications on top. We also budget the re-evaluation explicitly: the evaluation harness we build is what makes a swap a measured decision rather than a leap.
Can you work with our existing cloud and security teams?
Yes, and we prefer to. We deploy into your accounts, under your controls, using your infrastructure patterns wherever they exist. Your security team should be reviewing this, and everything we build is intended to be read, understood and owned by your engineers rather than by us.
What if we later decide hosted was the right answer?
Then you route to it. We design the boundary so that models can sit on either side of it, and a routing layer can send different data classifications to different backends. Locking you into the architecture we happened to build first would be a poor outcome for both of us.
Other services
AI readiness assessment
A structured review of your data, systems, controls and people, ending in a ranked list of AI opportunities with costs, risks and a build order.
Read more 03AI implementation
Retrieval over your documents, agents that complete real work, and automation wired into the systems you already run, built to be handed over, not rented back to you.
Read more 04AI governance & compliance
The policies, registers and evidence trail that let you say yes to AI, and prove to a regulator, auditor or procurement panel exactly how it is controlled.
Read moreStart with a straight answer
A 30-minute call, no pitch deck. Tell us what you are trying to do and we will tell you whether AI is the right tool, what it would take, and what it would cost, or that you should not bother.