Confidential AI inference

Prompts are readable on your device and inside the enclave. The network, the host and our operators handle only ciphertext.

THREAT MODEL
01 / 04

Enclave

The GPU runs in confidential computing mode, the CPU in SEV-SNP or TDX. Model, prompt and keys exist in plaintext only here.

Enclave Model, prompt, keys GPU CC modeCPU SEV-SNP, TDX HOST OS Kept outHYPERVISOR Kept outALEXANDRIA OPERATORS Kept outCLOUD PROVIDER Kept outNETWORK Kept out
THREAT MODEL
01 / 04

Enclave

The GPU runs in confidential computing mode, the CPU in SEV-SNP or TDX. Model, prompt and keys exist in plaintext only here.

Enclave Model, prompt, keys GPU CC modeCPU SEV-SNP, TDX HOST OS Kept outHYPERVISOR Kept outALEXANDRIA OPERATORS Kept outCLOUD PROVIDER Kept outNETWORK Kept out
02 / 04

Host OS and hypervisor

Memory stays encrypted while in use. The host and the hypervisor see only ciphertext.

Enclave Model, prompt, keys GPU CC modeCPU SEV-SNP, TDX HOST OS Kept outHYPERVISOR Kept outALEXANDRIA OPERATORS Kept outCLOUD PROVIDER Kept outNETWORK Kept out
03 / 04

Operators and cloud provider

There is no privileged access path into the enclave. Alexandria operators hold no keys.

Enclave Model, prompt, keys GPU CC modeCPU SEV-SNP, TDX HOST OS Kept outHYPERVISOR Kept outALEXANDRIA OPERATORS Kept outCLOUD PROVIDER Kept outNETWORK Kept out
04 / 04

Network

TLS terminates inside the enclave. The network carries ciphertext only.

Enclave Model, prompt, keys GPU CC modeCPU SEV-SNP, TDX HOST OS Kept outHYPERVISOR Kept outALEXANDRIA OPERATORS Kept outCLOUD PROVIDER Kept outNETWORK Kept out

Measured at every layer

Before the first token, the client checks hardware, firmware, build and model measurements against published values.

CLIENT compares all four MODEL sha256 b7e2…44c0BUILD sha384 3fd0…a1b9FIRMWARE sha384 9c41…e07aHARDWARE sha384 e5a8…7d13

Supports every open model

  • DeepSeek
  • Moonshot AI
  • Qwen
  • Z.ai
  • NVIDIA
  • Gemma
  • Meta Llama
  • OpenAI
  • Mistral AI
  • MiniMax
  • Microsoft
  • IBM
  • Ai2
  • StepFun
  • Tencent
  • Baidu
  • xAI
  • Cohere

Trust Center

Documents for security, legal and procurement review, sent on request.

VULNERABILITY REPORTS
security@alexandria.so
  • Security whitepaper
  • Architecture overview
  • Attestation guide
  • Data processing agreement
  • Subprocessor list
WHITEPAPER

Request Security whitepaper

We send documents to verified work addresses.