Skip to content
metabytes
OUR AI STACK

An AI stack built for production.

Metabytes designs AI systems across models, orchestration, company knowledge, tools, governance, evaluation and infrastructure. The stack changes with the workload, but every layer has a clear job.

EXPERIENCEORCHESTRATIONMODELSCONTEXTTOOLSGOVERNANCEEVALUATION
Production AI stack8 layers
Stack principles

Built to change, control and improve.

The layers are deliberately separated so models can change, permissions stay enforceable, tools stay controlled and the whole workflow can be evaluated and operated in production.

These five rules shape every layer that follows.

What this makes possible
Swap modelswithout rewriting the product
Enforce permissionsin every retrieval and action
Audit every actionwith traces and versions
Measure qualityat workflow level, not prompt level
Architecture rule
KeepIntelligencereplaceable
KeepAccessexplicit
KeepBehaviourobservable
5 principles8 layersStart with the experience layer ↓
L1
Experience layer

Where people and systems meet the AI.

The experience layer is where AI becomes usable — in an app, a workflow, search, chat or an API. Every entry point connects to the same orchestration, controls and company context.

The interface can change without rebuilding the intelligence underneath.

Layer principleDesign around the task, not the model.
Complex interactionApp or copilot
Quick questionChat or search
Machine-to-machineAPI
Repeatable processWorkflow or agent
Many ways in
Next layerL2 · OrchestrationDecides what happens next ↓
AI control plane
Next layerL3 · ModelsModels provide the intelligence ↓
L2
Orchestration layer

The control plane of the AI system.

Orchestration manages workflow state, assembles context, selects models, calls tools, applies policy, handles retries and decides what should happen next.

The model provides intelligence. Orchestration turns it into a reliable workflow.

Orchestration handles
Workflow stateCarried between every step
Context assemblyThe right information, in order
Model routingThe right model for each task
Tool executionControlled calls to real systems
Retries & fallbacksRecovery without user impact
Approval pathsHuman checkpoints where needed
Layer principleKeep workflow logic outside the model.
Workflow logicControlled, tested, versioned
ModelSwappable intelligence
L3
Model layer

The right model, ready to change.

Different workloads trade off reasoning quality, latency, cost, context, modality and deployment. The routing layer keeps those choices outside the application, so models can change without rebuilding the product.

Layer principleModel choice belongs in the architecture, not hard-coded into the application.
Select a workload to see how the router chooses a primary model, fallback and delivery context.
Input from L2Routed task from orchestrationReasoning → Gateway → Claude → Agent
· Workload
· Model gateway
Evaluates
Task typeMulti-step reasoning
ContextLong, mixed sources
LatencyTolerant
CostModerate
PolicyStandard data
ModalityText
· Model
Primary · routedClaude
FallbackOpenAIUsed if the primary fails, times out or breaches policy.
Available
GeminiGrokOpen models
· Delivery context
Agent
App
Search
Workflow
Route logic
PrimaryClaudeFallbackOpenAI · secondary frontier modelDeliveryAgent
L4
Knowledge layer

The right context, not everything.

The knowledge layer connects AI to the information it needs without exposing the whole organisation. Sources are indexed, permissions preserved and only the context the task needs is assembled.

Grounded, permission-aware and traceable back to source.

Knowledge handles
Source ingestionDocuments, systems and SaaS
Permission inheritanceAccess mirrors the source
RetrievalSemantic, hybrid and reranked
FreshnessChanged content re-indexed
CitationsEvery answer traceable
Context assemblyMinimal, task-specific input
Layer principleMinimum context, from sources the user can access.
Knowledge context pipeline
Sources · PermissionsAccess mirrors the sourceRetrieval respects the same permissions people have in the original systems.
Inherited from sourceChecked on every requestNo shared super-index
OutputContext → model↺ Citations trace back to source
Tool registry
Action type · WriteNarrow, explicit changesWrite tools change records only within defined fields and limits.
Typed parametersValidated before runningReversible where possible
Next layerL6 · GovernanceControls that apply everywhere ↓
L5
Tools & actions

Controlled access to real systems.

The tool layer turns AI decisions into controlled business actions. Each tool is narrowly scoped, typed and permissioned, so the system can only read, write or trigger what the workflow requires.

Higher-risk writes are explicit, auditable and approval-gated.

Tools handle
Typed actionsDefined inputs and outputs
Scoped permissionsOnly what the task needs
Read / write separationDifferent risk, different rules
Approval gatesHuman sign-off on risky actions
Execution resultsState returned to orchestration
Audit trailsEvery call recorded
Layer principleExpose the smallest safe action surface.
L6
Governance layer

Governance runs inside the stack.

Governance is enforced as the system runs. Identity, data policy, permissions, approvals and audit shape what context is accessed, which tools are used and what actions are allowed on every request.

Rules are executable, observable and changeable after launch.

Governance handles
IdentityUsers, roles and services
Policy rulesExecutable, versioned rules
Data accessClassification-aware
Tool permissionsScoped to each identity
Human approvalsTriggered by risk
Audit trailsEvery request recorded
Layer principleRuntime controls, not static documents.
Governance control plane
Control · PolicyRules the system enforcesPolicies decide which data, models, tools and actions are allowed.
Versioned rulesData-class awareChanged without redeploy
L4Governs contextL3Governs modelsL5Governs toolsL2Governs actions
Workflow evaluation
Test focus · TaskDid it do the job?Routine cases confirm the workflow completes correctly end to end.
Representative casesAcceptance criteriaOutcome, not just text
Next layerL8 · OperationsKeeps it observable in production ↓
L7
Evaluation layer

Test the workflow, not the answer.

Evaluation checks whether the system completed the task, used the right context and tools, respected policy and approvals, and produced an acceptable outcome.

Tests cover routine work, edge cases and when the system should stop or escalate.

Evaluation checks
TaskWas it completed correctly?
ContextWas the right information used?
ModelWas the response acceptable?
ToolWas the right action taken?
ControlWere policy and approvals followed?
OutcomeDid the business result land?
Layer principleJudge the whole system against the work.
L8
Observability & LLMOps

Visible behaviour, versions and cost.

Once a system is live, every workflow should be traceable. Prompts, models, tools, sources and evaluations are versioned, cost is visible per workflow and failures trigger clear signals.

Easier to debug, compare releases, control spend and improve reliability.

This layer handles
Trace visibilityEvery step of every run
Version historyWhat ran, and when
Workflow costSpend by task, not token
Live alertsSignals before users notice
Failure diagnosisFind the step that broke
Release comparisonOld vs new, side by side
Layer principleObservable enough to explain, improve and operate.
Production visibility
View · TraceSee every stepEach run shows what happened, in what order and how long it took.
Step timingsInputs and outputsBranches and retries
ImproveTraceIssue foundVersion changeRe-runCompare
Deployment decision map
Fast startMax control
AppYour cloud AI stackModel / tooling
Runs inYour cloud tenancyData controlYour cloud controlsBest forEnterprise production on existing estatesTrade-offTied to one cloud ecosystem
Speed to deployFast
Level of controlHigh
Operating effortModerate
Metabytes delivers
Landing zone setupIAM and networkingCloud-native ops
Choose this when
You already run on that cloudEnterprise controls requiredClose to cloud data
Infrastructure & deployment

Deploy where the data allows.

AI can run through provider APIs, cloud AI platforms, private open-model infrastructure or a hybrid gateway. The right route depends on the data, performance needs and control model.

Choose it deliberately, not by default from the first provider used.

Decision inputs
Data sensitivityWhat can leave your estate
Latency profileInteractive, batch or real-time
Compliance & residencyWhere data must stay
Operating modelWho runs it day to day
Model flexibilityHow often models change
Cost structureUsage-based or reserved
Section principleMatch the route to the operating reality.
Performance & economics

Optimise the path, not the token.

Model price is only one part of the economics. Real cost and performance are shaped by routing, context size, cache reuse, tool calls, retries, latency and fallback across the whole workflow.

Use the least expensive path that still meets quality, control and resilience.

We optimise
Model routingRight model per task class
Context sizeOnly what the task needs
Cache reuseStable answers and context
Tool efficiencyFewer, better calls
Retry behaviourValidate before repeating
Fallback strategyResilient, not wasteful
Economics principleOptimise the whole path to the outcome.
Workflow economicsCost · latency · quality · resilience
Optimises acrossL2L3L4L5L8
Stack by workload

The stack adapts to the work.

Different tasks need different models, context, tools and controls. The Metabytes stack is configured around the work, rather than forcing every use case through the same architecture.

The architecture stays consistent. The configuration changes.

Architecture goalResolve routine requests with controlled action and human approval where needed.
Primary layersOrchestration · Knowledge · Tools · Governance
Model strategyFrontier + fallback
Control modelApproval on write actions
Success measureTime to resolution
Build vs integrate

Buy the commodity. Engineer the advantage.

Not every layer needs custom engineering. We use proven platforms for standard capabilities, then invest where workflow fit, control, data handling or differentiation actually matter.

Decided component by component, so the stack moves fast without unnecessary custom code.

We decide using
DifferentiationDoes it set you apart?
Workflow specificityHow unique is the process?
Data sensitivityWhat must stay in your control?
Control requirementsHow much must be enforced?
Platform maturityIs a proven option available?
Speed to productionHow soon must it run?
Build principleIntegrate the standard. Engineer what is yours.
Capability placementDefault approach · shifts by priority
Priority · BalancedStandard platforms underneath, Metabytes engineering on the workflow, tools and controls that make it work.
OutcomeLess custom code where it adds no value. More engineering where it creates control or advantage.
Services behind the stack

Build one layer, or the whole stack.

Each layer can be designed, built or improved on its own, but production AI usually spans several. Our services map directly to the architecture, so you can start with the problem, the layer or the capability you need.

Work on one part of the stack, or hand us the full system.

Service principleStart at the constraint, then connect the rest.e.g. start at L4 Knowledge, then connect models, tools and governance.
Need the full stack?AI TransformationStrategy, architecture, delivery and adoption across the complete AI system.Explore AI Transformation →
Stack-to-service map
Stack layers
Metabytes services
L4 · Knowledge1 services build or operate this layerExplore service →
Metabytes AI architecture

See how the complete Metabytes AI stack fits together.

Five core layers handle the work. Governance, evaluation and operations run across all of them.

8 layers · one production stack
Core layers · do the work
L6GovernanceIdentity · policy · approval · audit
Spans all core layers
L7EvaluationTask · tools · grounding · controls
Spans all core layers
L8Observability & LLMOpsTrace · versions · cost · alerts
Spans all core layers
One systemEvery layer can evolve independently. The system stays connected through orchestration, governance, evaluation and operations.
FAQs

Questions about our AI stack

Not sure where to start?

Bring us the workflow.

Show us where work is slow, repetitive or difficult to scale. We can help identify whether AI, automation or a simpler system is the right next step.

Talk to our team→No finished brief required.