Core stack
PyTorchFastAPIRayKubernetes
I specialise in deployment architecture, reliability engineering, and the operational practices that keep models fast, stable, and accountable.
Production readiness, observability, SLOs, incident playbooks, and rollback design to stop fire-fighting.
Fit: Best for teams with prototypes in prod and reliability debt.
Batching, caching, quantisation, routing, and capacity planning to hit sub-second paths without runaway spend.
Fit: Best for LLM-powered UX where costs spiked with traffic.
CI/CD, eval pipelines, staged rollouts, and guardrails to ship a first dependable release quickly.
Fit: Best for teams needing a low-drama path to first launch.
A practical production stack covering model serving, observability, and data reliability.