Senior / Staff AI Platform Engineer – Agents & AI SDLC

About the role

Toters is building an AI platform that supports product‑facing agents and engineers using AI coding agents. As one of the first engineers on this platform you will create safe, measurable, scalable and cost‑effective foundations for AI agents.

Key responsibilities

• Build and operate the LLM gateway with routing, fallback, PII redaction, guardrails and cost attribution.
• Develop the MCP gateway for tool registration, authentication and making internal APIs agent‑ready.
• Create a unified evaluation backbone for production and coding agents, including trajectory evaluations and OpenTelemetry tracing.
• Provide isolated execution environments for agents and maintain a curated registry of skills, tools and instructions.
• Track AI cost per task, reduce context bloat and make AI spend visible by team.
• Own the platform for coding agents such as Claude Code, Cursor and emerging tools, defining instruction layering and skill distribution.
• Introduce agent‑aware CI stages, evaluations, AI review and self‑healing for routine failures.
• Define and enforce an LLM‑ready repository standard across Go, Java and PHP codebases.

Required profile

• 6+ years (senior) or 9+ years (staff) of backend, platform or infrastructure engineering experience at scale.
• 1+ year (senior) or 2+ years (staff) shipping LLM‑based systems or agentic tooling to production.
• Deep expertise in at least one AI platform track and ability to contribute to shared foundations.
• Strong technical judgment, ability to set direction without direct management responsibility.

Required skills

• Go or Java (strong experience)
• Python for AI tooling
• AWS, Kubernetes, Terraform
• Distributed‑systems knowledge (gateways, proxies, authentication, rate limiting)
• CI/CD pipeline design and testing strategies
• Experience with LLMs, AI agents and evaluation frameworks

What we offer

• Flexible hybrid work environment
• Opportunity to build a new AI platform from the ground up
• Collaboration across Product, ML, Backend, Infrastructure and Engineering teams
• Strong mentorship and continuous learning culture
• Competitive compensation and exclusive discounts on Toters orders
• First‑class medical insurance