AI Engineer III
Job Summary: The AI Engineer III is the lead builder of the "Engine Room," responsible for the reliability, scalability, and observability of the Pantheon AI Mesh and Azure AI Foundry stack. This role designs and maintains the CI/CD pipelines for models and agents, ensuring that AI solutions are deployed securely, monitored for drift, and can be rolled back instantly if issues arise. Essential Functions: Architect and maintain the LLMOps/GenAIOps toolchain, including model registries, prompt version control, and reproducible training pipelines. Implement and manage the Azure AI Foundry environment, configuring model routers, quota management, and private endpoints for secure inferencing. Develop comprehensive observability dashboards to track model latency, token costs, hallucination rates, and drift. Automate "Policy-as-API" controls within the orchestration layer to enforce governance guardrails (e.g., PII filtering) at runtime. Collaborate with the Platform SRE team to ensure high