• Build and operate the LLM Platform: Develop model routing, prompt registry, and orchestration services for multi-model workflows. • Integrate external LLM APIs (OpenAI, Anthropic, Mistral) and internal finetuned models. • Enable fast, safe experimentation: Implement automated evaluation pipelines (offline + online) with golden sets, rubrics, and regression detection. • Support CI/CD for prompt and model changes, with rollback and approval gates. • Collaborate cross-functionally: Partner with product pods to instrument RAG pipelines and prompt versioning. • Work with deep learning and data teams to integrate structured and unstructured retrieval into LLM workflows. • Optimize performance and cost: Profile latency, token usage, and caching strategies. • Build observability and monitoring for LLM calls, embeddings, and agent behaviors. • Ensure reliability and safety: Implement guardrails (toxicity, PII filters, jailbreak detection). Maintain policy enforcement and audit logging for AI usage.