
Forward Deployed Engineer - AVP
AI
Citi is seeking a Forward Deployed Engineer (AVP) in London to build and deploy production-ready agentic AI solutions. The role involves hands-on engineering of agent features, automated evaluation testbeds, and CI/CD test pipelines, requiring 3-5 years of software engineering experience with Python, Java, or Go and Generative AI application development.
What you'll do
- Develop and iterate on agent features, prompt templates, system instructions, few-shot examples, and data pre-processing scripts under the guidance of senior team members.
- Build, calibrate, and execute automated evaluation test suites using enterprise evaluation studios and frameworks (measuring agent task completion, tool call correctness, semantic similarity, latency, and hallucination metrics).
- Curate, version, and maintain domain-specific golden evaluation datasets, synthetic benchmarks, and edge-case regression testbeds in collaboration with Line of Business domain experts.
What you need
Must-have
PythonJavaGoREST APIsgRPCDockerGitGenerative AI
Soft skills
AnalyticalProblem-solvingCommunicationCollaborationDetail-orientedMethodical
Forward Deployed EngineerAVPBankingFinancial ServicesInvestment BankingAI EngineeringAgentic AIGenerative AIPythonCI/CD