Sr Principal / Architect Engineer, Software - Backend, AI Observability/Evaluations (Chronosphere)

Palo Alto NetworksKorumburraOn-siteFull-time2 weeks ago

Chronosphere, a Palo Alto Networks company, is seeking a Sr Principal / Architect Engineer for backend development of AI Observability and Evaluation capabilities. The role involves building scalable backend systems, APIs, and data processing for AI telemetry and evaluation, requiring 12-15+ years of software engineering experience and strong backend language skills.

What you'll do

Build backend capabilities that help developers observe and evaluate AI models, agents, and RAG applications before and during production
Design systems for systematic testing, measurement, and benchmarking of AI agents and applications accuracy, relevance, performance, and safety
Build scalable APIs and data processing systems that contextualize AI telemetry and evaluation results
Help shape the technical roadmap and architecture for AI Observability and Evaluation
Collaborate with product managers, deeply technical teammates, and customers to scope, validate, and deliver integrated features and developer workflows
Improve our own system observability
Improve the performance, reliability, and cost efficiency of the distributed systems powering AI Observability and Evaluation
Mentor engineers and help maintain our engineering standards

What you need

Must-have

GoJavaPythonRustAWSGCPAzureREST APIs

Nice-to-have

LLM powered product features

Soft skills

CollaborationAutonomyJudgementMentoringProduct sense

Backend EngineeringAI ObservabilityAI EvaluationSoftware ArchitectureCloud InfrastructureDistributed SystemsCybersecuritySenior PrincipalFull-timeOn-site

/What you'll do

/What you need

Must-have

Nice-to-have

Soft skills

What you'll do

What you need