Staff Software Engineer - AI Compute, Together Cloud

Together AIAmsterdamHybridFull-time3 weeks ago

Together AI is hiring a Staff Software Engineer for its Together Cloud team in Amsterdam to architect and build the next-generation AI cloud platform, including GPU and network virtualization, in-DC IaaS, and global GPU scheduling. The role requires 7+ years of professional software development experience, deep distributed systems expertise, and strong technical leadership. This is an architect-and-build role spanning hypervisor, kernel, SDN, and control plane work across global data centers.

What you'll do

Own the GPU and network virtualization stack: hypervisor, kernel, and SDN work for high-performance, portable, strongly isolated GPU compute and DC networking
Own the in-DC IaaS layer: architect and roadmap services, Kubernetes operators, and libraries for compute, storage, and networks (VMs, parallel filesystems, VPCs, InfiniBand partitions)
Lead build-out for a new Vera Rubin data center with thousands of GPUs, from hardware bring-up to customer-facing API
Design the GPU scheduling and global management plane: distributed control plane for on-demand and reserved clusters across dozens of data centers
Architect monitoring and automated remediation for fault tolerance, including detection, isolation, and recovery of failed nodes
Set technical direction across teams: lead design reviews, resolve architectural disagreements, unblock cross-team dependencies, and define standards
Grow the team: mentor senior and junior engineers and help raise the hiring bar
Set the engineering bar: create testing frameworks, tools, and developer documentation, and shape the open-source Together AI platform

What you need

Must-have

GoDistributed systemsMicroservicesAWSAzureGCPConcurrencyMemory management

Nice-to-have

Kubernetes operatorsCustom schedulersQEMU/KVMcloud-hypervisorVFIOvirtioPCIe passthroughKubeVirt

Soft skills

CommunicationDiplomacyTechnical leadershipMentoringTroubleshootingProblem solvingAbility to define scope under ambiguity

Software DevelopmentAI CloudGPU InfrastructureDistributed SystemsKubernetesVirtualizationIaaSStaff EngineerGoAmsterdam

/What you'll do

/What you need

Must-have

Nice-to-have

Soft skills

What you'll do

What you need