Machine Learning Engineer - LLMs

ProsusAmsterdamHybridFull-time3 weeks ago

Prosus is seeking an experienced Machine Learning Engineer to develop domain-specific language models, owning the full training pipeline from continued pre-training to advanced post-training techniques. The role requires hands-on experience training language models at scale, deep understanding of distributed systems, and strong Python and PyTorch skills. Based in Amsterdam, this on-site full-time position offers high-impact AI projects and state-of-the-art infrastructure.

What you'll do

Analyze model performance and training data to identify improvement opportunities and formulate hypotheses for enhancement
Design, execute, and rigorously evaluate experiments to improve model quality, training efficiency, and downstream task performance
Train large language models for our domain through continued pre-training and full parameter fine-tuning on proprietary datasets
Design and implement post-training pipelines using RLHF, DPO, GRPO, and other reinforcement learning techniques
Build and optimize distributed training infrastructure across multi-node GPU clusters using frameworks like DeepSpeed, FSDP, Megatron-LM, or Axolotl
Own large-scale data preparation: filtering, quality assessment, deduplication, and data mixture strategies for training corpora at 100B+ token scale
Generate and curate high-quality synthetic data for instruction fine-tuning and capability enhancement
Debug training stability issues, optimize training throughput, and monitor model performance throughout long-running distributed jobs
Implement techniques from recent papers and adapt them to our use cases
Build robust evaluation frameworks to measure model quality and guide training decisions
Write production-grade, well-tested code and contribute to team engineering standards

What you need

Must-have

PythonPyTorchDeepSpeedFSDPMegatron-LMAxolotlTransformersAccelerate

Nice-to-have

RLHFDPOGRPOReinforcement learningQuantizationModel compressionDistillationvLLM

Soft skills

MotivatedFast-pacedAutonomyJudgmentCreativity

Machine LearningLLMsAITechnologyEcommerceAmsterdamFull-timeOn-sitePythonPyTorch

/What you'll do

/What you need

Must-have

Nice-to-have

Soft skills

What you'll do

What you need