ML Researcher
AI
Base Compute, an AI inference lab focused on on-device AGI, is seeking an ML Researcher in Melbourne to work on inference efficiency, model routing, and autonomous research pipelines. The role requires a PhD in ML or equivalent research experience, deep knowledge of LLM architectures, and expertise in areas like speculative decoding or quantization.
What you'll do
- Inference research: Identifying and validating new approaches to on-device efficiency, including speculative decoding variants, novel quantization schemes and entirely new techniques yet to be discovered
- Model routing research: Building the intelligence that decides how requests are served between on-device vs. frontier API models
- Autoresearch pipelines: Designing systems that can autonomously explore, hypothesize and evaluate research ideas that accelerate our R&D loop
- Evaluations and benchmarks: Developing rigorous evals that measure performance in the real world, outside of clean academic settings
What you need
Must-have
LLM architecturesAI inferencespeculative decodingquantization theorymodel distillationreinforcement learning
Nice-to-have
CUDAROCmMetalTritonGPU architecturesaccelerator architectureskernel optimization
Soft skills
communicationhonest feedbackdocumentation
ML ResearcherArtificial IntelligenceOn-device AIInferenceLLMResearchHybridMelbourne