Senior Software Engineer (Token Factory)

About the role

<div class="content-intro"><p><strong>About Nebius:</strong></p> <p>Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.</p> <p>Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.</p> <p>Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&amp;D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&amp;D.</p></div><h2><strong>The role</strong></h2> <p>This role is for Nebius AI R&amp;D, a team focused on applied research and the development of AI-heavy products. Examples of applied research that we have recently published include:</p> <ul> <li><a href="https://nebius.com/blog/posts/training-and-search-for-software-engineering-agents">investigating</a>&nbsp;how test-time guided search can be used to build more powerful agents;</li> <li>dramatically&nbsp;<a href="https://nebius.com/blog/posts/scaling-data-collection-for-training-swe-agents">scaling</a>&nbsp;task data collection to power reinforcement learning for SWE agents;</li> <li><a href="https://nebius.com/blog/posts/kvax-open-source-flash-attention-for-jax">maximizing efficiency</a>&nbsp;of LLM training on agentic trajectories.</li> </ul> <p>One example of an AI product that we are deeply involved in is Nebius Token Factory — an <a href="https://nebius.com/studio/inference">inference</a>&nbsp;and&nbsp;<a href="https://nebius.com/services/studio-fine-tuning">fine-tuning</a> platform for AI models.</p> <p>This role will require expertise in distributed systems to build large-scale LLM training platform.</p> <p><strong>Your responsibilities will include:&nbsp;</strong></p> <ul> <li>Designing and developing LLM training platform.</li> <li>Maintaining our ML infrastructure, ensuring optimal performance, scalability and reliability.</li> <li>Improving job scheduling strategies to minimize resource fragmentation.&nbsp;</li> </ul> <p><strong>We expect you to have:</strong></p> <ul> <li>5+ years of professional software development experience.</li> <li>Strong software engineering skills (we mostly use Python and Go).</li> <li>Proficiency in contemporary software engineering approaches, including CI/CD, version control and unit testing.</li> <li>Experience with developing web services.</li> <li>A commitment to maintaining extreme rigor in all job-related activities.</li> </ul> <p><strong>Nice to have:</strong></p> <ul> <li><strong>Previous experience working with language models or other similar NLP technologies.</strong></li> <li>A track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment.</li> <li>Strong engineering skills, including experience in developing large distributed systems or high-load web services.</li> <li>Open-source projects that showcase your engineering prowess.</li> </ul><div class="content-conclusion"><p><strong>Benefits &amp; Perks:</strong></p> <ul> <li>Competitive compensation</li> <li>Career growth and learning opportunities</li> <li>Flexibility and ownership</li> <li>Collaborative and innovative culture</li> <li>Opportunity to work on impactful AI projects</li> <li>International environment and talented teams</li> </ul> <p><strong>What's it like to work at Nebius:</strong></p> <p>Fast moving&nbsp;- Bold thinking&nbsp;- Constant growth&nbsp;- Meaningful impact&nbsp;- Trust and real ownership&nbsp;- Opportunity to shape the future of AI&nbsp;</p> <p><strong>Equal Opportunity Statement:</strong></p> <p>Nebius is an equal opportunity employer. We are committed to fostering an inclusive and di

Skills