Browse JobsCareer BlogJob Search ResourcesAI Interview PreparationWorkzil HomeJob ListingsPricing PlansContact UsCreate AccountHiring SolutionsSecurity & PrivacyAffiliate ProgramFree CV BuilderAI CV ReviewerFree Resume BuilderAI Resume ReviewerSalary CalculatorSalary Comparison ChartsLayoff TrackerLayoff NewsHiring Trends 2026Startup Funding TrackerCompany Expansion TrackerVisa Sponsorship CompaniesBest Companies to Work ForBlog ArticlesCareer ResourcesAI Interview PrepTerms of ServicePrivacy PolicyCookie PolicyPost a JobAI Candidate ScreeningEmployer PricingEnterprise SolutionsJobs in New YorkJobs in San FranciscoJobs in AustinJobs in SeattleJobs in ChicagoJobs in Los AngelesJobs in BostonJobs in DenverJobs in AtlantaJobs in MiamiJobs in DallasJobs in Washington DCJobs in San JoseJobs in RaleighJobs in NashvilleSoftware Engineer JobsData Scientist JobsProduct Manager JobsData Analyst JobsUX Designer JobsFrontend Developer JobsDevOps Engineer JobsMarketing Manager JobsFinancial Analyst JobsCybersecurity Analyst JobsSoftware Engineer Salary GuideData Scientist SalaryProduct Manager SalaryUX Designer SalaryDevOps Engineer SalaryCloud Architect SalarySoftware Engineer Salary CalculatorData Scientist Salary CalculatorProduct Manager Salary CalculatorSoftware Engineer Salary San FranciscoSoftware Engineer Salary New YorkData Scientist Salary SeattleProduct Manager Salary AustinDevOps Engineer Salary CalculatorUX Designer Salary CalculatorSoftware Engineer Interview QuestionsProduct Manager Interview QuestionsData Scientist Interview QuestionsUX Designer Interview QuestionsFrontend Developer Interview QuestionsRemote Software Engineer JobsRemote Product Manager JobsRemote Data Analyst JobsRemote UX Designer JobsRemote Frontend Developer JobsElectrician JobsPlumber JobsHVAC Technician JobsRegistered Nurse JobsTruck Driver JobsWarehouse Worker JobsCarpenter JobsWelder JobsRestaurant Manager JobsConstruction Manager JobsDental Hygienist JobsReal Estate Agent JobsElectrician Salary GuidePlumber Salary GuideRegistered Nurse SalaryTruck Driver SalaryHVAC Technician SalaryWelder Salary GuideElectrician Interview QuestionsNursing Interview QuestionsTruck Driver Interview QuestionsRestaurant Manager Interview QuestionsLayoffs 2026Layoffs 2025Layoffs 2024Layoffs 2023Google LayoffsMeta LayoffsAmazon LayoffsMicrosoft LayoffsSoftware Engineer Resume BuilderData Scientist Resume BuilderProduct Manager Resume BuilderRegistered Nurse Resume BuilderMarketing Manager Resume BuilderTechnology Industry JobsFinance Industry JobsHealthcare Industry JobsConstruction & Trades JobsRetail & E-Commerce JobsSoftware Engineer vs Data ScientistSoftware Engineer vs Product ManagerData Scientist vs Data AnalystFrontend vs Backend DeveloperProduct Manager vs Project ManagerElectrician vs Plumber
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    WorkzilWorkzil
    Find Jobs
    Pricing
    Sign inGet Started
    • Find Jobs
    • Companies
    • AI Interview Prep
    • For Employers
    • Intelligence
    • Pricing
    • Support
    • Free Tools
      • CV / Resume Builder
      • CV / Resume Reviewer
      • Salary Calculator
      • Salary Comparison
    • Company Intelligence
      • Layoff Tracker
      • Hiring Trends
      • Funding Tracker
      • Expansion News
      • Visa Sponsorship
      • Layoff News
    • Career Research
      • Best Companies
      • Industry Guides
      • Compare Roles
      • Salary Guides
      • Interview Questions
      • Remote Jobs
    • Resources
      • Blog
      • Resources
      • Community
    • Post a Job
    • Sign Up
    • Sign In
    • Contact
    Skip to main content
    Search jobsRemoteInterview practice
    What is WorkzilSign inGet started
    JobsAmsterdamSenior or Staff Software Engineer, Inference / Compute Infrastructure Engineering · Together AI
    T
    Together AI10-50 employees

    Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

    Amsterdam · Posted Nov 3, 2026

    Pay
    Pay not published
    Where
    Amsterdam
    Level
    Not stated
    Posted
    Nov 3, 2026
    Date from the source

    About the role

    About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its full lifecycle — turning racks of GPUs into running inference clusters without a human touching a runbook. The Research and Inference team is your customer: today they file tickets and wait; the target state is that they issue a single API call to stand up, scale, or tear down a cluster, and the system takes care of the rest. The platform is manifest-driven such that teams declare the desired state of a cluster or host — shape, topology, software stack — and the system is responsible for reconciling reality to that manifest, continuously, through every stage of its lifecycle. You will design the engines that manifest the schema, the engines that execute against it, and the workflows that carry a piece of hardware or a cluster from one state to the next—taking it from bare metal to a fully functioning AI cluster for training or inference. You'll write production code which is typed, tested, versioned, and deployed through CI/CD that models infrastructure state and reconciles it, the same way a Kubernetes controller reconciles a cluster's desired state. Success looks like eliminating manual provisioning work, not documenting it better. A product mindset - you've built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship. You build it, you own it. You are not only responsible for delivering the software but also for operating and supporting it in production. Responsibilities • Build the provisioning state machine: design and implement the software that models the full lifecycle of a physical host from discovery, inference bring-up to GPU driver/CUDA stack, health validation, and decommission/RMA — as explicit, versioned states and transitions. • Build the self-service API: design declarative APIs and a control plane so the inference team can request, scale, and tear down inference clusters with one API call — no ticket, no human in the loop. • Automate self-healing: detect degraded or failed nodes, drain them safely, trigger repair or replacement, and reintroduce healthy capacity into the pool automatically. • Own reliability of the pipeline: idempotency, retries, rollback, and drift detection so the provisioning system is as dependable as any other production service. • Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect, scheduling constraints — and encode them as first-class abstractions in the platform. • Engineer it like software: strong typing, automated tests, code review, versioning, and CI/CD for infrastructure code — this is a product, not a collection of Ansible playbooks. Requirements Core requirements (all levels): • Strong software engineering background in Go, Python, Rust, or similar — you write and test real software for a living. • Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent to run long-lived, manifest-driven workflows that survive failures and resume mid-execution. • Experience building software control planes or orchestration systems that model state and reconcile it over time (e.g., Kubernetes controllers/operators, custom reconciliation loops, workflow engines). • Experience with event-driven systems — designing and building software around message queues, event streams, or pub/sub (e.g., Kafka, NATS, SQS) rather than polling or cron-driven scripts. • A product mindset. You’ve built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship. Nice to have: • Exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and/or networking fundamentals (VLANs, BGP, fabric design), or GPU/accelerator infrastructure. • Experience with GPU cluster software stacks (NCCL, CUDA, InfiniBand/RoCE). • Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization. • Systems programming in Rust or Go. About Together AI Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month. Application Policy Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application. Equal Opportunity Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our privacy policy at https://www.together.ai/privacy.
    Apply on the employer's siteAI interview

    Opens the employer's application page in a new tab.

    AI interview

    Practise this interview with AI

    A mock interview for this exact role, with feedback you can act on.

    Workzil

    Workzil is one cycle: find work, read the market behind it, and hire. Every number names its source and its date.

    Back to Workzil

    Workzil sites

    • WorkzilWhat we do: one cycle, from finding work to hiring.
    • Workzil JobsOpen roles with real posting dates and published pay.
    • Workzil MarketPay and hiring for your role and place, with sources.
    • Workzil EmployersCompany pages with live roles, claimed by work email.
    © 2026 WorkzilPrivacyTerms