Posted

Sr. Compiler Engineer

by Tensordyne

  • Semiconductors
  • Artificial Intelligence
  • Computer Hardware
Munich, Germany
Hybrid
Full-time
Professional or Experienced
I’m interested

Free account · stay hidden from your current employer

Your interest is shared with employers only as an anonymized demand signal.

Introduction

The compiler decides whether our inference silicon runs at 30% utilization or 90% or more. That's the job. Together with our team, you'll build the backend that turns AI workloads into microcode for Tensordyne hardware - Napier today and the silicon that follows. This is a clean-slate compiler effort targeting a genuinely unusual architecture. You'll have the opportunity to work on fundamental parts of the compiler.

Tasks

  • Contribute to backend compilation end to end: lowering, instruction scheduling, register and resource allocation, and microcode generation.
  • Consider the memory hierarchy: SRAM residency, HBM traffic, DMA orchestration, layout, rematerialization, and data movement. The goal is simple: keep the machine compute-bound rather than waiting on memory.
  • Develop tiling, fusion, and software-pipelining strategies that close the gap between theoretical and achieved throughput.
  • Design compiler interfaces that work for both agents and engineers: structured IR access, machine-readable diagnostics, searchable tuning spaces, and actionable performance feedback.
  • Solve problems conventional batch compilers often avoid: dynamic shapes, compile latency, KV-cache management, and the different optimization objectives of time-to-first-token (TTFT) versus steady-state throughput.
  • Build cost models that predict performance on silicon that doesn't exist yet, then continuously calibrate those models against real hardware.
  • Feed compiler learnings back into ISA and microarchitecture requirements for the next generation of silicon.

Requirements

  • Production compiler experience in code generation, optimization, or graph mapping. Tell us what you shipped and what it achieved, not how many years you've been doing it.
  • Experience with MLIR and/or LLVM, with meaningful contributions to an active compiler stack such as LLVM, MLIR, TVM, IREE, XLA, Triton, Inductor, or an equivalent internal system.
  • Strong modern C++ skills and a disciplined approach to testing and correctness. Rust experience is a plus.
  • Experience targeting custom accelerators or non-standard ISAs. You should be comfortable reading a microarchitecture specification, understanding its implications, and arguing with its assumptions when the compiler says they don't hold.
  • Strong performance intuition: memory hierarchy, data movement, parallelism, synchronization, occupancy, and the factors that determine whether theoretical hardware throughput becomes real throughput.
  • A co-design mindset. Compiler, kernels, runtime, ISA, and silicon are one system. You'll cross those boundaries whenever that's where the performance opportunity is.
  • Defensible opinions about what today's ML compilers get wrong and evidence behind them.
  • Work on autotuning, auto-scheduling, or polyhedral compilation.
  • Serious hands-on experience using agents in compiler, kernel-generation, or optimization loops.
  • CUDA/Triton expertise, particularly with the CUTLASS or NCCL ecosystems.
  • Experience with VLIW, systolic, dataflow, or other unconventional architectures.
  • Open-source compiler contributions we can read and discuss.
Tensordyne

TensordyneSunnyvale, USA

Industries
Semiconductors, Artificial Intelligence, Computer Hardware
Growth
9%