Posted
Sr. Compiler Engineer
by Tensordyne
- Semiconductors
- Artificial Intelligence
- Computer Hardware
I’m interested
Free account · stay hidden from your current employer
Your interest is shared with employers only as an anonymized demand signal.
Introduction
The compiler decides whether our inference silicon runs at 30% utilization or 90% or more. That's the job. Together with our team, you'll build the backend that turns AI workloads into microcode for Tensordyne hardware - Napier today and the silicon that follows. This is a clean-slate compiler effort targeting a genuinely unusual architecture. You'll have the opportunity to work on fundamental parts of the compiler.
Tasks
- Contribute to backend compilation end to end: lowering, instruction scheduling, register and resource allocation, and microcode generation.
- Consider the memory hierarchy: SRAM residency, HBM traffic, DMA orchestration, layout, rematerialization, and data movement. The goal is simple: keep the machine compute-bound rather than waiting on memory.
- Develop tiling, fusion, and software-pipelining strategies that close the gap between theoretical and achieved throughput.
- Design compiler interfaces that work for both agents and engineers: structured IR access, machine-readable diagnostics, searchable tuning spaces, and actionable performance feedback.
- Solve problems conventional batch compilers often avoid: dynamic shapes, compile latency, KV-cache management, and the different optimization objectives of time-to-first-token (TTFT) versus steady-state throughput.
- Build cost models that predict performance on silicon that doesn't exist yet, then continuously calibrate those models against real hardware.
- Feed compiler learnings back into ISA and microarchitecture requirements for the next generation of silicon.
Requirements
- Production compiler experience in code generation, optimization, or graph mapping. Tell us what you shipped and what it achieved, not how many years you've been doing it.
- Experience with MLIR and/or LLVM, with meaningful contributions to an active compiler stack such as LLVM, MLIR, TVM, IREE, XLA, Triton, Inductor, or an equivalent internal system.
- Strong modern C++ skills and a disciplined approach to testing and correctness. Rust experience is a plus.
- Experience targeting custom accelerators or non-standard ISAs. You should be comfortable reading a microarchitecture specification, understanding its implications, and arguing with its assumptions when the compiler says they don't hold.
- Strong performance intuition: memory hierarchy, data movement, parallelism, synchronization, occupancy, and the factors that determine whether theoretical hardware throughput becomes real throughput.
- A co-design mindset. Compiler, kernels, runtime, ISA, and silicon are one system. You'll cross those boundaries whenever that's where the performance opportunity is.
- Defensible opinions about what today's ML compilers get wrong and evidence behind them.
- Work on autotuning, auto-scheduling, or polyhedral compilation.
- Serious hands-on experience using agents in compiler, kernel-generation, or optimization loops.
- CUDA/Triton expertise, particularly with the CUTLASS or NCCL ecosystems.
- Experience with VLIW, systolic, dataflow, or other unconventional architectures.
- Open-source compiler contributions we can read and discuss.