tolk
foundation · like tinygradTolk is a port of tinygrad in OCaml — a minimal compiler for GPU tensor computation. It takes tensor-level computation graphs, optimizes them, and emits kernels for the CPU (C, compiled with Clang), Metal, CUDA and NVIDIA's kernel driver (CUDA C, compiled with NVRTC), and AMD (HIP, compiled with comgr).
- install
- opam install tolk
- built on
- rig
Most programs never call tolk themselves: Rune.jit compiles through it. This page is for working on the compiler, or for driving it directly.
Features
- Three-level IR — tensor graphs, kernel DAGs, and linear programs with shared conventions (sub-axes, tagging, map_children)
- Symbolic simplification — three-phase algebraic pipeline for index expressions with div/mod folding
- Hardware decompositions — transcendentals, int64 emulation, float type promotion, and late op rewrites
- Codegen pipeline — range simplification, GPU dimension mapping, beam search optimization, and linearization
- Schedule pipeline — tensor-to-kernel graph transformation with range analysis, for one device
- JIT integration — used by Rune's
jittransformation to compile and dispatch kernels at runtime
Architecture
Tolk follows a layered compilation pipeline:
- Tensor IR — high-level operation graph (reductions, reshapes, movement ops)
- Schedule — transforms tensor graphs into kernel graphs via rangeify and indexing
- Codegen — optimizes kernel structure (range simplification, GPU dims, beam search)
- Lowering — lowers to linear program IR (devectorization, expansion, decompositions)
- Renderer — emits backend-specific source code (C, Metal, CUDA, HIP)
- Engine — runs the compiled kernels on rig's devices (
tolk.engine)
Libraries
tolk— the compiler: it takes a program and a target, and returns data (source, binaries, memory plans and schedules). It depends on no runtime.tolk.engine— runs that output on rig's devices.
this page is tested with mdxedit this page ↗