JAX Pallas Kernels: Write GPU Kernels for Max Performance
JAX Pallas kernels: NVIDIA GPU programming API for high-performance compute. Write optimized kernels for matrix multiplication and memory access.
Tag: Compilers
JAX XLA: Why Your GPU is Idle 40% of the Time
Recompilation is the silent killer of training throughput. If you see 'Jit' in your profiler, you are losing money. We dive into XLA internals.