The Decision Engine Behind Fused Attention: How Transformer Engine Orchestrates cuDNN on Blackwell

A source-grounded tour of Transformer Engine’s fused-attention dispatch: cuDNN Graph API, versioned backend eligibility, Blackwell paths, kernel-pipelining context, and deterministic training constraints.