The inspiration for this column comes not from the epic 1999 film The Matrix, as the title may suggest, but from an episode of Sean Carroll’s Mindscape podcast that I listened to over the summer. The ...

Abstract: Matrix multiplication computation (MMC) is a fundamental operation with various applications, including linear regression, k-nearest neighbor classification and biometric identification.

The idea isn't novel, but presents major challenges. Tensordyne thinks it has solved them, and promises massive speed and ...

This repository contains the CUDA kernels for general matrix-matrix multiplication (GEMM) and the corresponding performance analysis. The correctness of the CUDA kernels is guaranteed for any matrix ...

On a B200, the nvjet_tst_16x64_64x16_4x1_v_bz_TNN kernel is used, and it takes roughly 8.1 microseconds. On a H200, the nvjet_tst_64x8_64x16_4x1_v_bz_TNT kernel is ...

Abstract: Matrix multiplication is a crucial operation in many data-intensive workloads. Given the large size of matrices in today's workloads, it is common to split the computation into tasks ...