My understanding of scientific HPC algorithms is that at their hearts they very often rely on huge amounts of matrix multiplication. This is not something restricted to neural nets by any means. Since the Tensor Cores are in fact specialized matrix multiplication hardware, and since they added...