Raja on the CUDA moat and competitors.
"the programming model and the execution models of massively parallel/accelerated systems are tied at the hip (didn't intend to get RocM fans excited
).
Until you match the execution model of a CUDA GPU, it is frustrating experience to get performance. My scars on the back are screaming ..OpenCL, RocM, OneAPI....
triton is old news. if anything triton helped reduce friction to access CUDA, and is a boon for nVidia. One can argue that CUDA stickiness grew since mid-2021, not reduced - kind of validated by Nvidia's market growth since 2021 as well.
Software standards don't solve CUDA problem.
Simple, scalable, open and robust parallel HW architecture is the foundation needed to build a new software stack. There are some good attempts in the startup eco-system, but way too fragmented.
Each small team is trying to build the entire stack from chiplets through systems through compilers and runtimes and cloud orchestration layers as well, and failing
There is great opportunity for entrepreuners with deep pockets, likes of @a16z @vkhosla @elonmus to orchestrate 5-6 startups to collaborate to build a whole new stack"
wccftech.com
