NVIDIA CUDA Moat Strengthens Rather Than Weakens in Agent Era, Claims MXNet Creator

What was said

"CUDA MOLT is definitely there. And with this kind of automatic generation technology and the CUDA mode, I think it's even higher. The reason is this kind of evolution requires a lot of tools and ecosystem to make it happen. For example, we need an accurate profiler, and we need a reliable driver, and we need everything there to make it happen. For CUDA ecosystem, like with this kind of tool and everyone in using CUDA can achieve better performance than faster than ever."

Bing Xu, co-creator of MXNet, argued against the prevailing view that CUDA's moat is narrowing, claiming instead that AI agents optimizing at the PTX level actually deepen NVIDIA's advantage. His company runs swarms of GPT-4.5-powered agents that write and evolve GPU kernel code, achieving expert-level performance on mature workloads and 50% speedups on new ones like Kimi Delta Attention. He contends NVIDIA's superior profiling tools and driver ecosystem enable faster agent-driven optimization than competitors can match.