4 ms·
You're just moving the goal post & not addressing the question I asked. Why isn't AI optimizing the kernels in its own code the way people have been optimizing
by measurablefunc 9mo ago
You're just moving the goal post & not addressing the question I asked. Why isn't AI optimizing the kernels in its own code the way people have been optimizing it like in the posted paper?
- phkahler 9mo agoIt will, right after it reads the paper.
- measurablefunc 9mo agoI read the paper. All the prerequisites are already available in existing literature & they basically profiled & optimized around the bottlenecks to avoid pipeline stalls w/ instructions that utilize the available tensor & CUDA cores. Seems like something these super duper AIs that don't get tired should be able to do pretty easily.
- aspenmartin 9mo agoThey do? https://www.deeplearning.ai/the-batch/alphatensor-for-faster-matrix-multiplication-explained/ https://www.deeplearning.ai/the-batch/alphatensor-for-faster... https://deepmind.google/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/ https://deepmind.google/blog/alphaevolve-a-gemini-powered-co... https://www.rubrik.com/blog/ai/25/teaching-ai-to-write-gpu-code-a-deep-dive-into-reinforcement-fine-tuning?utm_source=chatgpt.com https://www.rubrik.com/blog/ai/25/teaching-ai-to-write-gpu-c...