4 ms·
The thing about modern AI, it's that operations involved here (e.g. Dense matmuls) are lot simpler and GPU friendly than what you'd find in a typical HPC applic
by shihab 3y ago
The thing about modern AI, it's that operations involved here (e.g. Dense matmuls) are lot simpler and GPU friendly than what you'd find in a typical HPC applications. This means you can get pretty close to peak hardware performance using high-level languages like Python or OpenAI's Triton. I think it's unlikely that the push to improve ROCm's standard libraries will come from an AI-focused startup
- cavisne 3y agoEven with AMD working on hard on specific benchmarks for marketing purposes they could not get close to peak hardware performance on their brand new chips. https://www.semianalysis.com/p/amd-mi300-performance-faster-than https://www.semianalysis.com/p/amd-mi300-performance-faster-...