3 ms·
Is this an ad for a new, closed-source, GPGPU backend?
by zxexz 2y ago
Is this an ad for a new, closed-source, GPGPU backend?
- BoredPositron 2y agoPretty much and the test suit is optimized to get the results they wanted.
- nottorp 2y agoPretty sure a useful benchmark for this kind of thing would calculate performance per watt (or per watt and dollar). That info is conspicuously absent from the article.
- acchow 2y agoThe electricity consumption in the cloud is not really important. The H100 rents for about $4.5/hr consuming 0.7kWh in that hour which will likely cost them less than 7 cents.
- nottorp 2y ago> The electricity consumption in the cloud is not really important. That just says you don't run a cloud for profit :)
- latchkey 2y agoHere is the open source backend... https://www.reddit.com/r/AMD_MI300/comments/1dgimxt/benchmarking_brilliance_single_amd_mi300x_vllm/ https://www.reddit.com/r/AMD_MI300/comments/1dgimxt/benchmar...