3 ms·

> we are also seeing incredible advances in software performance Incredible? > open ai announced like 15% improvement by fixing gpu kernel issue That is... o

> we are also seeing incredible advances in software performance Incredible? > open ai announced like 15% improvement by fixing gpu kernel issue That is... ordinary software optimization.

blovescoffee 2mo ago
a 15% improvement at a trillion dollar scale company is massive
- ninkendo 2mo ago
  15% improvements are usually called “fixing a mistake in the code” or “getting to that task in the backlog for optimizing that code we had to ship on a deadline”. They’re more likely the bigger the company: more contributors working in disparate areas means more low hanging fruit is probably lying around.
enraged_camel 2mo ago
There's nothing ordinary about downloading a new GPU driver and having performance go up by 15%.
- obidan 2mo ago
  This is untrue. It is very ordinary. How much do you know about GPU drivers that you state this so assuredly? Drivers are software. Software can be improved. Do you believe there are no prior examples of GPU drivers being improved such that particular compute patterns go up in performance by more than 15%? This driver improved Total War performance by 71% https://www.nvidia.com/download/driverResults.aspx/74714/en- https://www.nvidia.com/download/driverResults.aspx/74714/en-... Also note you can go ahead and improve any open source driver right now, most likely. Compile it for your specific card and remove all other architecture specific if-cases and you can get an improvement. Edit: also here’s a opencl 30% compute perf increase documented here : https://m.hexus.net/tech/news/graphics/74425-haswell-systems-get-opencl-gaming-boosts-driver-update/ https://m.hexus.net/tech/news/graphics/74425-haswell-systems... that i just googled for
- slashdave 2mo ago
  No, we do this kind of thing regularly. Optimizations often depend on the model that is using them. Namely, fusion techniques.

> we are also seeing incredible advances in software performance Incredible? > open ai announced like 15% improvement by fixing gpu kernel issue That is... ordinary software optimization.

blovescoffee 2mo ago

a 15% improvement at a trillion dollar scale company is massive

ninkendo 2mo ago
15% improvements are usually called “fixing a mistake in the code” or “getting to that task in the backlog for optimizing that code we had to ship on a deadline”. They’re more likely the bigger the company: more contributors working in disparate areas means more low hanging fruit is probably lying around.

enraged_camel 2mo ago

There's nothing ordinary about downloading a new GPU driver and having performance go up by 15%.

obidan 2mo ago
This is untrue. It is very ordinary. How much do you know about GPU drivers that you state this so assuredly? Drivers are software. Software can be improved. Do you believe there are no prior examples of GPU drivers being improved such that particular compute patterns go up in performance by more than 15%? This driver improved Total War performance by 71% https://www.nvidia.com/download/driverResults.aspx/74714/en- https://www.nvidia.com/download/driverResults.aspx/74714/en-... Also note you can go ahead and improve any open source driver right now, most likely. Compile it for your specific card and remove all other architecture specific if-cases and you can get an improvement. Edit: also here’s a opencl 30% compute perf increase documented here : https://m.hexus.net/tech/news/graphics/74425-haswell-systems-get-opencl-gaming-boosts-driver-update/ https://m.hexus.net/tech/news/graphics/74425-haswell-systems... that i just googled for
slashdave 2mo ago
No, we do this kind of thing regularly. Optimizations often depend on the model that is using them. Namely, fusion techniques.