3 ms·

>People haven't spent time optimizing the fp32 versions of these kernels in years. Wow, so, you're basically saying the AI created new algos in a domain with n

>People haven't spent time optimizing the fp32 versions of these kernels in years. Wow, so, you're basically saying the AI created new algos in a domain with no pre-existing solutions? Awesome!

Aurornis 1y ago
No one said the AI created new algorithms nor that there weren’t pre-existing solutions. The implication was that the FP32 versions of these kernels have lagged behind the more popular versions. There was opportunity to translate the advancements from other kernels into these. Someone would need to look closely to see exactly what was done, but it’s premature to suggest anything like “new algos” or “no pre-existing solutions” This is a great use case for LLMs, though. I often do something similar where I make improvements to something I use most frequently and ask an LLM to translate that pattern to other similar parts of the code.
- moralestapia 1y ago
  >The implication was that the FP32 versions of these kernels have lagged behind the more popular versions. Help me understand this 'cause I'm a bit slow these days ... Does that mean optimized FP32 versions of these kernels were already there or not?
  - almostgotcaught 1y ago
    > Help me understand this 'cause I'm a bit slow these days ... If I do `sed 's/f32/f16/g' kernel.cu` does this count as AI? Help me understand because I'm a little slow when it comes to all the dumb shit people attribute to LLMs these days...
    - moralestapia 1y ago
      Indeed, you're slow on these news. >sed 's/f32/f16/g' kernel.cu This is not what's happening here, it's a completely different thing, read TFA.
  - imtringued 1y ago
    You are a blatant troll and you know that.
  - Dylan16807 1y ago
    > Does that mean optimized FP32 versions of these kernels were already there or not? If you're trying to support your original point with that argument, then you're using some pretty awful definitions of the terms "new algos" and "no pre-existing solutions".
uoaei 1y ago
The hype cycle in action, folks. Pay heed.
- deleted 1y ago
  [deleted]
vlovich123 1y ago
The solution not existing in PyTorch does not mean the solution doesn’t exist elsewhere on the internet. Remember - PyTorch is largely maintained by employees of companies that have their own priorities for the SW and those priorities may not include hyper optimizing fp32 kernels. That being said, it is cool if AI is enabling lower cost adoption of better more optimized kernels with less effort.
imtringued 1y ago
Read the article before spouting lies. Actually never mind that. Read the damn comment you're responding to. There have been human written kernels for both fp16 and fp32 for a long time. Here is the corrected version of your comment: "Wow, so, you're basically saying the AI created the same but faster algos in a well known domain with established pre-existing solutions, whose overall impact on the runtime of practical workloads is insignificant? Awesome!"

>People haven't spent time optimizing the fp32 versions of these kernels in years. Wow, so, you're basically saying the AI created new algos in a domain with no pre-existing solutions? Awesome!

Aurornis 1y ago

No one said the AI created new algorithms nor that there weren’t pre-existing solutions. The implication was that the FP32 versions of these kernels have lagged behind the more popular versions. There was opportunity to translate the advancements from other kernels into these. Someone would need to look closely to see exactly what was done, but it’s premature to suggest anything like “new algos” or “no pre-existing solutions” This is a great use case for LLMs, though. I often do something similar where I make improvements to something I use most frequently and ask an LLM to translate that pattern to other similar parts of the code.

moralestapia 1y ago
>The implication was that the FP32 versions of these kernels have lagged behind the more popular versions. Help me understand this 'cause I'm a bit slow these days ... Does that mean optimized FP32 versions of these kernels were already there or not?
- almostgotcaught 1y ago
  > Help me understand this 'cause I'm a bit slow these days ... If I do `sed 's/f32/f16/g' kernel.cu` does this count as AI? Help me understand because I'm a little slow when it comes to all the dumb shit people attribute to LLMs these days...
  - moralestapia 1y ago
    Indeed, you're slow on these news. >sed 's/f32/f16/g' kernel.cu This is not what's happening here, it's a completely different thing, read TFA.
- imtringued 1y ago
  You are a blatant troll and you know that.
- Dylan16807 1y ago
  > Does that mean optimized FP32 versions of these kernels were already there or not? If you're trying to support your original point with that argument, then you're using some pretty awful definitions of the terms "new algos" and "no pre-existing solutions".

uoaei 1y ago

The hype cycle in action, folks. Pay heed.

deleted 1y ago
[deleted]

vlovich123 1y ago

The solution not existing in PyTorch does not mean the solution doesn’t exist elsewhere on the internet. Remember - PyTorch is largely maintained by employees of companies that have their own priorities for the SW and those priorities may not include hyper optimizing fp32 kernels. That being said, it is cool if AI is enabling lower cost adoption of better more optimized kernels with less effort.

imtringued 1y ago

Read the article before spouting lies. Actually never mind that. Read the damn comment you're responding to. There have been human written kernels for both fp16 and fp32 for a long time. Here is the corrected version of your comment: "Wow, so, you're basically saying the AI created the same but faster algos in a well known domain with established pre-existing solutions, whose overall impact on the runtime of practical workloads is insignificant? Awesome!"