5 ms·

Can someone explain the down votes? What exactly is incorrect in OPs comment?

snissn 3y ago
i don't know why people downvote, but writing highly performant gpu code across multiple languages is still in the realm of only a few people with a lot of the right experience can do well, and while ai can help assist those people it's not a problem that can be fully solved by an ai at this moment, maybe a few years with a large feedback loop of iterating, testing, benchmarking, repeating. i guess one day but not now
- solverist 3y ago
  If the bottleneck is writing performant code then seems like that's the first thing AI companies should solve with AI. If that's solved then building applications on top of that foundation is very easy. Are there any companies working on this problem?
  - lambda 3y ago
    Did you just create three new accounts to ask this series of questions? These questions, and account names, all seem to share similar patterns.
    - developist 3y ago
      HN keeps throttling after 2 comments. Maybe they need more AI to detect bots instead of whatever algorithm they are using at the moment. Back to the question at hand. How exactly do AI companies plan to build AGI if they can not optimize the AI development loop with their tools and techniques?
      - deleted 3y ago
        [deleted]
TrueDuality 3y ago
I would have to guess it has something to do with that task not actually being suitable for language models at their current stage. Even if they could be trusted to perform the task, its actually not that much work to just... write code to handle keeping this kind of thing in sync. It's really really not that much more work. You really don't even need to do it, both training and inference can be done within PyTorch or in C++. If it was necessary for some reason... Running a language model to keep something like this is sync over long term training and iteration would likely be more expensive than a developer's time AND block the researcher in a verification loop on the output which still probably needs to be checked by the developer (they could be the same person which will just deepen the frustration they experience). The use of a lot of garbage accounts in this thread and lack of model details also looks pretty shady...
- solverist 3y ago
  I'm confused. If these tools aren't good enough for AI research then why would they be good enough for consumer applications? If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type systems.
  - TrueDuality 3y ago
    I don't think you read what I said, or you don't know what you're talking about. Language models are actively being researched to be useful, but as of right now _they are not ready, capable, or trustworthy enough_ to perform tasks without supervision, they're especially bad at complex code and code that doesn't have many examples in the internet corpuses such as optimized CUDA kernels...
  - stale2002 3y ago
    > If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. it quite literally is useful for consumer usecases though. For example, one consumer usecase that is being used by a lot of students right now is cheating on their homework. It is right now being used for all sorts of consumer things like that. Also, if you have an opinion you can just say what your opinion is. You don't have to hide it behind questions and alt accounts. You can just have an opinion and say it.

i don't know why people downvote, but writing highly performant gpu code across multiple languages is still in the realm of only a few people with a lot of the right experience can do well, and while ai can help assist those people it's not a problem that can be fully solved by an ai at this moment, maybe a few years with a large feedback loop of iterating, testing, benchmarking, repeating. i guess one day but not now

solverist 3y ago
If the bottleneck is writing performant code then seems like that's the first thing AI companies should solve with AI. If that's solved then building applications on top of that foundation is very easy. Are there any companies working on this problem?
- lambda 3y ago
  Did you just create three new accounts to ask this series of questions? These questions, and account names, all seem to share similar patterns.
  - developist 3y ago
    HN keeps throttling after 2 comments. Maybe they need more AI to detect bots instead of whatever algorithm they are using at the moment. Back to the question at hand. How exactly do AI companies plan to build AGI if they can not optimize the AI development loop with their tools and techniques?
    - deleted 3y ago
      [deleted]

TrueDuality 3y ago

I would have to guess it has something to do with that task not actually being suitable for language models at their current stage. Even if they could be trusted to perform the task, its actually not that much work to just... write code to handle keeping this kind of thing in sync. It's really really not that much more work. You really don't even need to do it, both training and inference can be done within PyTorch or in C++. If it was necessary for some reason... Running a language model to keep something like this is sync over long term training and iteration would likely be more expensive than a developer's time AND block the researcher in a verification loop on the output which still probably needs to be checked by the developer (they could be the same person which will just deepen the frustration they experience). The use of a lot of garbage accounts in this thread and lack of model details also looks pretty shady...

solverist 3y ago
I'm confused. If these tools aren't good enough for AI research then why would they be good enough for consumer applications? If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. Code can be very easily verified by linters and type systems so the problem of verification is much simpler than in consumer use cases without linters and type systems.
- TrueDuality 3y ago
  I don't think you read what I said, or you don't know what you're talking about. Language models are actively being researched to be useful, but as of right now _they are not ready, capable, or trustworthy enough_ to perform tasks without supervision, they're especially bad at complex code and code that doesn't have many examples in the internet corpuses such as optimized CUDA kernels...
- stale2002 3y ago
  > If language models can not help with the AI development loop then the technology is not going to be useful for consumer use cases. it quite literally is useful for consumer usecases though. For example, one consumer usecase that is being used by a lot of students right now is cheating on their homework. It is right now being used for all sorts of consumer things like that. Also, if you have an opinion you can just say what your opinion is. You don't have to hide it behind questions and alt accounts. You can just have an opinion and say it.