3 ms·

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get yo

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?

nl 9mo ago
Post RL you won't need to put the grammar in the prompt anymore.
- measurablefunc 9mo ago
  The grammar of this language is no more than a few hundred tokens (thousands at worst) & current LLMs support context windows in the millions of tokens.
  - nl 9mo ago
    Sure. The point is that your statement about the ability to do RL is wrong. Additionally your response to the Deepseek paper in the other subthread shows profound and deliberate ignorance.
    - measurablefunc 9mo ago
      Theorycrafting is very easy. Not a single person in this thread has shown any code to do what they're suggesting. You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible or admit you lack the relevant understanding to back up your claims.
      - nl 9mo ago
        > You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible GPU poor here though... To quote someone (you...) on the internet: > More generally, don't ask random people on the internet to do work for you for free. https://news.ycombinator.com/item?id=46689232 https://news.ycombinator.com/item?id=46689232
        measurablefunc 9mo ago
        Claims require evidence & if you are unwilling to present it then admit you do not have any evidence to support your claims. It's not complicated. Either RL works & you have evidence or you do not know & can not claim that it works w/o first doing the required due diligence which (shockingly) actually requires work instead of empty theory crafting & hand waving.

If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?

nl 9mo ago

Post RL you won't need to put the grammar in the prompt anymore.

measurablefunc 9mo ago
The grammar of this language is no more than a few hundred tokens (thousands at worst) & current LLMs support context windows in the millions of tokens.
- nl 9mo ago
  Sure. The point is that your statement about the ability to do RL is wrong. Additionally your response to the Deepseek paper in the other subthread shows profound and deliberate ignorance.
  - measurablefunc 9mo ago
    Theorycrafting is very easy. Not a single person in this thread has shown any code to do what they're suggesting. You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible or admit you lack the relevant understanding to back up your claims.
    - nl 9mo ago
      > You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible GPU poor here though... To quote someone (you...) on the internet: > More generally, don't ask random people on the internet to do work for you for free. https://news.ycombinator.com/item?id=46689232 https://news.ycombinator.com/item?id=46689232
      - measurablefunc 9mo ago
        Claims require evidence & if you are unwilling to present it then admit you do not have any evidence to support your claims. It's not complicated. Either RL works & you have evidence or you do not know & can not claim that it works w/o first doing the required due diligence which (shockingly) actually requires work instead of empty theory crafting & hand waving.