5 ms·

Revealing against what? If you look at the README it is completely revealed... so i would argue there is nothing to "reveal" in the first place. > I started

by i5heu 1y ago

Revealing against what? If you look at the README it is completely revealed... so i would argue there is nothing to "reveal" in the first place. > I started this project on a lark, fully expecting the AI to produce terrible code for me to laugh at. And then, uh... the code actually looked pretty good. Not perfect, but I just told the AI to fix things, and it did. I was shocked. > To emphasize, this is not "vibe coded". Every line was thoroughly reviewed and cross-referenced with relevant RFCs, by security experts with previous experience with those RFCs.

risyachka 1y ago
If the guy knew how to properly implement oauth - did he save any time though by prompting or just tried to prove a point that if you actually already know all details of impl you can guide llm to do it? Thats the biggest issue I see. In most cases I don't use llm because DIYing it takes less time than prompting/waiting/checking every line.
- JimDabell 1y ago
  > did he save any time though Yes: > It took me a few days to build the library with AI. > I estimate it would have taken a few weeks, maybe months to write by hand. – https://news.ycombinator.com/item?id=44160208 https://news.ycombinator.com/item?id=44160208 > or just tried to prove a point that if you actually already know all details of impl you can guide llm to do it? No: > I was an AI skeptic. I thoughts LLMs were glorified Markov chain generators that didn't actually understand code and couldn't produce anything novel. I started this project on a lark, fully expecting the AI to produce terrible code for me to laugh at. And then, uh... the code actually looked pretty good. Not perfect, but I just told the AI to fix things, and it did. I was shocked. — https://github.com/cloudflare/workers-oauth-provider/?tab=readme-ov-file#written-using-claude https://github.com/cloudflare/workers-oauth-provider/?tab=re...
  - autoexec 1y ago
    > I thoughts LLMs were glorified Markov chain generators that didn't actually understand code and couldn't produce anything novel. How novel is a OAuth provider library for cloudflare workers? I wouldn't be surprised if it'd been trained on multiple examples.
    - deleted 1y ago
      [deleted]
    - kentonv 1y ago
      I'm not aware of any other OAuth provider libraries for Workers. Plenty of clients, but not providers -- implementing the provider side is not that common, historically. See my other comment: https://news.ycombinator.com/item?id=44164204 https://news.ycombinator.com/item?id=44164204
      - nipah 1y ago
        Novelness is not a characteristic of interpolation, tho, it's about extrapolation. If you have plenty of clients and plenty of related stuff to the provider side, even if on on auth, then it could be considerably trivial for the LLM to interpolate on that field.
- DonHopkins 1y ago
  [flagged]
- theshrike79 1y ago
  Do people save time by learning to write code at 420WPM? By optimising their vi(m) layouts and using languages with lots of fancy operators that make things quicker to write? Using an LLM to write code you already know how to write is just like using intellisense or any other smart autocomplete, but at a larger scale.
rienbdj 1y ago
> Revealing against what? Revealing of what it is like working with an LLM in this way.
JW_00000 1y ago
I think OP meant "revealing" as in "enlightening", not as "uncovering something that was hidden intentionally".
kortilla 1y ago
Revealing the types of critical mistakes LLMs make. In particular someone that didn’t already understand OAuth likely would not have caught this and ended up with a vulnerable system.

by i5heu 1y ago

risyachka 1y ago

If the guy knew how to properly implement oauth - did he save any time though by prompting or just tried to prove a point that if you actually already know all details of impl you can guide llm to do it? Thats the biggest issue I see. In most cases I don't use llm because DIYing it takes less time than prompting/waiting/checking every line.

JimDabell 1y ago
> did he save any time though Yes: > It took me a few days to build the library with AI. > I estimate it would have taken a few weeks, maybe months to write by hand. – https://news.ycombinator.com/item?id=44160208 https://news.ycombinator.com/item?id=44160208 > or just tried to prove a point that if you actually already know all details of impl you can guide llm to do it? No: > I was an AI skeptic. I thoughts LLMs were glorified Markov chain generators that didn't actually understand code and couldn't produce anything novel. I started this project on a lark, fully expecting the AI to produce terrible code for me to laugh at. And then, uh... the code actually looked pretty good. Not perfect, but I just told the AI to fix things, and it did. I was shocked. — https://github.com/cloudflare/workers-oauth-provider/?tab=readme-ov-file#written-using-claude https://github.com/cloudflare/workers-oauth-provider/?tab=re...
- autoexec 1y ago
  > I thoughts LLMs were glorified Markov chain generators that didn't actually understand code and couldn't produce anything novel. How novel is a OAuth provider library for cloudflare workers? I wouldn't be surprised if it'd been trained on multiple examples.
  - deleted 1y ago
    [deleted]
  - kentonv 1y ago
    I'm not aware of any other OAuth provider libraries for Workers. Plenty of clients, but not providers -- implementing the provider side is not that common, historically. See my other comment: https://news.ycombinator.com/item?id=44164204 https://news.ycombinator.com/item?id=44164204
    - nipah 1y ago
      Novelness is not a characteristic of interpolation, tho, it's about extrapolation. If you have plenty of clients and plenty of related stuff to the provider side, even if on on auth, then it could be considerably trivial for the LLM to interpolate on that field.
DonHopkins 1y ago
[flagged]
theshrike79 1y ago
Do people save time by learning to write code at 420WPM? By optimising their vi(m) layouts and using languages with lots of fancy operators that make things quicker to write? Using an LLM to write code you already know how to write is just like using intellisense or any other smart autocomplete, but at a larger scale.

rienbdj 1y ago

> Revealing against what? Revealing of what it is like working with an LLM in this way.

JW_00000 1y ago

I think OP meant "revealing" as in "enlightening", not as "uncovering something that was hidden intentionally".

kortilla 1y ago

Revealing the types of critical mistakes LLMs make. In particular someone that didn’t already understand OAuth likely would not have caught this and ended up with a vulnerable system.