3 ms·
Sturgeon's Law is proved correct time and again. Most things are crap. Most people produce some crap in their lives. Some people only produce crap. Those people
by pc86 2mo ago
Sturgeon's Law is proved correct time and again. Most things are crap. Most people produce some crap in their lives. Some people only produce crap. Those people still need to eat but unfortunately some of them (somehow) find their way into tech and actually convince people to pay money for crap.
Especially with a low bar to entry like what is essentially AI-backed transcription-as-a-service, I'm not sure 90% is high enough. There will be 100 companies offering essentially the same thing and it's unfortunately the responsibility of the customer to find the one written by someone who doesn't have a parsnip where their brain should be.
- noir_lord 2mo agoFortunately we have LLM's to not produce that crap... wait, those LLM's were trained on the existing crap and produce the same crap... oh no.
- user43928 2mo agoI doubt SOTA models nowadays are going to produce an implementation without any kind of authentication like here, and not tell you about it. And even if, a later "is this ready for release" will probably surface such obvious issues. I do not think LLMs are the problem here. Today, they are most likely more competent than whoever set this up.
- skydhash 2mo agoStill the six month wait time when everything should be good? /s
- user43928 2mo agoNo, what I said is that I think this has already been good for some time.
- wongarsu 2mo agoHowever if you start current SOTA models out on a bad codebase they will happily write more bad code to fit in with the "conventions" of the existing code. Including authentication and isolation. If you start out your app on the wrong foot (for example because you lack the vocabulary to express what you need) you can end up with nicely polished turds Asking the LLM for a review of the code would still have caught it
- sensanaty 2mo agoI love the never-ending "SOTA" treadmill used to defend anything and everything these LLM tools shit up. Doesn't matter what happens, it wasn't one of the "SOTA" models (which changes every 7 seconds) ergo it's irrelevant, how very convenient for the AI pushers!
- Ekaros 2mo agoCan someone give me exact time when SOTA stop being good? Is it a day, week or a month? As such can I consider anything older than that time period to automatically be crap?
- user43928 2mo agoMore than half a year ago, someone may or may not have used AI to implement this insecure backend. That is not a very good basis to start complaining about AI producing insecure code. If you still want to do it, at least check if it actually is the case with reasonably intelligent current models.
- bonoboTP 2mo agoThey were RL trained on verifiable rewards. It's not purely learning to predict the next token of a human produced stream.
- esafak 2mo agoThis is not an issue. IF you prompt it right you could have avoided this with models at least a year old.