3 ms·
The difference in response time - especially versus a regex running locally - is really difficult to express to someone who hasn't made much use of LLM calls in
by lopsotronic 7mo ago
The difference in response time - especially versus a regex running locally - is really difficult to express to someone who hasn't made much use of LLM calls in their natural language projects.
Someone said 10,000x slower, but that's off - in my experience - by about four orders of magnitude. And that's average, it gets much worse.
Now personally I would have maybe made a call through a "traditional" ML widget (scikit, numpy, spaCy, fastText, sentence-transformer, etc) but - for me anyway - that whole entire stack is Python. Transpiling all that to TS might be a maintenance burden I don't particularly feel like taking on. And on client facing code I'm not really sure it's even possible.
- cyanydeez 7mo agoSo, think of it as a business man: You don't really care if your customers swear or whatever, but you know that it'll generate bad headlines. So you gotta do something. Just like a door lock isn't designed for a master criminal, you don't need to design your filter for some master swearer; no, you design it good enough that it gives the impression that further tries are futile. So yeah, you do what's less intesive to the cpu, but also, you do what's enough to prevent the majority of the concerns where a screenshot or log ends up showing blatant "unmoral" behavior.
- true_religion 7mo agoThis door lock doesn’t even work against people speaking French, so I think they could have tried a mite harder.
- sebastiennight 7mo agoEn toute honnêteté, je pense avoir dit "damn it" plus d'une fois à chat gépété avant de fermer la fenêtre dans un accès de rage
- ben_w 7mo agoThe up-side of the US market is (almost) everyone there speaks English. The down side is, that includes all the well-networked pearl-clutchers. Europe (including France) will have the same people, but it's harder to coordinate a network of pearl-clutching between some saying "Il faut protéger nos enfants de cette vulgarité!" and others saying "Η τηλεόραση και τα μέσα ενημέρωσης διαστρεβλώνουν τις αξίες μας!" even when they care about the exact same media. For headlines, that's enough. For what's behind the pearl-clutching, for what leads to the headlines pandering to them being worth writing, I agree with everyone else on this thread saying a simple word list is weird and probably pointless. Not just for false-negatives, but also false-positives: the Latin influence on many European languages leads to one very big politically-incorrect-in-the-USA problem for all the EU products talking about anything "black" (which includes what's printed on some brands of dark chocolate, one of which I saw in Hungary even though Hungarian isn't a Latin language but an Ugric language and only takes influences from Latin).
- sebastiennight 7mo agoI just went through quite an adventure trying to translate back and forth from/to Hungarian to/from different languages to figure out which Hungarian word you meant, and arrived at the conclusion that this language is encrypted against human comprehension.
- bandie91 7mo agodark chocolate is "étcsokoládé" literally edible-chocolate in Hungarian. i heared the throat-cleaning "Negró" candy (marketed by a chimney sweeper man with soot-covered face) was usually which hurt English-speaking people's self-deprecating sensitivities.
- deleted 7mo ago[deleted]
- bigbuppo 7mo agoThere are only Americans on the internet.
- tomaskafka 7mo agoNom de dieu de putain de bordel de merde de saloperie de connard d'enculé de ta mère.
- z500 7mo agoIt's like wiping your arse with silk.
- themafia 7mo agoYea.. but.. in English only. Fortunately I can swear pretty well in Spanish.
- jacquesm 7mo agoThat's like saying you can use a chisel for woodworking.
- senderista 7mo agoOnly a native speaker can tell if you swear well in a foreign language.
- themafia 7mo agoAnd Claude can't tell at all.
- mlmonkey 7mo ago> Someone said 10,000x slower, but that's off - in my experience - by about four orders of magnitude. You do know that 10,000x _is_ four orders of magnitude, right? :-D
- noprof6691 7mo agoThey're sending it to an llm anyway tho? Not sure why they wouldn't just add a sentiment field to the requested response shape.
- FuckButtons 7mo agobecause a regex on the client is free vs gpu compute is absolutely not.
- noprof6691 7mo agoBUT THEY'RE ALREADY RUNNING IT THROUGH THE LLM.
- wcrossbow 7mo agoIf it’s good enough it’s good enough, but just like there are many more options than going full blown LLM or just use a regex there are more options than transpile a massive Python stack to TS or give up.
- viktorianer 6mo ago[flagged]