dakolli

11 ms·

301.
by dakolli 5mo ago
My grandpa retired as an IL police officer in his 50s and lived for 30+ more years making 6 figures from his pension and getting 3% or 5% (I forgot) adjustments every year. He probably had the most chill retirement of anybody I've ever
302.
by dakolli 5mo ago
Interesting I didn't know about this, but it makes sense after reading the article. They are benchmarking on a single GPU on a 20bb param model. Does it scale across 60 H100s over NVLink/NVSwitch. I would be interested to see thos
303.
by dakolli 5mo ago
Just because you read it on a github repo doesn't make it true, it also doesn't take into account cpu temps and inevitable throttling you'll encounter.
304.
by dakolli 5mo ago
That's not possible, read my comment above. These are private companies, there are no public filings regarding their profitability in any sense. You're just making things up. If you have a machine running at 150 tok/ps you ca
305.
by dakolli 5mo ago
Large companies are paying an arm and a leg, but I'm still certain even at $15.00 per million tokens they are not profitible. If you have a machine running at 150 tok/ps you can only make $5820 a month at $15 per 1mm running 24&#x
306.
by dakolli 5mo ago
So you're running an llm to do data transformation that deterministic processes would be much better suited for and running 1,000 watt power supply to do so. Wild.
307.
by dakolli 5mo ago
I would still question what usefulness there is with a local model even with 10k in GPUs. I certainly haven't seen any great uses myself from these smaller models (<500 parameters) except claims from people who are totally enamored
308.
by dakolli 5mo ago
I'm just saying that agent that can fix your bugs actually cost $100-150 an hour to run and you're getting it essentially for $200.00 a month. The cost of cloud compute actually hasn't gone down for old hardware all that much
309.
by dakolli 5mo ago
This is simply delusional, It cost 20-30k a month to run Kimi 2.6. The tokens are sold for $3 per mm. To sell tokens profitably you'd need to be able to run inference at 150 tokens per second for less than $1,000 USD a month. I don&#x2
310.
by dakolli 6mo ago
I have unlimited access to every single frontier model, I've tested all of them, they are not good at writing software. They are basically slot machines, sometimes you win a little bit and sometimes you win a lot but usually you just b
311.
by dakolli 6mo ago
Ahh yes, I'm sure agents did this all autonomously without any human in the loop what so ever. They are useless without experts to handle them.
312.
by dakolli 6mo ago
Interesting article, thanks. I've done a bit of small scale phone farming (for my own cheap mobile proxies). In all reality the phones aren't that expensive, I went with Moto 5gs that cost $130 (retail), so in their case the phone
313.
by dakolli 6mo ago
LLMs aren't capable of doing this, and never will be no matter what Anthropic tries tell you.
314.
by dakolli 6mo ago
Ahh, that makes sense.
315.
by dakolli 6mo ago
Why is every startup using that same Serif font now, Garamond or whatever. Is it an LLM design phenomenon? Its kinda ruining that font style for me. Also $1,500 a month for 10 "influencers" is wild. This doesn't seem that sop
316.
by dakolli 6mo ago
In 2008, the Department of Homeland Security (DHS) contacted Unspam Technologies, asking, "Do you have any idea how valuable the data you have is?" The DHS' email served as the impetus for Cloudflare, a technology company Pri
317.
by dakolli 6mo ago
llms aren't doing any of that. Some smart people are using llms find those vulns, there's a huge difference.
318.
by dakolli 6mo ago
Everyone thinks this is funny and ignoring the fact that its a great showcase of how net negative and useless llms are to society.
319.
by dakolli 6mo ago
> If you looked at a graph of GPU power in consumer hardware and model capability per billion parameters over time, it seems inevitable that in the next few years a "good enough" model will run on entry-level hardware. Of cour
320.
by dakolli 6mo ago
I personally think its easier to detect llm controlled browser sessions, the people deploying them are far more naive and inexperienced than traditional scrapers/crawlers. insert You wouldn't bring a 40 Petabyte Zip Bomb to Schoo
321.
by dakolli 6mo ago
There are physical limits to how much you can compress data. I'm just saying, don't sit on your hands waiting for this to happen, becuase its probably not going to for another decade +. There's no use in waiting, just write t
322.
by dakolli 6mo ago
A future with less RAM is possible with more applications using computational storage with ssd/nvme. But that's not my main argument is that its delusional for OP thinks its reasonable to expect that soon we'll be able to run
323.
by dakolli 6mo ago
Do you really think the trend of consumer hardware is heading towards more memory and better specs? Apple's most popular product this year is an 8gb of RAM laptop.. The trend is heading in the opposite direction, less options for stron
324.
by dakolli 6mo ago
Because everyone in these replies is in complete denial about the physical limits of memory and scaling in general. Ya'll literally living in an alternate reality where model capability increases with a decrease in size, its simply not
325.
by dakolli 6mo ago
Frontier models can hardly do the tasks I want them too, I simply cannot buy into this notion.
326.
by dakolli 6mo ago
Its not hard to tell at all, just look at how much it costs to run a 10T param model (especially with parallelized agents). Those costs are not worth the occasional slot machine-eque jackpot you get. For an entity like Google it might be wo
327.
by dakolli 6mo ago
There will always be a huge gap between frontier models and open source models (unless you're very rich). This whole industry makes no sense, everyone is ignoring the unit economics. It cost 20k a month to running Kimi 2.6 at decent to
328.
by dakolli 6mo ago
I wasn't trying to be negative. I think the changes you made to your landing page are more communicative than before, good luck with val.town.
329.
by dakolli 6mo ago
That's a good question, I was having a hard time figuring that out myself. They call themselves the "zapier" for developers. In reality it seems kinda like a FaaS but idk. They have a code intelligence product that seems like
330.
by dakolli 6mo ago
The homepage of val.town says "Zapier for know-code engineers".. Is KNOW -code engineer a term?

More ›