pants2

8 ms·

151.
by pants2 6mo ago
This might be even more limited though. They can't physically fit a large model on a single chip.
152.
by pants2 6mo ago
Ah good point, this is using Q4, benchmarked total throughout serving with Llama.cpp.
153.
by pants2 6mo ago
Interesting token numbers they're using, because I've benchmarked it at 69 tok/s single steam and 130 multi stream.
154.
by pants2 6mo ago
Yeah, only way to get there is assuming they're not giving prompt caching discounts while my laptop is getting prompt caching benefits, with very many large prompts. So yes I am skeptical of their numbers.
155.
by pants2 6mo ago
Or saved heating costs in the winter!
156.
by pants2 6mo ago
You might not even know it as a user but the payment/distribution here is all built on crypto+stablecoins. This is a great use case for it.
157.
by pants2 6mo ago
Cool idea. Just some back-of-the-envelope math here (not trusting what's on their site): My M5 Pro can generate 130 tok/s (4 streams) on Gemma 4 26B. Darkbloom's pricing is $0.20 per Mtok output. That's about $2.24/
158.
by pants2 6mo ago
Nearly all social media sites are better accessed through Brave browser on mobile, where there are no ads (including Instagram) and the experience is less optimized therefore less addicting.
159.
by pants2 6mo ago
Apple only banned they app because they didn't get a 30% cut of the stolen crypto
160.
by pants2 6mo ago
I wonder what new laws of physics AI models have discovered encoded opaquely in their weights, yet to be discovered by physicists
161.
by pants2 6mo ago
Clearly they have a weekly automation to take the backlog of feature requests and build a new feature!
162.
by pants2 6mo ago
Grading systems in school are and have always been broken, ChatGPT is only making these issues more apparent. Students are great "reward hackers" and are incentivized to find the most efficient solution to getting good grades rega
163.
by pants2 6mo ago
I partially agree, but current monetary fines were set when enforcement was very manual and often lenient. Technically, in California, even speeding 1 MPH above the speed limit can land you a $234 fine. If we had perfect AI systems that fin
164.
by pants2 6mo ago
This is my experience as well. I remember one day completely zoning out and writing pages of drivel "defining what it means to be a X" or whatever. Got an A+. After that I realized professors didn't care about my original tho
165.
by pants2 6mo ago
I really think that software in general is getting buggier, with ChatGPT/Claude being some of the buggiest software I use. I constantly run into quality issues there and I've reported at least a dozen bugs to ChatGPT this year. On
166.
by pants2 6mo ago
One interesting note is the plugins were acquired on Flippa, which is a general marketplace to buy/sell software businesses, not limited to WP plugins. What I worry about are the long tail of indie apps/extensions/plugins tha
167.
by pants2 6mo ago
This Veritasium video is excellent, and makes the argument that there is something intrinsic in mathematics (game theory) that encourages prosocial behavior. https://www.youtube.com/watch?v=mScpHTIi-kM
168.
by pants2 6mo ago
Sorry but this website screams AI slop to me. Very sparse, lots of cards and random icons and rounded corners, looks like a few messages in to a Claude code session
169.
Ask HN: Has anyone reconsidered Antivirus software after recent security news?
6 points by pants2 6mo ago|7 comments
170.
by pants2 6mo ago
"Dear Grandma, Sorry to hear about your friend. It might cheer you up knowing that YouTube TV has over 450 channels and is currently offering two months free to be subscribers!"
171.
by pants2 6mo ago
When I find problems at that AI does a bad job at, I take note, and those are exactly the kind of problems I give in a take-home assignment + interview. If the candidate turns in AI slop and doesn't understand the fundamentals of what
172.
by pants2 6mo ago
Presumably because it takes 6 months to distill Claude - but if they keep it closed like they are doing with Mythos it may take significantly longer.
173.
by pants2 6mo ago
I do think you're right, custom software is now more viable for small companies, you'll see a lot of them hiring a SWE or two to build out custom tooling whereas before it didn't make financial sense since it needed a whole t
174.
by pants2 6mo ago
Hi @frasermarlow, this is a nice start! Of course the water here is land which is an issue, but I think it's fun. I think the brown color of the map made it all desert when it should probably be more New Zealand - like. Might not be su
175.
by pants2 6mo ago
Very good point on the roll-back. However in terms of the hack, Bitcoin is slow - most exchanges require a few confirmations so it's 30+ minutes to land a deposit in Coinbase/Binance at minimum, and a transfer that huge would inst
176.
by pants2 6mo ago
Would love just for fun to feed this through an image generator to make it look like satellite imagery or maybe even Google Maps.
177.
by pants2 6mo ago
The Bitcoin “value overflow incident” on August 15, 2010 is probably the closest thing and that didn't affect the price much (though one BTC was around 8c at the time)
178.
by pants2 6mo ago
Microstrategy is already pushing/funding quantum resilience for Bitcoin, so yes!
179.
by pants2 6mo ago
Murmur BS aside - holy shit, they had to abandon two C-130 class planes because they got stuck in the mud? And lost an A-10 Warthog on top of the original F-15? This looks like a massive fuckup!
180.
by pants2 6mo ago
It would certainly be good news for cybersecurity employment!

More ›