why_only_15

4 ms·

1.
by why_only_15 5d ago
yeah there's some KV cache offload
2.
by why_only_15 5d ago
This is just wrong unless you're using some confusing definition. Notice that companies trying to do lots of inference aren't looking for CPUs, they're looking for GPUs/TPUs.
3.
by why_only_15 8d ago
CPU DRAM can't really be used for inference efficiently -- inference mostly wants memory bandwidth, not memory capacity, and GPU DRAM has >10x more bandwidth. The fabs can switch between them but you can't switch after the fact
4.
Show HN: Helping agents break out of their sandboxes in a monitorable way(sparrowsystems.co)
1 points by why_only_15 10d ago|0 comments
5.
by why_only_15 11d ago
They have various benchmarks, e.g. how much time it takes them to do wikipedia page -> page games. Jev seems to take the same or fewer hops but in ~10x less time and for ~10x less money. It's totally reasonable to compare against LL
6.
Show HN: What people watched on Netflix since 2023(girl.surgery)
1 points by why_only_15 2mo ago|0 comments
7.
by why_only_15 2mo ago
To what degree can you say something like "if the kernel doesn't have metaprogramming [or some other set of features] it's fine". When were the last bugs with a reduced feature set?
8.
by why_only_15 2mo ago
The whole point is that these are security bugs that didn't necessarily bother people so far but could be exploited
9.
by why_only_15 2mo ago
I really don't like this. Don't post your AI-generated articles here. https://www.pangram.com/history/fce67fb4-4f6a-4eb4-a323-5048...
10.
by why_only_15 2mo ago
The correct comparison is not sonnet, but qwen3.5-27b on a cloud. Alibaba's pricing [0] is $0.20/m input $1.56/m output, so $0.72 for the prompt processing or $0.22 for the generation. Yours is still cheaper but the margins a
11.
by why_only_15 2mo ago
Why is the post AI-generated? If you're going to make something for us to read you pay us the courtesy of actually writing it first. https://www.pangram.com/history/61fbc90e-180d-4d91-a85d-16ff...
12.
by why_only_15 2mo ago
The post itself is totally AI-generated. It has tons of tells, in addition to Pangram saying so. https://www.pangram.com/history/61fbc90e-180d-4d91-a85d-16ff...
13.
by why_only_15 4mo ago
why do you think so? they provide some evidence of this in the article, but there have been several improvements in e.g. nanogpt-speedrun or openai parameter golf made by AIs
14.
by why_only_15 4mo ago
Does China subsidize housing construction? Is your claim something like "China encourages/forces consumers to save at high rates which lowers interest rates and makes there be more construction"?
15.
by why_only_15 4mo ago
what's the origin of your $20k/vuln estimate?
16.
by why_only_15 5mo ago
The formal Ottoman name was Kostantiniyye=Constantinople until the empire's fall in 1922. The official shift happened in 1930, with the Turkish Postal Services Law changing the name to Istanbul.
17.
by why_only_15 6mo ago
This is a quite old technique. The idea, as I understood it, was that lots of data at Google was stored in triplicate for reliability purposes. Instead of fetching one, you fetched all three and then took the one that arrived first. Then yo
18.
by why_only_15 6mo ago
I am in this world, but am not familiar with this specifically. My guess is that they found a bug with their implementation of the model using the weights Google released. These bugs are often difficult to track down because the only indica
19.
by why_only_15 6mo ago
The point is that if DoD's supply chain restriction does what Hegseth seems to want, all contractors involved with Anthropic would have to divest. That includes Amazon and Google, who are both DoD contractors who provide massive quan
20.
by why_only_15 6mo ago
This is not really possible. My guess is that the government is not willing to spend the necessary quantity of money to get e.g. Amazon or Google to divest of Anthropic and stop providing them computing resources.
21.
by why_only_15 6mo ago
The point of the supply chain risk designation was not just to have the DoD stop using Anthropic (they could have done that by just cancelling the contract). Their intended effect was to force every company that sells to the US government,
22.
by why_only_15 7mo ago
if your bucket name is ever exposed and you later delete it, then this doesn't help you.
23.
by why_only_15 7mo ago
Why did you post an AI generated article (against HN rules)? https://www.pangram.com/history/0943da35-d51a-4d81-8207-fae7...
24.
by why_only_15 7mo ago
This seems like a really poorly thought out article. You should take more care on making sure your understanding is correct before publishing in the future. Taking the Amazon example in Part 2: For e-books (simpler), Amazon gets 30% for run
25.
by why_only_15 7mo ago
Very cool stuff! Thank you for making.
26.
by why_only_15 7mo ago
I think Cosmo's refutations were mostly not very useful and based on misunderstandings of what I was trying to say. This is fine and we discussed it prior to their article being published. The point I was trying to make with "RL i
27.
by why_only_15 7mo ago
The chess people seemed to think my article was reasonably accurate. But I'm not really sure.
28.
by why_only_15 10mo ago
Hawaii did do geothermal, but in fact it's so geothermically active their main geothermal plant went offline for a while because lava got shot up their boreholes https://en.wikipedia.org/wiki/Puna_Geothermal_Ventur
29.
by why_only_15 10mo ago
Iceland is a tiny country with unusual amounts of energy. Not all renewable sources are the same -- hydropower is fairly reliable too, for example -- but Iceland is just not a useful example for the whole world. The largest geothermal plant
30.
by why_only_15 11mo ago
I'm not really sure but my recollection from talking to them in 2019 was that it was quite difficult to get features shipped because of e.g. hacking risk.

More ›