jrflo

6 ms·

121.
by jrflo 2mo ago
Do you really need a KV cache if inference is that fast though?
122.
by jrflo 2mo ago
Not a security guy but my understanding is: you only need to find one flaw to exploit a system, to make a system totally secure you need to find them all. It's inherently easier to use these tools offensively rather than defensively.
123.
by jrflo 2mo ago
https://spectrum.ieee.org/orbital-data-centers-heat This analysis calculates 80 square meters of radiator surface area needed per rack, or 200,000 square meters per 100 MW. It's not to say it can't be done, I thin
124.
by jrflo 2mo ago
This is a nothingburger article, 23,000 jobs lost is essentially flat.
125.
by jrflo 2mo ago
The Fed is not going to cut rates. Looking at Fed Rate futures they only predict increases: https://www.cmegroup.com/markets/interest-rates/cme-fedwatch...
126.
by jrflo 2mo ago
> Cost of compute on Earth Power build Permitting Operating costs Land Energy costs Infrastructure Cooling > Cost of compute in space Launch cost Operating costs Satellite build Infra
127.
by jrflo 2mo ago
Thank you for this, I'm going to just accept this theory and close the thread because it makes me so upset, lol
128.
by jrflo 2mo ago
You clearly haven't spent much time around young adults. I work with college students a fair amount and they use chatbots for 100% of their questions, including the ones you listed. And much like google got a rich data trove from user&
129.
by jrflo 2mo ago
Their entire business is predicated on search dominance, which is now on much shakier footing. Agreed that those comments were ridiculous pre-ChatGPT, but now they have a genuine challenger.
130.
by jrflo 2mo ago
Realistically it's "too much 'environmental' review", aka NIMBYs killing any project that will actually implement good public transit because it will ruin the view from their kitchen
131.
by jrflo 2mo ago
Totally agreed. Capitalism is just a game of competition, and if you want to win the game you should take all advantages that you have. Pretty much everyone else you're competing against will be doing the same. I know a guy who worked
132.
by jrflo 2mo ago
I think we previously assumed that AGI would need to come before superintelligence, but it kind of seems like that's wrong? Super intelligence in a narrow field has arguably already arrived (solving problems that were previously unsolv
133.
by jrflo 2mo ago
I think that HN is particularly negative towards AI because the vast majority of users here will have their prestigious CS careers disrupted by AI advances. So, there's an inherent negative bias towards this news. I for one am really f
134.
by jrflo 2mo ago
The local LLM argument never really held water tbh. You can get surprisingly good performance for lightweight tasks locally, but you're just fighting economies of scale if you're going trying to beat a datacenter on cost.
135.
by jrflo 2mo ago
It's marketing hyperbole, but Luna is more intelligent per dollar than deepseek-v4 pro. Cost means nothing without the associated capability
136.
by jrflo 2mo ago
Very interesting. Can you share more about your hypothesis/research pipeline? I have been using Sol for those types of task because I figured you'd need more reasoning for getting good ideas, but maybe quantity > quality at a c
137.
by jrflo 2mo ago
Burning the weights into silicon would be many orders of magnitude increase, not just 10x. It's kind of crazy that this hockey stick the AI hype bros talk about seems more and more every day like it might be real
138.
by jrflo 2mo ago
I agree. I think part of the problem is how recommendation algorithms have conditioned people to act online. Recommendation algorithms optimize for overall platform engagement to increase revenue, which tends to reward anti-social behavior
139.
by jrflo 2mo ago
There will always be a need for on-demand power. Renewables are great, but cannot deal with peaks as easily and capacity is dependent on weather.
140.
by jrflo 2mo ago
Sure. "State" and "National" parks mean something different than most city or county parks, which tend to be more amenity focused.
141.
by jrflo 2mo ago
Looks like a nice park! Was a bit odd of a read to me because the vast majority of the parks in my part the US are like this (sports fields, playgrounds, lakes, open green space, bike paths, grills, pavilions, etc), didn't realize I ha
142.
by jrflo 2mo ago
> DeepMind then launched the AlphaFold Protein Structure Database, giving researchers free access to over 200 million protein structure predictions. Is this existing database enough for researchers?
143.
by jrflo 2mo ago
Definitely not. It was my first time using Sol Ultra, and I did not expect it to run for 12hr+ continuously. Previously with 5.5 I had to coax it to go for longer than a half hour, so I just started a run and forgot to check back in on it.
144.
by jrflo 2mo ago
I don't know, codex does not disclose that information, it just says "1.1B Tokens". OpenAI recently got rid of their 5-hour usage window, so you can burn the entire week in one go, which is what I did.
145.
by jrflo 3mo ago
That's not really that ridiculous. Looking at my ChatGPT stats my biggest day of token usage was 1B tokens (seeing how far Sol Ultra could go on a difficult problem with a quantitative goal and eval harness that it could run on it&#x27
146.
by jrflo 3mo ago
The author of the original paper did not include error bars on the cost and quality results, which is a bit alarming. They did include a +/-, but did not list explicitly if that means standard deviation, range, or 95% CI, etc. Another
147.
by jrflo 3mo ago
I feel like this just furthers my point. Over 100 years ago a court ruled that companies have to operate primarily for the benefit of their shareholders. That is the regime we have been operating in ever since. You may get some eccentric ca
148.
by jrflo 3mo ago
Because it used to be profitable for them to say that when the only people paying attention were a niche technical audience. Now, it's no longer profitable to do so. That's what it's always been about.
149.
by jrflo 3mo ago
I'm not referring to the sum feeling of all employees, I'm referring to the actions of the company as a whole, which is largely driven by the C-suite who have a financial responsibility to investors.
150.
by jrflo 3mo ago
No large company has ever cared about anything other than the financials, this is not specific to AI.

More ›