airspresso

3 ms·

1.
by airspresso 6d ago
We are certainly not in the diminishing returns phase for LLM progress. No sign of that yet.
2.
by airspresso 6d ago
No, those use LPDDR5(x), not HBM.
3.
by airspresso 11d ago
From what I'm seeing elsewhere, context size up to 128k should be possible on this hardware. It really matters for agentic workloads to push that context size headroom up. Anthropic are spoiling us with models that do 500k context and
4.
by airspresso 23d ago
I'm with you on this, the knowledge sharing on YT is massive and in general not replicated in written form anywhere else. Anything that needs fixing involves a YT search for me these days, since that has the highest chance of turning u
5.
by airspresso 23d ago
Clicked the links just to see preview screenshots, that is hilarious with all the cows XD
6.
by airspresso 26d ago
It gave the card an aura of mystique (pun intended) and I remember really wanting it. I guess that means they succeeded in making a statement with it.
7.
by airspresso 1mo ago
Nvidia is also pushing for local inference IMHO. They want open models and competition in the model layer, not two big labs controlling all of it.
8.
by airspresso 1mo ago
This depends heavily on what the use-case is. Yes, if it's a coder making software and having to read LLM output then writing style matters. If the LLM is used in an automated data processing pipeline with a capped level of complexity,
9.
by airspresso 1mo ago
By leveraging the experience Broadcom has in this area. Still remains to be seen how that goes when they want to scale production.
10.
by airspresso 1mo ago
Most of the generative art is hosted on IPFS.
11.
by airspresso 1mo ago
Wait, it's allowed again? Completely missed that. Been avoiding to use it and trying to find workarounds, not great.
12.
by airspresso 1mo ago
The Cerebras hardware is not locked to specific models / model families. Taalas is the company that's etching models into their silicon, locking it to that model forever.
13.
by airspresso 1mo ago
Agree. My team standardized on black in our Python CI/CD pipeline and precommit hooks and it was surprising how much time we reclaimed from not having to review coding style and discuss patterns. The compromise was to apply black and n
14.
by airspresso 2mo ago
My default assumption (with no knowledge about this particular case) is that all gear in YouTube videos is sponsored. Too easy to get jealous of all the fancy setups. But I don't want to become a YouTuber so that settles that.
15.
by airspresso 3mo ago
OpenAI's upcoming mega IPO
16.
by airspresso 4mo ago
> Time for me to go research the early history of electrification. The Stepchange podcast has an amazing episode on The Grid [1], walking us through the arc of history of how it became the utility it is today. [1]: https://www
17.
by airspresso 5mo ago
> posting this sentence was part of the deal to get the compute This 100%
18.
by airspresso 5mo ago
> but given that you can actually run the models yourself on AWS Bedrock That's not exactly how it works. Anthropic are hosting their models in AWS Bedrock as a managed service. Customers call those LLMs just like calling any other
19.
by airspresso 5mo ago
Fun that it has oscillated from instant boot then to minutes-long boot a decade later back to instant boot (or resume to be fair) today.
20.
by airspresso 5mo ago
I had the same confusion and closed the tab, only to discover here on HN that there's more. Open by default sounds reasonable.
21.
by airspresso 6mo ago
There is a surprising amount of code needed in each of the inference frameworks (LM Studio, llama.cpp, etc) to support each new model release. For example to format the input in the right way using a chat template, to parse the output prope
22.
by airspresso 6mo ago
I think we lost that terminology war. Open source models mean open weight. There are only a couple examples of fully open source models with open data and code, and the labs are not incentivized to go that far.
23.
by airspresso 6mo ago
That's a good point. Charging stations benefit from being a service station too though, with amenities and a cafe etc, since people want something to do while they charge. So a gas station is a better candidate than a parking lot when
24.
by airspresso 6mo ago
Yes, retooling gas stations is the way to go. Already happening in Norway where stations now show the price of kWh in addition to gas and diesel prominently on signs by the road. Charging is just a different kind of pump.
25.
by airspresso 6mo ago
America certainly did not invent electric cars. Depending on which electric car you consider the first real one, the inventor was either French, British or German [1]. [1]: https://en.wikipedia.org/wiki/History_of_the_e
26.
by airspresso 6mo ago
Unsloth is providing the best and most reliable libraries for finetuning LLMs. We've used it for production use-cases where I work, definitely solid.
27.
by airspresso 7mo ago
Also wrestling with this challenge at the moment and curious to hear experiences from others. Even though it requires human input, the capture and the way it's updated has to get automated.
28.
by airspresso 8mo ago
Spend time building a test harness and evaluations of whether the solution meets the requirements. Then you don't need to look at the code because those other pieces will bring the necessary guarantees and trust.
29.
by airspresso 8mo ago
Because we all prefer it over Gemini and Codex. Anthropic knows that and needs to get as much out of it as possible while they can. Not saying the others will catch up soon. But at some point other models will be as capable as Opus and Sonn
30.
by airspresso 8mo ago
Still do. Great for workloads where it's okay to bundle a bunch of requests and wait some hours (up to 24h, usually done faster) for all of them to complete.

More ›