Eridrus

8 ms·

121.
by Eridrus 5mo ago
The Pelicans are mostly just entertainment.
122.
by Eridrus 5mo ago
Yeah, this is less of a benchmark and more "I like this one guys!". Just totally subjective grading criteria of a single poorly defined example with no end use case in mind to guide how to even do evaluation.
123.
by Eridrus 5mo ago
If your model doesn't actually show the tradeoff you're getting for speed, you're doing marketing and not benchmarking. Which is fine, we all have to make money, but it is disingenuous. It's just unfortunate that running
124.
by Eridrus 5mo ago
Nobody releases numbers that show them to be worse than competitors lol. This even applies to OpenAI & Anthropic who don't even eval on the same datasets a lot of the time.
125.
by Eridrus 5mo ago
We do win some deals on reliability, and have lost some, but AWS outages are not an important factor in any of this. It's not that I think reliability doesn't matter at all, but most of our services are not multi region and it&#x2
126.
by Eridrus 5mo ago
Yeah, this seems like a way overengineered solution. I moved to the US 15 years ago and it was too noisey for me to sleep well (fire trucks, cars, etc), but ear plugs solved the problem and are portable to other places you might need to sle
127.
by Eridrus 5mo ago
The LLMs are actually worse at generating Python than other langs, hypothesized due to quality of training data lol. I still read the generated code, so I'm not quite willing to give up on Python yet though.
128.
by Eridrus 5mo ago
90% of customers are located in use-1. Latency to use-1 is more important than being up when everyone else is down.
129.
by Eridrus 5mo ago
People say this, but this this was just a single AZ, and in the last 3 years of running my startup mostly out of use-1, and we've only had one regional outage, and even that was partial, with most instances uneffected. And honestly, ev
130.
by Eridrus 6mo ago
You can get the frontier models hosted in Stockholm & Ireland: https://docs.aws.amazon.com/bedrock/latest/userguide/model-c... There's probably a very good business to be made of bringing close to fr
131.
by Eridrus 6mo ago
I think they updated the article since you grabbed this line. Amazon CEO says that these models are coming to Bedrock though: https://x.com/ajassy/status/2048806022253609115
132.
by Eridrus 6mo ago
Biggest upside of this is I expect OpenAI models to be available on Bedrock, which is huge for not having to go back to all your customers with data protection agreements.
133.
by Eridrus 6mo ago
The injustice isn't that consumers were harmed (this is just the nature of public policy with both winners and losers), but that our legal system does not accept that tax incidence exists and is giving taxpayer funds to businesses for
134.
by Eridrus 6mo ago
I have no opinion on Affirm as a business, but going beyond the headline, this seems pretty unimpressive. "over 60% of our pull requests (PRs) are agent-assisted" is a pretty low bar these days. The off the shelf tools (Claude Cod
135.
by Eridrus 6mo ago
The actual incidence of tariffs is mostly on consumers, so giving remedies to businesses doesn't actually make any sense. I'm not surprised, but I think this is a miscarriage of justice.
136.
by Eridrus 6mo ago
It's unfortunate that the word performance is overloaded and ML folks have a specific definition..that isn't what the rest of CS uses, but I understand Anthropic to mean response quality when they say this and not any other dimens
137.
by Eridrus 6mo ago
Yes. Caching is a cost optimization not a response quality metric.
138.
by Eridrus 6mo ago
To be fair to Anthropic, they did not intentionally degrade performance. To take the opposite side, this is the quality of software you get atm when your org is all in on vibe coding everything.
139.
by Eridrus 6mo ago
As a person doing design, yes, you feel like you cannot let go. But as a person employing designers, I have already accepted that I will let go. We did a marketing website redesign for our b2b saas product with a 3rd party design firm, we g
140.
by Eridrus 6mo ago
The only real example I can think of being bootstrapped is Airbnb, and even that wasn't bootstrapped for long. Unless you have a good go to market strategy, you might want to try something easier. At the risk of being overly critical,
141.
by Eridrus 6mo ago
The article itself spells out several alternatives to buying continuous amounts of Helium: high temperature semiconductors and zero boil-off systems that don't require a continual supply. All these "we're going to run out&quo
142.
by Eridrus 7mo ago
The article is just helpfully illustrating how artisanal you can make your slop if you really try!
143.
by Eridrus 7mo ago
How are people building anything without evals? Maybe I spent too much time in the ML mines, but it is somewhat inconceivable to iterate on a tricky problem without a eval set.
144.
by Eridrus 7mo ago
Beyond this, you are what you do. And you are what you do for other people. Besides providing support and entertainment for our friends and families, the concrete things we do that bring value to society are through our jobs. Society doesn&
145.
by Eridrus 7mo ago
What's a typical example? I have been broadly quite happy with gpt 5.4 xhigh's reasoning on things like performance engineering tasks.
146.
by Eridrus 7mo ago
Cursor have said they are using Composer through their inference provider (Fireworks). Presumably the MIT is not viral like the GPL, so Cursor, and companies that use Cursor do not need to display Kimi attribution on their products. It&#x27
147.
by Eridrus 7mo ago
Right, but if these things are so rare that we all only know the one viral example, I feel like that lends credence to the models basically generally not having this problem. Researchers built the Winnograd Schema Challenge more than a deca
148.
by Eridrus 7mo ago
Unrelated to FSD, what's a good example where frontier AI struggles with logical thinking that even stupid humans can figure out? I personally feel like that isn't really true any more.
149.
by Eridrus 7mo ago
It's not horrifically slow.
150.
by Eridrus 7mo ago
I think plenty of software is a pile of shit and still derive value from it.

More ›