rco8786

15 ms·

301.
by rco8786 1y ago
Inference is cheap. Training is cheaper. Then where's all the money going? OpenAI is reporting heavy losses, but you're saying the unit economics of inference are all good. What are they spending money on?
302.
by rco8786 1y ago
AWS isn’t doing the training on those models.
303.
by rco8786 1y ago
Eh, it's exactly the Johnny Depp movie that would simplify this into "just flip the power switch". LLM code already runs on millions of servers and other devices, across thousands of racks, hundreds of data centers, distrib
304.
by rco8786 1y ago
But it's just like, math. The math is out there now. You can't shut down math.
305.
by rco8786 1y ago
Is it even possible to shut it down?
306.
by rco8786 1y ago
I try and lean on Sentry and error tracking for as long as possible. And I'm happy to see some competition (and a simpler looking option).
307.
by rco8786 1y ago
> Unless you can run the LLM locally, on a computer you own, you are now completely dependent on a remote centralized system to do your work. To be fair, the entire internet is basically this already.
308.
by rco8786 1y ago
Interesting. Presumably UK legalese would also differ significantly from US legalese
309.
by rco8786 1y ago
This feels like it's making it worse lol
310.
by rco8786 1y ago
Try seven figure.
311.
by rco8786 1y ago
Random fun fact. Whit Diffie is cousin to the late country music singer Joe Diffie. Their Wiki pages make no mention of this, though they do mention the other’s page in case users end up on the wrong one.
312.
by rco8786 1y ago
Yea I think we're saying the same thing
313.
by rco8786 1y ago
This looks pretty amazing. Congrats on the launch.
314.
by rco8786 1y ago
Yea that's a decent analogy. You see the incoming trades before they are actually executed, and you can react accordingly.
315.
by rco8786 1y ago
I didn't get the impression this was about competing on speed.
316.
by rco8786 1y ago
> The robot isn’t equivalent to the code in this analogy. It’s the thing that generates the code. I think this inversion is what a lot of people are missing, or just don't understand (because they don't understand what code is
317.
by rco8786 1y ago
> I think people's associations might be wrong then I don't disagree, just that when talking about any given subject having an understanding of how the audience already thinks about that subject is somewhat important. The bigge
318.
by rco8786 1y ago
What you’re describing is generally good coding practice. But not, I don’t think, what people associate with DI.
319.
by rco8786 1y ago
I wonder why the authors decided to make `flatten` only go one level deep, and have `flattenDeep` that goes N levels. AFAIK most other implementations of Array.flatten do it recursively through however many levels exist.
320.
by rco8786 1y ago
No, the logic would be that a football player's 40 time doesn't impress, because you want to see the on field performance. Or a movie trailer doesn't impress, because it's only meant to get you to watch the movie which m
321.
by rco8786 1y ago
It could be! But that's also what people said about all the models before it!
322.
by rco8786 1y ago
Why shouldn’t we judge a company’s capabilities against what their CEOs claim them to be capable of?
323.
by rco8786 1y ago
> why does every engineer keep talking about it like it’s more than marketing hype? because it is more than marketing hype. real people are taking real action based on this narrative. > why do you actually accept this is a real narrat
324.
by rco8786 1y ago
Satya says: "I’d say maybe 20%, 30% of the code that is inside of our repos today and some of our projects are probably all written by software". Zuckerberg says: "Our bet is sort of that in the next year probably … maybe hal
325.
by rco8786 1y ago
I’m curious why you think it hasn’t already been trained on 100ks or millions of PRs and their comments/feedback.
326.
by rco8786 1y ago
> its a lot cheaper than a junior I’m not even sure if this is true when considering training costs of the model. It takes a lot of junior engineer salaries to amortize the billions spent building this thing in the first place.
327.
by rco8786 1y ago
That's a weird comment. I do think for myself. I wasn't even talking about my own personal thoughts on the matter. I can just plainly see that the overwhelming narrative in the public zeitgeist is that AI can do jobs that humans c
328.
by rco8786 1y ago
I think people would be more likely to adopt this view if the overall narrative about AI is that it’s a work in progress and we expect it to get magnitudes better. But the narrative is that AI is already replacing human software engineers.
329.
by rco8786 1y ago
It seems unlikely that any one individual would be able to output a sufficient amount of context for that to not go off the rails really quickly (or just be extremely inefficient as most agents sit idle waiting for verification of their wor
330.
by rco8786 1y ago
Are those MS roles right? A "principal" engineer needs 6 YOE and makes $322k TC?

More ›