ozr

8 ms·

31.
by ozr 2y ago
RAG and fine-tuning are very different. Few-shot prompting and RAG are both variants of in-context learning.
32.
by ozr 2y ago
I’ve taught LLMs imaginary words and their meanings with minute amounts of data (two or three examples) via full fine-tuning, LoRA and QLoRA. I have no idea where the myth of ‘can’t add new knowledge via fine-tuning’ came from. It’s a stic
33.
by ozr 2y ago
> the more Shotwell is running things, the more optimistic I am about SpaceX’s future. Her age is relevant when discussing the future of SpaceX, considering the median retirement age.
34.
by ozr 2y ago
She's 60 years old now.
35.
by ozr 2y ago
The awesome-X lists seem like a community attempt to do something similar.
36.
by ozr 2y ago
He's obviously not closing Jira tickets at Meta, but that doesn't mean he's not an engineer. As an example of the positive impact that the Llama releases have had, this post from him has been doing the rounds lately in respo
37.
by ozr 2y ago
If your product is an AI model (OpenAI, Anthropic, etc) you can't give it away for free. If your product is a social graph w/ ads (Meta), you can. It's hardly corporate charity: * Meta releasing these models creates an improv
38.
by ozr 3y ago
For a k/v store, a hash table will take you very, very far.
39.
by ozr 3y ago
You aren't required to purchase a home or drive a car. If you chose to, as most Americans do, then yes: the demand is inelastic. But that doesn't imply what you're saying unless the supplier has monopoly power, which they, b
40.
by ozr 3y ago
Insurance carriers have an incentive to compete on price like any other business. There are plenty of options. The margins are generally pretty small, and there is a lot of regulation around what portion of payments must be used for cla
41.
by ozr 3y ago
This is not correct. Fine-tuning can absolutely add new knowledge to a model. It's been repeatedly demonstrated at this point. LIMA demonstrated that instruction-tuning and output formatting could be trained with a limited number of
42.
by ozr 3y ago
Cartel is maybe overly pejorative, but it's definitely based on relationships. Postmasters at large ESPs and inbox providers can and will text each other to resolve issues. This is pretty much how the internet works as well (BGP, etc).
43.
by ozr 3y ago
I've been on large and small teams of people that cared and didn't care. It feels noble and reasonable and right to tie it to a greater purpose; like your soup kitchen vs supermarket example. It's not that type of care the
44.
by ozr 3y ago
In context, he's not describing a compromise, he's talking about a 'wrecking amendment'. Adding something absurd to a bill. The difference is that the person adding the amendment doesn't actually want or expect th
45.
by ozr 3y ago
> I don't see how you're expecting things to work differently. Would we expect Democrat-sponsored legislation to fail for reasons apart from Republican opposition? There is a popular perception that: - If Democrats are in the m
46.
by ozr 3y ago
The founder ('Beff Jezos') has a large twitter presence.
47.
by ozr 3y ago
As someone that has had those titles for many years in the past: I'm only going to object to the one that's paying less at the time. A good sysadmin was always doing the same thing as a good SRE.
48.
by ozr 3y ago
> Traffic within a data center is relatively cheap, is it not? Complexity is very, very expensive.
49.
by ozr 3y ago
I'm less concerned than the OP. It seems like they are using the revenue from search to fund other endeavors. Same model as Google, fundamentally.
50.
by ozr 3y ago
> I also found it weird that the author thought being an EM is a good path to being an entrepreneur. This was the pitch from my manager that led to me moving into an EM role. He knew I was interested in doing a startup in the future, bu
51.
by ozr 3y ago
I'm an engineer with a passing interest in the law. I've frequently had to explain to otherwise smart and capable people that their one weird trick will just get them a contempt charge.
52.
by ozr 3y ago
Salary is one part of comp, which is one part of what makes a company attractive. There are plenty of levers to pull that are not salary, and not based on geography.
53.
by ozr 3y ago
> You can try to pay everyone according to the highest possible local salary you might compete against, but now you're arbitrarily paying more than you need to everywhere else. This is the difference. I don't see it as arbitra
54.
by ozr 3y ago
The (good) companies I've been at are location agnostic on pay, or close to it. It's not about getting a discount, it's about expanding the talent pool. We want the best we can get, not the best within 25 miles of a hub.
55.
by ozr 3y ago
Definitely lucrative enough. The use case you've described isn't particularly uncommon, but lots of companies just pay for the egress. The problem is that there are now multiple generations of software engineers that do not know
56.
by ozr 3y ago
This is why you'd 'charge up' some prepaid store.
57.
by ozr 3y ago
For you and me, yeah the training is useless. For someone actually naive enough to pick up gift cards for the 'CEO'? It could help.
58.
by ozr 3y ago
It's a sophisticated attack for sure, but the data collection really isn't too difficult now. A minute or two of audio is sufficient for voice, and a single good image.
59.
by ozr 3y ago
The bit of code at the center of an operating system that mediates access between userspace code and the hardware. Whereas in CUDA programming, a kernel is just the code running on the device. When I first heard kernel in relation to CUDA
60.
by ozr 3y ago
I agree, but the push for 'AI Safety' as a whole is driven by the x-risk crowd. There are a few people genuinely concerned, however misguidedly, about the outputs of LLMs. The big money coming into the field from EAs and the sort

More ›