AaronFriel

12 ms·

91.
by AaronFriel 3y ago
That's true for conventional fine-tuning, but is it the case for parameter efficient fine tuning and qLORA? My understanding is that for a N billion parameter model, fine tuning can occur with a slightly-less-than-N gigabyte of VRAM G
92.
by AaronFriel 3y ago
Do you have an empirical basis for that? I'm curious because on one hand, Bun is advertising they are solving a major challenge for library authors, really betting quite heavily on that being persuasive for adoption. The risk for Bun&#
93.
by AaronFriel 3y ago
How common are packages with no imports, exports, requires, or "module.exports="? I imagine that's quite rare, because such a package would only be imported or required for its side effects; and because that package cannot im
94.
by AaronFriel 3y ago
I hope this is only a slight tangent; since the authors talk about their model serving throughput and I hope I can get a gut-check on my understanding of the state-of-the-art of model serving. The success of ChatGPT and my current work has
95.
by AaronFriel 3y ago
> Pulumi is true open source, uses the Apache 2.0 license, and does not and never will depend on BSL-licensed software in any way, HashiCorp owned or otherwise. https://www.pulumi.com/blog/pulumi-hearts-opensource&#x
96.
by AaronFriel 3y ago
Hey, Pulumi engineer here. The engine doesn't compile to a declarative template. It's a common misconception, however because the user's program runs concurrently with the Pulumi engine, fully dynamic resource graphs are poss
97.
by AaronFriel 3y ago
This is essentially folk wisdom - but I think you can trust the other people in this thread that it's accurate. I doubt anyone has done a scientific study on this, but you could see this for yourself by setting your computer's clo
98.
by AaronFriel 3y ago
I think this is an advantage of Pulumi, here are two use cases: 1. Creating a resource where created is not the same as ready. This is extraordinarily common with compute resources (a virtual machine, a container, an HTTP server, a process)
99.
by AaronFriel 3y ago
Pulumi has a few languages other than YAML and Pulumi is declarative[1], and the programs you write are only as complex as you want them to be. This python program declares an S3 bucket and declares ten objects to exist in it. from pu
100.
by AaronFriel 3y ago
And yet, college is still worth it. While many folks like to point out the Baumol effect aka cost disease, it's also important to remember that college is overwhelmingly worth it, and the government ought to subsidize college educati
101.
by AaronFriel 3y ago
When I was writing a Haskell client library for Hyperdex, another distributed kv store, I found it incredibly helpful to implement a simulator for correctness. This helped me identify which behavior was unspecified (arithmetic overflow: sho
102.
by AaronFriel 3y ago
Is the state not reimbursing/covering these costs related to their lawsuit? I can't imagine anyone would ever be an expert witness if they had to bear all costs either party or the judge imposes on them.
103.
by AaronFriel 3y ago
I think alignment is poorly defined. Aligned to whose philosophy ? Name two human beings who are aligned and always act in each other's best interest in history, and I'll buy your bridge.
104.
by AaronFriel 3y ago
It's unclear if narrow AI is as powerful as multimodal models with tools, as of yet. Is an LLM which has access to narrow AI "tools" strictly more powerful, capable of running experiments or improving itself? See: AutoGPT, La
105.
by AaronFriel 3y ago
I'm reminded of the sci-fi author Peter F. Hamilton's Commonwealth Saga. In it, in order to perform the increasingly complex problem of creating and maintaining stable wormholes, humanity builds increasingly intelligent machines u
106.
by AaronFriel 3y ago
Ah, that's much better than the thread had me believe! Kudos to the security folks at Google.
107.
by AaronFriel 3y ago
I don't think the average user would understand what "unlocked bootloader" means, and may even mistake it for a feature or enhancement. It is a supply chain risk. The Android & Pixel teams walk a fine line here: they risk
108.
by AaronFriel 3y ago
I've followed a different path, but I've come to the same conclusion. Along my path, picking up languages like Haskell or Node early on meant using Linux. So since high school I've always had _a_ Linux machine available, but
109.
by AaronFriel 3y ago
NVidia acquired Mellanox in 2019 in order to own the interconnect - exactly the custom hardware/software stack you thought needed.
110.
by AaronFriel 3y ago
As I understand it, it's also the CPU manufacturers, motherboard suppliers, and system integrators. Intel and AMD are not consistently supporting S3, and some motherboards (iirc) toggle it off even when the chip purports to support it.
111.
by AaronFriel 3y ago
The performance report doesn't describe the loss approached by each of these fine tunings, but I wonder if the number of tokens in the instruction dataset was just not nearly long enough to produce high quality output. I can't thi
112.
by AaronFriel 3y ago
Pulumian here - this is something I'm working on and hopefully we'll have more to share soon. We're in a good position here in that our providers have rich schemas: https://raw.githubusercontent.com/pulumi&#x2
113.
by AaronFriel 4y ago
Why do you believe that?
114.
by AaronFriel 4y ago
What prior do you have to think a particular city is exceptional, such as in the types of crime? I often hear claims like this, such as about catalytic converter theft, and I think: that happens back home in Midwest, rural Iowa. Des Moines,
115.
by AaronFriel 4y ago
Not exactly, it's a little more nuanced than that. I've done demos using our EKS provider to spin up a cluster, outputting a kubeconfig property and plumbing that into a Kubernetes provider to deploy a Helm chart to the cluster. I
116.
by AaronFriel 4y ago
Pulumi does not generate a declarative manifest, your infrastructure program runs at the same time as the engine which applies resource operations. This allows you to use API calls, sleeps, and so on. It's a much more powerful model, a
117.
by AaronFriel 4y ago
I suspect the fatal error OpenAI saw was an "SSL error: decryption failed or bad mac"? Or if SSL were disabled, they likely would see the sort of parsing error vaguely described as an "unrecoverable server error" due to
118.
by AaronFriel 4y ago
Duplicate? https://news.ycombinator.com/item?id=34985793
119.
by AaronFriel 4y ago
You're right. One is a necessary tool for the most skilled actors to use against their greatest threats; the other is merely another vector for exploiting trusted computing primitives.
120.
by AaronFriel 4y ago
Amusingly, this exploit titled BlackLotus priced at $5,000 is cheaper than its likely namesake, the Magic: the Gathering card Black Lotus. The cheapest Black Lotus cards are around $10k[1], an artist proof, signed Black Lotus may be worth a

More ›