rfw300

8 ms·

91.
by rfw300 2y ago
Yes. “Superalignment” (admittedly a corny term) refers to the specific case of aligning AI systems that are more intelligent than human beings. Alignment is an umbrella term which can also refer to basic work like fine-tuning an LLM to foll
92.
by rfw300 2y ago
I think this misses the mark. The ad is inherently symbolic—it’s not this particular piano, but the fact that they’re destroying all of these beloved instruments of creativity in such a gratuitous and evocative manner. That’s what upsetting
93.
by rfw300 2y ago
Yes, compute-optimal for training only. The purpose of the paper wasn’t to determine the most economically practical model one could build, the most “intelligent” model one could build given some amount of compute.
94.
by rfw300 3y ago
I’ve been using the Claude 3 API since the models were announced. I believe it’s generally available (though capacity constrained & rate limited at present).
95.
by rfw300 3y ago
A caveat: my impression of Phi-2, based on my own use and others’ experiences online, is that these benchmarks do not remotely resemble reality. The model is a paper tiger that is unable to perform almost any real-world task because it’s be
96.
by rfw300 3y ago
I think if you’re looking for a logical answer from first principles, you won’t find one. It’s more that the legal system runs on precedent, and a book fits far more squarely in the fact patterns of previous First Amendment cases. Likely th
97.
by rfw300 3y ago
That’s fair, but TypeScript coupled with modern JS dev tooling makes it actually a pretty palatable experience these days. Speaking as someone who used to want to jump into pits for JavaScript-related reasons.
98.
by rfw300 3y ago
Delaware corporations cannot transition to a dual-class stock structure post-IPO.
99.
by rfw300 3y ago
The paper refers to ChatGPT as a 175B parameter LLM. This is almost certainly incorrect; the original largest version of GPT-3 was 175B but analysis of the speed and cost of the current model as well as public statements by OpenAI indicate
100.
by rfw300 3y ago
I recently purchased a 3090 on Reddit’s hardwareswap community for $550. New GPUs are pricey right now because of shortages, but if you look around a bit it can be affordable.
101.
by rfw300 3y ago
I also thought that seems implausibly large. My guess, based on some quick research, is that a large fraction of that is procedurally generated, not human-written. Here's one example: > Formal verification tools allow those teams to
102.
by rfw300 3y ago
If you read the complaint, it explains this pretty well. The use of copyrighted content by search engines is fundamentally different from the way LLMs use that same content. The former directs traffic (and therefore $$) to the publisher, th
103.
by rfw300 3y ago
That seems like a pretty remarkable pace of innovation, no?
104.
by rfw300 3y ago
As the paper notes, two of the authors are from DeepMind, the chemicals they are synthesizing are those predicted to be stable by a DeepMind model, and the entire work arises out of an extensive collaboration between DeepMind and the Berkel
105.
by rfw300 3y ago
The main thing is chat is just one application of LLMs. Other applications are much more latency sensitive. Imagine, for instance, an LLM-powered realtime grammar checker in an editor.
106.
by rfw300 3y ago
Ironic, considering the United States literally purchased Florida from Spain.
107.
by rfw300 3y ago
Computers aren’t humans. There’s no reason licenses should treat them the same way when completely different considerations of fairness and economic impact apply.
108.
by rfw300 3y ago
This is incorrect as of last year: https://en.wikipedia.org/wiki/Carson_v._Makin There is a powerful political and legal movement behind the idea that state-funded religious indoctrination is not only permitted, but re
109.
by rfw300 3y ago
I don’t think anyone is saying it’s causation, the correlation is in and of itself interesting!
110.
by rfw300 3y ago
That’s because you’re a human. Copyright and fair use law was built for people, and letting AI models have the same privileges will lead to worse outcomes. What’s so wrong about saying that it isn’t fair use for a machine to learn from your
111.
by rfw300 4y ago
The article seems premised on a misunderstanding that OpenAI is a research lab. For all intents and purposes, it’s a for-profit subsidiary of Microsoft, and there’s little financial incentive for it to maintain old models for others’ benefi
112.
by rfw300 4y ago
I think the issue with the “AI doing X better than most people is an indictment of the people or the way we teach them” genre of takes is that it assumes the current state of AI progress will hold. Today, it writes at a college freshman lev
113.
by rfw300 4y ago
In fact there is an environment variable that enables exactly that. There are obviously performance issues associated with that, but it does work.
114.
by rfw300 4y ago
And the implied prediction was also dead wrong. So perhaps people should update their priors.
115.
by rfw300 4y ago
It is very important to note that in the state of New York, the trial court (the lowest level court) is called the Supreme Court. So while this ruling is notable, it is not the state’s highest court ruling on the matter. This ruling will
116.
by rfw300 4y ago
And the desktop application is itself missing a bunch of features from the mobile app!
117.
by rfw300 4y ago
I think the point is that Facebook's contribution to society (with its actual product, not its tech work) has been negative; its goal is to turn every knob it can find to get people to spend more time on Facebook, not actually solve an
118.
by rfw300 4y ago
It’s worth noting many of these regulations came into existence (or became stringently enforced) because of 2008.
119.
by rfw300 4y ago
Exactly this. The Platonic ideal of statutory interpretation is the “no vehicles in the park” statute. It’s simple enough on the surface but you can think of an infinite number of edge cases that demand nuance (e.g. Scooters? A war memorial
120.
by rfw300 5y ago
> Sorry, but it's dross! It's the kind of work the guy in the art shop up the road churns out, and sells to the ignorant locals in my town. I want to chime in that I think this is not only technologically impressive, but also s

More ›