wrsh07

4 ms·

31.
by wrsh07 2mo ago
This is probably true in a smaller way for OpenAI When you have a lot of free users the business demands that you serve them with the best cheap model you can build And time spent building that may provide dividends (eg OpenAI has very good
32.
by wrsh07 2mo ago
It seems like they threw it a decently large battery of open math problems and probably limited it to something like $200-500 per problem: https://x.com/polynoamial/status/2083478171975082334 As a complete guess,
33.
by wrsh07 2mo ago
This is great! I would love an explicit "set bookmark to here" button if I scroll up from the high watermark I discovered the reset, but it took a minute and I expect given the way I read being able to explicitly walk the high wat
34.
by wrsh07 3mo ago
I have two strong reactions to pieces like this: First, this is about not just a job or career, but someone's identity. And we must have compassion that they are losing something that is fundamental to who they are. To them, it doesn&#
35.
by wrsh07 3mo ago
It's also much better to distribute the challenge of identifying problems amenable to which prompts Could they do it? Sure, but to what end? It would make more people hate them and feel even more "take our interesting work."
36.
by wrsh07 3mo ago
Note, in posts like the following, the author indicates they are able to get free subscriptions from OpenAI As an aside, there's this idea in math that when you create a new field you shouldn't solve all the easy problems - you ne
37.
by wrsh07 3mo ago
Can you say more about what happens for bucket assignment? Eg is it appending to a file or writing to a 2d array? Agreed on linear vs n log n, ofc, and streaming considerations might also be relevant
38.
by wrsh07 3mo ago
I'm somewhat curious about the initial problem: > Consider the following real problem, one of the steps in scikit-learn’s gradient histogram boosting algorithm: > You have a large array of floating point numbers. > You want to
39.
by wrsh07 3mo ago
Literally bullet 2: > 2. Use a compiled language to write a Python extension. It's fine to be grumpy about languages, but python is the de facto standard in many industries, and a lot of people don't get to choose. So, yes, ask
40.
by wrsh07 3mo ago
Of course! And I think it's fair to require people to be honest. I just fundamentally disagree with this line of thinking: > even a subscription is better than royalties Royalties are a great business model that allows more creators
41.
by wrsh07 3mo ago
I have often wondered how to make this clear wrt science communication Eg much is not known about dinosaurs. Many things cannot be found in fossils (obligatory xkcd: https://xkcd.com/1747/ ) How do you communicate what
42.
by wrsh07 3mo ago
Ok, then do that? The game you make will be limited by that choice. If those limitations are acceptable, then great! My contention is that people can build more ambitious games that are more likely to make their creators rich if they use Un
43.
by wrsh07 3mo ago
I think this is confused All of the people who I was reading and listening to and watching before AI are all still creating. Many of them are even creating new things or new types of things I imagine breaking into the creative industry is &
44.
by wrsh07 3mo ago
These examples don't really add up to me. You can continue to enjoy the books and articles etc They are just also used to create a new thing In the picnic example, the picnickers can't use the lawn anymore. As an aside: as somebod
45.
by wrsh07 3mo ago
You misunderstand the business model. Unreal is like venture capital or a book advance (or the equivalent in music record deal) Can you self publish? Sure, of course, have fun. But if you want the support and infrastructure of a company tha
46.
by wrsh07 3mo ago
The question is about counterfactuals If unreal cost money up front, would this have been built? No. Unreal is saying: hey, we contributed to 1/20th of your success, because you could not have done this without us. Thus, in the event t
47.
by wrsh07 3mo ago
A continue that let's you keep playing would be fun. Or maybe different modes (eg hard vs normal)
48.
by wrsh07 3mo ago
I think Zach Gage (developer of excellent games including Really Bad Chess, Spelltower, etc) says on Adam Conover's podcast that for many people they have difficulty improving at a skill when they have time (or other) pressure Thus, he
49.
by wrsh07 3mo ago
To be clear, some of the token expense is because it's encouraged, and it's encouraged at some companies so that people will break out of their existing workflows to hopefully find useful new ways of working or building There is m
50.
by wrsh07 3mo ago
Hey, this looks fascinating! I can't quickly tell what all you have archived^, but I have some friends who are academic historians who might be interested in certain categories of work (and could help verify some esoteric languages) -
51.
by wrsh07 3mo ago
Ah I wonder if there's confusion somewhere. My understanding is that distillation uses specific probing queries to extract model weights in some meaningful sense. There's also the element of "how one uses model outputs can be
52.
by wrsh07 3mo ago
The administration hasn't been so good at keeping the mask on but fair! Was hoping someone else had proposed it though. It's a good thought
53.
by wrsh07 3mo ago
This is a bit of a non sequitur. The most charitable read i can get is: > Theft presupposes a legitimate possessory claim by the victim. If A’s possession of X is itself wrongful because A stole X from B, then when C takes X from A, C ha
54.
by wrsh07 3mo ago
This is the most credible-seeming claim about why a competent administration might suspend access (by any means necessary, but also by export controls) to models like Fable However, I haven't seen any prominent articles proposing this
55.
by wrsh07 3mo ago
It seems like a reasonable person could say that a model being distilled "against the model provider's wishes" is in some sense a cyber attack that is stealing information (eg the lower order bits of the model weights) I thin
56.
by wrsh07 3mo ago
They are losing a ton of money on this and would be much much better off if people (Americans or not) had been building with Fable over the past few weeks rather than not If Anthropic wanted to continue slow rolling their best model to a se
57.
by wrsh07 4mo ago
Whether or not you assume bad intent of the government here, the amount of money the export control on Fable has cost Anthropic has to be unbelievably high Eg I expect I would have paid more than 2x per day what I spent the past few weeks,
58.
by wrsh07 4mo ago
Right, but there exist problems that need to be routinely solved and can be solved on glm 5.2. is the model state of the art when it is published? No. But when it comes out you could optimize it and let your solver run forever for quite che
59.
by wrsh07 4mo ago
While I agree that anthropic has several communication and PR problems, it doesn't seem like Fable has been shown to offer any advantage here (for cyber offensive capabilities) over the previous state of the art. I'm not saying al
60.
by wrsh07 4mo ago
How do you think founders should feel about advertising then? Eg Ben Thompson always argues that consumer products where you want to maximize audience (eg to distribute fixed costs, benefit from scale, power a multi-sided flywheel) should p

More ›