ohyes

3 ms·

1.
by ohyes 6d ago
Well I think that’s the interesting bit, can the LLM figure out a way to escape the sandbox and upload to the website? Maybe a model can figure out its own weights if it runs enough test data through itself (similar to “distillation”) assum
2.
by ohyes 8d ago
That’s definitely how I like to ensure my code isn’t garbage. But now I use the tools I would have made to make the LLM & harness more useful and I might make more with the LLM because it costs me slightly less mentally.
3.
by ohyes 9d ago
Hard to know, does each GB of ram give some marginal increase in profit or potential profit? I’d guess no. Past a certain point the model has all the capabilities it can possibly usefully offer and honestly we may already be past that. The
4.
by ohyes 13d ago
I take issue with how people frame their use of LLM in the same regard. “I had Claude do this for me and it broke something.” No. Just no. You used Claude, a tool, and broke it, and you’re deflecting agency from yourself, possibly because y
5.
by ohyes 14d ago
Translation: our moat is evaporating faster than we can build it back up, because there are real technical and scale limitations the technology, so we want to slow everyone else down while we raise prices to turn a profit.
6.
by ohyes 15d ago
AI providers are in fact incentivized to have you not think about the task. I’ve found that they automatically do more for you, and frankly, a lot of the time I don’t want it to do more for me. Ask me a question rather than burning a bunch
7.
by ohyes 20d ago
You forgot the “co-authored by Fable 5.1” line on your post.
8.
by ohyes 23d ago
So the interesting thing is that this shrinking “linguistic diversity” is fundamental to how an LLM works. The LLM is a big probabilistic statistical trick. It picks the next token based on certain words are simply “the best” because they a
9.
by ohyes 28d ago
I played in the early days and quit to have a life, came back for a bit to check it out. Basically the community is people checking it out, bots, and the terminally addicted multi boxing 30 accounts.
10.
by ohyes 1mo ago
To be honest I’ll ask a model to specifically think of edge cases but I won’t expect any model to do the edge cases of its own volition
11.
by ohyes 1mo ago
The whole point is that we’re TikToking the software industry and no one will know what to tell the ai to get the software written in a way that works. It’s in principle the same as idiocracy where no one knows how to make burrito covers an
12.
by ohyes 1mo ago
You can train and run small models on an old gpu. That’s what I’m doing now at, well, much older than 17. Does it produce a useful model? No. Not even remotely. However, I do learn stuff about models that takes it from “magic” to “useful to
13.
by ohyes 1mo ago
Am I the only one who just downloads directly from LM Studio and just runs the server there? It’s trivial.
14.
by ohyes 1mo ago
Well they decide what a token is. So they can do less superfluous things and backfill with a weaker model.
15.
by ohyes 1mo ago
Okay but is that a relatable sound bite that will make someone click a link? No.
16.
by ohyes 2mo ago
On the one hand we have Claude doing my work for me, on the other hand it is laced with unoriginality, on the gripping hand everyone will get all references. All witty stuff disappearing and turning into LLM mush is kind of the maximal expr
17.
by ohyes 3mo ago
Okay. In my experience asking an LLM requires you to know the right set of questions and the right process for working through the problem that you’re having. You have to know the correct terminology to use to describe your problem. These a
18.
by ohyes 3mo ago
as soon as you start calling a group of stock tickers the “magnificent 7” they’re destined to underperform, as that’s a feelings based assessment and many investors will continue to buy the feelings long past the value being fair. “Do they
19.
by ohyes 3mo ago
“When the stocks don’t go up they don’t match the market which generally goes up”
20.
by ohyes 3mo ago
I mean, technically… I’ve lived in that world. You just go back 25 years. We had the Dewey decimal system (card catalog) and the library, hard copy encyclopedias. You could also ask someone else. Then we had computerized encyclopedias and s
21.
by ohyes 3mo ago
Excellent point my colleague has the exact opposite incentive.
22.
by ohyes 3mo ago
Sure, if we’re going to go that broad. People are already leaning heavily towards learning nothing instead of using Wikipedia. I guess to me it has to be comparable to be an alternative. Like, I don’t consider doomscrolling x an alternative
23.
by ohyes 3mo ago
The free alternative to Wikipedia is the library, not “don’t learn anything new ever”. I find Claude is surprisingly similar to a confident but incorrect coworker, with the benefit that Claude will reevaluate when I correct it.
24.
by ohyes 4mo ago
The solution is inexpensive drugs for addicts, minimum standard of living, programs for getting off drugs. But there’s an incentive to make drugs expensive and people desperate, and to punish people for their “failures” rather than forgivin
25.
by ohyes 4mo ago
LLM is a powerful tool but it still doesn’t have the context that a person would have. A million tokens is a drop in the bucket compared to the overall context that the person guiding the LLM needs to keep it on track and being productive.
26.
by ohyes 8mo ago
I remember when there was a kid who kept installing this and the Chex doom on the school pcs in 7th grade. GTA was pretty controversial as a game even though it is incredibly tame by today’s standards. I’m pretty sure they never caught him.
27.
by ohyes 9mo ago
People have a strong financial incentive to not understand this. It’s subprime mortgages.
28.
by ohyes 10mo ago
20 juniors become some % of 20 seniors. and some % of that principals. Even if it lives up to the claims you’re still destroying the pipeline for creating experienced people. It is incredibly short sighted.
29.
by ohyes 11mo ago
Yep, paid modding is Bethesda cooking and eating the golden goose. As soon as it happens it kills what makes their games special.
30.
by ohyes 11mo ago
Some claim we are centaurs, we say Neigh!

More ›