SkitterKherpi

3 ms·

1.
by SkitterKherpi 2mo ago
They'll probably be back later. It's very possible they are "saving up" for a much bigger run.
2.
by SkitterKherpi 3mo ago
$5/$25 for Opus 4.8 vs $3/$15 doesnt seem cheaper enough to be too worth it. It depends how much better it is than e.g. Mimo, but I imagine Mimo and co to be too cost efficient in the lower tier to be overtaken by Sonnet for most
3.
by SkitterKherpi 3mo ago
I assume you have the dgx spark? At this point I am not 100% on the difference other than Linux and Windows. The RTX spark should come around Q4, unless I am mistaken.
4.
by SkitterKherpi 3mo ago
You can run 8bit 27B models at 24GB, it's definitely enough for the model size.
5.
by SkitterKherpi 3mo ago
10k is rather a lot yes. For LLMs you can use a lot of tokens with 10k with less hassle without the machine (and also it's not like electricity is free), but for some other things like video models 10k would get burned very fast. I am
6.
by SkitterKherpi 3mo ago
I am considering getting something like NVIDIA's RTX Spark when it comes out, though even that will be limited to 128GB.
7.
by SkitterKherpi 3mo ago
27-30B in general seems to be the level where you actually start having decent models. I just wish consumer hardware hadn't stagnated so much that we can't easily go higher than that, and that even running those requires a $5k mac
8.
by SkitterKherpi 3mo ago
Gemni is really not that far behind, 3.1Pro was the best model or close to it when it came out, 3.5Pro likely wont be but whenever they get to 4 that could easily be Fable level, just later than when Fable itself came out.
9.
by SkitterKherpi 3mo ago
So them banning Fable for only non-Americans is what we non-Americans should expect to be the norm going forward? Way to build even more resentment abroad. I'm very pro-west, but at this point okay, I guess the rest of us have to side
10.
by SkitterKherpi 3mo ago
I like the idea, but I am worried that it's yet another step on the road towards personal multi-purpose tower PCs built part by part no longer being a thing.
11.
by SkitterKherpi 4mo ago
It has so far been the kind of thing that always feels like the next version of the local models would be the one that is just good enough.
12.
by SkitterKherpi 4mo ago
It is impressive how well they've scheduled all their releases, posts, and other news to dominate the tech news cycle almost every day in this pre-IPO phase.
13.
by SkitterKherpi 4mo ago
I can see it but even if I do that for something like tests I'd still eat the time cost of the normal Gemma for 10% extra performance. And further, if you switch between the fast and normal Gemma for different tasks you eat the big tim
14.
by SkitterKherpi 4mo ago
It is cool but local models while okay already feel noticeably worse than even the cheapest APIs so I can't see myself sacrificing even a little bit of their quality for speed. I'm sure it's worth it for some usecases, curiou
15.
by SkitterKherpi 4mo ago
There's a lot more examples of grep usage than Visual code search in the training set.
16.
by SkitterKherpi 4mo ago
It also tried to force usage the paid Claude API instead of claude code usage just because there's a mention of another provider we might want to plug in (which hasnt even happened) for AI integration.
17.
by SkitterKherpi 4mo ago
Since the EU has been under investing in nuclear, solar + batteries investments is the only way forward. While the EU is making good progress, I still think it should invest a lot more a lot faster. EDIT: I just found out that my comments s
18.
by SkitterKherpi 4mo ago
This reminds me of GANs and generating directly from a latent vector, as well as exploring them. I wonder how many of the original tricks used with GANs (like extrapolation stuff, optimizing for the latent vector to get a result etc) are ea
19.
by SkitterKherpi 4mo ago
Perhaps this mainly tested a subset of them but context files as long term memory clearly help in general. The models make the same type of mistakes without them, which are often trivially fixed from then on if the desired behavior is inclu
20.
by SkitterKherpi 4mo ago
There are definitely things Deepseek beats GPT on - cost effectiveness, lack of reluctance on some tasks, but from using most models I doubt it actually outperforms in a useful way in quality in a meaningful way.
21.
by SkitterKherpi 4mo ago
I've never associated it with speed either due to UI. It's not slow, and it does feel snappy compared to some of the older alternatives but it's never felt particularly fast. Granted, we don't use it as much anymore.