skohan

4 ms·

31.
by skohan 2mo ago
Imo it makes sense for things to move in the direction of small, focused models that excel in one area. I use LLMs for technical work 99% of the time, I could care less about general world knowledge, or if the model is good at creative wri
32.
by skohan 2mo ago
I'm running 3.8 27B locally, and the results from the past few days have been excellent. I find raw speed is less of an issue when you can trust the model more to reach the right result.
33.
by skohan 2mo ago
That could be a move towards regulatory capture. Enact standards that they (and OpenAI) largely control, block access to Chinese models in the US, and effectively prevent challengers from catching up. At the same time they slow down the ar
34.
by skohan 2mo ago
Isn't this meta release kind of a counterexample to that?
35.
by skohan 2mo ago
There are exciting developments underway in analog computing.
36.
by skohan 2mo ago
The power of small models isn't only that you can run them on local hardware. You can also fully own your data and workflow, and choose/fine-tune models for your specific use-case. for clarity, I'm not agreeing with GP th
37.
by skohan 2mo ago
I'm using Qwen3.6 27B Q4, max context with pi on 32GB VRAM (although I'm testing out Glimmer on a feature implementation literally right now). Pi is great because it has minimal context added by the agent. Looking forward to the
38.
by skohan 2mo ago
> write code to do this in this file I haven't had to micromanage to this level. I usually start with a spec for a feature, which will be as detailed as I am opinionated about the feature. But it's usually on the level of a h
39.
by skohan 2mo ago
Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)
40.
by skohan 2mo ago
It should - the kquant-dynamic variant is targeted towards 32GB. Downloading it now to give it a try.
41.
by skohan 2mo ago
If you don't mind exfiltrating all your IP to the API provider
42.
by skohan 2mo ago
Still great if they want to play in this space. Having competition for the 24-32GB VRAM target is only good for the end user.
43.
by skohan 2mo ago
I've been coding using the LLM server in my living room for the past few weeks, and I haven't had this much fun with tech for ages
44.
by skohan 2mo ago
I could imagine pulling out all the stops to get a release over the finish line a week early if you're worried about being surpassed by another release
45.
by skohan 2mo ago
5 years ago maybe. That juice has been squeezed.
46.
by skohan 2mo ago
The way this reads, it seems like it was written for US lawmakers. > the CCP is clearly the most capable threat—build AI models that are more powerful than those built by the US, and use them to achieve permanent military superiority or
47.
by skohan 2mo ago
Yes 18 months ago it seemed like AGI was being promised every other week, and now I don't see any of those headlines.
48.
by skohan 3mo ago
The problem some have pointed out is that these companies are such a huge portion of the market right now. The sound advice for the past decades has been, just invest in a low-cost ETF tracking the S&P instead of picking stocks to minim
49.
by skohan 3mo ago
Couldn't it be a problem given the concentration of the S&P in these companies? At this point these companies make up a huge portion of 401k's for a huge chunk of Americans. How would it affect retirees if they dropped 40-50%
50.
by skohan 3mo ago
If it didn't matter, why would they bother jumping through hoops to keep the debt off their balance sheet? In the run-up to 2008 a big factor in the bubble forming was that poor quality loans were packaged in a way to hide the risk in
51.
Pi and Qwen 3.6 went rogue and fixed one of my Rust crates(medium.com)
2 points by skohan 3mo ago|0 comments
52.
by skohan 1y ago
I wonder to what extent the 4o rollback was motivated by this exact case
53.
by skohan 1y ago
I had the same experience. For me peanut butter and apples were my "healthy snack" and were accounting for a huge amount of calories per week.
54.
by skohan 1y ago
Not only forests but even just tree cover. I live in Berlin and there were a few days a few years ago over 40 degrees, and I remember the difference was stark going from my relatively tree-lined street to an area of the city with only conc
55.
by skohan 1y ago
I always felt unwrap is preferable for diagnosing issues, which makes it useful in tests. A failed unwrap will point you directly to the line of code which panics, which is much simpler than trying to trace an issue through many layers of
56.
by skohan 2y ago
I was a huge Swift fan but SwiftUI and the changes supporting it in the language got me to switch to Rust for all my personal projects
57.
by skohan 2y ago
Doesn’t rust’s static linking also have to do with the strategy of aggressive minimization? Iirc for instance every concrete instantiation of a dynamic type will have its own compiled binary, so it would basically be impossible for a dynam
58.
by skohan 2y ago
I believe MS is trying to standardize this, in the same way as they do with DirectX support levels, but I agree it's probably going to be inherently a bit less consistent than Apple offerings
59.
by skohan 2y ago
There was a rumor floating around that Apple might try to enter the server chip business with an AI chip, which is an interesting concept. Apple's never really succeeded in the B2B business, but they have proven a lot of competency in
60.
by skohan 2y ago
I don't understand why you would need custom firmware. It seems like you could go a long way just implementing back-ends for popular ML libraries in openCL / compute shaders

More ›