BarakWidawsky

4 ms·

1.
by BarakWidawsky 4mo ago
You’re mostly right but conflating attention with autoregressive/causal which is the real issue that prevents you from using more compute You can use diffusion with attention, and this model does in fact use attention
2.
Arcee AI Trinity Mini and Nano – US based open weight models(arcee.ai)
4 points by BarakWidawsky 10mo ago|3 comments
3.
by BarakWidawsky 11mo ago
I think it's extremely important to distinguish being friendly (perhaps overly so), and agreeing with the user when they're wrong The first case is just preference, the second case is materially damaging From my experience, ChatGP
4.
by BarakWidawsky 11mo ago
Looks like the dataset is distilled from Gemini nano-banana Definitely very useful, but I’m so curious how the original datasets from these image editing models were created. I’m guessing a lot of it is synthetic data to construct scenes pr
5.
by BarakWidawsky 1y ago
I’m guessing this is so they optimize processor yields as manufacturing improves Smaller chips means more of a wafer is usable when a defect exists
6.
by BarakWidawsky 1y ago
I wonder how much of this is due to Diffusion models having less capacity for memorization than auto regressive models The auto regressive models consistently show better loss for the same number of training tokens I find a lot of the concl
7.
by BarakWidawsky 1y ago
It’s interesting that it looks like they didn’t apply their own RL to the model, and instead fine tuned on reasoning traces from large datasets and generating reasoning traces from larger models
8.
Red Star OS (North Korean OS)(en.wikipedia.org)
1 points by BarakWidawsky 1y ago|0 comments
9.
by BarakWidawsky 1y ago
If this is a faster backend for LLVM, does it potentially obviate the niche Cranelift is optimizing for?
10.
by BarakWidawsky 2y ago
I have taken a Waymo in the rain before, if they have stopped supporting that as part of the service that’s new, buts it’s definitely within the systems capabilities. It worked great
11.
Why we write numbers in big endian(cesanta.com)
2 points by BarakWidawsky 3y ago|2 comments