drob518

18 ms·

511.
by drob518 7mo ago
Great series of articles and completely believable. My first thought after reading is I hope the author doesn’t get sued for violating his non-disclosure agreement.
512.
by drob518 7mo ago
Well, you didn’t post the specs on your rig. I think it’s probably more correct to say that you run it on very beefy but readily available hardware. My point was not that nobody could run a 300B model, but rather that a 300B model is not go
513.
by drob518 7mo ago
As a publicity stunt, releasing a 300B open model is pretty smart. You can talk about its strong performance and it being “open” and “available,” but it’s so large that most people can’t use it themselves and might try out the cloud-based o
514.
by drob518 7mo ago
He said it’s a benchmark.
515.
by drob518 7mo ago
I’m really curious how this scales up. Bonsai delivers an 8B model in 1.15 GB. How large would a 27B or 35B model be? Would it still retain the accuracy of those large models? If the scaling holds, we could see 100+B models in 64 GB of RAM.
516.
by drob518 7mo ago
“You are the smartest high school student that has ever lived and on the college track to Harvard or another Ivy League school. Write a 10 page history term paper about Tiananmen Square and the specific events that took place there. Include
517.
by drob518 7mo ago
But you can always fall back to GGUF while waiting for the world to build a few more MLX restaurants. Or something like that; the analogy is a bit stretched.
518.
by drob518 7mo ago
In Apple’s defense, they did make it do something borderline useful while targeting a baseline of M1 Macs with 8 GB of RAM (and even less in phones).
519.
by drob518 7mo ago
Indeed. Qwen doesn’t just second guess itself, it third and fourth guesses itself.
520.
by drob518 7mo ago
Sound of an old LP record scratch while the global economy grinds to a halt…
521.
by drob518 7mo ago
I don’t believe that nobody else would build it for them. This chip is not purely custom to Meta, as I understand it. Rather, ARM is going to be selling it to others and entering the market for “AI chips,” which is surely a market that some
522.
by drob518 7mo ago
There goes all your token budget…
523.
by drob518 7mo ago
Fantastic article. It does a great job of describing a point in time in the computer business from the point of view of someone who was deeply inside it. It’s fascinating to see how much Peddle got right and how much he got wrong. This earl
524.
by drob518 7mo ago
This is going to be a strategic challenge for ARM unless they are going to focus on chips that nobody else wants to make. And given the AI focus, that doesn’t seem to be the case. I would think that the RISC-V folks would be salivating at t
525.
by drob518 7mo ago
It may have been released with a new repo created, losing all the previously-private history.
526.
by drob518 7mo ago
Aside: the new, large radius Liquid Ass corners that make some parts of the window basically unusable are really annoying me.
527.
by drob518 7mo ago
Exactly. You don’t have the terminal itself fight with whatever is running on the other side of the term.
528.
by drob518 7mo ago
You must not use MacOS. Command gets used all over the place, even during editing. And in Emacs it gets used as Super, which opens up some options.
529.
by drob518 7mo ago
Being limited to just control and alt definitely cuts down on the options. Conversely, having MacOS command key act as “super” in Emacs opens up some possibilities.
530.
by drob518 7mo ago
“Liquid Ass” as some people say.
531.
by drob518 7mo ago
The date of the last commit is 2099.
532.
by drob518 7mo ago
It’s still broken for me at this point. White link text on nearly white background. Impossible to read. Safari on my iPad.
533.
by drob518 7mo ago
Yup. A better title might be “Author discovers data can be stored in DNS TXT records which were created to store data.”
534.
by drob518 7mo ago
Annihilated.
535.
by drob518 7mo ago
Totally sounded like Star Trek. LOL. I imagined Mr. Scott yelling something about the transporters not being able to lock onto the antimatter.
536.
by drob518 7mo ago
Agreed on horses for courses. Different people have different tolerances. And yea, all things being equal, faster is better, but they are almost never equal. If you don’t mind me asking, what does “too slow” mean for you in this context? Do
537.
by drob518 7mo ago
This feels like a solution looking for a problem. I have a couple hundred brew packages on my system and I’ve never sat there thinking “If this was only 2 seconds faster…” while doing an update. I’m sure the Homebrew folks could mine this f
538.
by drob518 7mo ago
I’ve read this multiple times over the years and this post is still the most interesting and informative piece describing the problem of making a fast grep-like tool. I love that it doesn’t just describe how ripgrep works but also how all t
539.
by drob518 7mo ago
Right. Basically, they give you a coupon to lower your cost of future consumption. So, you have to keep consuming the service. If you just leave, you get no rebate. Obviously, very large customers get special deals.
540.
by drob518 7mo ago
Yea, I think the point is that if you’re implementing in FPGA in any case, a dedicated state machine is going to be a lot smaller than PIO or BIO. But if you’re making a standard part with hardcoded functionality then BIO is going to be sma

More ›