androiddrew

5 ms·

61.
by androiddrew 6mo ago
Get turboquant 4 bit implemented and this would be game changer.
62.
by androiddrew 7mo ago
Wish they had this for zig
63.
by androiddrew 7mo ago
Alternative headline: household spyware cash machine forced to pay $20 for being bad. If you want to punish Meta then you have to punish the wonder boy who runs it. Not even share holders can fight off the guy spending 80B on the metaverse.
64.
by androiddrew 7mo ago
The poster probably is hoping someone will post the archived version in the comments
65.
by androiddrew 7mo ago
I heard a delightful term for building apps only for yourself “houseplant programming”.
66.
by androiddrew 7mo ago
Could you share what you are using for inference and how you are running it? I have a 64G VRAM/128G system RAM setup.
67.
by androiddrew 7mo ago
Good, because it’s fucking ridiculous that pharma gets special patent loop holes to maintain a monopoly beyond what the basic protection grants.
68.
by androiddrew 7mo ago
I don’t know why this keeps coming up. Has this been a big deal for everyone else? Like ok usability improvement, but the number of times I have read an article about this is silly.
69.
by androiddrew 7mo ago
Yes, when the poetry people purposely added a feature to fail CI with a 1/10 chance because they wanted to depreciate a feature, I depreciated poetry.
70.
by androiddrew 7mo ago
MOE but 120B range. Man I wish it was an 80B. I have 2 GPUs with 62Gib of usable VRAM. A 4bit 80B gives me some context window, but 120B puts me into system RAM
71.
by androiddrew 7mo ago
Yeah, well might just come on your new laptop
72.
by androiddrew 7mo ago
Give me a 120B dense model on one of these and yeah my API use will probably drop.
73.
by androiddrew 7mo ago
I hope this is real.
74.
by androiddrew 7mo ago
I have never been in a flow state with an agent running. I use agents, but that isn’t flow.
75.
by androiddrew 7mo ago
Which dense model are you referring to? The dense model isn’t finetuned for code instruction according to the model card.
76.
by androiddrew 8mo ago
Is this a thing?
77.
by androiddrew 8mo ago
Oh, well awesome. Glad to see you are getting so much out of the Strix line. I am eagerly awaiting the next gen. I think that will be a tipping point in AMD’s favor. I am a bit of an AMD nerd, even though they don’t seem to love their devel
78.
by androiddrew 8mo ago
Oh yeah he is doing great things. Not on Strix myself but his dual AMD AI Pro r9700 build ironically is the same machine I built.
79.
by androiddrew 8mo ago
Pretty sure they mean the GB10
80.
by androiddrew 8mo ago
Yeah, there is a lot of advantage to having this machine because the CUDA stack is still king. My Two AMD GPUs are suffering when it comes to working with ROCm stack. I have forks of Ollama and VLLM that took many weekends to figure out.
81.
by androiddrew 8mo ago
Ah I see ASUS machine for 3K. Hopefully in a year or two we can get a better machine with twice the ram for same price. Then I’d probably buy one.
82.
by androiddrew 8mo ago
The initial benchmarks I saw didn’t really have the DGX spark (GB10) doing much better in generation throughput than the AMD Strix Halo. Prefill, the GB10 does pretty well, much better than the Strix. Memory bandwidth is 273 Gb/s. Whic
83.
by androiddrew 8mo ago
One of the few acquisitions I do support
84.
by androiddrew 8mo ago
They raised 60 million. The investors think it’s worth 600M+
85.
by androiddrew 8mo ago
“We realized that we were too focused on the consumer market. “ - Intel
86.
by androiddrew 8mo ago
I think a lot of people don’t realize that in the US we have the federal Gun Control Act of 1968, which gives you the right to manufacture a fire arm. There are still requirements like it must be for personal use, cannot be transferred, mus
87.
by androiddrew 9mo ago
I know george hotz was the CEO. Who is it now?
88.
by androiddrew 9mo ago
You tell that language what to do!
89.
by androiddrew 9mo ago
Doesn’t matter, must have for trophy
90.
by androiddrew 9mo ago
Whenever I see these I think of Fight Club

More ›