dwa3592

5 ms·

31.
by dwa3592 3mo ago
It will, but the process at this point is SSD bound rather than compute bound. On a bigger machine, Apple silicon must help but I don't have a bigger machine. I can think about this more and will make changes if that helps.
32.
by dwa3592 3mo ago
>>Yes, it’s technically running, but not in a way that would be useful by normal LLM standards. What are the LLM standards? Do you know how many people use perplexity? I know many people who are not software engineers or tech workers
33.
by dwa3592 3mo ago
Why isn't there a video of it?
34.
by dwa3592 3mo ago
agreed!! in my heart i really wanted to say by the end of 2026 but wanted to add some wiggle room in case they start to ban open source AI development.
35.
by dwa3592 3mo ago
it's a 16GB machine. i am proud of this machine so far.
36.
by dwa3592 3mo ago
i have been optimizing for that. for now samosa is capped at using half of the avaiable cores and switching between them, which keeps the system 'less hot' as it would have been. i will also release better thermal control in the n
37.
by dwa3592 3mo ago
i am working on making it faster but to me 7-9 tokens/sec feels very good. it was 0 tokens/sec a year ago.
38.
by dwa3592 3mo ago
>>It's quite telling you didn't use Qwen3.6-35B-A3B locally to build that that would have run into a race condition unfortunately ;) but there is a sample landing page + a python function on the repo which shows what the mod
39.
by dwa3592 3mo ago
I have a prediction. By the mid of 2027, we will have >200B MoE models running on basic consumer hardware. I am running Qwen3.6-35B-A3B locally on my 16GB mac with 7-9 tokens/second. Link - https://github.com/deepanw
40.
by dwa3592 3mo ago
Thanks for testing. Actually if you open the samosa app; it will show you memory consumption, tokens/sec etc. Let me know what you think.
41.
by dwa3592 3mo ago
me and my wife made up a word in 2024 for this. the word doesn't exist in any language. we say it to each other all the time. even if i give you the spelling for it, you will say it wrong. i recommend everyone to do something similar.
42.
by dwa3592 3mo ago
>>One reason I am not running local models on my Mac now a days, is My Mac book pro is getting heated more Samosa was optimized for keeping mac's temp in check. This is one of the important reasons for creating this - no excessiv
43.
by dwa3592 3mo ago
i was pleasantly surprised to find out it hadn't been done until now.
44.
Show HN: Samosa Chat - Run Qwen3.6-35B-A3B Locally on a 16 GB Mac(github.com)
6 points by dwa3592 3mo ago|9 comments
45.
by dwa3592 3mo ago
my iphone is already kind of dumb. i don't have any social media apps. i have all notifications turned off (except ringtone for call). i only use my phone for calling and texting. it feels very expensive for those 2 operations. but i h
46.
by dwa3592 3mo ago
This marketing video on the page is nice!! can't wait for the hardware to get cheaper to live the AI life i wanna live.
47.
by dwa3592 3mo ago
What I agree with in this article is that there is shit ton of slop on the internet today. What I disagree with is that if pangram says it's human, then it's not AI. That is hardly the case. Pangram fails spectacularly in detectin
48.
by dwa3592 3mo ago
I like the timer but just give the option - play with timer (pro), play without timer (relax). split the results as well.
49.
by dwa3592 3mo ago
would be nice if the results also showed the analog watch positions.
50.
by dwa3592 3mo ago
i will give you the remaining 1% because i felt the same way.
51.
by dwa3592 3mo ago
This is very cool. Congratulations to the Mistral team. Map less navigation in the outside world has been around for quite a while. But map less navigation inside the buildings is relatively new. Some stanford researchers trained a vision
52.
by dwa3592 3mo ago
maybe it did a cartwheel instead of turning right.
53.
by dwa3592 3mo ago
>>Give any LLM the first paragraph of any Wikipedia article - almost certainly in the training set, and uniquely so - and it won't predict the next word correctly, a lot of the time. But it will predict a word that is grammatical
54.
by dwa3592 3mo ago
>>The worst is the cruise control that tries to stick to the speed limit is this a feature really? is it only applied in European cars?
55.
by dwa3592 3mo ago
not quiet true - if you wanna use the land - you'd have to pay to destroy the house already built on top of it.
56.
by dwa3592 3mo ago
>>If someone substituted all of your sensory inputs for something else for your entire life, how would you notice? I don't know how or if I will notice. That's the biology, chemistry and physics of the brain that I don'
57.
by dwa3592 3mo ago
Actually there are many such headlines, just replace the Netherlands with [China, Singapore, Australia, India].
58.
by dwa3592 3mo ago
This is so cool. Thanks for doing this. The fact that we have this in a palm sized object is just crazy. Also, if/when we have a similar sized device for doing CRISPR .... umm i should stop here - it's becoming the plot of Gattaca
59.
by dwa3592 3mo ago
you are right, i was more curt than i should have been. apologies. but you helped prove my point: >>"This sentence has five words" is going to appear far more often than "This sentence has four words". it's no
60.
by dwa3592 3mo ago
I read your comment multiple times and sorry to say none of your criticisms make any logical sense in any shape or form whatsoever. >> > LMs are not performing natural language understanding (NLU), and only have success in tasks th

More ›