prometheus1992

5 ms·

31.
by prometheus1992 1mo ago
It's hard to believe 16GB unified memory will give you 5 tok/sec unless you are ignoring the thermal warnings. I am running Qwen3.6-35B-A3B on my 16GB M3 and get 7-8 tokens/sec with all the optimizations while keeping the pea
32.
by prometheus1992 1mo ago
I find it incredibly difficult to contribute to code files that were initiated by LLMs. Need to dig deeper to understand why but I just don't like it. I end up prompting my way out of any issues I see, sometimes it works out sometimes
33.
by prometheus1992 1mo ago
Nice work! This sort of reminds me of a game I saw demo'd on HN about a year ago, where you could walk and talk to the people and do some tasks- the difference being - in that game the world felt like a convex sphere and here it is con
34.
by prometheus1992 1mo ago
not sure who is downvoting this comment. meta should not exist as a company.
35.
by prometheus1992 1mo ago
Not sure many people know this - most of the robotics stuff that you see in the news is based on MujoCo (Multi-Joint dynamics with Contact) engine, that is used primarily to create simulated environments in which these robots learn the RL p
36.
by prometheus1992 1mo ago
The new mac minis and mac studios are going to be in shortage for at least first 6 months from 9.22
37.
by prometheus1992 1mo ago
I really like molmo 2
38.
by prometheus1992 2mo ago
Can't wait to try this. Ornith1 (9B) was a really nice model. I have been running it locally using - https://github.com/deepanwadhwa/samosa-chat
39.
by prometheus1992 2mo ago
I was recently at a hotel where the front desk lady was wearing these glasses. I immediately saw the cameras and asked, "are those meta glasses", she said yeah but these are not on right now. I don't get how she thought it&#x
40.
by prometheus1992 2mo ago
you are trying to see something that's not quite there in this case. there is shit ton of very good research that happens all over the world. but i also sympathize with what you are trying insinuate and that's also probably happen
41.
by prometheus1992 2mo ago
ahh gotcha. that speed sounds about right. i am running qwen 3.6 35bA3B(group-32 int4) on my m3 air (16gb) and get about 8 tokens per sec. i have not yet tried the 3.6 27B.
42.
by prometheus1992 2mo ago
16GB mac mini - what chip? m4 pro i assume?
43.
by prometheus1992 2mo ago
its so toxic when people show this kind of confidence in their ability to tell when something is ai or not.
44.
by prometheus1992 2mo ago
This is beautiful. By the end of it I started to feel like I was calculating complicated chess lines in a middle game.
45.
by prometheus1992 2mo ago
The "reasoning" text that we see is what the model learned during the post training. In the post training datasets of reasoning models, "reasoning" is fed to the model with inputs and outputs. So the model learns - X is
46.
by prometheus1992 2mo ago
Models will become immoral before they attain the intelligence level we want them to.
47.
by prometheus1992 2mo ago
I am actually going to read the output rather than guessing it.
48.
by prometheus1992 2mo ago
three things jump at me: 1 - governments should be freaking out right now, because this tool could definitely wreak havoc on poorly designed systems. 2 - there is no way openai did not train the model to conduct attacks like these. i would
49.
by prometheus1992 3mo ago
>>There is nothing "open source" about the Chinese models in question. hard disagree here. openness can have a scale and on that scale Open AI is less open than zai. olmo will be very very open on that same scale.
50.
by prometheus1992 3mo ago
how about gravy? or aunti-gravy?
51.
by prometheus1992 3mo ago
I think there is another angle here - maybe, just maybe google doesn't want to release a pro/stronger model sooner because of two reasons- 1) they're afraid they'll have to get their hands dirty in a certain war?? 2) wha
52.
by prometheus1992 5mo ago
[flagged]
53.
by prometheus1992 5mo ago
This is funny and sad at the same time. I have actually seen many people going in that direction.
54.
by prometheus1992 5mo ago
Agreed, but the way ram prices are going, I don't think we would be able to afford hardware that can run any useful model.