arjie

35 ms·

781.
by arjie 5mo ago
Pass the generated text through some kind of quality prompt. It’s got too much filler right now. The story is interesting but it’s hard to read because it’s hard to tell which parts are meaningful and which parts are filler. E.g. “we pulled
782.
by arjie 5mo ago
Thank you. Useful to know. Clipped on top by reduce, I assume.
783.
by arjie 5mo ago
Ah I’m on the same PR just behind. Thank you.
784.
by arjie 5mo ago
Vouched your comment. Very cool. What are you running on to get 190 tok/s? I get 400 tok/s at c=4 but c=1 is slower than you.
785.
by arjie 5mo ago
I run a small business ( https://technologybrother.com ) that runs a few small SaaS so I ordered the GPUs through corporate sales. If the barrier is getting an LLC, those are relatively cheap. The nice thing is that if you'v
786.
by arjie 5mo ago
Not “local” and not interactive coding but sharing since it might be helpful. I have 2x RTX Pro 6000 Blackwell running DeepSeek V4 Flash. I get 160 tok/s raw but it’s a reasoning model. For my use case, I have it auto-write code and an
787.
by arjie 5mo ago
Brilliant, thank you. Maybe I'll get a couple in a bit.
788.
by arjie 5mo ago
Speech itself was kind of fun: https://blog.google/company-news/inside-google/message-ceo/s... Pretty light hearted, and honestly considering that he's given a speech to an empty stadium before (as refer
789.
by arjie 5mo ago
I did not notice those. And it's my fault for not looking at the Daily Mail critically by looking one level deeper. I should know better than this since this is something I complain about, and also I am aware the DM is rarely accurate.
790.
by arjie 5mo ago
I don't think that's true. Supply-chain issues caused by the COVID-19 pandemic and response were probably a big factor - or so I've read, I'm not an expert. In any case, by 2024 (pre-DOGE), new-world screw-worm fly had b
791.
by arjie 5mo ago
Public health operations are hard because often when you reduce total life years lost you also redistribute the life years lost. Take the original Oral Polio Vaccine. I suspect that’s what I received as a child in India but it was also orig
792.
by arjie 5mo ago
Interesting story. I didn’t know about that. Looking it up, it appears to be well covered and one book Double Fold discusses it extensively. Thank you for sharing.
793.
by arjie 5mo ago
Quite interesting to see that measles is coming back. I suppose there is a notion of generational memory. Two generations out, people forget what the world was like. Forgetting like this on a civilizational level is probably adaptive unless
794.
by arjie 5mo ago
Benchmaxxing is the new “have a crypto trading strategy”. No one is impressed by it except non practitioners.
795.
by arjie 5mo ago
You can’t realistically make any money through work alone. Being paid for that work and being able to hold the value of that medium of exchange fully depends on the rest of us keeping an orderly society around you.
796.
by arjie 5mo ago
There is an argument to be made that societal structure enables much of that wealth to be made. J K Rowling can make a billion dollars not just because people want her stuff and give her money for it but because we have a system of intellec
797.
by arjie 5mo ago
Were you able to connect the two P150 using the qsfp-dd cable? They only sell 4x and 8x topologies so I’m curious if that worked for you. Are you able to run them tensor parallel?
798.
by arjie 5mo ago
That is interesting. I would have thought they had that right without needing to add it to the ToS.
799.
by arjie 5mo ago
Click through to their profiles and you'll find that they habitually do this. Preserve your own sanity and just eject them from your feed by removing comment subtrees starting with their comments. I see less than half of the comments i
800.
by arjie 5mo ago
That’s the cost of using a new hardware provider. A single RTX Pro 6000 Blackwell Max-Q will do better than that and be much more usable. I have 2 running DS4 Flash at 160 tok/s with max num seqs 4. Very interesting though, these Tenst
801.
by arjie 5mo ago
A Pixel phone is a pretty neat computer. I tried a short project to turn one into a voice assistant node and then into a balcony camera to watch my plants etc. Realistically I should have rooted it and installed a full Linux etc. because yo
802.
by arjie 5mo ago
Negative examples are cool. Time consuming to put together. I did appreciate that. What are some positive examples?
803.
by arjie 5mo ago
Pretty sad, in my opinion. In my ideal the state should have visibility into the shape of the people present so that we can make good decisions about our combined organization. I think we’re making a mistake we will come to regret by intent
804.
by arjie 5mo ago
Hahaha that’s pretty funny. But in their defence perhaps if you didn’t want a tall tale you shouldn’t have asked for a Fable? ;)
805.
by arjie 5mo ago
On the other hand, a bridge sign that says "No entry for heavy vehicles" is unlikely to now read "I am out of office for the next 2 weeks" in Welsh: https://www.theguardian.com/theguardian/2008/
806.
by arjie 5mo ago
Clearly a long antecedent and possible spiritual predecessor to SCP-3008 and the Backrooms genre which recently spawned a liminal horror movie called Backrooms. It it feels derivative, that's probably the Seinfeld Isn't Funny effe
807.
by arjie 5mo ago
Modern public libraries primarily serve other purposes than paper book lending. University libraries don’t face that constraint but with the Library of Congress and Google we have a safe copy for surviving civilizations. So the only questio
808.
by arjie 5mo ago
As a bit of a bonus for the latter airline, you are permitted to yell "Forth Aer Lingus!" as you charge headlong towards your seat. RyanAir is ultra-budget. You need to be ready for the whole thing, but often you can get something
809.
by arjie 5mo ago
This is just an old engineering principle of work amplification. For an input of x you shouldn’t routinely do nx. If you do you’ll get flooded. Debounce, throttle, load shed, improve throughput and latency. Lots of solutions. Just map it to
810.
by arjie 5mo ago
These papers usually have poor stability to prompting and rerunning. It would be nice if we had some kind of meta-evaluation metric where rewriting the prompt conditions or varying the input params could be used to determine how stable a re

More ›