jacquesm

10 ms·

211.
by jacquesm 2mo ago
We offload working memory to paper if we want to understand something that does not fit into the regular meat bits.
212.
by jacquesm 2mo ago
For me it is the simplest reasons of all: privacy / confidentiality. There is absolutely no way any of this data leaves my systems.
213.
by jacquesm 2mo ago
The next morning: if you have long common prefixes then you may want to increase the --cache-ram setting.
214.
by jacquesm 2mo ago
It used to be, anyway.
215.
by jacquesm 2mo ago
That's just like humans though. Find me a developer that loves maintaining code and I'll show you 10 that love rewrites or greenfield.
216.
by jacquesm 2mo ago
Unbelievable these comments on a thread about someone who committed suicide. Have a heart.
217.
by jacquesm 2mo ago
That's exactly it. Musk sees space as extraterritorial, which in the true sense of the word of course it absolutely is. But all those bits have to go to ground somewhere. As long as that somewhere is friendly no problem. That can chang
218.
by jacquesm 2mo ago
Private AI is perfectly practical already and it really doesn't need Google at all. Besides the word 'practical' here is really stretching things.
219.
by jacquesm 2mo ago
The default reasoning is set to 'xhigh', if you want to compare with the past or reduce the time (if you can take the hit in output quality) then you can pick 'high' or 'medium' as well.
220.
by jacquesm 2mo ago
Depending on your compliance needs this may be the only way.
221.
by jacquesm 2mo ago
It's a ridiculous waste of energy, just use local compute.
222.
by jacquesm 2mo ago
Looking forward to having your problems :)
223.
by jacquesm 2mo ago
I've found that once you factor in multiple GPUs things can get complex quite quickly because the default packing routine in the LLM runners tends to be very coarse resulting in substantial amounts of VRAM wasted. More so if you start
224.
by jacquesm 2mo ago
I absolutely love this comment. I wished there was a website where people would post their working command lines as well as what hardware they are using to run that stuff on + tokens / sec prefill + gen.
225.
Enable P2P PCI transfers on Nvidia 3090, 4090, 5090(github.com)
2 points by jacquesm 2mo ago|0 comments
226.
by jacquesm 2mo ago
Pretty much all of the people that are in the billionaire class with a few exceptions have been rewarded while repeatedly lying, cheating and stealing. The fact that it is white collar crime rather than that there is a corpse is one part of
227.
by jacquesm 2mo ago
That's super cynical but I can't help it, I agree. The weird thing that really gets me is that it is happening out in the open for everybody to see.
228.
by jacquesm 2mo ago
As long as it works... and maybe one day it will no longer work and then at least we can point back to discussions such as these and say 'you were right, up to a point'. The problem with weapons is that usually weapons end up bein
229.
by jacquesm 2mo ago
It makes you wonder to what degree they are making more money by raising the prices and restricting supply absent meaningful competition, or, alternatively, by making them in volume until they can supply the total demand. The lack of compet
230.
by jacquesm 2mo ago
Without substantiating what issues you have with unsloth gguf files you are just adding noise, no signal.
231.
Nvidia doubles RTX PRO 6000 Blackwell's MSRP to a staggering $16,000(tomshardware.com)
37 points by jacquesm 2mo ago|20 comments
232.
by jacquesm 2mo ago
You evaded the question.
233.
Daily global sea surface temperatures break records for the time of year(climate.copernicus.eu)
9 points by jacquesm 2mo ago|0 comments
234.
by jacquesm 2mo ago
Let me tell you about that time when I walked around in a DC in NL and ran into an unaccompanied FBI liaison officer... I don't think any of us have the total picture, but the bits that I do have are sufficient to worry me about the de
235.
by jacquesm 2mo ago
Canadian judges can rule whatever they want, it isn't going to make a difference in practice: if Canada or a Canadian entity wants data from an EU company they're going to have to go through the proper channels to do so. Taking sh
236.
by jacquesm 2mo ago
Technically, the US president is also not elected by the people but by the electors, which in many ways is comparable to how the EU elected the EU Commission President.
237.
by jacquesm 2mo ago
Because everybody on HN is most likely aware that Google is an American company and that by using them you pretty much can assume that your data can be compromised without your knowledge or recourse. Post Snowden there should be zero doubt
238.
by jacquesm 2mo ago
There is a Godwin in there somewhere.
239.
by jacquesm 2mo ago
The times are wild enough that I first checked if Trump had been making any moves on Iceland, just in case I had missed something...
240.
by jacquesm 2mo ago
You're right, just the other day our MP lined his pockets to the tune of a couple of billion, pumped his shitcoin, tipped off his friends about about the stock market movements he was going to cause, sent a couple of good deals to his

More ›