nullc

4 ms·

1.
by nullc 5d ago
I get pet-cemetery vibes from these AI powered resurrections. As in ... "the AI brought it back to life, but it came back /wrong/".
2.
by nullc 5d ago
Generally being succinct goes hand and hand with being zero knowledge. The proof must be MUCH smaller than the whole computation or even the inputs (otherwise, just provide the uncompressed image!). And the proof has to resist forgery. So g
3.
by nullc 6d ago
Large lab "hacking" is only for the purpose of pushing competition suppressing doomer stories. You can tell by the fact their security is fine where it counts: keeping their weights and internal execution harnesses trade secret.
4.
by nullc 6d ago
Playing these games autoregressively isn't even the right way to use the LLM for this task (unless it was trained to do so...). It's somewhat like having a creative writing bechmark but requiring that all the input/output be
5.
by nullc 6d ago
A better benchmark might be asking the LLMs to write GO ai and then comparing that-- the issue is that there will be a HUGE difference in performance that depends purely on this game being in the LLM's training... but training a genera
6.
by nullc 6d ago
It'll be interesting when people start applying similar effort that is going into LLM search for security vulnerabilities to finding conventional reliability/performance bugs.
7.
by nullc 7d ago
Nice underhanded coding technique / bugdoor material once the "infinite loops are not UB" notion is widespread enough. :P
8.
by nullc 7d ago
Zero initializing also hides bugs. Say you have some code that should not be reading the initial state and is buggy if it does. Without zero-init, valgrind and msan will give you an immediate and false positive message that your code is wro
9.
by nullc 7d ago
They never shipped the zen 5 epyc big cache chip (e.g. 9685X). :( I'd hoped they pulled it to produce a HBM integrated chip instead, but they didn't do that either.
10.
by nullc 7d ago
I'm confused by a number of comments here and the article seemingly taking a position that a $250k lab instrument is required . For one a similar instrument can be constructed from surplus parts for far less. Secondly, it's a si
11.
by nullc 7d ago
And be super-bankrupted by patent litigation from Apple. I don't think they're worried. After all, they successfully threatened Adobe with spurious patent litigation unless they joined w/ apple in illegally fixing wages. Yo
12.
by nullc 7d ago
As an example, in that example who pays for the orgy compound on Telegraph Ave?
13.
by nullc 7d ago
Because they depend on a supply of anxiety fueled doomers to both fund their lifestyle and provide a supply of willing participants for their control and fetish games.
14.
by nullc 7d ago
Those "rational methods" are essentially just pascal's wager. You stick some ~infinitely bad outcome (nasal daemons torturing simulations of you and everyone you love for all time) and/or ~infinitely good outcome (perfe
15.
by nullc 9d ago
It's pretty interesting to watch an LLM drive ngspice. ... clearly an area that could use more training, but good enough to make it less annoying for me to use.
16.
by nullc 9d ago
My post was an earlier post in this thread. I give figures for pure cpu , not using any GPU. The RTX 2070 figure is a separate figure (with rather insane speeds for that model!). You could contribute to the discussion by grabbing some
17.
by nullc 9d ago
https://news.ycombinator.com/item?id=49728887 How much ram has a fair amount of flexibility since MoE can be kept on flash and swapped in at a performance cost, and depending on how small a context you can use.
18.
by nullc 9d ago
No it doesn't. TODAY you can run with good performance a local LLM entirely on CPU that can do translation, summaries, search assistance, and all the things mentioned here. On a 8GB system with a SSD it might be a bit slow due to ha
19.
by nullc 9d ago
Another element of these "claimed to be private but can't keep its promises" is how caustic it is to the trust we have for our friends, family, and business associates. People here can be privacy aware and well informed and a
20.
by nullc 10d ago
I have never felt anything about gambling. Most boring thing ever. I don't feel anything about investment, and wrote automation to track mine because it's all so boring. I wouldn't tempt fate to try to expose myself more, bu
21.
by nullc 10d ago
Late thought: consider what telegram went through over just end to end encryption... And practically every country has lower privacy standards for data that crosses borders.
22.
by nullc 10d ago
That sounds about right for Q4. it's an extremely sparse MOE, so there is some odds of acceptable performance using a smaller in-memory cache and the rest on flash. ... I don't have a setup to test that right now. (Of course, if t
23.
by nullc 10d ago
I am speaking from direct personal experience: Yud's cult is inherently violent. By having defined their priorities as essential to the survival of any life on earth they have pre-justified taking any action 'necessary', no
24.
by nullc 10d ago
Have you tried Ling-3.0-tiny? It runs fine on CPU-- on a 14700KF gets 40tg/s and 250pp/s and on a ordinary gpu (RTX 4070) does over 200tg/s with no MTP and 7185pp/s. It's certainly not as capable as something that
25.
by nullc 10d ago
Cloud inferrance is not private: These providers, even if they don't get hacked, have bribed employees, or outright lie, cannot and will not resist a subpoena or similar. Mozilla is acting unethically by obfuscating what's on off
26.
by nullc 11d ago
The breach is bad no doubt-- but this information was already readily available to bad actors e.g. via Lexis Nexis. Practically all states sell DL and registration information to information brokers, and the remaining ones require you to o
27.
by nullc 11d ago
"We know our product is an unlawful violation of federal wiretap law since it will make zero-party-consent recordings, not that we care about violating the law at Apple because we know we can out spend anyone who would litigate against
28.
by nullc 11d ago
1960: "I have a great idea! lets have every person in the country carry a radio tracking beacon!" "That'll never fly!" 2012: "I can has TWO iphones??"
29.
by nullc 11d ago
Leaders in the MIRI/EA cult-o-sphere have advocated mass murder via nuclear weapons against towns that don't prevent people from performing too many multiplication operations. Why is anyone surprised that they'd engage in de
30.
by nullc 11d ago
Use of closed models is unprofessional, and depending on your field negligent. The fact that it has been widely normalized does not make it less so. You're handing over your (presumably your customer/employers) data to an unaccou

More ›