hnfong

17 ms·

391.
by hnfong 2y ago
Then the optimal strategy is to never say "don't know" and never get caught lying. Seems to work for many people. I suspect my career has been hampered by a higher-than-average willingness to say "I don't know"
392.
by hnfong 2y ago
People think the property market in Hong Kong and China is going to collapse. And much of the asset price can be attributed to real estate.
393.
by hnfong 2y ago
FWIW, it's very common for stocks listed in the Hong Kong stock exchange to have its share price below assets minus debts..
394.
by hnfong 2y ago
IMHO, the "western" style of retirement, i.e. using other people's children's money to fund the elderly's retirement doesn't look that great either...
395.
by hnfong 2y ago
The difference is that the President of the USA currently has a popular mandate to annex more countries and is an actual threat to world peace.
396.
by hnfong 2y ago
South Korea probably went too far in the other direction. Apparently their presidents have a tendency to end up imprisoned after they step down. If I were the sitting president I'd probably be scared too, and might take risks to try to
397.
by hnfong 2y ago
It "feels" different to be "me". Then because we are social animals, we presume without evidence that this is the same for other people as well. We (most of us anwyay) don't form social bonds with machines, so there
398.
by hnfong 2y ago
I'm not an insider and I'm not sure whether this is directly related to "energy minimization", but "diffusion language models" have apparently gained some popularity in recent weeks. https://arxiv.or
399.
by hnfong 2y ago
Apparently there's a quote attributed to Bill Gates: "people overestimate what they can do in one year and underestimate what they can do in 10 years." People overestimate the changes that could happen within a couple years,
400.
by hnfong 2y ago
I was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt. I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.
401.
by hnfong 2y ago
My bad, original comment updated.
402.
by hnfong 2y ago
Quants at 4 bits are generally considered good, and 8 bits are generally considered overkill unless somehow need to squeeze the last bits of performance (in terms of generation quality) from it. There are papers to that effect though admit
403.
by hnfong 2y ago
If you actually looked at gemma-3 you’ll see that it does support system prompts. I’ve never seen a case where putting the system prompt in the user prompt would lead to significantly different outcomes though. Would like to see some exampl
404.
by hnfong 2y ago
I think some people mistake arrogance as wisdom. It's more prevalent in these days of social media where people mistake strong words and loud proclamation for truth, but I suspect similar things have been happening on a smaller scale i
405.
by hnfong 2y ago
Unless something changed recently, I’m not aware of big perf differences between MLX and llama.cpp on Apple hardware.
406.
by hnfong 2y ago
The DeepSeek R1 distilled onto Llama and Qwen base models are also unfortunately called “DeepSeek” by some. Are you sure you’re looking at the right thing? The OG DeepSeek models are hundreds of GB quantized, nobody is using RTX GPUs to run
407.
by hnfong 2y ago
Coca Cola only has a moat because soft drinks and junk food are mostly a done product without much space for innovation left. AI is still not there yet, and if any model becomes significantly better than ChatGPT people will flock over to
408.
by hnfong 2y ago
Being perceived as the boss of the most powerful company when AGI arrives is probably worth more than whatever little stock he holds...
409.
by hnfong 2y ago
The big players have made the web so complicated that it's impossible to maintain one's own standards compliant browser without millions of investment, and you don't get a business model because everyone else is giving their
410.
by hnfong 2y ago
At least there are words. The Brits have nothing.
411.
by hnfong 2y ago
This is basically a "the Emperor's new clothes" situation where the UK's constitution can only be seen by smart and educated people. (Yes, you have QCs [now KCs] saying otherwise, but that's exactly my point.) Face
412.
by hnfong 2y ago
As other commenters have mentioned, the performance of this set up is probably not really great since there's not enough VRAM and lots of bits have to be moved between CPU and GPU RAM. That said, there are sub-256GB quants of DeepSeek-
413.
by hnfong 2y ago
Well, GP isn't wrong. Nazi Germany controlled most of Europe in WWII, fought against Russia (Soviet Union) and lost...
414.
by hnfong 2y ago
Any risk Elon's taking is peanuts compared with George Washington taking on the world's leading colonial power...
415.
by hnfong 2y ago
That's sort of what Trump was subtly trying to get at -- Zelenskyy's political power continues as long as the war continues. If we take the worst interpretation of his character that he is willing to do whatever it takes to hold o
416.
by hnfong 2y ago
More context: https://news.ycombinator.com/item?id=40560768
417.
by hnfong 2y ago
The issue with `considering you don't deem it to be important` is that the statement presumes a particular attitude for the recipient which may or may not be true. Maybe they were sick for a couple days. Or were recently on vacation (a
418.
by hnfong 2y ago
LLMs can be deterministic if you set the temp to zero. It's not feasibly debuggable though, I'll give you that. On this point it's not really different in principle from having a non-OSS compiler. Using OSS compilers are grea
419.
by hnfong 2y ago
I already said they are technically not black boxes. We are not in disagreement here. The fact that code is all there and deterministic isn't sufficient. People use newer versions of compilers and you can't predict what the people
420.
by hnfong 2y ago
I get your point, but realistically you're talking about a minuscule chance of being sued as first defendant given the thousands of OSS devs in the region. Is a rational person supposed to be worried about the < 0.1% chance of finan

More ›