hnfong

29 ms·

601.
by hnfong 2y ago
I literally saved the link to this story in my "look again in a couple days" folder, and lo and behold, the story makes sense again.
602.
by hnfong 2y ago
It's almost a myth these days that you need top end GPUs to run models. Some smaller models (say <10B parameters with quantization) run on CPUs fine. Of course you won't have hundreds of tokens per sec, but you'll probably
603.
by hnfong 2y ago
> I don't believe we live in such epistemic black holes That's fine. > how do you know you're not a brain in a vat. I don't. > all we know is that we probably aren't a brain in a vat. hah. No we don't,
604.
by hnfong 2y ago
I'd be very worried if people who write software for a living actually believe they understand rockets more than software... ... and if not, why the analogy? Aren't analogies used when you want to explain something that people are
605.
by hnfong 2y ago
TikTok agrees.
606.
by hnfong 2y ago
Here's an actual case where understanding computer science would have been immensely helpful... > The motivation for this aberrant behavior was a contest put on by a local radio station. Each day a disk jockey would read a serial nu
607.
by hnfong 3y ago
FWIW, LLMs are currently stomped by the "mere" N^2.
608.
by hnfong 3y ago
This. My native language uses some additional CJK chars on plane 2, and before ~2010s a lot of software had glitches beyond the basic plane of unicode. I am forever grateful for the "Gen Z" who pushed for Emojis. Javascript's
609.
by hnfong 3y ago
In my runs even Llama3-8B-chat gets it right. A dolphin/mistral fine tune also go it right. Deepseek 67B also.
610.
by hnfong 3y ago
A couple hundred billion floating point numbers is enough to store quite a few things. Also, algorithms you learn in CS are for scaling problems to arbitrary sizes, but you don't strictly need those algos to handle problems of a small
611.
by hnfong 3y ago
First Google result for "China foreign direct investment" (no quotes) for me: "Foreign direct investment in China falls to 30-year low" https://asia.nikkei.com/Economy/Foreign-direct-investment-in...
612.
by hnfong 3y ago
I'm guessing GP means the other Big Tech companies have some kind of rent-seeking operation because they already have a tight grasp of some big moat. Eg. Google has Search that isn't going anywhere soon; Meta owns pretty much all
613.
by hnfong 3y ago
1900s grandfather: I buried a sack of gold coins in my backyard. 2000s grandfather: The computer that I used to mine bitcoin is probably in the pile of junk inside the garage.
614.
by hnfong 3y ago
The context is sparse, but it looks like Google laid off the Python team based in the US. The poster was not in US, so maybe that's why they're not laid off. The quote you mentioned was a sarcastic comment on the US-specific layof
615.
by hnfong 3y ago
There was some speculations in a Reddit thread: https://www.reddit.com/r/LocalLLaMA/comments/1b5uv86/perplex... As far as quantifiable results in terms of perplexity go, q4+ quants are generally consider
616.
by hnfong 3y ago
> That is also why you don't see ultra large tech companies in the EU. And for consumer, that is a good thing, because it keeps companies in check. Tech is different because the advantage of scale is huge . And Europeans use Facebo
617.
by hnfong 3y ago
I have a friend who had to pester Lufthansa for more than six months before she got her refund for a delayed flight. It was kind of amusing how she just went on Lufthansa's social media accounts and kept complaining. The legislation re
618.
by hnfong 3y ago
Very useful info. Thank you!
619.
by hnfong 3y ago
Very nice! This list is super convenient for LLM “connoisseurs”(?) like me. Did you have a script to generate it or was it manually done?
620.
by hnfong 3y ago
"Luckily" the USA is capitalist enough that, if the top S&P500 companies are all releasing open (weight) models to the public, regulation isn't going to happen any time soon.
621.
by hnfong 3y ago
Yes, but AFAICT there are no reliable records of what people actually said in spoken Chinese in those ancient/classical eras. And thus it's quite meaningless to speculate about the evolution of the spoken Chinese languages* over t
622.
by hnfong 3y ago
I hesitate to nitpick on you given your surname, but I haven't seen 中文 (or any other _文) referring to culture specifically, as opposed to language. My understanding is that 文 (in this context) refers to the written language, whereas 語
623.
by hnfong 3y ago
CPU inference is “OK” on quantized models smaller than 10B Gives at least a couple tokens per sec on fast modern CPUs. So it really depends on how fast the speed needs to be and the expected loads, compute cost and budget etc etc
624.
by hnfong 3y ago
Russell's paradox speaks of logical contradictions. Language is full of logical contradictions, but it's fine to us (not to logicians though). Similarly Gödel speaks of consistent proofs in logical systems. His incompleteness theo
625.
by hnfong 3y ago
I don't think there's any trend of written Chinese toward simplicity. Broadly speaking it has evolved towards "complexity" over its history. If you looked up the texts in the most ancient Chinese (oracle bones, bronze in
626.
by hnfong 3y ago
It might not be technically correct that they learned the full set of Chinese grammar in a week, but I can imagine one week is sufficient for a beginner to get the basics and start reading/speaking/writing the language and absorb
627.
by hnfong 3y ago
Google Wave was open sourced as Apache Wave, I think. Not sure whether anyone actually utilized it...
628.
by hnfong 3y ago
I considered writing a top-level comment, but a reply here to expand on my assertion is probably more appropriate -- To state the obvious, in general it's a bad idea to directly contradict your "boss", especially so if he is
629.
by hnfong 3y ago
I think GP was kind of referring to the (IMHO) slightly awkward way the article presents the concept of "Mandate of Heaven". I think your interpretation is much closer to the truth.
630.
by hnfong 3y ago
Having a standing army was considered the norm for most of China's history. The issue is that usually the standing army stations at either the borders, or at the capital. Rebellions usually start at some place that's far away from

More ›