hnfong

50 ms·

811.
by hnfong 3y ago
I feel that a lot of people here are confusing the math and "reality". You're definitely correct about the math, i.e. the systems that we humans have invented to model reality. But I guess most of us don't really care
812.
by hnfong 3y ago
I agree with all your claims here in the literal sense, but suppose there's a minimum length, then it would seem to be at least theoretically possible to use discrete mathematics to formulate an approximation to the "real number f
813.
by hnfong 3y ago
The important point IMHO isn't about being skeptical, but having the ability to verify the claims, or if not, at least having a good heuristic to detect bullshit (eg. by checking whether it contradicts with something you already know).
814.
by hnfong 3y ago
This blog post might shed some light on the matter. If I'm understanding it correctly, it claims there are emergent features on the LLM weights that make it easier to "compress" the floats into smaller bits without losing muc
815.
by hnfong 3y ago
Honest answer: some early Buddhist followers taking some form of acid/mushrooms and saw geometric visions of the Mandelbrot set and thought it was a divine manifestation of Buddha? I mean, I don't think this is likely, but that&#x
816.
by hnfong 3y ago
The Mandelbrot set is quite well known. Yet something I learned recently blew my mind. It's about the uncanny resemblance between the images generated by the Mandelbrot set, and among all things, the popular image of Buddha. For exampl
817.
by hnfong 3y ago
> Embeddings are a type of lossy compression Always felt they're more like hashes/fingerprints for the RAG use cases. > Typically documents are broken down into chunks That's what I would have guessed. It's still s
818.
by hnfong 3y ago
I must be missing something -- why is the size of the documents a factor? If you embeded a document it would become a vector of ~1k floats, and 115k*1k floats is a couple hundred MB, trivial to fit in modern day RAM.
819.
by hnfong 3y ago
Any "compression" mechanism that apparently violates Shanon's theorems would be "lossy" anyway, and lossy compression is essentially creating something that looks superficially like the original but isn't. A sc
820.
by hnfong 3y ago
You (humanity) don't learn from first principles either. The 3-year-old toddler doesn't learn the rules of English grammar before they learn to speak. Sure, we don't know how humans manage to learn with so "little"
821.
by hnfong 3y ago
Hence the conclusion must be: clearly we have intelligence because God created us. :)
822.
by hnfong 3y ago
Thanks! I needed to know that.
823.
by hnfong 3y ago
I'm Asian, so I don't have a stake in this Euro-American "conflict" personally. What I can tell you is that I religiously avoid cheeses made in USA, because they generally taste horrible. Cheeses from continental Europe
824.
by hnfong 3y ago
> Somehow I get the feeling most commenters who criticise Singapore for its 'draconian authoritarian totalitarian xyz-itarian oligarchic police state laws' have never set foot in the place. Rather ironically, if the original
825.
by hnfong 3y ago
GP's comments are interesting indeed. And while I think they're a bit extreme, I sympathize a lot. I've observed people who believe themselves rational use "reason" to lead themselves astray. Because "reason&qu
826.
by hnfong 3y ago
Yeah that's literally the trolley problem -- do you kill the 1-in-a-million person (due to adverse reactions to vacine) to save the 1-in-a-thousand people (who didn't catch measles due to vaccine)? Of course you do, at least you d
827.
by hnfong 3y ago
I kind of think it's dangerous for science to "inform" our ethical values in the ways you mentioned. For example, the scientific fact that Earth circles the Sun shouldn't mean that we should also have a moral system that
828.
by hnfong 3y ago
That's why I said Moore's law limping along.. it has slowed significantly, and the original transistor doubling every 18~24 months is definitely dead, but transistor processes are still improving, slowly. The trade off is always t
829.
by hnfong 3y ago
You could have said the same things to laptops 40 years ago, and smartphones 20 years ago. As long as Moore's law limps along, eventually performance/weight/battery will work out.
830.
by hnfong 3y ago
(I don't work for Google) Much of what you wrote here seems familiar with those who work for LARGE orgs or companies. The individual simply cannot have much influence when your org is > 10000 people. I suspect the thing unique to Go
831.
by hnfong 3y ago
That's my point. If you could pry open a human brain and decipher how it works, you'll see some representation of the song being sent around to various parts of the brain.
832.
by hnfong 3y ago
No language model plays a song either in the narrow sense, they just send a representation of the song to some other program (or human) that might play it. Mere knowledge is irrelevant only because we don't (yet) have a mechanism to
833.
by hnfong 3y ago
> I don't care what a distributor takes as long as I have other options > this 30% is more or less a lock-in cost for the only official way to do business on IOS As an app developer you're pretty much "screwed" TBH
834.
by hnfong 3y ago
Yes but ironically if you intentionally triggered the bug you'll definitely be found guilty of fraud. I don't think the "I was just trying to show how ridiculous the bug was" defense will go too well in court.
835.
by hnfong 3y ago
> In UK law, it is presumed that computers systems work perfectly, and it is up to the "other side" to prove they didn't. This is kind of true, but there's a bit of nuance -- presumptions can be rebutted by the othe
836.
by hnfong 3y ago
In a sane universe. You could rephrase ALL invasions as "defense of another". For example, Putin's excuse to invade Ukraine was 'to "protect the people" of the Russian-controlled breakaway republics.' Othe
837.
by hnfong 3y ago
> I don't find that convincing, given that the main claimants to this "multipolar world" are totalitarian dictatorships. If the USA is dictating issues outside its borders, and the affected people have no vote in US politi
838.
by hnfong 3y ago
ChatGPT is generally useful as a tool for most people. If you work on any secret project, you're not supposed to just log into openai.com and ask ChatGPT about things related to the secret stuff. That's why OpenAI/Microsoft h
839.
by hnfong 3y ago
All you can argue for is that Apple is the most popular iOS vendor by a large margin and hence a monopoly in the iOS market. You still can't say Apple is a monopoly by being the second most popular in the smartphone OS market...
840.
by hnfong 3y ago
It seems like (if I'm reading it right) you cured yourself so congrats on that. Do note that unless you somehow cured at least a couple other people with Crohns using your method, it's quite possible that it only works for a small

More ›