samvher

10 ms·

61.
by samvher 3y ago
I can recommend the book "Learned Optimism" by Martin Seligman, maybe you can benefit from it. It definitely helped me work through feelings like this. > being objectively inferior, in basically every way Maybe one reason that
62.
by samvher 3y ago
Thanks, will keep this in mind for future posts!
63.
by samvher 3y ago
Yeah my explanation was definitely a lossy summary. You can do similar things with GPT, but BERT is bidirectional, so for a given token it can take into account both tokens before and after it. GPT would only take into account tokens before
64.
by samvher 3y ago
Nice! You'd get a long way just by swapping out the wikipedia dataset being pulled in. Though you might need to still accommodate for some special characters as well, I don't know how important those are in Brazilian Portuguese.
65.
by samvher 3y ago
Haha fair question. I didn't make any special changes, I just left the lid open and put the laptop in a ventilated spot. I'm actually in the tropics, so I guess Lenovo scores some points here (the laptop is a Legion 5 Pro).
66.
by samvher 3y ago
It's all behind the submission link! I've set it up so that you can run it start to end, if you want. The only thing I'm not 100% sure about is resource requirements - I have an 8GB GPU and 32GB of RAM, it could be that if yo
67.
A BERT for laptops, from scratch(github.com)
208 points by samvher 3y ago|46 comments
68.
by samvher 3y ago
I built and trained a BERT on my gaming laptop (3070 RTX) to ~94% of BERT-base's performance in ~17 hours* (BERT-base was trained on 4 TPUs for 4 days). This notebook goes over the whole process, from implementing and training a tokeni
69.
by samvher 3y ago
Can you say more? It sounds like you're referring to more than just the contamination of the word "open".
70.
by samvher 3y ago
Interesting idea. I'd argue that while salary correlates with value, it's not the same though. It seems most likely to me that this mechanism would just reserve the privilege of employing immigrants to a few high income sectors, r
71.
You're the OS(drfreckles42.itch.io)
3 points by samvher 3y ago|0 comments
72.
by samvher 3y ago
I don't like the exclusive network of countries either... I guess we have different perceptions of what's fair/acceptable.
73.
by samvher 3y ago
I'm from a non US country, so the concept of a Harvard is foreign to me as well. And yes, I've also worked for selective employers where maths degrees mattered a lot. It never bothered me. Not sure what you're trying to say.
74.
by samvher 3y ago
I have worked in an environment where it really did seem to matter. An organization set up by Harvard folks where other Harvard folks seemed to have advantages in (a) getting in and (b) getting ahead. It wasn't ever really addressed ex
75.
by samvher 3y ago
If you use vim every day, the common operations become muscle memory, I don't even think about jumping through the file, find and replace, block edits etc, they just happen. For me personally, the context in which I edit files changes
76.
by samvher 3y ago
Thanks a lot for the recommendation, read this over the weekend and learned a bunch. If you have other papers to recommend in similar categories I'm all ears :)
77.
by samvher 3y ago
I found this lecture and the one following it very helpful as well: https://www.youtube.com/watch?v=ptuGllU5SQQ&list=PLoROMvodv4...
78.
by samvher 3y ago
It's not so much that a different setpoint is worse per se "at steady state", it's that the world has been in a fairly steady state for quite a while now, with little variation, and our structures have grown to depend on
79.
by samvher 3y ago
What would be the set of skills that would put you in the category of LLM talent that is in extreme short supply? Just curious what the current bar is here and which of the LLM-related skills might be worth building.
80.
by samvher 3y ago
Care to expand on your thinking here? In what way do you think these recipients would be cherry picked, and what do you think would be the political goals?
81.
by samvher 3y ago
This Wikipedia page is worth a read: https://en.wikipedia.org/wiki/Interlocking_directorate
82.
by samvher 3y ago
I recently had the same questions and here is how I understand it: 1. You could concatenate the positional embedding and the semantic embedding and that way isolate them from each other. But if that separation is necessary, the model can le
83.
by samvher 4y ago
Just to check if I follow - is this a red flag because these founders are then not properly incentivized, because their ownership is a sure thing? (Although I guess you could then still argue that the incentive is growing the value of their
84.
by samvher 4y ago
1) Is everything really being mined already? My sense is that another round of GPT-like training on YouTube, EdX and Coursera data + some other large video archives (BBC and the like) could still make quite a bit of difference. Text and ima
85.
by samvher 4y ago
Why is that, that they are key to performance with RISC-V? And why are they the reason not to have conditional moves? Would love to know more!
86.
by samvher 4y ago
Similarly there's an open Yale course "Listening to music": https://oyc.yale.edu/music/musi-112/lecture-1 I enjoyed it, it goes into quite a bit of music theory and many different musical styles, wi
87.
by samvher 4y ago
> An important component of credit courses is the time limitness Huh? Why would that be an important component? I mean I know that it's typical for courses that come with credit, but in my mind it's just a side effect of the ad
88.
by samvher 4y ago
What's /g/?
89.
Decimal fixed point and floating point arithmetic in Python(docs.python.org)
2 points by samvher 4y ago|0 comments
90.
by samvher 4y ago
How do you show that? A large portfolio of successful projects/many years of experience?

More ›