deepGem

8 ms·

31.
by deepGem 2y ago
Any idea what the sRAM to uRAM ratio is on these new GPUs ? If they have meaningfully higher sRAM than the Hopper GPUs, it could lead to meaningful speedups in large model training. If they didn't increase the memory bandwidth, then 51
32.
by deepGem 2y ago
This is correct. What I meant to say was that in due course, re-training on the fly will become a norm. Even without on the fly re-training we are looking at a small delta.
33.
by deepGem 2y ago
There's no way you are a loser. 1 successful exit, flaunt it man. No one cares about the exit value. The fact that you had a successful exit is a huge win. I would say that you can certainly strive for a 250-300K salary in the bay are
34.
by deepGem 2y ago
But once it knows it’s pretty certain to become common knowledge almost instantaneously. That’s not possible now. What you learn stays localised to you and may be people 1 degree away from you that’s it.
35.
by deepGem 2y ago
I don't do plunges but do cold showers. They are not the same but cold showers do have one anecdotal benefit for me, I don't feel cold post the cold shower. My immunity had been pretty good but am not sure if I can attribute that
36.
by deepGem 2y ago
That's what I am gathering as well. Where is OpenAI going to have substantial proof to claim that their outputs were used ? The reasoning prompts and answers for SFT from V3 you mean ? No idea. For that matter you have no idea where Op
37.
by deepGem 2y ago
From the R1 paper In this study, we demonstrate that reasoning capabilities can be significantly improved through large-scale reinforcement learning (RL), even without using supervised fine-tuning (SFT) as a cold start. Furthermore, perform
38.
by deepGem 2y ago
Essentially software is going to become like email. Dirt cheap to produce. The folks who will get employed and continue to make money like crazy will be the email automation company equivalents. Perhaps a bad analogy but the jobs are not go
39.
by deepGem 2y ago
It's not that anyone suspects OpenAI doing dodgy shit. Data flowing out of an enterprise is very high risk. No matter what security safeguards you employ. So they want everything inside their cloud perimeter and on servers they can con
40.
by deepGem 2y ago
I am trying out a handyman copilot for small repairs and these folks also have similar vibes. I think job protection is their no 1 priority. The field is rife with regulations as well. Some jobs need licensed professionals while other jobs
41.
by deepGem 2y ago
I have seen hallucinations in comments more than in code. In some of the code hallucinations, I can correct them myself. The hallucinations are obvious. try without finally blocks etc. So my workflow is to just review every bit of code the
42.
by deepGem 2y ago
asymmetry is fine but not able to do a left calf raise is a problem. I do drive an automatic yes.
43.
by deepGem 2y ago
I have a unique related problem. My left leg calf muscle is almost an inch smaller than my right calf muscle. I just noticed it this year. Felt so weird. Why would there be imbalance in calf muscle growth to such an extreme degree. Then I t
44.
by deepGem 2y ago
I think handwriting is a very personal trait. Some people value good handwriting and they write neat even when they write fast. Others don't. Sadly, a vast majority if the world exists in the other camp. This is why they invented typew
45.
by deepGem 2y ago
Not to mention software like peoplesoft, SAP and servicenow. Absolute shit interfaces that employees have to deal with day in and day out. Now, an in-house tool built on top of this Anthropic API can save hours of drudgery. I can already se
46.
by deepGem 2y ago
By the barrage of exits following Mira's resignation, it does look like Sam fired her, the team got the wind of this and are now quitting in droves. This is the thing about lying and being polite. You can't hide the truth for long
47.
by deepGem 2y ago
I doubt someone with Mira or Ilya’s calibre have to worry about future opportunities. They can very well craft their own opportunities. Saying I was wrong should not be this complicated, or saying we failed. I do however agree that there is
48.
by deepGem 2y ago
Why is it so hard to just accept this and be transparent about motives ? It's fair to say 'we were not aligned with Sam, we tried an ouster, didn't pan out so the best thing for us to do is to leave and let Sam pursue his pat
49.
by deepGem 2y ago
Predictability is great for everyone, from managers to directors to even company investors. What everyone wants to see is consistent yoy/qoq growth. We should all strive for this kind of consistency. However, balancing this consistency
50.
by deepGem 2y ago
Their goal might not even be to build a high growth high revenue business. Sustainable yes. So perhaps low growth, low - med revenue and who knows potentially high revenue. If anyone else had done this, I'd be very skeptical but give A
51.
by deepGem 2y ago
It’s a huge problem in India. 10 times worse than US.
52.
by deepGem 2y ago
It's high time someone disrupted the damn desk phone network of these hospitals. It's definitely not a technical hurdle in 2024. All calls go on the data network. You route your calls out of the main router and any call that gets
53.
by deepGem 2y ago
You should try fast.ai practical deep learning for coders part 1 and 2. It's quite dated 2022 but the principles you learn are very valid and highly useful in today's context. Especially self attention, transformers and the newer
54.
by deepGem 2y ago
DJI's response (a bit dated) https://dronedj.com/2024/03/02/dji-response-drone-ban-us/ The allegations are so subjective that they sound like some middle schooler complaining to their mom. “DJI dron
55.
by deepGem 2y ago
Also what does "oppty" from the title mean? The lazy man's version of opportunity
56.
by deepGem 2y ago
Every startup CEO must demystify 83(b) for their employees. If you don't have cash on hand to pay for early taxes, the company can pay a signing bonus or something for those who elect 83(b) to pay for the upfront taxes. OR Just pay mar
57.
by deepGem 2y ago
One really powerful use case they demoed was that of meeting conflicts. "Can you meet tonight at 7?" Me "oh yes" Siri "No you can't, your daughter's recital is at 7" It's these integrations which
58.
by deepGem 2y ago
"The children involved in the study were born with DFNB9, which accounts for between 2 and 8% of hereditary deafness. It is caused by mutations in the OTOF gene which prevent the production of functioning otoferlin protein, which can s
59.
by deepGem 2y ago
Oh yeah, you are describing a leader here. They are hustling for the next best project to take on for their team and/or for the company. They have moved beyond solving today's problems and spend most of their time on tomorrow&#x27
60.
by deepGem 2y ago
What you are saying here is, for the lack of a better word, macro verification and that's completely valid.

More ›