vhiremath4

10 ms·

61.
by vhiremath4 2y ago
It seems like the smaller models get the largest size decrease by embedding share/weight tying between the linear head and token embeddings. Is there any research going into how to further reduce size from there?
62.
by vhiremath4 2y ago
This is kind of what I was thinking. I don’t get it. It seems like CriticGPT was maybe trained using RM/RL with PPO as well? So there’s gonna be mistakes with what CriticGPT pushes back on which may make the labeler doubt themselves?
63.
by vhiremath4 2y ago
When they say “LLM data”, does that usually include the tokenizer as well? Beginner question from someone at the end of Karpathy’s Zero to Hero course.
64.
by vhiremath4 2y ago
> Broadly speaking the only solutions are tax rises, spending cuts or more debt. But these are three very different parties, with conflicting views over borrowing and spending. So they basically just couldn’t come up with a solution when
65.
by vhiremath4 2y ago
which core exercises worked best for you?
66.
by vhiremath4 2y ago
There is currently a proliferation of robotics companies of all shapes and sizes. Lots of capital is being deployed into robotics. My best guess is give it 3-5 years before we start to see and accept that there will be many more robot frien
67.
by vhiremath4 2y ago
Finally a title so simple to answer what I’ve been too lazy to read into the details on but was curious about.
68.
by vhiremath4 2y ago
Thank you for recording with us! And good luck with this product. There's definitely a bunch of use cases for scrappy prototyping or early mocks!
69.
by vhiremath4 2y ago
Funny story. Before pivoting my startup to Loom, we were a user testing company named Opentest. Instead of spinning up a DB and creating a dashboard for my co-founders to look at who requested certain user tests, I just dumped everything in
70.
by vhiremath4 3y ago
Agreed with the spirit of this post. OpenAI also pays very well though and has super high caliber talent (from what I can see from friends who have joined and other online anecdotes).
71.
by vhiremath4 3y ago
Honestly, you only get this kind of humility when you're working with absolute wizards on a consistent basis. That's how I read that whole analysis. Absolutely fascinating.
72.
by vhiremath4 3y ago
My favorite part was the analysis of "I'm not really a security researcher or reverse engineer but here's a complete breakdown of exactly how the behavior changes." You only get this kind of humility when you're wor
73.
by vhiremath4 3y ago
Honestly, this is pretty mind-blowing. I am going to start incorporating using this as a mix of sounding board/on-demand therapist more often. This gives me very "Her" vibes (referencing the movie). I'm excited about thi
74.
by vhiremath4 3y ago
I learned a lot working side by side an engineering leader who built Google Docs (I hired him in as our VPE). He taught me the importance of two types of authority: positional (org hierarchy) and personal (technical, market understanding, t
75.
by vhiremath4 3y ago
Highly recommend his talk on the power of simplicity. This was one of those lightbulb moments for me when I was a younger programmer: https://www.youtube.com/watch?v=NdSD07U5uBs
76.
by vhiremath4 3y ago
Strong +1. Also hi Zach!
77.
by vhiremath4 3y ago
Wow comments like this keep me coming back to HN. Thank you. Super thoughtful.
78.
by vhiremath4 3y ago
Totally agree. And hello! Small world :)
79.
by vhiremath4 3y ago
I understand what you're getting at, but are high-energy people not working in government or other critical industries because of VC lore, or is there a significant contribution from these industries being slow and bureaucratic? If I&#
80.
by vhiremath4 3y ago
You are a junior operator. Senior operators get red pilled on this stuff and build up their intuition about people based on these experiences. Welcome to the real game. It has just begun. If you or anyone else wants advice on founder dynami
81.
by vhiremath4 3y ago
Coming from both a place of kindness and a place of selfishness: 1. Please keep at it. We need more people with experience staying in software. I don’t know your financial situation, but software is huge and something will land! 2. Based on
82.
Google has no visionary leaders and a pervasive sense of nihilism(linkedin.com)
133 points by vhiremath4 3y ago|78 comments
83.
by vhiremath4 3y ago
https://archive.ph/PCSc9
84.
by vhiremath4 3y ago
A warning to anyone who uses JSONB in Postgres. Past a certain size, the engine must go to the TOAST table off disk, even for indexed reads . If you store your JSONB in Postgres, don’t wait for it to grow out of hand or store a bunch of ra
85.
by vhiremath4 3y ago
Actually some of what I'm feeling seems to be thought through in this piece (quite elegantly): https://news.ycombinator.com/item?id=38177409
86.
by vhiremath4 3y ago
I've noticed a steady uptick in bugginess with iMessage on Mac, which is a shame. I'm happy they're addressing it! That said, I also feel like this, mixed with them not really shipping much new UX/device innovation, sign
87.
Atlassian agrees to buy video messaging provider Loom for $975M(nasdaq.com)
2 points by vhiremath4 3y ago|1 comments
88.
by vhiremath4 3y ago
To be clear, you're talking about a guy wanting you to exchange a sexual favor for him giving you a ride right? Or am I totally misreading this? If that's the case, I wouldn't classify you running away as you being cynical. Y
89.
by vhiremath4 3y ago
It’s interesting to think, when a company starts to vertically integrate, how deep do you go? Seems like OpenAI is exploring its own devices/OS as well, which makes sense to me, but it’s a vertical integration bet. This seems to be ano
90.
by vhiremath4 3y ago
This depends on responsibility. If you are working within a service you own, you might be working with a bunch of abstractions you need to know because it's your responsibility to. Layers that bifurcate responsibility (and usually team

More ›