Maro

15 ms·

121.
Ask HN: How does LLM serving infra work?
26 points by Maro 2y ago|2 comments
122.
by Maro 2y ago
My blog has tons of articles about A/B testing, with math and Python code to illustrate. Good starting point: https://bytepawn.com/five-ways-to-reduce-variance-in-ab-test...
123.
by Maro 2y ago
I like to use passwordless email-auth, ie. send a magic link over email, they click it, and it cookies them, making them authenticated for some reasonable amount of time (like 1-7 days). Obviously not strong enough for important things like
124.
by Maro 2y ago
I wrote a clean C++ version of `wc` for fun, and successfully beat the system version by 10-20% iirc. My goal was to make the code much more readable than the GNU/C version, which is a big spaghetti loop, while maintaining the same sem
125.
by Maro 2y ago
Google images: dark matter halo
126.
by Maro 2y ago
Quick explanation: A galaxy (elliptic, or spiral) is made out of billions of stars, like our sun. These stars rotate around the center of the galaxy (very slowly, think millions of years for 1 rotation). A rotation curve measures the veloci
127.
by Maro 2y ago
I've never seen one irl.
128.
by Maro 2y ago
I don't take Microsoft devices seriously, esp. PCs, except the Xbox they never last or gain widespread adoption..
129.
by Maro 2y ago
Good point about future exposure. A counter-argument: people already do all sorts illegal (misdemeanor?) things every day, tracked by big tech, and nothing happens. Some examples: • speeding: your smart phone knows what road you're on,
130.
by Maro 2y ago
Narrowly? Half of people are pro-Trump, half of people are pro-Isreal/Palestine.
131.
by Maro 2y ago
Companies like Google have had access to our full email, search, location, photo roll, video viewing, docs, etc history for 10+ years. I don't think also having our LLM prompts fundamentally changes this picture.. I guess this is what
132.
by Maro 2y ago
I've had a full-time job as a Software Engineer (later Data Engineer / Data Science), since I was 23 years old. I've done all sorts of programming, worked in academia, done my own startup (Scalien), worked at medium-sized suc
133.
by Maro 2y ago
I think the price is also a yellow flag. $1k seems to low..
134.
by Maro 2y ago
AI research in 2024, both fundamental and applied, is probably the most funded research in the history of mankind..
135.
by Maro 2y ago
"You need to impress the hiring manager in 10 seconds" - I think this is a flawed view. The word "impress" does not apply here. The CV just needs to be good enough not to be thrown out. You don't get hired based on
136.
by Maro 2y ago
This is actually the second version of the comment. The first version I didn't post because I thought it's too harsh. This is good enough, has a good element of tough love, but people sometimes need that. "They may not have t
137.
by Maro 2y ago
Tips, thoughts [as a hiring manager]: 1. Build a professional CV. The current one (CV_Late2022.pdf), with a black background, bright colored links, no useful information, it's off-putting and looks amateurish. I found your "real&q
138.
by Maro 2y ago
Interesting! Would this approach (with non-linear learning) still be able to utilize GPUs to speed up training?
139.
by Maro 2y ago
I buy tons of print books on Amazon, probably around 20-30 per year.
140.
by Maro 2y ago
I have no agenda for or against Nick Bostrom. It's a full paragraph quote from the Wikipedia article, with a link.
141.
by Maro 2y ago
This 2023 incident around founder Nick Bostrom may have something to do with it: https://en.wikipedia.org/wiki/Nick_Bostrom#1996_email_contro... From the wikipedia article: > In January 2023, Bostrom issued an apolo
142.
by Maro 3y ago
I usually switch jobs every 2-3 years. Usually when I get a new job I stop speaking to recruiters for about 12-18 months, and then I open up again and start responding to Linkedin pings again, just to see what's out there. Same at my c
143.
by Maro 3y ago
I love Superset. I've been running it in production since 2017, at two jobs, the current one a big corporation. Best general-purpose, database-backed dashboarding system out there. I would never pay for Tableau or PowerBI. Same for Air
144.
by Maro 3y ago
Great is God's Zoo. The candidate may embellish and fuzz thing (both on the CV and verbally), mixing what they did with what the team did, color things to make themselves look better, etc. In certain parts of the world, that's jus
145.
by Maro 3y ago
Interviews are for weeding out poor candidates; what you have left are the good ones. Weeding out poor candidates is not possible with 10-15 minutes informal chats.
146.
by Maro 3y ago
SWE is a common abbreviation for Software Engineer. Others: PM, DE, PE, DS, UX, QA, etc.
147.
by Maro 3y ago
I worked at roughly 10 companies in my life. Most either used Outlook/Office or Gmail/Calendar/Drive. Personally I hate the Microsoft office productivity stack, and on the other hand, I love using the Google stack, including
148.
by Maro 3y ago
Search, Ads, Analytics, Gmail, Docs, Drive, Youtube, Maps, Android, Calendar.. All 10 are category defining (but at least top 3) products. I'd like to have a 1-trick pony like that one day!
149.
by Maro 3y ago
Given that this is an entirely new FSD engine, Elon should reset the counter for "X million miles driven with only Y accidents".
150.
by Maro 3y ago
I have multiple Google Home speaker devices at home. My experience that about 1/3 of the time, even in silence, it does not understand simple commands like "Stop" or "Pause". Sometimes I say "Stop" and it

More ›