alsodumb

18 ms·

181.
by alsodumb 3y ago
Yup, that’s sums up the incentive for publishing so many papers and get citations. Some professor put it in a nice way - the current system motivates us to think of research in terms of LPUs - least publishing units. No matter how establish
182.
by alsodumb 3y ago
Unfortunately, it's an open secret that fake or low-effort almost useless papers are very common in every area of scientific research. Typically, it doesn't affect people working in that specific area - they develop/have a si
183.
by alsodumb 3y ago
I broadly work in decision making under uncertainty - so a bit of control theory, a bit of optimization, a bit of machine learning, and AI planning (MDPs, POMDPs). I definitely don't do math say at the level of a math grad student, but
184.
by alsodumb 3y ago
Depends on what model you're using. I'm a PhD student, I use GPT-4 as a "knowledgeable on all topics but sometimes confidently wrong" companion. I'd say ChatGPT is where I search first in 90% of the cases these days
185.
by alsodumb 3y ago
Yup I think you got it perfectly. Just a small note: yes one isn’t rigidly defining what those characteristics are while finding similar embeddings (aka nearest vectors using some distance metric), but those characteristics are implicitly e
186.
by alsodumb 3y ago
Funny you compare ML with other fields - in my experience ML is the most open and reproducible area of scientific research, by far. Talk to researchers in other areas, many write “dataset and code available by request” but never share it, h
187.
by alsodumb 3y ago
Researchers always have a lot to take away from Google papers that don’t release code or dataset - people understand that sometimes folks at companies sometimes cannot release the code or dataset. Doesn’t make any key contributions less mea
188.
by alsodumb 3y ago
All the things you mentioned make it a platform, but even as a model, none of the smaller open-source models come close to GPT 3.5 or 4 in my experience. You can test it by using the GPT3.5 or 4 with their API. They outputs are waaaay bette
189.
by alsodumb 3y ago
Call me biased, but I've learned over time that anything that comes out of the Waston team looks good only in PR statements but sucks at production - especially at tasks like OCR. YMMV.
190.
by alsodumb 3y ago
I always thought privacy.com let’s you do essentially this but I could be wrong.
191.
by alsodumb 3y ago
In Engineering (especially robotics and ML/AI), it’s definitely not the tenure that’s making people apply for assistant professor roles. Almost everyone I met did it only because they want the freedom to pick the research direction and
192.
by alsodumb 3y ago
It's pretty clear that they're doing it for citation farming. I've seen another paper from KAUST that uses fancy title on a trivial paper.
193.
by alsodumb 4y ago
"It even took a while to get a good answer to why inference is so slow" No it didn't, if you read their paper they mention multiple times what parts take most of the time. There is only so much one can write in a paper. Meta
194.
by alsodumb 4y ago
There are papers that omit useful info, this one certainly ain't it. They mention on their website homepage FAQ that image embedding takes 0.15 seconds on an A100. SAM team released the entire codebase, model weights, and the entire da
195.
by alsodumb 4y ago
From what I understand EDR team was absorbed internally, with most of them going to Brain. So technically they just shutdown EDR without really laying off the small team. I could be wrong though. Edit: Looks like I was wrong. My interaction
196.
by alsodumb 4y ago
Which is not bad imo. Infact SAM actively proposed a fix for this. Bounding box algorithms are relatively easier to train and SAM can take in a rough bounding box of the laptop as input prompt and create a detailed segmentation of laptop. T
197.
by alsodumb 4y ago
I don't know where you're doing your PhD but this absolutely not true.
198.
by alsodumb 4y ago
In context learning (i.e., tuning the LLM by adding all relevant info to prompts) seems to be preferred over fine-tuning. I'm not sure what exactly the reason is, perhaps because fine-tuning often doesn't make sense in a dynamic s
199.
by alsodumb 4y ago
The post was rightfully flagged while trying to make it's way to the frontpage of HN with blatant astroturfing. I was hoping to see good discussion around too. And it would have happened had Data bricks employees or PR people didn&#x27
200.
by alsodumb 4y ago
They are probably an employee at this company, check their profile history. The first comment was on a previous DOLLY post and now this one.
201.
by alsodumb 4y ago
The only thing this comment and your profile history goes to show is how you work at this company.
202.
by alsodumb 4y ago
Maybe OP, Data bricks founder, should reply to this comment and answer if he or anyone else in his team paid people to get this post with a not-so-useful-dataset to the top of HN.
203.
by alsodumb 4y ago
I'm not saying Twitter front end is that hard to clone, but I wonder how many ex-twitter employees are at Substack now working on Notes.
204.
by alsodumb 4y ago
You seem to take this very personally. The author is a computational researcher, and most of his funding likely comes from NSF not NIH. Why would you expect him to write about how NIH grants work? Why would you expect him to write how thing
205.
by alsodumb 4y ago
There a too many administrators imo, who are often paid quite a bit. I don't think a University needs so many associate deans, assistant deans, and directors. Unfortunately it's people in those roles that make future hiring decisi
206.
by alsodumb 4y ago
UIUC - 58.6% One thing that really annoys me as a grad student is the fact that the University charges tuition to my advisor even if I'm not taking any classes. Most PhD students finish their course work pretty quickly and don't t
207.
by alsodumb 4y ago
Just a data point but we hire some undergraduate graders every semester and I think the pay is around $14/hr.
208.
by alsodumb 4y ago
Same with me. I got it pretty soon after announcement.
209.
by alsodumb 4y ago
Awesome work and it's a great HN contribution! I loved your blog post, it gave me a gist of everything I wanted to know without reading the paper (I have back ground in bandits). I have a couple of non-technical questions: 1. Can you s
210.
by alsodumb 4y ago
I wouldn't be so sure about the author making up the narrative, it very well could be real but it is definitely not the majority. I get what you are saying, but none of this would put "a Math grad student to shame". If you re

More ›