gas9S9zw3P9c

7 ms·

31.
by gas9S9zw3P9c 6y ago
Preface: I'd wait a few months before declaring it a game changer. There currently is a huge OpenAI marketing campaign going on touting how amazing GPT-3 is. Almost all the GPT-3 press comes from OpenAI's friends and network of YC
32.
by gas9S9zw3P9c 6y ago
My bet is on large-scale databases and data engineering. AI is hyped, but the sad truth is that a lot of the recent advances come from bigger models and making use of more data. Historically the same thing has happened a few times [0]. It&#
33.
Giving GPT-3 a Turing Test(lacker.io)
12 points by gas9S9zw3P9c 6y ago|2 comments
34.
by gas9S9zw3P9c 6y ago
Thanks for sharing your learning path and congrats to your success. There are so many great resources out there that it's possible for anyone to become an expert. Unfortunately, people like you who are willing to put in the hard work s
35.
by gas9S9zw3P9c 6y ago
The peer review system is so broken, especially with the number of submissions that the top journals get in ML now, that I don't even pay attention to what's accepted where anymore. It's all the same as arXiv to me. The best
36.
by gas9S9zw3P9c 6y ago
Oh yes, I don't think advanced math is required in any way. However, there is a difference in that researchers who have worked with these models for many years (often including having done some of the math) have a very good intuitive u
37.
by gas9S9zw3P9c 6y ago
I think you're absolutely right. In my experience 1. There is much more supply than demand in terms of Machine Learning and Data Science. There aren't actually that many jobs outside of research, it's just that the hype makes
38.
by gas9S9zw3P9c 6y ago
Definitely. I came from a software engineering background into AI 6+ years ago, and I was lucky to be there at the right time. From purely a career perspective, leaving aside that this may be your life's passion, I believe that right n
39.
by gas9S9zw3P9c 6y ago
As a researcher in the field I am not quite sure how I feel about these kind of resources. I am all for making research accessible to a wider audience and I believe that you don't need a PhD, or any degree, to do meaningful work. At th
40.
by gas9S9zw3P9c 6y ago
Another benefit that hasn't been mentioned in the comments is that it serves as documentation. As new developers come into your team, you need to describe the infrastructure setup. Having your infrastructure defined in a clean reposito
41.
by gas9S9zw3P9c 6y ago
I enjoyed Fooled By Randomness. Taleb's other books are good too, but Fooled By Randomness was my favorite.
42.
by gas9S9zw3P9c 6y ago
Well, I think it comes down to how you define search. People are amazed and how good GPT-3 is at generating text, but looking at it from a search lens, you could argue that rather than "generating" it searches for the most relevan
43.
by gas9S9zw3P9c 6y ago
As someone working in the field I have a few thoughts: 1. The way I think about these huge models is no longer as something that makes predictions, but rather as a kind of huge knowledge base (compressed training data as representations) wi
44.
by gas9S9zw3P9c 6y ago
There are some case studies on the website [0], but I would be wary of them. My experience from working in these kind of research environments is that the case studies are consulting jobs where a few PhD students do work for a company, and
45.
by gas9S9zw3P9c 6y ago
I also have problems understanding what exactly it does. I just briefly skimmed the paper, but it seems like the idea is as follows. Assuming you don't have ground truth labels for your data: 1. Generate many different nosiy labels for
46.
by gas9S9zw3P9c 6y ago
I used to work as a professional trader. I see this question so often, but it's just a strange question to ask. You are asking something like "I want to learn programming, you know, to make stuff like Apple or Google" - If yo
47.
by gas9S9zw3P9c 6y ago
I think this is true, but I don't think most people are aware of this. As the world becomes swamped with fake news and content of all forms, more people will realize that humans are not the rational beings they think they were. Perhaps
48.
by gas9S9zw3P9c 6y ago
A few thoughts: 1. This has been possible for a while. GPT-3 is impressive, but I don't see it enabling too many fundamentally new things because many interesting applications are in the tails of the distribution where you don't h
49.
Ask HN: Do you consider finance/trading to be an evil industry?
1 points by gas9S9zw3P9c 6y ago|3 comments
50.
by gas9S9zw3P9c 6y ago
Yeah, more or less. I'm not complaining about the JVM directly, but rather about what typical Java software, of which Kafka is one example, looks like, at least in my mind. Whenever I see JVM I think: Horrible user experience and tooli
51.
by gas9S9zw3P9c 6y ago
I'm curious - why do you call the hedge fund world evil? I hear this quite often but where does it come from? I've worked in both a hedge fund and in tech, and I found the former to be less evil and pretentious. People in finance
52.
by gas9S9zw3P9c 6y ago
> I am curious: based on your experience, do you think that, in principle, an omniscient observer of all transactions on stock exchanges and who made them could answer questions like this in many cases? If so, what concrete things would
53.
by gas9S9zw3P9c 6y ago
You're asking a great question. I used to work as a professional trader and the answer is that probably nobody really knows. Like you said, any explanation you hear about prices moving is just a narrative fallacy. People love hearing s
54.
by gas9S9zw3P9c 6y ago
Yep. I'm using containers and Kubernetes in production so I'm trying to stay far away from anything JVM-based. On top of being slow to start, memory hungry, and plagued by GC issues, JVM docker images are always huge. I don't
55.
by gas9S9zw3P9c 6y ago
I've used Kafka a lot in the past and I've been looking at Pulsar. The broker being stateless is great. I've had issues with moving partitions around in Kafka. That being said, I'm getting tired of managing these clunky
56.
by gas9S9zw3P9c 6y ago
The problem with this is that there is no context. It's impossible to verify or evaluate what happened. Who knows what "helped" means. It could be fixing a bug in an open source software product that was eventually used to re
57.
by gas9S9zw3P9c 6y ago
You're right, so I'd rather not so these claims on a resume at all. But, for example, if you've managed a team for several years or given a lot of talks, it's more likely that you're good at communicating ideas, sim
58.
by gas9S9zw3P9c 6y ago
Let me give you a slightly different take. There are no specific things I'm looking for. But here are a few red flags that have proven to be good indicators of who NOT to hire. Don't - Use high-level vague marketing speech like &q
59.
by gas9S9zw3P9c 6y ago
Well done! The only company that successfully managed to ride both the blockchain and AI hype :)
60.
by gas9S9zw3P9c 6y ago
The article lost me at "According to LinkedIn" :) I think this perfectly captures how Blockchain is something you put on your LinkedIn profile purely for signaling to recruiters and non-technical PR and marketing people that use L

More ›