muskmusk

14 ms·

31.
by muskmusk 3y ago
I generally tend to agree with you. However, to give the opposing camp some credit: causation is not always so obvious. For example I don't think today's LLM capabilities followed obviously from the state of affairs in let'
32.
by muskmusk 3y ago
I agree with your general premise, but I think you left a couple of points of your list at the end: it is obscenely expensive to keep training + there are other more low hanging fruit + you expect hardware to get better over time. I don&#x2
33.
by muskmusk 3y ago
> I don’t think this rebuts the significance of emergence, since metrics like exact match are what we ultimately want to optimize for many tasks. Consider asking ChatGPT what 15 + 23 is—you want the answer to be 38, and nothing else. May
34.
by muskmusk 3y ago
There seems to be an element of vague definitions causing problems here. Humans grow linearly. We don't suddenly wake up 20 cm taller. Linear as that may be it still shows emergent behaviour when I am suddenly able to reach the cookie
35.
by muskmusk 3y ago
Ilya Sutskever says that one of his early insights is that neural networks can do most things that humans can do quickly . I think that applies here as well. Some people can do math quickly in their head, but most people cant. They need pe
36.
by muskmusk 3y ago
Pr's are not bad. But using them to solve things that should be solved other things like catching bugs and enforcing style guides is bad. If doing a pr takes longer than 5 minutes in general then consider if you are relying too much on
37.
by muskmusk 4y ago
> If we have learned one thing from deep learning, it is that scaling works. From the ImageNet [15] competitions and their various winners to ChatGPT, Gato [13], and most recently to GPT-4 [1], we have seen that more data and more comput
38.
by muskmusk 4y ago
Out of curiosity, why not?
39.
by muskmusk 4y ago
Rather than feeling scared I think you can use this to productively guide you. Look through the prompts he is using. Do they strike you as something a random person can produce? Not really. They show that Simon has excellent understanding o
40.
by muskmusk 4y ago
Assuming no-one is using the database yes. Also not trivial to set up and use plus vm startup is somewhat slow. If your want a full featured product (in the postgres space) that does it then look at neon.tech (no affiliation).
41.
by muskmusk 4y ago
Let's say we in fact do agree to pause AI research for 6 months as proposed. It could happen that the world comes together in perfect unison, figures out the regulatory details and then resumes research. It could also not happen. There
42.
by muskmusk 4y ago
Sure :)
43.
ChatGPT Plugins and Integration(dr0l3.github.io)
2 points by muskmusk 4y ago|2 comments
44.
by muskmusk 4y ago
Your job, no matter who you are, is always to please the customer. If you focus on that then you will be fine. But if your focus is a more selfish one then you could be exposed.
45.
by muskmusk 4y ago
Thank you. Glad to hear i am not the only one who sees this :)
46.
by muskmusk 4y ago
Not really. You just have checkbox somewhere that says "don't copy" and then it won't. Leave the decision to the user instead of baking it into the technology.
47.
by muskmusk 4y ago
In the olden days before Satya Nadella. Microsoft was a bloodsucking vampire of a company that couldn't execute anything of significance, but they had a pretty solid research department. Google could ofcourse sit on a much better versi
48.
by muskmusk 4y ago
I don't think the problem is one type of management vs another type of management. But about a completely disproportional application of one type of management. Heavy coding and no management have a place in the world. But no coding an
49.
by muskmusk 4y ago
This is almost always the prevailing idea. "Management are doing this on purpose". Dont think that is the case. Its more like we hired a somewhat poor manager, that manager hired yet more poor managers who in turn hired even more
50.
by muskmusk 4y ago
>The "it's been done before" one is pretty relevant. But is it? 99.999% of software development has been done before. Even if you do something that is legitimately new (like creating a chatbot that can generate code on dem
51.
by muskmusk 4y ago
As another new thing it is also useful in the real world.
52.
by muskmusk 4y ago
Not sure I understand the commotion. The same thing can be done in the real world with enough time and money. But somehow doing it digitally for free is a problem? If teenage girls don't know how to handle this then maybe we should tea
53.
by muskmusk 4y ago
TAKE MY MONEY!
54.
by muskmusk 4y ago
I think that if you could conclusively answer that question you would be sipping drinks on a beach somewhere. The people who are investing seems to think so. Also the applications of this tech is broader than search, but still includes it.
55.
by muskmusk 4y ago
I use a single folder of files along with a script that can fuzzy search said folder. It works perfectly. Knowledge is messy and doesn't really conform to a database schema. Certainly not one you would want to write :) I think a better
56.
by muskmusk 4y ago
It's not man Vs machine. It's man with machine. Learn to work effectively with "ai" and you will have no problem.
57.
by muskmusk 4y ago
I cant hold it in: Yeah it would be really convenient if there was some sort of global database that could hold all this data.
58.
by muskmusk 4y ago
This question was relevant 15 years ago when the tech for building something like this did not exist. Today the tech exists so it really doesn't matter. A still unsolved problem is how to moderate effectively. Spend your time with that
59.
by muskmusk 4y ago
https://hubermanlab.com/controlling-your-dopamine-for-motiva...
60.
by muskmusk 4y ago
The one that I didn't have to read. A mistake i see many engineers commit is obsess over their code and how "pretty" it is. What they seem to forget is that code is only read when it isn't doing what it's supposed t

More ›