letitgo12345

8 ms·

61.
by letitgo12345 4y ago
Issue is the data moat OAI is building. They'll have hundreds of millions of high quality user interactions with ChatGPT they can use to finetune their models. What will anyone else including Google have?
62.
by letitgo12345 4y ago
People really don't seem to understand just how far ahead OAI is in its reasoning abilities ( https://crfm.stanford.edu/helm/v0.2.2/?group=reasoning ) Maybe PaLM is near there (it's not evaluated on that p
63.
by letitgo12345 4y ago
Hope so. Don't want a single corporate entity (OAI/MS) dominating the entire economy. This sector desperately needs competition
64.
by letitgo12345 4y ago
"I'm looking for X. Can you give me a few options with the benefits and drawbacks of each" or "I'm looking for X. Can you ask me a few questions and give me a choice of products based on that" or "I'm
65.
by letitgo12345 4y ago
From what I heard, they don't have scaling capabilities to deploy the bigger models right now which they're working on and that's the biggest issue.
66.
by letitgo12345 4y ago
They have been collecting human feedback data for 2 years + probably have a lot of data from Copilot + are training with large context models + have invested a ridiculous amount in curating pretraining data -- the kind of stuff that won&#x2
67.
by letitgo12345 4y ago
Imagine Walmart launching a ChatGPT interfaced bot for shopping that customers take a liking to. Walmart starts acquiring both new customers as well as high quality data they can use for RLHF for shopping. Eventually Walmart's data moa
68.
by letitgo12345 4y ago
I would prefer to say that we've seen a glimpse of what a future world with a perfect reasoner will be like
69.
by letitgo12345 4y ago
It's definitely not just copying verbatim. If you mean it's emulating the reasoning pattern it sees in the training data well...don't humans do that as well to get answers to novel problems?
70.
by letitgo12345 4y ago
I guess the meaning of our existence was always handing the universe over to the AI overlords lol
71.
by letitgo12345 4y ago
Will take a bit of time before AI can consistently beat us on coding/proofs but the raw ingredients imo are there. As someone who was skeptical of AGI via just scaling things up even after GPT-3, what convinced me was the chain of thou
72.
by letitgo12345 4y ago
They sank it in "customer obsessed research" lol
73.
by letitgo12345 4y ago
Where are you getting the 200 number from?
74.
by letitgo12345 4y ago
Even the best Google models seem to be lagging for reasoning tasks vs OpenAI ones at the moment - see the graphs at https://github.com/suzgunmirac/BIG-Bench-Hard
75.
by letitgo12345 4y ago
They're paid so presumably safer at least
76.
by letitgo12345 4y ago
Ughh and they don't offer logprobs for the chat interface...
77.
by letitgo12345 4y ago
It's 10 cents/1K tokens - far cry from the 2 cents/1K tokens that equivalent size models OpenAI was offering
78.
by letitgo12345 4y ago
> It is stunning that Amazon wasn't the forerunner in using ChatGPT/LLM-based tech for Alexa I'm a current scientist at Amazon. Amazon has little ability to invest in longer term research. While you have scope to pursue pr
79.
by letitgo12345 4y ago
Theano preceded Tensorflow by 8 years. So I don't think it was all manual coding before TF. Torch (in Lua) was also around much before TF
80.
by letitgo12345 4y ago
You would be taking snippets of code (that are potentially unparseable), concating them together and putting it in the prompt. The issue is that it would be kind of prompt the model has never seen before in the training data. Maybe it would
81.
by letitgo12345 4y ago
Not sure how easy it would be to make work. Code edit data is not that prevalent. The best I can think of is looking at github commit changes. That's one place where Repl.it has a big advantage as it has live editing data from its user
82.
by letitgo12345 4y ago
I think they find a N^2.778 complexity algorithm (obtained by applying their 4x4 discovered algorithm recursively) so this is not correct.
83.
by letitgo12345 5y ago
The realistic future is Chinese social media companies (and by proxy Chinese govt) ruling the internet instead of Facebook and Twitter :)
84.
by letitgo12345 6y ago
Flip side -- the pioneering research may not have been possible without govt funding of science through a grant based system. Imo the right conclusion here is to increase govt funding massively. Unclear to me how to not do it based on a gra
85.
by letitgo12345 6y ago
It's a bit trickier than that as the flash freezing process is on the scale of milliseconds iirc which can affect what ensemble of folds are seen via cryo-em
86.
by letitgo12345 6y ago
Maybe the reason some Asians are successful given the opportunities is because such stories are thought of as uplifting instead of lamenting against the system. The system is bad but what's wrong with celebrating and finding inspiratio
87.
by letitgo12345 7y ago
MIT has an exception for homeless students.
88.
by letitgo12345 7y ago
I doubt it's easy to isolate
89.
by letitgo12345 7y ago
Even apart from undercounting of case #s, we know that the # of severe cases is 5% upper bound which is much more likely to be accurate and the deaths are a fraction of that so I would bet on the number being on the lower end than the highe
90.
by letitgo12345 7y ago
My impression is that a lot of interesting "leads" are generated by ground based telescopes and only then examined in more detailed by space based telescopes. If you kill off the generating mechanism, then effectiveness of space t

More ›