4 ms·
> neither of us are going to spend millions of dollars training two versions of GPT-3 we will have to agree to disagree I encourage you to apply to TRC https:/
by sillysaurusx 4y ago
> neither of us are going to spend millions of dollars training two versions of GPT-3 we will have to agree to disagree
I encourage you to apply to TRC https://sites.research.google/trc/about/ https://sites.research.google/trc/about/
You'll be able to access millions of dollars worth of compute. It's how I got my start.
I love when I'm mistaken, since that's how science is pushed forward – we can't be certain we're right, only that we're not wrong yet. So it would be delightful if you formulate this into a testable hypothesis and falsify it yourself.
You can use The Pile to train your GPT: https://pile.eleuther.ai/ https://pile.eleuther.ai/