3 ms·
The average cost of an academic NLP researcher is probably closer to $30k/year.
by mattkrause 6y ago
The average cost of an academic NLP researcher is probably closer to $30k/year.
- p1esk 6y agoMost universities have access to supercomputers, including GPU clusters. But that's not the point, not every NLP problem requires experimenting with 175B parameter models. Academic researchers shouldn't try to compete with Google or OpenAI in scaling up models. They should try to come up with new approaches. Our brains have been evolving under tight constraints (size, energy, noise, etc). Maybe a good academic problem to solve is "how can I do what GPT-3 does if I only have an 8 GPU workstation?" This might lead to all kinds of breakthroughs.