nschucher

3 ms·

1.
by nschucher 6y ago
Maybe we can look for historical examples of how legislation had a positive impact on a widespread harmful habit. Early on, the U.S. Congress adopted the Federal Cigarette Labeling and Advertising Act of 1965 and the Public Health Cigar
2.
by nschucher 6y ago
They trained a >600B parameter translation model (GPT-3 is 175B parameters). GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ( https://arxiv.org/abs/2006.16668 )
3.
by nschucher 6y ago
I'm as impressed as anyone with GPT-3 samples, but you're sort of ignoring the symbol grounding elephant in the room regarding language models ( https://openreview.net/pdf?id=GKTvAcb12b ). Language models are not gr
4.
by nschucher 8y ago
They have published multiple major TTS papers since the original WaveNet paper in 2016. Including the recent Tacotron results with impressive style control. Tacotron (Mar. 2017): https://arxiv.org/abs/1703.10135 Parall
5.
by nschucher 8y ago
This is called federated learning[0] at least by Google. I don't know whether they've added this to more products or whether it works well. It would be interesting to see this done in open source. [0] https://ai.googleb
6.
by nschucher 9y ago
They're most likely referring to adversarial attacks where degenerate inputs are constructed that could cause AlphaGo Zero to perform sub-optimally or catastrophically fail (see OpenAI Research [0]). This is distinct from generative ad
7.
by nschucher 9y ago
It was trained with self-play and evaluated on AlphaGo Lee (the version that beat Lee Sedol) and AlphaGo Master (the version that beat Ke Jie and I believe a number of online matches against top-ranked professional players).
8.
by nschucher 9y ago
>No one is ever going to use word vectors to figure out what genders are capable of what jobs. How can you possibly make this claim? Biased word embeddings have the potential to bias inference in downstream systems (whether it's ano
9.
by nschucher 10y ago
Have you seen the results from Dynamic Memory Networks? [0] The relevant example from the paper: I: Jane went to the hallway. I: Mary walked to the bathroom. I: Sandra went to the garden. I: Daniel went back to the garden. I: Sa
10.
by nschucher 10y ago
DeepMind is the name of an AI company that was acquired by Google. https://deepmind.com/ AlphaGo is the program that beat Go. These game playing algorithms are variations of Deep Q Learning Reinforcement Learning algos.