3 ms·
They do. Karpathy spoke about it in on Tesla AI day. They use it for transforming image space to a vector space. See: https://youtu.be/j0z4FweCy4M https://yout
by dexter89_kp3 5y ago
They do. Karpathy spoke about it in on Tesla AI day. They use it for transforming image space to a vector space.
See: https://youtu.be/j0z4FweCy4M https://youtu.be/j0z4FweCy4M (timestamp 54.40 onwards)
- sillysaurusx 5y agoCan you provide a more specific timestamp? 54.40 doesn't seem to mention anything about transformers, and "onwards" is two hours. I'd be really surprised if they use transformers due to how computationally expensive they are for anything involving vision. EDIT: Found it. 1h: https://www.youtube.com/watch?v=j0z4FweCy4M?t=1h https://www.youtube.com/watch?v=j0z4FweCy4M?t=1h Fascinating. I guess transformers are efficient.
- dexter89_kp3 5y agoI gave the timestamp where they start talking about the problem they are trying to solve using transformers. As you said it is around 1hr mark