4 ms·
RL has been there since 2019 [1]. Aside from the previously-mentioned (and not necessarily incremental) React, CassandraDB, PyTorch, etc there is work in terms
by rajman187 4y ago
RL has been there since 2019 [1]. Aside from the previously-mentioned (and not necessarily incremental) React, CassandraDB, PyTorch, etc there is work in terms of egocentric data which is far larger than existing datasets [2], even more fundamental research related to mathematical optimization [3], and of course FAIR (used to be Facebook AI Research), which is now part of RL-R, who recently published work on language models [4].
It’s not all that well advertised but there is a lot of research that gets open-sourced so it’s a bit (understandably) naive to call it copied or incremental work.
[1] https://en.m.wikipedia.org/wiki/Reality_Labs https://en.m.wikipedia.org/wiki/Reality_Labs
[2] https://about.meta.com/realitylabs/projectaria/ https://about.meta.com/realitylabs/projectaria/
[3] https://github.com/facebookresearch/baspacho https://github.com/facebookresearch/baspacho
[4] https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/ https://ai.facebook.com/blog/democratizing-access-to-large-s...