3 ms·
Which if you think about it, is awesome- a simple autoencoder and a transformer with tons of data. It's sort of the dream of ML since it combines automatic lea
by dekhn 4y ago
Which if you think about it, is awesome- a simple autoencoder and a transformer with tons of data. It's sort of the dream of ML since it combines automatic learning of a representation with a statistical sequence model using two methods which have been successful in a number of other fields, aren't that complicated for regular scientists to understand, and isn't that far from how people were modelling proteins before the ML revolution.