3 ms·
that person's description is unnecessarily jargony. sparse tensor just means vector that's mostly zero and has some ones. take your corpus of concepts and numbe
by mlevental 7y ago
that person's description is unnecessarily jargony. sparse tensor just means vector that's mostly zero and has some ones. take your corpus of concepts and number them 0 to n-1. then each word you want to turn into a vec turns into a vector that has ones for concepts it's associated with and 0 elsewhere. learning that association is what word2vec does.
- rytill 7y agoCan you explain attention in this same way?
- mlevental 7y agonah i don't know much about LSTM but this looks like a fine tutorial https://towardsdatascience.com/intuitive-understanding-of-attention-mechanism-in-deep-learning-6c9482aecf4f https://towardsdatascience.com/intuitive-understanding-of-at...