3 ms·
I've been working on a basic multi-layer perceptron network using IndexedDB. I found IDB performance is not quite as fast as needed to pull it off with the algo
by taylorbuley 14y ago
I've been working on a basic multi-layer perceptron network using IndexedDB. I found IDB performance is not quite as fast as needed to pull it off with the algos I was using
- option_greek 14y agoIs there any specific reason you are using a DB in this case ? As I understand, for most of the cases, the neural net data stays in memory and is persisted to disk only to save and load the network.
- taylorbuley 14y agoFor me the big win is if this can be done purely on the client side. I see two main advantages: 1) the user doesn't have to give up her privacy in exchange for recommendations 2) the service doesn't have to burn CPU it would have had to otherwise
- dave_sullivan 14y agoWhen you train your network, you'll want to be loading mini-batches into memory. I've found flat files just fine for data sets of about 50,000 to 300,000 samples. The model itself will just be a matrix and a vector for each layer. Feel free to email me if you have any questions about getting going/speeding things up, happy to help. They can be really slow or reasonably fast depending on the implementation.