4 ms·
Vectorflow: Minimalist neural network library faster than TensorFlow in D
- smegsicle 5y agowhat does it take to get a good word-to-vec--style model going- or are those not 'sparse' ?
- VHRanger 5y agoThey should be sparse -- the input to Word2Vec is one-hot encodings of words in the models dictionary
- softinio 5y agoI am curious to know more about what lead to D lang being chosen for this project?
- VHRanger 5y agoCheck the blog post - They wanted the same language for implementation and user API - They wanted a single machine, CPU bound runtime where the executable is the model Given these, D and Go make sense - easy to pick up, compiles fast and performant.
- maxloh 5y agoWhy is D so unpopular? It seems to be a decent language.
- qualudeheart 5y agoNot enough marketing. Too much competition in the alternative systems language space.
- hintymad 5y agoI wonder if "faster" really matters. The implementation-level optimization seems paled when compared to productivity, ecosystem, and algorithm-level and hardware-level boost. Case in point, Caffe2 wanted to be the backend of PyTorch in FB, yet failed. MxNet claims to be "faster" than PyTorch in pretty much every way and Smola personally pushed orgs in AWS AI really hard to adopt MxNet and Gluon* yet failed. The latter failure is particularly worth mentioning: all teams in AWS AI complied and adopted MxNet but then three years later decided to move to PyTorch. All-in-all, the incremental speed boost was simply irrelevant.
- dr_zoidberg 5y agoI keep a few projects at work where we train models with Keras+TensorFlow. Twice before I tried to switch to PyTorch, because it did have nicer features/syntax for research and SOTA models, but deploy and support was limited on the toolchain we use, so we had to stay with Keras+TF. I'd still like to switch to PyTorch because of a few goodies, but the deploy of the models on some platforms is still simpler starting from a TF model. If anyone has a few links or resources to point me to, I'm more than happy to make a third try.
- stainablesteel 5y agoif there was constant deployment in some large industrial niche, faster implementations might help you save on your electric bill
- yvdriess 5y agoVectorflow was my gateway drug to Dlang.
- MuffinFlavored 5y agoWhat are interesting things you can do with a minimalist neural network, or even a full blown neural network for that matter? You just kind of like... train a data set, hope you don't under or overtrain, and then what? Feed it some input, get out an approximate output?
- cinntaile 5y agoTheir usecase is explained in the accompanying blogpost. https://netflixtechblog.medium.com/introducing-vectorflow-fe10d7f126b8 https://netflixtechblog.medium.com/introducing-vectorflow-fe...
- deleted 5y ago[deleted]
- nl 5y agoThis is interesting. Modern NN implementations (Pytorch/TF) are optimised for training deep neural networks on GPUs. This is instead designed for shallow neural networks on CPUs. That's similar to the original Word2Vec implementation, and there are lots of similar use cases where this could be useful
- 1024core 5y agoIs it faster though when it's running on a distributed system with 128 machines?
- IfOnlyYouKnew 5y ago“ Vectorflow is a minimalist neural network library optimized for sparse data and single machine environments.”