26 ms·

Just skimming the code, this is an impressive piece of work, probably one of the most comprehensive open source ASR implementations using deep learning I've see

Just skimming the code, this is an impressive piece of work, probably one of the most comprehensive open source ASR implementations using deep learning I've seen yet. It certainly looks correct based on the careful documentation (English comments would also help), but the most important part is providing a pre-trained model. Validating TF code can be an expensive and painstaking process, and if you have the weights, then sharing them proves that your net works. Saying this seems obvious, but very few open source implementations actually take that step, for whatever reason (not sure why).

deepnet 9y ago
The weights are also useful to build on, as an initialisation for a related task, or to look for semantic vectors without having to do the (often lengthy) training oneself. I second your call for more publishing of trained models as well as source code and applaud the OP for doing so. Great post.
jacquesm 9y ago
I suspect that the size of the weights file might have to do something with that. 500M+ is not strange and if enough people hit your small VPS or Amazon account that can either cause you to be rate capped, go down or go broke. It would be nice if a universal 'model+dataset+weights' sharing service would spring into being.
- carbocation 9y ago
  Seems like this is a perfect place to use Bittorrent: a large, desirable file for which you own the distribution permissions.
  - ambicapter 9y ago
    Yeah, that seems really obvious now that you say it. Not sure if there is such a thing as a cheap seedbox around.
- lern_too_spel 9y ago
  If you quantize the model, you already get a factor of 8 reduction in model size, and GitHub Releases allows files up to 2 GB.
- akhilcacharya 9y ago
  >It would be nice if a universal 'model+dataset+weights' sharing service would spring into being. I've asked for this multiple times and yet every time someone comes out of the woodwork saying it's been done or that nobody would use it. People usually link to the Caffe model zoos or something like this (potentially unsafe according to Chrome) https://www.gradientzoo.com/ https://www.gradientzoo.com/

deepnet 9y ago

The weights are also useful to build on, as an initialisation for a related task, or to look for semantic vectors without having to do the (often lengthy) training oneself. I second your call for more publishing of trained models as well as source code and applaud the OP for doing so. Great post.

jacquesm 9y ago

I suspect that the size of the weights file might have to do something with that. 500M+ is not strange and if enough people hit your small VPS or Amazon account that can either cause you to be rate capped, go down or go broke. It would be nice if a universal 'model+dataset+weights' sharing service would spring into being.

carbocation 9y ago
Seems like this is a perfect place to use Bittorrent: a large, desirable file for which you own the distribution permissions.
- ambicapter 9y ago
  Yeah, that seems really obvious now that you say it. Not sure if there is such a thing as a cheap seedbox around.
lern_too_spel 9y ago
If you quantize the model, you already get a factor of 8 reduction in model size, and GitHub Releases allows files up to 2 GB.
akhilcacharya 9y ago
>It would be nice if a universal 'model+dataset+weights' sharing service would spring into being. I've asked for this multiple times and yet every time someone comes out of the woodwork saying it's been done or that nobody would use it. People usually link to the Caffe model zoos or something like this (potentially unsafe according to Chrome) https://www.gradientzoo.com/ https://www.gradientzoo.com/