3 ms·
Must be a way to prune the nn with some reduction of quality. Probably a means to reduce the quality until it is on an Arduino and some like an anonymous video
by bhouston 8y ago
Must be a way to prune the nn with some reduction of quality. Probably a means to reduce the quality until it is on an Arduino and some like an anonymous video.
There was speech synethsis on the apple iie in like 64k of RAM and a 1mhz CPU.
- jsjohnst 8y ago> There was speech synethsis on the apple iie in like 64k of RAM and a 1mhz CPU. Speech synthesis is far far far easier than parsing a human voice, especially when it doesn’t need to sound realistic (as was the case back then).
- thesz 8y agoCurrent approach of speech recognition is about as old (maximum likelihood using WFST). In the old papers about problem, there was vocabulary size of 64K words, because nothing was working for bigger vocabularies.
- kenarsa 8y agoPruning is a great idea to reduce memory usage. One thing to be careful with is that pruned matrices use irregular memory access and they might be slower as we don't have SIMD support for sparse matrix multiplication on generic CPU's (e.g. ARM) yet.
- thesz 8y agoYou may decompose matrix for each layer into two matrices with a bottleneck layer. E.g., A=BC (approximately) where A is MxN matrix and B and C are MxK and KxN matrices, where K is small enough. It is done using SVD and improves speed without sacrificing memory access patterns.