3 ms·
yeah, SimpleChains definitely won't be useful for the next large language model, but there's a lot of very small models in the world from physics, to pharma, to
by adgjlsfhk1 5y ago
yeah, SimpleChains definitely won't be useful for the next large language model, but there's a lot of very small models in the world from physics, to pharma, to high frequency trading. Having libraries that are optimized for these usecases is a major benefit for a fairly large niche of users.
- dleslie 5y agoAnd video games, too. Small models may be useful for procedural content and dynamic environment and actor responses. The barrier, so far, had been the performance overhead of using them.
- dunefox 5y agoThe question is if these users don't already have all of their code in Python/C++/etc. and would even consider using Julia.
- liuliu 5y agoNeural network renaissance definitely renewed the interests to use neural networks as function approximators in many areas. For the one I am interested in recently (dynamics control), many networks are small feed-forward ones or two-layer LSTMs. The importance there is about balance robust controller v.s. update frequency. If you can run the same controller at higher frequency, it is basically free performance improvement (the robot will be more stable, more responsive etc.).