4 ms·
What do you think of life-long learning scenario that models are trained incrementally forever? For example, I train a model with 1000 examples, it sucks. The n
by XuMiao 8y ago
What do you think of life-long learning scenario that models are trained incrementally forever? For example, I train a model with 1000 examples, it sucks. The next guy pick it up and train a new one by putting a regularizer over mine. It might still suck. But after maybe 1000 people, the model begins to get significantly better. Now, I will pickup what I left and improve it by leveraging the current best. This continues forever.
Imagine that this community is supported by a block chain. We won't be relying on big companies any more eventually.
- jacquesm 8y agoWhat is it with the word 'blockchain' that will make people toss it into otherwise completely unrelated text?
- oehpr 8y agonothing, they're describing a series of content addressable blocks that link back to their ancestors. Which is a good application of a block chain. Think IPFS. It's not cryptocurrency. Though cryptocurrency definitely popularized the technique.
- fwip 8y agoIPFS isn't a blockchain just like git isn't a blockchain. "Blockchain" has semantic meaning that "a chain of blocks" does not.
- deleted 8y ago[deleted]
- SiempreViernes 8y agoThat recent period in time when it was a license to print money?
- Varcht 8y agoYou know, we love our overloaded terms? In this context it means "Decentralized storage". Keeps people on their toes, keeps the AI guessing.
- Terr_ 8y ago> What do you think of life-long learning scenario that models are trained incrementally forever? The same as the "life-long" coding scenario where monoliths are tweaked incrementally forever. They may have niches but they'll kinda suck, because the underlying problem-space evolves too. Code loses value with age.