3 ms·
From the README dear god rwkv is fast. i switched to another tab after starting training it from scratch & when i returned it was emitting plausible english &
by all2 4y ago
From the README
dear god rwkv is fast. i switched to another tab after starting training it from scratch & when i returned it was emitting plausible english & maori words, i left to go microwave some coffee & when i came back it was producing fully grammatically correct sentences.
- solomatov 4y agoIt happens the same way if you train a small transformer. It learns to produce words very quickly.