Harrisonv

3 ms·

1. 1.▲
   by Harrisonv 3y ago

   perfect recall is often a function of the architecture allowing for data to bleed through linkages. you can increase the perfect token recall through dialated wavenet structures, or, in the case of v5, the use of multi-head linear attention
2. 2.▲
   by Harrisonv 3y ago

   Try rwkv-demo-api.recursal.ai if you want to try it and dont want to wait for gradio
3. 3.▲
   by Harrisonv 3y ago

   For linear transformers, the current metric is "perfect token recall", the ability for the model to recall a randomized sequence of data. You can find the limit of a particular model architecture by training a model of a particula