2 ms·
Note: if you read the paper carefully, this is LlaMA-derived, so suffers from the same use restrictions. We really need the open LLMs to catch up!
by zellyn 3y ago
Note: if you read the paper carefully, this is LlaMA-derived, so suffers from the same use restrictions. We really need the open LLMs to catch up!
- jimsimmons 3y agoRealistically you can assume there’ll be one soon and develop with these models and switch over
- quickthrower2 3y agoThere are some already (one of the openllamas I think, and that discord group made one with the linear attention recently although trained on fewer params I think) Maybe not easy to switch to a non-meta-llama ?