8 ms·
As seen on r/LocalLlaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/ https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/ For what it's worth
by mike210 1y ago
As seen on r/LocalLlaMA here: https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/ https://www.reddit.com/r/LocalLLaMA/comments/1kfkg29/
For what it's worth I pasted this into a few tokenizers and got just over 24k tokens. Seems like an enormously long manual of instructions, with a lot of very specific instructions embedded...
- jey 1y agoI think it’s feasible because of their token prefix prompt caching, available to everyone via API: https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching https://docs.anthropic.com/en/docs/build-with-claude/prompt-...