3 ms·
Cloudflare very recently launched new models, including the excellent Openhermes. The context size sucks though. Default max (sequence) tokens (stream): 512 De
by sergiotapia 3y ago
Cloudflare very recently launched new models, including the excellent Openhermes. The context size sucks though.
Default max (sequence) tokens (stream): 512
Default max (sequence) tokens: 256
https://developers.cloudflare.com/workers-ai/models/text-generation/ https://developers.cloudflare.com/workers-ai/models/text-gen...
- ErikBjare 3y agoThose are just defaults, not the maximum possible context size.
- sergiotapia 3y agoI see where can I read more about their max context size?