4 ms·
I like that you use a local model to start off; why switch to OpenAI for tokenization?
by ukuina 4y ago
I like that you use a local model to start off; why switch to OpenAI for tokenization?
- newhouseb 4y agoThe code supports both local and OpenAI as a backend, I added OpenAI as a backend because their models are still miles better than anything I can run locally (even 65B LLaMA)