3 ms·
tough to answer. depends on the llm, on the api provider or hosting method, on the prompt but you could get a simple estimate by running a CoT prompt, copying
by tikkun 2y ago
tough to answer. depends on the llm, on the api provider or hosting method, on the prompt
but you could get a simple estimate by running a CoT prompt, copying the output tokens, and then using an online token counter to count the length & tokens of the CoT part of the completion
- manili 2y agoThe issue is that I can give it a try on a set of toy problems, but finding a real-world-class problem is totally a different story IMHO. That is exactly the reason I asked about people's "experiences". Anyway thanks for the response.
- kingkongjaffa 2y ago> real-world-class problem The issue is that this notion is nonsense. There are just problems nothing about them makes them “world class” whatever that means.
- manili 2y agoFair enough, it's "nonsense". Curious to know about YOUR experience. Sounds "nonsense" yet?