4 ms·

Use the API and a 3rd party client like lobe. The API is way less restrictive.

• eurekin 3y ago
  I burn through my 10 USD limit in a weekend or two, if I'm using the API. Is that not an issue for you?
  • michaelt 3y ago
    $10 lasting two weekends sounds about right for a $20/month product?
    • eurekin 3y ago
      I'm using the chatgpt sometimes 2-3 hours a day. That could easily go 10x
  • teruakohatu 3y ago
    The trick is managing the context (number of tokens). It’s tempting to have a long conversation about tweaking some code, but a shorter context (last X messages), or ‘forking’ the conversation regularly can both improve performance and drastically lowers cost.
    • eurekin 3y ago
      How do you go about that (besides manually editing the whole prompt)?
      • blackoil 3y ago
        Get GPT3.5 (10th cost) to summarize previous conversation after every few prompts or once conversation history reaches certain size. Once your history is 5k tokens bring it down to 500.
        • eurekin 3y ago
          Oh! That's actually cool. Could use that mixtral on the next pc as well
  • Zetobal 3y ago
    Use the gpt4-turbo-preview it's 10x less expensive.