3 ms·

In my particular tests (YMMV), even 13B vicuna beats Bard, though... tough times for Google.

• morrbo 4y ago
  massive YMMV moment for me. my particular usecase was "extract the following attributes from a load of unstructured text, format the results as JSON". ChatGPT was the best (but only on 4 and Davinci), Vicuna just didn't perform at all (nor other variants of llama 7/13/33). Bard smashed it, relatively speaking, in terms of speed. I gave up pretty quickly though because of no information on pricing and/or API. It's funny how all-or-nothing these things seem to be
  • avereveard 4y ago
    On the smaller models you may want to split the task in smaller chunk either in parallel one value at a time or in sequence like extract the attributes, then take the output and ask to format it into a json
    • Tostino 4y ago
      In relation to this, when using GPT4, I have added the addendum to my prompts: "This seems like a lot of work, please split the work into two chunks, and let's start on the first chunk now." It will generally segment the problem in some logical way and work just fine, with vastly improved reasoning abilities due to not trying to do as much at once.
      • avereveard 4y ago
        Ah, clever, thanks for sharing.