3 ms·
This isn't true. Lots of people care deeply and use 3.5 levels of performance at some point in their software stack. For lots of applications the speed/quality
by nl 3y ago
This isn't true. Lots of people care deeply and use 3.5 levels of performance at some point in their software stack.
For lots of applications the speed/quality/price trade offs make a lot of sense.
For example if you are doing vanilla question answering over lots of documents then 3.5 or Mixtral are better than GPT4 because the speed is important.
- huytersd 3y agoIt’s a price issue because 3.5 and 4 response times are about the same for me.