2 ms·
I have yet to find a use case where quality can be traded off. Would love to hear what you had in mind.
by curious_cat_163 2y ago
I have yet to find a use case where quality can be traded off.
Would love to hear what you had in mind.
- Breza 2y agoI've encountered plenty of tasks where lower quality models work quite well. I prefer using Claude 3 Opus, DBRX, or Llama-3, but that level of quality isn't always needed. Here are a few examples. Top story picker. Given a bunch of news stories, pick which one should be the lead story. Data viz color picker. Given a list of categories for a chart, return a color for each one. Windows Start menu. Given a list of installed programs and a query, select the five most likely programs that the user wants.
- mvdtnz 2y agoEvery single use case of LLMs inherently sacrifices quality, whether the developers are willing to admit it or not. I agree with you though that there aren't many use cases where end users would knowingly accept the trade off.
- Lerc 2y agoIt is not so much a drop in quality as there are tasks that every model above a certain threshold will perform equally. Most can do 2+2 = 4. One test prompt I use on LLMs is asking it to produce a JavaScript function that takes an ImageData object and returns a new ImageData object with an all direction Sobel edge detection. Quite a lot of even quite small models can generate functions like this. In general, I don't even think this is a question that needs to be answered. A lot of API providers have different quality/price tiers. The fact that people are using the different tiers should be sufficient to show that at least some people are finding cases where cheaper models are good enough.