3 ms·

Note that 'no free lunch' has a specific meaning with no relation whatsoever to model size/quality trade-offs... https://en.wikipedia.org/wiki/No_free_lunch_th

Note that 'no free lunch' has a specific meaning with no relation whatsoever to model size/quality trade-offs... https://en.wikipedia.org/wiki/No_free_lunch_theorem https://en.wikipedia.org/wiki/No_free_lunch_theorem In the speed/quality trade-off sense, there have /often/ been free lunches in many areas of computer science, where algorithmic improvements let us solve problems orders of magnitude faster. We don't fully understand what further improvements will be available for LLMs.

pests 3y ago
That phrase comes from the more general adage though. https://en.wikipedia.org/wiki/No_such_thing_as_a_free_lunch https://en.wikipedia.org/wiki/No_such_thing_as_a_free_lunch
mewpmewp2 3y ago
Free lunch here relates to pricing/speed I would say, because gpt-4 and gpt-4-turbo are sold together. If gpt-4-turbo is cheaper, faster and has much larger context window, why would it make sense to also sell gpt-4... Unless it's a marketing trick or perhaps for backwards compatibility, which could also be.