3 ms·
One time I came across a git repo that let me download a gigabyte of prime numbers and I thought to myself, is that more or less efficient than me running a pro
by jazzyjackson 3y ago
One time I came across a git repo that let me download a gigabyte of prime numbers and I thought to myself, is that more or less efficient than me running a program locally to generate a gigabyte of prime numbers?
The compute for a direct answer like that is fractions of a penny, it might be better to create answers on the fly than store an index of every question anyone has asked (well, that's essentially what the weights are after all)
- _factor 3y agoIt’s in interesting question. I assume they’re using accelerators, and the alternative is a disk or memory hit. It still seems expensive to me. https://www.linkedin.com/pulse/rising-cost-llm-based-search-azeem-azhar https://www.linkedin.com/pulse/rising-cost-llm-based-search-...