I was critiquing accuracy of ChatGPT, which has a certain cost. "Just use GPT4, 5, ..." was the solution proposed in response, but that ain't free. In fact, it'

I was critiquing accuracy of ChatGPT, which has a certain cost. "Just use GPT4, 5, ..." was the solution proposed in response, but that ain't free. In fact, it's one to two orders of magnitude more expensive.[0] I'm also pessimistic on custom hardware being that much of a help. I read about Cerberus's giant wafer chip in 2019[1] and even saw it at a conference in early 2020 pre-pandemic, and I have yet to see that make orders of magnitude worth of improvement. The attention mechanism simply requires huge amounts of multiply-adds, especially at GPT-scale. That costs energy and cash no matter how much custom hardware you throw at it. [0]https://openai.com/pricing https://openai.com/pricing [1]https://www.wired.com/story/cerebras-chip-cluster-neural-networks-ai/ https://www.wired.com/story/cerebras-chip-cluster-neural-net...