4 ms·

https://arcprize.org/leaderboard https://arcprize.org/leaderboard $13.62 per task - so we need another 5-10 years for the price to run this to become reasonabl

• igravious 8mo ago
  That's not a long time in the grand scheme of things.
  • throwup238 8mo ago
    Speak for yourself. Five years is a long time to wait for my plans of world domination.
    • amelius 8mo ago
      Yes, you better hurry.
    • tasuki 8mo ago
      This concerns me actually. With enough people (n>=2) wanting to achieve world domination, we have a problem.
      • gowld 8mo ago
        n = 2 is Pinky and the Brain.
        • antonvs 8mo ago
          I'm convinced that a substantial fraction of current tech CEOs were unwittingly programmed as children by that show.
      • throwup238 8mo ago
        It’s not that I want to achieve world domination (imagine how much work that would be!), it’s just that it’s the inevitable path for AI and I’d rather it be me than then next shmuck with a Claude Max subscription.
        • pixl97 8mo ago
          I mean everyone with prompt access to the model says these things, but people like Sam and Elon say these things and mean it.
        • amelius 8mo ago
          Don't build your castle in someone else's kingdom.
• onlyrealcuzzo 8mo ago
  Why 5-10 years? At current rates, price per equivalent output is dropping at 99.9% over 5 years. That's basically $0.01 in 5 years. Does it really need to be that cheap to be worth it? Keep in mind, $0.01 in 5 years is worth less than $0.01 today.
  • willis936 8mo ago
    Wow that's incredible! Could you show your work?
    • onlyrealcuzzo 8mo ago
      https://epoch.ai/data-insights/llm-inference-price-trends https://epoch.ai/data-insights/llm-inference-price-trends
• re-thc 8mo ago
  What’s reasonable? It’s less than minimum hourly wage in some countries.
  • willis936 8mo ago
    Burned in seconds.
    • gowld 8mo ago
      Getting the work done faster for the same money doesn't make the work more expensive. You could slow down the inference to make the task take longer, if $/sec matters.
      • willis936 8mo ago
        You're right, but I don't think we're getting an hour's worth of work out of single prompts yet. Usually it's an hour's worth of work out of 10 prompts for iteration. Now that's a day's wage for an hour of work. I'm certain the crossover will come soon, but it doesn't feel there yet.
        • re-thc 8mo ago
          > but I don't think we're getting an hour's worth of work out of single prompts yet But I don't think every developer is getting paid minimum wage either. > Now that's a day's wage for an hour of work For many developers in the US that can still be an hour's wage.
• golem14 8mo ago
  A grad student hour is probably more expensive…
  • elromulous 8mo ago
    In my experience, a grad student hour is treated as free :(
    • golem14 8mo ago
      You never applied for a grant, have you?
  • zipy124 8mo ago
    Grad students are incredibly cheap? In the UK for instance their stipend is £20,780 a year...
  • Tom1380 8mo ago
    As it should be. They're a human!
• tedd4u 8mo ago
  5-10 years? The human panel cost/task is $17 with 100% score. Deep Think is $13.62 with 84.6%. 20% discount for 15% lower score. Sorry, what am I missing?