3 ms·

It appears that they do support Prompt Caching: https://inference-docs.cerebras.ai/capabilities/prompt-caching https://inference-docs.cerebras.ai/capabilities/p

• abtinf 23d ago
  > How are cached tokens priced? > There is no additional fee for using prompt caching. Input tokens, whether served from the cache or processed fresh, are billed at the standard input token rate for the respective model. Well, talk about flipping the narrative.
  • Barbing 23d ago
    heh Is there a speed increase or is that purely marketing spin on “we might cache on our end but no discount for you”?
    • lostmsu 23d ago
      Pure marketing.
  • deleted 23d ago
    [deleted]
  • qlte 23d ago
    [dead]
• the_duke 23d ago
  It doesn't reduce the price though.
  • jasongill 22d ago
    Good catch, I guess I got lost in the marketing speak of the page!
• deleted 23d ago
  [deleted]