3 ms·

There are a couple now. Groq , sambanova and tenstorrent come to mind. The more the merrier. If we do need power plants worth of juice then it may as well be d

by Havoc 2y ago

There are a couple now. Groq , sambanova and tenstorrent come to mind. The more the merrier. If we do need power plants worth of juice then it may as well be dedicated custom hardware to optimise this to the max

ilaksh 2y ago
Thanks for telling me about Sambanova. Too bad they don't have an API. The speed is absolutely incredible. They actually have a demo where it just keeps re-running the chat completion as you are typing your query.
- Havoc 2y ago
  >Too bad they don't have an API. Think they do, but I couldn't sign up...the verify email just never arrived and eventually got fed up.
  - ilaksh 2y ago
    Where is the API sign up?