4 ms·

Great points. Dont even get me started about how function calling in other LLMs costs me tokens. Something OpenAI provides OOTB. I'm also not a big fan of OpenA

Great points. Dont even get me started about how function calling in other LLMs costs me tokens. Something OpenAI provides OOTB. I'm also not a big fan of OpenAI's lock in. Right now I'm on a huge Claude 3 Haiku kick. That said, OpenAI does seem to get the APIs right and my hunch is the new Assistants API is going to potentially disrupt things again. Time will tell.

heggy 2y ago
I would love to be using Claude, but you can't get API access (beyond an initial trial period) in the EU without providing a European VAT number. They don't want personal users or people to even learn and experiment I guess.
- bjterry 2y ago
  You can use the Claude APIs via OpenRouter with a pre-paid account.
  - heggy 2y ago
    Thanks, this did the job!
- metaskills 2y ago
  Interesting, would Amazon Bedrock be an alternative? That's how I use Claude.
- Jimmc414 2y ago
  I'd guess it's more likely about the additional programming needed to meet GDPR compliance requirements.
msp26 2y ago
> Dont even get me started about how function calling in other LLMs costs me tokens. Something OpenAI provides out of the box. Not sure what you mean by this.
- metaskills 2y ago
  I have some assumptions/guesses on how billing works. Gonna do a post on this on my unremarkable.ai blog, please do signup for posts there, no spam. I could be right or wrong but need to do some experiments and publish later.
benreesman 2y ago
Opus is really cool. I’ve found it to have a few persistent bugs in what I initially assumed is tokenization but now wonder if might be more fundamental, but modulo a few typographical-level errors, I personally think it’s the most useful of the API-mediated models for involved sessions. And there are some serious people at Anthropic, they’ll get the typo thing if they haven’t already (been a busy week and change, they easily could have shipped a fix and I overlooked it).

heggy 2y ago

I would love to be using Claude, but you can't get API access (beyond an initial trial period) in the EU without providing a European VAT number. They don't want personal users or people to even learn and experiment I guess.

bjterry 2y ago
You can use the Claude APIs via OpenRouter with a pre-paid account.
- heggy 2y ago
  Thanks, this did the job!
metaskills 2y ago
Interesting, would Amazon Bedrock be an alternative? That's how I use Claude.
Jimmc414 2y ago
I'd guess it's more likely about the additional programming needed to meet GDPR compliance requirements.

msp26 2y ago

> Dont even get me started about how function calling in other LLMs costs me tokens. Something OpenAI provides out of the box. Not sure what you mean by this.

metaskills 2y ago
I have some assumptions/guesses on how billing works. Gonna do a post on this on my unremarkable.ai blog, please do signup for posts there, no spam. I could be right or wrong but need to do some experiments and publish later.

benreesman 2y ago

Opus is really cool. I’ve found it to have a few persistent bugs in what I initially assumed is tokenization but now wonder if might be more fundamental, but modulo a few typographical-level errors, I personally think it’s the most useful of the API-mediated models for involved sessions. And there are some serious people at Anthropic, they’ll get the typo thing if they haven’t already (been a busy week and change, they easily could have shipped a fix and I overlooked it).