3 ms·
But, it isn't running locally. It uses tools locally but the LLM is still shipping the output of those tools to Anthropic and running the inference there. A co
by johann8384 10mo ago
But, it isn't running locally. It uses tools locally but the LLM is still shipping the output of those tools to Anthropic and running the inference there.
A compromise to this would be Bedrock but that still ships the data to Amazon to execute the LLM on their processors.