3 ms·
>What's the best way to use LLama2-70b without existing infrastructure for orchestrating it? That's an exercise left to the reader for now, and is where your v
by ramesh31 3y ago
>What's the best way to use LLama2-70b without existing infrastructure for orchestrating it?
That's an exercise left to the reader for now, and is where your value/moat lies.
- thewataccount 3y ago> That's an exercise left to the reader for now, and is where your value/moat lies. Hopefully more on-demand services enter the space. Currently where I am we don't have the resources for any type of self orchestration and our use case is so low/sporadic that we can't simply have a dedicated instance. Last I saw the current services were rather expensive but I should recheck.