4 ms·
This is great stuff, have you tried with local models? Summarization etc. is easy but I haven’t played with image to text models locally? Any ideas. I can run 3
by BloondAndDoom 8mo ago
This is great stuff, have you tried with local models? Summarization etc. is easy but I haven’t played with image to text models locally? Any ideas. I can run 32b models fine and for summarization kind of tasks they are extremely good I’d even say more than necessary
- fidorka 8mo agoHey, just released a new version with support for local models - you just configure the custom endpoint and model name and it should just work. Let us know what you think:)