3 ms·
Tangentially related, how much would you guys be willing to pay for a company that could deliver a local model implementation that could run on high tier consum
by asynchronous 3y ago
Tangentially related, how much would you guys be willing to pay for a company that could deliver a local model implementation that could run on high tier consumer grade hardware at a reduced ability?
I feel like even if there was some severe restrictions (model wasn't open source, DRM, etc.) I’d still be willing to fork out for it.
- fallingmeat 3y agoIs this the promise of Amazon Sagemaker?
- FanaHOVA 3y agoMLC Chat lets you run RedPajama 3B on an iPhone. It's free. You'd need to specify what type of model you're thinking about I guess?
- idkyall 3y agoI've seen at least one startup around this idea posted on HN: https://codecomplete.ai/ https://codecomplete.ai/ Probably also tiny corp for self hosting: https://geohot.github.io/blog/jekyll/update/2023/05/24/the-tiny-corp-raised-5M.html https://geohot.github.io/blog/jekyll/update/2023/05/24/the-t... I think there's a tremendous concern about letting data exfiltrate to any AI SaaS offering among business execs. If you could offer an experience minus the cloud that's easy to use and has compliance/logging features, I think you'd find success from industries that are reticent sharing customer data(e.g. Banking, government) who benefit greatly from the NLP workflows that LLMs enable