4 ms·
It feels absolutely amazing to build an AI startup right now: - We struggled with limited context windows [solved] - We had issues with consistent JSON output
by hubraumhugo 3y ago
It feels absolutely amazing to build an AI startup right now:
- We struggled with limited context windows [solved]
- We had issues with consistent JSON output [solved]
- We had rate limiting and performance issues with 3rd party models [solved]
- Hosting OSS models was a pain [solved]
It's like your product becomes automatically cheaper, more reliable, and more scalable with every major LLM advancement. I'm going to test the new Claude models against our evaluation and test data soon.
Obivously you still need to build up defensibility and focus on differentiating with everything “non-AI”.
- behnamoh 3y agoI'd argue it's actually risky to build an AI startup now. Most any feature you bring to the table will be old news when the AI manufacturers add that to their platform.
- TheGeminon 3y agoYou just need to focus niche and upmarket, OpenAI is e.g. never going to make that "clone your chats and have your LLM-self go on pre-dates" app that went around Twitter.
- behnamoh 3y agoYeah but that kind of stuff doesn't generate income, they're just cute programming toys.
- Havoc 3y agoWhat was the solution on Jain? Gbnf grammars?
- Havoc 3y agoJSON not Jain sigh autocorrect
- deleted 3y ago[deleted]
- bvm 3y ago>- Hosting OSS models was a pain [solved] what's the solution here? vllm?