4 ms·

Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing mod

by tinco 3y ago

Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing model than GPT-4. If you're planning on keeping pace with competitive models we'd love to integrate the use of your model into our service.

rushingcreek 3y ago
If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.
- tinco 3y ago
  Makes sense, we're also very small (pre-seed) so definitely no cash cow for you guys yet. We probably shouldn't be prematurely optimizing our prompting performance as it's not really a bottleneck, but a 4x improvement just by swapping an API would be too good not to act on.
- mike_hearn 3y ago
  If you offer an API then you can be used with tools like https://aider.chat/ https://aider.chat/, which is the best way to use LLMs for coding. But if only available via the web it's not possible. BTW this is the main reason I pay for the OpenAI API.
- ilaksh 3y ago
  Please consider releasing an API. Having a faster alternative to GPT-4 would be amazing for so many use cases. Especially for agents that do function calling.
- halfjoking 3y ago
  If you offer an API you don't have to maintain a Visual Studio plugin. Trying to compete with tools like Cursor would be the real distraction. And Cursor is just the start - there will be innovative workflows built on top of APIs you can't predict. You're missing out not having developers build an ecosystem for you.
- karmajunkie 3y ago
  just as a point to consider, NOT having an api (and thus no integrations into my editors of choice) is the main reason i haven’t given y’all a fair test run. i’d almost rather not know what i’m missing (though the threads here have convinced me to give it a shot.)

by tinco 3y ago

rushingcreek 3y ago

If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.

tinco 3y ago
Makes sense, we're also very small (pre-seed) so definitely no cash cow for you guys yet. We probably shouldn't be prematurely optimizing our prompting performance as it's not really a bottleneck, but a 4x improvement just by swapping an API would be too good not to act on.
mike_hearn 3y ago
If you offer an API then you can be used with tools like https://aider.chat/ https://aider.chat/, which is the best way to use LLMs for coding. But if only available via the web it's not possible. BTW this is the main reason I pay for the OpenAI API.
ilaksh 3y ago
Please consider releasing an API. Having a faster alternative to GPT-4 would be amazing for so many use cases. Especially for agents that do function calling.
halfjoking 3y ago
If you offer an API you don't have to maintain a Visual Studio plugin. Trying to compete with tools like Cursor would be the real distraction. And Cursor is just the start - there will be innovative workflows built on top of APIs you can't predict. You're missing out not having developers build an ecosystem for you.
karmajunkie 3y ago
just as a point to consider, NOT having an api (and thus no integrations into my editors of choice) is the main reason i haven’t given y’all a fair test run. i’d almost rather not know what i’m missing (though the threads here have convinced me to give it a shot.)