gsandahl

5 ms·

1.
by gsandahl 6mo ago
Agree, this is where llms can uncover new perspectives!
2.
by gsandahl 6mo ago
Oh lord, imagine asking ”serious” questions https://opper.ai/ai-roundtable/questions/you-are-standing-in...
3.
by gsandahl 1y ago
Most of the tasks have assessed with ground truth, occasionally helped with an LLM as a judge to assess the answer if the answer is a sentence and not an exact result. Example: Given a long travel journal How many cities does the author men
4.
by gsandahl 1y ago
We are running task specific benchmarks across a number of categories (agentic tasks, context tasks, normalization tasks etc), and on our benchmarks we see Gpt-5 rating slightly below o3. But at a much lower cost. See https://opp
5.
by gsandahl 1y ago
Please do and give us some feedback!
6.
by gsandahl 1y ago
I think just how far you can go with examples has been an interesting learning! As these models have become smarter, they are also getting better at reasoning from examples and understanding intent. We will be publishing some research in th
7.
by gsandahl 1y ago
No up to date demo video unfortunately :( Sounds like a great use case though!
8.
by gsandahl 1y ago
We have been thinking a bit about this, and one option would be to have some form of locally hosted runner. You can optimize the task in the cloud and deploy it locally. Something like that. It is possible to plug in custom models so techni
9.
by gsandahl 1y ago
Yes that's possible! You can populate examples of great outputs to task specific datasets and have those be automatically populated to the prompt. More info here: https://docs.opper.ai/capabilities/learning
10.
by gsandahl 1y ago
Thanks for the shout out!
11.
by gsandahl 1y ago
Co-Founder here thanks for taking a look at Opper! I’m hanging around the thread all day, so feel free to ask anything, share feedback, or tell us where you’d like the product to go next
12.
Schema Based Prompting: Structured Inputs for Predictable Outputs(opper.ai)
4 points by gsandahl 2y ago|0 comments
13.
by gsandahl 2y ago
Its on that trajectory at least :)