3 ms·
We also just added Jev support https://github.com/browserbase/stagehand/pull/2952 https://github.com/browserbase/stagehand/pull/2952 On the act/extract/observe
by MiguelG719 14d ago
We also just added Jev support https://github.com/browserbase/stagehand/pull/2952 https://github.com/browserbase/stagehand/pull/2952
On the act/extract/observe evals it shows promising results being extremely efficient
- act: 4.3x faster, 97% fewer LLM calls. Pass rate: 97.5% -> 98.3%.
- heldout: 4.1x faster, 78% fewer LLM calls. Pass rate: 87.5% -> 97.5%.
- observe: 11.1x faster, 69% fewer LLM calls. Pass rate: 75.0% -> 83.3%.
- extract: 8.7x faster, 75% fewer LLM calls. Pass rate unchanged at 92%.
cost effectively 0