4 ms·
I've tried o3 Pro for my use cases (parsing emails in the legal profession) and didn't have better results than the non pro. In fact, o1-preview has given me m
by starik36 1y ago
I've tried o3 Pro for my use cases (parsing emails in the legal profession) and didn't have better results than the non pro.
In fact, o1-preview has given me more consistently correct results than any other model. But it's being sunset next month so I have to move to o3.
- AaronAPU 1y agoIMO 4o is much better at people-parsing. The reasoning models o1-pro / o3-pro are really good at writing code and solving algorithmic problems.
- resters 1y agowhat is people parsing?
- starik36 1y agoThe email from the lawyer might mention lots of names. Who are the plaintiffs, who are defendants, their attorneys, assistants, or insurance adjusters. The model parses out who is who and connects names to titles to email addresses.
- resters 1y agoInteresting, that's what I thought it meant, but didn't realize it was a term of art.
- AaronAPU 1y agoThings like inferring the meaning of “people parsing” when it isn’t explicitly defined but can be implied by context. Not strict rational A+B=C, nuance.
- starik36 1y agoI've tried it with various models. And 4o is really good given that it returns data at least 10 times faster. But if you ask it to fill out a Json document, o3 (or other reasoning models) is still better, more correct and predictable. Or at least, better enough to justify waiting a minute for the API call to return vs 3-5 seconds.
- ActionHank 1y agoOut of interest, how widespread would you say this usage is amongst your peers in the legal profession?
- starik36 1y agoChatGPT is pretty widespread. The only obstacle in the past was the fear that confidential documents might be used for training. OpenAI fixed that with a business account type that guarantees no training. As far as usage of API for business processes (like document processing) - I can't say.
- AtlasBarfed 1y agoGuarantees ...... How? You should assume Facebook level morality.
- starik36 1y agoI hear you. But the in-house lawyer read and approved the SLA. So all asses are covered!