4 ms·
“Have you tried…” It’s not “trying” that matters. What matters is testing. But nobody is testing LLMs… Or what they call testing is mostly shrugging and smilin
by satisfice 2y ago
“Have you tried…”
It’s not “trying” that matters. What matters is testing. But nobody is testing LLMs… Or what they call testing is mostly shrugging and smiling and running dubious benchmarks.
- kridsdale3 2y agoIf the imperative-code based apps that I've been shipping my whole career had failure rates on par with the *best* LLM prompts (think 10 to 35 percent), I'd not have a career.
- satisfice 2y agoThis is why I comment on Hacker News. Because sometimes I feel a little less alone. Cheers, friend.
- deepsquirrelnet 2y agoStanford NLPs framework DSPy really encourages a traditional ML development process. It’s about the only one I’d consider to be a true ML framework.