4 ms·
castform founder here. despite our bet on fine-tuned smaller open-source models, i'm still quite bullish on the big labs. i think scaled closed models will cont
by kumama 2mo ago
castform founder here. despite our bet on fine-tuned smaller open-source models, i'm still quite bullish on the big labs. i think scaled closed models will continue to dominate for more general purpose use-case like codegen, search, etc. but intelligence has lots of long-tail applications and i think for these longer-tail applications, finetuned custom models will rule
- sroussey 2mo agoProduct search model: https://www.linkedin.com/posts/introducing-ontology-1-ugcPost-7488272626277294080-XxvU/ https://www.linkedin.com/posts/introducing-ontology-1-ugcPos... Edit: more direct links, sorry: https://onton.com/research/ontology-1 https://onton.com/research/ontology-1 https://onton.com/research/ontology-1-benchmarks https://onton.com/research/ontology-1-benchmarks
- kumama 2mo agothis is really cool. i'm sure some of the larger e-commerce companies are already using clickstream data to tune better query rewriters/ranking models
- podocarp 2mo agoSorry but what is neurosymbolic model, it's not explained I think
- sroussey 2mo agoIMB YouTube video explainer: https://www.youtube.com/watch?v=ZfWDVO3rzeA https://www.youtube.com/watch?v=ZfWDVO3rzeA
- fennecfoxy 2mo agoI would also like someone to clarify this for me. I (think) I understand what people mean by a neurosymbolic model however common definitions are a bit funky. If it's neuro (llm/transformer similar) symbolic (symbolic with hand crafted rules) then, imo, that's no different from current tool calling harness implementations and I'd love for someone to explain it further to me if I've misunderstood. If it's neuro (llm/transformer similar) symbolic (symbolic rules that have also been learned via training) then yeah I can understand how it's a distinct concept. But every definition I've seen tells me that a standard harness of: query->llm->[tool call symbol + tool name + tool params] aka symbols governed by logic, including param/arg validation->llm->etc Already meets the requirements for being "neurosymbolic"...
- nosduhz 2mo agoCan totally see your point (and there are probably cases) where people are applying a harness on top of an LLM and calling it neurosymbolic. In our case with Ontology, it's the latter! Symbolic rules learned via training + constantly updating autonomously.
- nosduhz 2mo agoWoah thank you for posting!