sosodev

17 ms·

151.
by sosodev 10mo ago
Yes, and I'm a little ashamed to admit my morning routine wasn't the same without it.
152.
by sosodev 10mo ago
The claim that a small, fast, and decently accurate model makes a good foundation for agentic workloads seems like a reasonable claim. However, is cost the biggest limiting factor for agent adoption at this point? I would suspect that the m
153.
by sosodev 10mo ago
I love how detailed and transparent the data set statistics are on the huggingface pages. https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B... I've noticed that open models have made huge efficiency gai
154.
by sosodev 10mo ago
It’s all subjective. Personally I think it would border on useless for local inference but maybe some people are happy with low quality models at slow speeds.
155.
by sosodev 10mo ago
Even if they fire him he'll still have a huge amount of ownership in the company...
156.
by sosodev 10mo ago
Thank you for sharing this. Their point about the 128GB desktop mainboard being a bargain while their prices remain low rings true. I bought one a couple weeks ago because I've been wanting to build a beefy, efficient home server and I
157.
by sosodev 10mo ago
Yes, a sufficiently advanced marrying of TTS and LLM could pass a lot of these tests. That kind of blurs the line between native voice model and not though. You would need: * A STT (ASR) model that outputs phonetics not just words * An LLM
158.
by sosodev 10mo ago
It specifically says in the architecture docs for the agents platform that it's STT (ASR) -> LLM -> TTS https://elevenlabs.io/docs/agents-platform/overview#architec...
159.
by sosodev 10mo ago
You can test it by asking it to: change the pitch of its voice, make specific sounds (like laughter), differentiate between words that are spelled the same but pronounced differently (record and record), etc.
160.
by sosodev 10mo ago
Does elevenlabs have a real-time conversational voice model? It seems like like their focus is largely on text to speech and speech to text. Which can approximate that type of thing but it's not at all the same as the native voice to v
161.
by sosodev 10mo ago
Qwen's voice chat is nowhere near as good as ChatGPT's.
162.
by sosodev 10mo ago
Weirdly, I just tried it again and it seems to understand the difference between record and record just fine. Perhaps if there's heavy demand for voice chat, like after a new release, they load shed by using TTS to a smaller model. How
163.
by sosodev 10mo ago
I just got my framework mainboard today. I haven't had a chance to set it up yet but from the research I've been doing it seems like Minimax M2 might be the best coding model for it at the moment. Similar performance to Devstral2
164.
by sosodev 10mo ago
Huh, you're right. I tried your test and it clearly can't understand the difference between homophones. That seems to imply they're using some sort of TTS mechanism. Which is really weird because Qwen3-Omni claims to support
165.
by sosodev 10mo ago
Aren't all text messages routed through a server? I guess it's more decentralized when it comes to telecom though.
166.
by sosodev 10mo ago
Is your work open source?
167.
by sosodev 10mo ago
That's unfortunate but not too surprising. This type of model is very new to the local hosting space.
168.
by sosodev 10mo ago
I did find this app: https://github.com/gabber-dev/gabber The creator posted a little demo of it working with Qwen3 Omni that is quite impressive: https://www.youtube.com/watch?v=5DBFVe3cLto He didn&#x
169.
by sosodev 10mo ago
It does for sure. I did some more digging and it does real-time too. That's fascinating.
170.
by sosodev 10mo ago
I think it's because they've crammed vision, audio, multiple voices, prosody control, multiple languages, etc into just 30 billion parameters. I think ChatGPT has the most lifelike speech with their voice models. They seem to have
171.
by sosodev 10mo ago
Does Qwen3-Omni support real-time conversation like GPT-4o? Looking at their documentation it doesn't seem like it does. Are there any open weight models that do? Not talking about speech to text -> LLM -> text to speech btw I me
172.
by sosodev 10mo ago
And it can do it, right? I think AMD AI Max line the first realistic offering for this type of thing. The Apple offerings are interesting but the lack of x86, Linux, and general compatibility make it hard sell imo.
173.
by sosodev 10mo ago
If you just want to run a local LLM you could download ollama and do it in minutes. You'll be limited to small models (I would start with qwen3:1.7b) but it should be quite fast.
174.
by sosodev 10mo ago
The open weight model data is very interesting. I missed the release of Minimax M2. The benchmarks seem insanely impressive for its size. I would suspect benchmaxing but why would people be using it if it wasn’t useful?
175.
by sosodev 10mo ago
I so desperately wish it weren't abandoned. I hate that it's almost 2026 and I still can't get a fiber connection to my apartment in a dense part of San Diego. I've moved several times throughout the years and it has ne
176.
by sosodev 10mo ago
I’ve noticed that the open weight models have a lot of issues on OpenRouter. You get a lot of inconsistency in quality due to varying quants at least. I’ve had some seriously nonsensical responses from models that I can’t replicate at all w
177.
by sosodev 11mo ago
Because at that point you don't know where the data came from. You could be training on foreign propaganda without realizing it. Presumably they wouldn't be training on synthetic data produced by anything less than a open frontier
178.
by sosodev 11mo ago
If the performance is comparable to Qwen3 in practice that's quite impressive. Half the dataset being synthetic is interesting. I wonder what that actually means. They say that Datology needed 2048 H100s to generate the synthetic data.
179.
by sosodev 11mo ago
I'm fairly certain that it's happening right now. There is no threshold that LLMs need to "break through" to see adoption. The number of non-technical using them to write software is growing every day. I was working free
180.
by sosodev 11mo ago
How do you know their skills and knowledge are declining rapidly? Does using an LLM cause one to suddenly forget everything?

More ›