3 ms·
Do you think small models will arrive? I mean if I need to write a web application in typescript why should I use a model that knows all the programming languag
by emadb 5mo ago
Do you think small models will arrive? I mean if I need to write a web application in typescript why should I use a model that knows all the programming languages and it is able to reply to any questions about almost everything? I just a need a small performant model that knows how to write web applications in typescript. That could be very helpful and easy to run on my laptop.
- thot_experiment 5mo agoDepending on your laptop, if your laptop is a Strix Halo or a Macbook with a decent amount of ram, that day they arrived is about 6 months ago, and today if you can run Gemma 31b, you're golden for your basic workslop code. You can do most of it with local models. Heck, for a lot of the tier of programming you might encounter in the average job Qwen 35b MoE is good enough and it can hit 100tok/s on decent hardware.
- driese 5mo agoFor the same reason that a human who is fluent in five languages can probably express themselves better in either one compared to human that only speaks one, while also having a more nuanced understanding of general grammar. From what I know, learning on a more diverse set makes a model better overall.
- amelius 5mo agoThis might be an interesting research question: can you train a model on many languages, and then extract a much smaller model that knows only one language without much loss of quality?
- kelnos 5mo agoHumans brains and LLMs are not the same, though. I don't think your analogy is remotely applicable, even if your conclusion may be correct.