6 ms·
Okay but hold your horses. Still a bit buggy. Sample output: Meta's Llama 3.1 models can output multilingual text which is awesome. Here are some examples out
by AMICABoard 2y ago
Okay but hold your horses. Still a bit buggy.
Sample output:
Meta's Llama 3.1 models can output multilingual text which is awesome. Here are some examples output of 8 bit quantized 8b model with 100 token output (-n 100)... Quantization creates some brain damage.
English
My cat is funny. "Funny cat," I say, walking up to it. "What are you up to?" It sits up straight and looks at me with a tilted head, as if to say, "What's wrong with you?" Sometimes I just have to laugh at how funny a cat can be. So I say, "Okay, you're funny. I'll give you some treats." It stretches out a little and I give it some treats. It eats them up quickly and starts
German
Besitzen Sie einen Amiga 500? Wenn nicht, werden Sie wissen, dass dies ein Computer war, der im späten 1980er und frühen 1990er Jahren für Spiele verfügbar war, die für Personen mit bestimmten Körperverletzungen gedacht waren. Manchmal müssen wir uns an frühere Zeiten erinnern, die, wie wir jetzt wissen, schwierig waren. Hier ist ein Link, der meine Geschichte bespre
French
Le vin français est, à bien des égards, un vin des origines, car il a joué un rôle important dans l'histoire de la France". La réputation des vins de France repose principalement sur leurs qualités gustatives et la gestion des vignobles contrôlée, ce qui rend le vin français un "produit d'exception". La France est donc leader mondial de la production de vin, avec 25 % des exportations mon
Thai
แมวของฉันตลกชอบเล่นบนม้วนกระดาษ และฉันก็ไม่แน่ใจว่าควรจะยินยอมที่จะให้เล่นหรือไม่
เมื่อเวลาผ่านไป ฉันเห็นว่าแมวของฉันเล่นม้วนกระดาษเป็นระยะ ๆ ฉันจึงตัดสินใจที่จะลองปรับเปลี่ยนเกมให้สนุกขึ้น
Hindi
मेरी बिल्ली बहुत मज़ाया है और वह हमेशा अपनी शारीरिक गतिविधियों से मुझे मजाक करती है। वास्तव में, जब वह अपनी खिलौनों की चपपेट में आती है तो वह विशेष रूप से क्लासिक बन जाती है। इसके अलावा, वह एक छोटी सी च
- FrostKiwi 2y ago> Quantization creates some brain damage. Love the wording.
- AMICABoard 2y agoMaybe we should make "Brain Damage Factor" a official term to denote how much types of quantizations degrade output compared to unquantized.:)
- Y_Y 2y agoI think that's known as degradation, but I think the brain damage metric could be usefully applies to the poor sods who try to get the quantization to work in the first place.
- AMICABoard 2y agoLol :)
- impossiblefork 2y agoThere's actually an old paper titled Optimal Brain Damage, where they don't try to find optimal quantizations, but optimal sparse versions of a models-- i.e. where some weights are set to zero.
- AMICABoard 2y agoInteresting, I heard something like that, but now I must read about it.
- nickpsecurity 2y agoI found… Optimal Brain Damage https://www.researchgate.net/publication/221618539_Optimal_Brain_Damage https://www.researchgate.net/publication/221618539_Optimal_B... Optimal Brain Compression https://openreview.net/pdf?id=ksVGCOlOEba#:~:text=The%20resulting%20algorithm%2C%20called%20the,weights%2C%20further%20reducing%20the%20loss https://openreview.net/pdf?id=ksVGCOlOEba#:~:text=The%20resu.... TinyVolt’s implementation of it: https://github.com/TinyVolt/optimal-brain-compression https://github.com/TinyVolt/optimal-brain-compression
- AMICABoard 2y agoThanks, I'll read it up. Interesting.
- nickpsecurity 2y agoThat was really for them. You’re out there building neat stuff. Your talent might warrant looking into AdderNets and Bitnets which might get the cost down. There’s also some brain-inspired designs. I don’t think many people have implemented such things. You might discover something new experimenting with them.
- AMICABoard 2y ago:)
- actionfromafar 2y agoEinen Amiga 500? Shut up and take my money!
- AMICABoard 2y agoJa Amiga 500! My first computer. Still in love with her...:)
- aninteger 2y ago> My cat is funny. "Funny cat," I say, walking up to it. "What are you up to?" It sits up straight and looks at me with a tilted head, as if to say, "What's wrong with you?" Sometimes I just have to laugh at how funny a cat can be. So I say, "Okay, you're funny. I'll give you some treats." It stretches out a little and I give it some treats. It eats them up quickly and starts This is kind of like 3rd grade English. What would be required to go beyond that?
- AMICABoard 2y agoActually "My cat is funny" was the prompt it continued that. I got to fix some stuff to reflect meta's implementation and also fix the chat mode, then it would be usable. Will take a few days to do that.
- trhway 2y ago>This is kind of like 3rd grade English This is also how you'd communicate with a cat or dog. We [still] can't use complex long sentences in communications with them. And the LLM seems to be nicely reproducing that style and mindset of complete yet small sentence-bites you're in when communicating with your Good Boy or your Funny Cat.
- AMICABoard 2y agoHmmm interesting take.
- alex_smart 2y agoThe Hindi output is garbage.
- AMICABoard 2y agoLikely, cos other langs too. The fault may be my incomplete implementation.