4 ms·
> I spend much longer trying to figure out how to get 1-trit training to work and I never could. What did you try? What were the research directions at the tim
by sixfiveotwo 2y ago
> I spend much longer trying to figure out how to get 1-trit training to work and I never could.
What did you try? What were the research directions at the time?
- llm_trw 2y agoThis is a big question that needs a research paper worth of explanation. Feel free to email me if you care enough to have a more in-depth discussion.
- sixfiveotwo 2y agoSorry, I understand it was a bit intrusively direct. To bring some context, I toyed a little with neural networks a few years ago and wondered myself about this topic of training a so called quantized network (I wanted to write a small multilayer perceptron based library parameterized by the coefficient type - floating point or integer of different precision), but didn't implement it. Since you mentioned your own work in that area, it picked my interest, but I don't want to waste your time unnecessarily.
- llm_trw 2y agoSomeone posted a paper that I didn't know about, but goes through pretty much all the work I did in the space: https://news.ycombinator.com/item?id=42095999 https://news.ycombinator.com/item?id=42095999 It's missing the colourful commentary that I'd usually give, but alas, we can't have it all.
- sixfiveotwo 2y agothank you, that looks awesome.