4 ms·
this appeared some time ago, https://taalas.com/ https://taalas.com/, but I'm sure there's others thinking these same thoughts. this would be best for small mod
by sometimelurker 4mo ago
this appeared some time ago, https://taalas.com/ https://taalas.com/, but I'm sure there's others thinking these same thoughts.
this would be best for small models imo, nothing frontier because that changes too fast
- 1e1a 4mo agoyou can try it out here: https://chatjimmy.ai/ https://chatjimmy.ai/
- Meetvelde 4mo agothat's so fast it feels fake
- the_sleaze_ 4mo ago13,789 tok/s Well I've gotten one of those "holy fuck this is the future" deeply unsettled anxious feelings in my gut again. It's been a week or 2, it was time.
- froh 4mo agoi only found one discussion of the tech here on HN https://news.ycombinator.com/item?id=47103661 https://news.ycombinator.com/item?id=47103661
- agazso 4mo agoIt's indeed super fast, but the output is complete BS hallucination. Not sure what's the value of this.
- runeks 4mo agoIt's a proof of concept that it's possible to etch a neural net into a chip and get massive performance (and efficiency) boost