5 ms·
This just wrapping llama.cpp right? I’m sorry but I’m pretty tired of projects wrapping x.cpp. I’ve been developing a Rust + WebGPU ML framework for the past
by FL33TW00D 3y ago
This just wrapping llama.cpp right?
I’m sorry but I’m pretty tired of projects wrapping x.cpp.
I’ve been developing a Rust + WebGPU ML framework for the past 6 months. I’ve learned quickly how impressive the work by GG is.
It’s early stages but you can check it out here:
https://www.ratchet.sh/ https://www.ratchet.sh/
https://github.com/FL33TW00D/whisper-turbo https://github.com/FL33TW00D/whisper-turbo
- hluska 3y agoYou ripped on someone else’s work and promoted your own in the same comment?? You need to seriously reflect upon your ethics.
- FL33TW00D 3y agoI appreciate the work that went into slimming this binary down, but it's a ~negligble amount of work compared to llama.cpp itself. HN is inundated with posts doing xyz on top of the x.cpp community. Whilst I appreciate it is exciting - I wish more people would explore the low-level themselves! We can be much more creative in this new playground.
- spiderfarmer 3y agoWhy not both.
- meiraleal 3y ago> We can be much more creative in this new playground. You are not being creative gatekeeping, this behavior is quite old.
- hluska 3y ago[flagged]
- FL33TW00D 3y agoThis isn't directed at the author of this post. I was just referring to the plethora of thin x.cpp wrappers.
- animuchan 3y agoJust to add a different POV, this didn't register as an "insult" or "idiotic take" at all for me. If a project amounts to basically running another project's binary and displaying the results, it's fair criticism to point that out, is it not?
- meiraleal 3y ago> Just to add a different POV, this didn't register as an "insult" or "idiotic take" at all for me. Just to clarify. Are you the author?
- rgbrgb 3y agoIsn’t doing Stuff on top of it what it’s for? llama.cpp is explicitly highly portable systems code with bindings in many languages.
- tansan 3y agoWho's GG?
- europeanNyan 3y agohttps://github.com/ggerganov https://github.com/ggerganov
- 0xDEADFED5 3y agohttps://en.wikipedia.org/wiki/GG_Allin https://en.wikipedia.org/wiki/GG_Allin
- stavros 3y agoCan you elaborate on what you find impressive? I know nothing about this stuff so I can't appreciate it.
- Me1000 3y agoThis is really cool! Thank you for sharing! Excited to follow your progress!
- FL33TW00D 3y agoThank you!