6 ms·
I have a fairly strong suspicion you could generate ggml C code from python models directly. Not even for execution from python, just to give you a performant
by regularfry 3y ago
I have a fairly strong suspicion you could generate ggml C code from python models directly. Not even for execution from python, just to give you a performant CPU model for any architecture rather than waiting for them to be manually ported.
Not sure that's a job for me, though - maybe someone else has already done it and I just haven't seen it yet?
- tekknolagi 3y agoIs ggml an easy to use library? That would make generating tensor-based networks easier for sure
- JonChesterfield 3y agoSounds like triton