3 ms·
Very interesting project! Are there benchmarks for the "compatibility mode" or are all the numbers for the Gigatoken API?
by dmezzetti 2mo ago
Very interesting project! Are there benchmarks for the "compatibility mode" or are all the numbers for the Gigatoken API?
- marcelroed 2mo agoNumbers are for the Gigatoken API, but compatibility mode just means eating a bunch of Python overhead (creating lists, reading strings to bytes). You can expect a modest ~200-300x speedup with compatibility mode depending on how you use it.
- robotresearcher 2mo ago> a modest ~200-300x speedup with compatibility mode marcelroed is modest, this speedup is not. Good work.
- marcelroed 2mo agoI can add some benchmarks for compatibility mode in the future. I have a little more juice to squeeze out of the Python interop though, so not quite ready for it yet.