4 ms·
Nice concept – but unfortunstely I found it to be incorrect in all of the examples I tried with my Mac. It'd also need to be much more precise in hardware spe
by abujazar 2y ago
Nice concept – but unfortunstely I found it to be incorrect in all of the examples I tried with my Mac.
It'd also need to be much more precise in hardware specs and cover a lot more models and their variants to be actually useful.
Grading the compatibilty is also an absolute requirement – it's rarely an absolute yes or no, but often a question of available GPU memory. There's a lot of other factors too which don't seem to be considered.
- rkagerer 2y agoI found it to be incorrect in all of the examples I tried Are you sure it's not powered by an LLM inside?
- abujazar 2y agoI believe it'd be more precise if it used an appropriately chosen and applied LLM in combination with web research – in contrast to juggling together some LLM generated code.
- ggerules 2y agoConfirmed. Nice idea but it doesn't really define"run". I can run some relatively large models compared to their choices. They just happen to be slow.