hardrave

3 ms·

1. 1.▲
   Show HN: NightRun, bare metal LLM inference, no OS, boots from USB(github.com)

   6 points by hardrave 2mo ago|0 comments
2. 2.▲
   by hardrave 2mo ago

   I had almost the opposite experience. Fable managed to build a pretty advanced low-level systems project for me end to end, while Opus kept getting stuck on the overall architecture. Opus was easier to steer, but Fable was much better at ac
3. 3.▲
   by hardrave 2mo ago

   3.5 tok/s, I would say it's pretty usable.
4. 4.▲
   by hardrave 2mo ago

   Quite useful. Please add GCP :)
5. 5.▲
   by hardrave 2mo ago

   I really like the project. Would be nice to have more languages.