molli

25 ms·

1. 31.▲
   Show HN: Like grep but for natural questions. Mixtral 8x7B – 28 tok/s on 8GB GPU(github.com)

   10 points by molli 3y ago|0 comments
2. 32.▲
   by molli 3y ago

   hi, it's cpu, makes full use of simd on multiple cores and i got 3 tok/s. it's also memory mapped, so it stays in ram once it's loaded. the weights are 8 bit quantized. it can run as a server and is the backend of https
3. 33.▲
   Show HN: Inference Mixtral 8x7B in pure Rust(github.com)

   4 points by molli 3y ago|2 comments
4. 34.▲
   Show HN: Most mentioned people on Lex Fridman Podcast(twitter.com)

   6 points by molli 4y ago|4 comments
5. 35.▲
   Show HN: Follow this Twitter bot and get the fastest growing GitHub Repos daily(twitter.com)

   5 points by molli 4y ago|1 comments
6. 36.▲
   Show HN: Hedgy.app – Search Engine for the Lex Fridman Podcast(hedgy.app)

   4 points by molli 5y ago|1 comments
7. 37.▲
   Show HN: Built a shop that turns images into artworks and open sourced the code(github.com)

   3 points by molli 5y ago|0 comments