4 ms·
Petals runs Llama 2 (70B) from Colab at 5 tokens/sec
- borzunov 3y agoChat web app: http://chat.petals.ml http://chat.petals.ml Colab: https://colab.research.google.com/drive/1uCphNY7gfAUkdDrTx21dZZwCOUDCMPw8?usp=sharing https://colab.research.google.com/drive/1uCphNY7gfAUkdDrTx21... Project description: https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals
- borzunov 3y agoWe've moved to a new domain, the chat is now at https://chat.petals.dev https://chat.petals.dev
- amrb 3y agoGreat project and I'm happy to see it expand to more models!