3 ms·
I made an app for running t5 locally - compiled version allows you to run without installing anything. https://capsizegames.itch.io/chat-ai https://capsizegame
by w4ffl35 4y ago
I made an app for running t5 locally - compiled version allows you to run without installing anything.
https://capsizegames.itch.io/chat-ai https://capsizegames.itch.io/chat-ai
https://github.com/Capsize-Games/chatai https://github.com/Capsize-Games/chatai
- DoctorOetker 4y agointeresting, what are the hardware requirements? does it happen to run on CPU on a server with 96GB RAM?
- w4ffl35 4y agothe compiled app is meant for people to install and use with their GPU and runs on as low as a GTX 1080. I haven't tested against CPU only builds. You can take a look at the source code and see if it would be useful to you.