3 ms·
Not as far as I'm aware, but it's probably possible on a smaller, hobbyist scale. I've been playing with a few GPT libraries this week (namely rust-bert[0]) and
by smoldesu 4y ago
Not as far as I'm aware, but it's probably possible on a smaller, hobbyist scale. I've been playing with a few GPT libraries this week (namely rust-bert[0]) and I've been really impressed with local generation results on my crappy 2 core netbook. I can get 2 sentences to generate in ~5 seconds, which is pretty good in my book.
Armed with a Pi-style SBC and your AI library of choice, I bet you could get pretty far implementing some toy-like behavior. Bonus points if you use Whisper for speech-to-text, and double brownie points if you can get an AI voice to read the generation back.
[0] https://github.com/guillaume-be/rust-bert/ https://github.com/guillaume-be/rust-bert/