2 ms·
> usure where to start and what the hardware requirements would be Have a look at the localllama subreddit In short though dual 3090 is common, single 4090 or
by Havoc 3y ago
> usure where to start and what the hardware requirements would be
Have a look at the localllama subreddit
In short though dual 3090 is common, single 4090 or various flavours of M123 macs. Alternatively p40 can be jury-rigged too but research that carefully. In fact anything with more than one gpu is going to require careful research