with llama.cpp it's easier than ever too. i have used these models even just to vent about stuff or to rubber duck. it's pretty helpful, but i'm right there wit

with llama.cpp it's easier than ever too. i have used these models even just to vent about stuff or to rubber duck. it's pretty helpful, but i'm right there with you, local or nothing.