4 ms·
You can start asking it questions about a topic and it'll narrow down the data sets it needs and tell you how it can reduce resources needed to run / download b
by themodelplumber 3y ago
You can start asking it questions about a topic and it'll narrow down the data sets it needs and tell you how it can reduce resources needed to run / download based on what it knows you are talking about, or where you tell it this conversation needs to go. So you could in effect take a topic-constrained AI offline and continue the conversation in a more resource-friendly way than usual.
I don't know if this is really a thing that could be done but it'd be nice if somehow the AI could be a partner in reducing that energy / memory / CPU / data footprint. Like how we used to carry USB disks with portable apps, a portable AI
Just an idea