2 ms·
Is there a way to tune OpenWebUI or some other non-CLI interface to support this configuration? I have a rig with this exact spec, but I suspect the 20B model w
by unquietwiki 1y ago
Is there a way to tune OpenWebUI or some other non-CLI interface to support this configuration? I have a rig with this exact spec, but I suspect the 20B model would be more successful.