3 ms·
OLLAMA_FLASH_ATTENTION is essential for getting reasonable performance. Yes I did well with that laptop, it's been a trusty steed :) a refurb too.
by appsoftware 7mo ago
OLLAMA_FLASH_ATTENTION is essential for getting reasonable performance. Yes I did well with that laptop, it's been a trusty steed :) a refurb too.