2 ms·What's time to first token? Raw throughput is usually not the problem in local setups in my experience.by bbatha 4mo agoWhat's time to first token? Raw throughput is usually not the problem in local setups in my experience.