3 ms·
Looks cool. What kind of delay would it add to a chatbot application?
by droobytrain 1y ago
Looks cool. What kind of delay would it add to a chatbot application?
- dwa3592 1y agoAuthor here. I need to calculate the timing delay but I don't feel any difference in speed in my local chatbot app, where every prompt is filtered. I am on Mac M3, 16GB.