3 ms·
Don't make Naked LLM calls. Protect your users and their data
- deleted 1y ago[deleted]
- lexiciccone 1y ago[dead]
- droobytrain 1y agoLooks cool. What kind of delay would it add to a chatbot application?
- dwa3592 1y agoAuthor here. I need to calculate the timing delay but I don't feel any difference in speed in my local chatbot app, where every prompt is filtered. I am on Mac M3, 16GB.