URL:
medium.com
3 comments
[deleted]
Looks cool. What kind of delay would it add to a chatbot application?
Author here. I need to calculate the timing delay but I don't feel any difference in speed in my local chatbot app, where every prompt is filtered. I am on Mac M3, 16GB.
[dead]