Just learned about it the other day from this thread from Feb, 2024: https://old.reddit.com/r/LocalLLaMA/comments/1aqrd7t/i_made_an_inference_sever_that_support

Just learned about it the other day from this thread from Feb, 2024: https://old.reddit.com/r/LocalLLaMA/comments/1aqrd7t/i_made_an_inference_sever_that_supports_repeating/ https://old.reddit.com/r/LocalLLaMA/comments/1aqrd7t/i_made_... Has some interesting github links.