3 ms·
Kinda makes you wonder if the OpenAI team is rapidly dealing with memory leaks caused by maliciously formed prompts to ChatGPT right now. Or maybe they wrote it
by repastat3hmasta 4y ago
Kinda makes you wonder if the OpenAI team is rapidly dealing with memory leaks caused by maliciously formed prompts to ChatGPT right now. Or maybe they wrote it in a memory-safe language?
- jjgreen 4y agoI doubt it, the GCs would give it a stutter.
- foxyv 4y agoIf you are doing it right, on multi-threaded computers, modern GCs will usually not result in freezes or stutter. Usually, even on older GCs, only a Full Mark and Sweep GC will cause a pause in operation. If you are seeing a lot of Full GCs usually that means that you aren't managing memory properly or have un-closed resources building up.