Some numbers are posted in the comments: > … you can expect the speed to half when going from 4k to 16k long prompt … > … it did slow down somewhat (from 25T

Some numbers are posted in the comments: > … you can expect the speed to half when going from 4k to 16k long prompt … > … it did slow down somewhat (from 25T/s to 18T/s) for very long context … Depends on the hardware configuration (size of VRAM, speed of CPU and system RAM) and llama.cpp parameter settings, a bigger context prompt slows the T/s number significantly but not order of magnitudes. Facit: gpt-oss 120B on a small GPU is not the proper setup for chat use cases.