4 ms·
Yes, and the forward-only inference strategy. It seems like a normal question, so it starts answering, then carries on from there.
by thatjoeoverthr 1y ago
Yes, and the forward-only inference strategy. It seems like a normal question, so it starts answering, then carries on from there.
- genewitch 1y agoHow come there is not the equivalent of a stable diffusion "sampler * selection for LLMs? The restart sampler for stable diffusion is so good compared to most of the original samplers. I often try to get an answer from the LM studio people but I think I really should ask the llama.cpp people.