4 ms·
How Fireworks evaluates quantization precisely and interpretably
- swyx 2y agocontext here is there has been some drama in the community between inference providers: - https://x.com/togethercompute/status/1818706177238397155 https://x.com/togethercompute/status/1818706177238397155 - https://x.com/dzhulgakov/status/1818753731573551516 https://x.com/dzhulgakov/status/1818753731573551516 - https://x.com/jiayq/status/1818786673695809793 https://x.com/jiayq/status/1818786673695809793