3 ms·
How does it work exactly? How this model is cheaper and has the same perf as Opus 4.5?
by worldsavior 8mo ago
How does it work exactly? How this model is cheaper and has the same perf as Opus 4.5?
- anthonypasq 8mo agothis is called progress
- metaltyphoon 8mo agoOr, we can bleed out cash for a very long time.
- worldsavior 8mo agoI'm asking technically how progress works. What is actually being improved here
- anthonypasq 8mo agomostly cost of hardware going down. as models scale, nvidia produces a new hardware generation that outputs more tokens per watt, but those speed gains get eaten by the fact that the model is bigger ie. more expensive to serve. Also we have no clue whether Anthropics inference margin is compressing or not and they just want to maintain the price.
- red2awn 8mo agoDistilling from a teacher (Opus 4.5) and scaling RL more.
- worldsavior 8mo agoSo less parameters but "better" weights?