3 ms·
Most likely those models would be extracted from the hardware in no time.
by szatkus 14d ago
Most likely those models would be extracted from the hardware in no time.
- amelius 14d agoI suspect no, because most of the tokens would be used for its internal reasoning loop, and a cheaper model could be used to obfuscate the output.