You can ablate surprisingly large chunks of a model with near to no effect, you can try this easily - download an open weight model in torch. Obviously it’s no

You can ablate surprisingly large chunks of a model with near to no effect, you can try this easily - download an open weight model in torch. Obviously it’s not ideal but you could likely have single digit % of all weights affected and still have a useful model (many caveats here: e.g. locality of damaged weights matters, distribution of errors matters, fail high/low matters, …)