I guess you could add a sort of gating operation with a learnable parameter that sends the value to -inf if doesn't reach the threshold. Of course it might hav

I guess you could add a sort of gating operation with a learnable parameter that sends the value to -inf if doesn't reach the threshold. Of course it might have some other serious repercussions.