Nice, i've been hoping this would be possible for a while. I'll have to do a new fine-tune of Inkbot on top of one of the 70b models. What are the max context

Nice, i've been hoping this would be possible for a while. I'll have to do a new fine-tune of Inkbot on top of one of the 70b models. What are the max context lengths / batch sizes you can train at with this method for 2x24gb? What about 4x24gb?