This is interesting but I'd love it if they'd split training and inference. Training might be highly expensive and conducted once, while inference might be less

This is interesting but I'd love it if they'd split training and inference. Training might be highly expensive and conducted once, while inference might be less expensive but conducted many, many times.