So for huge log files would the entire thing be feed in with the offending lines of previous log files identified files in 4096 chunked tokens? Any one got a be

So for huge log files would the entire thing be feed in with the offending lines of previous log files identified files in 4096 chunked tokens? Any one got a better workflow for training based on the above scenario? These log files are multiple MBs within a few minutes from the Android kernel.