Loading the CSV through read_CSV then maybe querying it as json/dict. So read_csv(file).to_dict(orient='records') That changes the CSV data into a list of obj

Loading the CSV through read_CSV then maybe querying it as json/dict. So read_csv(file).to_dict(orient='records') That changes the CSV data into a list of objects. I had this problem in a project I was working on and it speed up the processing. You could then also revert the data back to CSV through DataFrame(list).to_csv(path to save the file)