3 ms·
I like to think of Pandas as a replacement of Excel. I think where Pandas users go off the tracks is when you start getting to 100M rows and start having memory
by hervature 5y ago
I like to think of Pandas as a replacement of Excel. I think where Pandas users go off the tracks is when you start getting to 100M rows and start having memory/kernel issues. For many of us, it is obvious that the next station is a database with the transformations necessary. But not many people ever get to this scale. It doesn't help that Pandas has a read_sql() function.