3 ms·
Removing GIL brings flexibility too. Assuming now you have a big dictionary, which contains tens of millions of records to be filtered upon, another say TB of
by karmasimida 5y ago
Removing GIL brings flexibility too.
Assuming now you have a big dictionary, which contains tens of millions of records to be filtered upon, another say TB of data. In current Python land, you either:
1. Using multi-processing, but each process needs to create its own dictionary
2. Or create an external DB, and using the DB's client to retrieve data in certain way.
This pattern has occurred again and again in my use case, and it is always messy to solve in Python. Had Python has true multi-threading, then sharing some big but read-only object among real threads would be a possibility, and believe me, a lot of people would be really happy.