ehsantn

5 ms·

1. 1.▲
   by ehsantn 1y ago

   The article highlights important challenges regarding Python performance optimization, particularly due to its highly dynamic nature. However, a practical solution involves viewing Python fundamentally as a Domain Specific Language (DSL) fr
2. 2.▲
   by ehsantn 2y ago

   Bodo is a JIT compiler for Pandas/Numpy code that statically types the code during compilation time. However, it infers types automatically (looks at file metadata etc) and not really built for manually typing everything. https:/
3. 3.▲
   by ehsantn 2y ago

   I think staying in Python is best to ensure the team's productivity. There are a lot of tools that help accelerate and scale Pandas code while trying to be as compatible as possible. You can look at "Pandas on Spark", Snowpar
4. 4.▲
   by ehsantn 2y ago

   Thanks!
5. 5.▲
   Show HN: Bodo – high-performance compute engine for Python data processing(github.com)

   11 points by ehsantn 2y ago|2 comments
6. 6.▲
   by ehsantn 5y ago

   Dask's architecture is unable to handle large scale data processing tasks (e.g. ETL, dataframe operations) because it's just a distributed task scheduler. It works as long as tasks have very little communication across them. But d
7. 7.▲
   Bodo: Scale Python Data Science to HPC Automatically(bodo-inc.com)

   2 points by ehsantn 7y ago|0 comments