3 ms·

> A great example is the machine learning: An immediate google gets you as far as 'install these 10x libs' then write this. This is because ML mostly uses Pyth

> A great example is the machine learning: An immediate google gets you as far as 'install these 10x libs' then write this. This is because ML mostly uses Python. And Python is an absolute clusterfuck of dependency hell. https://xkcd.com/1987/ https://xkcd.com/1987/

AYBABTME 4y ago
How do you get started with Python dependencies? I've been trying to play with some scientific code and never managed to get it to run and install its dependencies.
- mejutoco 4y ago
  If you are not using Windows you can use: pip: https://pypi.org/project/pip/ https://pypi.org/project/pip/ pipenv: https://pipenv.pypa.io/en/latest/ https://pipenv.pypa.io/en/latest/ poetry: https://python-poetry.org/ https://python-poetry.org/ Which are basically the same thing.
- simne 4y ago
  Read about virtualenv, or some of it's analogs. Yes, answer, You run Your scientific projects in chroot environment, with it's own Python and libraries, and connect to outer world via http-json or in some cases with csv files (pipes). To run with pipes, could run third party user space program, which will call different Python envs (fortunately it's easy, just find interpreter inside venv directory tree, and use it directly, instead of just python), and will feed them with data. And yes, sometimes this becomes real pain, because we humans, not machines, and it's easy to make mistake, when working with two so similar envs as typical Python.
  - simne 4y ago
    Also could share data with db, but I think it is not always good, to add (usually) heavy weight db libraries into venv, but pipes are lightweight, and csv/json/yml also not heavy.
bilekas 4y ago
> ML mostly uses Python This is a symptom maybe and not a cause. I preferred R-lang for data intensive even matlab, but I don't know because all tutorials are in Python and there is no low lvl ones.
HybridCurve 4y ago
I was a HPC system admin for years an I still avoid python because of this and having to manage 2-3 different versions for everyone that never updated their scripts. I hated it and to this day I do my best to write my own support routines in my programs to minimize pulling in anything but the most common libraries or packages.
- simne 4y ago
  You are lucky, have no much deal with js world, especially Node, but also affected React, etc. There real Hell. - I have not seen any real project, without few totally outdated libraries, which changed everything if You once decide update.

AYBABTME 4y ago

How do you get started with Python dependencies? I've been trying to play with some scientific code and never managed to get it to run and install its dependencies.

mejutoco 4y ago
If you are not using Windows you can use: pip: https://pypi.org/project/pip/ https://pypi.org/project/pip/ pipenv: https://pipenv.pypa.io/en/latest/ https://pipenv.pypa.io/en/latest/ poetry: https://python-poetry.org/ https://python-poetry.org/ Which are basically the same thing.
simne 4y ago
Read about virtualenv, or some of it's analogs. Yes, answer, You run Your scientific projects in chroot environment, with it's own Python and libraries, and connect to outer world via http-json or in some cases with csv files (pipes). To run with pipes, could run third party user space program, which will call different Python envs (fortunately it's easy, just find interpreter inside venv directory tree, and use it directly, instead of just python), and will feed them with data. And yes, sometimes this becomes real pain, because we humans, not machines, and it's easy to make mistake, when working with two so similar envs as typical Python.
- simne 4y ago
  Also could share data with db, but I think it is not always good, to add (usually) heavy weight db libraries into venv, but pipes are lightweight, and csv/json/yml also not heavy.

bilekas 4y ago

> ML mostly uses Python This is a symptom maybe and not a cause. I preferred R-lang for data intensive even matlab, but I don't know because all tutorials are in Python and there is no low lvl ones.

HybridCurve 4y ago

I was a HPC system admin for years an I still avoid python because of this and having to manage 2-3 different versions for everyone that never updated their scripts. I hated it and to this day I do my best to write my own support routines in my programs to minimize pulling in anything but the most common libraries or packages.

simne 4y ago
You are lucky, have no much deal with js world, especially Node, but also affected React, etc. There real Hell. - I have not seen any real project, without few totally outdated libraries, which changed everything if You once decide update.