itamarst

7 ms·

31.
Beware of misleading GPU vs. CPU benchmarks(pythonspeed.com)
3 points by itamarst 3y ago|1 comments
32.
by itamarst 3y ago
NumPy default is that you iterate over the earlier dimensions first. The slow code is likely at least partially slow due to branch misprediction (this is specific to my CPU, not true on CPUs with AVX-512), see https://pythonspeed
33.
by itamarst 3y ago
Neat! Unfortunately at the moment it still ignores cgroups, it's just a wrapper around sched_getaffinity(). https://github.com/python/cpython/blob/6a69b80d1b1f3987fcec3...
34.
by itamarst 3y ago
That's not it. I updated the article with an experiment of processing 5 items at a time. The fast function doing 5 images at a time is slower than the slow function doing 1 image at a time (24*5 > 90). If your theory was correct, we
35.
How many CPU cores can you use in parallel?(pythonspeed.com)
183 points by itamarst 3y ago|98 comments
36.
by itamarst 3y ago
Visiting NYC a few weeks ago the bike-based restaurant delivery people were interesting to see, not a thing where I live. Relevant to "active time", they seemed to spend a lot of time during the day just waiting around...
37.
Using Polars in a Pandas World(pythonspeed.com)
2 points by itamarst 3y ago|0 comments
38.
Two kinds of threads pools, and why you need both(pythonspeed.com)
2 points by itamarst 3y ago|0 comments
39.
by itamarst 3y ago
There's presumably a reason they've spent the past 20 years adding additional instructions to CPUs, yeah :) And a large part of the Python ecosystem just ignores all of them. (NumPy has a bunch of SIMD with function-level dispatch
40.
by itamarst 3y ago
Author here. The original article I was going to write was about using newer instruction sets, but then I discovered it doesn't even use original SSE instructions by default, so I wrote this instead. Eventually I'll write that oth
41.
Speeding Up Cython with SIMD(pythonspeed.com)
1 points by itamarst 3y ago|0 comments
42.
by itamarst 3y ago
Author here: Note that this hasn't yet been updated for Cython 3, which does fix or improve some of these (but not the fundamental limitation that you're stuck with C or C++).
43.
Speeding up Floyd-Steinberg dithering: an optimization exercise(pythonspeed.com)
2 points by itamarst 3y ago|1 comments
44.
by itamarst 3y ago
Reminder that on Linux multiprocessing is broken out of the box, and you need to configure it to not freeze your process at random: https://pythonspeed.com/articles/python-multiprocessing/ (This will be fixed in f
45.
by itamarst 3y ago
Cython is really great at a small scale, but it has issues scaling up to large codebases (of Cython), where I think it's an anti-pattern. None of these are the fault of the Cython creators, it's really an extremely useful tool, it
46.
by itamarst 3y ago
There are electric folding bikes you can take inside with you.
47.
The easiest way to speed up Python with Rust(pythonspeed.com)
5 points by itamarst 3y ago|0 comments
48.
by itamarst 3y ago
It's nice to see how many different approaches to profiling there are these days in Python. I work on another (commercial but with free plan) Python profiler, Sciagraph: https://sciagraph.com . The main use case is data scie
49.
When NumPy is too slow(pythonspeed.com)
5 points by itamarst 3y ago|0 comments
50.
Python 3.7: 30% of PyPI downloads, end of life in 3 weeks(pythonspeed.com)
1 points by itamarst 3y ago|0 comments
51.
by itamarst 3y ago
Yeah, it was low again.
52.
Understanding CPUs can help speed up Numba and NumPy code(pythonspeed.com)
3 points by itamarst 3y ago|2 comments
53.
Choosing a good file format for Pandas(pythonspeed.com)
2 points by itamarst 3y ago|0 comments
54.
by itamarst 3y ago
There's a fun pair of alternate history novellas based on this: https://publishing.tor.com/americanhippo-sarahgailey/9781250...
55.
“Externally managed environments”: when PEP 668 breaks pip(pythonspeed.com)
6 points by itamarst 3y ago|0 comments
56.
Polars for initial data analysis, Polars for production(pythonspeed.com)
2 points by itamarst 4y ago|0 comments
57.
Staying secure by breaking Docker caching(pythonspeed.com)
1 points by itamarst 4y ago|0 comments
58.
by itamarst 4y ago
Just so you know who is funding this site: https://en.wikipedia.org/wiki/American_Council_on_Science_an...
59.
Speeding up text processing in Python (is hard)(pythonspeed.com)
5 points by itamarst 4y ago|1 comments
60.
by itamarst 4y ago
In normal sufficently-rich countries they call this a "hospital".

More ›