3 ms·
I think I have a use for this but I’m realizing that I don’t know how to build a mental model of what is going to parallelize in this system. Surely some algori
by jes5199 2y ago
I think I have a use for this but I’m realizing that I don’t know how to build a mental model of what is going to parallelize in this system. Surely some algorithms are better and getting chopped up than others - how can I tell what is going on?
- mjaniczek 2y agoI think this is an unsolved tooling question right now. You could get some sense of the parallelism by using `/usr/bin/time` and dividing the wall time with the user time. You could look at the Task Manager / Activity Monitor / htop and see if it's using 800% CPU or whatever. You could use psrecord (https://pypi.org/project/psrecord/ https://pypi.org/project/psrecord/) to get a relatively finegrained CPU+mem usage graph across the duration of the program. But it would probably still be best to record some sort of stats in the Bend/HVM itself, enabled via a CLI flag. Reductions per ms, sampled across the program duration, or something like that. I'd be interested in anybody's ideas of what a good metric would be here! EDIT: CLI flag, not CPU flag