4 ms·

> 153 slides in 45 minutes (and fail) less is more :) one one the best and most memorable talks i went to was 4 slides long. that said i've been thinking a lo

> 153 slides in 45 minutes (and fail) less is more :) one one the best and most memorable talks i went to was 4 slides long. that said i've been thinking a lot the past week or so about a machine i can dedicate to scientific computing, preferably using Sage noteboks or something like that. i have some long running evaluations (graphs) that i would rather not crush my laptop for. and so i get to thinking about the kind of machine i want to do this on, something parallel is tempting because of the higher speed gains. that said, i'm wondering if that would help Python (and hence Sage) or not. so now i'm looking at something like iJulia (Julia in an IPython notebook) and cobbling together something like this. than i see your parallel python mods and wonder if i should try this. should i? will it help me in my use case (speeding up a Sage server)?

turnersr 12y ago
My guess is that you can't drop in PyParallel without any work of porting Sage because it's not clear how you would pass objects around like those used for GAP. Sage also would have to be rewritten to use this new API of implementing protocol-based classes. You probably don't want to use all of Sage for that anyway because you are most likely not using GAP, for example. Instead gut out parts of Sage and look at IPython's interface to Spark http://nbviewer.ipython.org/gist/JoshRosen/6856670 http://nbviewer.ipython.org/gist/JoshRosen/6856670 or implement a protocol for your specific computation and use PyParallel. I highly doubt you just point to new a Python implementation and tell Sage to just roll with it and expect things to be automagically faster. Also, if you have a long running job, then why would you do it in a notebook that requires you to keep your browser open?
- jnazario 12y ago
  thanks, turnersr, all good points.
- trentnelson 12y ago
  ^^^ what turnersr said. (Spot on, by the way.)
GFK_of_xmaspast 12y ago
Depending on what kind of graph problem you might consider graphlab or one of the other specialty graph processing systems out there.
vit_tucek 12y ago
I use cloud.sagemath.com for offloading heavy computational work.

turnersr 12y ago

My guess is that you can't drop in PyParallel without any work of porting Sage because it's not clear how you would pass objects around like those used for GAP. Sage also would have to be rewritten to use this new API of implementing protocol-based classes. You probably don't want to use all of Sage for that anyway because you are most likely not using GAP, for example. Instead gut out parts of Sage and look at IPython's interface to Spark http://nbviewer.ipython.org/gist/JoshRosen/6856670 http://nbviewer.ipython.org/gist/JoshRosen/6856670 or implement a protocol for your specific computation and use PyParallel. I highly doubt you just point to new a Python implementation and tell Sage to just roll with it and expect things to be automagically faster. Also, if you have a long running job, then why would you do it in a notebook that requires you to keep your browser open?

jnazario 12y ago
thanks, turnersr, all good points.
trentnelson 12y ago
^^^ what turnersr said. (Spot on, by the way.)

GFK_of_xmaspast 12y ago

Depending on what kind of graph problem you might consider graphlab or one of the other specialty graph processing systems out there.

vit_tucek 12y ago

I use cloud.sagemath.com for offloading heavy computational work.