3 ms·
Free Dask cluster available to use at tcp://3.216.44.221:8786 tldr: you can use our 4-computer Dask cluster (including two GPUs, a GTX 1080Ti and a Radeon 690
by george_ciobanu 5y ago
Free Dask cluster available to use at tcp://3.216.44.221:8786
tldr:
you can use our 4-computer Dask cluster (including two GPUs, a GTX 1080Ti and a Radeon 6900XT) at no cost. If you need even more computing power, message me (george AT lindenhoney DOT com).
FAQ
What is Dask?
Dask is a Python framework for distributed computing, designed to enable data scientists to process large amounts of data and huge computations on a scale from 1 to thousands of computers.
How do I use the cluster you created?
Install Dask (python -m pip install "dask[complete]"
from dask.distributed import Client
client = Client(tcp://3.216.44.221:8786)
Use it! https://examples.dask.org https://examples.dask.org
Do I need to sign up?
No. You can literally just use it as above from any Python script or notebook.
Why are you making it available?
I’m looking to better understand how people use Dask and how to best make it available to data scientists as an easy to use service.
What can I use the cluster for?
Anything you want such as data science, web crawling (except spam, porn, illegal activities or DoS) etc. Please be nice.
Can I hack your cluster?
Probably not. But ff you find any security issues please let us know instead and we will fix them.
What’s the catch? Do you track my usage?
None. These are my gaming/closet computers that I just want people to use.
I do track anonymous function calls people make and the total volume of data that passes through the system (bandwidth, disk usage, RAM usage etc) but I do not look at or save any of your data.
How can I add my own worker machines to the cluster?
Easy - set up Dask worker(s) and point them to tcp://3.216.44.221:8786
How about security and confidentiality?
These are computers I have at home so all you have is my promise that I won’t look/save/copy your data or code. Pinky swear. However, it is possible for other unfriendly users to look at your data if you save it, even temporarily, on the disk, since all Dask tasks run under the same user.
Who are you?
https://www.linkedin.com/in/georgeciobanunyc https://www.linkedin.com/in/georgeciobanunyc
What if someone else who uses the cluster messes up with my data, copies it or otherwise takes it down?
Use your best judgement. I hardened the cluster’s security to the best of my ability but I can’t guarantee that someone else won’t mess with them. If you work for the NSA/a bank/IRS/etc you should definitely not upload sensitive data to these computers.
I need more GPUs or a bigger (hundreds or thousands of computers) cluster!
Glad to help, just email me (see above).
I need a larger cluster but private (using AWS, Azure, GCP)
Same as above, email me and I can help.
What are the computer specs?
Two of them are AMD processors with 8 physical cores each, the other is a quad core Intel and the last one is a Mac (Intel, 4 cores). The dedicated graphics cards (GPUs) are on the AMD computers.