5 ms·

Show HN: 1000 GitHub Data Science projects, now executable in 1 click

125 points by sanketsarang 6y ago

sanketsarang 6y ago
I am Sanket and I’m the founder of BlobCity (cloud.blobcity.com). We’re building the largest repository of data science models, with a one-click execution made possible. We call it the A.I. Cloud. Data Science models, today are scattered, and as an engineer and architect of systems, I’ve personally experienced, there is a lot of time spent on trying out the right models, versioning, collaboration and execution. Not everything works alongside everything. We’ve now made this achievable by running a cloud infrastructure where you can not only explore the DS projects, but also run it on the cloud with 1-click. Collaborate with your fellow team mates and work together on a ready Jupyter ecosystem together. Here are some key things to know: • Explore and run, 1000+ GitHub projects on the cloud • Unlimited open source Cloudbooks for free • We have spent time and effort to curate the top projects that our team and existing users nominated for and tried to keep the UX clean and easy to use. Suggest any that you’d want to see in here, a one-click deployment worthy project.
- victor9000 6y ago
  Search by text assumes that I'm looking for something specific. But it would be great if we could sort results by github stars, for people that are just window shopping. It would also be great if projects could be assigned topics that users could then use to filter results.
  - sanketsarang 6y ago
    Yes, absolutely agree. We just launched today. A lot of work is still in progress :)
- gabereiser 6y ago
  I checked out your 1000+ GitHub projects I could explore. I clicked on the "Run" button. Immediately prompted to create an account. Immediately closed the tab.
  - sanketsarang 6y ago
    Interesting. Were you trying to "Run" just to see if "Run" works, or were you interested in executing a specific repository? Basically we allow users to make their own personal editable copies of the Cloudbook. When you "Run", it is first replicating the Cloudbook into your account and then running. You can edit the code in your copy without affecting the main Cloudbook. Free unlimited CPU, RAM & Storage gets included with every Cloudbook for you to make continuous edits and perform repeat runs, including long running run operations. Not sure how we can achieve this without a registration. Do you have something in mind?
    - gabereiser 6y ago
      I was kinda half expecting a few demos to just run without having to create an account to prove the value of your platform. If I have to create an account to figure that out, I’m not going to and I’m going to go explore another product. Once your value prop is apparent, I’m sure people will have no problem signing up. I just didn’t see that before being nagged to create one.
      - sanketsarang 6y ago
        That's a brilliant suggestion. We are making a change to allow all public Cloudbooks to be run in guest mode (without registration) for 30 mins. The Cloudbook will auto shutdown in 30 mins to prevent any misuse. Would this be enough to assess the value prop?
      - sanketsarang 6y ago
        On related topic, what would you consider a good value proposition? Meaning what are the things you would expect out of BlobCity for you to become a registered and loyal member?
gumby 6y ago
I suggest you put some info right at the top to explain what Blob City is. Like a headline/call to action: "one-click execution of the largest repository of data science models" And a link to "learn more!"
- sanketsarang 6y ago
  Planning this for the next deployment. Coming right up ...
- deleted 6y ago
  [deleted]
purple-again 6y ago
Not really my space so all I have to offer is a super minor nitpick. On iPhone the hamburger doesn’t do anything when I click on it in landscape or portrait. Best of luck with your project!
- sanketsarang 6y ago
  Oopsie, this CSS stuff. Fixing right up.
sanketsarang 6y ago
We missed saving the GitHub stars in the search index, and need to re-index all over again. Until then, here are the top 10 most starred Data Science projects on GitHub that you can now run for free on BlobCity. jakevdp/PythonDataScienceHandbook - 27k stars https://cloud.blobcity.com/#/ps/view-cloudbook/4dcbb39e-5504-4d4a-8e23-b6d210be6c3d/base/CPU?name=jakevdp%2FPythonDataScienceHandbook https://cloud.blobcity.com/#/ps/view-cloudbook/4dcbb39e-5504... ageron/handson-ml - 21.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/67219954-282d-49df-8484-4bd966fb1a15/base/CPU?name=ageron%2Fhandson-ml https://cloud.blobcity.com/#/ps/view-cloudbook/67219954-282d... fchollet/deep-learning-with-python-notebooks - 11.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/f4ee1d51-fe2d-43df-8b26-8c61bd421183/base/CPU?name=fchollet%2Fdeep-learning-with-python-notebooks https://cloud.blobcity.com/#/ps/view-cloudbook/f4ee1d51-fe2d... ageron/handson-ml2 - 11.6k https://cloud.blobcity.com/#/ps/view-cloudbook/febe3f7a-b244-4eaf-8407-9b03b26eb5ea/base/CPU?name=ageron%2Fhandson-ml2 https://cloud.blobcity.com/#/ps/view-cloudbook/febe3f7a-b244... fastai/fastbook - 10.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/b49537b2-73b9-40ad-9bbc-e489285e83ee/base/CPU?name=fastai%2Ffastbook https://cloud.blobcity.com/#/ps/view-cloudbook/b49537b2-73b9... httctgk/PRML - 9.3k stars https://cloud.blobcity.com/#/ps/view-cloudbook/3f358679-853d-4620-a34a-e4ddd8becf6d/base/CPU?name=ctgk%2FPRML https://cloud.blobcity.com/#/ps/view-cloudbook/3f358679-853d... fastai/numerical-linear-algebra - 7.5k stars https://cloud.blobcity.com/#/ps/view-cloudbook/642e0518-a541-458e-96ba-1dc79b61ba49/base/CPU?name=fastai%2Fnumerical-linear-algebra https://cloud.blobcity.com/#/ps/view-cloudbook/642e0518-a541... justmarkham/scikit-learn-videos - 3k stars https://cloud.blobcity.com/#/ps/view-cloudbook/f171c24a-481c-4905-9318-114b030c549a/base/CPU?name=justmarkham%2Fscikit-learn-videos https://cloud.blobcity.com/#/ps/view-cloudbook/f171c24a-481c... jakevdp/WhirlwindTourOfPython - 2.6k stars https://cloud.blobcity.com/#/ps/view-cloudbook/2dbfc8d1-ca42-4413-8f26-45640551ece9/base/CPU?name=jakevdp%2FWhirlwindTourOfPython https://cloud.blobcity.com/#/ps/view-cloudbook/2dbfc8d1-ca42... twosigma/beakerx - 2.5k stars https://cloud.blobcity.com/#/ps/view-cloudbook/c8aced7c-d5d5-490e-a681-a070e3d19192/base/CPU?name=twosigma%2Fbeakerx https://cloud.blobcity.com/#/ps/view-cloudbook/c8aced7c-d5d5...
codesnakers 6y ago
I worked for blobcity as a freelancer 5 years ago, in May 2015. I worked for maybe a week or 10 days. Never got paid, they stopped replying back. Emails, whatsapp I messaged them for weeks.
- robgibbons 6y ago
  Should have taken them to court.
- sanketsarang 6y ago
  Sorry to hear this. Please send your engagement details to accounts@blobcity.com. We will be able to help.
  - whatl3y 6y ago
    So 1. I’m glad this is the most upvoted comment in order to provide visibility and 2. I’m glad the founder wants to make it right apparently by having the alleged freelancer send details to rectify but the the fact that the founder doesn’t immediately refute that this occurred and only wants to now potentially make it right by having the freelancer send his details over to get paid is very troubling for me. I hope this comes out as a false allegation but if not I wouldn’t want to support this at all.
    - swirepe 6y ago
      Imagine if they did immediately refute that this occurred. Wouldn't you be more suspicious of the defensiveness? A: five years ago you made a pretty bad mistake that hurt me personally. B: I must have let my priorities slip, and it sounds like in my oversight I hurt you personally. Reach out with more details and we can make this right. or A: five years ago you made a pretty bad mistake that hurt me personally. B: I don't really make mistakes like that.
      - whatl3y 6y ago
        > I must have let priorities slip saying a metaphorical “fuck you, I can’t pay you for the work you did for my business” by ignoring OPs alleged many emails and correspondence to get compensated is just as bad if not worse than a literal “fuck you, I can’t pay you” imo, but I’m also one that appreciates honesty and not sketchiness or being ghosted even if the outcome is not in my favor.
neerajgd 6y ago
Innovative solutions, innovative business model, quick response to change, clear thought process, great results. Enjoyed working with the team as client.
sanketsarang 6y ago
I believe I forgot to mention. BlobCity A.I. Cloud is not just for discovering and running GitHub repos. You can create and run your own Jupyter Notebooks on our Cloud. We call these Cloudbooks, and Cloudbooks come with unlimited compute, RAM, Storage & GPU. Yes that is right. It is truly unlimited :) You can create your own Cloudbooks and use our unlimited infra for your next AI experiment. If your code & data is open, our infra is free for you. If your code & data is private, then plans start at just $25/m. GPU's are available on the $75/m and $150/m plan. Do give it a try for your next AI / Data Science project. More info here: https://blobcity.com https://blobcity.com
- sixhobbits 6y ago
  Truly unlimited free compute power? Something something strong claims. That must be the closest I've seen to a self refuting claim on here in a long time. Would love to hear more about how you do either the truly unlimited part or the free part practically.
  - sanketsarang 6y ago
    Its free for sure, and comes with unlimited runtime. CPU & RAM will be limited by normal hardware capabilities of a single server. Storage is unlimited. Some of our free servers run up to 1TB RAM and 64 cores of compute power. This is extremely large unless you are analysing images from the Hubble telescope. Please do give it a try. Only condition, your code & data must be open source if you want it on the free plan. Else you can take a paid plan. Unlimited part remains the same, but it won’t be free for private use.
sireat 6y ago
Nice to see another player in the crowded hosted Jupyter notebooks space! Still very far from smooth (<10) click experience. The workflow took a while to get started: Manually create account (no external auth option such as Github?) -> verify account -> create notebook -> set pw for notebook -> run notebook I did all that only to find that no required libraries are there.... not even Pandas? By comparision Google Colab onboarding is much smoother and you know you are getting a working Tensorflow, Pandas, Plotly etc out the box. Sure you pay the privacy tax to Google for this smoothness. My biases: - I've installed and maintain Littlest Jupyter Hub instance for teammates at my organization. - I teach using local Anaconda installation. - I use myBinder and Google Colab. If I did not have a smooth experience I would imagine someone starting out would have a harder time. At the very least you should curate the packages so they run out of the box, without fiddling with requirements.txt, yaml, pip install, conda etc.
- sanketsarang 6y ago
  This is good feedback. Thank you for documenting your experience. Basis this we concluded on the following. Adding features: - Login with Google & Github accounts - Changing default type setting to "Data Science Notebook" - A package library with one-click install Changing features: - Simpler UX (reduced clicks required) - Removing the mandatory plan selection - Starting every user on free plan by default Anything else you recommend we should do?
- sanketsarang 6y ago
  Since you are an active user of myBinder and Colab, I am tempted to ask. What are those features we can add that will make you let go of myBinder and Colab?

125 points by sanketsarang 6y ago

I am Sanket and I’m the founder of BlobCity (cloud.blobcity.com). We’re building the largest repository of data science models, with a one-click execution made possible. We call it the A.I. Cloud. Data Science models, today are scattered, and as an engineer and architect of systems, I’ve personally experienced, there is a lot of time spent on trying out the right models, versioning, collaboration and execution. Not everything works alongside everything. We’ve now made this achievable by running a cloud infrastructure where you can not only explore the DS projects, but also run it on the cloud with 1-click. Collaborate with your fellow team mates and work together on a ready Jupyter ecosystem together. Here are some key things to know: • Explore and run, 1000+ GitHub projects on the cloud • Unlimited open source Cloudbooks for free • We have spent time and effort to curate the top projects that our team and existing users nominated for and tried to keep the UX clean and easy to use. Suggest any that you’d want to see in here, a one-click deployment worthy project.

victor9000 6y ago
Search by text assumes that I'm looking for something specific. But it would be great if we could sort results by github stars, for people that are just window shopping. It would also be great if projects could be assigned topics that users could then use to filter results.
- sanketsarang 6y ago
  Yes, absolutely agree. We just launched today. A lot of work is still in progress :)
gabereiser 6y ago
I checked out your 1000+ GitHub projects I could explore. I clicked on the "Run" button. Immediately prompted to create an account. Immediately closed the tab.
- sanketsarang 6y ago
  Interesting. Were you trying to "Run" just to see if "Run" works, or were you interested in executing a specific repository? Basically we allow users to make their own personal editable copies of the Cloudbook. When you "Run", it is first replicating the Cloudbook into your account and then running. You can edit the code in your copy without affecting the main Cloudbook. Free unlimited CPU, RAM & Storage gets included with every Cloudbook for you to make continuous edits and perform repeat runs, including long running run operations. Not sure how we can achieve this without a registration. Do you have something in mind?
  - gabereiser 6y ago
    I was kinda half expecting a few demos to just run without having to create an account to prove the value of your platform. If I have to create an account to figure that out, I’m not going to and I’m going to go explore another product. Once your value prop is apparent, I’m sure people will have no problem signing up. I just didn’t see that before being nagged to create one.
    - sanketsarang 6y ago
      That's a brilliant suggestion. We are making a change to allow all public Cloudbooks to be run in guest mode (without registration) for 30 mins. The Cloudbook will auto shutdown in 30 mins to prevent any misuse. Would this be enough to assess the value prop?
    - sanketsarang 6y ago
      On related topic, what would you consider a good value proposition? Meaning what are the things you would expect out of BlobCity for you to become a registered and loyal member?

gumby 6y ago

I suggest you put some info right at the top to explain what Blob City is. Like a headline/call to action: "one-click execution of the largest repository of data science models" And a link to "learn more!"

sanketsarang 6y ago
Planning this for the next deployment. Coming right up ...
deleted 6y ago
[deleted]

purple-again 6y ago

Not really my space so all I have to offer is a super minor nitpick. On iPhone the hamburger doesn’t do anything when I click on it in landscape or portrait. Best of luck with your project!

sanketsarang 6y ago
Oopsie, this CSS stuff. Fixing right up.

sanketsarang 6y ago

We missed saving the GitHub stars in the search index, and need to re-index all over again. Until then, here are the top 10 most starred Data Science projects on GitHub that you can now run for free on BlobCity. jakevdp/PythonDataScienceHandbook - 27k stars https://cloud.blobcity.com/#/ps/view-cloudbook/4dcbb39e-5504-4d4a-8e23-b6d210be6c3d/base/CPU?name=jakevdp%2FPythonDataScienceHandbook https://cloud.blobcity.com/#/ps/view-cloudbook/4dcbb39e-5504... ageron/handson-ml - 21.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/67219954-282d-49df-8484-4bd966fb1a15/base/CPU?name=ageron%2Fhandson-ml https://cloud.blobcity.com/#/ps/view-cloudbook/67219954-282d... fchollet/deep-learning-with-python-notebooks - 11.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/f4ee1d51-fe2d-43df-8b26-8c61bd421183/base/CPU?name=fchollet%2Fdeep-learning-with-python-notebooks https://cloud.blobcity.com/#/ps/view-cloudbook/f4ee1d51-fe2d... ageron/handson-ml2 - 11.6k https://cloud.blobcity.com/#/ps/view-cloudbook/febe3f7a-b244-4eaf-8407-9b03b26eb5ea/base/CPU?name=ageron%2Fhandson-ml2 https://cloud.blobcity.com/#/ps/view-cloudbook/febe3f7a-b244... fastai/fastbook - 10.7k stars https://cloud.blobcity.com/#/ps/view-cloudbook/b49537b2-73b9-40ad-9bbc-e489285e83ee/base/CPU?name=fastai%2Ffastbook https://cloud.blobcity.com/#/ps/view-cloudbook/b49537b2-73b9... httctgk/PRML - 9.3k stars https://cloud.blobcity.com/#/ps/view-cloudbook/3f358679-853d-4620-a34a-e4ddd8becf6d/base/CPU?name=ctgk%2FPRML https://cloud.blobcity.com/#/ps/view-cloudbook/3f358679-853d... fastai/numerical-linear-algebra - 7.5k stars https://cloud.blobcity.com/#/ps/view-cloudbook/642e0518-a541-458e-96ba-1dc79b61ba49/base/CPU?name=fastai%2Fnumerical-linear-algebra https://cloud.blobcity.com/#/ps/view-cloudbook/642e0518-a541... justmarkham/scikit-learn-videos - 3k stars https://cloud.blobcity.com/#/ps/view-cloudbook/f171c24a-481c-4905-9318-114b030c549a/base/CPU?name=justmarkham%2Fscikit-learn-videos https://cloud.blobcity.com/#/ps/view-cloudbook/f171c24a-481c... jakevdp/WhirlwindTourOfPython - 2.6k stars https://cloud.blobcity.com/#/ps/view-cloudbook/2dbfc8d1-ca42-4413-8f26-45640551ece9/base/CPU?name=jakevdp%2FWhirlwindTourOfPython https://cloud.blobcity.com/#/ps/view-cloudbook/2dbfc8d1-ca42... twosigma/beakerx - 2.5k stars https://cloud.blobcity.com/#/ps/view-cloudbook/c8aced7c-d5d5-490e-a681-a070e3d19192/base/CPU?name=twosigma%2Fbeakerx https://cloud.blobcity.com/#/ps/view-cloudbook/c8aced7c-d5d5...

codesnakers 6y ago

I worked for blobcity as a freelancer 5 years ago, in May 2015. I worked for maybe a week or 10 days. Never got paid, they stopped replying back. Emails, whatsapp I messaged them for weeks.

robgibbons 6y ago
Should have taken them to court.
sanketsarang 6y ago
Sorry to hear this. Please send your engagement details to accounts@blobcity.com. We will be able to help.
- whatl3y 6y ago
  So 1. I’m glad this is the most upvoted comment in order to provide visibility and 2. I’m glad the founder wants to make it right apparently by having the alleged freelancer send details to rectify but the the fact that the founder doesn’t immediately refute that this occurred and only wants to now potentially make it right by having the freelancer send his details over to get paid is very troubling for me. I hope this comes out as a false allegation but if not I wouldn’t want to support this at all.
  - swirepe 6y ago
    Imagine if they did immediately refute that this occurred. Wouldn't you be more suspicious of the defensiveness? A: five years ago you made a pretty bad mistake that hurt me personally. B: I must have let my priorities slip, and it sounds like in my oversight I hurt you personally. Reach out with more details and we can make this right. or A: five years ago you made a pretty bad mistake that hurt me personally. B: I don't really make mistakes like that.
    - whatl3y 6y ago
      > I must have let priorities slip saying a metaphorical “fuck you, I can’t pay you for the work you did for my business” by ignoring OPs alleged many emails and correspondence to get compensated is just as bad if not worse than a literal “fuck you, I can’t pay you” imo, but I’m also one that appreciates honesty and not sketchiness or being ghosted even if the outcome is not in my favor.

neerajgd 6y ago

Innovative solutions, innovative business model, quick response to change, clear thought process, great results. Enjoyed working with the team as client.

sanketsarang 6y ago

I believe I forgot to mention. BlobCity A.I. Cloud is not just for discovering and running GitHub repos. You can create and run your own Jupyter Notebooks on our Cloud. We call these Cloudbooks, and Cloudbooks come with unlimited compute, RAM, Storage & GPU. Yes that is right. It is truly unlimited :) You can create your own Cloudbooks and use our unlimited infra for your next AI experiment. If your code & data is open, our infra is free for you. If your code & data is private, then plans start at just $25/m. GPU's are available on the $75/m and $150/m plan. Do give it a try for your next AI / Data Science project. More info here: https://blobcity.com https://blobcity.com

sixhobbits 6y ago
Truly unlimited free compute power? Something something strong claims. That must be the closest I've seen to a self refuting claim on here in a long time. Would love to hear more about how you do either the truly unlimited part or the free part practically.
- sanketsarang 6y ago
  Its free for sure, and comes with unlimited runtime. CPU & RAM will be limited by normal hardware capabilities of a single server. Storage is unlimited. Some of our free servers run up to 1TB RAM and 64 cores of compute power. This is extremely large unless you are analysing images from the Hubble telescope. Please do give it a try. Only condition, your code & data must be open source if you want it on the free plan. Else you can take a paid plan. Unlimited part remains the same, but it won’t be free for private use.

sireat 6y ago

Nice to see another player in the crowded hosted Jupyter notebooks space! Still very far from smooth (<10) click experience. The workflow took a while to get started: Manually create account (no external auth option such as Github?) -> verify account -> create notebook -> set pw for notebook -> run notebook I did all that only to find that no required libraries are there.... not even Pandas? By comparision Google Colab onboarding is much smoother and you know you are getting a working Tensorflow, Pandas, Plotly etc out the box. Sure you pay the privacy tax to Google for this smoothness. My biases: - I've installed and maintain Littlest Jupyter Hub instance for teammates at my organization. - I teach using local Anaconda installation. - I use myBinder and Google Colab. If I did not have a smooth experience I would imagine someone starting out would have a harder time. At the very least you should curate the packages so they run out of the box, without fiddling with requirements.txt, yaml, pip install, conda etc.

sanketsarang 6y ago
This is good feedback. Thank you for documenting your experience. Basis this we concluded on the following. Adding features: - Login with Google & Github accounts - Changing default type setting to "Data Science Notebook" - A package library with one-click install Changing features: - Simpler UX (reduced clicks required) - Removing the mandatory plan selection - Starting every user on free plan by default Anything else you recommend we should do?
sanketsarang 6y ago
Since you are an active user of myBinder and Colab, I am tempted to ask. What are those features we can add that will make you let go of myBinder and Colab?