6 ms·
Thanks for making Datasette! I've been using it to build a project to make US ranked choice election results more accessible. It's very intuitive and easy to us
by picardo 6y ago
Thanks for making Datasette! I've been using it to build a project to make US ranked choice election results more accessible. It's very intuitive and easy to use. The main difficulty for me is how to get around the limitation that the sqlite files have to be colocated on the same server. These datasets can get pretty large, and I can't host them on Github, and since I can't put the datasette db on an S3 bucket, I've been exploring mounting AWS Elastic File System to the Docker container. Is there a better way?
- sorenbs 6y agoHi Picardo! We are toying around with the idea of launching a Cloud SQLite product targeting this exact use case. How large are your data sets? Would you be interested in a quick call to discuss your needs in more detail?
- picardo 6y agohey, thanks. That sounds interesting, but this is a volunteer project. I'm donating my time, so I don't think I can justify a service like that right now. The datasets are around 200MB each, just over the 100MB limit of Github.
- sorenbs 6y agoThanks for the details! We would price such a service to be competitive with the obvious alternative of using a long-running VPS or ec2 instance.
- lasean 6y agoFYI, I'm using Google Cloud Run for this at the moment. Scales to zero, issues the SSL cert and provides the HTTPS endpoint. That's what I'd be benchmarking your service against. Let me know if you actually do something in this space.
- justsomeuser 6y agoWhy don't you place them onto an AWS disk and attach it to the VM instance running Datasette?
- picardo 6y agoYep, that's probably what I'll end up doing.
- simonw 6y agoGoogle Cloud Run works well with database files up to a couple of GBs. Beyond that the best solution at the moment is to run a VPS - I've had good results with DigitalOcean droplets.