hyperknot

8 ms·

61.
by hyperknot 2y ago
I think he was referring to a freely available full planet OSM mbtiles dump, to be used with OpenMapTiles. I cannot find a reference to that in your blog post.
62.
by hyperknot 2y ago
Yes, the key thing about Btrfs is how it handles inodes and how it can store data with the metadata. In the OpenFreeMap image, 60% of the files are stored with the metadata, essentially taking up no space.
63.
by hyperknot 2y ago
Cloudflare Free is a good idea, but I'm afraid they'd be the one who limit me before. There is a comment in this thread who did 150 TB+ on Hetzner. I don't believe Cloudflare Free would allow 150 TB, not alone 300 TB in a mon
64.
by hyperknot 2y ago
You are right in that I'd be afraid if this was hosted on AWS or on Cloudflare Workers. This whole idea is only possible because there are some hosts like Hetzner, which offer flat rate bandwidth.
65.
by hyperknot 2y ago
Thanks a lot! Yes, I believe this dynamic pricing is making it impossible for small or non-profit projects to host maps. And you can see, "fun" maps basically disappeared from the internet - they were really common 10 years ago! F
66.
by hyperknot 2y ago
Since I wrote it, one person made 1 commit related to the visual style. Before that, 1 visual commit in 2023 and then 2021 is when work kind of stopped.
67.
by hyperknot 2y ago
Here the requests are really really small, on average 405 bytes each. I guess in your genomics work you are making larger requests, so probably it's not so much of an issue. BTW, we are discussing latency with bdon in this issue, it se
68.
by hyperknot 2y ago
Thanks! It's not so bespoke, it's Fabric ( https://www.fabfile.org/ ), it's been around at least since 2011, but probably much longer, since they already had 1.2.0 in 2011. It's a super reliable script for
69.
by hyperknot 2y ago
I benchmarked and nginx can host 30 Gbps on cold cache, on actual real world load. (I played back a log of 1 million real world requests). So using nginx in a 1 Gbps server is definitely not asking too much of it, or I might not have unders
70.
by hyperknot 2y ago
Thank you for sharing the story! I hope OpenFreeMap can contribute either with the MBTiles / Btrfs dumps, or with the public instance.
71.
by hyperknot 2y ago
Yes, small files can fit in the metadata, which makes a super big difference when you have 300 million files of 405 bytes each. Also, inode handling is way better compared to ext4.
72.
by hyperknot 2y ago
Yes, Versatiles is a nice truly open project! One of the long term plans for OpenFreeMap is to migrate to Shortbread + Versatiles styles.
73.
by hyperknot 2y ago
Thank you for sharing this, I'll make a issue about both. The Vatican situation is trickier than you'd think, as it's on country level, while Rome is on city level, and naturally you'd want to give countries a priority o
74.
by hyperknot 2y ago
Yes, MapLibre is the gold standard now.
75.
by hyperknot 2y ago
The Linux kernel's filesystem cache is actually really efficient at doing this. I doubt we could come up with a nginx scripting solution which could be equally efficient.
76.
by hyperknot 2y ago
The whole extract_mbtiles.py file is 97 lines of code. This contains parsing MBTiles, writing metadata and some CLI specific lines. It's actually quite a concise script for doing this while taking care of the hard-link limits.
77.
by hyperknot 2y ago
I've literally just launched it.
78.
by hyperknot 2y ago
On the main page I disabled scroll zoom, because it hijacks your scroll and literally you cannot scroll through the map. It makes sense for full-screen maps only. Of course, you have 100% control over exactly what controls you configure wit
79.
by hyperknot 2y ago
My main project is MapHub, it gives me my income. It's not an income like you'd get in a FAANG job, but still, I'm running it for making a living. For MapHub to work, I had to invest in my own tile server infrastructure: ther
80.
by hyperknot 2y ago
The thing is that hosting this really isn't that expensive. My first GitHub Sponsors goal is to reach $175 per month, which would cover the hosting on Hetzner. Of course this cost can grow if the project gets more popular, but it'
81.
by hyperknot 2y ago
Yes, PMTiles with the Caddy plugin is very similar to nginx + Btrfs. At that point, the difference between the two projects is mostly which schema is being used.
82.
by hyperknot 2y ago
Thanks a lot, I didn't know about it! I also liked the fact that Btrfs is probably super well tested in the Linux kernel by now. btrfs.openfreemap.com just a public Cloudflare bucket, no idea why it might be slow.
83.
by hyperknot 2y ago
I'd recommend at least 200 GB.
84.
by hyperknot 2y ago
If you know the tile numbers, you can just copy them out of the Btrfs image.
85.
by hyperknot 2y ago
I think both solutions could easily saturate a 1 Gbps line. I benchmarked Btrfs + nginx and it could do 30 Gbps, which doesn't really make a difference if your server is 1 Gbps only. The fact that there is no service running was the mo
86.
by hyperknot 2y ago
Wow, now that's an ambitious project! I wish you a lot of success with it!
87.
by hyperknot 2y ago
Yes, I think it would. Have a look at the extract_mbtiles script: https://github.com/hyperknot/openfreemap/blob/main/modules/t...
88.
by hyperknot 2y ago
They are providing the building blocks for making a self-hosted vector tiles server, they don't actually host the tiles.
89.
by hyperknot 2y ago
No, the ping is 150 ms to us-west-2, and the tiles load in like 5 seconds on a cold start. Of course we cannot test cold start on HN comments because HN is the definition of hot :-) I can imagine workers to be fast, it's the range requ
90.
by hyperknot 2y ago
What you need is a bike specific style for OpenMapTiles schema. Maybe you can find it on GitHub. Once you have the style, you can use Maputnik to tune it to your liking like on this link: https://maputnik.github.io/editor&#x

More ›