12 ms·
The Sandstorm Team Is Joining Cloudflare
- ryanlol 10y ago>Although Cloudflare recently suffered from a widely-reported security incident, their response was impressively fast and transparent. lol.
- deleted 10y ago[deleted]
- wyldfire 10y agoNice to see a soft landing for this worthwhile project. EDIT: disregard the above, that this was a careless misunderstanding of the title. TFA says "Sandstorm, for its part, remains an independent entity, and I won’t be working on it during my day job at Cloudflare. However, I will be working on Cap’n Proto."
- diggan 10y agoThe people behind Sandstorm are joining Cloudflare and will now have less time to spend on Sandstorm. That's sad, because I was excited in general behind the idea of Sandstorm, and I hope it continues to be worked on, even if it's just during the weekend.
- yebyen 10y agoThe really big announcement came about six weeks ago, when Kenton announced that Sandstorm for Work was open sourced and not anymore a product that is for sale. If you didn't follow that link in the first paragraph and didn't hear about it already from some other source, https://sandstorm.io/news/2017-02-06-sandstorm-returning-to-community-roots https://sandstorm.io/news/2017-02-06-sandstorm-returning-to-... IMHO this is all really good news, because people who were on the fence about Sandstorm before can feel more free to commit resources to developing it, without worrying that Sandstorm the company is going to come along and make decisions against their interest, or try to make their work proprietary, or leverage it for the company to make more profit at their expense. (Not that we thought those things would happen...) They would certainly have less time to work on Sandstorm if they were not able to go right out and get full-time jobs, once it was determined Sandstorm the company was out of money! IMHO there is nothing but good news in these announcements.
- tracker1 10y agoIt definitely looks interesting.. may play with it on DO or Linode this weekend, if I remember to do so...
- nilved 10y agoOh boy. I guess that's it for Sandstorm.
- kentonv 10y agoNo. Sandstorm is "my baby" and I'm not going to stop working on it just because I have a day job.
- jameskegel 10y agoI hope as your work life evolves this statement holds true. Congrats and good luck, and thanks for the code.
- deleted 10y ago[deleted]
- snackai 10y agoWelcome to the dark side of the internet fucker. Cloudflare is a threat to a free internet. Try surfing with Tor these days sucker.
- exabrial 10y agoI would much rather use "self hosted" apps like Gitlab, sandstorm, graylog, and the like than SAAS offerings. Your data security and upgrade cycles are in your own hands.
- freehunter 10y agoThat's part of the reason people use SAAS offerings in the first place. They don't want to have to be responsible for data security and upgrade cycles. These things are hard and when even the professionals get it wrong, what hope does a layman have?
- kentonv 10y agoHi all, I'm not sure how responsive I'll be able to be on this thread since I'm in orientation today. :) But, here's the things I expect to be repeating a lot: - Sandstorm is still an independent company, under control of Jade and myself. - Sandstorm is "my baby" and I'm not going to stop working on it just because I have a day job. Yes, it will slow down a bit -- but on the bright side, we were previously spending the vast majority of our time trying to figure out enterprise sales (rather than actually building cool features), and we don't have to do that anymore. So, the difference may not be as big as you'd think. See: https://sandstorm.io/news/2017-02-06-sandstorm-returning-to-community-roots https://sandstorm.io/news/2017-02-06-sandstorm-returning-to-... - Nevertheless I'm pretty excited about the work I'll be doing at Cloudflare as well -- which includes Cap'n Proto and other fascinating infrastructure tech.
- jacquesm 10y ago> Sandstorm is still an independent company, under control of Jade and myself. Whenever I hear that I'm subvocalizing 'for now'. How do you see this in the longer term?
- nine_k 10y ago(Isn't everything in our life "for now", given a sufficiently long now?) What kind of hostile commercial interest there might be, especially when the technology is protected by open-source licenses? If there were a non-hostile commercial interest, akin to Citus in Postgres, won't it be a win for all?
- jacquesm 10y agoThat such independence is - historically at least - usually the opposite. There are very few examples of where post acquisition such independence turned out to be the real deal.
- geofft 10y agoAs far as I can tell, Sandstorm did not get acquired or acquihired - Kenton, Jade, and others (?) as individuals all accepted job offers from Cloudflare.
- devnull42 10y ago>Although Cloudflare recently suffered from a widely-reported security incident, their response was impressively fast and transparent. Really....seemed like they massively downplayed to me.
- kentonv 10y agoFWIW I blogged more about it a couple weeks ago (editorial at the bottom): https://sandstorm.io/news/2017-02-28-cloudbleed https://sandstorm.io/news/2017-02-28-cloudbleed
- ryanlol 10y agoYour blog post doesn't seem to discuss their response very much. What leads you to believe that CloudFlare was impressively fast and transparent in this case? Especially since statements from Project Zero seem to imply that they were anything but.
- kentonv 10y agoCF disabled the problematic feature within hours, on a Friday evening. After that, figuring out what private data was stuck in search engine caches was obviously going to take some time. It seems clear enough that they were working as fast as they could. Tavis is awesome but I think he was being unfairly hard on them in the project zero thread. (Note: All of the above is based on my external observations, as I was not yet an employee nor did I have any internal access at the time.)
- xxdesmus 10y ago"statements from Project Zero" -- nope, statement from one person. Also you're assuming those are facts.
- fictioncircle 10y agoBecause they did, its typical corporate PR speak for any PR release which is basically what the OP is. https://www.washingtonpost.com/blogs/blogpost/post/google-engineer-steve-yegge-has-his-jerry-maguire-moment/2011/10/13/gIQATU1hkL_blog.html https://www.washingtonpost.com/blogs/blogpost/post/google-en... Even someone as popular as Steve Yegge that probably could have told Google to GFY basically switched to PR speak the next day: > Yegge wrote a mea culpa the next day and praised Google PR for not coming down on him. He took the post offline but let others keep their copies. And then he stopped ranting and presumably went back to work. If only some politicians could learn from his example. When you make a mistake, the more you talk about it, the longer the story lives. I don't think anything he says has been a PR disaster and I think his POV is genuinely correct (that could be just because he is persuasive :P). I think the truth is people want the white lie of PR speak because when you stop and try to be honest, many people will try to use it against you later so its safer to use the PR filter that is a white lie than be 100% transparent.
- hnbroseph 10y agocool, but what does sandstorm have to do with cloudflare? then again i don't quite get what it is... some kind of file/app sharing thing.
- yebyen 10y agoSandstorm takes apps that normally would need someone to run a server, breaks them down into the smallest shareable unit (a "grain"), and lets you host them all centrally, on the Sandstorm server. Whether that's the Oasis service, your own machines, or something in between. So instead of running a whole Gitlab server, you'd run a Sandstorm server that hosts Gitlab grains, each consisting of a single repository. Gitlab itself is no longer responsible for sharing and authentication, the Gitlab grain lets Sandstorm handle that. Apps need to be rewired to fit into this paradigm, but once they do, it feels like one coherent platform rather than a bunch of separate individually hosted apps that maybe you glue together somehow. For Etherpad, instead of running an Etherpad server that hosts many notepads, you create an Etherpad grain that has just one shared pad. For a drawing app, the grain would be just one drawing. For a photo gallery app, maybe it would be just one gallery. (These are all real examples, these grains all exist and work as I'm describing.)
- derefr 10y ago> Whether that's the Oasis service, your own machines, or something in between. To clarify: does a "grain" just run in one place, or is each "grain" a cluster of containers that can be spread-scheduled between disparate regions (i.e. "the Oasis service" and "your own machines" at the same time)? And, if the latter, do the cluster nodes have awareness of their locations, and can take advantage of that?
- yebyen 10y agoI have honestly no idea, other than I know that the grains are not permanent resident processes. IOW when they are not in use, they spin down and do not actively consume resources other than disk. I think the grain runs in one place, I think to use the container analog it would be one container, but as a point of clarification I believe that it is not using one of the container runtimes like docker or rkt that you will be familiar with, but uses its own sandboxing instead. I have not tried running the newly opened up Oasis backend so I can't really speak toward how it works. My experience with a single server running Sandstorm has been good, painless automatic upgrades, I would expect from what I know about this team, that since it's their dogfood they made it taste good.
- tannhaeuser 10y agoSad to here sandstorm.io didn't make it into a viable business for you. I can only imagine just how much energy went into it (and hopefully continues to go). When time allows, I'd very much appreciate a reflection on the economic viability for innovative infrastructure software in general (hosted vs enterprise sales, also taking RethinkDB's demise and that of other "new stack" startups into account, etc.), and I'm sure others here will as well.
- kordless 10y agoThe investment market for infrastructure software is difficult now. Some might put it another way, but I think it's challenging given the way that current market model choice moves back and forth between a preference for private or public offerings. Consider the evolution steps from MSPs to SaaS. Of late, offerings that provide a hybrid approach to software seem to be emerging. Gravitational and Relicated are examples of toolsets for these types of modelss. Take logging as a service and the more traditional self hosted log solution. What would work best users would be one piece of software, which could run both on-premise and in the cloud on someone else's servers, or even someone else's service. On-prem, it might be managed by those who wrote it. Hosted, it might represent a segment of a larger market play for intelligent time series analytics and sold as a monthly revenue rollup. Deploying these types of models will be interesting, but it's totally doable using some type of lightweight federation across services. Sandstorm represented a portion of the infrastructure needed to do simple deployments that felt like a hosted service. A service proving cryptocurrency payments for their APIs might be another piece of the puzzle. I continue thinking about these new markets as new technology enables them.
- anonymousDan 10y agoWhen you say hybrid, do you mean hybrid for the same customer (i.e. parts or instances of the service running at the same time on-premise and in the cloud) or for different customers (i.e. a particular customer will either run on-premise or in the cloud, but not both)?
- 10y ago
- Pica_soO 10y agoIn other news, silicon valley naming conspiracy discovered who's whole intend it is to make the stock-market report sound like a weather-forecast.
- the_common_man 10y agoBest of luck, kenton! If anyone is looking for alternatives: http://alternativeto.net/software/sandstorm-io/ http://alternativeto.net/software/sandstorm-io/ . I think Cozy, Yunohost, Cloudron, arkOS are the closest alternatives (Bitnami is about 1-click images and DO/linode are about cloud servers). Would be great to hear about other alternatives...
- derefr 10y agoAFAIK Sandstorm was way out ahead of its competitors in this space; it was the only one HN ever deigned to pay attention to, at least. Given that, and given that it's FOSS, then as long as the community is still interested in the project, the project should keep seeing development, regardless of the amount of time the original developers can put in. Even if that means a LibreOffice- or MariaDB-like fork.
- educar 10y ago> AFAIK Sandstorm was way out ahead of its competitors in this space I think of those listed projects only few are backed by for-profit entities (like sandstorm itself). Cozy in particular seems very well funded (https://www.crunchbase.com/organization/cozy-cloud#/entity https://www.crunchbase.com/organization/cozy-cloud#/entity). I also think the alternatives link is a bit misleading because those projects aren't really direct alternatives. I have investigated a bit in this space (for my personal hosting): * Cozy is simply for a personal server for email/contacts. This is more like ownCloud. It's not meant for hosting internet facing websites. * Sandstorm is sort of trying to build a Google Docs style portal. People share these docs with each other. This is why it has a "frame" around every doc/app. It's also not meant for hosting internet facing websites (by this i mean, it is not optimized for hosting your personal public blog). * Bitnami is 1-click images for opensource apps. I am guessing their main user base is people who want to install a stack quickly. It's a glorified docker pull or curl. * Cloudron is about running apps on a server. This is automation (ssl, backup, install/update etc) of what you would be doing today, if you have to setup a server and install apps like rocket.chat, gitlab etc. Cloudron uses docker for the apps. Yunohost does the exact same thing without docker.
- bogomipz 10y agoCan someone say how Cloudflare uses the Cap'n Proto rpc framework? I would be interested in hearing how this fits into a CDN architecture. Cheers.
- kentonv 10y agoAt present they (uh, we, I suppose!) use the serialization only, for a variety of uses including (publicly disclosed) the log analysis system. I have some ideas where the RPC would be useful, though.
- bogomipz 10y agoThanks for the replies and the link(interesting), cheers.
- caust1c 10y agoWe use it for serializing log events between our Edge colos and our data processing datacenters. We chose it because it is a zero copy serialization protocol, as opposed to protobuf which doesn't do zero copy. We don't currently use the RPC framework specifically though only the serialization.
- eastdakota 10y agoHere's a blog post which talks a bit about how we use Cap'n Proto in production: https://blog.cloudflare.com/introducing-lua-capnproto-better-serialization-in-lua/ https://blog.cloudflare.com/introducing-lua-capnproto-better...
- kev009 10y agoAs someone in the CDN industry, that was a smart aquihire.
- jamesinsf 10y agoThis is one of the better CloudFlare acquihires. Congrats!