7 ms·
That’s pretty cool. We were relying on beaver dams upstream from our lake and a floodgate system going downstream, but the boathouse on the lakehouse property w
by OldGoodNewBad 5y ago
That’s pretty cool. We were relying on beaver dams upstream from our lake and a floodgate system going downstream, but the boathouse on the lakehouse property was getting inundated by rising water levels when there was a large inflow. After consulting with a data hydrologist we were able to maintain the data lake with enough security to enable year round data boating and even dataskiing. I’m available for vapid buzzword creation but you won’t like my fees. Please talk to my off-roading accountant and he’ll skywrite a quote.
- mackatsol 5y ago"dataskiing" Awesome. Sounds like a cyberpunk job description.
- markus_zhang 5y agoThen there is a snowcrash.
- danmur 5y agoHa ha ha, even funnier after I read the article. I hate that kind of marketing.
- rexreed 5y agoWhat's sadder than companies spewing this marketing gobbledygook are the customers and the consulting firms that buy into them. Enterprise (and government) buying decision-making is highly flawed and these smart enterprise software firms as well as government contractors know just the right words and just the right method to sell things that would otherwise not even pass a real sniff test.
- MikeDelta 5y agoEven enterprise architects cannot get enough of this stuff, and you would expect them to know better.
- TeMPOraL 5y agoI think that they're in a "when in Rome, talk like the Romans talk" kind of situation.
- tomnipotent 5y agoJust because the problems Databricks solves aren't your problems, doesn't mean that they're not problems for other people or organizations. What's sadder are ignorant comments from non-domain experts surprised that tools exists for experts in other domains.
- jgalt212 5y agoThe problem is everything is in the cloud even if it does not belong there.
- tomnipotent 5y agoSounds like it's your problem, not "the" problem. Many people and organizations are happily cloud-based, and Databricks offering customers in the cloud better options is a win-win. What's the issue?
- jgalt212 5y agoThe issue is Jeff Bezos / Andy Jassy own all the machines.
- arminiusreturns 5y agoThanks I needed this laugh. I think I got bingo!
- aledalgrande 5y agoYou are so good I initially believed these were true words used in data engineering! XD
- syats 5y agoAfter 5 minutes of reading through their website, I still don't understand what is their actual product. I like to think of my self as someone who is computer-savy, working at a software company, designing systems that access several databases from several clients, using spark, aws, the works... and still, their website makes no fkn sense! Could someone translate, please? oh.. but look at the amount of job openings these guys have across the world.. is this another marketing ploy? I am deeply bothered by this kind of "products".
- reggieband 5y agoI am absolutely no expert in any of these domains but the level of confusion described in these comments seems a little exaggerated. Is it so hard to see what is going on here? A data lake is a centralized repository where all of a companies data is aggregated. This allows analysts to perform queries against a single data source (often masquerading as a SQL database) rather than against 100s of distinct databases (which may be a hodgepodge of no-sql, sql, custom-rest-api, etc.). These "data lakes" often grow to a massive size since they will often not only include your application data (usually batch replicated from prod databases on some schedule or in some cases streamed directly) but also data from external sources (e.g. a feed from your payment processor, compressed events from your app/website analytics, server logs, marketing and advertising sources). Storing and processing that volume of data efficiently is a difficult task. Many companies decide to just dump that data in a raw format into cloud storage services like AWS S3. Then some third parties made the SQL-like interfaces run on top of S3 (or connectors from S3 into other familiar tools like Spark). This allows for low-cost storage while also allowing data analysts the ability to use tools they are already very familiar with. This way of handling large volumes of data stored for analysis has become very popular. But now that you have so much data stored in S3 you might start to wonder how you can control access to it. An analyst doing queries on website performance might not require access to the payment processing data. Your security team might point out that your growing analyst team has more access to sensitive company data than is required. As you negotiate big corporate deals their security team might start to red-flag unnecessary access to data (or ask you for your policies governing access to that data and how those policies are enforced). This product seems to allow finer control over access to data stored in these kind of data lakes. In the same way a bunch of tools appeared to create a SQL like facade on top of the data, this tool creates a facade on top of data access control. Not only is what they are doing completely understandable from a quick skim of the article, it also seems totally necessary. I have no doubt this is a massive market and this product has every chance to serve a real need.
- tomnipotent 5y agoDatabricks does have a really bad habit of trying to use their product names as general terms, but other than that nothing in this post is particularly esoteric to data engineers anymore than DDD/CQRS/WET/DRY/SOLID/trees/nodes/links/references are to software engineers. Might as well pull out 20 year old jokes about snowflake and star schemas.
- engineerbruh 5y agoSo what are companies supposed to call their products? Would you propose they just call this "Data Security Solution"?
- deleted 5y ago[deleted]