iblaine

19 ms·

151.
by iblaine 7y ago
Workflow engine = can support hundreds of parallel workflows. This includes airflow, luigi, dagster, appworx, are used to manage data and are typically processes that run in minutes to hours. Orchestration engine = can support millions of
152.
by iblaine 8y ago
Hiring a data engineer would be your best option. The second best option would be to outsource the infra to a company like datacoral.com or pachyderm.io. Be aware that a single database or tool is probably not a solution. You may get more
153.
by iblaine 8y ago
IANAL but he’s awaiting trial for hacking, not being a journalist. Whether or not the charges are true will be one for the courts to figure out.
154.
by iblaine 8y ago
IMHO, this is the biggest news to come out of Google Next. Putting large volumes of data in the hands of analysts, in a safe way, is an impressive feat.
155.
by iblaine 8y ago
IPOs are increasingly turning into an exercise of the Greater Fool Theory [1]. I'm not sure if it's investors or employees who are the bigger fool. Investors can fall back on ratchets [2]. Lyft may sue a bank for helping pre-IP
156.
by iblaine 8y ago
Sanjay said one of the reasons he hired Kevin is because he wanted another hard core engineer in upper management at Microsoft. MSFT has historically allowed business decisions to trump technical decisions and Keven adds balance. /for
157.
by iblaine 8y ago
Metacat is worth checking out as well.
158.
by iblaine 8y ago
This happens daily on the Muni 30X in San Francisco. What this algorithm needs is a comfort level such that a persons decision to get on a bus is a function of their expected comfort level and expected arrival time.
159.
by iblaine 8y ago
I curated a list of 'winning' questions from this thread. Good luck and please ignore everything in this thread. * Does the company have contingency plans for down markets? * what is the current strike price and how many shares a
160.
by iblaine 8y ago
What are the closest equivalents / competitors to ArangoDB?
161.
by iblaine 8y ago
"Perhaps the biggest issue is that we need to stop treating “big data” as a marketing gimmick." says the guy who did a TED talk titled 'What Can Big Data Do For You'. Also, comparing IBM PS/2 disk transfer rates to
162.
by iblaine 8y ago
As a former engineer at Lyft, looks like my RSUs would be worth ~2x my salary per year. Typical RSU grants are 25% of your salary per year, so those Lyft RSUs would have been a good return. But that's at a $18-25B valuation. I think
163.
by iblaine 8y ago
This is a confusing feature. Converting PDFs to text is already a trivial technical challenge, so it's not a product differentiator. What is a product differentiator is converging indexing(index and store all the things) used by Rock
164.
by iblaine 8y ago
NPR has a great podcast on Theranos called The Dropout. There seems to be a growing trend that it's ok to fake it till you make it...consider Theranos, The Fyre Festival, Trump.
165.
by iblaine 8y ago
I recently had a candidate that had very good Scala skills and very poor SQL skills. Despite Scala and spark being powerful, you can over complicate a solution in those languages that could otherwise be easily solved in SQL. That’s interest
166.
by iblaine 8y ago
And this is ok. A shift away from strongly typed languages encourages laziness. A shift towards resilient micro services accommodates laziness. It’s good enough to get by and allow large companies like airbnb to grow. Clean code vs time to
167.
by iblaine 8y ago
This is clearly a primer on SQL and meant for those looking for an introduction. If you're one of those people, then you would also be interested in this deck on the evolution of SQL. https://www.slideshare.net/Markus
168.
by iblaine 8y ago
This is clickbait to sell a book. "Having trouble doing the thing? The problem doing the thing is you. Buy my book for $45, then you can do the thing."
169.
by iblaine 8y ago
I prefer lucidchart for being easy to integrate to confluence and share with teams.
170.
by iblaine 8y ago
Not pivotal
171.
by iblaine 8y ago
TL;DR; Successful guy visits Africa, sees animals in the wild instead of Zoo's, creates clickbait article to imply capitalism is a zoo and people do not belong in zoo's. The premise of this argument is that people do not belong
172.
by iblaine 8y ago
This is generally how the CEO of Lyft got the idea to create Lyft.
173.
by iblaine 8y ago
Crypt has too many opportunists. It really is tragic because the technology is interesting. I do not see it the problem being fixed.
174.
by iblaine 8y ago
How does this compare to airflow? Is it free or how does it generate revenue?
175.
by iblaine 8y ago
I heard the same story about the jogger being hit by the autonomous Humvee at CMU. I ended up going somewhere other than CMU, but the onsite interview process included a tour, and that tour mentioned this jogger being 'hit'.
176.
by iblaine 8y ago
Just because a tool gives you enough rope to hang yourself with, doesn't mean it's a bad tool.
177.
by iblaine 8y ago
Of the founders I have met that are fully vest, most stick around. I presume because they have a comfortable lifestyle or their shares will be worth more by their direct participation in the company. I firmly believe that true altruism doe
178.
by iblaine 8y ago
If we learned anything from SNAP, it's that investors are still greedy. APPF is a good example of a recent IPO that has done very well since its IPO date. IMHO, hyped up companies like Lyft have all the value sucked out before the IPO
179.
by iblaine 8y ago
TiDB should be in here but trying to keep up with the latest trends is overwhelming.
180.
by iblaine 8y ago
> Assuming no bad actors Blockchain gives you security against bad actors. Here's a similar use case for a marijuana supply chain: https://www.nasdaq.com/article/leveraging-blockchains-to-tra...

More ›