dikei

23 ms·

301.
by dikei 5y ago
Well, Kubespray is just an Ansible-based installer that almost walk you through the process of setting up a K8S cluster. And Calico is the default option in Kubespray, so unless you want more customization, you don't need to learn anyt
302.
by dikei 5y ago
Last time I checked, Druid were not very good at ad-hoc tasks because it lacked join and SQL supports was sketchy. How is it now ?
303.
by dikei 5y ago
> How do you do networking? Layer a service mesh with custom overlay networking that abstract upon k8s clusterip. Overlay network is easy if you don't need your pod and service IP to be routable from outside the cluster. It took me
304.
by dikei 5y ago
JDK 11 is now at 11.0.12, which was released in July, and you can get it for free from multiple vendors. Non-LTS JDK doesn't have anything after 6 months.
305.
by dikei 5y ago
Probably for insurance and tax purposes.
306.
by dikei 5y ago
I have 2 questions: * How do you setup hot stand-by for each database ? * Do you have coordinated backup for all the databases, or are they backed up individually ?
307.
by dikei 5y ago
Yup, I agree with you. Most businesses can work fine with traditional RDBMS, even on TB scale if you have a large box with lots of RAM and SSDs. My example was just one use-case where one should consider using a more unconventional DBs like
308.
by dikei 5y ago
Well, millions of rows of data is tiny these days: if you have 100_000 IOT devices, each generate on average 10 telemetry points a second, that's already 1M writes per second. Storing these telemetry for a week and you already have 600
309.
by dikei 5y ago
Using NoSQL is fast, but requires you to know the how you want to read the data before you start writing. This is not the case with analytics, where new queries pop up all the time. As a result, NoSQL never really catch on in the analytics&
310.
by dikei 5y ago
Devops like Telegram because it has proper bot API, unlike many other competitors.
311.
by dikei 5y ago
Imho, mvnd is a step in the right direction. Next is how to make maven cache work more reliably and aggressively, as maven is still too slow at incremental build: A zero-change build can take seconds, while Bazel finishes almost instantly.
312.
by dikei 5y ago
> Your durability numbers imply erasure coding. Is that the case? Well, you can't really build inexpensive, large scale, reliable storage without erasure coding. So that's probably a given.
313.
by dikei 5y ago
Truth, I think I only used them one or twice to download some papers with attractive names that couldn't be found anywhere. It turned out the papers were quite bad, I figured they wouldn't be so hard to find otherwise.
314.
by dikei 5y ago
Back when I was a student, I never like ResearchGate: they forced you to create an account, then upload some random rubbish PDFs just to get credits to download what you want.
315.
by dikei 5y ago
If you're not careful, the data engineers team is often overloaded with requests from the analysis team. With big data warehouse, more often than not, the fancy dashboards would not run fast enough without a dedicate pipeline that mate
316.
by dikei 5y ago
Typescript has already filled the niche of a typed, OOP language in the browser for me. And it's surely much better supported than TeaVM.
317.
by dikei 5y ago
Java in the browser (Applet) is unsecured, because it can download and run untrusted code in the user machine. Java in the server, on the other hand, is as secured as any other runtime, i.e only as good as the application written on it.
318.
by dikei 5y ago
Column store is just the first step in OLAP optimization. You also need an engine that's optimized for columnar calculation(minimize data transfer/copy, vectorized calculation, etc..). It's the reason why purpose-built column
319.
by dikei 5y ago
>>> Redis is the leading real-time data platform I'm gonna need a citation on that.
320.
by dikei 5y ago
Yep, we used to setup these things with a bunch of different systems using our collection of Ansible playbooks. The playbooks are complex, so as to handle all kind of edge cases. Furthermore, since they are developed over a long period, the
321.
by dikei 5y ago
Yup, Loom will simplify a lot the Producer-Consumer pattern on I/O operation. With virtual threads, it's basically free to block on consumer threads, so you would need only 1 bounded pool for the consumers. Currently for efficienc
322.
by dikei 5y ago
Flink serialization become much less painful when we switch every value type in our job to Avro. It requires a bit more code compare to using Java POJO or Scala case class, but you can actually add more field to existing data type without b
323.
by dikei 5y ago
Advantage of Flink over Kafka Stream * Flink work on other message queue tech other than Kafka like Amazon SQS, Pulsar, etc.. * Back when I last read about Kafka Stream, Flink has better support for stateful processing, the entire state of
324.
by dikei 5y ago
Actually, unified batch and stream processing in Flink is a bit of false advertisement. In Flink, stream and batch have different API (DataStream vs DataSet) so reusing logic is not really practical, unless you abstract out everything, in w
325.
by dikei 5y ago
IMHO, if you need stream processing, start with Apache Flink. It not only offers a much easier to user API compare to Storm and Heron, but also has a superior execution model for time-based, exactly-once, stateful stream processing.
326.
by dikei 5y ago
Some people want to work just enough to make money to support their other hobbies. Earning 3 times the money for twice the amount of responsibility is not worth it for them.
327.
by dikei 5y ago
>> This framework is not a promotion checklist for your role I hope this is true. There were too many times where things started out as a general guideline but gradually turned into a rigid checklist where one must tick all the boxes
328.
by dikei 5y ago
That's just concatenation though. Asciidoctor has very good support for `include`, so you can include a file in the middle of another file. Furthermore, you can even do partial include where you only include a section of another the fi
329.
by dikei 5y ago
I much prefer Asciidoctor to Markdown when writing documents that's longer than a single A4 page, since it has the ability to combine multiple files into a single document if needed.
330.
by dikei 5y ago
Probably should have noted that this article is dated 2013, almost a decade ago.

More ›