dikei

32 ms·

361.
by dikei 6y ago
If you just want to prevent other users from snooping you, use VLAN. There's no protection against the network administrators though.
362.
by dikei 6y ago
In term of cutting edge tech, They have their own GPUs, CPUs from ARM, Networking from Mellanox, so I'd say they're pretty much set to build a kick ass TPU.
363.
by dikei 6y ago
The problem with most metadata catalog is not technical, but the human: Catalog are documents for data, and developers hate writing documents.
364.
by dikei 6y ago
Tens of thousands seems rather low, we are running 3 million series with less than 32GB of RAM and still have room to spare.
365.
by dikei 6y ago
I think he also meant that Uber could not compete, if it does this alone without its competitors doing the same.
366.
by dikei 6y ago
https://pulsar.apache.org/docs/en/concepts-messaging/#orderi... Basically, they have the same ordering guarantee as Kafka: FIFO is guaranteed for messages from the same producer, within the same partition. If
367.
by dikei 6y ago
Who use Microsoft build of PHP ? Back when I was still coding PHP on Windows, I just used the XAMPP bundle to get the entire web stack up and running in minutes. Granted, that was 10 years ago, I'm neither coding PHP nor coding on Wind
368.
by dikei 6y ago
I really like the architecture of Pulsar, it is very elegant with clear separation of duties between components. That said, we have used Kafka for so long, and it works well enough at our scale that we have no reason to even test Pulsar. Ka
369.
by dikei 6y ago
> Who watches the watchers? You would need multiple watchers who watch one another. Of course, if all watchers die at the same time, you're out of luck. This is only part of the solution though, because in order to write and test e
370.
by dikei 6y ago
I'm sorry but I refuse to believe that you're having a great experience using IntelliJ IDEA with a Core2Duo and 4GB RAM.
371.
by dikei 6y ago
FWIW, I'm using the official power supply and have never encounter any power issue.
372.
by dikei 6y ago
We have never been able to make Hive LLAP run reliably on our HDP cluster, queries sometimes just hang for no apparent reason. On the other hand, our Presto cluster runs pretty much anything we throw at it, and when it fails, the failures a
373.
by dikei 6y ago
We only use NiFi on the edge of our data lake. It's very good at bulk loading, pulling log files/sensor data from hundreds of systems into our systems. However, it does not handle small records well, and deploying custom processor
374.
by dikei 7y ago
I tried setting up a Druid cluster once, they have so many components that it's hard to manage. Also Druid didn't not support SQL at the time and we don't want to learn its weird query language due to the lack of documentatio
375.
by dikei 7y ago
Ehh, what you just described is often how service versioning works: launch a v2 service with the v1 still active, keep them running concurrently for a while, then turn off the v1 when it's no longer used. You can distinguish the versio
376.
by dikei 7y ago
Prometheus is not really a database, because the only operation allowed is query, you can't insert/delete data manually. For many use cases, that's not acceptable.
377.
by dikei 7y ago
No, he made a good point. It's a matter of perspective, what is considered data in one situation, can be consider code in other situations. Hell, they even created the NX-bit to prevent malicious memory space becoming executable.
378.
by dikei 7y ago
For this amount of data, I would use good old Postgres, partition the data by ingestion time, then just detach the old partitions when you need to archive it. For joining data from multiple database, if the data is large, I would use someth
379.
by dikei 7y ago
Well, inexperience users/data scientists tend to not care about what they write out :) Nevertheless, my point is a Data Lake's does not offer free unlimited scalability. It takes a lots of effort and good engineering practice to m
380.
by dikei 7y ago
> The reason data lakes make sense is because it is effectively unlimited scalability. You can have as many crazy ETL jobs, inexperienced users, Data Scientists all reading/writing at the same time with no impact. Eh, almost all Dat
381.
by dikei 7y ago
> So if recreational heroin had never been made illegal, pharmaceutical companies would today be "forced" to sell it? If one company does start to sell it, its competitors will probably be "forced" to sell it too. &gt
382.
by dikei 7y ago
I hate it too, but I can't completely fault them. Companies need to be profitable, and the pricing race to the bottom means they can hardly increase individual pricing, which in turn force them to exploit other directions.
383.
by dikei 7y ago
This might be useful as a backdoor around networks with strict rules that block SSH access, until the network admins detect and block this as well. People got fired for installing tools like this, think twice before trying with your company
384.
by dikei 7y ago
To be fair, Window XP's firewall cannot block Outgoing connection, only Incoming. Vista SP1 and later versions of Windows include a firewall with Outbound blocking.
385.
by dikei 7y ago
> allowing an application like firefox to connect to a particular site on a particular port only. Eh, this is such a basic task that even Window's built-in firewall can do it. They just do not make it very obvious in the UI.
386.
by dikei 7y ago
There's loads of firewall application on Windows: ZoneAlarm, Comodo, Tinywall. Some use their own packets filtering driver, while some are just frontend for Window's built-in firewall. I used to run these for a while, but it gets
387.
by dikei 7y ago
From reading their documents, I really like the design of Pulsar. However, Kafka has been working so well for us and has much better integration with other components of our stack (Flink, Spark, NiFi, etc) that there's no compelling re
388.
by dikei 7y ago
Google receive over 100 Billion USD per year from ads revenue. If spending a few billion dollars can get you a new Google, then every one would have done it a long time ago.
389.
by dikei 7y ago
An example is when you are developing/testing distributed systems. Many tests which used to require a cluster to run can now be run on a single machine, which helps a lot with debugging.
390.
by dikei 7y ago
Columnar formats generally compress very well due to the similarity between values in the same column.

More ›