kikimora

11 ms·

181.
by kikimora 3y ago
How EBS snapshots going to be consistent? I mean AWS takes them at random time, a half of a write may be captured. Another, less common scenario is silent data corruption you never notice until you need to restore.
182.
by kikimora 3y ago
I’m thinking of how a data lake with parquet files can be structured. Each parquet file has header with summary statistics about the data, it has Blum filters too. A scanner would inspect files falling into the requested time range, for eac
183.
by kikimora 3y ago
IMHO this is what most non-technical founders are missing. They come to you with a proposal like “build this thing and then I’ll sell” and you have to trust they would. Sometimes they provably can and this is a great deal then. More often t
184.
by kikimora 3y ago
There are plenty of people I know who would qualify. None would be interested to work for free.
185.
by kikimora 3y ago
Can you share your experience of when columnar fails? It is possible to scan NVMe at a speed of multiple GB/sec, scans can be parallel and happen on multiple disks, over compressed data (10 Gb of logs ~ 1Gb to scan), data can be segmen
186.
by kikimora 3y ago
What do you use instead, CF?
187.
by kikimora 3y ago
I never being able to understand why log indexing has to build inverted index. Decent columnar store with partitioning by date should be enough to quickly filter gigabytes of logs.
188.
by kikimora 3y ago
PG has “copy” which would blow away bulk inserts. Other DB vendors have similar stuff for high-performance inserts. You would be much better off using those than using bulk inserts.
189.
by kikimora 3y ago
I remember SQLite have been using inserts to implement import under the hood.
190.
by kikimora 3y ago
This mirrors my experience - tests working with real software running on real infrastructure uncover real bugs, easier to write and maintain in the long run. You still need unit test to verify edge case such us database going down or throw
191.
by kikimora 3y ago
A problem with radio signal or with a wire would affect all TCP connections at the same time. It does not matter if it is one or many, the outcome will be the same. I believe in real life this is a majority of cases. A problem affecting jus
192.
by kikimora 3y ago
> What is this obvious solution? You, an application developer, need to launch a new service. I give you a service account that lets you do almost everything inside of that account along with a viewer account for your user that lets you
193.
by kikimora 3y ago
This! Every team and product gets AWS account or two, this is all you need at a basic level.
194.
by kikimora 3y ago
In my country public attorneys 100% work with police to convict you, not to protect you.
195.
by kikimora 3y ago
Interestingly blockchain seems to highly benefit Nigerian citizens who can use it to save their assets from devaluation despite government opposing it.
196.
by kikimora 3y ago
This is how you protect one small server, you don't need cloud for this. But if you do use it for a small server you'll overpay a lot in relative terms and small amount in absolute terms.
197.
by kikimora 3y ago
If it is just a content website then maybe yes. Cloud complexity probably won’t worth it. Still I can think of a corporate blog, and you have employees come and go then it became a problem even for a small website. Otherwise an angry admin
198.
by kikimora 3y ago
With default settings an attacker can run up-to 10000 req/sec on your api gw which would result in a sizable bill if left unnoticed. So with AWS you have to configure throttling and AWS protects you from low level ddos. How do you save
199.
by kikimora 3y ago
AWS guarantees protection from all DDoS attacks done at level 3-4 (Google aws shield). If someone calls your api million times then there is throttling.
200.
by kikimora 3y ago
Please explain how you rotate ssh keys, store audit logs, backup (and test backup procedures), configure secure network between vpses such that your neighbor cannot eavesdrop.
201.
by kikimora 3y ago
This is a highly welcomed feature however, I don’t think AWS has it.
202.
by kikimora 3y ago
A cloud is network and tools, less hardware. For example see this [1] Reddit thread discussing network in Hetzner. Any other bare-metal would have same challenges. Once you solve network security you have to deal with server access. People
203.
by kikimora 3y ago
War enablers have nothing, their families apparently have a lot, somehow. A strict KYC/AML would quickly find connections of their family wealth to Russia, Putin and his regime. However reality is banks forced to go after each and ever
204.
by kikimora 3y ago
You describe a significant minority, but minority nonetheless. This is 50+ generation and they are quickly fading away as their support.
205.
by kikimora 3y ago
I don’t see a calculated decision to not intervene would demonstrate lack of critical thinking.
206.
by kikimora 3y ago
This is #1 topic in Russia right now. Even some state media outlets report on this.
207.
by kikimora 3y ago
Best thing about Lambda it is typically zero maintenance.
208.
by kikimora 3y ago
Never encountered this in the last 5 years working on .NET + Linux system.
209.
by kikimora 3y ago
I don’t know if a similar tool exists but in principle Java and .NET has profiling APIs that let you look into method calls. They can be used as a basis for a similar tool.
210.
by kikimora 3y ago
Of course this can be done in many different ways. The point is with serverless it is much easier to achieve.

More ›