marklit

18 ms·

301.
Discover Hidden Secrets in Git Repos with Rust(blog.jonaylor.xyz)
2 points by marklit 5y ago|0 comments
302.
by marklit 5y ago
The Parquet support, with the ability to handle row groups, skip over data not of interest to a query and aggregations that will likely be 3 orders of magnitude quicker are a pretty unique feature. Also, there's no need to write any co
303.
Actix: A Web Framework for Rust(tech.marksblogg.com)
4 points by marklit 5y ago|0 comments
304.
Rocket: A Web Framework for Rust(tech.marksblogg.com)
5 points by marklit 5y ago|0 comments
305.
Rocket: A Web Framework for Rust(tech.marksblogg.com)
4 points by marklit 5y ago|0 comments
306.
by marklit 5y ago
Feeding the fail2ban log to Papertrail or another logging service should give enough visibility. I've seen fail2ban block the IPv4 of a company's headquarters because a new member of staff setup their SSH config wrong and made too
307.
by marklit 5y ago
Git supports extension-specific overrides which enables things like textual comparison of Office files. https://tech.marksblogg.com/git-track-changes-in-media-offic...
308.
Rocket: A Web Framework for Rust(tech.marksblogg.com)
1 points by marklit 5y ago|0 comments
309.
by marklit 5y ago
Long passwords can cause a DDOS attack as they need to be hashed. Longer the password, longer the hashing takes. Django had to patch this back in 2013: https://github.com/django/django/commit/5ecc0f828ebe270cf
310.
by marklit 5y ago
There are fewer steps to setting up Airflow locally compared to Prefect. There seems to be encouragement with Prefect to use remote servers instead of running things locally. Airflow has been around since late 2014 and has ~800 developers c
311.
Data Fluent for PostgreSQL(github.com)
1 points by marklit 5y ago|0 comments
312.
by marklit 5y ago
It's not about space reduction, it's about handling the small file problem. HDFS can handle up to 500M files without issue but the amount of RAM needed to store the files' metadata starts to go beyond what you'd typicall
313.
by marklit 6y ago
YouTube runs an in-house database called Procella. Its feature set is pretty amazing. Some of the devs behind it came from the Hadoop world. Google published a paper on its architecture. Klepmann's book is still a good read. A lot of t
314.
by marklit 6y ago
I can't comment on native drivers. When I said ODBC-like interfaces I was trying to use a catch-all phrase for sources that look like a typical server-based data store (i.e. PostgreSQL, Hive, Kafka).
315.
by marklit 6y ago
I've been using it for years with clients. It tends to sit in between source data and a final destination. Most data platforms are trying to take data from 10s if not 100s of sources and unify them. The variety of formats and sources i
316.
by marklit 6y ago
Red Bull are a kdb shop: https://youtu.be/QxfdFWKo_pQ I've seen Numpy code slightly blurred out of Mercedes videos on YouTube in the past.
317.
by marklit 6y ago
Dexed, Odin2, VCV Rack, Audacity, Obxd, Helm and Surge are all open source and you can find their code on GitHub. JUCE seems to be the framework used to make most of the above compile across platforms. VCV Rack does a good job at modelling
318.
by marklit 6y ago
Aren't most developers in the world paid a salary or day rate and thus are paid for their time? What incentive is there for them to "hurry up" rather than sandbag?
319.
by marklit 6y ago
Sorry, I just cleaned that paragraph up. Cheers for the heads up.
320.
Working with the Hadoop Distributed File System(tech.marksblogg.com)
1 points by marklit 8y ago|0 comments
321.
Ask HN: What are you using HDFS for?
1 points by marklit 8y ago|0 comments
322.
by marklit 9y ago
I'd have it all under one listing with the job title you're looking to have for the next two years going forward. Put a short list of some of your more well-known clients and then a list of technologies you've worked with tha
323.
by marklit 9y ago
I've avoided going down this rabbit hole. Staff costs can outweigh software and hardware in some cases. Hiring someone that knows kdb+/q could cost a fair bit more than someone who only has some PostgreSQL experience.
324.
by marklit 9y ago
The benchmarks are aimed at OLAP not OLTP workloads. If I had a large query set to run on each vendor I'd be more likely to hit compatibility issues which could mean fewer benchmarks going out. As it is I spend a lot of time getting ha
325.
by marklit 9y ago
Cheers, fixed.
326.
1.1B Taxi Rides with BrytlytDB 2.1 and a 5-node IBM Minsky Cluster(tech.marksblogg.com)
7 points by marklit 9y ago|1 comments
327.
by marklit 9y ago
Does anyone have any experience of negotiating your costs down with Mixpanel? Years ago I remember my CTO ringing up our hosting provider and in the space of a phone call bringing some of our costs down 90%.
328.
by marklit 9y ago
Bottom right-hand corner of every chart has a "headlines" window. Might not be amazing but it is there.
329.
1.1B Taxi Trips on BrytlytDB 2.0(tech.marksblogg.com)
120 points by marklit 9y ago|1 comments
330.
A Minimalist Guide to SQLite(tech.marksblogg.com)
3 points by marklit 9y ago|0 comments

More ›