meritt

17 ms·

121.
by meritt 7y ago
Sure, but if performance is the actual issue, then you'd likely pick an even faster and more compact wire format (proto, avro, thrift). I guess the ability to have a schemalass and no type checking format (just like JSON), while enjoyi
122.
by meritt 7y ago
I fail to see the use case too. If you want a compact wire format, there are numerous options (protobufs, avro, thrift, etc) and their size is achieved by storing the data in a compact binary format and the schema separately. With MessagePa
123.
by meritt 7y ago
I disagree. When someone looks at an epidemic that just made landfall a month ago and compares those numbers on an absolute basis to a virus (seasonal flu) that's completely embedded in the fabric of the entire US, and concludes that s
124.
by meritt 7y ago
I look forward to HN's resident statistics gurus to explain how the traditional flu and drunk driving kill more people per year than the paltry 14 deaths in the US and therefore everyone is overreacting. Edit: Apparently my sarcasm was
125.
by meritt 7y ago
> but it seems like you still need a backend Of course. It's just managed by someone else and you often are paying per usage. And you'll find yourself needing to wrangle numerous serverless platforms to actually build out relev
126.
by meritt 7y ago
> by backing out all of our changes and only putting in his changes That so feels like a mistake because that's the sort of tactic that would completely and utterly remove their capability of ever working as a corporate lawyer ever
127.
by meritt 7y ago
> Maybe there's a good reason to have as many services as they do. Or maybe we're in a tech bubble and if you want engineers, you have to acquiesce to their demands of working with the latest shiny tools while they create mount
128.
by meritt 7y ago
You misinterpret my comment as being against databases, when in fact I'm simply against the notion of utilizing a purpose-built OLAP database (Clickhouse) merely as the storage layer for yet another analytical platform (Pandas). In thi
129.
by meritt 7y ago
Where did I suggest storing the data on a local machine? Common usage when using pandas/spark/etc is storing source data in parquet/orc/etc and they fully support data partitioning. That doesn't need to come from a
130.
by meritt 7y ago
Why would you bother using a database like clickhouse to store data if you're just going to analyze it in pandas? Just store it in a csv, parquet, or orc. > As i'm sure things like pivot tables and rolling windows are a PITA in
131.
by meritt 7y ago
I've ran a remote-only company for 8 years and generally struggled to find employees who are suitable working remote. Especially junior employees I've had no luck. The best remote employees I've found are those who tend to be
132.
by meritt 7y ago
https://aws.amazon.com/ec2/pricing/on-demand/#Elastic_IP_Add... Pricing is about the same and it's guaranteed to you, not to a instance that may get shut down
133.
by meritt 7y ago
Fairly new to this topic and coming from a traditional RDBMS background. How do you go about deciding how many rows/records to store per object? And how does Athena/Bigquery know which objects to query? Do people use partitioning
134.
by meritt 7y ago
Amazon ships products from their warehouses, in their packaging, charges credit cards as "Amazon.com", provides customer support, and accepts product returns. This makes it generally indistinguishable to the consumer if they'
135.
by meritt 7y ago
Static site generation is just a trendy reinvention of caching. Put a CDN in front of your site, or run one of the many wordpress cache plugins [1] and point your httpd at the cache directory instead of PHP. [1] https://wordpress
136.
by meritt 7y ago
I didn't vote on the comment but it came across to me as emblematic of what I feel is "wrong" with technology trends over the past decade. Where instead of solving business problems it's mostly building tools on top of t
137.
by meritt 7y ago
It's amusing to me how programmers look back with disdain at web development in the 90s and how "you just uploaded files to a FTP server" and now we've circled back to the same thing, just with a whole lot more plumbing
138.
by meritt 7y ago
I'm also salty. What's your plan? I'm either gonna migrate to git (and use a different host), or self-host something like hetapod.net
139.
by meritt 7y ago
> I'm actually curious why PHP was chosen From the article: "However, by 2015, as VisualEditor and Parsoid matured and became established, maintaining two parallel wikitext engines in perpetuity was untenable" They didn&#x
140.
by meritt 7y ago
We backup data that's not on S3 outside of AWS (code, operational databases), but most of our S3 data is effectively stuck due to the insane export prices. It's not the end of the world if we were to lose everything in S3 anyway.
141.
by meritt 7y ago
Because the rest of my infrastructure currently runs on AWS and aws egress charges are far more expensive than the b2 savings.
142.
by meritt 7y ago
RDS (postgres, mysql, maria) is basically just a managed ec2 instance. The instance cost is about ~2x the comparable price for an ec2 instance, which seems reasonable to me. Storage costs are pretty comparable to EBS. You can do push-button
143.
by meritt 7y ago
I still use bitbucket because I also use mercurial, but they've deprecated that and will only offer git beginning later this year. So, no, I don't know why anyone would use bitbucket at this point.
144.
by meritt 7y ago
> Wow those margins are shockingly thin That's by design. Amazon has found it's far more effective to deploy their excess capital toward company expenditures in the form of acquisitions, real estate, capex, employees, stock buy
145.
by meritt 7y ago
> I wonder what can you do to stop a big company from devouring your share in the SaaS market Make a product that seamlessly integrates with the rest of their ecosystem so they're more likely to acquire you than replace you.
146.
by meritt 7y ago
> to handle the same number of requests/sec you need much more workers, which has a lot of overhead When doing multiprocessing, it's advisable to fork() instead of creating fresh processes (or launching them in containers etc)
147.
Lawmakers Call for Investigation of Fintech Firm Yodlee’s Data Selling(wsj.com)
1 points by meritt 7y ago|0 comments
148.
by meritt 7y ago
Yup, exactly. Kimball's stuff is the best. You can achieve on a modest machine what modern techniques would require an incredibly expensive horizontally scaled MPP database. It does require a lot more planning and forethought to be cer
149.
by meritt 7y ago
Likely too boring and old school data warehousing, but this is what the notion of rollup/aggregate tables achieve. You define a table that's the result of some sort of an aggregation query (time is almost always involved: minutely
150.
by meritt 7y ago
> how they got $75M Justin Kan sold Twitch to Amazon for nearly $1B after 7 years, Socialcam for $60M in 18 months, and Exec for "under $10M" in 2 years. That's how he raised $75M. The company/product was completely i

More ›