oavdeev

6 ms·

1.
Agentic Metaflow(outerbounds.com)
11 points by oavdeev 1y ago|0 comments
2.
by oavdeev 5y ago
I have once built an interactive calculator[1] for this exact problem, maybe someone else will find it useful too [1] https://observablehq.com/@oavdeev/parallel-task-latency-calc...
3.
How to compute latency of N parallel requests(oavdeev.github.io)
2 points by oavdeev 7y ago|0 comments
4.
Parallel Task Latency Calculator(observablehq.com)
1 points by oavdeev 7y ago|0 comments
5.
by oavdeev 8y ago
Yeah QuickSight is their shot at that market. But (anecdotally) I don't think it getting much traction. The fact that they didn't have any flashy announcements about it at re:Invent this year somewhat corroborates that. There is s
6.
by oavdeev 8y ago
That set of people is not that small; it is basically what people in business analyst roles do all day. They know Excel very well and maybe even a bit of python/js, have a good understanding of the business problem at hand, but not tec
7.
by oavdeev 8y ago
It does; unfortunately they don't have a nice way to just disallow overwrites (that's why I was curious how you implemented that)
8.
by oavdeev 8y ago
How did you do "no overwrite" bit? By enabling versioning?
9.
by oavdeev 8y ago
I suspect it works well for business travellers though; they are not that price sensitive (as long as the fare is within the company policy).
10.
by oavdeev 8y ago
Here's lstopo output for the largest one, for good measure: https://instaguide.io/info.html?type=a1.4xlarge#tab=lstopo though there's nothing terribly surprising.
11.
by oavdeev 8y ago
Here's lstopo output on a 4-core AWS instance to illustrate your point: https://instaguide.io/info.html?type=c5.xlarge#tab=lstopo
12.
by oavdeev 8y ago
If you're using AWS anyway, I think using their managed Postgres / RDS could make this a lot easier operationally. No need for custom syncing/backup scripts, easier to scale the storage up. To the larger point, while I totall
13.
vPMU support on EC2 and the weird case of z1d instance family(oavdeev.github.io)
2 points by oavdeev 8y ago|0 comments
14.
/proc/cpuinfo and CPU topology for all 113 AWS instance types(medium.com)
3 points by oavdeev 8y ago|0 comments
15.
by oavdeev 8y ago
To be fair, AWS gives you bigger discounts for RI than GCP's sustained use. That makes sense; someone gotta pay for the risk. This said, GCPs committed use discounts still seem to be a better deal than convertible RIs. Looking at the r
16.
by oavdeev 8y ago
I mean.. I get it, there isn't a lot to work with, it is a thing that _stores files_ after all, and it most closely resembles a normal filesystem. But it does make GCP's storage product naming even more confusing overall (after &q
17.
by oavdeev 8y ago
So now they have two cloud storage products, called Cloud Firestore and Cloud Filestore? Their branding team is on top of their game, as always.
18.
by oavdeev 8y ago
You're talking about a hypothetical fund with 20/20 hindsight.
19.
by oavdeev 9y ago
Alpine.ai | ML engineer, Full Stack engineer | San Francisco | ONSITE We're well-funded, early stage startup in SF. You have a chance to join our team as one of the founding engineers. Did you know that Amazon Echo is the best selling
20.
by oavdeev 9y ago
Alpine.ai | San Francisco | ML and full stack engineers | ONSITE Did you know that Echo is the best selling product on all of Amazon this holiday season? We're building a platform for conversational product search, to make these 450M v
21.
Trck: querying discrete time series with state machines(tech.adroll.com)
13 points by oavdeev 10y ago|0 comments
22.
by oavdeev 10y ago
We've looked at Airflow. Two main things why we went with Luigi are * time-based and dependency-based scheduling do not mix well in our experience, if you try to do both at the same time you end up with a very complicated execution mod
23.
by oavdeev 10y ago
Yes, schema wise that's pretty close. However, last time I looked that didn't seem like a use case InfluxDB invested a ton of effort optimizing for, especially if you tried to store a lot of separate "event histories" ei
24.
by oavdeev 11y ago
Exact same photo was making rounds in Russian Facebook few weeks ago, judging by the door and the handle I bet it is indeed Moscow, not London. As in this case, no one saw the guy actually skimming cards. Also if he was doing really that, w
25.
by oavdeev 11y ago
This problem definitely existed with official 14.04 (HVM) AMI, though I haven't re-tested this recently, they may have fixed it. It did have some kind of SR-IOV driver but it was too old.
26.
by oavdeev 11y ago
Stock Ubuntu needs SR-IOV driver to get to the actual bandwidth limit on ec2, it makes a lot of difference. We routinely get to ~2 Gbps down from S3 with that setup (using largest instance types). edit: Gbps not GBps
27.
by oavdeev 11y ago
We wrote our own scheduler, called Quentin, which we may opensource. Essentially it is a simple queue that takes care of running containers and managing pools of instances that containers run on by integrating with AWS autoscaling. It is a
28.
by oavdeev 12y ago
Yeah, that's my point: if you're happy with this all-or-nothing logic, you can just use dummy target files. Allowing steps to partially succeed seems like adding quite a lot of complexity, and I'm not sure where it would be b
29.
by oavdeev 12y ago
Multiple outputs are tricky, what you going to do if you run a step and it somehow produces 2 out of 3 expected outputs? I mean, you need a way to decide whether whole thing failed or not, easiest way is indeed to have dummy targets. Anyway
30.
by oavdeev 13y ago
> There's this new idea where you can have an operating system, run the command 'apt-get install foobar', and BAM all of a sudden foobar is installed. Nah dude, that's never gonna fly. See, as mentioned in the top com

More ›