vii

12 ms·

31.
by vii 6y ago
they also estimate close to a petabyte of RAM; if all the RAM is spent in leaves that is about 6-7GB per leaf. I don't know that we can say it would be unreasonable to have 1 core per leaf replica; presumably some leaves have low utili
32.
by vii 6y ago
Wow great demo clip! Did you try a Sobel filter https://godoc.org/gocv.io/x/gocv#Sobel ? Curious if that could give more contiguous joined up edges than AdaptiveThreshold. From https://github.com/K
33.
by vii 6y ago
If it were just that, then overall the project would be dangerous trap, as there is a big cost of added complexity from the new high level configuration language with its limitations and own terminology (volumes, etc). Adding a wrapper, and
34.
by vii 6y ago
It's not ok to set goals and let people just get on with them. The result of that is the most extraordinary implementations; it's just not possible to lock down requirements clearly enough to have the right outcomes come out witho
35.
by vii 6y ago
The blog post describes him trying to catch up the deficit from vacation days away from the Internet. StackOverflow has done a great job with the points incentives. As noted in this blog, the daily cap on points is important - it's val
36.
by vii 6y ago
This is the paradox of interviewing for senior roles of all kinds: the real work is long term over years and needs careful decision making, but the interview is under an hour. Well structured thought and the ability to communicate and adjus
37.
by vii 6y ago
This study from Cornell attempts to estimate expenses and total costs in Seattle across both platforms https://digitalcommons.ilr.cornell.edu/cgi/viewcontent.cgi?a... Drivers received about $23.50/hr according to
38.
by vii 6y ago
clang also doesn't assume -march=native - just like gcc it makes binaries that can run on machines of the same architecture rather than specialising to the current processor's features. You can see the flags it's using by com
39.
by vii 6y ago
The gold linker and now lld can do LTO pretty fast across huge codebases: this breaks down the techniques used https://archive.fosdem.org/2019/schedule/event/llvm_lld/ Curious that Intel seems to recomme
40.
by vii 6y ago
py.test has a different way of finding tests. It loads Python files starting with "test_" or ending in "_test.py" then uses reflection, to find functions starting with "test_" or classes starting with "Tes
41.
by vii 6y ago
Yes, the network works back from the signed key, which is published last. The TESLA scheme uses a one-way pseudo-random hash function to generate keys, see this paper https://www.esat.kuleuven.be/cosic/publications&#x2F
42.
by vii 6y ago
Assuming you're doing bulk inserts, and can restart the insert on any failure, one tactic is to disable all consistency and durability storage features during the insert. This heavily reduces the IO operations needed and the need to wa
43.
by vii 6y ago
Yes. I linked to it because it touched on BGP optimisation techniques, and illustrates the dangers of automatically passing on each update. Is there a better link to a public postmortem that illustrates these problems in a datacenter contex
44.
by vii 6y ago
This article challenges partisans in the BGP vs OSPF debate but it's deeper than just pointing out that the wire protocol is quite superficial. Obviously, at scale you have to control OSPF to avoid update floods. But BGP also needs to
45.
by vii 6y ago
From the outside, big organisations have massive resources and access to experts. But inside there is intense competition for those resources and people. The people are expensive and there are many opportunities so you need to justify spend
46.
by vii 6y ago
The example of Ulysses S. Grant being the best student in his class for painting makes it clear that acquisition of these so called expiring skills is associated with long term success. The list of non-expiring skills has good intentions bu
47.
by vii 6y ago
The syntax follows https://github.com/krisajenkins/yesql/ which works with Clojure. So then the DB queries can be defined in a language agnostic way, so you don't need a gateway API to access the DB :) There
48.
by vii 6y ago
The plan described there is to use a signal (SIGSYS) to jump back into the process. This involves multiple kernel/userpace switches as most likely you need some Linux syscalls to emulate the MS Windows one. I like the idea of using eBP
49.
by vii 6y ago
The article explains that the primary benefit of user-mode green-thread fibers is not switching speed, but that they are much cheaper than OS threads, so you can have many more of them. The costs are paid in memory usage and also the operat
50.
by vii 6y ago
They made a related project - http://herbgrind.ucsd.edu/ - a tool that can automatically find floating point issues in real programs. You can also annotate the region you're interested in with herbgrind on/off con
51.
by vii 6y ago
Real traffic exposes wrong assumptions in code, which cannot be caught with unit or integration testing. Awesome to automate this kind of testing. I encourage people to invest heavily in setting up artificial environments to replay historic
52.
Gokul's S.P.A.D.E. Toolkit: Square's decision-making framework(coda.io)
5 points by vii 6y ago|1 comments
53.
by vii 6y ago
Perl was the #3 language on the Tiobe ranking in 2005. It had massive codebases in banks and other industries. In 2019 it was ranked #19 and the incompatible replacement, Perl6, is #93. Breaking backwards compatibility is hugely costly. It
54.
by vii 6y ago
Peter Yang's book Principles of Product Management covers this. The roadmap is a set of agreed plans and priorities - the word map is not super helpful here. As remarked in other comments - once the objectives are agreed, the product r
55.
by vii 6y ago
Amazon is offering 24TB RAM high memory machines on AWS. The Stackoverflow setup is far away from Big Iron :) In terms of opportunities to add complexity: I'm surprised there is no mention of a data-platform or any model training for r
56.
by vii 6y ago
This code creates that error by trying to wait in two threads in two loops. If the future is finished, it is fine to wait for it. Having multiple loops waiting for each other is pretty complex to debug. import asyncio import threading
57.
by vii 6y ago
exactly - The problem is that there are three logical states that need three different actions 1. if nothing done yet: start async computation 2. if async computation in progress: wait for it 3. return result as computaton done Atomicity in
58.
by vii 6y ago
The databases I implemented experimented with various ways to compile queries. Turns out that the JVM can run quite fast. I feel like LLVM (Julia) is likely to be able to be better for throughput and definitely better for predictability of
59.
by vii 6y ago
mmap'd databases are really quick to implement. I implemented both row and column orientated databases. The traders and quants loved it - and adoption took off after we built a web interface that let you see a whole day and also zoom i
60.
by vii 6y ago
There are many good points here. Companies depend on in-person proximity for automatically communicating. The article identifies a few cases where remote structures fail, like in responding quickly to new circumstances but it's a more

More ›