kahnjw

8 ms·

31.
by kahnjw 7y ago
I can’t exactly tell what you mean but I think you’re confusing two levels of abstraction here. C++ (or rust) and python already work in harmony to make training efficient. 1. In tensorflow and similar frameworks the Python runtime is used
32.
by kahnjw 7y ago
Latency in training literally does not matter. You care about throughput. In serving, where latency matters, most DL frameworks allow you to serve the model from a highly optimized C++ binary, no python needed. The poster you are replying t
33.
by kahnjw 7y ago
This is just not true. The python runtime is not the bottleneck. DL frameworks are DSLs written on top of piles of highly optimized C++ code that is executed as independently from the python runtime as possible. Optimizing the python or swa
34.
by kahnjw 7y ago
Add to that investor pessimism driving bond yields down or inverting them, a trade war, bad global growth numbers, and investors sucking every last penny out of the stock market while there is still time. That's all you need for a down
35.
by kahnjw 7y ago
I was thinking the exact same thing. Technical debt accrued at a large engineering organization is very similar to bloated infrastructure costs in the US. That also doesn't explain the _why_. My very rough take is that physical (and vi
36.
by kahnjw 7y ago
>Neural nets are infamously incapable of generalising beyond their training dataset In what sense? DNNs can certainly generalize to examples outside the training set. I agree that you get no guarantees on performance for samples drawn fr
37.
by kahnjw 7y ago
Of course. I didn't start out my career thinking I'd solve all the problems a given company has. I think that hero mentality is the reason a lot of startups fail, at least in a technical sense. I always viewed engineering in gener
38.
by kahnjw 7y ago
>I'd say also, I currently perceive Google/Facebook as a place to "slow down". They're big enough and have enough resources to do anything they want, so it seems like there's gonna be a lot of people just ha
39.
by kahnjw 7y ago
This is what I meant, I should have been more clear.
40.
by kahnjw 7y ago
The fields of neuroscience and psychology are far more advanced compared with the infantile field of deep learning. Humans also learn independently from one another which means outlier events aren’t as much of a problem. You have the abilit
41.
by kahnjw 7y ago
>> I'll respond clearly: We're multiple computer vision leaps forward away from what Elon needs for success. They're easily half a decade behind Lidar based systems. And people die as a consequence of putting those syst
42.
by kahnjw 7y ago
No it's just borderline unusable on anything other than a desktop and full of scams.
43.
by kahnjw 7y ago
You could run a smallish linear model on 2kb easily. Definitely not a deep net though.
44.
by kahnjw 7y ago
>EDIT: Ah, I see that Thiel said elsewhere that China already carried out espionage inside Google and hasn't backed this up. That claim is absent from this op-ed but it may be CYA for those comments on his part. I'm sure editor
45.
by kahnjw 7y ago
Context: Thiel originally made this claim in a speech where he claimed Google is committing "treason." [1] Given his "evidence" that's obviously insane. A large fractions of large multinationals have offices in Chin
46.
by kahnjw 7y ago
Pretty unbelievable the times published this opinion piece by Thiel. Without any real evidence to back his claim and given Thiel's past, its hard for me to imagine this isn't him pushing a false narrative for some emotionally char
47.
by kahnjw 7y ago
The only sane way I can map the problem in question onto your analogy is by subletting rent controlled units, thereby increasing their value and decreasing the value of the uncontrolled unit. I don’t think it’s a good analogy because people
48.
by kahnjw 7y ago
>we would like other countries to pay a bit more too and help shoulder the cost of R&D for new drugs and treatments. Allowing reimportation would do exactly that by increasing (from zero) US demand for drugs from foreign markets. EDI
49.
by kahnjw 7y ago
There is ample research supporting the notion that rent control increases prices and gentrifies neighborhoods [1][2][3]... The reason I believe this is economics 101. People want simple solutions to difficult problems. If prices are too hig
50.
by kahnjw 7y ago
The point isn’t about the supply of new construction but rather about supply of open leases. Rent control incentivized renters to stay put thereby reducing supply for potential residents. Limiting supply increases prices which further incen
51.
by kahnjw 7y ago
You're suggesting there is some causal relation here that I'm not sure exists. Desirable cities have housing crises. Those cities implement policies to attempt to abate these crises. Ironically, theory says that restrictions like
52.
by kahnjw 7y ago
This argument can be extended to any market with barrier-to-entry level high fixed cost and low variable cost. That's basically every large tech platform (search, social, ecommerce, cloud).
53.
by kahnjw 7y ago
I keep hearing people say some variation of this without understanding the irony of the statement. A perfectly competitive market means, among other things, that there is zero barrier to market entry. That means you can enter the market wit
54.
by kahnjw 7y ago
My guess is they felt they didn't have a choice. Having worked at a company with a very large AWS bill in the past, they actually listen to what their customers want. I also think it's clear that most cloud-going engineers and dec
55.
by kahnjw 7y ago
> The super perplexing thing is that cloud providers jumped on the kubernetes bandwagon so quickly and this is what made this commoditization possible. Pessimistically speaking, this means either they're either about to butcher the
56.
by kahnjw 7y ago
But then engineer X can't claim the watchtime gains and get promoted.
57.
by kahnjw 7y ago
How do you square that with a security cameras? Do you need to consent every time you enter a space secured by them?
58.
by kahnjw 7y ago
Collaborative editing is very difficult to implement in a pre-existing codebase. Decisions made during the initial design will be prohibitive to just bolting on collaborative editing in the future. To me, xi seems like an aspirational proje
59.
by kahnjw 7y ago
Can Uber count on being the incumbent the way Amazon did? Amazon built up physical logistics infrastructure and a subscription service that serve as a barrier to entry for competitors. Uber's only real market foothold is a network of d
60.
by kahnjw 7y ago
Question: for data keyed by user, did you find you'd actually be better off using an distributed in-process cache than a remote cache? I find that hard to believe but maybe I'm just not up to speed on how advanced these caching so

More ›