kiratp

7 ms·

61.
by kiratp 2y ago
It is the GP’s problem when this coworkers don’t want to work with them again. The tech hubs (SF, Seattle, NYC are pretty small communities.
62.
by kiratp 2y ago
Are you sure you haven't violated the laws of any of the other 190+ countries? sure enough to risk taking another vacation?
63.
by kiratp 2y ago
Current public SOTA seems to be “no congestion control” > We proceeded without DCQCN for our 400G deployments. At this time, we have had over a year of experience with just PFC for flow control, without any other transport-level congesti
64.
by kiratp 2y ago
You’re already paying for it via settlements. Requiring officer-named insurance would create immediate pressure to weed out bad behavior and prevent bad cops from being re-hired one county over.
65.
by kiratp 2y ago
The Bitter Lesson -> http://www.incompleteideas.net/IncIdeas/BitterLesson.html
66.
by kiratp 2y ago
Thank you! This confirms my intuition! Structured generation seems counter to every other signal we have that chain of thought etc improves performance.
67.
by kiratp 2y ago
The peer responses pretty much cover most reasons.
68.
by kiratp 2y ago
As an Indian American, I opt out of this photo scanning and the mm wave scanners (and get a pat down) every single time. The system needs active backpressure.
69.
by kiratp 2y ago
https://theintercept.com/2015/05/27/tsa-body-scanner-lobbyis... https://www.propublica.org/article/tsa-removes-x-ray-body-sc... The whole implementation of these scanners was layers of c
70.
by kiratp 2y ago
> However, a hardware-naive implementation is approximately worthless. This isn’t true when there is one vendor that’s 90% of the market and 2 maybe 3 generations of hardware to consider. Support A100, H100 and you are supporting most of
71.
by kiratp 2y ago
Its really grating to see headlines phrased this way, implying extreme outcomes. To someone not living in a city, it paints an immediate picture of dystopia. It pushes the rural-city divide further - the last thing we need more of.
72.
by kiratp 2y ago
I can’t back up the data in a PWA.
73.
by kiratp 2y ago
IMO if the trade off is cheaper, faster hardware iteration then Nvidia’s strategy makes a lot of sense.
74.
by kiratp 2y ago
By using the drivers you agree to their TOS. So yes, it applies even on your private network.
75.
by kiratp 2y ago
3 year commit pricing with Jetstream + Maxtext on TPU v5e is $0.25 per million tokens. On demand pricing put it at about $0.45 per million tokens. Source: We use TPUs at scale at https://osmos.io Google Next 2024 session going i
76.
by kiratp 2y ago
Nvidia EULA prevents you from using consumer gaming GPUs in datacenters so 4xxx cards are a non-starter for any service usecases EDIT: TOS -> EULA per comments below
77.
by kiratp 2y ago
Jax is the closest thing at the moment. https://developer.apple.com/metal/jax/ And MLX https://github.com/ml-explore/mlx
78.
by kiratp 2y ago
Helicopter rides are pretty much never covered. > The average cost of life flight within the U.S. ranges between $12,000 and $25,000, according to NAIC (National Association of Insurance Commissioners). This is based on a 52-mile trip, w
79.
by kiratp 2y ago
> 2. Small number of activated parameters shine in batch inference case for cloud providers Could you elaborate more please? Batch inference activates pretty much all the experts since token in every sequence in a batch could hit a diffe
80.
by kiratp 2y ago
The technique to use is to give the model an “out” for the missing/negative case. "{text}\n\n###\n\nPlease summarize the text above. The text is a video transcript. It may not have the names of the speakers in it. If you need to r
81.
JetStream – high throughput inference on TPUs(cloud.google.com)
10 points by kiratp 3y ago|0 comments
82.
by kiratp 3y ago
It fascinating to me that coming up on a year since Sapphire Rapids has been available in the public cloud, developers are still targeting AVX512 when they should be targeting VNNI and AMX. https://github.com/ggerganov/
83.
by kiratp 3y ago
> I don't care how much Apple hand holds grandma. Mobile is a hellscape for developers and other companies. As a developer and founder, grandma before developers. Every time. iOS is the first platform my family can just run with sa
84.
by kiratp 3y ago
+1 to this. I’ve been working with their research teams on this and credit due indeed. Some context: https://github.com/ggerganov/llama.cpp/issues/2555#issuecomm... https://github.com/ggergano
85.
by kiratp 3y ago
One thing I firmly believe - the people who will pull this off will be ones who just aren’t willing or able to see all the possible failure paths. Unreasonable optimism is the only path to success at this scale.
86.
by kiratp 3y ago
No Nvidia drivers for MacOS.
87.
by kiratp 3y ago
We should be happy that compute is once again improving and machines are getting outdated rapidly. Which is better - a world where your laptop is competitive for 5+ years but everything stays the same? Or one where entire new realms of adva
88.
by kiratp 3y ago
I guess it comes down to whether your usecase has a single correct answer vs multiple possible ones. For example a lot of what we do has one and only one correct sequence of tokens. Need to look at both but so much of the learning material
89.
by kiratp 3y ago
> For any model, the loss curve going down could mean it’s learning, or could mean it’s overfitting, we don’t know which without looking at validation loss, which is like a second set of test data the model hasn’t seen before. You want t
90.
by kiratp 3y ago
The FAA themselves recommend that foreign pilots do not use visual approaches at SFO. https://www.cbsnews.com/sanfrancisco/news/faa-wants-foreign-...

More ›