kiratp

11 ms·

121.
by kiratp 3y ago
“No support requests” was non-trivially due to RH’s efforts. Did those people thing that stable OSes just build themselves?
122.
by kiratp 3y ago
Nobody is deploying 3+GB models to iOS beyond some enthusiast “because you can” apps. Amazing tech but not feasible for any mainstream use yet. Eg: https://apps.apple.com/app/id6444050820
123.
by kiratp 3y ago
When hardware is so expensive and so difficult to obtain, performance starts to trump the cost of “single model implementation” pretty quickly. It can be cheaper to deploy Llama.cpp and then foobar.cpp (6 months from now) than it is to have
124.
by kiratp 3y ago
If you’re working with LLMs, just use this - https://github.com/ggerganov/llama.cpp It has Metal support.
125.
by kiratp 3y ago
This all sounds extremely miserable from an end user perspective. We are all going to have 15 app stores on our phones and they will all be sucking up every piece of identifying information they can. The EU is going to ruin app stores like
126.
by kiratp 3y ago
I'll take 3% over having a single payment processor I can't swap out. The change to the Indian economy was going to come through private investment anyway but the government blocked that. So saying the change came because of UPI i
127.
by kiratp 3y ago
India has been enacting regulation enshrining SMS as 2FA for their entire Digital payments infrastructure. They even require storing all biometrics (FaceID etc.) on gov servers and not on-device. We are in for a decade+ of this at minimum.
128.
by kiratp 3y ago
No thank you. This is how you get something like UPI in India. https://news.ycombinator.com/item?id=36980279
129.
by kiratp 3y ago
UPI is a terrible thing. 0) makes every transaction a trivial SQL query away for the government. 1) everything needs an SMS code. Just as we are trying to get everyone off SMS 2FA 2) doesn’t work for non-Indian numbers or roaming devices 3)
130.
by kiratp 3y ago
This is not true in the US, at least in Washington state for example. Honking = speech https://law.justia.com/cases/washington/supreme-court/2011/8...
131.
by kiratp 3y ago
The bar for the AI ecosystem to get models running is git clone + <20 lines of Python. If AMD can’t make that work on consumer GPUs, then the only option they have is to undercut Nvidia so deeply that it makes sense for the big players t
132.
by kiratp 3y ago
Explanation in relatively straightforward form: https://developer.apple.com/wwdc22/10077 Don’t shoot the messenger!
133.
by kiratp 3y ago
If you want high performance inference us this: https://vllm.ai/ For local batch stuff: https://huggingface.co/docs/transformers/main_classes/pipeli...
134.
by kiratp 3y ago
Because it’s not faster. Well at least the 3990x wasn’t. Compilation rapidly drops from parallel to single thread bound for most workloads. https://twitter.com/kiratpandya/status/1457438725680480257
135.
by kiratp 3y ago
https://electrek.co/2019/05/17/tesla-nerfs-autopilot-europe-...
136.
by kiratp 3y ago
People who paid for the FSD package have been given the upgrades for free.
137.
by kiratp 3y ago
The audience is all dreaming of what could have been in another life.
138.
by kiratp 3y ago
https://twitter.com/SendGridSupport/status/16615194199089725... > Ahoy there! We're experiencing a period of maintenance for the SendGrid website (see http://status.sendgrid.com ). You can subsc
139.
by kiratp 3y ago
Concorde was profitable. Accidents + 9/11 pullback killed it. The major factor against supersonic is actually the fact that sonic booms are not allowed over the continental United states. Companies like Boom Supersonic are focussed on
140.
by kiratp 3y ago
I was at Windows Phone (WP7/8 days) when “RCS was just a couple of years away”. Good thing I didn’t hold my breath - it didn’t seem to me then that there was any path to success and I was on my first job as a 20 year old. Google hasn’t
141.
by kiratp 3y ago
You can do it on CPU now. Benchmarks: https://github.com/ggerganov/llama.cpp/issues/34
142.
by kiratp 3y ago
Benchmarks for what you can do on CPU alone. https://github.com/ggerganov/llama.cpp/issues/34 An M1 Max does 100ms per token. A 64 core threadripper about 33ms per token.
143.
by kiratp 3y ago
And here are the benchmarks https://github.com/ggerganov/llama.cpp/issues/34
144.
by kiratp 3y ago
You need roughly (model size + (n * (prompt + generated text)) where n. Is the number of parallel users/ request.
145.
by kiratp 3y ago
Case in point > Rust, cargo build for our "test world binary".: 64 core Threadripper 3990x @ PBO level 3, ~400w, with Optane drive - 1 min 37s M1 Max, 64 GB, on battery @ 30% charge - 1:34s https://twitter.com/k
146.
by kiratp 3y ago
> And our only real change is to find yet another slaver, oh I mean capitalist to work for. Can we please tone down the rhetoric? This is quite disrespectful to the millions who suffered through actual slavery.
147.
by kiratp 3y ago
Same energy as “I pirate stuff because it’s not provided to me exactly when, how and at the exact price I want”. “Information wants to be free!” This entire thread is depressing.
148.
by kiratp 3y ago
That’s not an argument against letting the GUI experience be downloadable from the App Store. You just have to flip a flag.
149.
by kiratp 3y ago
For nothing else than the sake of “life is about the journey”, please consider changing your job. It is absolutely possible to align paid employment with fulfillment.
150.
by kiratp 3y ago
Why not let this be installed on Mac devices via test flight?

More ›