atty

7 ms·

31.
by atty 3y ago
I think this is using the OpenAI Whisper repo? If they want a real comparison, they should be comparing MLX to faster-whisper or insanely-fast-whisper on the 4090. Faster whisper runs sequentially, insanely fast whisper batches the audio in
32.
by atty 3y ago
As another commenter pointed out, you can give context for the decoder. So you can feed previous chunks into the model as the context. This is how we do it for streaming, at least.
33.
by atty 3y ago
I think the Ars writer here is very uninformed. Floc is completely different from Topics, and if you actually read the Topics spec, it seems to be significantly better than 3rd party cookies? At least to me. Maybe I’m missing something.
34.
by atty 3y ago
Awesome, thank you for the info! Edit: not awesome that wood is lower quality of course, the awesome was for the explanation.
35.
by atty 3y ago
Is this something that would cause a noticeable difference in quality, or more of an academic one?
36.
by atty 3y ago
That’s a good question and I can’t give a straight answer, because we are actually on three year lease plans through a vendor (think HPE). I know we get a pretty decent deal in general from them since we have basically an entire data center
37.
by atty 3y ago
I think the author has missed a pretty large segment of demand. Non-cloud/non-tech enterprises are also buying large quantities of H100s and A100s for their own machine learning and simulation workloads. Where I work, we are going to h
38.
by atty 3y ago
Holding them hostage? The reddits I’ve been a part of voted to be closed.
39.
by atty 3y ago
It does seem much faster and significantly worse to me - but I haven’t set any repeatable benchmark queries for myself, I suppose I could be imagining it. I hope they bring back the slow version. I don’t care if they have to cut the limit d
40.
by atty 3y ago
I thought SK Hynix was the big producer of HBM? But that could be out of date.
41.
by atty 3y ago
Isn’t that what AWS Outposts are? Leased hardware with a subset of AWS services running on them.
42.
by atty 3y ago
Agreed. I am so trained by macOS that it needs my iCloud password or account password randomly that I don’t even think about it anymore. I like to consider myself a savvy computer user, but I frankly only give myself a 50% chance at best of
43.
by atty 3y ago
I think that’s missing one big piece. What people really want cheap education that ends with a degree that is as well regarded as an Ivy or good state college degree. Community colleges, for better or worse, are seen as inferior education.
44.
by atty 4y ago
I agree that I’m uncomfortable with the consolidation of so much of the HPC stack under Nvidia (and would be 10x more uncomfortable if the ARM acquisition went through), but I don’t think there was really a monopoly there. I think the real
45.
by atty 4y ago
You’re correct, I was going to add on to my answer that this is combined with DDP for a “3D” style parallelism that could specifically benefit from the TPU’s network topology, but by the time I got done fixing all the typos (and still missi
46.
by atty 4y ago
Just as a quick example (there are lots of other examples), I currently am working on a model that does significant tensor-level parallelism. The input to the model is huge, so we replicate the weights for the encoder part of the model over
47.
by atty 4y ago
Apologies for being off topic but does anyone know technically how they’ve implemented their 3 modes (creative balanced and… was it factual?). Is it just adjusting the prompt? Or are they doing something like adjusting the temperature, or f
48.
by atty 4y ago
Beyond the other answers, I’ll point out that pytorch is developing tools that will make doing this work by hand or implementing in a framework much easier. They’re building a native DTensor implementation and testing out SPMD-style distrib
49.
by atty 4y ago
Similar setup here. I use a Mac laptop for all my general purpose work/programming/leisure, Linux servers I ssh into from the Mac for running jobs (ML stuff), and a windows laptop for playing games. Obviously a luxury to be able t
50.
by atty 4y ago
I think I’d switch that from “quickly” to “eventually”, or “have a head start to” - we could get grid independence “relatively” quickly if the government subsidized it (I highly doubt first Gen fusion competes with natural gas or solar cost
51.
by atty 4y ago
I don’t see how Twitter could afford to compete with YouTube financially. YouTube has the larger audience (3x MAU) so they get the best advertising deals, and they STILL don’t break out YouTube’s profit/loss individually, suggesting i
52.
by atty 4y ago
I agree with the spirit of your comment, and I am extremely excited by these results. However, I think the history of fusion has showed us that the cynics have had a much better track record than the fusion optimists, haha. My very uninform
53.
by atty 4y ago
That’s interesting. I have a MacBook for work with no Apple ID and I don’t think I’ve ever been asked to sign into anything. I wonder if there are fleet management controls my company is using to disable a lot of that stuff.
54.
by atty 4y ago
So if I’m parsing the results correctly they only have a single data point per language? Seems like they are testing individual programmers styles/speed just as much as they are testing the languages.
55.
by atty 4y ago
Sorry do you mean IPC (instructions per clock) or is there another term that I’m not aware of?
56.
by atty 4y ago
I’ve never had to use CGAL directly, but indirectly it played a role in my PhD thesis, as a backend for a clustering problem called jet finding in high energy nuclear physics :) always get a little ping of happiness when I see these tools p
57.
by atty 4y ago
As someone who worked at Kroger ~10 years ago, even then credit cards were probably only 60-70% of payments. A lot of cash and checks. The loyalty programs had their start when it wasn’t quite so easy to track purely via payment. Also helps
58.
by atty 4y ago
When dealing with the Schrödinger equation, the eigenvalues are the energy levels of the quantum system.
59.
by atty 4y ago
I find it interesting how many articles and people on HN say something similar. I had basically the opposite thoughts (and outcomes) from my PhD. I loved the 5 years I spent in my program, I learned a ton about super interesting topics, I l
60.
by atty 4y ago
I think there are many factors. First, the Chinese healthcare system is much smaller than western healthcare systems. Combine that with a much larger population and a pandemic and you end up in a bad situation really fast. Secondly, they’ve

More ›