cavisne

14 ms·

181.
by cavisne 3y ago
Using the underlying cost, it is not feasible to create a general purpose parallel processor for cheaper than Nvidia. Especially considering the economies of scale. So you basically need to make a bet on a less general purpose accelerator,
182.
by cavisne 3y ago
I wouldn’t think too deeply about it. It’s almost certainly just a prompt “if humans are in the picture make them from diverse backgrounds”.
183.
by cavisne 3y ago
Out of curiosity what’s stopping them cloning existing processes and technology like they do for everything else?
184.
by cavisne 3y ago
You don’t have to go to that level of detail but it is still relevant. For example FlashAttention is built on optimizing for this level of detail.
185.
by cavisne 3y ago
Right, and they don't even need to lower their training margins, since training needs a fancy interconnect they can just ship the same chip at different prices based on interconnect (and are already doing so with the 40xx vs H100).
186.
by cavisne 3y ago
It's a good question. I think fundamentally its because no wants to/can compete with Nvidia when making a general purpose parallel processor. They all want to make something a bit more specialized, so they need to guess what funct
187.
by cavisne 3y ago
Google do have an inference advantage with TPUs. Everyone else needs to pay nvidia margins. Training is murkier as it’s more about the total performance and scalability of the system.
188.
by cavisne 3y ago
I think this fits the intent of EU regulators. The DMA is essentially a tariff on American tech companies. A European company could now fork android and have a locked down App Store with large fees, without complying with DMA (as it only ap
189.
by cavisne 3y ago
Starbucks coffee has a Prop 65 label. It's likely that any domestic toaster would also put one on. The reason for this is the onus is on the company to prove it doesn't have any risky chemicals. The USA is the land of the frivolou
190.
by cavisne 3y ago
I remember (maybe its still like this!) there used to be a page you could go to and see all your alexa voice clips since forever. It's amazing amazon has gone so long not caring about privacy without backlash. EDIT: Yep its still there
191.
by cavisne 3y ago
Need to watch the video still but my assumption was since it’s illegal/frowned upon to advertise gambling, especially to minors. This is just an earth way to put ad… I mean streams of gambling in front of a large audience.
192.
by cavisne 3y ago
No they run on online casino money, the founders own Stake.com
193.
by cavisne 3y ago
This paper from Microsoft [1] is the coolest thing I've seen in this space. Basically workload (deep learning in this case) level optimization to allow jobs to be resized and preempted. [1] https://arxiv.org/pdf/22
194.
by cavisne 3y ago
Steve Coast (OSM founder) on Minds behind Maps [1]. Erik Prince on Shawn Ryan show - the host is a bit cringe but Erik has very unique perspective. My dream podcast for 2024 would be Erik Prince w/ Dwarkesh (someone a bit smarter to pu
195.
by cavisne 3y ago
If the size of the internet is really a bottleneck it seems Google is in quite a strong position. Assuming they have effectively a log of the internet, rather than counting the current state of the internet as usable data we should be think
196.
by cavisne 3y ago
This idea was actually in the launch keynote! Along with a bunch of other cool ideas that never shipped. Maybe someday someone will explain what went wrong. My guess is that competitors were quicker to market than they expected, and had uni
197.
by cavisne 3y ago
I think this would be easily detectable anyway as whatever IP’s they are using would be viewing videos that basically no one ever watches.
198.
by cavisne 3y ago
Nvidia has pretty epic margins in the datacenter space, so some of it will be that. Epic because their software advantage in AI lets them charge a premium, so why bother competing for the absolute cheapest $/FLOPS contract. More genera
199.
by cavisne 3y ago
Even with AMD working on hard on specific benchmarks for marketing purposes they could not get close to peak hardware performance on their brand new chips. https://www.semianalysis.com/p/amd-mi300-performance-faster-...
200.
by cavisne 3y ago
Wow that twitter thread was great, actually diving into the output of these scam organizations. PPP loan data is another great source for finding these scam charities, although most of them dont even have any output to critique.
201.
by cavisne 3y ago
"BI also reported in October 2022 that software engineer salaries at the company (Meta) can reach up to $308,148, not including stock options" Excluding stock options is underselling the compensation at FANG by a lot, as they vest
202.
by cavisne 3y ago
My hunch is that there is some fundamental misunderstanding of what CUDA is and why it works. Its been like 6 years now of well funded attempts to displace CUDA, and there has been very little progress. In fact I'd argue its gone backw
203.
by cavisne 3y ago
I looked a bit more into this program and its all a lot more complicated 1) The money was granted in 2020 based on an inaccurate map (leading starlink & others to get funding for covering places like Target's and major airports) 2)
204.
by cavisne 3y ago
Oversubscription where? ISPs are not buying anywhere near that much transit bandwidth.
205.
by cavisne 3y ago
Starlink is basically a WISP with an actually scalable business model, just the towers (and soon a lot of the backhaul) are up in space. WISPs rely on a local enthusiastic person to make it work.
206.
by cavisne 3y ago
The part of Meta research that worked on LLaMa happened to be based in the Paris office. Then some of the leads left and started Mistral. Complex/simple is not really the right way to think about training these models, I'd say its
207.
by cavisne 3y ago
The timing is potentially clever. Apple has committed to supporting RCS next year, and will face regulatory pressure in places like Europe. Even if short lived they could onboard a lot of Android users and then use RCS once it’s supported.
208.
by cavisne 3y ago
It would require a hardware update for older devices I believe, ie any that don’t have TPMs
209.
by cavisne 3y ago
Super interesting. I’ve seen that as a rumor but never confirmed. It’s an example of the sort of grey area that would’ve made “openai 2.0” tricky at Microsoft. A small startup can ignore ToS and scrape YouTube but Microsoft cannot.
210.
by cavisne 3y ago
Its pretty heartening that among all this drama and activism I've never heard of a users data being maliciously leaked from Google. To me thats the strongest signal that user data is pretty safe at Google (one of the authors points).

More ›